2024-01-24T12:47:01.958 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-24T12:47:01.958 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785 --owner scheduled_vshankar@teuthology --verbose --name vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} -- /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785/orig.config.yaml 2024-01-24T12:47:02.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T12:47:02.078 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785 branch: wip-vshankar-testing1-reef-2024-01-24-1150 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} email: vshankar@redhat.com first_in_suite: false job_id: '7530785' kernel: flavor: default kdb: true sha1: f2d3460408951339ac0933340ad449487c9efddc ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing1-reef-2024-01-24-1150 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing1-reef-2024-01-24-1150 sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4668 sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 sleep_before_teardown: 0 subset: 346/1024 suite: fs suite_branch: wip-vshankar-testing1-reef-2024-01-24-1150 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO6qSF79hcu2xwEl93Due8znq/AJy9oP3qGtTolhJtphDQ0WmLH3kKsrCYfv3HMdsM6Lr166rWQocA8uFWgTums= smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJtR4eptIOjV9QV7L7cywaJkxEyuolirOzoikyj4ghOQi1VZXdGTHIz3vCc7WT4qH2stJ4NJJ63P7UnilU98kuw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: c856e0f9244dd29a50697123b480d63f16a4ed81 timestamp: 2024-01-24_12:12:30 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-24T12:47:02.079 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa; will attempt to use it 2024-01-24T12:47:02.079 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks 2024-01-24T12:47:02.079 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-24T12:47:02.081 INFO:teuthology.task.internal:Checking packages... 2024-01-24T12:47:02.106 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '4e3182a65800aed6d4aa2f6b86da3cfd72188134' 2024-01-24T12:47:02.106 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-24T12:47:02.106 INFO:teuthology.packaging:ref: None 2024-01-24T12:47:02.106 INFO:teuthology.packaging:tag: None 2024-01-24T12:47:02.106 INFO:teuthology.packaging:branch: wip-vshankar-testing1-reef-2024-01-24-1150 2024-01-24T12:47:02.106 INFO:teuthology.packaging:sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T12:47:02.106 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing1-reef-2024-01-24-1150 2024-01-24T12:47:02.244 INFO:teuthology.task.internal:Found packages for ceph version 18.2.1-341-g4e3182a6-1jammy 2024-01-24T12:47:02.245 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-24T12:47:02.251 INFO:teuthology.task.internal:no buildpackages task found 2024-01-24T12:47:02.251 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-24T12:47:02.299 INFO:teuthology.task.internal:Saving configuration 2024-01-24T12:47:02.314 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-24T12:47:02.319 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T12:47:02.345 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 12:40:15.863398', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINgmS42GHguDNQUn9zLvUs05zrqsKI645n+u4syHdsRl'} 2024-01-24T12:47:02.363 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 12:40:15.861614', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBWwLYCzYOe3/LfVm4SXbV19gWXauUuZTtEKxNFJZLvV'} 2024-01-24T12:47:02.363 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-24T12:47:02.369 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-01-24T12:47:02.370 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-01-24T12:47:02.370 INFO:teuthology.run_tasks:Running task console_log... 2024-01-24T12:47:02.428 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1cd54af310>, signals=[15]) 2024-01-24T12:47:02.428 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-24T12:47:02.434 INFO:teuthology.task.internal:Opening connections... 2024-01-24T12:47:02.434 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T12:47:02.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:47:02.523 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T12:47:02.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:47:02.601 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-24T12:47:02.607 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-01-24T12:47:02.613 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-01-24T12:47:02.613 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-01-24T12:47:02.660 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-24T12:47:02.660 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Ubuntu" 2024-01-24T12:47:02.660 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="22.04" 2024-01-24T12:47:02.660 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-24T12:47:02.660 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_CODENAME=jammy 2024-01-24T12:47:02.660 INFO:teuthology.orchestra.run.smithi029.stdout:ID=ubuntu 2024-01-24T12:47:02.660 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE=debian 2024-01-24T12:47:02.661 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-24T12:47:02.661 INFO:teuthology.orchestra.run.smithi029.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-24T12:47:02.661 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-24T12:47:02.661 INFO:teuthology.orchestra.run.smithi029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-24T12:47:02.661 INFO:teuthology.orchestra.run.smithi029.stdout:UBUNTU_CODENAME=jammy 2024-01-24T12:47:02.661 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-01-24T12:47:02.695 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-01-24T12:47:02.700 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-01-24T12:47:02.700 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-01-24T12:47:02.748 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-24T12:47:02.749 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2024-01-24T12:47:02.749 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="22.04" 2024-01-24T12:47:02.749 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-24T12:47:02.749 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=jammy 2024-01-24T12:47:02.749 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2024-01-24T12:47:02.749 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2024-01-24T12:47:02.749 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-24T12:47:02.749 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-24T12:47:02.749 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-24T12:47:02.749 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-24T12:47:02.749 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=jammy 2024-01-24T12:47:02.750 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-01-24T12:47:02.769 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-24T12:47:02.779 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-24T12:47:02.784 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-24T12:47:02.784 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2024-01-24T12:47:02.787 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2024-01-24T12:47:02.795 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-24T12:47:02.801 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-24T12:47:02.801 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2024-01-24T12:47:02.834 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2024-01-24T12:47:02.875 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-24T12:47:02.927 INFO:teuthology.run_tasks:Running task kernel... 2024-01-24T12:47:02.941 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'f2d3460408951339ac0933340ad449487c9efddc'} 2024-01-24T12:47:02.941 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'f2d3460408951339ac0933340ad449487c9efddc'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'f2d3460408951339ac0933340ad449487c9efddc'}}, timeout 300 2024-01-24T12:47:02.942 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-24T12:47:02.942 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-24T12:47:02.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T12:47:02.947 DEBUG:teuthology.task.kernel:sha1 for mon.a is f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T12:47:02.947 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "f2d3460408951339ac0933340ad449487c9efddc"... 2024-01-24T12:47:02.947 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-01-24T12:47:02.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T12:47:02.948 DEBUG:teuthology.task.kernel:sha1 for mon.b is f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T12:47:02.948 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "f2d3460408951339ac0933340ad449487c9efddc"... 2024-01-24T12:47:02.948 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-01-24T12:47:02.992 INFO:teuthology.orchestra.run.smithi029.stdout:5.15.0-56-generic 2024-01-24T12:47:02.993 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T12:47:02.993 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-24T12:47:02.993 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T12:47:03.001 INFO:teuthology.orchestra.run.smithi163.stdout:5.15.0-56-generic 2024-01-24T12:47:03.001 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T12:47:03.001 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-24T12:47:03.001 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T12:47:03.150 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-01-24T12:47:03.151 DEBUG:teuthology.orchestra.run.smithi029:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-24T12:47:03.168 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-24T12:47:03.222 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-01-24T12:47:03.222 DEBUG:teuthology.orchestra.run.smithi163:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-24T12:47:03.236 INFO:teuthology.orchestra.run.smithi163.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-24T12:47:03.311 INFO:teuthology.orchestra.run.smithi029.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-24T12:47:03.311 INFO:teuthology.orchestra.run.smithi029.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-24T12:47:03.311 INFO:teuthology.orchestra.run.smithi029.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-24T12:47:03.311 INFO:teuthology.orchestra.run.smithi029.stderr:hint: 2024-01-24T12:47:03.311 INFO:teuthology.orchestra.run.smithi029.stderr:hint: git config --global init.defaultBranch 2024-01-24T12:47:03.312 INFO:teuthology.orchestra.run.smithi029.stderr:hint: 2024-01-24T12:47:03.312 INFO:teuthology.orchestra.run.smithi029.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-24T12:47:03.312 INFO:teuthology.orchestra.run.smithi029.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-24T12:47:03.312 INFO:teuthology.orchestra.run.smithi029.stderr:hint: 2024-01-24T12:47:03.312 INFO:teuthology.orchestra.run.smithi029.stderr:hint: git branch -m 2024-01-24T12:47:03.312 INFO:teuthology.orchestra.run.smithi029.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-24T12:47:03.314 DEBUG:teuthology.orchestra.run.smithi029:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-24T12:47:03.375 INFO:teuthology.orchestra.run.smithi163.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-24T12:47:03.375 INFO:teuthology.orchestra.run.smithi163.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-24T12:47:03.375 INFO:teuthology.orchestra.run.smithi163.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-24T12:47:03.375 INFO:teuthology.orchestra.run.smithi163.stderr:hint: 2024-01-24T12:47:03.375 INFO:teuthology.orchestra.run.smithi163.stderr:hint: git config --global init.defaultBranch 2024-01-24T12:47:03.375 INFO:teuthology.orchestra.run.smithi163.stderr:hint: 2024-01-24T12:47:03.375 INFO:teuthology.orchestra.run.smithi163.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-24T12:47:03.375 INFO:teuthology.orchestra.run.smithi163.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-24T12:47:03.375 INFO:teuthology.orchestra.run.smithi163.stderr:hint: 2024-01-24T12:47:03.375 INFO:teuthology.orchestra.run.smithi163.stderr:hint: git branch -m 2024-01-24T12:47:03.376 INFO:teuthology.orchestra.run.smithi163.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-24T12:47:03.378 DEBUG:teuthology.orchestra.run.smithi163:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-24T12:47:03.380 DEBUG:teuthology.orchestra.run.smithi029:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-24T12:47:03.438 DEBUG:teuthology.orchestra.run.smithi029:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-24T12:47:03.444 DEBUG:teuthology.orchestra.run.smithi163:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-24T12:47:03.501 DEBUG:teuthology.orchestra.run.smithi163:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-24T12:48:56.509 INFO:teuthology.orchestra.run.smithi163.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-24T12:48:56.509 INFO:teuthology.orchestra.run.smithi163.stderr: * [new branch] main -> origin/main 2024-01-24T12:48:56.541 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20190312 -> 20190312 2024-01-24T12:48:56.541 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20190416 -> 20190416 2024-01-24T12:48:56.542 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20190514 -> 20190514 2024-01-24T12:48:56.542 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20190618 -> 20190618 2024-01-24T12:48:56.542 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20190717 -> 20190717 2024-01-24T12:48:56.542 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20190815 -> 20190815 2024-01-24T12:48:56.542 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20190923 -> 20190923 2024-01-24T12:48:56.542 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20191022 -> 20191022 2024-01-24T12:48:56.542 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20191215 -> 20191215 2024-01-24T12:48:56.545 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20200122 -> 20200122 2024-01-24T12:48:56.545 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20200316 -> 20200316 2024-01-24T12:48:56.545 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20200421 -> 20200421 2024-01-24T12:48:56.545 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20200519 -> 20200519 2024-01-24T12:48:56.545 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20200619 -> 20200619 2024-01-24T12:48:56.545 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20200721 -> 20200721 2024-01-24T12:48:56.545 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20200817 -> 20200817 2024-01-24T12:48:56.545 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20200918 -> 20200918 2024-01-24T12:48:56.545 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20201022 -> 20201022 2024-01-24T12:48:56.545 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20201118 -> 20201118 2024-01-24T12:48:56.545 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20201218 -> 20201218 2024-01-24T12:48:56.545 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20210208 -> 20210208 2024-01-24T12:48:56.545 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20210315 -> 20210315 2024-01-24T12:48:56.545 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20210511 -> 20210511 2024-01-24T12:48:56.546 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20210716 -> 20210716 2024-01-24T12:48:56.546 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20210818 -> 20210818 2024-01-24T12:48:56.546 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20210919 -> 20210919 2024-01-24T12:48:56.546 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20211027 -> 20211027 2024-01-24T12:48:56.546 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20211216 -> 20211216 2024-01-24T12:48:56.546 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20220209 -> 20220209 2024-01-24T12:48:56.546 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20220310 -> 20220310 2024-01-24T12:48:56.546 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20220411 -> 20220411 2024-01-24T12:48:56.549 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20220509 -> 20220509 2024-01-24T12:48:56.549 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20220610 -> 20220610 2024-01-24T12:48:56.549 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20220708 -> 20220708 2024-01-24T12:48:56.549 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20220815 -> 20220815 2024-01-24T12:48:56.549 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20220913 -> 20220913 2024-01-24T12:48:56.549 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20221012 -> 20221012 2024-01-24T12:48:56.549 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20221109 -> 20221109 2024-01-24T12:48:56.549 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20221214 -> 20221214 2024-01-24T12:48:56.550 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20230117 -> 20230117 2024-01-24T12:48:56.550 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20230210 -> 20230210 2024-01-24T12:48:56.550 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20230310 -> 20230310 2024-01-24T12:48:56.550 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20230404 -> 20230404 2024-01-24T12:48:56.550 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20230515 -> 20230515 2024-01-24T12:48:56.550 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20230625 -> 20230625 2024-01-24T12:48:56.550 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20230804 -> 20230804 2024-01-24T12:48:56.550 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20230919 -> 20230919 2024-01-24T12:48:56.550 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20231030 -> 20231030 2024-01-24T12:48:56.550 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20231111 -> 20231111 2024-01-24T12:48:56.550 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20231211 -> 20231211 2024-01-24T12:48:56.550 INFO:teuthology.orchestra.run.smithi163.stderr: * [new tag] 20240115 -> 20240115 2024-01-24T12:48:57.689 INFO:teuthology.orchestra.run.smithi029.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-24T12:48:57.689 INFO:teuthology.orchestra.run.smithi029.stderr: * [new branch] main -> origin/main 2024-01-24T12:48:57.723 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20190312 -> 20190312 2024-01-24T12:48:57.723 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20190416 -> 20190416 2024-01-24T12:48:57.723 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20190514 -> 20190514 2024-01-24T12:48:57.723 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20190618 -> 20190618 2024-01-24T12:48:57.724 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20190717 -> 20190717 2024-01-24T12:48:57.724 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20190815 -> 20190815 2024-01-24T12:48:57.724 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20190923 -> 20190923 2024-01-24T12:48:57.724 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20191022 -> 20191022 2024-01-24T12:48:57.724 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20191215 -> 20191215 2024-01-24T12:48:57.724 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20200122 -> 20200122 2024-01-24T12:48:57.724 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20200316 -> 20200316 2024-01-24T12:48:57.728 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20200421 -> 20200421 2024-01-24T12:48:57.728 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20200519 -> 20200519 2024-01-24T12:48:57.729 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20200619 -> 20200619 2024-01-24T12:48:57.729 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20200721 -> 20200721 2024-01-24T12:48:57.729 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20200817 -> 20200817 2024-01-24T12:48:57.729 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20200918 -> 20200918 2024-01-24T12:48:57.729 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20201022 -> 20201022 2024-01-24T12:48:57.729 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20201118 -> 20201118 2024-01-24T12:48:57.729 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20201218 -> 20201218 2024-01-24T12:48:57.729 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20210208 -> 20210208 2024-01-24T12:48:57.729 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20210315 -> 20210315 2024-01-24T12:48:57.729 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20210511 -> 20210511 2024-01-24T12:48:57.729 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20210716 -> 20210716 2024-01-24T12:48:57.729 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20210818 -> 20210818 2024-01-24T12:48:57.730 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20210919 -> 20210919 2024-01-24T12:48:57.730 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20211027 -> 20211027 2024-01-24T12:48:57.730 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20211216 -> 20211216 2024-01-24T12:48:57.730 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20220209 -> 20220209 2024-01-24T12:48:57.730 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20220310 -> 20220310 2024-01-24T12:48:57.730 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20220411 -> 20220411 2024-01-24T12:48:57.730 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20220509 -> 20220509 2024-01-24T12:48:57.730 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20220610 -> 20220610 2024-01-24T12:48:57.730 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20220708 -> 20220708 2024-01-24T12:48:57.730 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20220815 -> 20220815 2024-01-24T12:48:57.730 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20220913 -> 20220913 2024-01-24T12:48:57.730 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20221012 -> 20221012 2024-01-24T12:48:57.730 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20221109 -> 20221109 2024-01-24T12:48:57.731 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20221214 -> 20221214 2024-01-24T12:48:57.731 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20230117 -> 20230117 2024-01-24T12:48:57.731 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20230210 -> 20230210 2024-01-24T12:48:57.731 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20230310 -> 20230310 2024-01-24T12:48:57.731 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20230404 -> 20230404 2024-01-24T12:48:57.731 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20230515 -> 20230515 2024-01-24T12:48:57.731 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20230625 -> 20230625 2024-01-24T12:48:57.731 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20230804 -> 20230804 2024-01-24T12:48:57.732 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20230919 -> 20230919 2024-01-24T12:48:57.732 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20231030 -> 20231030 2024-01-24T12:48:57.732 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20231111 -> 20231111 2024-01-24T12:48:57.732 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20231211 -> 20231211 2024-01-24T12:48:57.732 INFO:teuthology.orchestra.run.smithi029.stderr: * [new tag] 20240115 -> 20240115 2024-01-24T12:49:00.620 INFO:teuthology.orchestra.run.smithi163.stderr:Updating files: 50% (1732/3429) Updating files: 51% (1749/3429) Updating files: 52% (1784/3429) Updating files: 53% (1818/3429) Updating files: 54% (1852/3429) Updating files: 55% (1886/3429) Updating files: 56% (1921/3429) Updating files: 57% (1955/3429) Updating files: 58% (1989/3429) Updating files: 59% (2024/3429) Updating files: 60% (2058/3429) Updating files: 61% (2092/3429) Updating files: 62% (2126/3429) Updating files: 63% (2161/3429) Updating files: 64% (2195/3429) Updating files: 64% (2226/3429) Updating files: 65% (2229/3429) Updating files: 66% (2264/3429) Updating files: 67% (2298/3429) Updating files: 68% (2332/3429) Updating files: 69% (2367/3429) Updating files: 70% (2401/3429) Updating files: 71% (2435/3429) Updating files: 72% (2469/3429) Updating files: 73% (2504/3429) Updating files: 74% (2538/3429) Updating files: 75% (2572/3429) Updating files: 76% (2607/3429) Updating files: 77% (2641/3429) Updating files: 78% (2675/3429) Updating files: 79% (2709/3429) Updating files: 80% (2744/3429) Updating files: 81% (2778/3429) Updating files: 81% (2790/3429) Updating files: 82% (2812/3429) Updating files: 83% (2847/3429) Updating files: 84% (2881/3429) Updating files: 85% (2915/3429) Updating files: 86% (2949/3429) Updating files: 87% (2984/3429) Updating files: 88% (3018/3429) Updating files: 89% (3052/3429) Updating files: 90% (3087/3429) Updating files: 91% (3121/3429) Updating files: 92% (3155/3429) Updating files: 93% (3189/3429) Updating files: 94% (3224/3429) Updating files: 95% (3258/3429) Updating files: 96% (3292/3429) Updating files: 96% (3310/3429) Updating files: 97% (3327/3429) Updating files: 98% (3361/3429) Updating files: 99% (3395/3429) Updating files: 100% (3429/3429) Updating files: 100% (3429/3429), done. 2024-01-24T12:49:00.625 INFO:teuthology.orchestra.run.smithi163.stdout:HEAD is now at 39adc8bd Merge branch 'robot/pr-0-1706036629' into 'main' 2024-01-24T12:49:00.645 INFO:teuthology.task.kernel:Downloading kernel f2d3460408951339ac0933340ad449487c9efddc on mon.b... 2024-01-24T12:49:00.645 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T12:49:00.790 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gf2d346040895/ 2024-01-24T12:49:00.791 DEBUG:teuthology.orchestra.run.smithi163:> rm -f /tmp/linux-image.deb && echo linux-image-6.7.0-gf2d346040895_6.7.0-gf2d346040895-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gf2d346040895/ --input-file=- 2024-01-24T12:49:00.793 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi163.front.sepia.ceph.com to complete... 2024-01-24T12:49:02.018 INFO:teuthology.orchestra.run.smithi029.stderr:Updating files: 49% (1681/3429) Updating files: 50% (1715/3429) Updating files: 51% (1749/3429) Updating files: 52% (1784/3429) Updating files: 53% (1818/3429) Updating files: 54% (1852/3429) Updating files: 55% (1886/3429) Updating files: 56% (1921/3429) Updating files: 57% (1955/3429) Updating files: 58% (1989/3429) Updating files: 59% (2024/3429) Updating files: 60% (2058/3429) Updating files: 61% (2092/3429) Updating files: 62% (2126/3429) Updating files: 63% (2161/3429) Updating files: 63% (2183/3429) Updating files: 64% (2195/3429) Updating files: 65% (2229/3429) Updating files: 66% (2264/3429) Updating files: 67% (2298/3429) Updating files: 68% (2332/3429) Updating files: 69% (2367/3429) Updating files: 70% (2401/3429) Updating files: 71% (2435/3429) Updating files: 72% (2469/3429) Updating files: 73% (2504/3429) Updating files: 74% (2538/3429) Updating files: 75% (2572/3429) Updating files: 76% (2607/3429) Updating files: 76% (2621/3429) Updating files: 77% (2641/3429) Updating files: 78% (2675/3429) Updating files: 79% (2709/3429) Updating files: 80% (2744/3429) Updating files: 81% (2778/3429) Updating files: 82% (2812/3429) Updating files: 83% (2847/3429) Updating files: 83% (2864/3429) Updating files: 84% (2881/3429) Updating files: 85% (2915/3429) Updating files: 86% (2949/3429) Updating files: 87% (2984/3429) Updating files: 88% (3018/3429) Updating files: 89% (3052/3429) Updating files: 90% (3087/3429) Updating files: 91% (3121/3429) Updating files: 92% (3155/3429) Updating files: 93% (3189/3429) Updating files: 94% (3224/3429) Updating files: 95% (3258/3429) Updating files: 96% (3292/3429) Updating files: 97% (3327/3429) Updating files: 98% (3361/3429) Updating files: 99% (3395/3429) Updating files: 100% (3429/3429) Updating files: 100% (3429/3429), done. 2024-01-24T12:49:02.024 INFO:teuthology.orchestra.run.smithi029.stdout:HEAD is now at 39adc8bd Merge branch 'robot/pr-0-1706036629' into 'main' 2024-01-24T12:49:02.044 INFO:teuthology.task.kernel:Downloading kernel f2d3460408951339ac0933340ad449487c9efddc on mon.a... 2024-01-24T12:49:02.044 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T12:49:02.271 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gf2d346040895/ 2024-01-24T12:49:02.271 DEBUG:teuthology.orchestra.run.smithi029:> rm -f /tmp/linux-image.deb && echo linux-image-6.7.0-gf2d346040895_6.7.0-gf2d346040895-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gf2d346040895/ --input-file=- 2024-01-24T12:49:02.273 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi029.front.sepia.ceph.com to complete... 2024-01-24T12:49:04.273 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24 12:49:04 URL:https://1.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gf2d346040895/linux-image-6.7.0-gf2d346040895_6.7.0-gf2d346040895-1_amd64.deb [39079350/39079350] -> "/tmp/linux-image.deb" [1] 2024-01-24T12:49:04.273 INFO:teuthology.orchestra.run.smithi163.stderr:FINISHED --2024-01-24 12:49:04-- 2024-01-24T12:49:04.273 INFO:teuthology.orchestra.run.smithi163.stderr:Total wall clock time: 3.4s 2024-01-24T12:49:04.273 INFO:teuthology.orchestra.run.smithi163.stderr:Downloaded: 1 files, 37M in 3.1s (11.9 MB/s) 2024-01-24T12:49:04.277 INFO:teuthology.task.kernel:Installing kernel f2d3460408951339ac0933340ad449487c9efddc on mon.b... 2024-01-24T12:49:04.277 DEBUG:teuthology.orchestra.run.smithi163:> sudo dpkg -i /tmp/linux-image.deb 2024-01-24T12:49:04.585 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-image-6.7.0-gf2d346040895. 2024-01-24T12:49:05.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24 12:49:05 URL:https://1.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gf2d346040895/linux-image-6.7.0-gf2d346040895_6.7.0-gf2d346040895-1_amd64.deb [39079350/39079350] -> "/tmp/linux-image.deb" [1] 2024-01-24T12:49:05.168 INFO:teuthology.orchestra.run.smithi029.stderr:FINISHED --2024-01-24 12:49:05-- 2024-01-24T12:49:05.168 INFO:teuthology.orchestra.run.smithi029.stderr:Total wall clock time: 2.9s 2024-01-24T12:49:05.169 INFO:teuthology.orchestra.run.smithi029.stderr:Downloaded: 1 files, 37M in 2.6s (14.1 MB/s) 2024-01-24T12:49:05.172 INFO:teuthology.task.kernel:Installing kernel f2d3460408951339ac0933340ad449487c9efddc on mon.a... 2024-01-24T12:49:05.173 DEBUG:teuthology.orchestra.run.smithi029:> sudo dpkg -i /tmp/linux-image.deb 2024-01-24T12:49:05.467 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-image-6.7.0-gf2d346040895. 2024-01-24T12:49:06.581 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-24T12:49:06.586 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-24T12:49:06.694 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-image-6.7.0-gf2d346040895 (6.7.0-gf2d346040895-1) ... 2024-01-24T12:49:08.517 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-24T12:49:08.524 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-24T12:49:08.646 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-image-6.7.0-gf2d346040895 (6.7.0-gf2d346040895-1) ... 2024-01-24T12:49:09.859 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-image-6.7.0-gf2d346040895 (6.7.0-gf2d346040895-1) ... 2024-01-24T12:49:09.971 INFO:teuthology.orchestra.run.smithi163.stderr:update-initramfs: Generating /boot/initrd.img-6.7.0-gf2d346040895 2024-01-24T12:49:12.576 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-image-6.7.0-gf2d346040895 (6.7.0-gf2d346040895-1) ... 2024-01-24T12:49:12.736 INFO:teuthology.orchestra.run.smithi029.stderr:update-initramfs: Generating /boot/initrd.img-6.7.0-gf2d346040895 2024-01-24T12:49:31.126 INFO:teuthology.orchestra.run.smithi163.stderr:Sourcing file `/etc/default/grub' 2024-01-24T12:49:31.145 INFO:teuthology.orchestra.run.smithi163.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-24T12:49:31.164 INFO:teuthology.orchestra.run.smithi163.stderr:Generating grub configuration file ... 2024-01-24T12:49:31.431 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-6.7.0-gf2d346040895 2024-01-24T12:49:31.451 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-6.7.0-gf2d346040895 2024-01-24T12:49:31.756 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-24T12:49:31.765 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-24T12:49:31.834 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-24T12:49:31.840 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-24T12:49:31.978 INFO:teuthology.orchestra.run.smithi163.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-24T12:49:31.978 INFO:teuthology.orchestra.run.smithi163.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-24T12:49:31.978 INFO:teuthology.orchestra.run.smithi163.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-24T12:49:32.017 INFO:teuthology.orchestra.run.smithi163.stderr:done 2024-01-24T12:49:32.195 DEBUG:teuthology.orchestra.run.smithi163:> dpkg-deb -c /tmp/linux-image.deb 2024-01-24T12:49:32.202 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./ 2024-01-24T12:49:32.203 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./boot/ 2024-01-24T12:49:32.203 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 4444641 2024-01-24 04:16 ./boot/System.map-6.7.0-gf2d346040895 2024-01-24T12:49:32.214 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 170154 2024-01-24 04:16 ./boot/config-6.7.0-gf2d346040895 2024-01-24T12:49:32.215 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11441152 2024-01-24 04:16 ./boot/vmlinuz-6.7.0-gf2d346040895 2024-01-24T12:49:32.235 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/ 2024-01-24T12:49:32.235 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/ 2024-01-24T12:49:32.235 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/postinst.d/ 2024-01-24T12:49:32.235 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/postrm.d/ 2024-01-24T12:49:32.235 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/preinst.d/ 2024-01-24T12:49:32.235 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/prerm.d/ 2024-01-24T12:49:32.235 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/ 2024-01-24T12:49:32.236 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/ 2024-01-24T12:49:32.236 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/ 2024-01-24T12:49:32.236 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/ 2024-01-24T12:49:32.236 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/ 2024-01-24T12:49:32.236 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/ 2024-01-24T12:49:32.236 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/ 2024-01-24T12:49:32.236 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 490353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-24T12:49:32.236 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-24T12:49:32.236 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-24T12:49:32.236 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-24T12:49:32.236 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 93121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-24T12:49:32.236 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 106737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-24T12:49:32.236 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 152249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-24T12:49:32.237 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-24T12:49:32.237 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-24T12:49:32.237 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 83897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-24T12:49:32.237 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-24T12:49:32.237 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 47233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-24T12:49:32.238 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 47217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-24T12:49:32.238 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 51809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-24T12:49:32.238 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-24T12:49:32.239 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 42537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-24T12:49:32.239 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 58593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-24T12:49:32.239 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 50505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-24T12:49:32.239 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-24T12:49:32.239 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-24T12:49:32.239 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/ 2024-01-24T12:49:32.239 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/ 2024-01-24T12:49:32.239 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/mce/ 2024-01-24T12:49:32.239 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 40121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-24T12:49:32.239 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpuid.ko 2024-01-24T12:49:32.239 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/msr.ko 2024-01-24T12:49:32.239 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/ 2024-01-24T12:49:32.239 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 353745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-24T12:49:32.239 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 881681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-24T12:49:32.240 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 2276777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm.ko 2024-01-24T12:49:32.312 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/ 2024-01-24T12:49:32.312 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 53729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/af_alg.ko 2024-01-24T12:49:32.312 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/algif_hash.ko 2024-01-24T12:49:32.312 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/algif_skcipher.ko 2024-01-24T12:49:32.312 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/ansi_cprng.ko 2024-01-24T12:49:32.312 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/anubis.ko 2024-01-24T12:49:32.312 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/arc4.ko 2024-01-24T12:49:32.312 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/asymmetric_keys/ 2024-01-24T12:49:32.312 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-24T12:49:32.312 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/ 2024-01-24T12:49:32.312 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_memcpy.ko 2024-01-24T12:49:32.313 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_pq.ko 2024-01-24T12:49:32.313 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-24T12:49:32.313 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_tx.ko 2024-01-24T12:49:32.313 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_xor.ko 2024-01-24T12:49:32.313 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/raid6test.ko 2024-01-24T12:49:32.313 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/authenc.ko 2024-01-24T12:49:32.313 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/authencesn.ko 2024-01-24T12:49:32.313 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/blake2b_generic.ko 2024-01-24T12:49:32.313 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/blowfish_common.ko 2024-01-24T12:49:32.313 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/blowfish_generic.ko 2024-01-24T12:49:32.313 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 38817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/camellia_generic.ko 2024-01-24T12:49:32.313 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast5_generic.ko 2024-01-24T12:49:32.313 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast6_generic.ko 2024-01-24T12:49:32.313 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast_common.ko 2024-01-24T12:49:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/ccm.ko 2024-01-24T12:49:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cmac.ko 2024-01-24T12:49:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/crc32_generic.ko 2024-01-24T12:49:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 47777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cryptd.ko 2024-01-24T12:49:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_engine.ko 2024-01-24T12:49:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_simd.ko 2024-01-24T12:49:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_user.ko 2024-01-24T12:49:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cts.ko 2024-01-24T12:49:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/des_generic.ko 2024-01-24T12:49:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/dh_generic.ko 2024-01-24T12:49:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/echainiv.ko 2024-01-24T12:49:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/essiv.ko 2024-01-24T12:49:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/fcrypt.ko 2024-01-24T12:49:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/khazad.ko 2024-01-24T12:49:32.315 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/lrw.ko 2024-01-24T12:49:32.315 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/lz4.ko 2024-01-24T12:49:32.315 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/lz4hc.ko 2024-01-24T12:49:32.315 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/md4.ko 2024-01-24T12:49:32.315 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/michael_mic.ko 2024-01-24T12:49:32.315 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/pcbc.ko 2024-01-24T12:49:32.315 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/pcrypt.ko 2024-01-24T12:49:32.315 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/rmd160.ko 2024-01-24T12:49:32.315 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/seed.ko 2024-01-24T12:49:32.315 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/serpent_generic.ko 2024-01-24T12:49:32.315 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 149489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/tcrypt.ko 2024-01-24T12:49:32.315 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/tea.ko 2024-01-24T12:49:32.315 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/twofish_common.ko 2024-01-24T12:49:32.315 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/twofish_generic.ko 2024-01-24T12:49:32.316 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/vmac.ko 2024-01-24T12:49:32.316 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/wp512.ko 2024-01-24T12:49:32.316 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/xcbc.ko 2024-01-24T12:49:32.316 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/xor.ko 2024-01-24T12:49:32.316 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/xts.ko 2024-01-24T12:49:32.316 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/xxhash_generic.ko 2024-01-24T12:49:32.316 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ 2024-01-24T12:49:32.316 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/ 2024-01-24T12:49:32.316 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_extlog.ko 2024-01-24T12:49:32.316 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-24T12:49:32.316 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_pad.ko 2024-01-24T12:49:32.316 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/apei/ 2024-01-24T12:49:32.316 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/apei/einj.ko 2024-01-24T12:49:32.316 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/ec_sys.ko 2024-01-24T12:49:32.317 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/platform_profile.ko 2024-01-24T12:49:32.317 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/sbs.ko 2024-01-24T12:49:32.317 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/sbshc.ko 2024-01-24T12:49:32.317 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 104745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/video.ko 2024-01-24T12:49:32.317 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ 2024-01-24T12:49:32.317 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/acard-ahci.ko 2024-01-24T12:49:32.317 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 89657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ahci.ko 2024-01-24T12:49:32.317 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ahci_platform.ko 2024-01-24T12:49:32.317 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 88409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/libahci.ko 2024-01-24T12:49:32.317 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/libahci_platform.ko 2024-01-24T12:49:32.317 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_acpi.ko 2024-01-24T12:49:32.317 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ali.ko 2024-01-24T12:49:32.317 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_amd.ko 2024-01-24T12:49:32.317 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_artop.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_atiixp.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_atp867x.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cmd640.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cmd64x.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cypress.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_efar.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt366.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt37x.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_it8213.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_it821x.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_jmicron.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 51489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_legacy.ko 2024-01-24T12:49:32.318 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_marvell.ko 2024-01-24T12:49:32.319 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_mpiix.ko 2024-01-24T12:49:32.319 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_netcell.ko 2024-01-24T12:49:32.319 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ninja32.ko 2024-01-24T12:49:32.319 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ns87410.ko 2024-01-24T12:49:32.319 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ns87415.ko 2024-01-24T12:49:32.319 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_oldpiix.ko 2024-01-24T12:49:32.319 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_opti.ko 2024-01-24T12:49:32.319 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_optidma.ko 2024-01-24T12:49:32.319 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pcmcia.ko 2024-01-24T12:49:32.319 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-24T12:49:32.319 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-24T12:49:32.319 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_piccolo.ko 2024-01-24T12:49:32.319 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_radisys.ko 2024-01-24T12:49:32.319 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_rdc.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_rz1000.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sch.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_serverworks.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sil680.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sl82c105.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_triflex.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_via.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pdc_adma.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_inic162x.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 83353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_mv.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 70401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_nv.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_promise.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_qstor.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sil.ko 2024-01-24T12:49:32.320 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 38345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sil24.ko 2024-01-24T12:49:32.321 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sis.ko 2024-01-24T12:49:32.321 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_svw.ko 2024-01-24T12:49:32.321 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 44801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sx4.ko 2024-01-24T12:49:32.321 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_uli.ko 2024-01-24T12:49:32.321 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_via.ko 2024-01-24T12:49:32.321 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_vsc.ko 2024-01-24T12:49:32.321 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/auxdisplay/ 2024-01-24T12:49:32.321 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/auxdisplay/ks0108.ko 2024-01-24T12:49:32.321 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/bcma/ 2024-01-24T12:49:32.321 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 124545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/bcma/bcma.ko 2024-01-24T12:49:32.321 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/ 2024-01-24T12:49:32.321 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/aoe/ 2024-01-24T12:49:32.321 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 113785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/aoe/aoe.ko 2024-01-24T12:49:32.321 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/drbd/ 2024-01-24T12:49:32.322 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 965377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/drbd/drbd.ko 2024-01-24T12:49:32.322 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 173361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/floppy.ko 2024-01-24T12:49:32.322 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/mtip32xx/ 2024-01-24T12:49:32.322 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 94305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-24T12:49:32.322 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 116329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/nbd.ko 2024-01-24T12:49:32.322 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/null_blk/ 2024-01-24T12:49:32.322 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 110745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/null_blk/null_blk.ko 2024-01-24T12:49:32.322 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 98289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/pktcdvd.ko 2024-01-24T12:49:32.322 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 263777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/rbd.ko 2024-01-24T12:49:32.322 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkback/ 2024-01-24T12:49:32.322 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 98193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-24T12:49:32.322 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/zram/ 2024-01-24T12:49:32.322 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 60225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/zram/zram.ko 2024-01-24T12:49:32.322 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/applicom.ko 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hangcheck-timer.ko 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/ 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/via-rng.ko 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 148617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 139369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 70977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-24T12:49:32.323 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 53521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-24T12:49:32.324 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/lp.ko 2024-01-24T12:49:32.324 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/mwave/ 2024-01-24T12:49:32.324 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 84121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/mwave/mwave.ko 2024-01-24T12:49:32.324 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/nvram.ko 2024-01-24T12:49:32.324 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ppdev.ko 2024-01-24T12:49:32.324 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 51121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tlclk.ko 2024-01-24T12:49:32.324 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/ 2024-01-24T12:49:32.324 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-24T12:49:32.324 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-24T12:49:32.324 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-24T12:49:32.324 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-24T12:49:32.324 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-24T12:49:32.324 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-24T12:49:32.324 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-24T12:49:32.325 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/xillybus/ 2024-01-24T12:49:32.325 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-24T12:49:32.325 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 50953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-24T12:49:32.325 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-24T12:49:32.325 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/ 2024-01-24T12:49:32.325 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/clk-palmas.ko 2024-01-24T12:49:32.325 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 47769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/clk-si5351.ko 2024-01-24T12:49:32.325 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/clk-twl6040.ko 2024-01-24T12:49:32.325 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/clk-wm831x.ko 2024-01-24T12:49:32.325 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/ 2024-01-24T12:49:32.325 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-24T12:49:32.325 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-24T12:49:32.325 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-24T12:49:32.325 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ 2024-01-24T12:49:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ 2024-01-24T12:49:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 70777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-24T12:49:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 246913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ccp.ko 2024-01-24T12:49:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/ 2024-01-24T12:49:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/ 2024-01-24T12:49:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-24T12:49:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 517297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-24T12:49:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-24T12:49:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-24T12:49:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/padlock-aes.ko 2024-01-24T12:49:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/padlock-sha.ko 2024-01-24T12:49:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/virtio/ 2024-01-24T12:49:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 70257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-24T12:49:32.326 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dca/ 2024-01-24T12:49:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dca/dca.ko 2024-01-24T12:49:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ 2024-01-24T12:49:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/dw/ 2024-01-24T12:49:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-24T12:49:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ioat/ 2024-01-24T12:49:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 122593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-24T12:49:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/ 2024-01-24T12:49:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 79961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/amd64_edac.ko 2024-01-24T12:49:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/e752x_edac.ko 2024-01-24T12:49:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 63625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/edac_mce_amd.ko 2024-01-24T12:49:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i3000_edac.ko 2024-01-24T12:49:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i3200_edac.ko 2024-01-24T12:49:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i5100_edac.ko 2024-01-24T12:49:32.327 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i5400_edac.ko 2024-01-24T12:49:32.328 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i7300_edac.ko 2024-01-24T12:49:32.328 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 52049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i7core_edac.ko 2024-01-24T12:49:32.328 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i82975x_edac.ko 2024-01-24T12:49:32.328 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/ie31200_edac.ko 2024-01-24T12:49:32.328 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 56833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/sb_edac.ko 2024-01-24T12:49:32.328 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/x38_edac.ko 2024-01-24T12:49:32.328 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/ 2024-01-24T12:49:32.328 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-gpio.ko 2024-01-24T12:49:32.328 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-max14577.ko 2024-01-24T12:49:32.328 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-max77693.ko 2024-01-24T12:49:32.328 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-max8997.ko 2024-01-24T12:49:32.328 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-palmas.ko 2024-01-24T12:49:32.328 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-24T12:49:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-24T12:49:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/ 2024-01-24T12:49:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-24T12:49:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/efi/ 2024-01-24T12:49:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-24T12:49:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-24T12:49:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/ 2024-01-24T12:49:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-24T12:49:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-24T12:49:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-arizona.ko 2024-01-24T12:49:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-da9052.ko 2024-01-24T12:49:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-da9055.ko 2024-01-24T12:49:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-dln2.ko 2024-01-24T12:49:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 77857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-generic.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-ich.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-kempld.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-max7300.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-max730x.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-max732x.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 47209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-sch.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-24T12:49:32.330 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-24T12:49:32.331 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-24T12:49:32.331 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-24T12:49:32.331 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-24T12:49:32.331 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-vx855.ko 2024-01-24T12:49:32.331 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-24T12:49:32.331 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-24T12:49:32.331 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-24T12:49:32.331 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/ 2024-01-24T12:49:32.331 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-a4tech.ko 2024-01-24T12:49:32.331 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-apple.ko 2024-01-24T12:49:32.331 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-appleir.ko 2024-01-24T12:49:32.331 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-aureal.ko 2024-01-24T12:49:32.331 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-axff.ko 2024-01-24T12:49:32.331 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-belkin.ko 2024-01-24T12:49:32.332 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-cherry.ko 2024-01-24T12:49:32.332 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-chicony.ko 2024-01-24T12:49:32.332 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 60769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-cp2112.ko 2024-01-24T12:49:32.332 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-cypress.ko 2024-01-24T12:49:32.332 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-dr.ko 2024-01-24T12:49:32.332 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-elecom.ko 2024-01-24T12:49:32.332 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-elo.ko 2024-01-24T12:49:32.332 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-emsff.ko 2024-01-24T12:49:32.332 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-ezkey.ko 2024-01-24T12:49:32.332 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gaff.ko 2024-01-24T12:49:32.332 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-generic.ko 2024-01-24T12:49:32.332 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gt683r.ko 2024-01-24T12:49:32.332 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gyration.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtekff.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-hyperv.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-icade.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-kensington.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-keytouch.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-kye.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lcpower.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-led.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 42953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lenovo.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lg-g15.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 58081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 100657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-24T12:49:32.333 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 81025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-magicmouse.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-microsoft.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-monterey.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 50281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-multitouch.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-ntrig.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-ortek.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-penmount.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-petalynx.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 72969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-picolcd.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-pl.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-plantronics.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-primax.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-rmi.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-24T12:49:32.334 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-common.ko 2024-01-24T12:49:32.335 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-24T12:49:32.335 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-24T12:49:32.335 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-24T12:49:32.335 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-24T12:49:32.335 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-24T12:49:32.335 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-24T12:49:32.335 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-24T12:49:32.335 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-24T12:49:32.335 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-24T12:49:32.335 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat.ko 2024-01-24T12:49:32.335 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-saitek.ko 2024-01-24T12:49:32.335 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-samsung.ko 2024-01-24T12:49:32.335 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-24T12:49:32.335 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sjoy.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 51257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sony.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-speedlink.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-steelseries.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sunplus.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-tivo.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-tmff.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-topseed.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-twinhan.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 71097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-uclogic.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-waltop.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 143497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-wiimote.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-xinmo.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-zpff.ko 2024-01-24T12:49:32.336 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-zydacron.ko 2024-01-24T12:49:32.337 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 269313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid.ko 2024-01-24T12:49:32.337 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/uhid.ko 2024-01-24T12:49:32.337 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/usbhid/ 2024-01-24T12:49:32.337 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 125801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-24T12:49:32.337 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-24T12:49:32.337 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-24T12:49:32.337 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 217889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/wacom.ko 2024-01-24T12:49:32.337 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/ 2024-01-24T12:49:32.337 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 64209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_balloon.ko 2024-01-24T12:49:32.337 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 89649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_utils.ko 2024-01-24T12:49:32.337 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 305361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_vmbus.ko 2024-01-24T12:49:32.337 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ 2024-01-24T12:49:32.337 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 66529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/abituguru.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 61401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/abituguru3.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ad7414.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ad7418.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adc128d818.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1025.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 97985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1026.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1029.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 45561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1031.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm9240.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ads7828.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7410.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7411.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 74417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7462.ko 2024-01-24T12:49:32.338 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7470.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 69409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7475.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7x10.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/amc6821.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 55209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/applesmc.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 49921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asb100.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 58625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asc7621.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 40833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/atxp1.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/coretemp.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 44449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 99609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/dme1737.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ds1621.ko 2024-01-24T12:49:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ds620.ko 2024-01-24T12:49:32.340 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc1403.ko 2024-01-24T12:49:32.340 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc2103.ko 2024-01-24T12:49:32.340 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc6w201.ko 2024-01-24T12:49:32.340 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 66993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f71805f.ko 2024-01-24T12:49:32.340 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 94697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f71882fg.ko 2024-01-24T12:49:32.340 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 41409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f75375s.ko 2024-01-24T12:49:32.340 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/fam15h_power.ko 2024-01-24T12:49:32.340 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 55457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/fschmd.ko 2024-01-24T12:49:32.340 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/g760a.ko 2024-01-24T12:49:32.340 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/g762.ko 2024-01-24T12:49:32.340 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 46809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/gl518sm.ko 2024-01-24T12:49:32.340 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 45537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/gl520sm.ko 2024-01-24T12:49:32.340 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/hih6130.ko 2024-01-24T12:49:32.340 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-24T12:49:32.341 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/i5500_temp.ko 2024-01-24T12:49:32.341 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/i5k_amb.ko 2024-01-24T12:49:32.341 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ibmaem.ko 2024-01-24T12:49:32.341 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ibmpex.ko 2024-01-24T12:49:32.341 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ina209.ko 2024-01-24T12:49:32.341 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ina2xx.ko 2024-01-24T12:49:32.341 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 130457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/it87.ko 2024-01-24T12:49:32.341 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/jc42.ko 2024-01-24T12:49:32.341 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/k10temp.ko 2024-01-24T12:49:32.341 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/k8temp.ko 2024-01-24T12:49:32.341 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lineage-pem.ko 2024-01-24T12:49:32.341 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 48609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm63.ko 2024-01-24T12:49:32.341 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm73.ko 2024-01-24T12:49:32.341 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm75.ko 2024-01-24T12:49:32.342 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm77.ko 2024-01-24T12:49:32.342 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm78.ko 2024-01-24T12:49:32.342 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm80.ko 2024-01-24T12:49:32.342 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm83.ko 2024-01-24T12:49:32.342 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 72841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm85.ko 2024-01-24T12:49:32.342 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 46161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm87.ko 2024-01-24T12:49:32.342 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm90.ko 2024-01-24T12:49:32.342 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm92.ko 2024-01-24T12:49:32.342 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 108849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm93.ko 2024-01-24T12:49:32.342 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95234.ko 2024-01-24T12:49:32.342 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95241.ko 2024-01-24T12:49:32.342 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95245.ko 2024-01-24T12:49:32.342 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc2945.ko 2024-01-24T12:49:32.342 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4151.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4215.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4222.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4245.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4260.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4261.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max16065.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max1619.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max1668.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max197.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6639.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6650.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6697.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/mcp3021.ko 2024-01-24T12:49:32.343 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-24T12:49:32.344 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 44161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6683.ko 2024-01-24T12:49:32.344 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 119697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6775-core.ko 2024-01-24T12:49:32.344 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 60241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6775.ko 2024-01-24T12:49:32.344 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 59745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct7802.ko 2024-01-24T12:49:32.344 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 82345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pc87360.ko 2024-01-24T12:49:32.344 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 54441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pc87427.ko 2024-01-24T12:49:32.344 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pcf8591.ko 2024-01-24T12:49:32.344 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ 2024-01-24T12:49:32.344 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-24T12:49:32.344 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-24T12:49:32.344 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-24T12:49:32.344 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-24T12:49:32.344 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-24T12:49:32.345 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-24T12:49:32.345 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-24T12:49:32.345 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 82585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-24T12:49:32.345 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-24T12:49:32.345 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-24T12:49:32.345 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-24T12:49:32.345 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-24T12:49:32.345 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/powr1220.ko 2024-01-24T12:49:32.345 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch5627.ko 2024-01-24T12:49:32.345 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch5636.ko 2024-01-24T12:49:32.345 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-24T12:49:32.345 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sht15.ko 2024-01-24T12:49:32.345 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sht21.ko 2024-01-24T12:49:32.345 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/shtc1.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 40113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sis5595.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47b397.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47m1.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47m192.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/thmc50.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp102.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp103.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp401.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp421.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/via-cputemp.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 41953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/via686a.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 52465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/vt1211.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 51553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/vt8231.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 57457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83627ehf.ko 2024-01-24T12:49:32.346 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 78833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83627hf.ko 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 71353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83781d.ko 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 63233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83791d.ko 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 71329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83792d.ko 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 101481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83793.ko 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 119513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83795.ko 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83l785ts.ko 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83l786ng.ko 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/ 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/ 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/ 2024-01-24T12:49:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-24T12:49:32.348 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-24T12:49:32.348 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-24T12:49:32.348 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-24T12:49:32.348 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-24T12:49:32.348 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-24T12:49:32.348 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-24T12:49:32.348 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 6937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-24T12:49:32.348 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-24T12:49:32.348 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 50409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-24T12:49:32.348 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-24T12:49:32.348 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-24T12:49:32.348 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-24T12:49:32.348 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 62689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 47897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 47249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-24T12:49:32.349 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 47665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-mux.ko 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-smbus.ko 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-stub.ko 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/muxes/ 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-24T12:49:32.350 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 273625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 883809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_core.ko 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 69281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 324433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 97937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 282617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 66145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/ 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 493273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx4/ 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 420625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-24T12:49:32.351 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx5/ 2024-01-24T12:49:32.352 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 741577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-24T12:49:32.352 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mthca/ 2024-01-24T12:49:32.352 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 296977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-24T12:49:32.352 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-24T12:49:32.352 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 153825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-24T12:49:32.352 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/usnic/ 2024-01-24T12:49:32.352 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 169017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-24T12:49:32.352 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ 2024-01-24T12:49:32.352 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-24T12:49:32.352 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 263129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-24T12:49:32.352 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/iser/ 2024-01-24T12:49:32.352 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 100377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-24T12:49:32.352 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/isert/ 2024-01-24T12:49:32.352 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 111433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-24T12:49:32.353 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srp/ 2024-01-24T12:49:32.353 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 128761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-24T12:49:32.353 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srpt/ 2024-01-24T12:49:32.353 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 129537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-24T12:49:32.353 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/ 2024-01-24T12:49:32.353 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/evbug.ko 2024-01-24T12:49:32.353 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/ff-memless.ko 2024-01-24T12:49:32.353 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/ 2024-01-24T12:49:32.353 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-24T12:49:32.353 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-24T12:49:32.353 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 41249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/gameport.ko 2024-01-24T12:49:32.353 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 41809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/joydev.ko 2024-01-24T12:49:32.353 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/ 2024-01-24T12:49:32.353 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/lm8323.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/lm8333.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-24T12:49:32.354 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/qt1070.ko 2024-01-24T12:49:32.355 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/qt2160.ko 2024-01-24T12:49:32.355 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-24T12:49:32.355 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/stowaway.ko 2024-01-24T12:49:32.355 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-24T12:49:32.355 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-24T12:49:32.355 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-24T12:49:32.355 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-24T12:49:32.355 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-24T12:49:32.355 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/matrix-keymap.ko 2024-01-24T12:49:32.355 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/ 2024-01-24T12:49:32.355 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/appletouch.ko 2024-01-24T12:49:32.355 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/bcm5974.ko 2024-01-24T12:49:32.355 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 123441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/cyapatp.ko 2024-01-24T12:49:32.355 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 89465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-24T12:49:32.356 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-24T12:49:32.356 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 336017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/psmouse.ko 2024-01-24T12:49:32.356 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/sermouse.ko 2024-01-24T12:49:32.356 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-24T12:49:32.356 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-24T12:49:32.356 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-24T12:49:32.356 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/rmi4/ 2024-01-24T12:49:32.356 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 109921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-24T12:49:32.356 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/ 2024-01-24T12:49:32.356 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/altera_ps2.ko 2024-01-24T12:49:32.356 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/arc_ps2.ko 2024-01-24T12:49:32.356 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/ct82c710.ko 2024-01-24T12:49:32.356 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-24T12:49:32.357 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/parkbd.ko 2024-01-24T12:49:32.357 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/pcips2.ko 2024-01-24T12:49:32.357 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/ps2mult.ko 2024-01-24T12:49:32.357 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/serio_raw.ko 2024-01-24T12:49:32.357 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/serport.ko 2024-01-24T12:49:32.357 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/sparse-keymap.ko 2024-01-24T12:49:32.357 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/ 2024-01-24T12:49:32.357 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-88pm860x.ko 2024-01-24T12:49:32.357 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-adp5520.ko 2024-01-24T12:49:32.357 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 59761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-bd2802.ko 2024-01-24T12:49:32.357 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-blinkm.ko 2024-01-24T12:49:32.357 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-da903x.ko 2024-01-24T12:49:32.357 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-da9052.ko 2024-01-24T12:49:32.357 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-gpio.ko 2024-01-24T12:49:32.358 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm3530.ko 2024-01-24T12:49:32.358 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm3533.ko 2024-01-24T12:49:32.358 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm355x.ko 2024-01-24T12:49:32.358 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm3642.ko 2024-01-24T12:49:32.358 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lp3944.ko 2024-01-24T12:49:32.358 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lp8788.ko 2024-01-24T12:49:32.358 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-max8997.ko 2024-01-24T12:49:32.358 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-mc13783.ko 2024-01-24T12:49:32.358 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-24T12:49:32.358 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-pca9532.ko 2024-01-24T12:49:32.358 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-pca955x.ko 2024-01-24T12:49:32.358 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-pca963x.ko 2024-01-24T12:49:32.358 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-ss4200.ko 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-tca6507.ko 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-wm8350.ko 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/ 2024-01-24T12:49:32.359 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/bcache/ 2024-01-24T12:49:32.360 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 647281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/bcache/bcache.ko 2024-01-24T12:49:32.360 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 40593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-bio-prison.ko 2024-01-24T12:49:32.360 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 93417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-bufio.ko 2024-01-24T12:49:32.360 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 47537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-cache-smq.ko 2024-01-24T12:49:32.360 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 155921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-cache.ko 2024-01-24T12:49:32.360 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 107265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-crypt.ko 2024-01-24T12:49:32.360 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-delay.ko 2024-01-24T12:49:32.360 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 53865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-era.ko 2024-01-24T12:49:32.360 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-flakey.ko 2024-01-24T12:49:32.360 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 41545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-log-userspace.ko 2024-01-24T12:49:32.360 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-log.ko 2024-01-24T12:49:32.360 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 49553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-mirror.ko 2024-01-24T12:49:32.360 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 78041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-multipath.ko 2024-01-24T12:49:32.361 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-queue-length.ko 2024-01-24T12:49:32.361 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 71081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-raid.ko 2024-01-24T12:49:32.361 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-region-hash.ko 2024-01-24T12:49:32.361 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-round-robin.ko 2024-01-24T12:49:32.361 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-service-time.ko 2024-01-24T12:49:32.361 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 109553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-snapshot.ko 2024-01-24T12:49:32.361 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-switch.ko 2024-01-24T12:49:32.361 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 181873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-thin-pool.ko 2024-01-24T12:49:32.361 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 52081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-verity.ko 2024-01-24T12:49:32.361 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-zero.ko 2024-01-24T12:49:32.361 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/faulty.ko 2024-01-24T12:49:32.361 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/linear.ko 2024-01-24T12:49:32.361 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/multipath.ko 2024-01-24T12:49:32.361 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/persistent-data/ 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 199985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid0.ko 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 113009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid1.ko 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 158665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid10.ko 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 393793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid456.ko 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/ 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/ 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 178145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptbase.ko 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 63329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptctl.ko 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 46345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptfc.ko 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptlan.ko 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 123329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptsas.ko 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 81017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptscsih.ko 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 52961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptspi.ko 2024-01-24T12:49:32.362 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/ 2024-01-24T12:49:32.363 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/88pm800.ko 2024-01-24T12:49:32.363 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/88pm805.ko 2024-01-24T12:49:32.363 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/88pm80x.ko 2024-01-24T12:49:32.363 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/arizona-i2c.ko 2024-01-24T12:49:32.363 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 123745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/arizona.ko 2024-01-24T12:49:32.363 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/bcm590xx.ko 2024-01-24T12:49:32.363 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-24T12:49:32.363 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/dln2.ko 2024-01-24T12:49:32.363 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/janz-cmodio.ko 2024-01-24T12:49:32.363 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 53593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/kempld-core.ko 2024-01-24T12:49:32.363 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lm3533-core.ko 2024-01-24T12:49:32.363 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-24T12:49:32.363 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lp3943.ko 2024-01-24T12:49:32.363 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 57065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lpc_ich.ko 2024-01-24T12:49:32.364 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lpc_sch.ko 2024-01-24T12:49:32.364 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/max8907.ko 2024-01-24T12:49:32.364 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-24T12:49:32.364 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-24T12:49:32.364 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/menf21bmc.ko 2024-01-24T12:49:32.364 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-24T12:49:32.364 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-24T12:49:32.364 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/pcf50633.ko 2024-01-24T12:49:32.364 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-24T12:49:32.364 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/retu-mfd.ko 2024-01-24T12:49:32.364 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 80449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/si476x-core.ko 2024-01-24T12:49:32.364 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 48465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/sm501.ko 2024-01-24T12:49:32.364 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-24T12:49:32.364 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 51145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/tps65010.ko 2024-01-24T12:49:32.365 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/tps6507x.ko 2024-01-24T12:49:32.365 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/viperboard.ko 2024-01-24T12:49:32.365 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/vx855.ko 2024-01-24T12:49:32.365 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/wl1273-core.ko 2024-01-24T12:49:32.365 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 44361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/wm8994.ko 2024-01-24T12:49:32.365 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ 2024-01-24T12:49:32.365 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-24T12:49:32.365 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 48497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ad525x_dpot.ko 2024-01-24T12:49:32.365 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/altera-stapl/ 2024-01-24T12:49:32.365 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 46609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-24T12:49:32.365 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/apds9802als.ko 2024-01-24T12:49:32.365 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/apds990x.ko 2024-01-24T12:49:32.365 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 45601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/bh1770glc.ko 2024-01-24T12:49:32.365 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/c2port/ 2024-01-24T12:49:32.366 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-24T12:49:32.366 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/c2port/core.ko 2024-01-24T12:49:32.366 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/cb710/ 2024-01-24T12:49:32.366 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/cb710/cb710.ko 2024-01-24T12:49:32.366 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ds1682.ko 2024-01-24T12:49:32.366 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/dummy-irq.ko 2024-01-24T12:49:32.366 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/echo/ 2024-01-24T12:49:32.366 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/echo/echo.ko 2024-01-24T12:49:32.366 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/ 2024-01-24T12:49:32.366 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 38793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/at24.ko 2024-01-24T12:49:32.366 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-24T12:49:32.366 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/max6875.ko 2024-01-24T12:49:32.366 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/enclosure.ko 2024-01-24T12:49:32.366 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/genwqe/ 2024-01-24T12:49:32.367 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 152233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-24T12:49:32.367 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/hmc6352.ko 2024-01-24T12:49:32.367 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/hpilo.ko 2024-01-24T12:49:32.367 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ibmasm/ 2024-01-24T12:49:32.367 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 72657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-24T12:49:32.367 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ics932s401.ko 2024-01-24T12:49:32.367 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/isl29003.ko 2024-01-24T12:49:32.367 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/isl29020.ko 2024-01-24T12:49:32.367 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/ 2024-01-24T12:49:32.367 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 42521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-24T12:49:32.367 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-24T12:49:32.367 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/ 2024-01-24T12:49:32.367 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 125961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei-me.ko 2024-01-24T12:49:32.367 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 56537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei-txe.ko 2024-01-24T12:49:32.368 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 313689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei.ko 2024-01-24T12:49:32.368 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/phantom.ko 2024-01-24T12:49:32.368 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ti-st/ 2024-01-24T12:49:32.368 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 74393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-24T12:49:32.368 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tifm_7xx1.ko 2024-01-24T12:49:32.368 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tifm_core.ko 2024-01-24T12:49:32.368 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tsl2550.ko 2024-01-24T12:49:32.368 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 48449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_balloon.ko 2024-01-24T12:49:32.368 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_vmci/ 2024-01-24T12:49:32.368 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 183665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-24T12:49:32.368 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ 2024-01-24T12:49:32.368 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/bonding/ 2024-01-24T12:49:32.368 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 490897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/bonding/bonding.ko 2024-01-24T12:49:32.368 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/ 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/b53/ 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 106041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 40321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 455153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dummy.ko 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/eql.ko 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/ 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 45793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 42113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 130561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 68857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-24T12:49:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/ 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 59697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 99057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/adaptec/ 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 54529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/agere/ 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 69145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/alteon/ 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 59593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/altera/ 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 41577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/ 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 54617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-24T12:49:32.370 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 49297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-24T12:49:32.371 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 87305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-24T12:49:32.371 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/ 2024-01-24T12:49:32.371 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-24T12:49:32.371 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 97361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-24T12:49:32.371 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-24T12:49:32.371 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 102513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-24T12:49:32.371 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-24T12:49:32.371 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 90369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-24T12:49:32.371 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-24T12:49:32.371 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 81577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-24T12:49:32.371 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 69641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-24T12:49:32.371 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/ 2024-01-24T12:49:32.371 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 78409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-24T12:49:32.371 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 176769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-24T12:49:32.372 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-24T12:49:32.372 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 1421585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-24T12:49:32.442 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 128577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-24T12:49:32.442 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-24T12:49:32.443 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 131353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-24T12:49:32.443 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 314561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-24T12:49:32.443 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/ 2024-01-24T12:49:32.443 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-24T12:49:32.443 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 323793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-24T12:49:32.443 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/ 2024-01-24T12:49:32.443 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-24T12:49:32.443 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 193545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-24T12:49:32.443 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-24T12:49:32.443 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 347313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-24T12:49:32.443 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-24T12:49:32.443 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 1044921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-24T12:49:32.443 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-24T12:49:32.444 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 166209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-24T12:49:32.444 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-24T12:49:32.444 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-24T12:49:32.444 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/ 2024-01-24T12:49:32.444 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-24T12:49:32.444 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 204417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-24T12:49:32.444 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/ 2024-01-24T12:49:32.444 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-24T12:49:32.444 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 69457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-24T12:49:32.444 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 61497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-24T12:49:32.444 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 141273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-24T12:49:32.444 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 51505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-24T12:49:32.444 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 62825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-24T12:49:32.444 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-24T12:49:32.445 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/ 2024-01-24T12:49:32.445 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 60881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-24T12:49:32.445 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 62841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-24T12:49:32.445 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 45729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dnet.ko 2024-01-24T12:49:32.445 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-24T12:49:32.445 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/ 2024-01-24T12:49:32.445 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-24T12:49:32.445 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 281161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-24T12:49:32.445 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 49489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ethoc.ko 2024-01-24T12:49:32.445 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 51745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/fealnx.ko 2024-01-24T12:49:32.445 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/fujitsu/ 2024-01-24T12:49:32.445 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 45353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-24T12:49:32.445 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ 2024-01-24T12:49:32.445 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 90377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-24T12:49:32.446 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-24T12:49:32.446 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 295505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-24T12:49:32.446 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-24T12:49:32.446 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 584553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-24T12:49:32.446 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-24T12:49:32.446 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 246273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-24T12:49:32.446 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-24T12:49:32.446 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 937761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-24T12:49:32.446 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-24T12:49:32.446 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 287345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-24T12:49:32.446 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igb/ 2024-01-24T12:49:32.446 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 514617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-24T12:49:32.446 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-24T12:49:32.446 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 93521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-24T12:49:32.447 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-24T12:49:32.447 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 734457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-24T12:49:32.447 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-24T12:49:32.447 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 151793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-24T12:49:32.447 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 86929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/jme.ko 2024-01-24T12:49:32.447 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/ 2024-01-24T12:49:32.447 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-24T12:49:32.447 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 102297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-24T12:49:32.447 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 122609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-24T12:49:32.447 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/ 2024-01-24T12:49:32.447 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-24T12:49:32.447 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 727585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-24T12:49:32.447 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 279017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-24T12:49:32.447 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-24T12:49:32.448 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-24T12:49:32.448 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 1118433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-24T12:49:32.448 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ 2024-01-24T12:49:32.448 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 53113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-24T12:49:32.448 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 41049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-24T12:49:32.448 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-24T12:49:32.448 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 95673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-24T12:49:32.448 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/ 2024-01-24T12:49:32.448 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-24T12:49:32.448 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 108657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-24T12:49:32.448 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/ 2024-01-24T12:49:32.448 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 73449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-24T12:49:32.448 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 47785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-24T12:49:32.448 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/neterion/ 2024-01-24T12:49:32.449 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 150913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-24T12:49:32.449 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/nvidia/ 2024-01-24T12:49:32.449 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 136729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-24T12:49:32.449 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/ 2024-01-24T12:49:32.449 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 50489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-24T12:49:32.449 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 43153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-24T12:49:32.449 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/ 2024-01-24T12:49:32.449 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-24T12:49:32.449 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 227929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-24T12:49:32.449 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 87113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-24T12:49:32.449 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-24T12:49:32.449 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 672009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-24T12:49:32.449 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rdc/ 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 43025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/ 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 67393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 83993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 192369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/samsung/ 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 104289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sfc/ 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 1064929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/silan/ 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 47105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/ 2024-01-24T12:49:32.450 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 54825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-24T12:49:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 63345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-24T12:49:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/ 2024-01-24T12:49:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 61545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-24T12:49:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 67201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-24T12:49:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 73417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-24T12:49:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 68185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-24T12:49:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/ 2024-01-24T12:49:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-24T12:49:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-24T12:49:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-24T12:49:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-24T12:49:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 487729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-24T12:49:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/ 2024-01-24T12:49:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 103345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-24T12:49:32.452 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 166105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-24T12:49:32.452 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 66337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-24T12:49:32.452 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 78817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-24T12:49:32.452 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/tehuti/ 2024-01-24T12:49:32.452 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 50065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-24T12:49:32.452 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ti/ 2024-01-24T12:49:32.452 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 86537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-24T12:49:32.452 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/ 2024-01-24T12:49:32.452 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 80281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-24T12:49:32.452 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 83801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-24T12:49:32.452 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/ 2024-01-24T12:49:32.452 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 46225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-24T12:49:32.452 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-24T12:49:32.453 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/xircom/ 2024-01-24T12:49:32.453 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 60001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-24T12:49:32.453 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/fddi/ 2024-01-24T12:49:32.453 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 41009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/fddi/defxx.ko 2024-01-24T12:49:32.453 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/fddi/skfp/ 2024-01-24T12:49:32.453 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 217073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-24T12:49:32.453 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 74577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/geneve.ko 2024-01-24T12:49:32.453 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/hyperv/ 2024-01-24T12:49:32.453 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 236257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-24T12:49:32.453 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ieee802154/ 2024-01-24T12:49:32.453 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-24T12:49:32.453 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ifb.ko 2024-01-24T12:49:32.453 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ipvlan/ 2024-01-24T12:49:32.453 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 85833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 62777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/macvlan.ko 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/macvtap.ko 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/ 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio.ko 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mii.ko 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 45097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/netconsole.ko 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/nlmon.ko 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/ 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-24T12:49:32.454 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/ 2024-01-24T12:49:32.455 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/amd.ko 2024-01-24T12:49:32.455 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 50041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-24T12:49:32.455 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 44729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-24T12:49:32.455 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm87xx.ko 2024-01-24T12:49:32.455 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 44865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/broadcom.ko 2024-01-24T12:49:32.455 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/cicada.ko 2024-01-24T12:49:32.455 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/davicom.ko 2024-01-24T12:49:32.455 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/et1011c.ko 2024-01-24T12:49:32.455 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/icplus.ko 2024-01-24T12:49:32.455 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/lxt.ko 2024-01-24T12:49:32.455 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 82057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/marvell.ko 2024-01-24T12:49:32.455 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 76417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/micrel.ko 2024-01-24T12:49:32.455 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/national.ko 2024-01-24T12:49:32.455 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 95569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/phylink.ko 2024-01-24T12:49:32.456 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/qsemi.ko 2024-01-24T12:49:32.456 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 50073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/realtek.ko 2024-01-24T12:49:32.456 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/smsc.ko 2024-01-24T12:49:32.456 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/ste10Xp.ko 2024-01-24T12:49:32.456 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/vitesse.ko 2024-01-24T12:49:32.456 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/plip/ 2024-01-24T12:49:32.456 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 43513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/plip/plip.ko 2024-01-24T12:49:32.456 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ 2024-01-24T12:49:32.456 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-24T12:49:32.456 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_async.ko 2024-01-24T12:49:32.456 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-24T12:49:32.456 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-24T12:49:32.456 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-24T12:49:32.457 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 42857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pppoe.ko 2024-01-24T12:49:32.457 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pppox.ko 2024-01-24T12:49:32.457 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pptp.ko 2024-01-24T12:49:32.457 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/sb1000.ko 2024-01-24T12:49:32.457 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip/ 2024-01-24T12:49:32.457 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 42473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip/slip.ko 2024-01-24T12:49:32.457 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/sungem_phy.ko 2024-01-24T12:49:32.457 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 64593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/tap.ko 2024-01-24T12:49:32.457 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/ 2024-01-24T12:49:32.457 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 107097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team.ko 2024-01-24T12:49:32.457 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-24T12:49:32.457 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-24T12:49:32.457 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-24T12:49:32.457 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_random.ko 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 86953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/veth.ko 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vmxnet3/ 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 144377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vxlan/ 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 301305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vxlan/vxlan.ko 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netback/ 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 144033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ntb/ 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ntb/ntb.ko 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/ 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/ 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 265809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/nvme-core.ko 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 102553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/nvme.ko 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/ 2024-01-24T12:49:32.458 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 131281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport.ko 2024-01-24T12:49:32.459 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_cs.ko 2024-01-24T12:49:32.459 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 85385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_pc.ko 2024-01-24T12:49:32.459 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_serial.ko 2024-01-24T12:49:32.459 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/ 2024-01-24T12:49:32.459 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/ 2024-01-24T12:49:32.459 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-24T12:49:32.459 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-24T12:49:32.459 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-24T12:49:32.459 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/pci-stub.ko 2024-01-24T12:49:32.459 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 46473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/xen-pcifront.ko 2024-01-24T12:49:32.459 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/ 2024-01-24T12:49:32.459 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/i82092.ko 2024-01-24T12:49:32.459 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 146313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pcmcia.ko 2024-01-24T12:49:32.459 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 62185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pd6729.ko 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 112897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/ 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/broadcom/ 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/samsung/ 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/ 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/intel/ 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 69145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/ 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/ 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 50897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-24T12:49:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-24T12:49:32.461 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-24T12:49:32.461 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-24T12:49:32.461 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-24T12:49:32.461 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-24T12:49:32.461 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-24T12:49:32.461 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/ 2024-01-24T12:49:32.461 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 67105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-24T12:49:32.461 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/acerhdf.ko 2024-01-24T12:49:32.461 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-24T12:49:32.461 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 59673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-24T12:49:32.461 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-24T12:49:32.461 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 132033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-24T12:49:32.461 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 49129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 40273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/hdaps.ko 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel/ 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 43505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel_ips.ko 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 42337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-24T12:49:32.462 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-24T12:49:32.463 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-24T12:49:32.463 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-24T12:49:32.463 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-24T12:49:32.463 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-24T12:49:32.463 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 56913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/wmi.ko 2024-01-24T12:49:32.463 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/ 2024-01-24T12:49:32.463 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ 2024-01-24T12:49:32.463 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-24T12:49:32.463 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-24T12:49:32.463 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 55065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-24T12:49:32.463 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 54089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-24T12:49:32.463 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-24T12:49:32.463 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-24T12:49:32.463 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/da9030_battery.ko 2024-01-24T12:49:32.464 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/da9052-battery.ko 2024-01-24T12:49:32.464 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-24T12:49:32.464 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-24T12:49:32.464 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-24T12:49:32.464 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-24T12:49:32.464 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/gpio-charger.ko 2024-01-24T12:49:32.464 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-24T12:49:32.464 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-24T12:49:32.464 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/max14577_charger.ko 2024-01-24T12:49:32.464 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/max17042_battery.ko 2024-01-24T12:49:32.464 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/max8903_charger.ko 2024-01-24T12:49:32.464 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/max8925_power.ko 2024-01-24T12:49:32.464 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-24T12:49:32.464 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/sbs-battery.ko 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/test_power.ko 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/wm831x_power.ko 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/wm8350_power.ko 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/ 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 58009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/ 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/ 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps_parport.ko 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 41889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/pps_core.ko 2024-01-24T12:49:32.465 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ 2024-01-24T12:49:32.466 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 70961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ptp.ko 2024-01-24T12:49:32.466 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ptp_kvm.ko 2024-01-24T12:49:32.466 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/ 2024-01-24T12:49:32.466 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-24T12:49:32.466 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-24T12:49:32.466 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-24T12:49:32.466 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-da9052.ko 2024-01-24T12:49:32.466 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-da9055.ko 2024-01-24T12:49:32.466 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-da9063.ko 2024-01-24T12:49:32.466 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-24T12:49:32.466 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 68585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-24T12:49:32.466 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-24T12:49:32.466 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-24T12:49:32.466 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-24T12:49:32.467 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-24T12:49:32.467 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-24T12:49:32.467 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-24T12:49:32.467 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-24T12:49:32.467 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-em3027.ko 2024-01-24T12:49:32.467 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-24T12:49:32.467 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-24T12:49:32.467 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-24T12:49:32.467 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-24T12:49:32.467 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 38105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-24T12:49:32.467 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-24T12:49:32.467 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-24T12:49:32.467 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-24T12:49:32.467 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max6900.ko 2024-01-24T12:49:32.468 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max8907.ko 2024-01-24T12:49:32.468 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max8925.ko 2024-01-24T12:49:32.468 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max8997.ko 2024-01-24T12:49:32.468 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max8998.ko 2024-01-24T12:49:32.468 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-24T12:49:32.468 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-24T12:49:32.468 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-palmas.ko 2024-01-24T12:49:32.468 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 46641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-24T12:49:32.468 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-24T12:49:32.468 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-24T12:49:32.468 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-24T12:49:32.468 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-24T12:49:32.468 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-24T12:49:32.468 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-x1205.ko 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 77625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-9xxx.ko 2024-01-24T12:49:32.469 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 57673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-sas.ko 2024-01-24T12:49:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 55113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-xxxx.ko 2024-01-24T12:49:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 135193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/BusLogic.ko 2024-01-24T12:49:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/a100u2w.ko 2024-01-24T12:49:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aacraid/ 2024-01-24T12:49:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 271169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-24T12:49:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 100625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/advansys.ko 2024-01-24T12:49:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/ 2024-01-24T12:49:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 356961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-24T12:49:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 296089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-24T12:49:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic94xx/ 2024-01-24T12:49:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 189241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-24T12:49:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/am53c974.ko 2024-01-24T12:49:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/arcmsr/ 2024-01-24T12:49:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 106897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-24T12:49:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 38193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/atp870u.ko 2024-01-24T12:49:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/be2iscsi/ 2024-01-24T12:49:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 247033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-24T12:49:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bfa/ 2024-01-24T12:49:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 1172049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bfa/bfa.ko 2024-01-24T12:49:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2fc/ 2024-01-24T12:49:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 237753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-24T12:49:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2i/ 2024-01-24T12:49:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 115393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-24T12:49:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 40593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ch.ko 2024-01-24T12:49:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/csiostor/ 2024-01-24T12:49:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 308977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-24T12:49:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/ 2024-01-24T12:49:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-24T12:49:32.472 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 76153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-24T12:49:32.472 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-24T12:49:32.472 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 101457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-24T12:49:32.472 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 146633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-24T12:49:32.472 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 75561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/dc395x.ko 2024-01-24T12:49:32.472 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 38081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/dmx3191d.ko 2024-01-24T12:49:32.472 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esas2r/ 2024-01-24T12:49:32.472 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 212481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-24T12:49:32.472 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 60601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esp_scsi.ko 2024-01-24T12:49:32.472 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/ 2024-01-24T12:49:32.472 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 78217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-24T12:49:32.472 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 158521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-24T12:49:32.472 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fdomain.ko 2024-01-24T12:49:32.472 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fnic/ 2024-01-24T12:49:32.473 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 263561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fnic/fnic.ko 2024-01-24T12:49:32.473 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 201825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hpsa.ko 2024-01-24T12:49:32.473 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 51217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hptiop.ko 2024-01-24T12:49:32.473 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 49049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hv_storvsc.ko 2024-01-24T12:49:32.473 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/imm.ko 2024-01-24T12:49:32.473 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 44065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/initio.ko 2024-01-24T12:49:32.473 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 266545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ipr.ko 2024-01-24T12:49:32.473 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 101481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ips.ko 2024-01-24T12:49:32.473 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/isci/ 2024-01-24T12:49:32.473 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 317217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/isci/isci.ko 2024-01-24T12:49:32.473 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-24T12:49:32.473 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 52969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-24T12:49:32.473 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libfc/ 2024-01-24T12:49:32.473 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 315257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libfc/libfc.ko 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 145593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libiscsi.ko 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 53913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libsas/ 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 216497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libsas/libsas.ko 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/lpfc/ 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 2197561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/ 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 73577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 310865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 84657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid.ko 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mpt3sas/ 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 659849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvsas/ 2024-01-24T12:49:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 119585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 78137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvumi.ko 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/ 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 81657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pm8001/ 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 366433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 124641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pmcraid.ko 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ppa.ko 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 55433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla1280.ko 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/ 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 1876729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 85297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-24T12:49:32.475 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla4xxx/ 2024-01-24T12:49:32.476 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 559089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-24T12:49:32.476 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qlogicfas408.ko 2024-01-24T12:49:32.476 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/raid_class.ko 2024-01-24T12:49:32.476 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 261249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_debug.ko 2024-01-24T12:49:32.476 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 173945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-24T12:49:32.476 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 279321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-24T12:49:32.476 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 97737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-24T12:49:32.476 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 73977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-24T12:49:32.476 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 45001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-24T12:49:32.476 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ses.ko 2024-01-24T12:49:32.476 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 115897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/st.ko 2024-01-24T12:49:32.476 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 46833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/stex.ko 2024-01-24T12:49:32.476 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-24T12:49:32.476 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 164993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-24T12:49:32.477 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 42305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/virtio_scsi.ko 2024-01-24T12:49:32.477 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 50329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-24T12:49:32.477 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/wd719x.ko 2024-01-24T12:49:32.477 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 50033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/xen-scsifront.ko 2024-01-24T12:49:32.477 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ssb/ 2024-01-24T12:49:32.477 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 129489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ssb/ssb.ko 2024-01-24T12:49:32.477 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/ 2024-01-24T12:49:32.477 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/iscsi/ 2024-01-24T12:49:32.477 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 736865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-24T12:49:32.477 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/loopback/ 2024-01-24T12:49:32.477 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 49977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-24T12:49:32.477 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_file.ko 2024-01-24T12:49:32.477 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 43033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_iblock.ko 2024-01-24T12:49:32.477 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 930785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_mod.ko 2024-01-24T12:49:32.478 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 44249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_pscsi.ko 2024-01-24T12:49:32.478 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 122529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_user.ko 2024-01-24T12:49:32.478 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/tcm_fc/ 2024-01-24T12:49:32.478 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 75617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-24T12:49:32.478 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/ 2024-01-24T12:49:32.478 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/ 2024-01-24T12:49:32.478 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-24T12:49:32.478 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-24T12:49:32.478 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-24T12:49:32.478 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-24T12:49:32.478 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-24T12:49:32.478 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-24T12:49:32.478 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ 2024-01-24T12:49:32.479 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ipwireless/ 2024-01-24T12:49:32.480 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 78449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-24T12:49:32.480 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 57873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/moxa.ko 2024-01-24T12:49:32.480 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 50961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/mxser.ko 2024-01-24T12:49:32.480 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 108609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/n_gsm.ko 2024-01-24T12:49:32.480 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/n_hdlc.ko 2024-01-24T12:49:32.480 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 67937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/nozomi.ko 2024-01-24T12:49:32.480 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/ 2024-01-24T12:49:32.480 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250/ 2024-01-24T12:49:32.480 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-24T12:49:32.480 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 59505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-24T12:49:32.480 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-24T12:49:32.480 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/altera_uart.ko 2024-01-24T12:49:32.480 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/arc_uart.ko 2024-01-24T12:49:32.480 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 72433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/jsm/ 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 103097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/rp2.ko 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 53177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/ 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/core/ 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 536009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host/ 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/ 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 44521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio.ko 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_aec.ko 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_cif.ko 2024-01-24T12:49:32.481 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-24T12:49:32.482 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_mf624.ko 2024-01-24T12:49:32.482 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_netx.ko 2024-01-24T12:49:32.482 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_pci_generic.ko 2024-01-24T12:49:32.482 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-24T12:49:32.482 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_sercos3.ko 2024-01-24T12:49:32.482 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/ 2024-01-24T12:49:32.482 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/c67x00/ 2024-01-24T12:49:32.482 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 73321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-24T12:49:32.482 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ 2024-01-24T12:49:32.482 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 144657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-24T12:49:32.482 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-24T12:49:32.482 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-01-24T12:49:32.482 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-24T12:49:32.482 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/ 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 87081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/cdc-acm.ko 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 51353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 47313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/usblp.ko 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 89865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/usbtmc.ko 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/common/ 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/common/ulpi.ko 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc2/ 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc3/ 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 454425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/ 2024-01-24T12:49:32.483 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/ 2024-01-24T12:49:32.484 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 60225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-24T12:49:32.484 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 51889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-24T12:49:32.484 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-24T12:49:32.484 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 42457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-24T12:49:32.484 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-24T12:49:32.484 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-24T12:49:32.484 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 92497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-24T12:49:32.484 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 51049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-24T12:49:32.484 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 122089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-24T12:49:32.484 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 57945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-24T12:49:32.484 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-24T12:49:32.484 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-24T12:49:32.484 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 57737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-24T12:49:32.484 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 85617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 58121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 67345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/ 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-24T12:49:32.485 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 62369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 161265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/ 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 157705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 52729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 69713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 56041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 76065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 75081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-24T12:49:32.486 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 73177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 65817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 66105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 81513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 156425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/ 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 80121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 87361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 78881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 51337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/sl811_cs.ko 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/ 2024-01-24T12:49:32.487 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/mdc800.ko 2024-01-24T12:49:32.488 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/microtek.ko 2024-01-24T12:49:32.488 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ 2024-01-24T12:49:32.488 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 41729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/adutux.ko 2024-01-24T12:49:32.488 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/appledisplay.ko 2024-01-24T12:49:32.488 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-24T12:49:32.488 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/cytherm.ko 2024-01-24T12:49:32.488 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ehset.ko 2024-01-24T12:49:32.488 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/emi26.ko 2024-01-24T12:49:32.488 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/emi62.ko 2024-01-24T12:49:32.488 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ezusb.ko 2024-01-24T12:49:32.488 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/idmouse.ko 2024-01-24T12:49:32.488 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/iowarrior.ko 2024-01-24T12:49:32.488 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-24T12:49:32.488 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ldusb.ko 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/legousbtower.ko 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/lvstest.ko 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/sisusbvga/ 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 64849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usb3503.ko 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usblcd.ko 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 70817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usbtest.ko 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 41913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/uss720.ko 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/yurex.ko 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/mon/ 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 72977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/mon/usbmon.ko 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/musb/ 2024-01-24T12:49:32.489 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 301737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-24T12:49:32.490 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/ 2024-01-24T12:49:32.490 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-generic.ko 2024-01-24T12:49:32.490 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-24T12:49:32.490 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-24T12:49:32.490 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-24T12:49:32.490 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ 2024-01-24T12:49:32.490 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/aircable.ko 2024-01-24T12:49:32.490 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ark3116.ko 2024-01-24T12:49:32.490 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-24T12:49:32.490 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 38113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ch341.ko 2024-01-24T12:49:32.490 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 70265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cp210x.ko 2024-01-24T12:49:32.490 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cyberjack.ko 2024-01-24T12:49:32.490 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 58225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-24T12:49:32.490 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 49825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-24T12:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/empeg.ko 2024-01-24T12:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 44281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/f81232.ko 2024-01-24T12:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 175201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-24T12:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 53121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-24T12:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 137089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-24T12:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 124841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/io_ti.ko 2024-01-24T12:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 67777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ipaq.ko 2024-01-24T12:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ipw.ko 2024-01-24T12:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ir-usb.ko 2024-01-24T12:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 58241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-24T12:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 107529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/keyspan.ko 2024-01-24T12:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-24T12:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-24T12:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-24T12:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mct_u232.ko 2024-01-24T12:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/metro-usb.ko 2024-01-24T12:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 66457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mos7720.ko 2024-01-24T12:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 78225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mos7840.ko 2024-01-24T12:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 56345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mxuport.ko 2024-01-24T12:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/navman.ko 2024-01-24T12:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/omninet.ko 2024-01-24T12:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/opticon.ko 2024-01-24T12:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 191809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/option.ko 2024-01-24T12:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/oti6858.ko 2024-01-24T12:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 54361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/pl2303.ko 2024-01-24T12:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/qcaux.ko 2024-01-24T12:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/qcserial.ko 2024-01-24T12:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/quatech2.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/safe_serial.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 51633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/sierra.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ssu100.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/symbolserial.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 61497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb_debug.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 125633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usbserial.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/visor.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/whiteheat.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-24T12:49:32.493 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ 2024-01-24T12:49:32.494 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 52921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/uas.ko 2024-01-24T12:49:32.494 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-24T12:49:32.494 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-24T12:49:32.494 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-24T12:49:32.494 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-24T12:49:32.494 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-24T12:49:32.494 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-24T12:49:32.494 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-24T12:49:32.494 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-karma.ko 2024-01-24T12:49:32.494 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-24T12:49:32.494 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-24T12:49:32.494 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-24T12:49:32.494 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-24T12:49:32.494 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 180265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/usb-storage.ko 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/ 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 67489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 71121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 104001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/ 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/ 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 154321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 103761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/vfio.ko 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 77617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/ 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 113793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost.ko 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-24T12:49:32.495 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 58097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_net.ko 2024-01-24T12:49:32.496 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 89241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_scsi.ko 2024-01-24T12:49:32.496 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/ 2024-01-24T12:49:32.496 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/ 2024-01-24T12:49:32.496 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-24T12:49:32.496 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-24T12:49:32.496 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-24T12:49:32.496 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-24T12:49:32.496 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 40001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-24T12:49:32.496 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/apple_bl.ko 2024-01-24T12:49:32.496 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-24T12:49:32.496 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/bd6107.ko 2024-01-24T12:49:32.496 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-24T12:49:32.496 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-24T12:49:32.496 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lcd.ko 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/ 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ds2482.ko 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 38993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ds2490.ko 2024-01-24T12:49:32.497 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-24T12:49:32.498 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-24T12:49:32.498 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/ 2024-01-24T12:49:32.498 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-24T12:49:32.498 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-24T12:49:32.498 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-24T12:49:32.498 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-24T12:49:32.498 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-24T12:49:32.498 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-24T12:49:32.498 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-24T12:49:32.498 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-24T12:49:32.498 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-24T12:49:32.498 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-24T12:49:32.498 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 56433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-24T12:49:32.498 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 102705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/wire.ko 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/acquirewdt.ko 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/advantechwdt.ko 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/dw_wdt.ko 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/hpwdt.ko 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/i6300esb.ko 2024-01-24T12:49:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-24T12:49:32.500 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-24T12:49:32.500 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ib700wdt.ko 2024-01-24T12:49:32.500 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ibmasr.ko 2024-01-24T12:49:32.500 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-24T12:49:32.500 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-24T12:49:32.500 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/it87_wdt.ko 2024-01-24T12:49:32.500 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-24T12:49:32.500 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/machzwd.ko 2024-01-24T12:49:32.500 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-24T12:49:32.500 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-24T12:49:32.501 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/nv_tco.ko 2024-01-24T12:49:32.501 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-24T12:49:32.501 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-24T12:49:32.501 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 38665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-24T12:49:32.501 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-24T12:49:32.501 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/retu_wdt.ko 2024-01-24T12:49:32.501 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-24T12:49:32.501 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-24T12:49:32.501 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-24T12:49:32.501 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-24T12:49:32.501 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-24T12:49:32.501 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-24T12:49:32.501 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/softdog.ko 2024-01-24T12:49:32.501 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-24T12:49:32.502 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-24T12:49:32.502 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/via_wdt.ko 2024-01-24T12:49:32.502 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-24T12:49:32.502 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-24T12:49:32.502 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-24T12:49:32.502 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-24T12:49:32.502 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wdt_pci.ko 2024-01-24T12:49:32.502 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-24T12:49:32.502 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-24T12:49:32.502 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/xen_wdt.ko 2024-01-24T12:49:32.502 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/ 2024-01-24T12:49:32.502 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-evtchn.ko 2024-01-24T12:49:32.502 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-gntalloc.ko 2024-01-24T12:49:32.502 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 47873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-gntdev.ko 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-pciback/ 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 176489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 40193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-privcmd.ko 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 71257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-scsiback.ko 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xenfs/ 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/9p/ 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 166817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/9p/9p.ko 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/adfs/ 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 61689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/adfs/adfs.ko 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/affs/ 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 163489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/affs/affs.ko 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/afs/ 2024-01-24T12:49:32.503 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 935201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/afs/kafs.ko 2024-01-24T12:49:32.504 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/autofs/ 2024-01-24T12:49:32.504 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 103441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/autofs/autofs4.ko 2024-01-24T12:49:32.504 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/befs/ 2024-01-24T12:49:32.504 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 64721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/befs/befs.ko 2024-01-24T12:49:32.504 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/bfs/ 2024-01-24T12:49:32.504 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 41049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/bfs/bfs.ko 2024-01-24T12:49:32.504 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 38753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/binfmt_misc.ko 2024-01-24T12:49:32.504 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/btrfs/ 2024-01-24T12:49:32.504 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 3456161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/btrfs/btrfs.ko 2024-01-24T12:49:32.504 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/cachefiles/ 2024-01-24T12:49:32.504 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 306057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/cachefiles/cachefiles.ko 2024-01-24T12:49:32.504 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ceph/ 2024-01-24T12:49:32.504 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 1337105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ceph/ceph.ko 2024-01-24T12:49:32.504 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/coda/ 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 100865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/coda/coda.ko 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/configfs/ 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 108673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/configfs/configfs.ko 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/cramfs/ 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/cramfs/cramfs.ko 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/dlm/ 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 644161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/dlm/dlm.ko 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/efs/ 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/efs/efs.ko 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/f2fs/ 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 1506745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/f2fs/f2fs.ko 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/ 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/msdos.ko 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/freevxfs/ 2024-01-24T12:49:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 42657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/freevxfs/freevxfs.ko 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fscache/ 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 226521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fscache/fscache.ko 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse/ 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse/cuse.ko 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/gfs2/ 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 1230033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/gfs2/gfs2.ko 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hfs/ 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 142065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hfs/hfs.ko 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hfsplus/ 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 223329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hfsplus/hfsplus.ko 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hpfs/ 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 193641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hpfs/hpfs.ko 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/isofs/ 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 74833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/isofs/isofs.ko 2024-01-24T12:49:32.506 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/jfs/ 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 420001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/jfs/jfs.ko 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/lockd/ 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 282137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/lockd/lockd.ko 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/minix/ 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 89801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/minix/minix.ko 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/netfs/ 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 124681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/netfs/netfs.ko 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/ 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/blocklayout/ 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 81537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/filelayout/ 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 59465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/flexfilelayout/ 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 117473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 1058081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfs.ko 2024-01-24T12:49:32.507 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 66457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv2.ko 2024-01-24T12:49:32.508 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 120289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv3.ko 2024-01-24T12:49:32.508 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 2042273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv4.ko 2024-01-24T12:49:32.508 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/ 2024-01-24T12:49:32.508 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/grace.ko 2024-01-24T12:49:32.508 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/nfs_acl.ko 2024-01-24T12:49:32.508 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfsd/ 2024-01-24T12:49:32.508 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 1564041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfsd/nfsd.ko 2024-01-24T12:49:32.508 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nilfs2/ 2024-01-24T12:49:32.508 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 590833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nilfs2/nilfs2.ko 2024-01-24T12:49:32.554 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/ 2024-01-24T12:49:32.554 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-celtic.ko 2024-01-24T12:49:32.554 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-centeuro.ko 2024-01-24T12:49:32.554 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-croatian.ko 2024-01-24T12:49:32.554 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-cyrillic.ko 2024-01-24T12:49:32.554 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-gaelic.ko 2024-01-24T12:49:32.554 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-greek.ko 2024-01-24T12:49:32.555 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-iceland.ko 2024-01-24T12:49:32.555 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-inuit.ko 2024-01-24T12:49:32.555 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-roman.ko 2024-01-24T12:49:32.555 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-romanian.ko 2024-01-24T12:49:32.555 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-turkish.ko 2024-01-24T12:49:32.555 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_ascii.ko 2024-01-24T12:49:32.555 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1250.ko 2024-01-24T12:49:32.555 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1251.ko 2024-01-24T12:49:32.555 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1255.ko 2024-01-24T12:49:32.555 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp737.ko 2024-01-24T12:49:32.555 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp775.ko 2024-01-24T12:49:32.555 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp850.ko 2024-01-24T12:49:32.555 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp852.ko 2024-01-24T12:49:32.555 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp855.ko 2024-01-24T12:49:32.556 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp857.ko 2024-01-24T12:49:32.556 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp860.ko 2024-01-24T12:49:32.556 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp861.ko 2024-01-24T12:49:32.556 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp862.ko 2024-01-24T12:49:32.556 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp863.ko 2024-01-24T12:49:32.556 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp864.ko 2024-01-24T12:49:32.556 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp865.ko 2024-01-24T12:49:32.556 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp866.ko 2024-01-24T12:49:32.556 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp869.ko 2024-01-24T12:49:32.556 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp874.ko 2024-01-24T12:49:32.556 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 94145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp932.ko 2024-01-24T12:49:32.556 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 142681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp936.ko 2024-01-24T12:49:32.556 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 165753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp949.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 118129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp950.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_euc-jp.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-1.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-13.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-14.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-15.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-2.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-3.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-4.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-5.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-6.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-7.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-9.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-r.ko 2024-01-24T12:49:32.557 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-ru.ko 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-u.ko 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_utf8.ko 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ntfs/ 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 220641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ntfs/ntfs.ko 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/cluster/ 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 244777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlm/ 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 440785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlmfs/ 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 54273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 2593689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2.ko 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-24T12:49:32.558 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/omfs/ 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 53793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/omfs/omfs.ko 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/overlayfs/ 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 370753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/overlayfs/overlay.ko 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/pstore/ 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 54825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/pstore/ramoops.ko 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/qnx4/ 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/qnx4/qnx4.ko 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/qnx6/ 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 46713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/qnx6/qnx6.ko 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/quota/ 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/quota/quota_tree.ko 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/quota/quota_v1.ko 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/quota/quota_v2.ko 2024-01-24T12:49:32.559 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/reiserfs/ 2024-01-24T12:49:32.560 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 532153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/reiserfs/reiserfs.ko 2024-01-24T12:49:32.560 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/romfs/ 2024-01-24T12:49:32.560 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/romfs/romfs.ko 2024-01-24T12:49:32.560 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/ 2024-01-24T12:49:32.560 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/client/ 2024-01-24T12:49:32.560 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 2683457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/client/cifs.ko 2024-01-24T12:49:32.560 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/ 2024-01-24T12:49:32.560 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/cifs_arc4.ko 2024-01-24T12:49:32.560 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/cifs_md4.ko 2024-01-24T12:49:32.560 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/squashfs/ 2024-01-24T12:49:32.560 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 134881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/squashfs/squashfs.ko 2024-01-24T12:49:32.560 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/sysv/ 2024-01-24T12:49:32.560 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 91289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/sysv/sysv.ko 2024-01-24T12:49:32.560 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/udf/ 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 248505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/udf/udf.ko 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ufs/ 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 162585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ufs/ufs.ko 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/xfs/ 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 4014953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/xfs/xfs.ko 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/ 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/locking/ 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 80593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/locking/locktorture.ko 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/time/ 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/time/test_udelay.ko 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 60361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/torture.ko 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/ 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 6841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crc-itu-t.ko 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 6537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crc7.ko 2024-01-24T12:49:32.561 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crc8.ko 2024-01-24T12:49:32.562 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/ 2024-01-24T12:49:32.562 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/libarc4.ko 2024-01-24T12:49:32.562 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/libdes.ko 2024-01-24T12:49:32.562 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/interval_tree_test.ko 2024-01-24T12:49:32.562 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/libcrc32c.ko 2024-01-24T12:49:32.562 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/lru_cache.ko 2024-01-24T12:49:32.562 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/ 2024-01-24T12:49:32.562 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/lz4_compress.ko 2024-01-24T12:49:32.562 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/lz4hc_compress.ko 2024-01-24T12:49:32.562 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/math/ 2024-01-24T12:49:32.562 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 6625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/math/cordic.ko 2024-01-24T12:49:32.562 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/memory-notifier-error-inject.ko 2024-01-24T12:49:32.562 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/notifier-error-inject.ko 2024-01-24T12:49:32.562 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/percpu_test.ko 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/pm-notifier-error-inject.ko 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/raid6/ 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 143433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/raid6/raid6_pq.ko 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/rbtree_test.ko 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/reed_solomon/ 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 38849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test-kstrtox.ko 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test-string_helpers.ko 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 4876641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test_bpf.ko 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 49097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test_firmware.ko 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 6377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test_module.ko 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test_user_copy.ko 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_bm.ko 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_fsm.ko 2024-01-24T12:49:32.563 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_kmp.ko 2024-01-24T12:49:32.564 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/xz/ 2024-01-24T12:49:32.564 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/xz/xz_dec_test.ko 2024-01-24T12:49:32.564 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/mm/ 2024-01-24T12:49:32.564 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/mm/hwpoison-inject.ko 2024-01-24T12:49:32.564 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ 2024-01-24T12:49:32.564 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/ 2024-01-24T12:49:32.564 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 55761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/6lowpan.ko 2024-01-24T12:49:32.564 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_dest.ko 2024-01-24T12:49:32.564 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_fragment.ko 2024-01-24T12:49:32.564 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_hop.ko 2024-01-24T12:49:32.564 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 6993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-24T12:49:32.564 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_mobility.ko 2024-01-24T12:49:32.564 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_routing.ko 2024-01-24T12:49:32.564 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_udp.ko 2024-01-24T12:49:32.565 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/ 2024-01-24T12:49:32.565 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/garp.ko 2024-01-24T12:49:32.565 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/mrp.ko 2024-01-24T12:49:32.565 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/p8022.ko 2024-01-24T12:49:32.565 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/psnap.ko 2024-01-24T12:49:32.565 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/stp.ko 2024-01-24T12:49:32.565 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/8021q/ 2024-01-24T12:49:32.565 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 82625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/8021q/8021q.ko 2024-01-24T12:49:32.565 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/ 2024-01-24T12:49:32.565 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 198929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet.ko 2024-01-24T12:49:32.565 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_fd.ko 2024-01-24T12:49:32.565 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_rdma.ko 2024-01-24T12:49:32.565 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_virtio.ko 2024-01-24T12:49:32.565 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/batman-adv/ 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 650097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/batman-adv/batman-adv.ko 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/ 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 65145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/br_netfilter.ko 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 785945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/bridge.ko 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-24T12:49:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 56041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtables.ko 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ceph/ 2024-01-24T12:49:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 1046889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ceph/libceph.ko 2024-01-24T12:49:32.568 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/core/ 2024-01-24T12:49:32.568 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 126049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/core/pktgen.ko 2024-01-24T12:49:32.568 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/ 2024-01-24T12:49:32.568 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 194593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp.ko 2024-01-24T12:49:32.568 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_diag.ko 2024-01-24T12:49:32.568 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 58849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_ipv4.ko 2024-01-24T12:49:32.568 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 60881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_ipv6.ko 2024-01-24T12:49:32.568 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/ 2024-01-24T12:49:32.568 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 390185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/dsa_core.ko 2024-01-24T12:49:32.568 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_brcm.ko 2024-01-24T12:49:32.568 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_dsa.ko 2024-01-24T12:49:32.568 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_none.ko 2024-01-24T12:49:32.568 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_trailer.ko 2024-01-24T12:49:32.568 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/hsr/ 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 99921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/hsr/hsr.ko 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/6lowpan/ 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 45561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 255897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ieee802154.ko 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 47993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ah4.ko 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/esp4.ko 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 48513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/fou.ko 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/gre.ko 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 49609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/inet_diag.ko 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 61281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_gre.ko 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 61409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_tunnel.ko 2024-01-24T12:49:32.569 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_vti.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ipcomp.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 29009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ipip.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 41937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-24T12:49:32.570 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-24T12:49:32.571 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-24T12:49:32.571 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-24T12:49:32.571 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-24T12:49:32.571 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-24T12:49:32.571 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-24T12:49:32.571 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-24T12:49:32.571 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-24T12:49:32.571 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-24T12:49:32.571 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-24T12:49:32.571 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-24T12:49:32.571 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-24T12:49:32.571 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-24T12:49:32.571 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_bic.ko 2024-01-24T12:49:32.572 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_dctcp.ko 2024-01-24T12:49:32.572 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_diag.ko 2024-01-24T12:49:32.572 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_highspeed.ko 2024-01-24T12:49:32.572 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_htcp.ko 2024-01-24T12:49:32.572 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_hybla.ko 2024-01-24T12:49:32.572 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_illinois.ko 2024-01-24T12:49:32.572 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_lp.ko 2024-01-24T12:49:32.572 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_scalable.ko 2024-01-24T12:49:32.572 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_vegas.ko 2024-01-24T12:49:32.572 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_veno.ko 2024-01-24T12:49:32.572 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_westwood.ko 2024-01-24T12:49:32.572 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_yeah.ko 2024-01-24T12:49:32.572 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tunnel4.ko 2024-01-24T12:49:32.572 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/udp_diag.ko 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 44985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/udp_tunnel.ko 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ah6.ko 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/esp6.ko 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/fou6.ko 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 80113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_gre.ko 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 93985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_tunnel.ko 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 54321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_vti.ko 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ipcomp6.ko 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/mip6.ko 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 42497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-24T12:49:32.573 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-24T12:49:32.574 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-24T12:49:32.575 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-24T12:49:32.575 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-24T12:49:32.575 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-24T12:49:32.575 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-24T12:49:32.575 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-24T12:49:32.575 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-24T12:49:32.575 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-24T12:49:32.575 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 74929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/sit.ko 2024-01-24T12:49:32.575 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/tunnel6.ko 2024-01-24T12:49:32.575 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-24T12:49:32.575 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/key/ 2024-01-24T12:49:32.575 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 84441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/key/af_key.ko 2024-01-24T12:49:32.575 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/ 2024-01-24T12:49:32.575 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 125313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_core.ko 2024-01-24T12:49:32.576 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-24T12:49:32.576 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 25961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_eth.ko 2024-01-24T12:49:32.576 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ip.ko 2024-01-24T12:49:32.576 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ip6.ko 2024-01-24T12:49:32.576 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_netlink.ko 2024-01-24T12:49:32.576 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 53329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ppp.ko 2024-01-24T12:49:32.576 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/lapb/ 2024-01-24T12:49:32.576 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 48153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/lapb/lapb.ko 2024-01-24T12:49:32.576 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/llc/ 2024-01-24T12:49:32.576 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/llc/llc.ko 2024-01-24T12:49:32.576 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 268337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/llc/llc2.ko 2024-01-24T12:49:32.576 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/mac802154/ 2024-01-24T12:49:32.576 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 290505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/mac802154/mac802154.ko 2024-01-24T12:49:32.576 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/mpls/ 2024-01-24T12:49:32.577 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/mpls/mpls_gso.ko 2024-01-24T12:49:32.577 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ 2024-01-24T12:49:32.577 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ 2024-01-24T12:49:32.577 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 118817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set.ko 2024-01-24T12:49:32.577 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-24T12:49:32.577 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-24T12:49:32.577 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-24T12:49:32.577 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 100305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-24T12:49:32.577 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 100641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-24T12:49:32.577 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 102889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-24T12:49:32.577 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 102657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-24T12:49:32.577 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 112025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-24T12:49:32.577 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 59593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-24T12:49:32.577 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 108769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 112305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 112657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 110761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 113641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 412641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-24T12:49:32.578 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-24T12:49:32.579 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-24T12:49:32.579 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-24T12:49:32.579 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-24T12:49:32.579 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-24T12:49:32.579 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-24T12:49:32.579 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 49273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conncount.ko 2024-01-24T12:49:32.579 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 411601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack.ko 2024-01-24T12:49:32.579 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-24T12:49:32.579 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-24T12:49:32.579 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-24T12:49:32.579 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 118201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-24T12:49:32.579 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-24T12:49:32.579 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-24T12:49:32.579 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 108113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-24T12:49:32.580 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-24T12:49:32.580 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-24T12:49:32.580 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 66633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-24T12:49:32.580 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-24T12:49:32.580 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-24T12:49:32.580 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-24T12:49:32.580 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 91753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_flow_table.ko 2024-01-24T12:49:32.580 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-24T12:49:32.580 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 37305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_log_syslog.ko 2024-01-24T12:49:32.580 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 96577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat.ko 2024-01-24T12:49:32.580 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-24T12:49:32.580 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-24T12:49:32.580 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_irc.ko 2024-01-24T12:49:32.580 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_sip.ko 2024-01-24T12:49:32.581 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-24T12:49:32.581 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 44305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-24T12:49:32.581 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 614153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_tables.ko 2024-01-24T12:49:32.581 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 42617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink.ko 2024-01-24T12:49:32.581 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-24T12:49:32.581 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-24T12:49:32.581 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 39793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_log.ko 2024-01-24T12:49:32.581 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-24T12:49:32.581 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 49409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-24T12:49:32.581 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_chain_nat.ko 2024-01-24T12:49:32.581 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_compat.ko 2024-01-24T12:49:32.581 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 40777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_ct.ko 2024-01-24T12:49:32.581 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-24T12:49:32.581 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_fib.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_hash.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_limit.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_log.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_masq.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_nat.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_numgen.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_osf.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_queue.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_redir.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_reject.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_reject_inet.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_socket.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_synproxy.ko 2024-01-24T12:49:32.582 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_tproxy.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 89321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/x_tables.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_AUDIT.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 18177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CT.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_DSCP.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_HL.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_HMARK.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 38881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_LED.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_LOG.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NETMAP.ko 2024-01-24T12:49:32.583 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NFLOG.ko 2024-01-24T12:49:32.584 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-24T12:49:32.584 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_RATEEST.ko 2024-01-24T12:49:32.584 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-24T12:49:32.584 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_SECMARK.ko 2024-01-24T12:49:32.584 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-24T12:49:32.584 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-24T12:49:32.584 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TEE.ko 2024-01-24T12:49:32.584 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TPROXY.ko 2024-01-24T12:49:32.584 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TRACE.ko 2024-01-24T12:49:32.584 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_addrtype.ko 2024-01-24T12:49:32.584 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_bpf.ko 2024-01-24T12:49:32.584 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cgroup.ko 2024-01-24T12:49:32.584 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cluster.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_comment.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connbytes.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connlabel.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connlimit.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connmark.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_conntrack.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cpu.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_dccp.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_devgroup.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_dscp.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ecn.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_esp.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 43305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_hashlimit.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_helper.ko 2024-01-24T12:49:32.585 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_hl.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ipcomp.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_iprange.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ipvs.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_l2tp.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_length.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_limit.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_mac.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_mark.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_multiport.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_nat.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_nfacct.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_osf.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_owner.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_physdev.ko 2024-01-24T12:49:32.586 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_pkttype.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_policy.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_quota.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_rateest.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_realm.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_recent.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_sctp.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_set.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_socket.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_state.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_statistic.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_string.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 8561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_tcpmss.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_tcpudp.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_time.ko 2024-01-24T12:49:32.587 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_u32.ko 2024-01-24T12:49:32.588 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netlink/ 2024-01-24T12:49:32.588 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 14545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netlink/netlink_diag.ko 2024-01-24T12:49:32.588 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/nsh/ 2024-01-24T12:49:32.588 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 12433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/nsh/nsh.ko 2024-01-24T12:49:32.588 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/ 2024-01-24T12:49:32.588 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 383545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/openvswitch.ko 2024-01-24T12:49:32.588 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-geneve.ko 2024-01-24T12:49:32.588 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-gre.ko 2024-01-24T12:49:32.588 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-vxlan.ko 2024-01-24T12:49:32.588 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/packet/ 2024-01-24T12:49:32.588 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/packet/af_packet_diag.ko 2024-01-24T12:49:32.588 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/phonet/ 2024-01-24T12:49:32.588 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 112089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/phonet/phonet.ko 2024-01-24T12:49:32.588 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 54873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/phonet/pn_pep.ko 2024-01-24T12:49:32.589 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rds/ 2024-01-24T12:49:32.589 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 253033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds.ko 2024-01-24T12:49:32.589 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 164993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds_rdma.ko 2024-01-24T12:49:32.589 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 68193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds_tcp.ko 2024-01-24T12:49:32.589 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rxrpc/ 2024-01-24T12:49:32.589 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 818929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rxrpc/rxrpc.ko 2024-01-24T12:49:32.589 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/ 2024-01-24T12:49:32.589 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_csum.ko 2024-01-24T12:49:32.589 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_gact.ko 2024-01-24T12:49:32.589 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_ipt.ko 2024-01-24T12:49:32.589 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_mirred.ko 2024-01-24T12:49:32.589 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_nat.ko 2024-01-24T12:49:32.589 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 43457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_pedit.ko 2024-01-24T12:49:32.589 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_police.ko 2024-01-24T12:49:32.590 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_simple.ko 2024-01-24T12:49:32.590 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_skbedit.ko 2024-01-24T12:49:32.590 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_vlan.ko 2024-01-24T12:49:32.590 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_basic.ko 2024-01-24T12:49:32.590 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_bpf.ko 2024-01-24T12:49:32.590 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 19289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_cgroup.ko 2024-01-24T12:49:32.590 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_flow.ko 2024-01-24T12:49:32.590 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 32385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_fw.ko 2024-01-24T12:49:32.590 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 40017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_route.ko 2024-01-24T12:49:32.590 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 61537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_u32.ko 2024-01-24T12:49:32.590 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_cmp.ko 2024-01-24T12:49:32.590 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 13417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_ipset.ko 2024-01-24T12:49:32.590 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_meta.ko 2024-01-24T12:49:32.590 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_nbyte.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_text.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_u32.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 21777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_choke.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_codel.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 34689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_drr.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_fq.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_fq_codel.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 35553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_gred.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 49945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_hfsc.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 22097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_hhf.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 66585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_htb.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_ingress.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 30393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_mqprio.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_mqprio_lib.ko 2024-01-24T12:49:32.591 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_multiq.ko 2024-01-24T12:49:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 36257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_netem.ko 2024-01-24T12:49:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 27505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_pie.ko 2024-01-24T12:49:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_plug.ko 2024-01-24T12:49:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 24849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_prio.ko 2024-01-24T12:49:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 48633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_qfq.ko 2024-01-24T12:49:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 33025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_red.ko 2024-01-24T12:49:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 26889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_sfb.ko 2024-01-24T12:49:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 31417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_sfq.ko 2024-01-24T12:49:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_tbf.ko 2024-01-24T12:49:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 28161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_teql.ko 2024-01-24T12:49:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/ 2024-01-24T12:49:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 932329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/sctp.ko 2024-01-24T12:49:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/sctp_diag.ko 2024-01-24T12:49:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/ 2024-01-24T12:49:32.593 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/ 2024-01-24T12:49:32.593 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 336817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-24T12:49:32.593 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 55025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-24T12:49:32.593 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 1518553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/sunrpc.ko 2024-01-24T12:49:32.593 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/xprtrdma/ 2024-01-24T12:49:32.593 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 708345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-24T12:49:32.593 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/ 2024-01-24T12:49:32.593 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 10497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/diag.ko 2024-01-24T12:49:32.593 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 866465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/tipc.ko 2024-01-24T12:49:32.593 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/unix/ 2024-01-24T12:49:32.593 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 16041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/unix/unix_diag.ko 2024-01-24T12:49:32.593 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/ 2024-01-24T12:49:32.593 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 86425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-24T12:49:32.593 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 68065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 98041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock.ko 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 11185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 17769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/x25/ 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 125473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/x25/x25.ko 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/ 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/xfrm_algo.ko 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 20657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 104169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/xfrm_user.ko 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/virt/ 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/virt/lib/ 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 15545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/virt/lib/irqbypass.ko 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 641009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.alias 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 625033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.alias.bin 2024-01-24T12:49:32.594 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 7677 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.builtin 2024-01-24T12:49:32.595 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 23634 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.builtin.alias.bin 2024-01-24T12:49:32.595 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 9916 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.builtin.bin 2024-01-24T12:49:32.595 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 70653 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.builtin.modinfo 2024-01-24T12:49:32.595 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 147734 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.dep 2024-01-24T12:49:32.595 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 234045 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.dep.bin 2024-01-24T12:49:32.595 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 210 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.devname 2024-01-24T12:49:32.595 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 72797 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.order 2024-01-24T12:49:32.595 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 879 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.softdep 2024-01-24T12:49:32.595 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 255175 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.symbols 2024-01-24T12:49:32.595 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 309826 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.symbols.bin 2024-01-24T12:49:32.595 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./usr/ 2024-01-24T12:49:32.595 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./usr/share/ 2024-01-24T12:49:32.595 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./usr/share/doc/ 2024-01-24T12:49:32.595 INFO:teuthology.orchestra.run.smithi163.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./usr/share/doc/linux-image-6.7.0-gf2d346040895/ 2024-01-24T12:49:32.596 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 171 2024-01-24 04:16 ./usr/share/doc/linux-image-6.7.0-gf2d346040895/changelog.Debian.gz 2024-01-24T12:49:32.596 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r-- root/root 691 2024-01-24 04:16 ./usr/share/doc/linux-image-6.7.0-gf2d346040895/copyright 2024-01-24T12:49:32.597 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-gf2d346040895 2024-01-24T12:49:32.597 INFO:teuthology.task.kernel:searching for kernel 6.7.0-gf2d346040895 2024-01-24T12:49:32.597 DEBUG:teuthology.orchestra.run.smithi163:> egrep '(submenu|menuentry.*6.7.0-gf2d346040895).*{' /boot/grub/grub.cfg 2024-01-24T12:49:32.604 INFO:teuthology.orchestra.run.smithi163.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-24T12:49:32.604 INFO:teuthology.orchestra.run.smithi163.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gf2d346040895' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gf2d346040895-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-24T12:49:32.604 INFO:teuthology.orchestra.run.smithi163.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gf2d346040895 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gf2d346040895-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-24T12:49:32.604 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-24T12:49:32.605 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.7.0-gf2d346040895 2024-01-24T12:49:32.605 DEBUG:teuthology.orchestra.run.smithi163:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-24T12:49:32.648 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi163.front.sepia.ceph.com to complete... 2024-01-24T12:49:33.043 INFO:teuthology.orchestra.run.smithi163.stderr:Sourcing file `/etc/default/grub' 2024-01-24T12:49:33.044 INFO:teuthology.orchestra.run.smithi163.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-24T12:49:33.058 INFO:teuthology.orchestra.run.smithi163.stderr:Generating grub configuration file ... 2024-01-24T12:49:33.241 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-6.7.0-gf2d346040895 2024-01-24T12:49:33.246 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-6.7.0-gf2d346040895 2024-01-24T12:49:33.463 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-24T12:49:33.468 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-24T12:49:33.509 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-24T12:49:33.514 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-24T12:49:33.640 INFO:teuthology.orchestra.run.smithi163.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-24T12:49:33.640 INFO:teuthology.orchestra.run.smithi163.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-24T12:49:33.640 INFO:teuthology.orchestra.run.smithi163.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-24T12:49:33.651 INFO:teuthology.orchestra.run.smithi163.stderr:done 2024-01-24T12:49:45.948 INFO:teuthology.orchestra.run.smithi029.stderr:Sourcing file `/etc/default/grub' 2024-01-24T12:49:45.962 INFO:teuthology.orchestra.run.smithi029.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-24T12:49:46.002 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2024-01-24T12:49:46.348 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-6.7.0-gf2d346040895 2024-01-24T12:49:46.367 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-6.7.0-gf2d346040895 2024-01-24T12:49:46.730 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-24T12:49:46.747 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-24T12:49:46.819 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-24T12:49:46.824 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-24T12:49:47.208 INFO:teuthology.orchestra.run.smithi029.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-24T12:49:47.209 INFO:teuthology.orchestra.run.smithi029.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-24T12:49:47.209 INFO:teuthology.orchestra.run.smithi029.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-24T12:49:47.334 INFO:teuthology.orchestra.run.smithi029.stderr:done 2024-01-24T12:49:47.602 DEBUG:teuthology.orchestra.run.smithi029:> dpkg-deb -c /tmp/linux-image.deb 2024-01-24T12:49:47.610 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./ 2024-01-24T12:49:47.610 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./boot/ 2024-01-24T12:49:47.610 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 4444641 2024-01-24 04:16 ./boot/System.map-6.7.0-gf2d346040895 2024-01-24T12:49:47.622 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 170154 2024-01-24 04:16 ./boot/config-6.7.0-gf2d346040895 2024-01-24T12:49:47.623 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11441152 2024-01-24 04:16 ./boot/vmlinuz-6.7.0-gf2d346040895 2024-01-24T12:49:47.644 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/ 2024-01-24T12:49:47.644 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/ 2024-01-24T12:49:47.644 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/postinst.d/ 2024-01-24T12:49:47.644 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/postrm.d/ 2024-01-24T12:49:47.644 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/preinst.d/ 2024-01-24T12:49:47.644 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/prerm.d/ 2024-01-24T12:49:47.644 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/ 2024-01-24T12:49:47.644 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/ 2024-01-24T12:49:47.644 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/ 2024-01-24T12:49:47.645 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/ 2024-01-24T12:49:47.645 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/ 2024-01-24T12:49:47.645 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/ 2024-01-24T12:49:47.645 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/ 2024-01-24T12:49:47.645 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 490353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-24T12:49:47.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-24T12:49:47.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-24T12:49:47.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-24T12:49:47.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 93121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-24T12:49:47.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 106737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-24T12:49:47.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 152249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-24T12:49:47.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-24T12:49:47.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-24T12:49:47.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 83897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-24T12:49:47.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-24T12:49:47.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 47233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-24T12:49:47.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 47217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-24T12:49:47.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 51809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-24T12:49:47.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-24T12:49:47.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 42537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-24T12:49:47.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 58593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-24T12:49:47.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 50505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-24T12:49:47.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-24T12:49:47.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-24T12:49:47.650 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/ 2024-01-24T12:49:47.650 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/ 2024-01-24T12:49:47.650 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/mce/ 2024-01-24T12:49:47.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 40121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-24T12:49:47.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpuid.ko 2024-01-24T12:49:47.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/msr.ko 2024-01-24T12:49:47.650 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/ 2024-01-24T12:49:47.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 353745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-24T12:49:47.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 881681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-24T12:49:47.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 2276777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm.ko 2024-01-24T12:49:47.665 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/ 2024-01-24T12:49:47.665 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 53729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/af_alg.ko 2024-01-24T12:49:47.665 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/algif_hash.ko 2024-01-24T12:49:47.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/algif_skcipher.ko 2024-01-24T12:49:47.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/ansi_cprng.ko 2024-01-24T12:49:47.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/anubis.ko 2024-01-24T12:49:47.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/arc4.ko 2024-01-24T12:49:47.666 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/asymmetric_keys/ 2024-01-24T12:49:47.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-24T12:49:47.666 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/ 2024-01-24T12:49:47.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_memcpy.ko 2024-01-24T12:49:47.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_pq.ko 2024-01-24T12:49:47.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-24T12:49:47.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_tx.ko 2024-01-24T12:49:47.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_xor.ko 2024-01-24T12:49:47.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/raid6test.ko 2024-01-24T12:49:47.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/authenc.ko 2024-01-24T12:49:47.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/authencesn.ko 2024-01-24T12:49:47.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/blake2b_generic.ko 2024-01-24T12:49:47.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/blowfish_common.ko 2024-01-24T12:49:47.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/blowfish_generic.ko 2024-01-24T12:49:47.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 38817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/camellia_generic.ko 2024-01-24T12:49:47.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast5_generic.ko 2024-01-24T12:49:47.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast6_generic.ko 2024-01-24T12:49:47.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast_common.ko 2024-01-24T12:49:47.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/ccm.ko 2024-01-24T12:49:47.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cmac.ko 2024-01-24T12:49:47.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/crc32_generic.ko 2024-01-24T12:49:47.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 47777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cryptd.ko 2024-01-24T12:49:47.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_engine.ko 2024-01-24T12:49:47.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_simd.ko 2024-01-24T12:49:47.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_user.ko 2024-01-24T12:49:47.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cts.ko 2024-01-24T12:49:47.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/des_generic.ko 2024-01-24T12:49:47.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/dh_generic.ko 2024-01-24T12:49:47.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/echainiv.ko 2024-01-24T12:49:47.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/essiv.ko 2024-01-24T12:49:47.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/fcrypt.ko 2024-01-24T12:49:47.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/khazad.ko 2024-01-24T12:49:47.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/lrw.ko 2024-01-24T12:49:47.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/lz4.ko 2024-01-24T12:49:47.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/lz4hc.ko 2024-01-24T12:49:47.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/md4.ko 2024-01-24T12:49:47.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/michael_mic.ko 2024-01-24T12:49:47.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/pcbc.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/pcrypt.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/rmd160.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/seed.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/serpent_generic.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 149489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/tcrypt.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/tea.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/twofish_common.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/twofish_generic.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/vmac.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/wp512.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/xcbc.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/xor.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/xts.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/xxhash_generic.ko 2024-01-24T12:49:47.669 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/ 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_extlog.ko 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_pad.ko 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/apei/ 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/apei/einj.ko 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/ec_sys.ko 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/platform_profile.ko 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/sbs.ko 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/sbshc.ko 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 104745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/video.ko 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/acard-ahci.ko 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 89657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ahci.ko 2024-01-24T12:49:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ahci_platform.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 88409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/libahci.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/libahci_platform.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_acpi.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ali.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_amd.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_artop.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_atiixp.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_atp867x.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cmd640.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cmd64x.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cypress.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_efar.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt366.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt37x.ko 2024-01-24T12:49:47.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-24T12:49:47.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-24T12:49:47.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_it8213.ko 2024-01-24T12:49:47.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_it821x.ko 2024-01-24T12:49:47.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_jmicron.ko 2024-01-24T12:49:47.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 51489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_legacy.ko 2024-01-24T12:49:47.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_marvell.ko 2024-01-24T12:49:47.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_mpiix.ko 2024-01-24T12:49:47.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_netcell.ko 2024-01-24T12:49:47.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ninja32.ko 2024-01-24T12:49:47.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ns87410.ko 2024-01-24T12:49:47.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ns87415.ko 2024-01-24T12:49:47.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_oldpiix.ko 2024-01-24T12:49:47.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_opti.ko 2024-01-24T12:49:47.673 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_optidma.ko 2024-01-24T12:49:47.673 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pcmcia.ko 2024-01-24T12:49:47.673 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-24T12:49:47.673 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-24T12:49:47.673 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_piccolo.ko 2024-01-24T12:49:47.673 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_radisys.ko 2024-01-24T12:49:47.673 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_rdc.ko 2024-01-24T12:49:47.673 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_rz1000.ko 2024-01-24T12:49:47.673 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sch.ko 2024-01-24T12:49:47.673 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_serverworks.ko 2024-01-24T12:49:47.673 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sil680.ko 2024-01-24T12:49:47.673 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sl82c105.ko 2024-01-24T12:49:47.673 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_triflex.ko 2024-01-24T12:49:47.673 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_via.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pdc_adma.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_inic162x.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 83353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_mv.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 70401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_nv.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_promise.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_qstor.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sil.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 38345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sil24.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sis.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_svw.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 44801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sx4.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_uli.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_via.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_vsc.ko 2024-01-24T12:49:47.674 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/auxdisplay/ 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/auxdisplay/ks0108.ko 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/bcma/ 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 124545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/bcma/bcma.ko 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/ 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/aoe/ 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 113785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/aoe/aoe.ko 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/drbd/ 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 965377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/drbd/drbd.ko 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 173361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/floppy.ko 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/mtip32xx/ 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 94305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 116329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/nbd.ko 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/null_blk/ 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 110745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/null_blk/null_blk.ko 2024-01-24T12:49:47.675 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 98289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/pktcdvd.ko 2024-01-24T12:49:47.676 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 263777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/rbd.ko 2024-01-24T12:49:47.757 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkback/ 2024-01-24T12:49:47.757 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 98193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-24T12:49:47.757 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/zram/ 2024-01-24T12:49:47.757 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 60225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/zram/zram.ko 2024-01-24T12:49:47.757 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ 2024-01-24T12:49:47.758 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/applicom.ko 2024-01-24T12:49:47.758 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hangcheck-timer.ko 2024-01-24T12:49:47.758 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/ 2024-01-24T12:49:47.758 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-24T12:49:47.758 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-24T12:49:47.758 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-24T12:49:47.758 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/via-rng.ko 2024-01-24T12:49:47.758 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-24T12:49:47.758 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ 2024-01-24T12:49:47.758 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-24T12:49:47.759 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 148617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-24T12:49:47.759 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-24T12:49:47.759 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 139369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-24T12:49:47.759 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 70977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-24T12:49:47.759 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 53521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-24T12:49:47.759 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/lp.ko 2024-01-24T12:49:47.759 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/mwave/ 2024-01-24T12:49:47.759 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 84121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/mwave/mwave.ko 2024-01-24T12:49:47.759 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/nvram.ko 2024-01-24T12:49:47.760 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ppdev.ko 2024-01-24T12:49:47.760 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 51121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tlclk.ko 2024-01-24T12:49:47.760 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/ 2024-01-24T12:49:47.760 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-24T12:49:47.760 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-24T12:49:47.760 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-24T12:49:47.760 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-24T12:49:47.760 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-24T12:49:47.761 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-24T12:49:47.761 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-24T12:49:47.761 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/xillybus/ 2024-01-24T12:49:47.761 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-24T12:49:47.761 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 50953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-24T12:49:47.761 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-24T12:49:47.761 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/ 2024-01-24T12:49:47.761 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/clk-palmas.ko 2024-01-24T12:49:47.761 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 47769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/clk-si5351.ko 2024-01-24T12:49:47.762 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/clk-twl6040.ko 2024-01-24T12:49:47.762 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/clk-wm831x.ko 2024-01-24T12:49:47.762 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/ 2024-01-24T12:49:47.762 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-24T12:49:47.762 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-24T12:49:47.762 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-24T12:49:47.762 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ 2024-01-24T12:49:47.762 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ 2024-01-24T12:49:47.763 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 70777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-24T12:49:47.763 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 246913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ccp.ko 2024-01-24T12:49:47.763 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/ 2024-01-24T12:49:47.763 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/ 2024-01-24T12:49:47.763 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-24T12:49:47.763 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 517297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-24T12:49:47.763 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-24T12:49:47.763 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-24T12:49:47.763 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/padlock-aes.ko 2024-01-24T12:49:47.763 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/padlock-sha.ko 2024-01-24T12:49:47.764 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/virtio/ 2024-01-24T12:49:47.764 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 70257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-24T12:49:47.764 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dca/ 2024-01-24T12:49:47.764 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dca/dca.ko 2024-01-24T12:49:47.764 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ 2024-01-24T12:49:47.764 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/dw/ 2024-01-24T12:49:47.764 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-24T12:49:47.764 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ioat/ 2024-01-24T12:49:47.764 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 122593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-24T12:49:47.765 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/ 2024-01-24T12:49:47.765 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 79961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/amd64_edac.ko 2024-01-24T12:49:47.765 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/e752x_edac.ko 2024-01-24T12:49:47.765 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 63625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/edac_mce_amd.ko 2024-01-24T12:49:47.765 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i3000_edac.ko 2024-01-24T12:49:47.765 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i3200_edac.ko 2024-01-24T12:49:47.765 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i5100_edac.ko 2024-01-24T12:49:47.765 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i5400_edac.ko 2024-01-24T12:49:47.765 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i7300_edac.ko 2024-01-24T12:49:47.766 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 52049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i7core_edac.ko 2024-01-24T12:49:47.766 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i82975x_edac.ko 2024-01-24T12:49:47.766 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/ie31200_edac.ko 2024-01-24T12:49:47.766 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 56833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/sb_edac.ko 2024-01-24T12:49:47.766 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/x38_edac.ko 2024-01-24T12:49:47.766 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/ 2024-01-24T12:49:47.766 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-gpio.ko 2024-01-24T12:49:47.766 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-max14577.ko 2024-01-24T12:49:47.766 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-max77693.ko 2024-01-24T12:49:47.767 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-max8997.ko 2024-01-24T12:49:47.767 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-palmas.ko 2024-01-24T12:49:47.767 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-24T12:49:47.767 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-24T12:49:47.767 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/ 2024-01-24T12:49:47.767 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-24T12:49:47.767 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/efi/ 2024-01-24T12:49:47.767 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-24T12:49:47.767 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-24T12:49:47.767 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/ 2024-01-24T12:49:47.768 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-24T12:49:47.768 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-24T12:49:47.768 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-arizona.ko 2024-01-24T12:49:47.768 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-da9052.ko 2024-01-24T12:49:47.768 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-da9055.ko 2024-01-24T12:49:47.768 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-dln2.ko 2024-01-24T12:49:47.768 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 77857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-24T12:49:47.769 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-generic.ko 2024-01-24T12:49:47.769 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-ich.ko 2024-01-24T12:49:47.769 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-24T12:49:47.769 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-kempld.ko 2024-01-24T12:49:47.769 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-24T12:49:47.769 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-max7300.ko 2024-01-24T12:49:47.770 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-max730x.ko 2024-01-24T12:49:47.770 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-max732x.ko 2024-01-24T12:49:47.770 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-24T12:49:47.770 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 47209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-24T12:49:47.770 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-24T12:49:47.770 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-24T12:49:47.771 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-sch.ko 2024-01-24T12:49:47.771 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-24T12:49:47.771 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-24T12:49:47.771 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-24T12:49:47.771 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-24T12:49:47.771 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-24T12:49:47.772 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-vx855.ko 2024-01-24T12:49:47.772 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-24T12:49:47.772 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-24T12:49:47.772 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-24T12:49:47.772 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/ 2024-01-24T12:49:47.772 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-a4tech.ko 2024-01-24T12:49:47.772 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-apple.ko 2024-01-24T12:49:47.773 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-appleir.ko 2024-01-24T12:49:47.773 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-aureal.ko 2024-01-24T12:49:47.776 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-axff.ko 2024-01-24T12:49:47.776 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-belkin.ko 2024-01-24T12:49:47.776 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-cherry.ko 2024-01-24T12:49:47.777 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-chicony.ko 2024-01-24T12:49:47.777 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 60769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-cp2112.ko 2024-01-24T12:49:47.777 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-cypress.ko 2024-01-24T12:49:47.777 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-dr.ko 2024-01-24T12:49:47.777 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-elecom.ko 2024-01-24T12:49:47.777 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-elo.ko 2024-01-24T12:49:47.777 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-emsff.ko 2024-01-24T12:49:47.778 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-ezkey.ko 2024-01-24T12:49:47.778 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gaff.ko 2024-01-24T12:49:47.778 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-generic.ko 2024-01-24T12:49:47.778 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gt683r.ko 2024-01-24T12:49:47.778 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gyration.ko 2024-01-24T12:49:47.778 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-24T12:49:47.779 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-24T12:49:47.779 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtekff.ko 2024-01-24T12:49:47.779 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-hyperv.ko 2024-01-24T12:49:47.779 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-icade.ko 2024-01-24T12:49:47.779 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-kensington.ko 2024-01-24T12:49:47.779 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-keytouch.ko 2024-01-24T12:49:47.780 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-kye.ko 2024-01-24T12:49:47.780 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lcpower.ko 2024-01-24T12:49:47.780 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-led.ko 2024-01-24T12:49:47.780 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 42953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lenovo.ko 2024-01-24T12:49:47.780 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lg-g15.ko 2024-01-24T12:49:47.780 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 58081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-24T12:49:47.780 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 100657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-24T12:49:47.780 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 81025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech.ko 2024-01-24T12:49:47.780 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-magicmouse.ko 2024-01-24T12:49:47.780 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-microsoft.ko 2024-01-24T12:49:47.780 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-monterey.ko 2024-01-24T12:49:47.780 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 50281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-multitouch.ko 2024-01-24T12:49:47.781 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-ntrig.ko 2024-01-24T12:49:47.781 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-ortek.ko 2024-01-24T12:49:47.781 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-penmount.ko 2024-01-24T12:49:47.781 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-petalynx.ko 2024-01-24T12:49:47.781 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 72969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-picolcd.ko 2024-01-24T12:49:47.781 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-pl.ko 2024-01-24T12:49:47.781 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-plantronics.ko 2024-01-24T12:49:47.781 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-primax.ko 2024-01-24T12:49:47.781 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-rmi.ko 2024-01-24T12:49:47.781 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-24T12:49:47.781 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-common.ko 2024-01-24T12:49:47.781 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-24T12:49:47.781 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-24T12:49:47.782 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-24T12:49:47.782 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-24T12:49:47.782 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-24T12:49:47.782 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-24T12:49:47.782 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-24T12:49:47.782 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-24T12:49:47.782 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-24T12:49:47.782 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat.ko 2024-01-24T12:49:47.782 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-saitek.ko 2024-01-24T12:49:47.782 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-samsung.ko 2024-01-24T12:49:47.782 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-24T12:49:47.782 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sjoy.ko 2024-01-24T12:49:47.782 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 51257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sony.ko 2024-01-24T12:49:47.782 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-speedlink.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-steelseries.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sunplus.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-tivo.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-tmff.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-topseed.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-twinhan.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 71097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-uclogic.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-waltop.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 143497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-wiimote.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-xinmo.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-zpff.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-zydacron.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 269313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid.ko 2024-01-24T12:49:47.783 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/uhid.ko 2024-01-24T12:49:47.784 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/usbhid/ 2024-01-24T12:49:47.784 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 125801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-24T12:49:47.784 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-24T12:49:47.784 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-24T12:49:47.784 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 217889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/wacom.ko 2024-01-24T12:49:47.784 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/ 2024-01-24T12:49:47.784 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 64209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_balloon.ko 2024-01-24T12:49:47.784 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 89649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_utils.ko 2024-01-24T12:49:47.784 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 305361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_vmbus.ko 2024-01-24T12:49:47.784 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ 2024-01-24T12:49:47.784 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 66529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/abituguru.ko 2024-01-24T12:49:47.784 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 61401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/abituguru3.ko 2024-01-24T12:49:47.784 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-24T12:49:47.785 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ad7414.ko 2024-01-24T12:49:47.785 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ad7418.ko 2024-01-24T12:49:47.785 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adc128d818.ko 2024-01-24T12:49:47.785 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1025.ko 2024-01-24T12:49:47.785 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 97985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1026.ko 2024-01-24T12:49:47.785 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1029.ko 2024-01-24T12:49:47.785 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 45561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1031.ko 2024-01-24T12:49:47.785 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm9240.ko 2024-01-24T12:49:47.785 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ads7828.ko 2024-01-24T12:49:47.785 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7410.ko 2024-01-24T12:49:47.785 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7411.ko 2024-01-24T12:49:47.785 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 74417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7462.ko 2024-01-24T12:49:47.785 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7470.ko 2024-01-24T12:49:47.786 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 69409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7475.ko 2024-01-24T12:49:47.786 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7x10.ko 2024-01-24T12:49:47.786 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/amc6821.ko 2024-01-24T12:49:47.786 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 55209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/applesmc.ko 2024-01-24T12:49:47.786 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 49921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asb100.ko 2024-01-24T12:49:47.786 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 58625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asc7621.ko 2024-01-24T12:49:47.786 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 40833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-24T12:49:47.786 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/atxp1.ko 2024-01-24T12:49:47.786 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/coretemp.ko 2024-01-24T12:49:47.786 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-24T12:49:47.786 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-24T12:49:47.786 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 44449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-24T12:49:47.786 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 99609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/dme1737.ko 2024-01-24T12:49:47.787 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ds1621.ko 2024-01-24T12:49:47.787 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ds620.ko 2024-01-24T12:49:47.787 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc1403.ko 2024-01-24T12:49:47.787 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc2103.ko 2024-01-24T12:49:47.787 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc6w201.ko 2024-01-24T12:49:47.787 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 66993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f71805f.ko 2024-01-24T12:49:47.787 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 94697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f71882fg.ko 2024-01-24T12:49:47.787 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 41409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f75375s.ko 2024-01-24T12:49:47.787 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/fam15h_power.ko 2024-01-24T12:49:47.787 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 55457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/fschmd.ko 2024-01-24T12:49:47.787 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/g760a.ko 2024-01-24T12:49:47.787 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/g762.ko 2024-01-24T12:49:47.787 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 46809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/gl518sm.ko 2024-01-24T12:49:47.787 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 45537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/gl520sm.ko 2024-01-24T12:49:47.788 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/hih6130.ko 2024-01-24T12:49:47.788 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-24T12:49:47.788 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/i5500_temp.ko 2024-01-24T12:49:47.788 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/i5k_amb.ko 2024-01-24T12:49:47.788 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ibmaem.ko 2024-01-24T12:49:47.788 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ibmpex.ko 2024-01-24T12:49:47.788 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ina209.ko 2024-01-24T12:49:47.788 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ina2xx.ko 2024-01-24T12:49:47.788 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 130457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/it87.ko 2024-01-24T12:49:47.788 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/jc42.ko 2024-01-24T12:49:47.788 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/k10temp.ko 2024-01-24T12:49:47.788 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/k8temp.ko 2024-01-24T12:49:47.788 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lineage-pem.ko 2024-01-24T12:49:47.789 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 48609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm63.ko 2024-01-24T12:49:47.789 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm73.ko 2024-01-24T12:49:47.789 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm75.ko 2024-01-24T12:49:47.789 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm77.ko 2024-01-24T12:49:47.789 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm78.ko 2024-01-24T12:49:47.789 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm80.ko 2024-01-24T12:49:47.789 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm83.ko 2024-01-24T12:49:47.789 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 72841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm85.ko 2024-01-24T12:49:47.789 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 46161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm87.ko 2024-01-24T12:49:47.789 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm90.ko 2024-01-24T12:49:47.789 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm92.ko 2024-01-24T12:49:47.789 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 108849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm93.ko 2024-01-24T12:49:47.789 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95234.ko 2024-01-24T12:49:47.789 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95241.ko 2024-01-24T12:49:47.790 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95245.ko 2024-01-24T12:49:47.790 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc2945.ko 2024-01-24T12:49:47.790 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4151.ko 2024-01-24T12:49:47.790 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4215.ko 2024-01-24T12:49:47.790 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4222.ko 2024-01-24T12:49:47.790 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4245.ko 2024-01-24T12:49:47.790 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4260.ko 2024-01-24T12:49:47.790 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4261.ko 2024-01-24T12:49:47.790 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max16065.ko 2024-01-24T12:49:47.790 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max1619.ko 2024-01-24T12:49:47.790 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max1668.ko 2024-01-24T12:49:47.790 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max197.ko 2024-01-24T12:49:47.790 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6639.ko 2024-01-24T12:49:47.791 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6650.ko 2024-01-24T12:49:47.791 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6697.ko 2024-01-24T12:49:47.791 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-24T12:49:47.791 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/mcp3021.ko 2024-01-24T12:49:47.791 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-24T12:49:47.791 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 44161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6683.ko 2024-01-24T12:49:47.791 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 119697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6775-core.ko 2024-01-24T12:49:47.791 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 60241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6775.ko 2024-01-24T12:49:47.791 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 59745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct7802.ko 2024-01-24T12:49:47.791 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 82345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pc87360.ko 2024-01-24T12:49:47.791 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 54441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pc87427.ko 2024-01-24T12:49:47.791 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pcf8591.ko 2024-01-24T12:49:47.791 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ 2024-01-24T12:49:47.792 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-24T12:49:47.792 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-24T12:49:47.792 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-24T12:49:47.792 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-24T12:49:47.792 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-24T12:49:47.792 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-24T12:49:47.792 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-24T12:49:47.792 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 82585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-24T12:49:47.792 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-24T12:49:47.792 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-24T12:49:47.792 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-24T12:49:47.792 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-24T12:49:47.792 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/powr1220.ko 2024-01-24T12:49:47.793 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch5627.ko 2024-01-24T12:49:47.793 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch5636.ko 2024-01-24T12:49:47.793 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-24T12:49:47.793 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sht15.ko 2024-01-24T12:49:47.793 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sht21.ko 2024-01-24T12:49:47.793 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/shtc1.ko 2024-01-24T12:49:47.793 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 40113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sis5595.ko 2024-01-24T12:49:47.793 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47b397.ko 2024-01-24T12:49:47.793 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47m1.ko 2024-01-24T12:49:47.793 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47m192.ko 2024-01-24T12:49:47.793 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/thmc50.ko 2024-01-24T12:49:47.793 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp102.ko 2024-01-24T12:49:47.793 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp103.ko 2024-01-24T12:49:47.793 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp401.ko 2024-01-24T12:49:47.794 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp421.ko 2024-01-24T12:49:47.794 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/via-cputemp.ko 2024-01-24T12:49:47.794 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 41953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/via686a.ko 2024-01-24T12:49:47.794 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 52465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/vt1211.ko 2024-01-24T12:49:47.794 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 51553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/vt8231.ko 2024-01-24T12:49:47.794 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 57457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83627ehf.ko 2024-01-24T12:49:47.794 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 78833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83627hf.ko 2024-01-24T12:49:47.794 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 71353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83781d.ko 2024-01-24T12:49:47.794 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 63233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83791d.ko 2024-01-24T12:49:47.794 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 71329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83792d.ko 2024-01-24T12:49:47.794 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 101481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83793.ko 2024-01-24T12:49:47.794 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 119513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83795.ko 2024-01-24T12:49:47.794 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83l785ts.ko 2024-01-24T12:49:47.795 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83l786ng.ko 2024-01-24T12:49:47.795 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-24T12:49:47.795 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-24T12:49:47.795 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/ 2024-01-24T12:49:47.795 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/ 2024-01-24T12:49:47.795 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-24T12:49:47.795 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-24T12:49:47.795 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/ 2024-01-24T12:49:47.795 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-24T12:49:47.795 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-24T12:49:47.795 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-24T12:49:47.795 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-24T12:49:47.795 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-24T12:49:47.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-24T12:49:47.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-24T12:49:47.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 6937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-24T12:49:47.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-24T12:49:47.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 50409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-24T12:49:47.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-24T12:49:47.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-24T12:49:47.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-24T12:49:47.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-24T12:49:47.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-24T12:49:47.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 62689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-24T12:49:47.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-24T12:49:47.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 47897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-24T12:49:47.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-24T12:49:47.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-24T12:49:47.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-24T12:49:47.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-24T12:49:47.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-24T12:49:47.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-24T12:49:47.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 47249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-24T12:49:47.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-24T12:49:47.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-24T12:49:47.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-24T12:49:47.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-24T12:49:47.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-24T12:49:47.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-24T12:49:47.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-24T12:49:47.798 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-24T12:49:47.798 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-24T12:49:47.798 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-24T12:49:47.798 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-24T12:49:47.798 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 47665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-24T12:49:47.798 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-mux.ko 2024-01-24T12:49:47.798 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-smbus.ko 2024-01-24T12:49:47.798 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-stub.ko 2024-01-24T12:49:47.798 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/muxes/ 2024-01-24T12:49:47.798 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-24T12:49:47.798 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-24T12:49:47.798 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-24T12:49:47.798 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ 2024-01-24T12:49:47.798 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ 2024-01-24T12:49:47.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 273625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-24T12:49:47.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 883809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_core.ko 2024-01-24T12:49:47.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 69281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-24T12:49:47.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 324433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-24T12:49:47.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 97937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-24T12:49:47.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 282617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-24T12:49:47.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 66145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-24T12:49:47.799 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/ 2024-01-24T12:49:47.799 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-24T12:49:47.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 493273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-24T12:49:47.799 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx4/ 2024-01-24T12:49:47.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 420625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-24T12:49:47.799 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx5/ 2024-01-24T12:49:47.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 741577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-24T12:49:47.800 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mthca/ 2024-01-24T12:49:47.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 296977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-24T12:49:47.800 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-24T12:49:47.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 153825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-24T12:49:47.800 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/usnic/ 2024-01-24T12:49:47.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 169017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-24T12:49:47.800 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ 2024-01-24T12:49:47.800 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-24T12:49:47.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 263129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-24T12:49:47.800 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/iser/ 2024-01-24T12:49:47.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 100377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-24T12:49:47.800 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/isert/ 2024-01-24T12:49:47.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 111433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-24T12:49:47.801 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srp/ 2024-01-24T12:49:47.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 128761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-24T12:49:47.801 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srpt/ 2024-01-24T12:49:47.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 129537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-24T12:49:47.801 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/ 2024-01-24T12:49:47.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/evbug.ko 2024-01-24T12:49:47.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/ff-memless.ko 2024-01-24T12:49:47.801 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/ 2024-01-24T12:49:47.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-24T12:49:47.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-24T12:49:47.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 41249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/gameport.ko 2024-01-24T12:49:47.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 41809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/joydev.ko 2024-01-24T12:49:47.801 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/ 2024-01-24T12:49:47.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-24T12:49:47.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-24T12:49:47.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-24T12:49:47.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-24T12:49:47.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-24T12:49:47.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-24T12:49:47.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-24T12:49:47.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/lm8323.ko 2024-01-24T12:49:47.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/lm8333.ko 2024-01-24T12:49:47.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-24T12:49:47.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-24T12:49:47.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-24T12:49:47.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-24T12:49:47.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-24T12:49:47.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/qt1070.ko 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/qt2160.ko 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/stowaway.ko 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/matrix-keymap.ko 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/ 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/appletouch.ko 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/bcm5974.ko 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 123441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/cyapatp.ko 2024-01-24T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 89465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-24T12:49:47.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-24T12:49:47.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 336017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/psmouse.ko 2024-01-24T12:49:47.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/sermouse.ko 2024-01-24T12:49:47.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-24T12:49:47.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-24T12:49:47.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-24T12:49:47.804 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/rmi4/ 2024-01-24T12:49:47.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 109921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-24T12:49:47.804 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/ 2024-01-24T12:49:47.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/altera_ps2.ko 2024-01-24T12:49:47.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/arc_ps2.ko 2024-01-24T12:49:47.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/ct82c710.ko 2024-01-24T12:49:47.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-24T12:49:47.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/parkbd.ko 2024-01-24T12:49:47.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/pcips2.ko 2024-01-24T12:49:47.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/ps2mult.ko 2024-01-24T12:49:47.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/serio_raw.ko 2024-01-24T12:49:47.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/serport.ko 2024-01-24T12:49:47.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/sparse-keymap.ko 2024-01-24T12:49:47.805 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/ 2024-01-24T12:49:47.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-88pm860x.ko 2024-01-24T12:49:47.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-adp5520.ko 2024-01-24T12:49:47.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 59761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-bd2802.ko 2024-01-24T12:49:47.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-blinkm.ko 2024-01-24T12:49:47.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-da903x.ko 2024-01-24T12:49:47.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-da9052.ko 2024-01-24T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-gpio.ko 2024-01-24T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm3530.ko 2024-01-24T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm3533.ko 2024-01-24T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm355x.ko 2024-01-24T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm3642.ko 2024-01-24T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lp3944.ko 2024-01-24T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lp8788.ko 2024-01-24T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-max8997.ko 2024-01-24T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-mc13783.ko 2024-01-24T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-24T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-pca9532.ko 2024-01-24T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-pca955x.ko 2024-01-24T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-pca963x.ko 2024-01-24T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-ss4200.ko 2024-01-24T12:49:47.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-tca6507.ko 2024-01-24T12:49:47.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-24T12:49:47.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-wm8350.ko 2024-01-24T12:49:47.807 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ 2024-01-24T12:49:47.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-24T12:49:47.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-24T12:49:47.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-24T12:49:47.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-24T12:49:47.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-24T12:49:47.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-24T12:49:47.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-24T12:49:47.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-24T12:49:47.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-24T12:49:47.808 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/ 2024-01-24T12:49:47.808 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/bcache/ 2024-01-24T12:49:47.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 647281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/bcache/bcache.ko 2024-01-24T12:49:47.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 40593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-bio-prison.ko 2024-01-24T12:49:47.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 93417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-bufio.ko 2024-01-24T12:49:47.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 47537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-cache-smq.ko 2024-01-24T12:49:47.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 155921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-cache.ko 2024-01-24T12:49:47.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 107265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-crypt.ko 2024-01-24T12:49:47.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-delay.ko 2024-01-24T12:49:47.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 53865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-era.ko 2024-01-24T12:49:47.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-flakey.ko 2024-01-24T12:49:47.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 41545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-log-userspace.ko 2024-01-24T12:49:47.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-log.ko 2024-01-24T12:49:47.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 49553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-mirror.ko 2024-01-24T12:49:47.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 78041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-multipath.ko 2024-01-24T12:49:47.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-queue-length.ko 2024-01-24T12:49:47.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 71081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-raid.ko 2024-01-24T12:49:47.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-region-hash.ko 2024-01-24T12:49:47.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-round-robin.ko 2024-01-24T12:49:47.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-service-time.ko 2024-01-24T12:49:47.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 109553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-snapshot.ko 2024-01-24T12:49:47.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-switch.ko 2024-01-24T12:49:47.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 181873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-thin-pool.ko 2024-01-24T12:49:47.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 52081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-verity.ko 2024-01-24T12:49:47.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-zero.ko 2024-01-24T12:49:47.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/faulty.ko 2024-01-24T12:49:47.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/linear.ko 2024-01-24T12:49:47.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/multipath.ko 2024-01-24T12:49:47.810 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/persistent-data/ 2024-01-24T12:49:47.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 199985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-24T12:49:47.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid0.ko 2024-01-24T12:49:47.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 113009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid1.ko 2024-01-24T12:49:47.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 158665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid10.ko 2024-01-24T12:49:47.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 393793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid456.ko 2024-01-24T12:49:47.810 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/ 2024-01-24T12:49:47.810 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/ 2024-01-24T12:49:47.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 178145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptbase.ko 2024-01-24T12:49:47.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 63329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptctl.ko 2024-01-24T12:49:47.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 46345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptfc.ko 2024-01-24T12:49:47.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptlan.ko 2024-01-24T12:49:47.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 123329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptsas.ko 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 81017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptscsih.ko 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 52961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptspi.ko 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/ 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/88pm800.ko 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/88pm805.ko 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/88pm80x.ko 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/arizona-i2c.ko 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 123745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/arizona.ko 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/bcm590xx.ko 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/dln2.ko 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/janz-cmodio.ko 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 53593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/kempld-core.ko 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lm3533-core.ko 2024-01-24T12:49:47.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-24T12:49:47.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lp3943.ko 2024-01-24T12:49:47.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 57065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lpc_ich.ko 2024-01-24T12:49:47.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lpc_sch.ko 2024-01-24T12:49:47.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/max8907.ko 2024-01-24T12:49:47.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-24T12:49:47.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-24T12:49:47.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/menf21bmc.ko 2024-01-24T12:49:47.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-24T12:49:47.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-24T12:49:47.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/pcf50633.ko 2024-01-24T12:49:47.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-24T12:49:47.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/retu-mfd.ko 2024-01-24T12:49:47.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 80449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/si476x-core.ko 2024-01-24T12:49:47.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 48465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/sm501.ko 2024-01-24T12:49:47.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-24T12:49:47.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 51145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/tps65010.ko 2024-01-24T12:49:47.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/tps6507x.ko 2024-01-24T12:49:47.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/viperboard.ko 2024-01-24T12:49:47.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/vx855.ko 2024-01-24T12:49:47.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/wl1273-core.ko 2024-01-24T12:49:47.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 44361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/wm8994.ko 2024-01-24T12:49:47.813 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ 2024-01-24T12:49:47.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-24T12:49:47.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 48497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ad525x_dpot.ko 2024-01-24T12:49:47.813 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/altera-stapl/ 2024-01-24T12:49:47.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 46609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-24T12:49:47.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/apds9802als.ko 2024-01-24T12:49:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/apds990x.ko 2024-01-24T12:49:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 45601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/bh1770glc.ko 2024-01-24T12:49:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/c2port/ 2024-01-24T12:49:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-24T12:49:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/c2port/core.ko 2024-01-24T12:49:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/cb710/ 2024-01-24T12:49:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/cb710/cb710.ko 2024-01-24T12:49:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ds1682.ko 2024-01-24T12:49:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/dummy-irq.ko 2024-01-24T12:49:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/echo/ 2024-01-24T12:49:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/echo/echo.ko 2024-01-24T12:49:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/ 2024-01-24T12:49:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 38793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/at24.ko 2024-01-24T12:49:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-24T12:49:47.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/max6875.ko 2024-01-24T12:49:47.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/enclosure.ko 2024-01-24T12:49:47.815 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/genwqe/ 2024-01-24T12:49:47.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 152233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-24T12:49:47.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/hmc6352.ko 2024-01-24T12:49:47.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/hpilo.ko 2024-01-24T12:49:47.815 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ibmasm/ 2024-01-24T12:49:47.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 72657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-24T12:49:47.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ics932s401.ko 2024-01-24T12:49:47.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/isl29003.ko 2024-01-24T12:49:47.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/isl29020.ko 2024-01-24T12:49:47.815 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/ 2024-01-24T12:49:47.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 42521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-24T12:49:47.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-24T12:49:47.816 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/ 2024-01-24T12:49:47.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 125961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei-me.ko 2024-01-24T12:49:47.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 56537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei-txe.ko 2024-01-24T12:49:47.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 313689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei.ko 2024-01-24T12:49:47.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/phantom.ko 2024-01-24T12:49:47.816 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ti-st/ 2024-01-24T12:49:47.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 74393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-24T12:49:47.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tifm_7xx1.ko 2024-01-24T12:49:47.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tifm_core.ko 2024-01-24T12:49:47.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tsl2550.ko 2024-01-24T12:49:47.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 48449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_balloon.ko 2024-01-24T12:49:47.816 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_vmci/ 2024-01-24T12:49:47.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 183665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-24T12:49:47.817 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ 2024-01-24T12:49:47.817 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/bonding/ 2024-01-24T12:49:47.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 490897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/bonding/bonding.ko 2024-01-24T12:49:47.817 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/ 2024-01-24T12:49:47.817 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/b53/ 2024-01-24T12:49:47.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 106041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-24T12:49:47.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 40321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-24T12:49:47.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-24T12:49:47.817 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-24T12:49:47.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 455153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-24T12:49:47.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dummy.ko 2024-01-24T12:49:47.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/eql.ko 2024-01-24T12:49:47.817 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ 2024-01-24T12:49:47.817 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/ 2024-01-24T12:49:47.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 45793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-24T12:49:47.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 42113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-24T12:49:47.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 130561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-24T12:49:47.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 68857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-24T12:49:47.818 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/ 2024-01-24T12:49:47.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-24T12:49:47.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 59697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-24T12:49:47.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-24T12:49:47.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 99057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-24T12:49:47.818 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/adaptec/ 2024-01-24T12:49:47.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 54529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-24T12:49:47.818 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/agere/ 2024-01-24T12:49:47.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 69145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-24T12:49:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/alteon/ 2024-01-24T12:49:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 59593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-24T12:49:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/altera/ 2024-01-24T12:49:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 41577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-24T12:49:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/ 2024-01-24T12:49:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 54617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-24T12:49:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 49297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-24T12:49:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 87305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-24T12:49:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/ 2024-01-24T12:49:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-24T12:49:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 97361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-24T12:49:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-24T12:49:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 102513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-24T12:49:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-24T12:49:47.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 90369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-24T12:49:47.820 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-24T12:49:47.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 81577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-24T12:49:47.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 69641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-24T12:49:47.820 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/ 2024-01-24T12:49:47.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 78409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-24T12:49:47.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 176769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-24T12:49:47.820 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-24T12:49:47.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 1421585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-24T12:49:47.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 128577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-24T12:49:47.820 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-24T12:49:47.821 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 131353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-24T12:49:47.821 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 314561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-24T12:49:47.821 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/ 2024-01-24T12:49:47.821 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-24T12:49:47.821 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 323793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-24T12:49:47.821 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/ 2024-01-24T12:49:47.821 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-24T12:49:47.821 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 193545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-24T12:49:47.821 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-24T12:49:47.821 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 347313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-24T12:49:47.821 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-24T12:49:47.821 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 1044921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-24T12:49:47.821 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-24T12:49:47.821 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 166209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-24T12:49:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-24T12:49:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-24T12:49:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/ 2024-01-24T12:49:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-24T12:49:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 204417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-24T12:49:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/ 2024-01-24T12:49:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-24T12:49:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 69457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-24T12:49:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 61497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-24T12:49:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 141273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-24T12:49:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 51505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-24T12:49:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 62825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-24T12:49:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-24T12:49:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/ 2024-01-24T12:49:47.823 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 60881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-24T12:49:47.823 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 62841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-24T12:49:47.823 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 45729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dnet.ko 2024-01-24T12:49:47.823 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-24T12:49:47.823 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/ 2024-01-24T12:49:47.823 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-24T12:49:47.823 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 281161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-24T12:49:47.823 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 49489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ethoc.ko 2024-01-24T12:49:47.823 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 51745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/fealnx.ko 2024-01-24T12:49:47.823 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/fujitsu/ 2024-01-24T12:49:47.823 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 45353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-24T12:49:47.823 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ 2024-01-24T12:49:47.823 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 90377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-24T12:49:47.823 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-24T12:49:47.824 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 295505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-24T12:49:47.824 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-24T12:49:47.824 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 584553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-24T12:49:47.824 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-24T12:49:47.824 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 246273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-24T12:49:47.824 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-24T12:49:47.824 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 937761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-24T12:49:47.895 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-24T12:49:47.895 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 287345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-24T12:49:47.895 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igb/ 2024-01-24T12:49:47.895 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 514617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-24T12:49:47.895 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-24T12:49:47.895 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 93521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-24T12:49:47.895 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-24T12:49:47.895 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 734457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-24T12:49:47.895 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-24T12:49:47.895 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 151793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-24T12:49:47.895 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 86929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/jme.ko 2024-01-24T12:49:47.896 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/ 2024-01-24T12:49:47.896 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-24T12:49:47.896 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 102297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-24T12:49:47.896 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 122609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-24T12:49:47.896 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/ 2024-01-24T12:49:47.896 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-24T12:49:47.896 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 727585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-24T12:49:47.896 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 279017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-24T12:49:47.896 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-24T12:49:47.896 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-24T12:49:47.896 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 1118433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-24T12:49:47.896 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ 2024-01-24T12:49:47.896 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 53113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-24T12:49:47.896 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 41049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-24T12:49:47.897 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-24T12:49:47.897 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 95673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-24T12:49:47.897 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/ 2024-01-24T12:49:47.897 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-24T12:49:47.897 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 108657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-24T12:49:47.897 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/ 2024-01-24T12:49:47.897 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 73449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-24T12:49:47.897 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 47785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-24T12:49:47.897 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/neterion/ 2024-01-24T12:49:47.897 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 150913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-24T12:49:47.897 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/nvidia/ 2024-01-24T12:49:47.897 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 136729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-24T12:49:47.897 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/ 2024-01-24T12:49:47.898 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 50489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-24T12:49:47.898 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 43153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-24T12:49:47.898 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/ 2024-01-24T12:49:47.898 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-24T12:49:47.898 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 227929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-24T12:49:47.898 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 87113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-24T12:49:47.898 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-24T12:49:47.898 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 672009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-24T12:49:47.898 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rdc/ 2024-01-24T12:49:47.898 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 43025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-24T12:49:47.898 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/ 2024-01-24T12:49:47.898 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 67393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-24T12:49:47.898 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 83993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-24T12:49:47.898 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-24T12:49:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 192369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-24T12:49:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/samsung/ 2024-01-24T12:49:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-24T12:49:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 104289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-24T12:49:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sfc/ 2024-01-24T12:49:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 1064929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-24T12:49:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/silan/ 2024-01-24T12:49:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 47105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-24T12:49:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/ 2024-01-24T12:49:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 54825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-24T12:49:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 63345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-24T12:49:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/ 2024-01-24T12:49:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 61545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-24T12:49:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 67201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-24T12:49:47.900 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 73417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-24T12:49:47.900 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 68185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-24T12:49:47.900 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/ 2024-01-24T12:49:47.900 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-24T12:49:47.900 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-24T12:49:47.900 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-24T12:49:47.900 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-24T12:49:47.900 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 487729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-24T12:49:47.900 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/ 2024-01-24T12:49:47.900 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 103345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-24T12:49:47.900 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 166105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-24T12:49:47.900 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 66337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-24T12:49:47.900 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 78817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-24T12:49:47.901 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/tehuti/ 2024-01-24T12:49:47.901 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 50065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-24T12:49:47.901 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ti/ 2024-01-24T12:49:47.901 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 86537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-24T12:49:47.901 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/ 2024-01-24T12:49:47.901 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 80281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-24T12:49:47.901 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 83801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-24T12:49:47.901 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/ 2024-01-24T12:49:47.901 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 46225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-24T12:49:47.901 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-24T12:49:47.901 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/xircom/ 2024-01-24T12:49:47.901 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 60001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-24T12:49:47.901 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/fddi/ 2024-01-24T12:49:47.901 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 41009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/fddi/defxx.ko 2024-01-24T12:49:47.902 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/fddi/skfp/ 2024-01-24T12:49:47.902 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 217073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-24T12:49:47.902 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 74577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/geneve.ko 2024-01-24T12:49:47.902 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/hyperv/ 2024-01-24T12:49:47.902 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 236257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-24T12:49:47.902 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ieee802154/ 2024-01-24T12:49:47.902 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-24T12:49:47.902 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ifb.ko 2024-01-24T12:49:47.902 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ipvlan/ 2024-01-24T12:49:47.902 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 85833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-24T12:49:47.902 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 62777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/macvlan.ko 2024-01-24T12:49:47.902 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/macvtap.ko 2024-01-24T12:49:47.902 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/ 2024-01-24T12:49:47.902 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-24T12:49:47.903 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-24T12:49:47.903 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-24T12:49:47.903 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-24T12:49:47.903 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio.ko 2024-01-24T12:49:47.903 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mii.ko 2024-01-24T12:49:47.903 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 45097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/netconsole.ko 2024-01-24T12:49:47.903 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/nlmon.ko 2024-01-24T12:49:47.903 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/ 2024-01-24T12:49:47.903 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-24T12:49:47.903 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-24T12:49:47.903 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/ 2024-01-24T12:49:47.903 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/amd.ko 2024-01-24T12:49:47.903 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 50041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-24T12:49:47.903 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 44729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-24T12:49:47.904 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm87xx.ko 2024-01-24T12:49:47.904 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 44865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/broadcom.ko 2024-01-24T12:49:47.904 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/cicada.ko 2024-01-24T12:49:47.904 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/davicom.ko 2024-01-24T12:49:47.904 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/et1011c.ko 2024-01-24T12:49:47.904 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/icplus.ko 2024-01-24T12:49:47.904 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/lxt.ko 2024-01-24T12:49:47.904 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 82057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/marvell.ko 2024-01-24T12:49:47.904 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 76417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/micrel.ko 2024-01-24T12:49:47.904 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/national.ko 2024-01-24T12:49:47.904 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 95569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/phylink.ko 2024-01-24T12:49:47.904 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/qsemi.ko 2024-01-24T12:49:47.904 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 50073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/realtek.ko 2024-01-24T12:49:47.905 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/smsc.ko 2024-01-24T12:49:47.905 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/ste10Xp.ko 2024-01-24T12:49:47.905 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/vitesse.ko 2024-01-24T12:49:47.905 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/plip/ 2024-01-24T12:49:47.905 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 43513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/plip/plip.ko 2024-01-24T12:49:47.905 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ 2024-01-24T12:49:47.905 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-24T12:49:47.905 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_async.ko 2024-01-24T12:49:47.905 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-24T12:49:47.905 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-24T12:49:47.905 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-24T12:49:47.905 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 42857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pppoe.ko 2024-01-24T12:49:47.905 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pppox.ko 2024-01-24T12:49:47.906 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pptp.ko 2024-01-24T12:49:47.906 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/sb1000.ko 2024-01-24T12:49:47.906 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip/ 2024-01-24T12:49:47.906 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 42473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip/slip.ko 2024-01-24T12:49:47.906 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/sungem_phy.ko 2024-01-24T12:49:47.906 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 64593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/tap.ko 2024-01-24T12:49:47.906 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/ 2024-01-24T12:49:47.906 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 107097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team.ko 2024-01-24T12:49:47.906 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-24T12:49:47.906 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-24T12:49:47.906 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-24T12:49:47.906 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_random.ko 2024-01-24T12:49:47.906 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-24T12:49:47.906 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 86953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/veth.ko 2024-01-24T12:49:47.907 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vmxnet3/ 2024-01-24T12:49:47.907 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 144377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-24T12:49:47.907 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vxlan/ 2024-01-24T12:49:47.907 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 301305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vxlan/vxlan.ko 2024-01-24T12:49:47.907 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netback/ 2024-01-24T12:49:47.907 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 144033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-24T12:49:47.907 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ntb/ 2024-01-24T12:49:47.907 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ntb/ntb.ko 2024-01-24T12:49:47.907 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/ 2024-01-24T12:49:47.907 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/ 2024-01-24T12:49:47.907 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 265809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/nvme-core.ko 2024-01-24T12:49:47.907 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 102553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/nvme.ko 2024-01-24T12:49:47.907 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/ 2024-01-24T12:49:47.907 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 131281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport.ko 2024-01-24T12:49:47.908 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_cs.ko 2024-01-24T12:49:47.908 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 85385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_pc.ko 2024-01-24T12:49:47.908 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_serial.ko 2024-01-24T12:49:47.908 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/ 2024-01-24T12:49:47.908 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/ 2024-01-24T12:49:47.908 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-24T12:49:47.908 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-24T12:49:47.908 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-24T12:49:47.908 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/pci-stub.ko 2024-01-24T12:49:47.908 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 46473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/xen-pcifront.ko 2024-01-24T12:49:47.908 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/ 2024-01-24T12:49:47.908 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/i82092.ko 2024-01-24T12:49:47.908 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 146313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pcmcia.ko 2024-01-24T12:49:47.908 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 62185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-24T12:49:47.909 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-24T12:49:47.909 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pd6729.ko 2024-01-24T12:49:47.909 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 112897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-24T12:49:47.909 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/ 2024-01-24T12:49:47.909 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/broadcom/ 2024-01-24T12:49:47.909 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-24T12:49:47.909 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/samsung/ 2024-01-24T12:49:47.909 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-24T12:49:47.909 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/ 2024-01-24T12:49:47.909 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/intel/ 2024-01-24T12:49:47.909 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 69145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-24T12:49:47.909 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/ 2024-01-24T12:49:47.909 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/ 2024-01-24T12:49:47.909 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 50897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-24T12:49:47.910 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-24T12:49:47.910 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-24T12:49:47.910 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-24T12:49:47.910 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-24T12:49:47.910 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-24T12:49:47.910 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-24T12:49:47.910 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/ 2024-01-24T12:49:47.910 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 67105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-24T12:49:47.910 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/acerhdf.ko 2024-01-24T12:49:47.910 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-24T12:49:47.910 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 59673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-24T12:49:47.910 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-24T12:49:47.910 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 132033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-24T12:49:47.911 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-24T12:49:47.911 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 49129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-24T12:49:47.911 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-24T12:49:47.911 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 40273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-24T12:49:47.911 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-24T12:49:47.911 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/hdaps.ko 2024-01-24T12:49:47.911 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-24T12:49:47.911 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel/ 2024-01-24T12:49:47.911 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-24T12:49:47.911 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-24T12:49:47.911 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 43505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel_ips.ko 2024-01-24T12:49:47.911 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-24T12:49:47.911 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-24T12:49:47.911 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-24T12:49:47.912 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 42337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-24T12:49:47.912 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-24T12:49:47.912 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-24T12:49:47.912 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-24T12:49:47.912 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-24T12:49:47.912 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-24T12:49:47.912 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 56913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/wmi.ko 2024-01-24T12:49:47.912 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/ 2024-01-24T12:49:47.912 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ 2024-01-24T12:49:47.912 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-24T12:49:47.912 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-24T12:49:47.912 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 55065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-24T12:49:47.912 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 54089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-24T12:49:47.913 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-24T12:49:47.913 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-24T12:49:47.913 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/da9030_battery.ko 2024-01-24T12:49:47.913 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/da9052-battery.ko 2024-01-24T12:49:47.913 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-24T12:49:47.913 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-24T12:49:47.913 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-24T12:49:47.913 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-24T12:49:47.913 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/gpio-charger.ko 2024-01-24T12:49:47.913 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-24T12:49:47.913 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-24T12:49:47.913 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/max14577_charger.ko 2024-01-24T12:49:47.913 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/max17042_battery.ko 2024-01-24T12:49:47.914 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/max8903_charger.ko 2024-01-24T12:49:47.914 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/max8925_power.ko 2024-01-24T12:49:47.914 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-24T12:49:47.914 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/sbs-battery.ko 2024-01-24T12:49:47.914 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/test_power.ko 2024-01-24T12:49:47.914 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-24T12:49:47.914 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-24T12:49:47.914 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/wm831x_power.ko 2024-01-24T12:49:47.914 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/wm8350_power.ko 2024-01-24T12:49:47.914 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/ 2024-01-24T12:49:47.914 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 58009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-24T12:49:47.914 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-24T12:49:47.914 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/ 2024-01-24T12:49:47.914 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/ 2024-01-24T12:49:47.915 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-24T12:49:47.915 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-24T12:49:47.915 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps_parport.ko 2024-01-24T12:49:47.915 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 41889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/pps_core.ko 2024-01-24T12:49:47.915 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ 2024-01-24T12:49:47.915 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 70961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ptp.ko 2024-01-24T12:49:47.915 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ptp_kvm.ko 2024-01-24T12:49:47.915 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/ 2024-01-24T12:49:47.915 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-24T12:49:47.915 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-24T12:49:47.915 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-24T12:49:47.915 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-da9052.ko 2024-01-24T12:49:47.915 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-da9055.ko 2024-01-24T12:49:47.916 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-da9063.ko 2024-01-24T12:49:47.916 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-24T12:49:47.916 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 68585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-24T12:49:47.916 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-24T12:49:47.916 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-24T12:49:47.916 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-24T12:49:47.916 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-24T12:49:47.916 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-24T12:49:47.916 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-24T12:49:47.916 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-24T12:49:47.916 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-em3027.ko 2024-01-24T12:49:47.916 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-24T12:49:47.916 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-24T12:49:47.917 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-24T12:49:47.917 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-24T12:49:47.917 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 38105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-24T12:49:47.917 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-24T12:49:47.917 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-24T12:49:47.917 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-24T12:49:47.917 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max6900.ko 2024-01-24T12:49:47.917 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max8907.ko 2024-01-24T12:49:47.917 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max8925.ko 2024-01-24T12:49:47.917 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max8997.ko 2024-01-24T12:49:47.917 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max8998.ko 2024-01-24T12:49:47.917 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-24T12:49:47.917 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-24T12:49:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-palmas.ko 2024-01-24T12:49:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 46641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-24T12:49:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-24T12:49:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-24T12:49:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-24T12:49:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-24T12:49:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-24T12:49:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-24T12:49:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-24T12:49:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-24T12:49:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-24T12:49:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-24T12:49:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-24T12:49:47.918 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-24T12:49:47.919 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-24T12:49:47.919 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-24T12:49:47.919 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-24T12:49:47.919 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-24T12:49:47.919 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-24T12:49:47.919 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-x1205.ko 2024-01-24T12:49:47.919 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ 2024-01-24T12:49:47.919 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 77625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-9xxx.ko 2024-01-24T12:49:47.919 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 57673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-sas.ko 2024-01-24T12:49:47.919 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 55113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-xxxx.ko 2024-01-24T12:49:47.919 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 135193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/BusLogic.ko 2024-01-24T12:49:47.919 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/a100u2w.ko 2024-01-24T12:49:47.919 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aacraid/ 2024-01-24T12:49:47.919 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 271169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-24T12:49:47.920 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 100625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/advansys.ko 2024-01-24T12:49:47.920 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/ 2024-01-24T12:49:47.920 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 356961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-24T12:49:47.920 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 296089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-24T12:49:47.920 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic94xx/ 2024-01-24T12:49:47.920 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 189241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-24T12:49:47.920 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/am53c974.ko 2024-01-24T12:49:47.920 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/arcmsr/ 2024-01-24T12:49:47.920 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 106897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-24T12:49:47.920 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 38193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/atp870u.ko 2024-01-24T12:49:47.920 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/be2iscsi/ 2024-01-24T12:49:47.920 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 247033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-24T12:49:47.921 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bfa/ 2024-01-24T12:49:47.921 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 1172049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bfa/bfa.ko 2024-01-24T12:49:47.921 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2fc/ 2024-01-24T12:49:47.921 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 237753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-24T12:49:47.921 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2i/ 2024-01-24T12:49:47.921 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 115393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-24T12:49:47.921 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 40593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ch.ko 2024-01-24T12:49:47.921 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/csiostor/ 2024-01-24T12:49:47.921 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 308977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-24T12:49:47.921 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/ 2024-01-24T12:49:47.921 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-24T12:49:47.921 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 76153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-24T12:49:47.921 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-24T12:49:47.921 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 101457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-24T12:49:47.922 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 146633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-24T12:49:47.922 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 75561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/dc395x.ko 2024-01-24T12:49:47.922 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 38081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/dmx3191d.ko 2024-01-24T12:49:47.922 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esas2r/ 2024-01-24T12:49:47.922 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 212481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-24T12:49:47.922 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 60601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esp_scsi.ko 2024-01-24T12:49:47.922 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/ 2024-01-24T12:49:47.922 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 78217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-24T12:49:47.922 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 158521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-24T12:49:47.922 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fdomain.ko 2024-01-24T12:49:47.922 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fnic/ 2024-01-24T12:49:47.922 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 263561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fnic/fnic.ko 2024-01-24T12:49:47.922 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 201825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hpsa.ko 2024-01-24T12:49:47.923 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 51217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hptiop.ko 2024-01-24T12:49:47.923 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 49049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hv_storvsc.ko 2024-01-24T12:49:47.923 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/imm.ko 2024-01-24T12:49:47.923 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 44065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/initio.ko 2024-01-24T12:49:47.923 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 266545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ipr.ko 2024-01-24T12:49:47.923 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 101481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ips.ko 2024-01-24T12:49:47.923 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/isci/ 2024-01-24T12:49:47.923 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 317217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/isci/isci.ko 2024-01-24T12:49:47.923 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-24T12:49:47.923 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 52969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-24T12:49:47.923 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libfc/ 2024-01-24T12:49:47.923 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 315257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libfc/libfc.ko 2024-01-24T12:49:47.923 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 145593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libiscsi.ko 2024-01-24T12:49:47.924 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 53913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-24T12:49:47.924 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libsas/ 2024-01-24T12:49:47.924 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 216497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libsas/libsas.ko 2024-01-24T12:49:47.924 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/lpfc/ 2024-01-24T12:49:47.924 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 2197561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-24T12:49:47.924 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/ 2024-01-24T12:49:47.924 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 73577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-24T12:49:47.924 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-24T12:49:47.924 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 310865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-24T12:49:47.924 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 84657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid.ko 2024-01-24T12:49:47.924 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mpt3sas/ 2024-01-24T12:49:47.924 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 659849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-24T12:49:47.924 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvsas/ 2024-01-24T12:49:47.924 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 119585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-24T12:49:47.925 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 78137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvumi.ko 2024-01-24T12:49:47.925 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/ 2024-01-24T12:49:47.925 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 81657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-24T12:49:47.925 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-24T12:49:47.925 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-24T12:49:47.925 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-24T12:49:47.925 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pm8001/ 2024-01-24T12:49:47.925 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 366433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-24T12:49:47.925 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 124641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pmcraid.ko 2024-01-24T12:49:47.925 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ppa.ko 2024-01-24T12:49:47.925 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 55433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla1280.ko 2024-01-24T12:49:47.925 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/ 2024-01-24T12:49:47.925 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 1876729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-24T12:49:47.925 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 85297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla4xxx/ 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 559089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qlogicfas408.ko 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/raid_class.ko 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 261249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_debug.ko 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 173945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 279321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 97737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 73977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 45001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ses.ko 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 115897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/st.ko 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 46833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/stex.ko 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-24T12:49:47.926 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 164993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-24T12:49:47.927 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 42305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/virtio_scsi.ko 2024-01-24T12:49:47.927 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 50329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-24T12:49:47.927 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/wd719x.ko 2024-01-24T12:49:47.927 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 50033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/xen-scsifront.ko 2024-01-24T12:49:47.927 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ssb/ 2024-01-24T12:49:47.927 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 129489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ssb/ssb.ko 2024-01-24T12:49:47.927 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/ 2024-01-24T12:49:47.927 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/iscsi/ 2024-01-24T12:49:47.927 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 736865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-24T12:49:47.927 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/loopback/ 2024-01-24T12:49:47.927 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 49977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-24T12:49:47.927 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_file.ko 2024-01-24T12:49:47.927 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 43033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_iblock.ko 2024-01-24T12:49:47.927 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 930785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_mod.ko 2024-01-24T12:49:47.928 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 44249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_pscsi.ko 2024-01-24T12:49:47.928 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 122529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_user.ko 2024-01-24T12:49:47.928 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/tcm_fc/ 2024-01-24T12:49:47.928 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 75617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-24T12:49:47.928 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/ 2024-01-24T12:49:47.928 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/ 2024-01-24T12:49:47.928 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-24T12:49:47.928 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-24T12:49:47.928 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-24T12:49:47.928 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-24T12:49:47.928 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-24T12:49:47.928 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-24T12:49:47.928 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ 2024-01-24T12:49:47.929 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ipwireless/ 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 78449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 57873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/moxa.ko 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 50961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/mxser.ko 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 108609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/n_gsm.ko 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/n_hdlc.ko 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 67937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/nozomi.ko 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/ 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250/ 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 59505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/altera_uart.ko 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/arc_uart.ko 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 72433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-24T12:49:47.930 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/jsm/ 2024-01-24T12:49:47.931 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 103097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-24T12:49:47.931 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/rp2.ko 2024-01-24T12:49:47.931 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 53177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-24T12:49:47.931 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/ 2024-01-24T12:49:47.931 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/core/ 2024-01-24T12:49:47.931 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 536009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-24T12:49:47.931 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host/ 2024-01-24T12:49:47.931 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-24T12:49:47.931 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-24T12:49:47.931 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/ 2024-01-24T12:49:47.931 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 44521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio.ko 2024-01-24T12:49:47.931 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_aec.ko 2024-01-24T12:49:47.931 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_cif.ko 2024-01-24T12:49:47.931 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-24T12:49:47.932 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_mf624.ko 2024-01-24T12:49:47.932 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_netx.ko 2024-01-24T12:49:47.932 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_pci_generic.ko 2024-01-24T12:49:47.932 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-24T12:49:47.932 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_sercos3.ko 2024-01-24T12:49:47.932 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/ 2024-01-24T12:49:47.932 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/c67x00/ 2024-01-24T12:49:47.932 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 73321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-24T12:49:47.932 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ 2024-01-24T12:49:47.932 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 144657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-24T12:49:47.932 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-24T12:49:47.932 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-01-24T12:49:47.932 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/ 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 87081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/cdc-acm.ko 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 51353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 47313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/usblp.ko 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 89865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/usbtmc.ko 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/common/ 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/common/ulpi.ko 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc2/ 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc3/ 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 454425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-24T12:49:47.933 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/ 2024-01-24T12:49:47.934 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/ 2024-01-24T12:49:47.934 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 60225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-24T12:49:47.934 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 51889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-24T12:49:47.934 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-24T12:49:47.934 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 42457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-24T12:49:47.934 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-24T12:49:47.934 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-24T12:49:47.934 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 92497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-24T12:49:47.934 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 51049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-24T12:49:47.934 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 122089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-24T12:49:47.934 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 57945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-24T12:49:47.934 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-24T12:49:47.934 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-24T12:49:47.934 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 57737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-24T12:49:47.935 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 85617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-24T12:49:47.935 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-24T12:49:47.935 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 58121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-24T12:49:47.935 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 67345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-24T12:49:47.935 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/ 2024-01-24T12:49:47.935 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-24T12:49:47.935 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-24T12:49:47.935 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-24T12:49:47.935 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-24T12:49:47.935 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-24T12:49:47.935 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-24T12:49:47.935 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-24T12:49:47.935 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-24T12:49:47.935 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-24T12:49:47.936 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-24T12:49:47.936 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-24T12:49:47.936 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-24T12:49:47.936 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 62369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-24T12:49:47.936 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-24T12:49:47.936 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 161265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-24T12:49:47.936 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/ 2024-01-24T12:49:47.936 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-24T12:49:47.936 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-24T12:49:47.936 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 157705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-24T12:49:47.936 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-24T12:49:47.936 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 52729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-24T12:49:47.936 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 69713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-24T12:49:47.936 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 56041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-24T12:49:47.937 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 76065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-24T12:49:47.937 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 75081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-24T12:49:47.937 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 73177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-24T12:49:47.937 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 65817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-24T12:49:47.937 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 66105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-24T12:49:47.937 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 81513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-24T12:49:47.937 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 156425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-24T12:49:47.937 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/ 2024-01-24T12:49:47.937 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-24T12:49:47.937 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 80121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-24T12:49:47.937 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 87361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-24T12:49:47.937 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 78881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-24T12:49:47.937 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 51337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-24T12:49:47.937 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/sl811_cs.ko 2024-01-24T12:49:47.938 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-24T12:49:47.938 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-24T12:49:47.938 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/ 2024-01-24T12:49:47.938 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/mdc800.ko 2024-01-24T12:49:47.938 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/microtek.ko 2024-01-24T12:49:47.938 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ 2024-01-24T12:49:47.938 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 41729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/adutux.ko 2024-01-24T12:49:47.938 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/appledisplay.ko 2024-01-24T12:49:47.938 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-24T12:49:47.938 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/cytherm.ko 2024-01-24T12:49:47.938 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ehset.ko 2024-01-24T12:49:47.938 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/emi26.ko 2024-01-24T12:49:47.938 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/emi62.ko 2024-01-24T12:49:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ezusb.ko 2024-01-24T12:49:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/idmouse.ko 2024-01-24T12:49:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/iowarrior.ko 2024-01-24T12:49:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-24T12:49:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ldusb.ko 2024-01-24T12:49:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/legousbtower.ko 2024-01-24T12:49:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/lvstest.ko 2024-01-24T12:49:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/sisusbvga/ 2024-01-24T12:49:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 64849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-24T12:49:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-24T12:49:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usb3503.ko 2024-01-24T12:49:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usblcd.ko 2024-01-24T12:49:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-24T12:49:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 70817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usbtest.ko 2024-01-24T12:49:47.940 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 41913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/uss720.ko 2024-01-24T12:49:47.940 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/yurex.ko 2024-01-24T12:49:47.940 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/mon/ 2024-01-24T12:49:47.940 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 72977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/mon/usbmon.ko 2024-01-24T12:49:47.940 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/musb/ 2024-01-24T12:49:47.940 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 301737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-24T12:49:47.940 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/ 2024-01-24T12:49:47.940 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-generic.ko 2024-01-24T12:49:47.940 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-24T12:49:47.940 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-24T12:49:47.940 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-24T12:49:47.940 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ 2024-01-24T12:49:47.940 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/aircable.ko 2024-01-24T12:49:47.940 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ark3116.ko 2024-01-24T12:49:47.941 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-24T12:49:47.941 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 38113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ch341.ko 2024-01-24T12:49:47.941 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 70265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cp210x.ko 2024-01-24T12:49:47.941 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cyberjack.ko 2024-01-24T12:49:47.941 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 58225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-24T12:49:47.941 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 49825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-24T12:49:47.941 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/empeg.ko 2024-01-24T12:49:47.941 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 44281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/f81232.ko 2024-01-24T12:49:47.941 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 175201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-24T12:49:47.941 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 53121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-24T12:49:47.941 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 137089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-24T12:49:47.941 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 124841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/io_ti.ko 2024-01-24T12:49:47.941 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 67777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ipaq.ko 2024-01-24T12:49:47.942 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ipw.ko 2024-01-24T12:49:47.942 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ir-usb.ko 2024-01-24T12:49:47.942 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 58241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-24T12:49:47.942 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 107529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/keyspan.ko 2024-01-24T12:49:47.942 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-24T12:49:47.942 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-24T12:49:47.942 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-24T12:49:47.942 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mct_u232.ko 2024-01-24T12:49:47.942 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/metro-usb.ko 2024-01-24T12:49:47.942 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 66457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mos7720.ko 2024-01-24T12:49:47.942 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 78225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mos7840.ko 2024-01-24T12:49:47.942 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 56345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mxuport.ko 2024-01-24T12:49:47.942 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/navman.ko 2024-01-24T12:49:47.942 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/omninet.ko 2024-01-24T12:49:47.943 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/opticon.ko 2024-01-24T12:49:47.943 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 191809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/option.ko 2024-01-24T12:49:47.943 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/oti6858.ko 2024-01-24T12:49:47.943 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 54361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/pl2303.ko 2024-01-24T12:49:47.943 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/qcaux.ko 2024-01-24T12:49:47.943 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/qcserial.ko 2024-01-24T12:49:47.943 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/quatech2.ko 2024-01-24T12:49:47.943 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/safe_serial.ko 2024-01-24T12:49:47.943 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 51633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/sierra.ko 2024-01-24T12:49:47.943 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-24T12:49:47.943 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ssu100.ko 2024-01-24T12:49:47.943 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/symbolserial.ko 2024-01-24T12:49:47.943 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 61497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-24T12:49:47.944 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-24T12:49:47.944 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb_debug.ko 2024-01-24T12:49:47.944 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-24T12:49:47.944 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 125633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usbserial.ko 2024-01-24T12:49:47.944 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/visor.ko 2024-01-24T12:49:47.944 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/whiteheat.ko 2024-01-24T12:49:47.944 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-24T12:49:47.944 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-24T12:49:47.944 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ 2024-01-24T12:49:47.944 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 52921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/uas.ko 2024-01-24T12:49:47.944 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-24T12:49:47.944 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-24T12:49:47.944 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-24T12:49:47.944 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-24T12:49:47.945 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-24T12:49:47.945 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-24T12:49:47.945 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-24T12:49:47.945 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-karma.ko 2024-01-24T12:49:47.945 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-24T12:49:47.945 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-24T12:49:47.945 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-24T12:49:47.945 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-24T12:49:47.945 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-24T12:49:47.945 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 180265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/usb-storage.ko 2024-01-24T12:49:47.945 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/ 2024-01-24T12:49:47.945 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 67489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-24T12:49:47.945 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 71121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-24T12:49:47.946 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 104001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-24T12:49:47.946 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/ 2024-01-24T12:49:47.946 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/ 2024-01-24T12:49:47.946 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 154321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-24T12:49:47.946 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-24T12:49:47.946 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 103761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/vfio.ko 2024-01-24T12:49:47.946 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 77617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-24T12:49:47.946 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/ 2024-01-24T12:49:47.946 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 113793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost.ko 2024-01-24T12:49:47.946 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-24T12:49:47.946 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 58097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_net.ko 2024-01-24T12:49:47.946 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 89241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_scsi.ko 2024-01-24T12:49:47.946 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/ 2024-01-24T12:49:47.946 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/ 2024-01-24T12:49:47.947 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-24T12:49:47.947 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-24T12:49:47.947 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-24T12:49:47.947 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-24T12:49:47.947 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 40001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-24T12:49:47.947 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/apple_bl.ko 2024-01-24T12:49:47.947 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-24T12:49:47.947 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/bd6107.ko 2024-01-24T12:49:47.947 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-24T12:49:47.947 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-24T12:49:47.947 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-24T12:49:47.947 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-24T12:49:47.947 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lcd.ko 2024-01-24T12:49:47.948 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-24T12:49:47.948 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-24T12:49:47.948 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-24T12:49:47.948 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-24T12:49:47.948 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-24T12:49:47.948 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-24T12:49:47.948 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-24T12:49:47.948 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-24T12:49:47.948 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/ 2024-01-24T12:49:47.948 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ 2024-01-24T12:49:47.948 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ds2482.ko 2024-01-24T12:49:47.948 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 38993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ds2490.ko 2024-01-24T12:49:47.948 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-24T12:49:47.948 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-24T12:49:47.949 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/ 2024-01-24T12:49:47.949 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-24T12:49:47.949 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-24T12:49:47.949 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-24T12:49:47.949 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-24T12:49:47.949 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-24T12:49:47.949 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-24T12:49:47.949 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-24T12:49:47.949 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-24T12:49:47.949 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-24T12:49:47.949 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-24T12:49:47.949 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 56433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-24T12:49:47.949 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 102705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/wire.ko 2024-01-24T12:49:47.949 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ 2024-01-24T12:49:47.950 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/acquirewdt.ko 2024-01-24T12:49:47.950 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/advantechwdt.ko 2024-01-24T12:49:47.950 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-24T12:49:47.950 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-24T12:49:47.950 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-24T12:49:47.950 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-24T12:49:47.950 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-24T12:49:47.950 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-24T12:49:47.950 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/dw_wdt.ko 2024-01-24T12:49:47.950 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-24T12:49:47.950 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-24T12:49:47.950 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/hpwdt.ko 2024-01-24T12:49:47.950 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/i6300esb.ko 2024-01-24T12:49:47.951 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-24T12:49:47.951 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-24T12:49:47.951 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ib700wdt.ko 2024-01-24T12:49:47.951 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ibmasr.ko 2024-01-24T12:49:47.951 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-24T12:49:47.951 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-24T12:49:47.951 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/it87_wdt.ko 2024-01-24T12:49:47.951 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-24T12:49:47.951 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/machzwd.ko 2024-01-24T12:49:47.951 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-24T12:49:47.951 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-24T12:49:47.951 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/nv_tco.ko 2024-01-24T12:49:47.951 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-24T12:49:47.952 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-24T12:49:47.952 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 38665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-24T12:49:47.952 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-24T12:49:47.952 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/retu_wdt.ko 2024-01-24T12:49:47.952 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-24T12:49:47.952 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-24T12:49:47.952 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-24T12:49:47.952 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-24T12:49:47.952 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-24T12:49:47.952 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-24T12:49:47.952 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/softdog.ko 2024-01-24T12:49:47.952 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-24T12:49:47.952 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-24T12:49:47.952 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/via_wdt.ko 2024-01-24T12:49:47.953 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-24T12:49:47.953 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-24T12:49:47.953 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-24T12:49:47.953 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-24T12:49:47.953 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wdt_pci.ko 2024-01-24T12:49:47.953 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-24T12:49:47.953 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-24T12:49:47.953 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/xen_wdt.ko 2024-01-24T12:49:47.953 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/ 2024-01-24T12:49:47.953 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-evtchn.ko 2024-01-24T12:49:47.953 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-gntalloc.ko 2024-01-24T12:49:47.953 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 47873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-gntdev.ko 2024-01-24T12:49:47.953 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-pciback/ 2024-01-24T12:49:47.953 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 176489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-24T12:49:47.954 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 40193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-privcmd.ko 2024-01-24T12:49:47.954 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 71257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-scsiback.ko 2024-01-24T12:49:47.954 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xenfs/ 2024-01-24T12:49:47.954 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-24T12:49:47.954 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ 2024-01-24T12:49:47.954 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/9p/ 2024-01-24T12:49:47.954 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 166817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/9p/9p.ko 2024-01-24T12:49:47.954 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/adfs/ 2024-01-24T12:49:47.954 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 61689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/adfs/adfs.ko 2024-01-24T12:49:47.954 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/affs/ 2024-01-24T12:49:47.954 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 163489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/affs/affs.ko 2024-01-24T12:49:47.954 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/afs/ 2024-01-24T12:49:47.954 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 935201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/afs/kafs.ko 2024-01-24T12:49:47.954 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/autofs/ 2024-01-24T12:49:47.955 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 103441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/autofs/autofs4.ko 2024-01-24T12:49:47.955 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/befs/ 2024-01-24T12:49:47.955 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 64721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/befs/befs.ko 2024-01-24T12:49:47.955 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/bfs/ 2024-01-24T12:49:47.955 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 41049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/bfs/bfs.ko 2024-01-24T12:49:47.955 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 38753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/binfmt_misc.ko 2024-01-24T12:49:47.955 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/btrfs/ 2024-01-24T12:49:47.955 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 3456161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/btrfs/btrfs.ko 2024-01-24T12:49:47.955 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/cachefiles/ 2024-01-24T12:49:47.955 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 306057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/cachefiles/cachefiles.ko 2024-01-24T12:49:47.955 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ceph/ 2024-01-24T12:49:47.956 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 1337105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ceph/ceph.ko 2024-01-24T12:49:47.956 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/coda/ 2024-01-24T12:49:47.956 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 100865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/coda/coda.ko 2024-01-24T12:49:47.956 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/configfs/ 2024-01-24T12:49:47.956 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 108673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/configfs/configfs.ko 2024-01-24T12:49:47.956 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/cramfs/ 2024-01-24T12:49:47.956 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/cramfs/cramfs.ko 2024-01-24T12:49:47.956 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/dlm/ 2024-01-24T12:49:47.956 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 644161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/dlm/dlm.ko 2024-01-24T12:49:47.956 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/efs/ 2024-01-24T12:49:47.956 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/efs/efs.ko 2024-01-24T12:49:47.956 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/f2fs/ 2024-01-24T12:49:47.956 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 1506745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/f2fs/f2fs.ko 2024-01-24T12:49:47.957 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/ 2024-01-24T12:49:47.957 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/msdos.ko 2024-01-24T12:49:47.957 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/freevxfs/ 2024-01-24T12:49:47.957 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 42657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/freevxfs/freevxfs.ko 2024-01-24T12:49:47.957 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fscache/ 2024-01-24T12:49:47.957 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 226521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fscache/fscache.ko 2024-01-24T12:49:47.957 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse/ 2024-01-24T12:49:47.957 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse/cuse.ko 2024-01-24T12:49:47.957 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/gfs2/ 2024-01-24T12:49:47.957 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 1230033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/gfs2/gfs2.ko 2024-01-24T12:49:47.957 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hfs/ 2024-01-24T12:49:47.957 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 142065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hfs/hfs.ko 2024-01-24T12:49:47.957 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hfsplus/ 2024-01-24T12:49:47.958 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 223329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hfsplus/hfsplus.ko 2024-01-24T12:49:47.958 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hpfs/ 2024-01-24T12:49:47.958 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 193641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hpfs/hpfs.ko 2024-01-24T12:49:47.958 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/isofs/ 2024-01-24T12:49:47.958 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 74833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/isofs/isofs.ko 2024-01-24T12:49:47.958 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/jfs/ 2024-01-24T12:49:47.958 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 420001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/jfs/jfs.ko 2024-01-24T12:49:47.958 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/lockd/ 2024-01-24T12:49:47.958 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 282137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/lockd/lockd.ko 2024-01-24T12:49:47.958 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/minix/ 2024-01-24T12:49:47.958 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 89801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/minix/minix.ko 2024-01-24T12:49:47.958 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/netfs/ 2024-01-24T12:49:47.958 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 124681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/netfs/netfs.ko 2024-01-24T12:49:47.959 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/ 2024-01-24T12:49:47.959 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/blocklayout/ 2024-01-24T12:49:47.959 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 81537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-24T12:49:47.959 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/filelayout/ 2024-01-24T12:49:47.959 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 59465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-24T12:49:47.959 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/flexfilelayout/ 2024-01-24T12:49:47.959 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 117473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-24T12:49:47.959 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 1058081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfs.ko 2024-01-24T12:49:47.959 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 66457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv2.ko 2024-01-24T12:49:47.959 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 120289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv3.ko 2024-01-24T12:49:48.001 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 2042273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv4.ko 2024-01-24T12:49:48.002 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/ 2024-01-24T12:49:48.002 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/grace.ko 2024-01-24T12:49:48.002 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/nfs_acl.ko 2024-01-24T12:49:48.002 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfsd/ 2024-01-24T12:49:48.002 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 1564041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfsd/nfsd.ko 2024-01-24T12:49:48.002 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nilfs2/ 2024-01-24T12:49:48.002 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 590833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nilfs2/nilfs2.ko 2024-01-24T12:49:48.002 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/ 2024-01-24T12:49:48.002 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-celtic.ko 2024-01-24T12:49:48.002 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-centeuro.ko 2024-01-24T12:49:48.002 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-croatian.ko 2024-01-24T12:49:48.002 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-cyrillic.ko 2024-01-24T12:49:48.002 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-gaelic.ko 2024-01-24T12:49:48.003 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-greek.ko 2024-01-24T12:49:48.003 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-iceland.ko 2024-01-24T12:49:48.003 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-inuit.ko 2024-01-24T12:49:48.003 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-roman.ko 2024-01-24T12:49:48.003 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-romanian.ko 2024-01-24T12:49:48.003 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-turkish.ko 2024-01-24T12:49:48.003 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_ascii.ko 2024-01-24T12:49:48.003 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1250.ko 2024-01-24T12:49:48.003 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1251.ko 2024-01-24T12:49:48.003 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1255.ko 2024-01-24T12:49:48.003 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp737.ko 2024-01-24T12:49:48.003 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp775.ko 2024-01-24T12:49:48.003 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp850.ko 2024-01-24T12:49:48.003 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp852.ko 2024-01-24T12:49:48.004 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp855.ko 2024-01-24T12:49:48.004 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp857.ko 2024-01-24T12:49:48.004 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp860.ko 2024-01-24T12:49:48.004 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp861.ko 2024-01-24T12:49:48.004 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp862.ko 2024-01-24T12:49:48.004 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp863.ko 2024-01-24T12:49:48.004 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp864.ko 2024-01-24T12:49:48.004 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp865.ko 2024-01-24T12:49:48.004 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp866.ko 2024-01-24T12:49:48.004 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp869.ko 2024-01-24T12:49:48.004 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp874.ko 2024-01-24T12:49:48.004 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 94145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp932.ko 2024-01-24T12:49:48.004 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 142681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp936.ko 2024-01-24T12:49:48.005 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 165753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp949.ko 2024-01-24T12:49:48.005 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 118129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp950.ko 2024-01-24T12:49:48.005 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_euc-jp.ko 2024-01-24T12:49:48.005 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-1.ko 2024-01-24T12:49:48.005 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-13.ko 2024-01-24T12:49:48.005 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-14.ko 2024-01-24T12:49:48.005 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-15.ko 2024-01-24T12:49:48.005 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-2.ko 2024-01-24T12:49:48.005 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-3.ko 2024-01-24T12:49:48.005 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-4.ko 2024-01-24T12:49:48.005 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-5.ko 2024-01-24T12:49:48.005 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-6.ko 2024-01-24T12:49:48.005 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-7.ko 2024-01-24T12:49:48.005 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-9.ko 2024-01-24T12:49:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-r.ko 2024-01-24T12:49:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-ru.ko 2024-01-24T12:49:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-u.ko 2024-01-24T12:49:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-24T12:49:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_utf8.ko 2024-01-24T12:49:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ntfs/ 2024-01-24T12:49:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 220641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ntfs/ntfs.ko 2024-01-24T12:49:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ 2024-01-24T12:49:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/cluster/ 2024-01-24T12:49:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 244777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-24T12:49:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlm/ 2024-01-24T12:49:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 440785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-24T12:49:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlmfs/ 2024-01-24T12:49:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 54273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-24T12:49:48.007 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 2593689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2.ko 2024-01-24T12:49:48.007 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-24T12:49:48.007 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-24T12:49:48.007 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-24T12:49:48.007 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/omfs/ 2024-01-24T12:49:48.007 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 53793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/omfs/omfs.ko 2024-01-24T12:49:48.007 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/overlayfs/ 2024-01-24T12:49:48.007 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 370753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/overlayfs/overlay.ko 2024-01-24T12:49:48.007 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/pstore/ 2024-01-24T12:49:48.007 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 54825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/pstore/ramoops.ko 2024-01-24T12:49:48.007 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/qnx4/ 2024-01-24T12:49:48.007 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/qnx4/qnx4.ko 2024-01-24T12:49:48.007 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/qnx6/ 2024-01-24T12:49:48.008 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 46713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/qnx6/qnx6.ko 2024-01-24T12:49:48.008 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/quota/ 2024-01-24T12:49:48.008 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/quota/quota_tree.ko 2024-01-24T12:49:48.008 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/quota/quota_v1.ko 2024-01-24T12:49:48.008 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/quota/quota_v2.ko 2024-01-24T12:49:48.008 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/reiserfs/ 2024-01-24T12:49:48.008 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 532153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/reiserfs/reiserfs.ko 2024-01-24T12:49:48.008 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/romfs/ 2024-01-24T12:49:48.008 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/romfs/romfs.ko 2024-01-24T12:49:48.008 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/ 2024-01-24T12:49:48.008 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/client/ 2024-01-24T12:49:48.008 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 2683457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/client/cifs.ko 2024-01-24T12:49:48.008 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/ 2024-01-24T12:49:48.009 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/cifs_arc4.ko 2024-01-24T12:49:48.009 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/cifs_md4.ko 2024-01-24T12:49:48.009 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/squashfs/ 2024-01-24T12:49:48.009 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 134881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/squashfs/squashfs.ko 2024-01-24T12:49:48.009 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/sysv/ 2024-01-24T12:49:48.009 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 91289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/sysv/sysv.ko 2024-01-24T12:49:48.009 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/udf/ 2024-01-24T12:49:48.009 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 248505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/udf/udf.ko 2024-01-24T12:49:48.009 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ufs/ 2024-01-24T12:49:48.009 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 162585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ufs/ufs.ko 2024-01-24T12:49:48.009 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/xfs/ 2024-01-24T12:49:48.009 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 4014953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/xfs/xfs.ko 2024-01-24T12:49:48.009 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/ 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/locking/ 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 80593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/locking/locktorture.ko 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/time/ 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/time/test_udelay.ko 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 60361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/torture.ko 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/ 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 6841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crc-itu-t.ko 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 6537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crc7.ko 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crc8.ko 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/ 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/libarc4.ko 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/libdes.ko 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/interval_tree_test.ko 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/libcrc32c.ko 2024-01-24T12:49:48.010 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/lru_cache.ko 2024-01-24T12:49:48.011 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/ 2024-01-24T12:49:48.011 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/lz4_compress.ko 2024-01-24T12:49:48.011 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/lz4hc_compress.ko 2024-01-24T12:49:48.011 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/math/ 2024-01-24T12:49:48.011 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 6625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/math/cordic.ko 2024-01-24T12:49:48.011 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/memory-notifier-error-inject.ko 2024-01-24T12:49:48.011 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/notifier-error-inject.ko 2024-01-24T12:49:48.011 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/percpu_test.ko 2024-01-24T12:49:48.011 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/pm-notifier-error-inject.ko 2024-01-24T12:49:48.011 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/raid6/ 2024-01-24T12:49:48.011 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 143433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/raid6/raid6_pq.ko 2024-01-24T12:49:48.011 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/rbtree_test.ko 2024-01-24T12:49:48.011 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/reed_solomon/ 2024-01-24T12:49:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-24T12:49:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 38849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test-kstrtox.ko 2024-01-24T12:49:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test-string_helpers.ko 2024-01-24T12:49:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 4876641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test_bpf.ko 2024-01-24T12:49:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 49097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test_firmware.ko 2024-01-24T12:49:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 6377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test_module.ko 2024-01-24T12:49:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test_user_copy.ko 2024-01-24T12:49:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_bm.ko 2024-01-24T12:49:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_fsm.ko 2024-01-24T12:49:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_kmp.ko 2024-01-24T12:49:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/xz/ 2024-01-24T12:49:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/xz/xz_dec_test.ko 2024-01-24T12:49:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/mm/ 2024-01-24T12:49:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/mm/hwpoison-inject.ko 2024-01-24T12:49:48.013 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ 2024-01-24T12:49:48.013 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/ 2024-01-24T12:49:48.013 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 55761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/6lowpan.ko 2024-01-24T12:49:48.013 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_dest.ko 2024-01-24T12:49:48.013 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_fragment.ko 2024-01-24T12:49:48.013 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_hop.ko 2024-01-24T12:49:48.013 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 6993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-24T12:49:48.013 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_mobility.ko 2024-01-24T12:49:48.013 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_routing.ko 2024-01-24T12:49:48.013 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_udp.ko 2024-01-24T12:49:48.013 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/ 2024-01-24T12:49:48.013 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/garp.ko 2024-01-24T12:49:48.013 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/mrp.ko 2024-01-24T12:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/p8022.ko 2024-01-24T12:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/psnap.ko 2024-01-24T12:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/stp.ko 2024-01-24T12:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/8021q/ 2024-01-24T12:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 82625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/8021q/8021q.ko 2024-01-24T12:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/ 2024-01-24T12:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 198929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet.ko 2024-01-24T12:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_fd.ko 2024-01-24T12:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_rdma.ko 2024-01-24T12:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_virtio.ko 2024-01-24T12:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/batman-adv/ 2024-01-24T12:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 650097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/batman-adv/batman-adv.ko 2024-01-24T12:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/ 2024-01-24T12:49:48.015 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 65145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/br_netfilter.ko 2024-01-24T12:49:48.015 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 785945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/bridge.ko 2024-01-24T12:49:48.015 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ 2024-01-24T12:49:48.015 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-24T12:49:48.015 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-24T12:49:48.015 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-24T12:49:48.015 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-24T12:49:48.015 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-24T12:49:48.015 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-24T12:49:48.015 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-24T12:49:48.015 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-24T12:49:48.015 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-24T12:49:48.015 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-24T12:49:48.015 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-24T12:49:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-24T12:49:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-24T12:49:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-24T12:49:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-24T12:49:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-24T12:49:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-24T12:49:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-24T12:49:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-24T12:49:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-24T12:49:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 56041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtables.ko 2024-01-24T12:49:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-24T12:49:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-24T12:49:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ceph/ 2024-01-24T12:49:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 1046889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ceph/libceph.ko 2024-01-24T12:49:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/core/ 2024-01-24T12:49:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 126049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/core/pktgen.ko 2024-01-24T12:49:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/ 2024-01-24T12:49:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 194593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp.ko 2024-01-24T12:49:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_diag.ko 2024-01-24T12:49:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 58849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_ipv4.ko 2024-01-24T12:49:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 60881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_ipv6.ko 2024-01-24T12:49:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/ 2024-01-24T12:49:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 390185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/dsa_core.ko 2024-01-24T12:49:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_brcm.ko 2024-01-24T12:49:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_dsa.ko 2024-01-24T12:49:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_none.ko 2024-01-24T12:49:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_trailer.ko 2024-01-24T12:49:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/hsr/ 2024-01-24T12:49:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 99921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/hsr/hsr.ko 2024-01-24T12:49:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ 2024-01-24T12:49:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/6lowpan/ 2024-01-24T12:49:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 45561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-24T12:49:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 255897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ieee802154.ko 2024-01-24T12:49:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 47993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-24T12:49:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ 2024-01-24T12:49:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ah4.ko 2024-01-24T12:49:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/esp4.ko 2024-01-24T12:49:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 48513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/fou.ko 2024-01-24T12:49:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/gre.ko 2024-01-24T12:49:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 49609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/inet_diag.ko 2024-01-24T12:49:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 61281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_gre.ko 2024-01-24T12:49:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 61409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_tunnel.ko 2024-01-24T12:49:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_vti.ko 2024-01-24T12:49:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ipcomp.ko 2024-01-24T12:49:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 29009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ipip.ko 2024-01-24T12:49:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ 2024-01-24T12:49:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-24T12:49:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-24T12:49:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-24T12:49:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 41937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-24T12:49:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-24T12:49:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-24T12:49:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-24T12:49:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-24T12:49:48.020 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-24T12:49:48.020 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-24T12:49:48.020 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-24T12:49:48.020 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-24T12:49:48.020 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-24T12:49:48.020 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-24T12:49:48.020 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-24T12:49:48.020 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-24T12:49:48.020 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-24T12:49:48.020 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-24T12:49:48.020 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-24T12:49:48.020 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-24T12:49:48.020 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-24T12:49:48.021 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-24T12:49:48.021 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-24T12:49:48.021 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-24T12:49:48.021 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-24T12:49:48.021 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_bic.ko 2024-01-24T12:49:48.021 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_dctcp.ko 2024-01-24T12:49:48.021 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_diag.ko 2024-01-24T12:49:48.021 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_highspeed.ko 2024-01-24T12:49:48.021 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_htcp.ko 2024-01-24T12:49:48.021 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_hybla.ko 2024-01-24T12:49:48.021 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_illinois.ko 2024-01-24T12:49:48.021 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_lp.ko 2024-01-24T12:49:48.021 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_scalable.ko 2024-01-24T12:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_vegas.ko 2024-01-24T12:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_veno.ko 2024-01-24T12:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_westwood.ko 2024-01-24T12:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_yeah.ko 2024-01-24T12:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tunnel4.ko 2024-01-24T12:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/udp_diag.ko 2024-01-24T12:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 44985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/udp_tunnel.ko 2024-01-24T12:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-24T12:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ 2024-01-24T12:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ah6.ko 2024-01-24T12:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/esp6.ko 2024-01-24T12:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/fou6.ko 2024-01-24T12:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 80113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_gre.ko 2024-01-24T12:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 93985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_tunnel.ko 2024-01-24T12:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-24T12:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 54321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_vti.ko 2024-01-24T12:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ipcomp6.ko 2024-01-24T12:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/mip6.ko 2024-01-24T12:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ 2024-01-24T12:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 42497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-24T12:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-24T12:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-24T12:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-24T12:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-24T12:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-24T12:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-24T12:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-24T12:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-24T12:49:48.024 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-24T12:49:48.024 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-24T12:49:48.024 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-24T12:49:48.024 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-24T12:49:48.024 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-24T12:49:48.024 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-24T12:49:48.024 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-24T12:49:48.024 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-24T12:49:48.024 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-24T12:49:48.024 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-24T12:49:48.024 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-24T12:49:48.024 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-24T12:49:48.024 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-24T12:49:48.025 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-24T12:49:48.025 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-24T12:49:48.025 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-24T12:49:48.025 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 74929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/sit.ko 2024-01-24T12:49:48.025 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/tunnel6.ko 2024-01-24T12:49:48.025 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-24T12:49:48.025 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/key/ 2024-01-24T12:49:48.025 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 84441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/key/af_key.ko 2024-01-24T12:49:48.025 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/ 2024-01-24T12:49:48.025 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 125313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_core.ko 2024-01-24T12:49:48.025 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-24T12:49:48.025 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 25961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_eth.ko 2024-01-24T12:49:48.025 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ip.ko 2024-01-24T12:49:48.025 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ip6.ko 2024-01-24T12:49:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_netlink.ko 2024-01-24T12:49:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 53329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ppp.ko 2024-01-24T12:49:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/lapb/ 2024-01-24T12:49:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 48153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/lapb/lapb.ko 2024-01-24T12:49:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/llc/ 2024-01-24T12:49:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/llc/llc.ko 2024-01-24T12:49:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 268337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/llc/llc2.ko 2024-01-24T12:49:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/mac802154/ 2024-01-24T12:49:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 290505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/mac802154/mac802154.ko 2024-01-24T12:49:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/mpls/ 2024-01-24T12:49:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/mpls/mpls_gso.ko 2024-01-24T12:49:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ 2024-01-24T12:49:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ 2024-01-24T12:49:48.026 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 118817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set.ko 2024-01-24T12:49:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-24T12:49:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-24T12:49:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-24T12:49:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 100305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-24T12:49:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 100641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-24T12:49:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 102889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-24T12:49:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 102657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-24T12:49:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 112025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-24T12:49:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 59593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-24T12:49:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 108769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-24T12:49:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 112305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-24T12:49:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 112657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-24T12:49:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 110761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-24T12:49:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 113641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-24T12:49:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-24T12:49:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ 2024-01-24T12:49:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 412641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-24T12:49:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-24T12:49:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-24T12:49:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-24T12:49:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-24T12:49:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-24T12:49:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-24T12:49:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-24T12:49:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-24T12:49:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-24T12:49:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-24T12:49:48.029 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-24T12:49:48.029 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-24T12:49:48.029 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-24T12:49:48.029 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 49273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conncount.ko 2024-01-24T12:49:48.029 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 411601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack.ko 2024-01-24T12:49:48.029 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-24T12:49:48.029 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-24T12:49:48.029 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-24T12:49:48.029 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 118201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-24T12:49:48.029 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-24T12:49:48.029 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-24T12:49:48.029 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 108113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-24T12:49:48.029 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-24T12:49:48.030 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-24T12:49:48.030 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 66633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-24T12:49:48.030 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-24T12:49:48.030 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-24T12:49:48.030 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-24T12:49:48.030 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 91753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_flow_table.ko 2024-01-24T12:49:48.030 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-24T12:49:48.030 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 37305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_log_syslog.ko 2024-01-24T12:49:48.030 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 96577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat.ko 2024-01-24T12:49:48.030 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-24T12:49:48.030 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-24T12:49:48.030 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_irc.ko 2024-01-24T12:49:48.030 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_sip.ko 2024-01-24T12:49:48.030 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-24T12:49:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 44305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-24T12:49:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 614153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_tables.ko 2024-01-24T12:49:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 42617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink.ko 2024-01-24T12:49:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-24T12:49:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-24T12:49:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 39793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_log.ko 2024-01-24T12:49:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-24T12:49:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 49409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-24T12:49:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_chain_nat.ko 2024-01-24T12:49:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_compat.ko 2024-01-24T12:49:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 40777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_ct.ko 2024-01-24T12:49:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-24T12:49:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_fib.ko 2024-01-24T12:49:48.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-24T12:49:48.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_hash.ko 2024-01-24T12:49:48.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_limit.ko 2024-01-24T12:49:48.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_log.ko 2024-01-24T12:49:48.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_masq.ko 2024-01-24T12:49:48.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_nat.ko 2024-01-24T12:49:48.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_numgen.ko 2024-01-24T12:49:48.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_osf.ko 2024-01-24T12:49:48.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_queue.ko 2024-01-24T12:49:48.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_redir.ko 2024-01-24T12:49:48.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_reject.ko 2024-01-24T12:49:48.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_reject_inet.ko 2024-01-24T12:49:48.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_socket.ko 2024-01-24T12:49:48.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_synproxy.ko 2024-01-24T12:49:48.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_tproxy.ko 2024-01-24T12:49:48.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 89321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/x_tables.ko 2024-01-24T12:49:48.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_AUDIT.ko 2024-01-24T12:49:48.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-24T12:49:48.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-24T12:49:48.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-24T12:49:48.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 18177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CT.ko 2024-01-24T12:49:48.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_DSCP.ko 2024-01-24T12:49:48.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_HL.ko 2024-01-24T12:49:48.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_HMARK.ko 2024-01-24T12:49:48.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 38881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-24T12:49:48.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_LED.ko 2024-01-24T12:49:48.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_LOG.ko 2024-01-24T12:49:48.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-24T12:49:48.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NETMAP.ko 2024-01-24T12:49:48.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NFLOG.ko 2024-01-24T12:49:48.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-24T12:49:48.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_RATEEST.ko 2024-01-24T12:49:48.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-24T12:49:48.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_SECMARK.ko 2024-01-24T12:49:48.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-24T12:49:48.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-24T12:49:48.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TEE.ko 2024-01-24T12:49:48.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TPROXY.ko 2024-01-24T12:49:48.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TRACE.ko 2024-01-24T12:49:48.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_addrtype.ko 2024-01-24T12:49:48.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_bpf.ko 2024-01-24T12:49:48.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cgroup.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cluster.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_comment.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connbytes.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connlabel.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connlimit.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connmark.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_conntrack.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cpu.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_dccp.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_devgroup.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_dscp.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ecn.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_esp.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 43305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_hashlimit.ko 2024-01-24T12:49:48.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_helper.ko 2024-01-24T12:49:48.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_hl.ko 2024-01-24T12:49:48.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ipcomp.ko 2024-01-24T12:49:48.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_iprange.ko 2024-01-24T12:49:48.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ipvs.ko 2024-01-24T12:49:48.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_l2tp.ko 2024-01-24T12:49:48.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_length.ko 2024-01-24T12:49:48.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_limit.ko 2024-01-24T12:49:48.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_mac.ko 2024-01-24T12:49:48.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_mark.ko 2024-01-24T12:49:48.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_multiport.ko 2024-01-24T12:49:48.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_nat.ko 2024-01-24T12:49:48.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_nfacct.ko 2024-01-24T12:49:48.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_osf.ko 2024-01-24T12:49:48.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_owner.ko 2024-01-24T12:49:48.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_physdev.ko 2024-01-24T12:49:48.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_pkttype.ko 2024-01-24T12:49:48.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_policy.ko 2024-01-24T12:49:48.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_quota.ko 2024-01-24T12:49:48.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_rateest.ko 2024-01-24T12:49:48.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_realm.ko 2024-01-24T12:49:48.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_recent.ko 2024-01-24T12:49:48.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_sctp.ko 2024-01-24T12:49:48.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_set.ko 2024-01-24T12:49:48.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_socket.ko 2024-01-24T12:49:48.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_state.ko 2024-01-24T12:49:48.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_statistic.ko 2024-01-24T12:49:48.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_string.ko 2024-01-24T12:49:48.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 8561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_tcpmss.ko 2024-01-24T12:49:48.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_tcpudp.ko 2024-01-24T12:49:48.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_time.ko 2024-01-24T12:49:48.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_u32.ko 2024-01-24T12:49:48.038 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netlink/ 2024-01-24T12:49:48.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 14545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netlink/netlink_diag.ko 2024-01-24T12:49:48.038 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/nsh/ 2024-01-24T12:49:48.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 12433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/nsh/nsh.ko 2024-01-24T12:49:48.038 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/ 2024-01-24T12:49:48.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 383545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/openvswitch.ko 2024-01-24T12:49:48.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-geneve.ko 2024-01-24T12:49:48.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-gre.ko 2024-01-24T12:49:48.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-vxlan.ko 2024-01-24T12:49:48.038 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/packet/ 2024-01-24T12:49:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/packet/af_packet_diag.ko 2024-01-24T12:49:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/phonet/ 2024-01-24T12:49:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 112089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/phonet/phonet.ko 2024-01-24T12:49:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 54873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/phonet/pn_pep.ko 2024-01-24T12:49:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rds/ 2024-01-24T12:49:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 253033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds.ko 2024-01-24T12:49:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 164993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds_rdma.ko 2024-01-24T12:49:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 68193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds_tcp.ko 2024-01-24T12:49:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rxrpc/ 2024-01-24T12:49:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 818929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rxrpc/rxrpc.ko 2024-01-24T12:49:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/ 2024-01-24T12:49:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_csum.ko 2024-01-24T12:49:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_gact.ko 2024-01-24T12:49:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_ipt.ko 2024-01-24T12:49:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_mirred.ko 2024-01-24T12:49:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_nat.ko 2024-01-24T12:49:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 43457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_pedit.ko 2024-01-24T12:49:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_police.ko 2024-01-24T12:49:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_simple.ko 2024-01-24T12:49:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_skbedit.ko 2024-01-24T12:49:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_vlan.ko 2024-01-24T12:49:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_basic.ko 2024-01-24T12:49:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_bpf.ko 2024-01-24T12:49:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 19289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_cgroup.ko 2024-01-24T12:49:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_flow.ko 2024-01-24T12:49:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 32385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_fw.ko 2024-01-24T12:49:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 40017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_route.ko 2024-01-24T12:49:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 61537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_u32.ko 2024-01-24T12:49:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_cmp.ko 2024-01-24T12:49:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 13417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_ipset.ko 2024-01-24T12:49:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_meta.ko 2024-01-24T12:49:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_nbyte.ko 2024-01-24T12:49:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_text.ko 2024-01-24T12:49:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_u32.ko 2024-01-24T12:49:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 21777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_choke.ko 2024-01-24T12:49:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_codel.ko 2024-01-24T12:49:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 34689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_drr.ko 2024-01-24T12:49:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_fq.ko 2024-01-24T12:49:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_fq_codel.ko 2024-01-24T12:49:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 35553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_gred.ko 2024-01-24T12:49:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 49945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_hfsc.ko 2024-01-24T12:49:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 22097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_hhf.ko 2024-01-24T12:49:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 66585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_htb.ko 2024-01-24T12:49:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_ingress.ko 2024-01-24T12:49:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 30393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_mqprio.ko 2024-01-24T12:49:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_mqprio_lib.ko 2024-01-24T12:49:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_multiq.ko 2024-01-24T12:49:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 36257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_netem.ko 2024-01-24T12:49:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 27505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_pie.ko 2024-01-24T12:49:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_plug.ko 2024-01-24T12:49:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 24849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_prio.ko 2024-01-24T12:49:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 48633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_qfq.ko 2024-01-24T12:49:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 33025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_red.ko 2024-01-24T12:49:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 26889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_sfb.ko 2024-01-24T12:49:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 31417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_sfq.ko 2024-01-24T12:49:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_tbf.ko 2024-01-24T12:49:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 28161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_teql.ko 2024-01-24T12:49:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/ 2024-01-24T12:49:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 932329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/sctp.ko 2024-01-24T12:49:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/sctp_diag.ko 2024-01-24T12:49:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/ 2024-01-24T12:49:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/ 2024-01-24T12:49:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 336817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-24T12:49:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 55025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-24T12:49:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 1518553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/sunrpc.ko 2024-01-24T12:49:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/xprtrdma/ 2024-01-24T12:49:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 708345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-24T12:49:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/ 2024-01-24T12:49:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 10497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/diag.ko 2024-01-24T12:49:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 866465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/tipc.ko 2024-01-24T12:49:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/unix/ 2024-01-24T12:49:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 16041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/unix/unix_diag.ko 2024-01-24T12:49:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/ 2024-01-24T12:49:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 86425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-24T12:49:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 68065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-24T12:49:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 98041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock.ko 2024-01-24T12:49:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 11185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-24T12:49:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 17769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-24T12:49:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/x25/ 2024-01-24T12:49:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 125473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/x25/x25.ko 2024-01-24T12:49:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/ 2024-01-24T12:49:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/xfrm_algo.ko 2024-01-24T12:49:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 20657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-24T12:49:48.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 104169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/xfrm_user.ko 2024-01-24T12:49:48.046 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/virt/ 2024-01-24T12:49:48.046 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/virt/lib/ 2024-01-24T12:49:48.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 15545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/virt/lib/irqbypass.ko 2024-01-24T12:49:48.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 641009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.alias 2024-01-24T12:49:48.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 625033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.alias.bin 2024-01-24T12:49:48.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 7677 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.builtin 2024-01-24T12:49:48.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 23634 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.builtin.alias.bin 2024-01-24T12:49:48.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 9916 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.builtin.bin 2024-01-24T12:49:48.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 70653 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.builtin.modinfo 2024-01-24T12:49:48.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 147734 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.dep 2024-01-24T12:49:48.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 234045 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.dep.bin 2024-01-24T12:49:48.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 210 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.devname 2024-01-24T12:49:48.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 72797 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.order 2024-01-24T12:49:48.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 879 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.softdep 2024-01-24T12:49:48.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 255175 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.symbols 2024-01-24T12:49:48.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 309826 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.symbols.bin 2024-01-24T12:49:48.047 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./usr/ 2024-01-24T12:49:48.047 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./usr/share/ 2024-01-24T12:49:48.047 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./usr/share/doc/ 2024-01-24T12:49:48.047 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./usr/share/doc/linux-image-6.7.0-gf2d346040895/ 2024-01-24T12:49:48.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 171 2024-01-24 04:16 ./usr/share/doc/linux-image-6.7.0-gf2d346040895/changelog.Debian.gz 2024-01-24T12:49:48.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r-- root/root 691 2024-01-24 04:16 ./usr/share/doc/linux-image-6.7.0-gf2d346040895/copyright 2024-01-24T12:49:48.048 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-gf2d346040895 2024-01-24T12:49:48.048 INFO:teuthology.task.kernel:searching for kernel 6.7.0-gf2d346040895 2024-01-24T12:49:48.048 DEBUG:teuthology.orchestra.run.smithi029:> egrep '(submenu|menuentry.*6.7.0-gf2d346040895).*{' /boot/grub/grub.cfg 2024-01-24T12:49:48.056 INFO:teuthology.orchestra.run.smithi029.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-24T12:49:48.056 INFO:teuthology.orchestra.run.smithi029.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gf2d346040895' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gf2d346040895-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-24T12:49:48.056 INFO:teuthology.orchestra.run.smithi029.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gf2d346040895 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gf2d346040895-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-24T12:49:48.057 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-24T12:49:48.057 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.7.0-gf2d346040895 2024-01-24T12:49:48.057 DEBUG:teuthology.orchestra.run.smithi029:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-24T12:49:48.100 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi029.front.sepia.ceph.com to complete... 2024-01-24T12:49:48.687 INFO:teuthology.orchestra.run.smithi029.stderr:Sourcing file `/etc/default/grub' 2024-01-24T12:49:48.695 INFO:teuthology.orchestra.run.smithi029.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-24T12:49:48.708 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2024-01-24T12:49:48.997 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-6.7.0-gf2d346040895 2024-01-24T12:49:49.004 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-6.7.0-gf2d346040895 2024-01-24T12:49:49.234 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-24T12:49:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-24T12:49:49.282 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-24T12:49:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-24T12:49:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-24T12:49:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-24T12:49:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-24T12:49:49.433 INFO:teuthology.orchestra.run.smithi029.stderr:done 2024-01-24T12:50:04.797 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-01-24T12:50:04.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-01-24T12:50:04.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:50:20.632 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-01-24T12:50:20.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-24T12:50:20.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:50:23.164 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-24T12:50:32.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-01-24T12:50:32.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:50:35.228 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-24T12:50:39.036 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-24T12:50:47.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-01-24T12:50:47.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:50:48.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-24T12:50:48.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:50:50.300 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-24T12:51:05.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-01-24T12:51:05.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:51:23.840 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-24T12:51:41.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-01-24T12:51:41.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:51:42.455 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-01-24T12:51:43.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-01-24T12:51:43.660 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.7.0-gf2d346040895"... 2024-01-24T12:51:43.660 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-01-24T12:51:43.708 INFO:teuthology.orchestra.run.smithi163.stdout:6.7.0-gf2d346040895 2024-01-24T12:51:43.709 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-gf2d346040895 vs 6.7.0-gf2d346040895 2024-01-24T12:51:43.709 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-24T12:51:43.709 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-24T12:51:44.710 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-01-24T12:51:44.710 DEBUG:teuthology.orchestra.run.smithi163:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-24T12:51:45.246 INFO:teuthology.orchestra.run.smithi163.stdout:ttyS1 2024-01-24T12:51:45.296 DEBUG:teuthology.parallel:result is None 2024-01-24T12:51:48.041 DEBUG:teuthology.orchestra.remote:timed out 2024-01-24T12:52:00.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-24T12:52:00.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:52:00.360 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-01-24T12:52:01.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-24T12:52:01.346 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.7.0-gf2d346040895"... 2024-01-24T12:52:01.347 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-01-24T12:52:01.397 INFO:teuthology.orchestra.run.smithi029.stdout:6.7.0-gf2d346040895 2024-01-24T12:52:01.397 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-gf2d346040895 vs 6.7.0-gf2d346040895 2024-01-24T12:52:01.398 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-24T12:52:01.398 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-24T12:52:02.399 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-01-24T12:52:02.399 DEBUG:teuthology.orchestra.run.smithi029:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-24T12:52:02.521 INFO:teuthology.orchestra.run.smithi029.stdout:ttyS1 2024-01-24T12:52:02.560 DEBUG:teuthology.parallel:result is None 2024-01-24T12:52:02.561 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-24T12:52:02.572 INFO:teuthology.task.internal:Creating test directory... 2024-01-24T12:52:02.572 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-24T12:52:02.575 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-24T12:52:02.585 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-24T12:52:02.677 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-24T12:52:02.693 INFO:teuthology.task.internal:Creating archive directory... 2024-01-24T12:52:02.693 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-24T12:52:02.696 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-24T12:52:02.725 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-24T12:52:02.736 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-24T12:52:02.736 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-24T12:52:02.752 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-24T12:52:02.779 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T12:52:02.794 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T12:52:02.799 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T12:52:02.813 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T12:52:02.816 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-24T12:52:02.824 INFO:teuthology.task.internal:Configuring sudo... 2024-01-24T12:52:02.824 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-24T12:52:02.844 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-24T12:52:02.877 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-24T12:52:02.890 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-24T12:52:02.890 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-24T12:52:02.912 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-24T12:52:02.928 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-24T12:52:02.974 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-24T12:52:03.027 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T12:52:03.027 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-24T12:52:03.097 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-24T12:52:03.106 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-24T12:52:03.157 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T12:52:03.157 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-24T12:52:03.229 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2024-01-24T12:52:03.232 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2024-01-24T12:52:03.374 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-24T12:52:03.382 INFO:teuthology.task.internal:Starting timer... 2024-01-24T12:52:03.383 INFO:teuthology.run_tasks:Running task pcp... 2024-01-24T12:52:03.399 INFO:teuthology.run_tasks:Running task selinux... 2024-01-24T12:52:03.413 DEBUG:teuthology.task.selinux:Excluding smithi029: OS 'ubuntu' does not support SELinux 2024-01-24T12:52:03.413 DEBUG:teuthology.task.selinux:Excluding smithi163: OS 'ubuntu' does not support SELinux 2024-01-24T12:52:03.414 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-24T12:52:03.414 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-01-24T12:52:03.414 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-24T12:52:03.414 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-24T12:52:03.429 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-24T12:52:03.446 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-24T12:52:03.447 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi163.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-24T12:59:50.118 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi163.front.sepia.ceph.com')] 2024-01-24T12:59:50.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-24T12:59:50.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:59:50.205 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-01-24T12:59:50.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-24T12:59:50.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-01-24T12:59:50.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:59:50.404 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-01-24T12:59:50.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-01-24T12:59:50.519 INFO:teuthology.run_tasks:Running task clock... 2024-01-24T12:59:50.530 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-24T12:59:50.530 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-24T12:59:50.531 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T12:59:50.534 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-24T12:59:50.534 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T12:59:50.570 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-24T12:59:50.570 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: Command line: ntpd -gq 2024-01-24T12:59:50.570 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: ---------------------------------------------------- 2024-01-24T12:59:50.570 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: ntp-4 is maintained by Network Time Foundation, 2024-01-24T12:59:50.570 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-24T12:59:50.570 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: corporation. Support and training for ntp-4 are 2024-01-24T12:59:50.570 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: available at https://www.nwtime.org/support 2024-01-24T12:59:50.570 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: ---------------------------------------------------- 2024-01-24T12:59:50.571 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: proto: precision = 0.043 usec (-24) 2024-01-24T12:59:50.571 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: basedate set to 2022-02-04 2024-01-24T12:59:50.571 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: gps base set to 2022-02-06 (week 2196) 2024-01-24T12:59:50.571 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-24T12:59:50.572 INFO:teuthology.orchestra.run.smithi029.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-24T12:59:50.572 INFO:teuthology.orchestra.run.smithi029.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-24T12:59:50.572 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: restrict ::: KOD does nothing without LIMITED. 2024-01-24T12:59:50.573 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: Listen and drop on 0 v6wildcard [::]:123 2024-01-24T12:59:50.573 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-24T12:59:50.573 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: Listen normally on 2 lo 127.0.0.1:123 2024-01-24T12:59:50.573 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: Listen normally on 3 ens1f0 172.21.15.29:123 2024-01-24T12:59:50.574 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: Listen normally on 4 lo [::1]:123 2024-01-24T12:59:50.574 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:125a%2]:123 2024-01-24T12:59:50.574 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:50 ntpd[16818]: Listening on routing socket on fd #22 for interface updates 2024-01-24T12:59:50.603 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-24T12:59:50.603 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: Command line: ntpd -gq 2024-01-24T12:59:50.604 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: ---------------------------------------------------- 2024-01-24T12:59:50.604 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: ntp-4 is maintained by Network Time Foundation, 2024-01-24T12:59:50.604 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-24T12:59:50.604 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: corporation. Support and training for ntp-4 are 2024-01-24T12:59:50.604 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: available at https://www.nwtime.org/support 2024-01-24T12:59:50.604 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: ---------------------------------------------------- 2024-01-24T12:59:50.605 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: proto: precision = 0.042 usec (-24) 2024-01-24T12:59:50.605 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: basedate set to 2022-02-04 2024-01-24T12:59:50.605 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: gps base set to 2022-02-06 (week 2196) 2024-01-24T12:59:50.605 INFO:teuthology.orchestra.run.smithi163.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-24T12:59:50.606 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-24T12:59:50.606 INFO:teuthology.orchestra.run.smithi163.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-24T12:59:50.607 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: restrict ::: KOD does nothing without LIMITED. 2024-01-24T12:59:50.607 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: Listen and drop on 0 v6wildcard [::]:123 2024-01-24T12:59:50.607 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-24T12:59:50.607 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: Listen normally on 2 lo 127.0.0.1:123 2024-01-24T12:59:50.607 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: Listen normally on 3 enp3s0f1 172.21.15.163:123 2024-01-24T12:59:50.607 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: Listen normally on 4 lo [::1]:123 2024-01-24T12:59:50.607 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7d5b%5]:123 2024-01-24T12:59:50.608 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:50 ntpd[16844]: Listening on routing socket on fd #22 for interface updates 2024-01-24T12:59:51.571 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:51 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:51.571 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:51 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:51.571 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:51 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:51.571 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:51 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:51.571 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:51 ntpd[16818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:51.571 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:51 ntpd[16818]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:53.575 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:53.575 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:53.575 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:53.575 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:53.575 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:53.575 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:53.575 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:53.575 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:53.575 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:53.575 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:53.576 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:53.576 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:53.576 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:53.576 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:53.576 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:53.576 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:53.576 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:53.576 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:53.576 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:53.576 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:53 ntpd[16818]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:53.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:53 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:53 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:53 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:53 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:53 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:53 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:53 ntpd[16844]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:53 ntpd[16844]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:53 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:53 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:53 ntpd[16844]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:53 ntpd[16844]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:54.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:54 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:54.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:54 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:54.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:54 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:54.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:54 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:54.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:54 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:54.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:54 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:54.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:54 ntpd[16844]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:54.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:54 ntpd[16844]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:55.572 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:55.572 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:55.572 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:55.572 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:55.572 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:55.572 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:55.572 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:55 ntpd[16818]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:55.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:55 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:55 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:55 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:55 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:55 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:55 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:55 ntpd[16844]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:55 ntpd[16844]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:55 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:55 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:55 ntpd[16844]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:55 ntpd[16844]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:56.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:56 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:56.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:56 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:56.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:56 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:56.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:56 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:56.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:56 ntpd[16844]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:56.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:56 ntpd[16844]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:57.571 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:57 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:57.571 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:57 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:57.571 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:57 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:57.571 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:57 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:57.571 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:57 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:57.571 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:57 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:57.571 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:57 ntpd[16818]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:57.572 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:57 ntpd[16818]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:57.572 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:57 ntpd[16818]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:57.572 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:57 ntpd[16818]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:57.572 INFO:teuthology.orchestra.run.smithi029.stdout:24 Jan 12:59:57 ntpd[16818]: ntpd: time slew -0.000220 s 2024-01-24T12:59:57.572 INFO:teuthology.orchestra.run.smithi029.stdout:ntpd: time slew -0.000220s 2024-01-24T12:59:57.573 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:57 ntpd[16818]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-24T12:59:57.573 INFO:teuthology.orchestra.run.smithi029.stderr:24 Jan 12:59:57 ntpd[16818]: can't open /var/log/ntpstats/loopstats.20240124: Permission denied 2024-01-24T12:59:57.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:57 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:57.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:57 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:57.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:57 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:57.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:57 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:57.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:57 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:57.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:57 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:57.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:57 ntpd[16844]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:57.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:57 ntpd[16844]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:57.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:57 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:57.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:57 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:57.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:57 ntpd[16844]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:57.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:57 ntpd[16844]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:57.704 INFO:teuthology.orchestra.run.smithi029.stdout: remote refid st t when poll reach delay offset jitter 2024-01-24T12:59:57.705 INFO:teuthology.orchestra.run.smithi029.stdout:============================================================================== 2024-01-24T12:59:57.705 INFO:teuthology.orchestra.run.smithi029.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:59:57.705 INFO:teuthology.orchestra.run.smithi029.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:59:57.705 INFO:teuthology.orchestra.run.smithi029.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:59:57.705 INFO:teuthology.orchestra.run.smithi029.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:59:58.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:58 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:58.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:58 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:58.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:58 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:58.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:58 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:58.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:58 ntpd[16844]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:58.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:58 ntpd[16844]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:59.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:59 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:59.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:59 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:59.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:59 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:59.604 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:59 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:59.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:59 ntpd[16844]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:59:59.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:59 ntpd[16844]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:59:59.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:59 ntpd[16844]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:59:59.605 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:59 ntpd[16844]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:59:59.605 INFO:teuthology.orchestra.run.smithi163.stdout:24 Jan 12:59:59 ntpd[16844]: ntpd: time slew -0.000140 s 2024-01-24T12:59:59.605 INFO:teuthology.orchestra.run.smithi163.stdout:ntpd: time slew -0.000140s 2024-01-24T12:59:59.606 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:59 ntpd[16844]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-24T12:59:59.606 INFO:teuthology.orchestra.run.smithi163.stderr:24 Jan 12:59:59 ntpd[16844]: can't open /var/log/ntpstats/loopstats.20240124: Permission denied 2024-01-24T12:59:59.703 INFO:teuthology.orchestra.run.smithi163.stdout: remote refid st t when poll reach delay offset jitter 2024-01-24T12:59:59.704 INFO:teuthology.orchestra.run.smithi163.stdout:============================================================================== 2024-01-24T12:59:59.704 INFO:teuthology.orchestra.run.smithi163.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:59:59.704 INFO:teuthology.orchestra.run.smithi163.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:59:59.704 INFO:teuthology.orchestra.run.smithi163.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:59:59.704 INFO:teuthology.orchestra.run.smithi163.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:59:59.705 INFO:teuthology.run_tasks:Running task install... 2024-01-24T12:59:59.714 DEBUG:teuthology.task.install:project ceph 2024-01-24T12:59:59.714 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134'}} 2024-01-24T12:59:59.715 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134'} 2024-01-24T12:59:59.715 INFO:teuthology.task.install:Using flavor: default 2024-01-24T12:59:59.721 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-24T12:59:59.721 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-01-24T12:59:59.721 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-key list | grep Ceph 2024-01-24T12:59:59.722 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-key list | grep Ceph 2024-01-24T12:59:59.831 INFO:teuthology.orchestra.run.smithi029.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-24T12:59:59.851 INFO:teuthology.orchestra.run.smithi163.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-24T12:59:59.883 INFO:teuthology.orchestra.run.smithi029.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-24T12:59:59.884 INFO:teuthology.orchestra.run.smithi029.stdout:uid [ unknown] Ceph.com (release key) 2024-01-24T12:59:59.885 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-24T12:59:59.885 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-24T12:59:59.885 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T12:59:59.901 INFO:teuthology.orchestra.run.smithi163.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-24T12:59:59.901 INFO:teuthology.orchestra.run.smithi163.stdout:uid [ unknown] Ceph.com (release key) 2024-01-24T12:59:59.902 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-24T12:59:59.902 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-24T12:59:59.902 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T13:00:00.065 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default/ 2024-01-24T13:00:00.066 INFO:teuthology.task.install.deb:Package version is 18.2.1-341-g4e3182a6-1jammy 2024-01-24T13:00:00.114 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default/ 2024-01-24T13:00:00.114 INFO:teuthology.task.install.deb:Package version is 18.2.1-341-g4e3182a6-1jammy 2024-01-24T13:00:00.195 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:00:00.195 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-24T13:00:00.214 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get update 2024-01-24T13:00:00.283 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:00:00.283 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-24T13:00:00.304 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get update 2024-01-24T13:00:00.447 INFO:teuthology.orchestra.run.smithi163.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy InRelease 2024-01-24T13:00:00.469 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-24T13:00:00.491 INFO:teuthology.orchestra.run.smithi163.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-24T13:00:00.498 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-24T13:00:00.498 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-24T13:00:00.507 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-24T13:00:00.526 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-24T13:00:00.533 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2024-01-24T13:00:00.554 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-24T13:00:00.554 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-24T13:00:00.576 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-01-24T13:00:00.617 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-24T13:00:00.622 INFO:teuthology.orchestra.run.smithi029.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy InRelease 2024-01-24T13:00:00.659 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-24T13:00:00.695 INFO:teuthology.orchestra.run.smithi029.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-24T13:00:00.699 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-24T13:00:00.732 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2024-01-24T13:00:00.779 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-01-24T13:00:01.105 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 28.5 kB in 1s (49.8 kB/s) 2024-01-24T13:00:01.136 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 28.5 kB in 1s (40.7 kB/s) 2024-01-24T13:00:02.057 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-01-24T13:00:02.058 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-01-24T13:00:02.071 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.1-341-g4e3182a6-1jammy cephadm=18.2.1-341-g4e3182a6-1jammy ceph-mds=18.2.1-341-g4e3182a6-1jammy ceph-mgr=18.2.1-341-g4e3182a6-1jammy ceph-common=18.2.1-341-g4e3182a6-1jammy ceph-fuse=18.2.1-341-g4e3182a6-1jammy ceph-test=18.2.1-341-g4e3182a6-1jammy ceph-volume=18.2.1-341-g4e3182a6-1jammy radosgw=18.2.1-341-g4e3182a6-1jammy python3-rados=18.2.1-341-g4e3182a6-1jammy python3-rgw=18.2.1-341-g4e3182a6-1jammy python3-cephfs=18.2.1-341-g4e3182a6-1jammy python3-rbd=18.2.1-341-g4e3182a6-1jammy libcephfs2=18.2.1-341-g4e3182a6-1jammy libcephfs-dev=18.2.1-341-g4e3182a6-1jammy librados2=18.2.1-341-g4e3182a6-1jammy librbd1=18.2.1-341-g4e3182a6-1jammy rbd-fuse=18.2.1-341-g4e3182a6-1jammy python3-cephfs=18.2.1-341-g4e3182a6-1jammy cephfs-shell=18.2.1-341-g4e3182a6-1jammy cephfs-top=18.2.1-341-g4e3182a6-1jammy cephfs-mirror=18.2.1-341-g4e3182a6-1jammy 2024-01-24T13:00:02.073 DEBUG:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.1-341-g4e3182a6-1jammy cephadm=18.2.1-341-g4e3182a6-1jammy ceph-mds=18.2.1-341-g4e3182a6-1jammy ceph-mgr=18.2.1-341-g4e3182a6-1jammy ceph-common=18.2.1-341-g4e3182a6-1jammy ceph-fuse=18.2.1-341-g4e3182a6-1jammy ceph-test=18.2.1-341-g4e3182a6-1jammy ceph-volume=18.2.1-341-g4e3182a6-1jammy radosgw=18.2.1-341-g4e3182a6-1jammy python3-rados=18.2.1-341-g4e3182a6-1jammy python3-rgw=18.2.1-341-g4e3182a6-1jammy python3-cephfs=18.2.1-341-g4e3182a6-1jammy python3-rbd=18.2.1-341-g4e3182a6-1jammy libcephfs2=18.2.1-341-g4e3182a6-1jammy libcephfs-dev=18.2.1-341-g4e3182a6-1jammy librados2=18.2.1-341-g4e3182a6-1jammy librbd1=18.2.1-341-g4e3182a6-1jammy rbd-fuse=18.2.1-341-g4e3182a6-1jammy python3-cephfs=18.2.1-341-g4e3182a6-1jammy cephfs-shell=18.2.1-341-g4e3182a6-1jammy cephfs-top=18.2.1-341-g4e3182a6-1jammy cephfs-mirror=18.2.1-341-g4e3182a6-1jammy 2024-01-24T13:00:02.145 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-01-24T13:00:02.149 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-01-24T13:00:02.311 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2024-01-24T13:00:02.311 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2024-01-24T13:00:02.323 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2024-01-24T13:00:02.323 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2024-01-24T13:00:02.466 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages were automatically installed and are no longer required: 2024-01-24T13:00:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-24T13:00:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-24T13:00:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-24T13:00:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-24T13:00:02.466 INFO:teuthology.orchestra.run.smithi163.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-24T13:00:02.466 INFO:teuthology.orchestra.run.smithi163.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-24T13:00:02.468 INFO:teuthology.orchestra.run.smithi163.stdout:The following additional packages will be installed: 2024-01-24T13:00:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-24T13:00:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-24T13:00:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-01-24T13:00:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-24T13:00:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-01-24T13:00:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-24T13:00:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-24T13:00:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-24T13:00:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-24T13:00:02.468 INFO:teuthology.orchestra.run.smithi163.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-24T13:00:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-24T13:00:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-24T13:00:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-24T13:00:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-24T13:00:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-24T13:00:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-24T13:00:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-24T13:00:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-24T13:00:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-24T13:00:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-24T13:00:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-24T13:00:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-24T13:00:02.469 INFO:teuthology.orchestra.run.smithi163.stdout: qttranslations5-l10n socat xmlstarlet 2024-01-24T13:00:02.470 INFO:teuthology.orchestra.run.smithi163.stdout:Suggested packages: 2024-01-24T13:00:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-01-24T13:00:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-01-24T13:00:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-01-24T13:00:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-01-24T13:00:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-01-24T13:00:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-01-24T13:00:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: python3-watchdog 2024-01-24T13:00:02.470 INFO:teuthology.orchestra.run.smithi163.stdout:Recommended packages: 2024-01-24T13:00:02.470 INFO:teuthology.orchestra.run.smithi163.stdout: btrfs-tools 2024-01-24T13:00:02.484 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages were automatically installed and are no longer required: 2024-01-24T13:00:02.484 INFO:teuthology.orchestra.run.smithi029.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-24T13:00:02.484 INFO:teuthology.orchestra.run.smithi029.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-24T13:00:02.484 INFO:teuthology.orchestra.run.smithi029.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-24T13:00:02.484 INFO:teuthology.orchestra.run.smithi029.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-24T13:00:02.485 INFO:teuthology.orchestra.run.smithi029.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-24T13:00:02.485 INFO:teuthology.orchestra.run.smithi029.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-24T13:00:02.485 INFO:teuthology.orchestra.run.smithi029.stdout:The following additional packages will be installed: 2024-01-24T13:00:02.485 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-24T13:00:02.485 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-24T13:00:02.486 INFO:teuthology.orchestra.run.smithi029.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-01-24T13:00:02.486 INFO:teuthology.orchestra.run.smithi029.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-24T13:00:02.487 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-01-24T13:00:02.487 INFO:teuthology.orchestra.run.smithi029.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-24T13:00:02.487 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-24T13:00:02.487 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-24T13:00:02.487 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-24T13:00:02.487 INFO:teuthology.orchestra.run.smithi029.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-24T13:00:02.487 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-24T13:00:02.487 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-24T13:00:02.487 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-24T13:00:02.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-24T13:00:02.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-24T13:00:02.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-24T13:00:02.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-24T13:00:02.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-24T13:00:02.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-24T13:00:02.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-24T13:00:02.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-24T13:00:02.488 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-24T13:00:02.488 INFO:teuthology.orchestra.run.smithi029.stdout: qttranslations5-l10n socat xmlstarlet 2024-01-24T13:00:02.489 INFO:teuthology.orchestra.run.smithi029.stdout:Suggested packages: 2024-01-24T13:00:02.489 INFO:teuthology.orchestra.run.smithi029.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-01-24T13:00:02.489 INFO:teuthology.orchestra.run.smithi029.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-01-24T13:00:02.489 INFO:teuthology.orchestra.run.smithi029.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-01-24T13:00:02.489 INFO:teuthology.orchestra.run.smithi029.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-01-24T13:00:02.489 INFO:teuthology.orchestra.run.smithi029.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-01-24T13:00:02.489 INFO:teuthology.orchestra.run.smithi029.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-01-24T13:00:02.489 INFO:teuthology.orchestra.run.smithi029.stdout: python3-watchdog 2024-01-24T13:00:02.489 INFO:teuthology.orchestra.run.smithi029.stdout:Recommended packages: 2024-01-24T13:00:02.489 INFO:teuthology.orchestra.run.smithi029.stdout: btrfs-tools 2024-01-24T13:00:02.614 INFO:teuthology.orchestra.run.smithi163.stdout:The following NEW packages will be installed: 2024-01-24T13:00:02.614 INFO:teuthology.orchestra.run.smithi163.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-24T13:00:02.614 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-24T13:00:02.614 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-24T13:00:02.614 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-24T13:00:02.614 INFO:teuthology.orchestra.run.smithi163.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-01-24T13:00:02.614 INFO:teuthology.orchestra.run.smithi163.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-24T13:00:02.614 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-01-24T13:00:02.614 INFO:teuthology.orchestra.run.smithi163.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-01-24T13:00:02.615 INFO:teuthology.orchestra.run.smithi163.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-24T13:00:02.615 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-24T13:00:02.615 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-24T13:00:02.615 INFO:teuthology.orchestra.run.smithi163.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-24T13:00:02.615 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-24T13:00:02.615 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-24T13:00:02.615 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-24T13:00:02.615 INFO:teuthology.orchestra.run.smithi163.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-24T13:00:02.615 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-24T13:00:02.615 INFO:teuthology.orchestra.run.smithi163.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-24T13:00:02.615 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-24T13:00:02.615 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-24T13:00:02.615 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-24T13:00:02.615 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-24T13:00:02.616 INFO:teuthology.orchestra.run.smithi163.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-24T13:00:02.616 INFO:teuthology.orchestra.run.smithi163.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-24T13:00:02.616 INFO:teuthology.orchestra.run.smithi163.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-24T13:00:02.616 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-24T13:00:02.616 INFO:teuthology.orchestra.run.smithi163.stdout: socat xmlstarlet 2024-01-24T13:00:02.637 INFO:teuthology.orchestra.run.smithi029.stdout:The following NEW packages will be installed: 2024-01-24T13:00:02.637 INFO:teuthology.orchestra.run.smithi029.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-24T13:00:02.637 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-24T13:00:02.637 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-24T13:00:02.638 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-24T13:00:02.638 INFO:teuthology.orchestra.run.smithi029.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-01-24T13:00:02.638 INFO:teuthology.orchestra.run.smithi029.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-24T13:00:02.638 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-01-24T13:00:02.639 INFO:teuthology.orchestra.run.smithi029.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-01-24T13:00:02.639 INFO:teuthology.orchestra.run.smithi029.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-24T13:00:02.639 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-24T13:00:02.639 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-24T13:00:02.639 INFO:teuthology.orchestra.run.smithi029.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-24T13:00:02.639 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-24T13:00:02.639 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-24T13:00:02.639 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-24T13:00:02.640 INFO:teuthology.orchestra.run.smithi029.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-24T13:00:02.640 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-24T13:00:02.640 INFO:teuthology.orchestra.run.smithi029.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-24T13:00:02.640 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-24T13:00:02.640 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-24T13:00:02.640 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-24T13:00:02.640 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-24T13:00:02.640 INFO:teuthology.orchestra.run.smithi029.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-24T13:00:02.640 INFO:teuthology.orchestra.run.smithi029.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-24T13:00:02.640 INFO:teuthology.orchestra.run.smithi029.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-24T13:00:02.641 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-24T13:00:02.641 INFO:teuthology.orchestra.run.smithi029.stdout: socat xmlstarlet 2024-01-24T13:00:02.780 INFO:teuthology.orchestra.run.smithi163.stdout:0 upgraded, 115 newly installed, 0 to remove and 269 not upgraded. 2024-01-24T13:00:02.780 INFO:teuthology.orchestra.run.smithi163.stdout:Need to get 181 MB of archives. 2024-01-24T13:00:02.780 INFO:teuthology.orchestra.run.smithi163.stdout:After this operation, 812 MB of additional disk space will be used. 2024-01-24T13:00:02.781 INFO:teuthology.orchestra.run.smithi163.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.1-341-g4e3182a6-1jammy [3,416 kB] 2024-01-24T13:00:02.845 INFO:teuthology.orchestra.run.smithi029.stdout:0 upgraded, 115 newly installed, 0 to remove and 269 not upgraded. 2024-01-24T13:00:02.845 INFO:teuthology.orchestra.run.smithi029.stdout:Need to get 181 MB of archives. 2024-01-24T13:00:02.845 INFO:teuthology.orchestra.run.smithi029.stdout:After this operation, 812 MB of additional disk space will be used. 2024-01-24T13:00:02.845 INFO:teuthology.orchestra.run.smithi029.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.1-341-g4e3182a6-1jammy [3,416 kB] 2024-01-24T13:00:03.059 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.1-341-g4e3182a6-1jammy [3,103 kB] 2024-01-24T13:00:03.174 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.1-341-g4e3182a6-1jammy [671 kB] 2024-01-24T13:00:03.193 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.1-341-g4e3182a6-1jammy [356 kB] 2024-01-24T13:00:03.267 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.1-341-g4e3182a6-1jammy [32.8 kB] 2024-01-24T13:00:03.311 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.1-341-g4e3182a6-1jammy [180 kB] 2024-01-24T13:00:03.344 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.1-341-g4e3182a6-1jammy [61.5 kB] 2024-01-24T13:00:03.488 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.1-341-g4e3182a6-1jammy [330 kB] 2024-01-24T13:00:03.536 INFO:teuthology.orchestra.run.smithi163.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.1-341-g4e3182a6-1jammy [5,882 kB] 2024-01-24T13:00:03.723 INFO:teuthology.orchestra.run.smithi163.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-24T13:00:03.740 INFO:teuthology.orchestra.run.smithi163.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.1-341-g4e3182a6-1jammy [112 kB] 2024-01-24T13:00:03.741 INFO:teuthology.orchestra.run.smithi163.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.1-341-g4e3182a6-1jammy [442 kB] 2024-01-24T13:00:03.756 INFO:teuthology.orchestra.run.smithi163.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.1-341-g4e3182a6-1jammy [22.0 MB] 2024-01-24T13:00:03.781 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-24T13:00:03.801 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-24T13:00:03.806 INFO:teuthology.orchestra.run.smithi163.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-24T13:00:03.813 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-24T13:00:03.852 INFO:teuthology.orchestra.run.smithi163.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-24T13:00:03.862 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-01-24T13:00:03.873 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-24T13:00:03.892 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-24T13:00:03.894 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-24T13:00:03.906 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-24T13:00:03.948 INFO:teuthology.orchestra.run.smithi029.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-24T13:00:03.950 INFO:teuthology.orchestra.run.smithi029.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-24T13:00:03.957 INFO:teuthology.orchestra.run.smithi029.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-24T13:00:03.960 INFO:teuthology.orchestra.run.smithi029.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-24T13:00:03.961 INFO:teuthology.orchestra.run.smithi029.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-24T13:00:03.967 INFO:teuthology.orchestra.run.smithi029.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-24T13:00:03.968 INFO:teuthology.orchestra.run.smithi029.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-24T13:00:03.968 INFO:teuthology.orchestra.run.smithi029.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-24T13:00:03.969 INFO:teuthology.orchestra.run.smithi029.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-24T13:00:03.969 INFO:teuthology.orchestra.run.smithi029.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-24T13:00:03.990 INFO:teuthology.orchestra.run.smithi029.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-24T13:00:03.990 INFO:teuthology.orchestra.run.smithi029.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-24T13:00:03.991 INFO:teuthology.orchestra.run.smithi029.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-24T13:00:03.992 INFO:teuthology.orchestra.run.smithi029.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-24T13:00:03.992 INFO:teuthology.orchestra.run.smithi029.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-24T13:00:03.994 INFO:teuthology.orchestra.run.smithi029.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-24T13:00:03.995 INFO:teuthology.orchestra.run.smithi029.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-24T13:00:03.996 INFO:teuthology.orchestra.run.smithi029.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-24T13:00:04.010 INFO:teuthology.orchestra.run.smithi029.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-24T13:00:04.010 INFO:teuthology.orchestra.run.smithi029.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-24T13:00:04.030 INFO:teuthology.orchestra.run.smithi029.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-24T13:00:04.030 INFO:teuthology.orchestra.run.smithi029.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-24T13:00:04.031 INFO:teuthology.orchestra.run.smithi029.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-24T13:00:04.031 INFO:teuthology.orchestra.run.smithi029.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-24T13:00:04.032 INFO:teuthology.orchestra.run.smithi029.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-24T13:00:04.037 INFO:teuthology.orchestra.run.smithi029.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-24T13:00:04.037 INFO:teuthology.orchestra.run.smithi029.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-24T13:00:04.038 INFO:teuthology.orchestra.run.smithi029.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-24T13:00:04.049 INFO:teuthology.orchestra.run.smithi029.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-24T13:00:04.050 INFO:teuthology.orchestra.run.smithi029.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-24T13:00:04.059 INFO:teuthology.orchestra.run.smithi029.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-24T13:00:04.060 INFO:teuthology.orchestra.run.smithi029.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-24T13:00:04.060 INFO:teuthology.orchestra.run.smithi163.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-01-24T13:00:04.061 INFO:teuthology.orchestra.run.smithi029.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-24T13:00:04.061 INFO:teuthology.orchestra.run.smithi029.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-24T13:00:04.064 INFO:teuthology.orchestra.run.smithi029.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-24T13:00:04.064 INFO:teuthology.orchestra.run.smithi029.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-24T13:00:04.066 INFO:teuthology.orchestra.run.smithi029.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-24T13:00:04.101 INFO:teuthology.orchestra.run.smithi163.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-24T13:00:04.116 INFO:teuthology.orchestra.run.smithi029.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-24T13:00:04.117 INFO:teuthology.orchestra.run.smithi029.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-24T13:00:04.118 INFO:teuthology.orchestra.run.smithi029.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-24T13:00:04.119 INFO:teuthology.orchestra.run.smithi029.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-24T13:00:04.119 INFO:teuthology.orchestra.run.smithi029.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-24T13:00:04.121 INFO:teuthology.orchestra.run.smithi029.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-24T13:00:04.121 INFO:teuthology.orchestra.run.smithi029.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-24T13:00:04.121 INFO:teuthology.orchestra.run.smithi029.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-24T13:00:04.124 INFO:teuthology.orchestra.run.smithi029.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-24T13:00:04.140 INFO:teuthology.orchestra.run.smithi029.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-24T13:00:04.146 INFO:teuthology.orchestra.run.smithi029.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-24T13:00:04.167 INFO:teuthology.orchestra.run.smithi029.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-24T13:00:04.169 INFO:teuthology.orchestra.run.smithi029.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-24T13:00:04.169 INFO:teuthology.orchestra.run.smithi029.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-24T13:00:04.177 INFO:teuthology.orchestra.run.smithi163.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-24T13:00:04.189 INFO:teuthology.orchestra.run.smithi029.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-24T13:00:04.189 INFO:teuthology.orchestra.run.smithi029.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-24T13:00:04.190 INFO:teuthology.orchestra.run.smithi029.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-24T13:00:04.190 INFO:teuthology.orchestra.run.smithi029.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-24T13:00:04.191 INFO:teuthology.orchestra.run.smithi163.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-24T13:00:04.191 INFO:teuthology.orchestra.run.smithi029.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-24T13:00:04.208 INFO:teuthology.orchestra.run.smithi029.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-24T13:00:04.208 INFO:teuthology.orchestra.run.smithi029.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-24T13:00:04.209 INFO:teuthology.orchestra.run.smithi029.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-24T13:00:04.213 INFO:teuthology.orchestra.run.smithi029.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-24T13:00:04.229 INFO:teuthology.orchestra.run.smithi029.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-24T13:00:04.231 INFO:teuthology.orchestra.run.smithi029.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-24T13:00:04.231 INFO:teuthology.orchestra.run.smithi029.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-24T13:00:04.232 INFO:teuthology.orchestra.run.smithi163.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-24T13:00:04.235 INFO:teuthology.orchestra.run.smithi029.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-24T13:00:04.239 INFO:teuthology.orchestra.run.smithi029.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-24T13:00:04.239 INFO:teuthology.orchestra.run.smithi029.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-24T13:00:04.249 INFO:teuthology.orchestra.run.smithi029.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-24T13:00:04.252 INFO:teuthology.orchestra.run.smithi029.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-24T13:00:04.253 INFO:teuthology.orchestra.run.smithi029.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-24T13:00:04.255 INFO:teuthology.orchestra.run.smithi029.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-24T13:00:04.269 INFO:teuthology.orchestra.run.smithi029.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-24T13:00:04.269 INFO:teuthology.orchestra.run.smithi029.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-24T13:00:04.270 INFO:teuthology.orchestra.run.smithi029.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-24T13:00:04.410 INFO:teuthology.orchestra.run.smithi163.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-24T13:00:04.420 INFO:teuthology.orchestra.run.smithi163.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-24T13:00:04.448 INFO:teuthology.orchestra.run.smithi163.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-24T13:00:04.556 INFO:teuthology.orchestra.run.smithi163.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.1-341-g4e3182a6-1jammy [6,836 kB] 2024-01-24T13:00:04.768 INFO:teuthology.orchestra.run.smithi163.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.1-341-g4e3182a6-1jammy [238 kB] 2024-01-24T13:00:04.773 INFO:teuthology.orchestra.run.smithi163.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.1-341-g4e3182a6-1jammy [129 kB] 2024-01-24T13:00:04.782 INFO:teuthology.orchestra.run.smithi163.stdout:Get:27 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.1-341-g4e3182a6-1jammy [1,483 kB] 2024-01-24T13:00:04.836 INFO:teuthology.orchestra.run.smithi163.stdout:Get:28 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.1-341-g4e3182a6-1jammy [9,874 kB] 2024-01-24T13:00:05.172 INFO:teuthology.orchestra.run.smithi163.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.1-341-g4e3182a6-1jammy [31.5 MB] 2024-01-24T13:00:05.273 INFO:teuthology.orchestra.run.smithi029.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.1-341-g4e3182a6-1jammy [3,103 kB] 2024-01-24T13:00:06.287 INFO:teuthology.orchestra.run.smithi163.stdout:Get:30 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.1-341-g4e3182a6-1jammy [14.1 kB] 2024-01-24T13:00:06.287 INFO:teuthology.orchestra.run.smithi163.stdout:Get:31 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.1-341-g4e3182a6-1jammy [824 kB] 2024-01-24T13:00:06.308 INFO:teuthology.orchestra.run.smithi163.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.1-341-g4e3182a6-1jammy [2,175 kB] 2024-01-24T13:00:06.385 INFO:teuthology.orchestra.run.smithi163.stdout:Get:33 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.1-341-g4e3182a6-1jammy [235 kB] 2024-01-24T13:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout:Get:34 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.1-341-g4e3182a6-1jammy [138 kB] 2024-01-24T13:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout:Get:35 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.1-341-g4e3182a6-1jammy [1,901 kB] 2024-01-24T13:00:06.465 INFO:teuthology.orchestra.run.smithi163.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.1-341-g4e3182a6-1jammy [8,625 kB] 2024-01-24T13:00:06.698 INFO:teuthology.orchestra.run.smithi029.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.1-341-g4e3182a6-1jammy [671 kB] 2024-01-24T13:00:06.772 INFO:teuthology.orchestra.run.smithi163.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.1-341-g4e3182a6-1jammy [14.3 kB] 2024-01-24T13:00:06.772 INFO:teuthology.orchestra.run.smithi163.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.1-341-g4e3182a6-1jammy [46.4 MB] 2024-01-24T13:00:06.989 INFO:teuthology.orchestra.run.smithi029.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.1-341-g4e3182a6-1jammy [356 kB] 2024-01-24T13:00:07.144 INFO:teuthology.orchestra.run.smithi029.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.1-341-g4e3182a6-1jammy [32.8 kB] 2024-01-24T13:00:07.147 INFO:teuthology.orchestra.run.smithi029.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.1-341-g4e3182a6-1jammy [180 kB] 2024-01-24T13:00:07.230 INFO:teuthology.orchestra.run.smithi029.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.1-341-g4e3182a6-1jammy [61.5 kB] 2024-01-24T13:00:07.237 INFO:teuthology.orchestra.run.smithi029.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.1-341-g4e3182a6-1jammy [330 kB] 2024-01-24T13:00:07.387 INFO:teuthology.orchestra.run.smithi029.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.1-341-g4e3182a6-1jammy [5,882 kB] 2024-01-24T13:00:08.433 INFO:teuthology.orchestra.run.smithi163.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.1-341-g4e3182a6-1jammy [121 kB] 2024-01-24T13:00:08.434 INFO:teuthology.orchestra.run.smithi163.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.1-341-g4e3182a6-1jammy [228 kB] 2024-01-24T13:00:08.436 INFO:teuthology.orchestra.run.smithi163.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.1-341-g4e3182a6-1jammy [34.0 kB] 2024-01-24T13:00:08.436 INFO:teuthology.orchestra.run.smithi163.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.1-341-g4e3182a6-1jammy [23.3 kB] 2024-01-24T13:00:08.437 INFO:teuthology.orchestra.run.smithi163.stdout:Get:43 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.1-341-g4e3182a6-1jammy [38.3 kB] 2024-01-24T13:00:08.437 INFO:teuthology.orchestra.run.smithi163.stdout:Get:44 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.1-341-g4e3182a6-1jammy [11.6 MB] 2024-01-24T13:00:08.859 INFO:teuthology.orchestra.run.smithi163.stdout:Get:45 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.1-341-g4e3182a6-1jammy [92.9 kB] 2024-01-24T13:00:09.131 INFO:teuthology.orchestra.run.smithi029.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.1-341-g4e3182a6-1jammy [112 kB] 2024-01-24T13:00:09.148 INFO:teuthology.orchestra.run.smithi029.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.1-341-g4e3182a6-1jammy [442 kB] 2024-01-24T13:00:09.196 INFO:teuthology.orchestra.run.smithi029.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.1-341-g4e3182a6-1jammy [22.0 MB] 2024-01-24T13:00:09.398 INFO:teuthology.orchestra.run.smithi163.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-24T13:00:09.489 INFO:teuthology.orchestra.run.smithi163.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-24T13:00:09.657 INFO:teuthology.orchestra.run.smithi163.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-24T13:00:09.659 INFO:teuthology.orchestra.run.smithi163.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-24T13:00:09.660 INFO:teuthology.orchestra.run.smithi163.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-24T13:00:09.661 INFO:teuthology.orchestra.run.smithi163.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-24T13:00:09.662 INFO:teuthology.orchestra.run.smithi163.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-24T13:00:09.662 INFO:teuthology.orchestra.run.smithi163.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-24T13:00:09.663 INFO:teuthology.orchestra.run.smithi163.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-24T13:00:09.664 INFO:teuthology.orchestra.run.smithi163.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-24T13:00:09.664 INFO:teuthology.orchestra.run.smithi163.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-24T13:00:09.681 INFO:teuthology.orchestra.run.smithi163.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-24T13:00:09.694 INFO:teuthology.orchestra.run.smithi163.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-24T13:00:09.694 INFO:teuthology.orchestra.run.smithi163.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-24T13:00:09.695 INFO:teuthology.orchestra.run.smithi163.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-24T13:00:09.697 INFO:teuthology.orchestra.run.smithi163.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-24T13:00:09.698 INFO:teuthology.orchestra.run.smithi163.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-24T13:00:09.698 INFO:teuthology.orchestra.run.smithi163.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-24T13:00:09.699 INFO:teuthology.orchestra.run.smithi163.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-24T13:00:09.701 INFO:teuthology.orchestra.run.smithi163.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-24T13:00:09.703 INFO:teuthology.orchestra.run.smithi163.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-24T13:00:09.728 INFO:teuthology.orchestra.run.smithi163.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-24T13:00:09.741 INFO:teuthology.orchestra.run.smithi163.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-24T13:00:09.741 INFO:teuthology.orchestra.run.smithi163.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-24T13:00:09.742 INFO:teuthology.orchestra.run.smithi163.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-24T13:00:09.743 INFO:teuthology.orchestra.run.smithi163.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-24T13:00:09.744 INFO:teuthology.orchestra.run.smithi163.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-24T13:00:09.747 INFO:teuthology.orchestra.run.smithi163.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-24T13:00:09.759 INFO:teuthology.orchestra.run.smithi163.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-24T13:00:09.760 INFO:teuthology.orchestra.run.smithi163.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-24T13:00:09.761 INFO:teuthology.orchestra.run.smithi163.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-24T13:00:09.780 INFO:teuthology.orchestra.run.smithi163.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-24T13:00:09.781 INFO:teuthology.orchestra.run.smithi163.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-24T13:00:09.783 INFO:teuthology.orchestra.run.smithi163.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-24T13:00:09.854 INFO:teuthology.orchestra.run.smithi163.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-24T13:00:09.855 INFO:teuthology.orchestra.run.smithi163.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-24T13:00:09.857 INFO:teuthology.orchestra.run.smithi163.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-24T13:00:09.857 INFO:teuthology.orchestra.run.smithi163.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-24T13:00:09.858 INFO:teuthology.orchestra.run.smithi163.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-24T13:00:09.859 INFO:teuthology.orchestra.run.smithi163.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-24T13:00:09.860 INFO:teuthology.orchestra.run.smithi163.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-24T13:00:09.860 INFO:teuthology.orchestra.run.smithi163.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-24T13:00:09.863 INFO:teuthology.orchestra.run.smithi163.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-24T13:00:09.877 INFO:teuthology.orchestra.run.smithi163.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-24T13:00:09.884 INFO:teuthology.orchestra.run.smithi163.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-24T13:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-24T13:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-24T13:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-24T13:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-24T13:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-24T13:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-24T13:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-24T13:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-24T13:00:09.953 INFO:teuthology.orchestra.run.smithi163.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-24T13:00:09.953 INFO:teuthology.orchestra.run.smithi163.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-24T13:00:09.954 INFO:teuthology.orchestra.run.smithi163.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-24T13:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-24T13:00:09.974 INFO:teuthology.orchestra.run.smithi163.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-24T13:00:09.975 INFO:teuthology.orchestra.run.smithi163.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-24T13:00:09.976 INFO:teuthology.orchestra.run.smithi163.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-24T13:00:09.982 INFO:teuthology.orchestra.run.smithi163.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-24T13:00:09.985 INFO:teuthology.orchestra.run.smithi163.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-24T13:00:09.985 INFO:teuthology.orchestra.run.smithi163.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-24T13:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-24T13:00:09.998 INFO:teuthology.orchestra.run.smithi163.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-24T13:00:09.998 INFO:teuthology.orchestra.run.smithi163.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-24T13:00:10.000 INFO:teuthology.orchestra.run.smithi163.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-24T13:00:10.017 INFO:teuthology.orchestra.run.smithi163.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-24T13:00:10.017 INFO:teuthology.orchestra.run.smithi163.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-24T13:00:10.018 INFO:teuthology.orchestra.run.smithi163.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-24T13:00:10.596 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 181 MB in 7s (24.4 MB/s) 2024-01-24T13:00:10.743 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-24T13:00:10.808 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-24T13:00:10.811 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-24T13:00:10.859 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-24T13:00:11.145 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-24T13:00:11.158 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-24T13:00:11.195 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-24T13:00:11.347 INFO:teuthology.orchestra.run.smithi029.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.1-341-g4e3182a6-1jammy [6,836 kB] 2024-01-24T13:00:11.498 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cmd2. 2024-01-24T13:00:11.511 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-24T13:00:11.548 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-24T13:00:11.867 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libfmt8:amd64. 2024-01-24T13:00:11.881 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-01-24T13:00:11.883 INFO:teuthology.orchestra.run.smithi029.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.1-341-g4e3182a6-1jammy [238 kB] 2024-01-24T13:00:11.901 INFO:teuthology.orchestra.run.smithi029.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.1-341-g4e3182a6-1jammy [129 kB] 2024-01-24T13:00:11.920 INFO:teuthology.orchestra.run.smithi029.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.1-341-g4e3182a6-1jammy [1,483 kB] 2024-01-24T13:00:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-01-24T13:00:12.023 INFO:teuthology.orchestra.run.smithi029.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.1-341-g4e3182a6-1jammy [9,874 kB] 2024-01-24T13:00:12.296 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-24T13:00:12.309 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-24T13:00:12.354 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-24T13:00:12.682 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-24T13:00:12.695 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-24T13:00:12.740 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-24T13:00:12.741 INFO:teuthology.orchestra.run.smithi029.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.1-341-g4e3182a6-1jammy [31.5 MB] 2024-01-24T13:00:13.068 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-24T13:00:13.082 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-24T13:00:13.127 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T13:00:13.572 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-24T13:00:13.586 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T13:00:13.638 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T13:00:14.066 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-24T13:00:14.080 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T13:00:14.125 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T13:00:14.436 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-24T13:00:14.451 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T13:00:14.486 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T13:00:14.713 INFO:teuthology.orchestra.run.smithi029.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.1-341-g4e3182a6-1jammy [14.1 kB] 2024-01-24T13:00:14.713 INFO:teuthology.orchestra.run.smithi029.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.1-341-g4e3182a6-1jammy [824 kB] 2024-01-24T13:00:14.755 INFO:teuthology.orchestra.run.smithi029.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.1-341-g4e3182a6-1jammy [2,175 kB] 2024-01-24T13:00:14.847 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-24T13:00:14.861 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-24T13:00:14.878 INFO:teuthology.orchestra.run.smithi029.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.1-341-g4e3182a6-1jammy [235 kB] 2024-01-24T13:00:14.885 INFO:teuthology.orchestra.run.smithi029.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.1-341-g4e3182a6-1jammy [138 kB] 2024-01-24T13:00:14.897 INFO:teuthology.orchestra.run.smithi029.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.1-341-g4e3182a6-1jammy [1,901 kB] 2024-01-24T13:00:14.907 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-24T13:00:15.002 INFO:teuthology.orchestra.run.smithi029.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.1-341-g4e3182a6-1jammy [8,625 kB] 2024-01-24T13:00:15.259 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librados2. 2024-01-24T13:00:15.273 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../011-librados2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:15.317 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librados2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:15.463 INFO:teuthology.orchestra.run.smithi029.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.1-341-g4e3182a6-1jammy [14.3 kB] 2024-01-24T13:00:15.463 INFO:teuthology.orchestra.run.smithi029.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.1-341-g4e3182a6-1jammy [46.4 MB] 2024-01-24T13:00:15.719 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librbd1. 2024-01-24T13:00:15.734 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../012-librbd1_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:15.769 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librbd1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:16.147 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libcephfs2. 2024-01-24T13:00:16.161 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../013-libcephfs2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:16.230 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libcephfs2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:16.499 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rados. 2024-01-24T13:00:16.514 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../014-python3-rados_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:16.558 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rados (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:16.902 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-24T13:00:16.917 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:00:16.961 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-ceph-argparse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:17.205 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cephfs. 2024-01-24T13:00:17.219 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../016-python3-cephfs_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:17.255 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cephfs (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:17.697 INFO:teuthology.orchestra.run.smithi029.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.1-341-g4e3182a6-1jammy [121 kB] 2024-01-24T13:00:17.698 INFO:teuthology.orchestra.run.smithi029.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.1-341-g4e3182a6-1jammy [228 kB] 2024-01-24T13:00:17.700 INFO:teuthology.orchestra.run.smithi029.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.1-341-g4e3182a6-1jammy [34.0 kB] 2024-01-24T13:00:17.701 INFO:teuthology.orchestra.run.smithi029.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.1-341-g4e3182a6-1jammy [23.3 kB] 2024-01-24T13:00:17.701 INFO:teuthology.orchestra.run.smithi029.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.1-341-g4e3182a6-1jammy [38.3 kB] 2024-01-24T13:00:17.702 INFO:teuthology.orchestra.run.smithi029.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.1-341-g4e3182a6-1jammy [11.6 MB] 2024-01-24T13:00:17.766 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-24T13:00:17.781 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:00:17.824 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:18.153 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-prettytable. 2024-01-24T13:00:18.167 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-01-24T13:00:18.210 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-24T13:00:18.241 INFO:teuthology.orchestra.run.smithi029.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.1-341-g4e3182a6-1jammy [92.9 kB] 2024-01-24T13:00:18.505 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rbd. 2024-01-24T13:00:18.519 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../019-python3-rbd_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:18.563 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rbd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:18.828 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 181 MB in 16s (11.6 MB/s) 2024-01-24T13:00:18.891 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-24T13:00:18.906 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-24T13:00:18.941 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-24T13:00:18.987 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-24T13:00:19.056 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-24T13:00:19.059 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-24T13:00:19.102 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-24T13:00:19.218 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librgw2. 2024-01-24T13:00:19.233 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../021-librgw2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:19.276 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librgw2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:19.400 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-24T13:00:19.415 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-24T13:00:19.459 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-24T13:00:19.763 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rgw. 2024-01-24T13:00:19.776 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../022-python3-rgw_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:19.820 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:19.824 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cmd2. 2024-01-24T13:00:19.839 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-24T13:00:19.882 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-24T13:00:20.140 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-24T13:00:20.155 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-24T13:00:20.179 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libfmt8:amd64. 2024-01-24T13:00:20.190 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-24T13:00:20.194 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-01-24T13:00:20.280 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-01-24T13:00:20.484 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libradosstriper1. 2024-01-24T13:00:20.499 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../024-libradosstriper1_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:20.543 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libradosstriper1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:20.620 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-24T13:00:20.635 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-24T13:00:20.678 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-24T13:00:20.996 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-common. 2024-01-24T13:00:21.010 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../025-ceph-common_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:21.056 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:21.069 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-24T13:00:21.085 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-24T13:00:21.128 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-24T13:00:21.492 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-24T13:00:21.507 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-24T13:00:21.551 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T13:00:22.016 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-24T13:00:22.032 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T13:00:22.083 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T13:00:22.118 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-base. 2024-01-24T13:00:22.133 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../026-ceph-base_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:22.177 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-base (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:22.691 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-24T13:00:22.706 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T13:00:22.765 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T13:00:22.817 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-24T13:00:22.828 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-24T13:00:22.873 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-24T13:00:23.200 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cheroot. 2024-01-24T13:00:23.215 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-24T13:00:23.258 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-24T13:00:23.264 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-24T13:00:23.279 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T13:00:23.339 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T13:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-24T13:00:23.587 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-24T13:00:23.630 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-24T13:00:23.870 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-24T13:00:23.883 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-24T13:00:23.885 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-24T13:00:23.898 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-24T13:00:23.933 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-24T13:00:23.945 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-24T13:00:24.252 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-24T13:00:24.267 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-24T13:00:24.310 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-24T13:00:24.427 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librados2. 2024-01-24T13:00:24.442 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../011-librados2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:24.502 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librados2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:24.613 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-tempora. 2024-01-24T13:00:24.628 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-01-24T13:00:24.672 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-24T13:00:24.949 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-portend. 2024-01-24T13:00:24.965 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-01-24T13:00:24.999 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-24T13:00:25.183 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librbd1. 2024-01-24T13:00:25.199 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../012-librbd1_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:25.244 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-24T13:00:25.258 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librbd1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:25.259 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-24T13:00:25.293 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-24T13:00:25.572 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-24T13:00:25.586 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-24T13:00:25.630 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-24T13:00:25.913 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libcephfs2. 2024-01-24T13:00:25.929 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../013-libcephfs2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:25.989 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libcephfs2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:25.992 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-natsort. 2024-01-24T13:00:26.006 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-01-24T13:00:26.050 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-24T13:00:26.369 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-logutils. 2024-01-24T13:00:26.384 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-01-24T13:00:26.428 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-24T13:00:26.445 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rados. 2024-01-24T13:00:26.460 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../014-python3-rados_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:26.528 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rados (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:26.731 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-24T13:00:26.746 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-24T13:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-24T13:00:27.025 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-24T13:00:27.040 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:00:27.092 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-mako. 2024-01-24T13:00:27.107 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-24T13:00:27.108 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-ceph-argparse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:27.142 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-24T13:00:27.464 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cephfs. 2024-01-24T13:00:27.480 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../016-python3-cephfs_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:27.536 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-24T13:00:27.551 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-24T13:00:27.581 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cephfs (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:27.594 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-24T13:00:27.856 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-24T13:00:27.871 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-24T13:00:27.906 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-24T13:00:28.046 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-24T13:00:28.062 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:00:28.129 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:28.200 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-webob. 2024-01-24T13:00:28.215 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-24T13:00:28.258 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-24T13:00:28.593 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-prettytable. 2024-01-24T13:00:28.609 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-01-24T13:00:28.636 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-waitress. 2024-01-24T13:00:28.651 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-24T13:00:28.697 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-24T13:00:29.006 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-tempita. 2024-01-24T13:00:29.018 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-24T13:00:29.021 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-24T13:00:29.064 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-24T13:00:29.342 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-paste. 2024-01-24T13:00:29.356 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-24T13:00:29.392 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-24T13:00:29.416 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rbd. 2024-01-24T13:00:29.432 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../019-python3-rbd_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:29.500 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rbd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:29.787 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-24T13:00:29.802 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-24T13:00:29.845 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-24T13:00:30.030 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-24T13:00:30.046 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-24T13:00:30.107 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-24T13:00:30.223 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-24T13:00:30.238 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-24T13:00:30.289 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-24T13:00:30.495 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librgw2. 2024-01-24T13:00:30.510 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../021-librgw2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:30.553 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librgw2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:30.668 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-webtest. 2024-01-24T13:00:30.682 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-01-24T13:00:30.734 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-24T13:00:31.137 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pecan. 2024-01-24T13:00:31.151 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rgw. 2024-01-24T13:00:31.152 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-24T13:00:31.166 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../022-python3-rgw_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-24T13:00:31.209 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:31.540 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-24T13:00:31.555 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-24T13:00:31.566 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-certifi. 2024-01-24T13:00:31.581 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-01-24T13:00:31.625 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-24T13:00:31.631 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-24T13:00:31.919 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-idna. 2024-01-24T13:00:31.934 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-01-24T13:00:31.971 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libradosstriper1. 2024-01-24T13:00:31.987 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../024-libradosstriper1_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:32.003 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-24T13:00:32.030 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libradosstriper1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:32.314 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-urllib3. 2024-01-24T13:00:32.329 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-24T13:00:32.372 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-24T13:00:32.446 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-common. 2024-01-24T13:00:32.461 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../025-ceph-common_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:32.504 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:32.650 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-requests. 2024-01-24T13:00:32.665 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-24T13:00:32.700 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-24T13:00:32.986 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-24T13:00:33.001 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-24T13:00:33.044 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-24T13:00:33.348 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-24T13:00:33.363 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:00:33.398 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-modules-core (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:33.802 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-24T13:00:33.817 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:33.860 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libsqlite3-mod-ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:34.099 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-base. 2024-01-24T13:00:34.114 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../026-ceph-base_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:34.155 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-openssl. 2024-01-24T13:00:34.158 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-base (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:34.173 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2024-01-24T13:00:34.205 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-24T13:00:34.558 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr. 2024-01-24T13:00:34.573 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../058-ceph-mgr_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:34.616 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:35.011 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mon. 2024-01-24T13:00:35.026 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../059-ceph-mon_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:35.069 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mon (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:35.101 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-24T13:00:35.116 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-24T13:00:35.159 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-24T13:00:35.441 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cheroot. 2024-01-24T13:00:35.456 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-24T13:00:35.491 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-24T13:00:35.813 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-24T13:00:35.829 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-24T13:00:35.871 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-24T13:00:36.153 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-24T13:00:36.168 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-24T13:00:36.245 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-24T13:00:36.541 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-24T13:00:36.548 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-osd. 2024-01-24T13:00:36.557 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-24T13:00:36.563 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../060-ceph-osd_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:36.598 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-osd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:36.601 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-24T13:00:36.906 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-tempora. 2024-01-24T13:00:36.922 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-01-24T13:00:36.965 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-24T13:00:37.247 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-portend. 2024-01-24T13:00:37.262 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-01-24T13:00:37.305 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-24T13:00:37.652 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-24T13:00:37.668 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-24T13:00:37.710 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-24T13:00:37.860 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph. 2024-01-24T13:00:37.875 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../061-ceph_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:38.000 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-24T13:00:38.016 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-24T13:00:38.059 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-24T13:00:38.118 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:38.417 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-natsort. 2024-01-24T13:00:38.432 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-01-24T13:00:38.454 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-fuse. 2024-01-24T13:00:38.469 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../062-ceph-fuse_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:38.475 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-24T13:00:38.512 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:38.789 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-logutils. 2024-01-24T13:00:38.804 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-01-24T13:00:38.899 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-24T13:00:38.920 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mds. 2024-01-24T13:00:38.935 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../063-ceph-mds_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:38.974 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mds (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:39.204 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-24T13:00:39.219 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-24T13:00:39.262 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-24T13:00:39.310 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package cephadm. 2024-01-24T13:00:39.324 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../064-cephadm_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:39.368 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:39.553 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-mako. 2024-01-24T13:00:39.568 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-24T13:00:39.603 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-24T13:00:39.704 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-24T13:00:39.719 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-24T13:00:39.763 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-24T13:00:39.942 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-24T13:00:39.957 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-24T13:00:40.000 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-24T13:00:40.082 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-24T13:00:40.097 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-24T13:00:40.140 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-24T13:00:40.348 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-24T13:00:40.364 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-24T13:00:40.407 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-24T13:00:40.705 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-webob. 2024-01-24T13:00:40.720 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-24T13:00:40.763 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-24T13:00:41.102 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-waitress. 2024-01-24T13:00:41.118 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-24T13:00:41.128 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-babel. 2024-01-24T13:00:41.142 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-24T13:00:41.163 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-24T13:00:41.203 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-24T13:00:41.501 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-tempita. 2024-01-24T13:00:41.507 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jinja2. 2024-01-24T13:00:41.516 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-24T13:00:41.520 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2024-01-24T13:00:41.551 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-24T13:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-24T13:00:41.832 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-paste. 2024-01-24T13:00:41.848 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-24T13:00:41.891 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-24T13:00:41.910 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-24T13:00:41.923 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:00:41.968 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:42.205 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-24T13:00:42.220 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-24T13:00:42.263 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-24T13:00:42.313 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-24T13:00:42.327 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-24T13:00:42.363 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-24T13:00:42.561 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-24T13:00:42.577 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-24T13:00:42.620 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-24T13:00:42.633 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pluggy. 2024-01-24T13:00:42.647 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-24T13:00:42.691 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-24T13:00:42.935 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-webtest. 2024-01-24T13:00:42.951 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-01-24T13:00:42.994 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-24T13:00:43.002 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-py. 2024-01-24T13:00:43.016 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-01-24T13:00:43.068 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-24T13:00:43.299 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pecan. 2024-01-24T13:00:43.314 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-24T13:00:43.357 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-24T13:00:43.439 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-24T13:00:43.453 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-24T13:00:43.497 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-24T13:00:43.717 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-certifi. 2024-01-24T13:00:43.733 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-01-24T13:00:43.775 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-24T13:00:43.783 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-toml. 2024-01-24T13:00:43.798 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-01-24T13:00:43.833 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-24T13:00:44.078 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pytest. 2024-01-24T13:00:44.092 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-24T13:00:44.127 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-24T13:00:44.132 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-idna. 2024-01-24T13:00:44.148 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-01-24T13:00:44.190 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-24T13:00:44.465 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-24T13:00:44.479 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-01-24T13:00:44.504 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-urllib3. 2024-01-24T13:00:44.520 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-24T13:00:44.547 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-24T13:00:44.562 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-24T13:00:44.801 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-routes. 2024-01-24T13:00:44.816 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-24T13:00:44.851 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-24T13:00:44.895 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-requests. 2024-01-24T13:00:44.910 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-24T13:00:44.953 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-24T13:00:45.146 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-24T13:00:45.160 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:00:45.204 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-dashboard (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:45.268 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-24T13:00:45.284 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-24T13:00:45.326 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-24T13:00:45.607 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-24T13:00:45.621 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-24T13:00:45.648 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-24T13:00:45.664 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:00:45.682 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-24T13:00:45.707 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-modules-core (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:46.059 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-24T13:00:46.074 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:46.110 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libsqlite3-mod-ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:46.144 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-joblib. 2024-01-24T13:00:46.158 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-24T13:00:46.202 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-24T13:00:46.407 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-openssl. 2024-01-24T13:00:46.422 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2024-01-24T13:00:46.465 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-24T13:00:46.564 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-24T13:00:46.578 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-24T13:00:46.622 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-24T13:00:46.856 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr. 2024-01-24T13:00:46.871 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../058-ceph-mgr_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:46.914 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:46.950 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-sklearn. 2024-01-24T13:00:46.964 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-24T13:00:47.000 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-24T13:00:47.328 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mon. 2024-01-24T13:00:47.344 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../059-ceph-mon_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:47.386 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mon (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:47.743 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-24T13:00:47.757 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:00:47.801 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:48.519 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-osd. 2024-01-24T13:00:48.536 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../060-ceph-osd_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:48.577 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-osd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:49.023 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cachetools. 2024-01-24T13:00:49.037 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-01-24T13:00:49.088 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-24T13:00:49.324 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-24T13:00:49.339 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-24T13:00:49.374 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-24T13:00:49.685 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-24T13:00:49.701 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-24T13:00:49.743 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-24T13:00:50.022 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rsa. 2024-01-24T13:00:50.036 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-01-24T13:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-24T13:00:50.409 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-google-auth. 2024-01-24T13:00:50.423 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-01-24T13:00:50.467 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-24T13:00:50.795 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-24T13:00:50.810 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-24T13:00:50.853 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-24T13:00:50.860 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph. 2024-01-24T13:00:50.876 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../061-ceph_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:50.918 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:51.140 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-websocket. 2024-01-24T13:00:51.154 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-01-24T13:00:51.198 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-24T13:00:51.216 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-fuse. 2024-01-24T13:00:51.232 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../062-ceph-fuse_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:51.275 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:51.560 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-24T13:00:51.574 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-24T13:00:51.617 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-24T13:00:51.689 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mds. 2024-01-24T13:00:51.705 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../063-ceph-mds_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:51.747 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mds (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:52.154 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package cephadm. 2024-01-24T13:00:52.170 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../064-cephadm_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:52.213 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:52.306 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-24T13:00:52.321 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:00:52.364 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-k8sevents (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:52.520 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-24T13:00:52.535 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-24T13:00:52.578 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-24T13:00:52.709 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-24T13:00:52.723 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-24T13:00:52.767 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-24T13:00:52.916 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-24T13:00:52.932 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-24T13:00:52.975 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-24T13:00:53.087 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-24T13:00:53.101 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-24T13:00:53.137 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-24T13:00:53.390 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package jq. 2024-01-24T13:00:53.404 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-24T13:00:53.448 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-24T13:00:53.734 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package socat. 2024-01-24T13:00:53.749 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-24T13:00:53.792 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-24T13:00:53.936 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-babel. 2024-01-24T13:00:53.950 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-24T13:00:53.994 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-24T13:00:54.103 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package xmlstarlet. 2024-01-24T13:00:54.119 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-24T13:00:54.162 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-24T13:00:54.368 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jinja2. 2024-01-24T13:00:54.382 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2024-01-24T13:00:54.426 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-24T13:00:54.524 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-test. 2024-01-24T13:00:54.538 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../098-ceph-test_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:54.582 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-test (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:54.784 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-24T13:00:54.799 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:00:54.842 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:55.284 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-24T13:00:55.300 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-24T13:00:55.342 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-24T13:00:55.697 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pluggy. 2024-01-24T13:00:55.713 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-24T13:00:55.755 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-24T13:00:56.071 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-py. 2024-01-24T13:00:56.087 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-01-24T13:00:56.129 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-24T13:00:56.445 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-24T13:00:56.461 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-24T13:00:56.503 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-24T13:00:56.595 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-volume. 2024-01-24T13:00:56.611 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../099-ceph-volume_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:00:56.653 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-volume (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:56.834 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-toml. 2024-01-24T13:00:56.850 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-01-24T13:00:56.892 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-24T13:00:57.057 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-24T13:00:57.073 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:57.116 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking cephfs-mirror (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:57.182 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pytest. 2024-01-24T13:00:57.198 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-24T13:00:57.240 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-24T13:00:57.394 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-colorama. 2024-01-24T13:00:57.409 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-01-24T13:00:57.466 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-24T13:00:57.573 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-24T13:00:57.589 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-01-24T13:00:57.632 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-24T13:00:57.696 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package cephfs-shell. 2024-01-24T13:00:57.712 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../102-cephfs-shell_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:00:57.754 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking cephfs-shell (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:58.032 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package cephfs-top. 2024-01-24T13:00:58.048 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../103-cephfs-top_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:00:58.090 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking cephfs-top (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:58.343 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-24T13:00:58.359 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:00:58.401 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libcephfs-dev (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:00:58.980 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package nvme-cli. 2024-01-24T13:00:58.995 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-24T13:00:59.029 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-24T13:00:59.401 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-24T13:00:59.416 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-24T13:00:59.459 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-24T13:00:59.971 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pastescript. 2024-01-24T13:00:59.985 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-01-24T13:01:00.037 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-24T13:01:00.351 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-psutil. 2024-01-24T13:01:00.365 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-24T13:01:00.409 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-24T13:01:00.703 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pygments. 2024-01-24T13:01:00.718 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-24T13:01:00.753 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-24T13:01:01.240 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-24T13:01:01.255 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-24T13:01:01.290 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-24T13:01:01.593 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-simplejson. 2024-01-24T13:01:01.607 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-24T13:01:01.651 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-24T13:01:01.920 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-24T13:01:01.934 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-24T13:01:02.003 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-24T13:01:02.454 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-routes. 2024-01-24T13:01:02.469 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-24T13:01:02.512 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-24T13:01:02.765 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package radosgw. 2024-01-24T13:01:02.780 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../113-radosgw_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:01:02.823 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking radosgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:02.861 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-24T13:01:02.877 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:01:02.920 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-dashboard (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:03.369 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-24T13:01:03.384 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-24T13:01:03.410 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package rbd-fuse. 2024-01-24T13:01:03.425 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../114-rbd-fuse_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:01:03.427 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-24T13:01:03.460 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking rbd-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:03.726 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-24T13:01:03.927 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-joblib. 2024-01-24T13:01:03.943 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-24T13:01:03.985 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-24T13:01:03.997 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-24T13:01:04.123 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-24T13:01:04.374 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-24T13:01:04.389 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-24T13:01:04.425 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-24T13:01:04.433 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-24T13:01:04.790 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-sklearn. 2024-01-24T13:01:04.805 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-24T13:01:04.813 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-24T13:01:04.848 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-24T13:01:05.376 INFO:teuthology.orchestra.run.smithi163.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-24T13:01:05.389 INFO:teuthology.orchestra.run.smithi163.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-24T13:01:05.450 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:05.595 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-24T13:01:05.609 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:01:05.645 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:06.061 INFO:teuthology.orchestra.run.smithi163.stdout:Adding system user cephadm....done 2024-01-24T13:01:06.223 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-24T13:01:06.534 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-24T13:01:06.800 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-24T13:01:06.934 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-24T13:01:06.994 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cachetools. 2024-01-24T13:01:07.010 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-01-24T13:01:07.053 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-24T13:01:07.186 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-24T13:01:07.359 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-24T13:01:07.375 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-24T13:01:07.418 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-24T13:01:07.445 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-24T13:01:07.571 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-24T13:01:07.732 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-24T13:01:07.748 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-24T13:01:07.791 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-24T13:01:07.914 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-24T13:01:08.173 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rsa. 2024-01-24T13:01:08.189 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-01-24T13:01:08.231 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-24T13:01:08.274 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-24T13:01:08.531 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-google-auth. 2024-01-24T13:01:08.542 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-24T13:01:08.546 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-01-24T13:01:08.589 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-24T13:01:08.818 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-24T13:01:08.878 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-24T13:01:08.894 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-24T13:01:08.936 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-24T13:01:09.086 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-24T13:01:09.293 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-websocket. 2024-01-24T13:01:09.309 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-01-24T13:01:09.346 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-24T13:01:09.352 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-24T13:01:09.621 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-24T13:01:09.675 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-24T13:01:09.691 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-24T13:01:09.734 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-24T13:01:09.990 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-ceph-argparse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:10.257 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-24T13:01:10.366 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-24T13:01:10.479 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-24T13:01:10.493 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:01:10.579 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-k8sevents (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:10.626 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-24T13:01:10.877 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T13:01:10.910 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-24T13:01:10.925 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-24T13:01:10.969 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-24T13:01:10.986 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-24T13:01:11.315 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-24T13:01:11.331 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-24T13:01:11.374 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-24T13:01:11.387 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-24T13:01:11.513 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-24T13:01:11.639 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package jq. 2024-01-24T13:01:11.654 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-24T13:01:11.697 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-24T13:01:11.789 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-24T13:01:12.002 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package socat. 2024-01-24T13:01:12.018 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-24T13:01:12.052 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-24T13:01:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-24T13:01:12.350 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-24T13:01:12.359 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package xmlstarlet. 2024-01-24T13:01:12.375 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-24T13:01:12.417 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-24T13:01:12.777 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-test. 2024-01-24T13:01:12.792 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../098-ceph-test_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:01:12.835 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-test (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:13.035 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-24T13:01:13.302 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-24T13:01:13.453 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-24T13:01:13.579 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-24T13:01:13.897 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-24T13:01:14.298 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-24T13:01:14.541 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-24T13:01:14.942 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-24T13:01:15.244 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-24T13:01:15.611 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-24T13:01:15.971 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-24T13:01:16.144 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-volume. 2024-01-24T13:01:16.161 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../099-ceph-volume_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:01:16.203 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-volume (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:16.230 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-24T13:01:16.356 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:16.588 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-24T13:01:16.604 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:01:16.645 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking cephfs-mirror (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:16.666 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-idna (3.3-1) ... 2024-01-24T13:01:17.019 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-colorama. 2024-01-24T13:01:17.033 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-24T13:01:17.035 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-01-24T13:01:17.078 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-24T13:01:17.324 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package cephfs-shell. 2024-01-24T13:01:17.340 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../102-cephfs-shell_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:01:17.382 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking cephfs-shell (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:17.647 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package cephfs-top. 2024-01-24T13:01:17.663 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../103-cephfs-top_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T13:01:17.705 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking cephfs-top (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:17.944 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-24T13:01:17.960 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:01:18.002 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libcephfs-dev (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:18.255 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T13:01:18.389 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-24T13:01:18.442 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package nvme-cli. 2024-01-24T13:01:18.459 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-24T13:01:18.501 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-24T13:01:18.674 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-24T13:01:18.800 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-24T13:01:18.861 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-24T13:01:18.877 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-24T13:01:18.917 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-24T13:01:18.919 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-24T13:01:19.235 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-24T13:01:19.459 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pastescript. 2024-01-24T13:01:19.476 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-01-24T13:01:19.511 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-24T13:01:19.526 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-24T13:01:19.771 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T13:01:19.849 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-psutil. 2024-01-24T13:01:19.865 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-24T13:01:19.888 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-01-24T13:01:19.909 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-24T13:01:19.989 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-24T13:01:20.230 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pygments. 2024-01-24T13:01:20.246 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-24T13:01:20.288 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-24T13:01:20.324 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-24T13:01:20.617 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-24T13:01:20.831 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-24T13:01:20.846 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-24T13:01:20.889 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-24T13:01:20.892 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-24T13:01:21.135 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-24T13:01:21.202 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-simplejson. 2024-01-24T13:01:21.218 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-24T13:01:21.262 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-24T13:01:21.428 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-24T13:01:21.550 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-24T13:01:21.566 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-24T13:01:21.609 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-24T13:01:21.729 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-24T13:01:21.855 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-24T13:01:22.139 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-24T13:01:22.249 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-24T13:01:22.484 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package radosgw. 2024-01-24T13:01:22.500 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../113-radosgw_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:01:22.542 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking radosgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:22.591 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-24T13:01:22.901 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-24T13:01:23.143 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-24T13:01:23.416 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package rbd-fuse. 2024-01-24T13:01:23.432 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../114-rbd-fuse_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T13:01:23.474 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking rbd-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:23.562 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-24T13:01:23.771 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-24T13:01:23.846 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-24T13:01:23.955 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-24T13:01:24.052 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-24T13:01:24.178 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-24T13:01:24.340 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-24T13:01:24.450 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-24T13:01:24.633 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-24T13:01:24.837 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-24T13:01:24.892 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T13:01:25.018 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-24T13:01:25.353 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-24T13:01:25.405 INFO:teuthology.orchestra.run.smithi029.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-24T13:01:25.434 INFO:teuthology.orchestra.run.smithi029.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-24T13:01:25.474 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:25.662 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-24T13:01:25.980 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-24T13:01:26.080 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-24T13:01:26.091 INFO:teuthology.orchestra.run.smithi029.stdout:Adding system user cephadm....done 2024-01-24T13:01:26.255 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-24T13:01:26.348 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-24T13:01:26.541 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-24T13:01:26.624 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-24T13:01:26.801 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-24T13:01:26.892 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-24T13:01:26.930 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-24T13:01:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-24T13:01:27.268 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-24T13:01:27.561 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-24T13:01:27.592 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-24T13:01:27.720 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-24T13:01:27.930 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-24T13:01:28.041 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-24T13:01:28.064 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librados2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:28.190 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librgw2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:28.410 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libsqlite3-mod-ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:28.419 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-24T13:01:28.536 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libcephfs2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:28.662 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libradosstriper1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:28.698 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-24T13:01:28.788 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-24T13:01:28.959 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-24T13:01:29.089 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librbd1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:29.224 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-modules-core (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:29.244 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-24T13:01:29.344 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:29.513 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-24T13:01:29.569 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-24T13:01:29.569 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-24T13:01:29.792 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-24T13:01:30.061 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-ceph-argparse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:30.200 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libcephfs-dev (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:30.318 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rados (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:30.338 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-24T13:01:30.444 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up cephfs-top (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:30.464 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-24T13:01:30.570 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-24T13:01:30.735 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-24T13:01:30.995 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T13:01:31.489 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-24T13:01:31.841 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rbd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:31.874 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-24T13:01:31.942 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up rbd-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:32.003 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-24T13:01:32.060 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:32.186 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cephfs (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:32.280 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-24T13:01:32.312 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up cephfs-shell (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:32.429 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:32.557 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-24T13:01:32.918 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-24T13:01:32.958 INFO:teuthology.orchestra.run.smithi163.stdout:Adding group ceph....done 2024-01-24T13:01:33.342 INFO:teuthology.orchestra.run.smithi163.stdout:Adding system user ceph....done 2024-01-24T13:01:33.561 INFO:teuthology.orchestra.run.smithi163.stdout:Setting system user ceph properties....done 2024-01-24T13:01:33.580 INFO:teuthology.orchestra.run.smithi163.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-24T13:01:33.631 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-24T13:01:33.721 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-24T13:01:33.950 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-24T13:01:34.068 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-24T13:01:34.102 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-24T13:01:34.195 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-24T13:01:34.524 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-24T13:01:34.847 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up cephfs-mirror (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:34.910 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-24T13:01:35.064 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-24T13:01:35.064 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-24T13:01:35.170 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-24T13:01:35.608 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-24T13:01:35.682 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-test (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:35.791 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up radosgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:35.902 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-24T13:01:36.229 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-24T13:01:36.332 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-24T13:01:36.332 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-24T13:01:36.599 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-24T13:01:36.860 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-24T13:01:36.918 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-base (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:36.987 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:37.297 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-idna (3.3-1) ... 2024-01-24T13:01:37.311 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-24T13:01:37.650 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-24T13:01:37.944 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mds (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:38.200 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-24T13:01:38.201 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-24T13:01:38.847 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:38.913 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T13:01:39.040 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-24T13:01:39.057 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-24T13:01:39.057 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-24T13:01:39.309 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-24T13:01:39.421 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-24T13:01:39.548 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-24T13:01:39.657 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-osd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:39.859 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-24T13:01:39.969 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-24T13:01:39.969 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-24T13:01:40.128 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-24T13:01:40.398 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T13:01:40.550 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-01-24T13:01:40.636 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-k8sevents (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:40.677 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-24T13:01:40.762 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-diskprediction-local (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:40.904 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mon (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:40.996 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-24T13:01:41.111 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-24T13:01:41.111 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-24T13:01:41.266 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-24T13:01:41.526 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-24T13:01:41.756 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:41.837 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-24T13:01:41.873 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:41.983 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-dashboard (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:42.097 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-24T13:01:42.125 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-volume (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:42.384 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-24T13:01:42.486 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-24T13:01:42.494 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-24T13:01:42.780 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-24T13:01:42.907 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-24T13:01:43.219 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-24T13:01:43.521 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-24T13:01:43.736 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-24T13:01:43.790 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-24T13:01:44.221 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-24T13:01:44.254 INFO:teuthology.orchestra.run.smithi163.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-24T13:01:44.259 DEBUG:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-24T13:01:44.332 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-01-24T13:01:44.480 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-24T13:01:44.497 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2024-01-24T13:01:44.498 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2024-01-24T13:01:44.607 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-24T13:01:44.648 INFO:teuthology.orchestra.run.smithi163.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-24T13:01:44.648 INFO:teuthology.orchestra.run.smithi163.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-24T13:01:44.648 INFO:teuthology.orchestra.run.smithi163.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-24T13:01:44.648 INFO:teuthology.orchestra.run.smithi163.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-24T13:01:44.649 INFO:teuthology.orchestra.run.smithi163.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-24T13:01:44.649 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages were automatically installed and are no longer required: 2024-01-24T13:01:44.649 INFO:teuthology.orchestra.run.smithi163.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-24T13:01:44.649 INFO:teuthology.orchestra.run.smithi163.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-24T13:01:44.649 INFO:teuthology.orchestra.run.smithi163.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-24T13:01:44.649 INFO:teuthology.orchestra.run.smithi163.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-24T13:01:44.649 INFO:teuthology.orchestra.run.smithi163.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-24T13:01:44.649 INFO:teuthology.orchestra.run.smithi163.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-24T13:01:44.650 INFO:teuthology.orchestra.run.smithi163.stdout:The following additional packages will be installed: 2024-01-24T13:01:44.650 INFO:teuthology.orchestra.run.smithi163.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-24T13:01:44.650 INFO:teuthology.orchestra.run.smithi163.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-24T13:01:44.650 INFO:teuthology.orchestra.run.smithi163.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-24T13:01:44.650 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-24T13:01:44.650 INFO:teuthology.orchestra.run.smithi163.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-24T13:01:44.651 INFO:teuthology.orchestra.run.smithi163.stdout:Suggested packages: 2024-01-24T13:01:44.651 INFO:teuthology.orchestra.run.smithi163.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-24T13:01:44.651 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-24T13:01:44.651 INFO:teuthology.orchestra.run.smithi163.stdout: libengine-pkcs11-openssl 2024-01-24T13:01:44.699 INFO:teuthology.orchestra.run.smithi163.stdout:The following NEW packages will be installed: 2024-01-24T13:01:44.700 INFO:teuthology.orchestra.run.smithi163.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-24T13:01:44.700 INFO:teuthology.orchestra.run.smithi163.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-24T13:01:44.700 INFO:teuthology.orchestra.run.smithi163.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-24T13:01:44.701 INFO:teuthology.orchestra.run.smithi163.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-24T13:01:44.701 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-24T13:01:44.701 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-24T13:01:44.701 INFO:teuthology.orchestra.run.smithi163.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-24T13:01:44.701 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages will be upgraded: 2024-01-24T13:01:44.702 INFO:teuthology.orchestra.run.smithi163.stdout: libssl3 2024-01-24T13:01:44.765 INFO:teuthology.orchestra.run.smithi163.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-24T13:01:44.766 INFO:teuthology.orchestra.run.smithi163.stdout:Need to get 54.6 MB of archives. 2024-01-24T13:01:44.766 INFO:teuthology.orchestra.run.smithi163.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-24T13:01:44.766 INFO:teuthology.orchestra.run.smithi163.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-24T13:01:44.892 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-24T13:01:44.959 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-24T13:01:44.968 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-24T13:01:44.969 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-24T13:01:44.971 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-24T13:01:44.972 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-24T13:01:44.972 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-24T13:01:44.973 INFO:teuthology.orchestra.run.smithi163.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-24T13:01:44.974 INFO:teuthology.orchestra.run.smithi163.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-24T13:01:44.975 INFO:teuthology.orchestra.run.smithi163.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-24T13:01:44.980 INFO:teuthology.orchestra.run.smithi163.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-24T13:01:44.996 INFO:teuthology.orchestra.run.smithi163.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-24T13:01:45.009 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-24T13:01:45.263 INFO:teuthology.orchestra.run.smithi163.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-24T13:01:45.265 INFO:teuthology.orchestra.run.smithi163.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-24T13:01:45.265 INFO:teuthology.orchestra.run.smithi163.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-24T13:01:45.268 INFO:teuthology.orchestra.run.smithi163.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-24T13:01:45.269 INFO:teuthology.orchestra.run.smithi163.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-24T13:01:45.273 INFO:teuthology.orchestra.run.smithi163.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-24T13:01:45.275 INFO:teuthology.orchestra.run.smithi163.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-24T13:01:45.280 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-24T13:01:45.282 INFO:teuthology.orchestra.run.smithi163.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-24T13:01:45.282 INFO:teuthology.orchestra.run.smithi163.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-24T13:01:45.304 INFO:teuthology.orchestra.run.smithi163.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-24T13:01:45.305 INFO:teuthology.orchestra.run.smithi163.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-24T13:01:45.315 INFO:teuthology.orchestra.run.smithi163.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-24T13:01:45.339 INFO:teuthology.orchestra.run.smithi163.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-24T13:01:45.343 INFO:teuthology.orchestra.run.smithi163.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-24T13:01:45.344 INFO:teuthology.orchestra.run.smithi163.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-24T13:01:45.344 INFO:teuthology.orchestra.run.smithi163.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-24T13:01:45.345 INFO:teuthology.orchestra.run.smithi163.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-24T13:01:45.360 INFO:teuthology.orchestra.run.smithi163.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-24T13:01:45.364 INFO:teuthology.orchestra.run.smithi163.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-24T13:01:45.549 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T13:01:45.567 INFO:teuthology.orchestra.run.smithi163.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-24T13:01:45.567 INFO:teuthology.orchestra.run.smithi163.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-24T13:01:45.567 INFO:teuthology.orchestra.run.smithi163.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-24T13:01:45.568 INFO:teuthology.orchestra.run.smithi163.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-24T13:01:45.568 INFO:teuthology.orchestra.run.smithi163.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-24T13:01:45.568 INFO:teuthology.orchestra.run.smithi163.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-24T13:01:45.581 INFO:teuthology.orchestra.run.smithi163.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-24T13:01:45.581 INFO:teuthology.orchestra.run.smithi163.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-24T13:01:45.675 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-24T13:01:45.950 INFO:teuthology.orchestra.run.smithi163.stdout:Preconfiguring packages ... 2024-01-24T13:01:46.044 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-24T13:01:46.111 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 54.6 MB in 1s (62.6 MB/s) 2024-01-24T13:01:46.287 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package flex. 2024-01-24T13:01:46.356 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-24T13:01:46.358 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139847 files and directories currently installed.) 2024-01-24T13:01:46.362 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-24T13:01:46.402 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-24T13:01:46.650 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-24T13:01:46.802 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-24T13:01:47.030 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-24T13:01:47.096 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-24T13:01:47.249 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-24T13:01:47.383 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-24T13:01:47.660 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-24T13:01:47.679 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T13:01:48.054 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-24T13:01:48.200 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package bison. 2024-01-24T13:01:48.271 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139920 files and directories currently installed.) 2024-01-24T13:01:48.275 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-24T13:01:48.318 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-24T13:01:48.398 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-24T13:01:48.728 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-24T13:01:48.742 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-24T13:01:48.771 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-24T13:01:48.786 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-24T13:01:48.897 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librados2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:49.024 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librgw2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:49.114 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package dump. 2024-01-24T13:01:49.128 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-24T13:01:49.172 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking dump (0.4b47-3) ... 2024-01-24T13:01:49.240 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libsqlite3-mod-ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:49.367 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libcephfs2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:49.484 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package indent. 2024-01-24T13:01:49.496 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libradosstriper1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:49.498 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T13:01:49.534 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-24T13:01:49.623 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-24T13:01:49.761 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-24T13:01:49.775 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-24T13:01:49.811 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-24T13:01:49.976 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librbd1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:50.103 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-modules-core (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:50.148 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-24T13:01:50.162 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-24T13:01:50.206 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-24T13:01:50.231 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:50.447 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-24T13:01:50.447 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-24T13:01:50.450 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-24T13:01:50.464 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-24T13:01:50.533 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-24T13:01:50.895 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-24T13:01:50.909 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-24T13:01:50.953 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-24T13:01:51.102 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libcephfs-dev (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:51.205 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-24T13:01:51.220 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-24T13:01:51.228 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rados (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:51.263 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-24T13:01:51.516 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libjson-perl. 2024-01-24T13:01:51.531 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-24T13:01:51.566 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-24T13:01:51.911 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-24T13:01:51.926 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-24T13:01:51.969 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-24T13:01:52.358 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up cephfs-top (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:52.485 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-24T13:01:53.379 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-24T13:01:53.395 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-24T13:01:53.438 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T13:01:53.715 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-24T13:01:53.731 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-24T13:01:53.773 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T13:01:53.836 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rbd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:53.963 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up rbd-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:54.067 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-24T13:01:54.083 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-24T13:01:54.099 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:54.126 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T13:01:54.227 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cephfs (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:54.354 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up cephfs-shell (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:54.481 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:54.503 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-24T13:01:54.519 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-24T13:01:54.561 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-24T13:01:54.889 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-24T13:01:54.905 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-24T13:01:54.956 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-24T13:01:55.098 INFO:teuthology.orchestra.run.smithi029.stdout:Adding group ceph....done 2024-01-24T13:01:55.292 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-24T13:01:55.307 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T13:01:55.392 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T13:01:55.512 INFO:teuthology.orchestra.run.smithi029.stdout:Adding system user ceph....done 2024-01-24T13:01:55.783 INFO:teuthology.orchestra.run.smithi029.stdout:Setting system user ceph properties....done 2024-01-24T13:01:55.806 INFO:teuthology.orchestra.run.smithi029.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-24T13:01:55.820 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-24T13:01:55.835 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T13:01:55.886 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T13:01:55.963 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-24T13:01:56.214 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-24T13:01:56.229 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T13:01:56.280 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T13:01:56.383 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-24T13:01:56.593 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-24T13:01:56.609 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-24T13:01:56.660 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T13:01:57.011 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up cephfs-mirror (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:57.218 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-24T13:01:57.219 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-24T13:01:57.222 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-24T13:01:57.237 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-24T13:01:57.289 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-24T13:01:57.751 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package modemmanager. 2024-01-24T13:01:57.766 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-24T13:01:57.798 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-test (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:57.808 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T13:01:57.925 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up radosgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:58.440 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package network-manager. 2024-01-24T13:01:58.455 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-24T13:01:58.473 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-24T13:01:58.473 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-24T13:01:58.506 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-24T13:01:59.062 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-base (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:01:59.164 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ppp. 2024-01-24T13:01:59.180 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-24T13:01:59.435 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-24T13:01:59.515 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-24T13:01:59.836 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package pptp-linux. 2024-01-24T13:01:59.850 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-24T13:01:59.886 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-24T13:02:00.050 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mds (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:02:00.114 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-24T13:02:00.128 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-24T13:02:00.172 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-24T13:02:00.295 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-24T13:02:00.295 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-24T13:02:00.526 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-24T13:02:00.540 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-24T13:02:00.584 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking postgresql-client-common (238) ... 2024-01-24T13:02:00.888 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-24T13:02:00.895 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:02:00.902 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T13:02:00.947 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T13:02:01.114 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-24T13:02:01.115 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-24T13:02:01.510 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package postgresql-common. 2024-01-24T13:02:01.525 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-24T13:02:01.585 INFO:teuthology.orchestra.run.smithi163.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-24T13:02:01.617 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking postgresql-common (238) ... 2024-01-24T13:02:01.715 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-osd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:02:02.041 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-24T13:02:02.041 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-24T13:02:02.118 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package postgresql-14. 2024-01-24T13:02:02.133 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T13:02:02.179 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T13:02:02.670 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-k8sevents (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:02:02.839 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-diskprediction-local (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:02:02.991 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mon (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:02:03.197 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package postgresql. 2024-01-24T13:02:03.212 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-24T13:02:03.212 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-24T13:02:03.212 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-24T13:02:03.247 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking postgresql (14+238) ... 2024-01-24T13:02:03.508 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package postgresql-client. 2024-01-24T13:02:03.522 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-24T13:02:03.566 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking postgresql-client (14+238) ... 2024-01-24T13:02:03.794 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-24T13:02:03.808 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-24T13:02:03.811 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:02:03.852 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-24T13:02:03.963 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:02:04.090 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-dashboard (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:02:04.171 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package tcl8.6. 2024-01-24T13:02:04.186 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-24T13:02:04.230 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-24T13:02:04.284 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-volume (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T13:02:04.466 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package tcl. 2024-01-24T13:02:04.481 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-24T13:02:04.537 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-24T13:02:04.657 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-24T13:02:04.886 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package wpasupplicant. 2024-01-24T13:02:04.902 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-24T13:02:04.944 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-24T13:02:05.324 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-24T13:02:05.340 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-24T13:02:05.390 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-24T13:02:05.811 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-24T13:02:05.827 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-24T13:02:05.878 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-24T13:02:05.977 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-24T13:02:06.169 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up postgresql-client-common (238) ... 2024-01-24T13:02:06.359 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-24T13:02:06.460 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-24T13:02:06.490 INFO:teuthology.orchestra.run.smithi029.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-24T13:02:06.495 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-24T13:02:06.561 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T13:02:06.571 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-01-24T13:02:06.688 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-24T13:02:06.740 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2024-01-24T13:02:06.741 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2024-01-24T13:02:06.847 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-24T13:02:06.901 INFO:teuthology.orchestra.run.smithi029.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-24T13:02:06.901 INFO:teuthology.orchestra.run.smithi029.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-24T13:02:06.901 INFO:teuthology.orchestra.run.smithi029.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-24T13:02:06.901 INFO:teuthology.orchestra.run.smithi029.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-24T13:02:06.901 INFO:teuthology.orchestra.run.smithi029.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-24T13:02:06.901 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages were automatically installed and are no longer required: 2024-01-24T13:02:06.902 INFO:teuthology.orchestra.run.smithi029.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-24T13:02:06.902 INFO:teuthology.orchestra.run.smithi029.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-24T13:02:06.902 INFO:teuthology.orchestra.run.smithi029.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-24T13:02:06.902 INFO:teuthology.orchestra.run.smithi029.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-24T13:02:06.903 INFO:teuthology.orchestra.run.smithi029.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-24T13:02:06.903 INFO:teuthology.orchestra.run.smithi029.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-24T13:02:06.903 INFO:teuthology.orchestra.run.smithi029.stdout:The following additional packages will be installed: 2024-01-24T13:02:06.903 INFO:teuthology.orchestra.run.smithi029.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-24T13:02:06.903 INFO:teuthology.orchestra.run.smithi029.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-24T13:02:06.903 INFO:teuthology.orchestra.run.smithi029.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-24T13:02:06.903 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-24T13:02:06.903 INFO:teuthology.orchestra.run.smithi029.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-24T13:02:06.904 INFO:teuthology.orchestra.run.smithi029.stdout:Suggested packages: 2024-01-24T13:02:06.904 INFO:teuthology.orchestra.run.smithi029.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-24T13:02:06.904 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-24T13:02:06.904 INFO:teuthology.orchestra.run.smithi029.stdout: libengine-pkcs11-openssl 2024-01-24T13:02:06.954 INFO:teuthology.orchestra.run.smithi029.stdout:The following NEW packages will be installed: 2024-01-24T13:02:06.955 INFO:teuthology.orchestra.run.smithi029.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-24T13:02:06.955 INFO:teuthology.orchestra.run.smithi029.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-24T13:02:06.955 INFO:teuthology.orchestra.run.smithi029.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-24T13:02:06.955 INFO:teuthology.orchestra.run.smithi029.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-24T13:02:06.955 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-24T13:02:06.955 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-24T13:02:06.955 INFO:teuthology.orchestra.run.smithi029.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-24T13:02:06.956 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages will be upgraded: 2024-01-24T13:02:06.956 INFO:teuthology.orchestra.run.smithi029.stdout: libssl3 2024-01-24T13:02:06.973 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T13:02:07.017 INFO:teuthology.orchestra.run.smithi029.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-24T13:02:07.017 INFO:teuthology.orchestra.run.smithi029.stdout:Need to get 54.6 MB of archives. 2024-01-24T13:02:07.018 INFO:teuthology.orchestra.run.smithi029.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-24T13:02:07.018 INFO:teuthology.orchestra.run.smithi029.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-24T13:02:07.139 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-24T13:02:07.211 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-24T13:02:07.219 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-24T13:02:07.220 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-24T13:02:07.221 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-24T13:02:07.223 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-24T13:02:07.223 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-24T13:02:07.224 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-24T13:02:07.225 INFO:teuthology.orchestra.run.smithi029.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-24T13:02:07.225 INFO:teuthology.orchestra.run.smithi029.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-24T13:02:07.232 INFO:teuthology.orchestra.run.smithi029.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-24T13:02:07.246 INFO:teuthology.orchestra.run.smithi029.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-24T13:02:07.483 INFO:teuthology.orchestra.run.smithi029.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-24T13:02:07.484 INFO:teuthology.orchestra.run.smithi029.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-24T13:02:07.485 INFO:teuthology.orchestra.run.smithi029.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-24T13:02:07.487 INFO:teuthology.orchestra.run.smithi029.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-24T13:02:07.488 INFO:teuthology.orchestra.run.smithi029.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-24T13:02:07.492 INFO:teuthology.orchestra.run.smithi029.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-24T13:02:07.494 INFO:teuthology.orchestra.run.smithi029.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-24T13:02:07.501 INFO:teuthology.orchestra.run.smithi029.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-24T13:02:07.502 INFO:teuthology.orchestra.run.smithi029.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-24T13:02:07.524 INFO:teuthology.orchestra.run.smithi029.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-24T13:02:07.524 INFO:teuthology.orchestra.run.smithi029.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-24T13:02:07.534 INFO:teuthology.orchestra.run.smithi029.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-24T13:02:07.555 INFO:teuthology.orchestra.run.smithi029.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-24T13:02:07.559 INFO:teuthology.orchestra.run.smithi029.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-24T13:02:07.560 INFO:teuthology.orchestra.run.smithi029.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-24T13:02:07.560 INFO:teuthology.orchestra.run.smithi029.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-24T13:02:07.561 INFO:teuthology.orchestra.run.smithi029.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-24T13:02:07.572 INFO:teuthology.orchestra.run.smithi029.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-24T13:02:07.575 INFO:teuthology.orchestra.run.smithi029.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-24T13:02:07.734 INFO:teuthology.orchestra.run.smithi029.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-24T13:02:07.734 INFO:teuthology.orchestra.run.smithi029.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-24T13:02:07.734 INFO:teuthology.orchestra.run.smithi029.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-24T13:02:07.734 INFO:teuthology.orchestra.run.smithi029.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-24T13:02:07.735 INFO:teuthology.orchestra.run.smithi029.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-24T13:02:07.735 INFO:teuthology.orchestra.run.smithi029.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-24T13:02:07.749 INFO:teuthology.orchestra.run.smithi029.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-24T13:02:07.749 INFO:teuthology.orchestra.run.smithi029.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-24T13:02:07.923 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-24T13:02:08.021 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-24T13:02:08.140 INFO:teuthology.orchestra.run.smithi029.stdout:Preconfiguring packages ... 2024-01-24T13:02:08.399 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-24T13:02:08.399 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-24T13:02:08.509 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 54.6 MB in 1s (69.6 MB/s) 2024-01-24T13:02:08.652 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package flex. 2024-01-24T13:02:08.725 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139847 files and directories currently installed.) 2024-01-24T13:02:08.728 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-24T13:02:08.768 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-24T13:02:09.066 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-24T13:02:09.193 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T13:02:09.302 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-24T13:02:09.336 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-24T13:02:09.403 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-24T13:02:09.514 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-24T13:02:09.530 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-24T13:02:09.656 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-24T13:02:09.782 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-24T13:02:09.985 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T13:02:10.413 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-24T13:02:10.539 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up dump (0.4b47-3) ... 2024-01-24T13:02:10.566 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package bison. 2024-01-24T13:02:10.640 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139920 files and directories currently installed.) 2024-01-24T13:02:10.644 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-24T13:02:10.685 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-24T13:02:11.001 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-24T13:02:11.058 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T13:02:11.158 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-24T13:02:11.173 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-24T13:02:11.216 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-24T13:02:11.342 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-24T13:02:11.452 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-24T13:02:11.553 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-24T13:02:11.605 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package dump. 2024-01-24T13:02:11.622 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-24T13:02:11.654 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-24T13:02:11.664 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking dump (0.4b47-3) ... 2024-01-24T13:02:11.744 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-24T13:02:11.823 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-24T13:02:11.947 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package indent. 2024-01-24T13:02:11.949 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-24T13:02:11.963 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T13:02:12.005 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-24T13:02:12.125 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-24T13:02:12.243 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T13:02:12.319 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-24T13:02:12.336 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-24T13:02:12.345 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-24T13:02:12.378 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-24T13:02:12.513 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up postgresql-client (14+238) ... 2024-01-24T13:02:12.639 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-24T13:02:12.889 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-24T13:02:12.907 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-24T13:02:12.947 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-24T13:02:13.210 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-24T13:02:13.218 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:13.218 INFO:teuthology.orchestra.run.smithi163.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-24T13:02:13.218 INFO:teuthology.orchestra.run.smithi163.stdout:which means they are currently configured by ifupdown: 2024-01-24T13:02:13.218 INFO:teuthology.orchestra.run.smithi163.stdout:- enp3s0f1 2024-01-24T13:02:13.218 INFO:teuthology.orchestra.run.smithi163.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-24T13:02:13.218 INFO:teuthology.orchestra.run.smithi163.stdout:remove their configuration from /etc/network/interfaces. 2024-01-24T13:02:13.218 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:13.226 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-24T13:02:13.268 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-24T13:02:13.350 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-24T13:02:13.701 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-24T13:02:13.717 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-24T13:02:13.734 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-24T13:02:13.759 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-24T13:02:14.016 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-24T13:02:14.032 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-24T13:02:14.074 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-24T13:02:14.135 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-24T13:02:14.337 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libjson-perl. 2024-01-24T13:02:14.353 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-24T13:02:14.395 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-24T13:02:14.702 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-24T13:02:14.718 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-24T13:02:14.761 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-24T13:02:14.792 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T13:02:14.919 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-24T13:02:15.028 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-24T13:02:15.154 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up postgresql-common (238) ... 2024-01-24T13:02:16.489 INFO:teuthology.orchestra.run.smithi163.stdout:Adding user postgres to group ssl-cert 2024-01-24T13:02:16.741 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:16.741 INFO:teuthology.orchestra.run.smithi163.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-24T13:02:16.917 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-24T13:02:16.933 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-24T13:02:16.975 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T13:02:17.005 INFO:teuthology.orchestra.run.smithi163.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-24T13:02:17.005 INFO:teuthology.orchestra.run.smithi163.stdout:Removing obsolete dictionary files: 2024-01-24T13:02:17.247 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-24T13:02:17.263 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-24T13:02:17.305 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T13:02:17.619 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-24T13:02:17.636 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-24T13:02:17.674 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-24T13:02:17.743 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T13:02:18.125 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-24T13:02:18.142 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-24T13:02:18.165 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T13:02:18.184 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-24T13:02:18.507 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-24T13:02:18.524 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-24T13:02:18.532 INFO:teuthology.orchestra.run.smithi163.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-24T13:02:18.565 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-24T13:02:18.568 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-24T13:02:18.622 INFO:teuthology.orchestra.run.smithi163.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-24T13:02:18.623 INFO:teuthology.orchestra.run.smithi163.stdout:This user must also own the server process. 2024-01-24T13:02:18.623 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:18.623 INFO:teuthology.orchestra.run.smithi163.stdout:The database cluster will be initialized with locale "en_US". 2024-01-24T13:02:18.623 INFO:teuthology.orchestra.run.smithi163.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-24T13:02:18.623 INFO:teuthology.orchestra.run.smithi163.stdout:The default text search configuration will be set to "english". 2024-01-24T13:02:18.623 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:18.623 INFO:teuthology.orchestra.run.smithi163.stdout:Data page checksums are disabled. 2024-01-24T13:02:18.623 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:18.623 INFO:teuthology.orchestra.run.smithi163.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-24T13:02:18.624 INFO:teuthology.orchestra.run.smithi163.stdout:creating subdirectories ... ok 2024-01-24T13:02:18.624 INFO:teuthology.orchestra.run.smithi163.stdout:selecting dynamic shared memory implementation ... posix 2024-01-24T13:02:18.647 INFO:teuthology.orchestra.run.smithi163.stdout:selecting default max_connections ... 100 2024-01-24T13:02:18.681 INFO:teuthology.orchestra.run.smithi163.stdout:selecting default shared_buffers ... 128MB 2024-01-24T13:02:18.694 INFO:teuthology.orchestra.run.smithi163.stdout:selecting default time zone ... Etc/UTC 2024-01-24T13:02:18.695 INFO:teuthology.orchestra.run.smithi163.stdout:creating configuration files ... ok 2024-01-24T13:02:18.858 INFO:teuthology.orchestra.run.smithi163.stdout:running bootstrap script ... ok 2024-01-24T13:02:18.931 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-24T13:02:18.947 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T13:02:19.005 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T13:02:19.394 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-24T13:02:19.410 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T13:02:19.452 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T13:02:19.461 INFO:teuthology.orchestra.run.smithi163.stdout:performing post-bootstrap initialization ... ok 2024-01-24T13:02:19.783 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-24T13:02:19.799 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T13:02:19.842 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T13:02:19.981 INFO:teuthology.orchestra.run.smithi163.stdout:syncing data to disk ... ok 2024-01-24T13:02:20.079 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-24T13:02:20.095 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-24T13:02:20.137 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T13:02:20.497 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-24T13:02:20.753 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-24T13:02:20.769 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-24T13:02:20.812 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-24T13:02:21.177 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package modemmanager. 2024-01-24T13:02:21.193 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-24T13:02:21.235 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T13:02:21.914 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package network-manager. 2024-01-24T13:02:21.931 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-24T13:02:21.981 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-24T13:02:22.655 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ppp. 2024-01-24T13:02:22.672 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-24T13:02:23.007 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-24T13:02:23.482 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T13:02:23.600 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-24T13:02:23.727 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up postgresql (14+238) ... 2024-01-24T13:02:23.809 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package pptp-linux. 2024-01-24T13:02:23.825 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-24T13:02:23.861 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T13:02:23.867 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-24T13:02:23.979 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T13:02:24.147 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-24T13:02:24.164 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-24T13:02:24.205 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-24T13:02:24.238 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-24T13:02:24.239 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-24T13:02:24.571 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-24T13:02:24.587 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-24T13:02:24.629 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking postgresql-client-common (238) ... 2024-01-24T13:02:24.946 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-24T13:02:24.962 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T13:02:24.991 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-24T13:02:25.004 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T13:02:25.301 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-24T13:02:25.452 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-24T13:02:25.606 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package postgresql-common. 2024-01-24T13:02:25.622 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-24T13:02:25.684 INFO:teuthology.orchestra.run.smithi029.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-24T13:02:25.715 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking postgresql-common (238) ... 2024-01-24T13:02:26.264 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package postgresql-14. 2024-01-24T13:02:26.281 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T13:02:26.326 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T13:02:26.856 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-24T13:02:26.957 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-24T13:02:27.522 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package postgresql. 2024-01-24T13:02:27.537 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-24T13:02:27.581 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking postgresql (14+238) ... 2024-01-24T13:02:27.674 INFO:teuthology.orchestra.run.smithi163.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-24T13:02:27.682 DEBUG:teuthology.parallel:result is None 2024-01-24T13:02:27.836 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package postgresql-client. 2024-01-24T13:02:27.851 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-24T13:02:27.895 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking postgresql-client (14+238) ... 2024-01-24T13:02:28.140 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-24T13:02:28.156 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-24T13:02:28.326 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-24T13:02:28.716 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package tcl8.6. 2024-01-24T13:02:28.733 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-24T13:02:28.775 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-24T13:02:29.064 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package tcl. 2024-01-24T13:02:29.081 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-24T13:02:29.127 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-24T13:02:29.503 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package wpasupplicant. 2024-01-24T13:02:29.519 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-24T13:02:29.561 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-24T13:02:29.979 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-24T13:02:29.996 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-24T13:02:30.037 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-24T13:02:30.420 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-24T13:02:30.436 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-24T13:02:30.486 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-24T13:02:30.793 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up postgresql-client-common (238) ... 2024-01-24T13:02:31.024 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-24T13:02:31.211 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-24T13:02:31.347 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T13:02:31.473 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-24T13:02:31.600 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-24T13:02:31.728 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T13:02:32.707 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-24T13:02:32.814 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-24T13:02:33.201 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-24T13:02:33.201 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-24T13:02:33.878 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-24T13:02:34.006 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T13:02:34.133 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-24T13:02:34.260 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-24T13:02:34.395 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-24T13:02:34.522 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-24T13:02:34.651 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-24T13:02:35.437 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-24T13:02:35.564 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up dump (0.4b47-3) ... 2024-01-24T13:02:35.659 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-24T13:02:35.725 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T13:02:35.854 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-24T13:02:35.989 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-24T13:02:36.116 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-24T13:02:36.243 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-24T13:02:36.333 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-24T13:02:36.447 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-24T13:02:36.574 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-24T13:02:36.751 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-24T13:02:36.878 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T13:02:37.015 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-24T13:02:37.184 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up postgresql-client (14+238) ... 2024-01-24T13:02:37.311 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-24T13:02:37.889 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:37.889 INFO:teuthology.orchestra.run.smithi029.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-24T13:02:37.889 INFO:teuthology.orchestra.run.smithi029.stdout:which means they are currently configured by ifupdown: 2024-01-24T13:02:37.889 INFO:teuthology.orchestra.run.smithi029.stdout:- ens1f0 2024-01-24T13:02:37.889 INFO:teuthology.orchestra.run.smithi029.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-24T13:02:37.889 INFO:teuthology.orchestra.run.smithi029.stdout:remove their configuration from /etc/network/interfaces. 2024-01-24T13:02:37.889 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:38.028 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-24T13:02:38.399 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-24T13:02:38.804 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-24T13:02:40.202 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T13:02:40.379 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-24T13:02:40.506 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-24T13:02:40.634 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up postgresql-common (238) ... 2024-01-24T13:02:41.644 INFO:teuthology.orchestra.run.smithi029.stdout:Adding user postgres to group ssl-cert 2024-01-24T13:02:41.913 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:41.913 INFO:teuthology.orchestra.run.smithi029.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-24T13:02:42.192 INFO:teuthology.orchestra.run.smithi029.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-24T13:02:42.193 INFO:teuthology.orchestra.run.smithi029.stdout:Removing obsolete dictionary files: 2024-01-24T13:02:42.883 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-24T13:02:43.339 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T13:02:43.687 INFO:teuthology.orchestra.run.smithi029.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-24T13:02:43.701 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-24T13:02:43.770 INFO:teuthology.orchestra.run.smithi029.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-24T13:02:43.770 INFO:teuthology.orchestra.run.smithi029.stdout:This user must also own the server process. 2024-01-24T13:02:43.770 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:43.771 INFO:teuthology.orchestra.run.smithi029.stdout:The database cluster will be initialized with locale "en_US". 2024-01-24T13:02:43.771 INFO:teuthology.orchestra.run.smithi029.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-24T13:02:43.771 INFO:teuthology.orchestra.run.smithi029.stdout:The default text search configuration will be set to "english". 2024-01-24T13:02:43.771 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:43.771 INFO:teuthology.orchestra.run.smithi029.stdout:Data page checksums are disabled. 2024-01-24T13:02:43.771 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:43.771 INFO:teuthology.orchestra.run.smithi029.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-24T13:02:43.772 INFO:teuthology.orchestra.run.smithi029.stdout:creating subdirectories ... ok 2024-01-24T13:02:43.772 INFO:teuthology.orchestra.run.smithi029.stdout:selecting dynamic shared memory implementation ... posix 2024-01-24T13:02:43.795 INFO:teuthology.orchestra.run.smithi029.stdout:selecting default max_connections ... 100 2024-01-24T13:02:43.831 INFO:teuthology.orchestra.run.smithi029.stdout:selecting default shared_buffers ... 128MB 2024-01-24T13:02:43.845 INFO:teuthology.orchestra.run.smithi029.stdout:selecting default time zone ... Etc/UTC 2024-01-24T13:02:43.846 INFO:teuthology.orchestra.run.smithi029.stdout:creating configuration files ... ok 2024-01-24T13:02:44.020 INFO:teuthology.orchestra.run.smithi029.stdout:running bootstrap script ... ok 2024-01-24T13:02:44.784 INFO:teuthology.orchestra.run.smithi029.stdout:performing post-bootstrap initialization ... ok 2024-01-24T13:02:45.576 INFO:teuthology.orchestra.run.smithi029.stdout:syncing data to disk ... ok 2024-01-24T13:02:46.092 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-24T13:02:49.149 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T13:02:49.276 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-24T13:02:49.403 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up postgresql (14+238) ... 2024-01-24T13:02:49.571 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T13:02:49.700 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T13:02:49.967 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-24T13:02:49.968 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-24T13:02:50.695 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-24T13:02:51.117 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-24T13:02:51.270 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-24T13:02:52.785 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-24T13:02:52.885 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-24T13:02:53.688 INFO:teuthology.orchestra.run.smithi029.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-24T13:02:53.694 DEBUG:teuthology.parallel:result is None 2024-01-24T13:02:53.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T13:02:53.842 DEBUG:teuthology.orchestra.run.smithi029:> dpkg-query -W -f '${Version}' ceph 2024-01-24T13:02:53.865 INFO:teuthology.orchestra.run.smithi029.stdout:18.2.1-341-g4e3182a6-1jammy 2024-01-24T13:02:53.865 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-341-g4e3182a6-1jammy 2024-01-24T13:02:53.865 INFO:teuthology.task.install:The correct ceph version 18.2.1-341-g4e3182a6-1jammy is installed. 2024-01-24T13:02:53.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T13:02:54.013 DEBUG:teuthology.orchestra.run.smithi163:> dpkg-query -W -f '${Version}' ceph 2024-01-24T13:02:54.037 INFO:teuthology.orchestra.run.smithi163.stdout:18.2.1-341-g4e3182a6-1jammy 2024-01-24T13:02:54.037 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-341-g4e3182a6-1jammy 2024-01-24T13:02:54.038 INFO:teuthology.task.install:The correct ceph version 18.2.1-341-g4e3182a6-1jammy is installed. 2024-01-24T13:02:54.040 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-24T13:02:54.040 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:02:54.040 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-24T13:02:54.060 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:02:54.061 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-24T13:02:54.101 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-24T13:02:54.101 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:02:54.101 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2024-01-24T13:02:54.121 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-24T13:02:54.181 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:02:54.181 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2024-01-24T13:02:54.202 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-24T13:02:54.268 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-24T13:02:54.268 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:02:54.268 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-24T13:02:54.287 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-24T13:02:54.353 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:02:54.353 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-24T13:02:54.374 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-24T13:02:54.440 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-24T13:02:54.440 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:02:54.440 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2024-01-24T13:02:54.459 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-24T13:02:54.526 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:02:54.526 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/stdin-killer 2024-01-24T13:02:54.546 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-24T13:02:54.608 INFO:teuthology.run_tasks:Running task ceph... 2024-01-24T13:02:54.678 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-24T13:02:54.678 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2024-01-24T13:02:54.682 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /var/log/ceph 2024-01-24T13:02:54.702 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-24T13:02:54.702 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-24T13:02:54.746 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-24T13:02:54.767 INFO:tasks.ceph:Creating extra log directories... 2024-01-24T13:02:54.767 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-24T13:02:54.806 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-24T13:02:54.840 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-24T13:02:54.841 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-24T13:02:54.841 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-24T13:02:54.841 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:02:54.841 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-24T13:02:54.875 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-24T13:02:54.965 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:02:54.965 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-24T13:02:54.973 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-24T13:02:55.070 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-24T13:02:55.070 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-24T13:02:55.071 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785', 'branch': 'wip-vshankar-testing1-reef-2024-01-24-1150', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7530785', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'f2d3460408951339ac0933340ad449487c9efddc'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing1-reef-2024-01-24-1150'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing1-reef-2024-01-24-1150', 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4668, 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134', 'sleep_before_teardown': 0, 'subset': '346/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing1-reef-2024-01-24-1150', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO6qSF79hcu2xwEl93Due8znq/AJy9oP3qGtTolhJtphDQ0WmLH3kKsrCYfv3HMdsM6Lr166rWQocA8uFWgTums=', 'smithi163.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJtR4eptIOjV9QV7L7cywaJkxEyuolirOzoikyj4ghOQi1VZXdGTHIz3vCc7WT4qH2stJ4NJJ63P7UnilU98kuw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'f2d3460408951339ac0933340ad449487c9efddc'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'c856e0f9244dd29a50697123b480d63f16a4ed81', 'timestamp': '2024-01-24_12:12:30', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-24T13:02:55.071 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-24T13:02:55.074 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-24T13:02:55.083 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2024-01-24T13:02:55.126 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/run/ceph 2024-01-24T13:02:55.147 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:02:55.147 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2024-01-24T13:02:55.191 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-24T13:02:55.192 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2024-01-24T13:02:55.242 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-24T13:02:55.243 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T13:02:55.243 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-01-24T13:02:55.243 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T13:02:55.243 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-01-24 12:56:18.308480279 +0000 2024-01-24T13:02:55.243 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-01-24 12:56:18.064482459 +0000 2024-01-24T13:02:55.243 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-01-24 12:56:18.064482459 +0000 2024-01-24T13:02:55.243 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-01-24 12:56:18.064482459 +0000 2024-01-24T13:02:55.243 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-24T13:02:55.303 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-01-24T13:02:55.304 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-01-24T13:02:55.304 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000228026 s, 2.2 MB/s 2024-01-24T13:02:55.305 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-24T13:02:55.357 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2024-01-24T13:02:55.407 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-24T13:02:55.407 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T13:02:55.407 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-01-24T13:02:55.407 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T13:02:55.407 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-01-24 12:56:18.848475455 +0000 2024-01-24T13:02:55.407 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-01-24 12:56:18.584477813 +0000 2024-01-24T13:02:55.407 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-01-24 12:56:18.584477813 +0000 2024-01-24T13:02:55.408 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-01-24 12:56:18.584477813 +0000 2024-01-24T13:02:55.408 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-24T13:02:55.467 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-01-24T13:02:55.468 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-01-24T13:02:55.468 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000220144 s, 2.3 MB/s 2024-01-24T13:02:55.469 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-24T13:02:55.520 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2024-01-24T13:02:55.575 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-24T13:02:55.575 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T13:02:55.575 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-01-24T13:02:55.575 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T13:02:55.576 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-01-24 12:56:19.336471097 +0000 2024-01-24T13:02:55.576 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-01-24 12:56:19.092473276 +0000 2024-01-24T13:02:55.576 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-01-24 12:56:19.092473276 +0000 2024-01-24T13:02:55.576 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-01-24 12:56:19.092473276 +0000 2024-01-24T13:02:55.576 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-24T13:02:55.635 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-01-24T13:02:55.636 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-01-24T13:02:55.636 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000226219 s, 2.3 MB/s 2024-01-24T13:02:55.637 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-24T13:02:55.693 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2024-01-24T13:02:55.743 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-24T13:02:55.743 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T13:02:55.743 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-01-24T13:02:55.743 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T13:02:55.743 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-01-24 12:56:19.844466559 +0000 2024-01-24T13:02:55.743 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-01-24 12:56:19.584468881 +0000 2024-01-24T13:02:55.743 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-01-24 12:56:19.584468881 +0000 2024-01-24T13:02:55.743 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-01-24 12:56:19.584468881 +0000 2024-01-24T13:02:55.744 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-24T13:02:55.803 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-01-24T13:02:55.804 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-01-24T13:02:55.804 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000200809 s, 2.5 MB/s 2024-01-24T13:02:55.805 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-24T13:02:55.856 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-24T13:02:55.856 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:02:55.857 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/scratch_devs of=/dev/stdout 2024-01-24T13:02:55.866 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-24T13:02:55.866 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_1 2024-01-24T13:02:55.916 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-24T13:02:55.916 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T13:02:55.916 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-01-24T13:02:55.916 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T13:02:55.916 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-01-24 12:55:59.218202100 +0000 2024-01-24T13:02:55.916 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-01-24 12:55:58.986204173 +0000 2024-01-24T13:02:55.916 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-01-24 12:55:58.986204173 +0000 2024-01-24T13:02:55.917 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-01-24 12:55:58.986204173 +0000 2024-01-24T13:02:55.917 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-24T13:02:55.978 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-01-24T13:02:55.978 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-01-24T13:02:55.978 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000408131 s, 1.3 MB/s 2024-01-24T13:02:55.980 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-24T13:02:56.035 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_2 2024-01-24T13:02:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-24T13:02:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T13:02:56.085 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-01-24T13:02:56.085 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T13:02:56.085 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-01-24 12:55:59.726197562 +0000 2024-01-24T13:02:56.085 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-01-24 12:55:59.470199850 +0000 2024-01-24T13:02:56.085 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-01-24 12:55:59.470199850 +0000 2024-01-24T13:02:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-01-24 12:55:59.470199850 +0000 2024-01-24T13:02:56.085 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-24T13:02:56.146 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-01-24T13:02:56.146 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-01-24T13:02:56.147 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000389717 s, 1.3 MB/s 2024-01-24T13:02:56.149 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-24T13:02:56.202 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_3 2024-01-24T13:02:56.252 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-24T13:02:56.252 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T13:02:56.252 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-01-24T13:02:56.252 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T13:02:56.253 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-01-24 12:56:00.246192918 +0000 2024-01-24T13:02:56.253 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-01-24 12:55:59.978195312 +0000 2024-01-24T13:02:56.253 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-01-24 12:55:59.978195312 +0000 2024-01-24T13:02:56.253 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-01-24 12:55:59.978195312 +0000 2024-01-24T13:02:56.253 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-24T13:02:56.314 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-01-24T13:02:56.314 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-01-24T13:02:56.314 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000372195 s, 1.4 MB/s 2024-01-24T13:02:56.316 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-24T13:02:56.370 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_4 2024-01-24T13:02:56.420 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-24T13:02:56.420 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T13:02:56.420 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-01-24T13:02:56.420 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T13:02:56.420 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-01-24 12:56:00.738188524 +0000 2024-01-24T13:02:56.420 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-01-24 12:56:00.494190703 +0000 2024-01-24T13:02:56.420 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-01-24 12:56:00.494190703 +0000 2024-01-24T13:02:56.420 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-01-24 12:56:00.494190703 +0000 2024-01-24T13:02:56.421 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-24T13:02:56.482 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-01-24T13:02:56.482 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-01-24T13:02:56.482 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000368018 s, 1.4 MB/s 2024-01-24T13:02:56.484 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-24T13:02:56.538 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-24T13:02:56.538 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-24T13:02:56.538 INFO:tasks.ceph:Generating config... 2024-01-24T13:02:56.539 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-24T13:02:56.539 INFO:tasks.ceph:[client] debug client = 20 2024-01-24T13:02:56.539 INFO:tasks.ceph:[client] debug ms = 1 2024-01-24T13:02:56.540 INFO:tasks.ceph:[client] pid file = 2024-01-24T13:02:56.540 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-24T13:02:56.540 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-24T13:02:56.540 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-24T13:02:56.540 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-24T13:02:56.540 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-24T13:02:56.540 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-24T13:02:56.540 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-24T13:02:56.540 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-24T13:02:56.540 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-24T13:02:56.540 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-24T13:02:56.540 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-24T13:02:56.540 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-24T13:02:56.540 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-24T13:02:56.541 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-24T13:02:56.541 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-24T13:02:56.541 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-24T13:02:56.541 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-24T13:02:56.541 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-24T13:02:56.541 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-24T13:02:56.541 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-24T13:02:56.541 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-01-24T13:02:56.541 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-01-24T13:02:56.541 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-24T13:02:56.541 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-24T13:02:56.541 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-01-24T13:02:56.541 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-24T13:02:56.541 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-24T13:02:56.541 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-24T13:02:56.541 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-24T13:02:56.542 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-24T13:02:56.542 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-24T13:02:56.542 INFO:tasks.ceph:Setting up mon.a... 2024-01-24T13:02:56.542 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-24T13:02:56.587 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.keyring 2024-01-24T13:02:56.881 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-24T13:02:56.933 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-24T13:02:56.953 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.29'), ('mon.b', '172.21.15.163'), ('mon.c', '[v2:172.21.15.163:3301,v1:172.21.15.163:6790]')] 2024-01-24T13:02:56.955 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.29,172.21.15.163,[v2:172.21.15.163:3301,v1:172.21.15.163:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-24T13:02:56.956 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:02:56.957 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-24T13:02:57.003 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.29 --add b 172.21.15.163 --addv c '[v2:172.21.15.163:3301,v1:172.21.15.163:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-24T13:02:57.094 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-24T13:02:57.094 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: generated fsid 065451ff-9152-4ec9-a888-63a66559ccfb 2024-01-24T13:02:57.094 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = pacific 2024-01-24T13:02:57.094 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 0 2024-01-24T13:02:57.094 INFO:teuthology.orchestra.run.smithi029.stdout:fsid 065451ff-9152-4ec9-a888-63a66559ccfb 2024-01-24T13:02:57.094 INFO:teuthology.orchestra.run.smithi029.stdout:last_changed 2024-01-24T13:02:57.096416+0000 2024-01-24T13:02:57.094 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-01-24T13:02:57.096416+0000 2024-01-24T13:02:57.094 INFO:teuthology.orchestra.run.smithi029.stdout:min_mon_release 16 (pacific) 2024-01-24T13:02:57.094 INFO:teuthology.orchestra.run.smithi029.stdout:election_strategy: 1 2024-01-24T13:02:57.095 INFO:teuthology.orchestra.run.smithi029.stdout:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-01-24T13:02:57.095 INFO:teuthology.orchestra.run.smithi029.stdout:1: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-01-24T13:02:57.095 INFO:teuthology.orchestra.run.smithi029.stdout:2: [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] mon.c 2024-01-24T13:02:57.095 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-24T13:02:57.097 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-24T13:02:57.105 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 065451ff-9152-4ec9-a888-63a66559ccfb... 2024-01-24T13:02:57.106 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-24T13:02:57.153 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-24T13:02:57.193 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2024-01-24T13:02:57.194 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2024-01-24T13:02:57.194 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-24T13:02:57.194 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2024-01-24T13:02:57.194 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.194 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2024-01-24T13:02:57.194 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.194 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2024-01-24T13:02:57.194 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.194 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2024-01-24T13:02:57.194 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2024-01-24T13:02:57.195 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.195 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2024-01-24T13:02:57.195 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2024-01-24T13:02:57.195 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.195 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-24T13:02:57.195 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2024-01-24T13:02:57.195 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.195 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2024-01-24T13:02:57.195 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-24T13:02:57.196 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.196 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2024-01-24T13:02:57.196 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.196 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2024-01-24T13:02:57.196 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2024-01-24T13:02:57.196 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2024-01-24T13:02:57.196 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2024-01-24T13:02:57.196 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2024-01-24T13:02:57.196 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2024-01-24T13:02:57.197 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2024-01-24T13:02:57.197 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-24T13:02:57.197 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-24T13:02:57.197 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2024-01-24T13:02:57.197 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.197 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-24T13:02:57.197 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.197 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2024-01-24T13:02:57.197 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.197 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2024-01-24T13:02:57.198 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.198 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2024-01-24T13:02:57.198 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2024-01-24T13:02:57.198 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2024-01-24T13:02:57.198 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,172.21.15.163,[v2:172.21.15.163:3301,v1:172.21.15.163:6790]" 2024-01-24T13:02:57.198 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = 065451ff-9152-4ec9-a888-63a66559ccfb 2024-01-24T13:02:57.198 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.198 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2024-01-24T13:02:57.198 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2024-01-24T13:02:57.198 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.199 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2024-01-24T13:02:57.199 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2024-01-24T13:02:57.199 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2024-01-24T13:02:57.199 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.199 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2024-01-24T13:02:57.199 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2024-01-24T13:02:57.199 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.199 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2024-01-24T13:02:57.199 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2024-01-24T13:02:57.199 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2024-01-24T13:02:57.200 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.200 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2024-01-24T13:02:57.200 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2024-01-24T13:02:57.200 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.200 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2024-01-24T13:02:57.200 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.200 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2024-01-24T13:02:57.200 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.200 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2024-01-24T13:02:57.200 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.201 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2024-01-24T13:02:57.201 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2024-01-24T13:02:57.201 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.201 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2024-01-24T13:02:57.201 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2024-01-24T13:02:57.201 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2024-01-24T13:02:57.201 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2024-01-24T13:02:57.202 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 20 2024-01-24T13:02:57.202 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 20 2024-01-24T13:02:57.202 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-01-24T13:02:57.202 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2024-01-24T13:02:57.202 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 10 2024-01-24T13:02:57.202 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2024-01-24T13:02:57.202 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2024-01-24T13:02:57.203 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2024-01-24T13:02:57.203 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2024-01-24T13:02:57.203 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2024-01-24T13:02:57.203 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2024-01-24T13:02:57.203 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.204 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2024-01-24T13:02:57.204 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-01-24T13:02:57.204 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2024-01-24T13:02:57.204 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-01-24T13:02:57.204 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-01-24T13:02:57.204 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-01-24T13:02:57.205 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-01-24T13:02:57.205 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2024-01-24T13:02:57.205 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.205 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2024-01-24T13:02:57.205 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-01-24T13:02:57.205 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-01-24T13:02:57.206 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2024-01-24T13:02:57.206 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-01-24T13:02:57.206 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2024-01-24T13:02:57.206 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2024-01-24T13:02:57.206 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-01-24T13:02:57.206 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2024-01-24T13:02:57.206 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2024-01-24T13:02:57.207 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-01-24T13:02:57.207 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.207 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-24T13:02:57.207 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2024-01-24T13:02:57.207 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2024-01-24T13:02:57.207 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.208 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2024-01-24T13:02:57.208 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-24T13:02:57.208 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-24T13:02:57.208 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.208 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2024-01-24T13:02:57.208 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2024-01-24T13:02:57.209 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.209 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2024-01-24T13:02:57.209 INFO:teuthology.orchestra.run.smithi029.stdout: mon op complaint time = 120 2024-01-24T13:02:57.209 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:02:57.209 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2024-01-24T13:02:57.209 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2024-01-24T13:02:57.210 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2024-01-24T13:02:57.210 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2024-01-24T13:02:57.210 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-24T13:02:57.210 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-24T13:02:57.210 INFO:teuthology.orchestra.run.smithi029.stdout: client mount timeout = 600 2024-01-24T13:02:57.210 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2024-01-24T13:02:57.210 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-01-24T13:02:57.211 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = "" 2024-01-24T13:02:57.211 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2024-01-24T13:02:57.211 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2024-01-24T13:02:57.211 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2024-01-24T13:02:57.211 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2024-01-24T13:02:57.211 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2024-01-24T13:02:57.211 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2024-01-24T13:02:57.212 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2024-01-24T13:02:57.212 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2024-01-24T13:02:57.212 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2024-01-24T13:02:57.212 INFO:teuthology.orchestra.run.smithi029.stdout:[mds] 2024-01-24T13:02:57.212 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds = 20 2024-01-24T13:02:57.212 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds balancer = 20 2024-01-24T13:02:57.213 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-01-24T13:02:57.213 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug frag = True 2024-01-24T13:02:57.213 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug scatterstat = True 2024-01-24T13:02:57.213 INFO:teuthology.orchestra.run.smithi029.stdout: mds op complaint time = 180 2024-01-24T13:02:57.213 INFO:teuthology.orchestra.run.smithi029.stdout: mds verify scatter = True 2024-01-24T13:02:57.213 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2024-01-24T13:02:57.213 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2024-01-24T13:02:57.214 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2024-01-24T13:02:57.216 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2024-01-24T13:02:57.216 INFO:teuthology.orchestra.run.smithi163.stdout: chdir = "" 2024-01-24T13:02:57.216 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-24T13:02:57.217 INFO:teuthology.orchestra.run.smithi163.stdout: auth supported = cephx 2024-01-24T13:02:57.217 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.217 INFO:teuthology.orchestra.run.smithi163.stdout: filestore xattr use omap = true 2024-01-24T13:02:57.217 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.217 INFO:teuthology.orchestra.run.smithi163.stdout: mon clock drift allowed = 1.000 2024-01-24T13:02:57.217 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.217 INFO:teuthology.orchestra.run.smithi163.stdout: osd crush chooseleaf type = 0 2024-01-24T13:02:57.218 INFO:teuthology.orchestra.run.smithi163.stdout: auth debug = true 2024-01-24T13:02:57.218 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.218 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on old message = true 2024-01-24T13:02:57.218 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on bug = true 2024-01-24T13:02:57.218 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.218 INFO:teuthology.orchestra.run.smithi163.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-24T13:02:57.218 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn max object skew = 0 2024-01-24T13:02:57.219 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.219 INFO:teuthology.orchestra.run.smithi163.stdout: # disable pg_autoscaler by default for new pools 2024-01-24T13:02:57.219 INFO:teuthology.orchestra.run.smithi163.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-24T13:02:57.219 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.219 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default size = 2 2024-01-24T13:02:57.219 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.219 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow primary affinity = true 2024-01-24T13:02:57.220 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow pg remap = true 2024-01-24T13:02:57.220 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on legacy crush tunables = false 2024-01-24T13:02:57.220 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on crush straw calc version zero = false 2024-01-24T13:02:57.220 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on no sortbitwise = false 2024-01-24T13:02:57.220 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = false 2024-01-24T13:02:57.220 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on too few osds = false 2024-01-24T13:02:57.220 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-24T13:02:57.221 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-24T13:02:57.221 INFO:teuthology.orchestra.run.smithi163.stdout: mon_allow_pool_size_one = true 2024-01-24T13:02:57.221 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.221 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-24T13:02:57.221 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.221 INFO:teuthology.orchestra.run.smithi163.stdout: osd default data pool replay window = 5 2024-01-24T13:02:57.221 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.222 INFO:teuthology.orchestra.run.smithi163.stdout: mon allow pool delete = true 2024-01-24T13:02:57.222 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.222 INFO:teuthology.orchestra.run.smithi163.stdout: mon cluster log file level = debug 2024-01-24T13:02:57.222 INFO:teuthology.orchestra.run.smithi163.stdout: debug asserts on shutdown = true 2024-01-24T13:02:57.222 INFO:teuthology.orchestra.run.smithi163.stdout: mon health detail to clog = false 2024-01-24T13:02:57.222 INFO:teuthology.orchestra.run.smithi163.stdout: mon host = "172.21.15.29,172.21.15.163,[v2:172.21.15.163:3301,v1:172.21.15.163:6790]" 2024-01-24T13:02:57.222 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = 065451ff-9152-4ec9-a888-63a66559ccfb 2024-01-24T13:02:57.222 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.223 INFO:teuthology.orchestra.run.smithi163.stdout:[osd] 2024-01-24T13:02:57.223 INFO:teuthology.orchestra.run.smithi163.stdout: osd journal size = 100 2024-01-24T13:02:57.223 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.223 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub load threshold = 5.0 2024-01-24T13:02:57.223 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub max interval = 600 2024-01-24T13:02:57.223 INFO:teuthology.orchestra.run.smithi163.stdout: osd mclock profile = high_recovery_ops 2024-01-24T13:02:57.223 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.224 INFO:teuthology.orchestra.run.smithi163.stdout: osd recover clone overlap = true 2024-01-24T13:02:57.224 INFO:teuthology.orchestra.run.smithi163.stdout: osd recovery max chunk = 1048576 2024-01-24T13:02:57.224 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.224 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug shutdown = true 2024-01-24T13:02:57.224 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug op order = true 2024-01-24T13:02:57.224 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug verify stray on activate = true 2024-01-24T13:02:57.224 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.225 INFO:teuthology.orchestra.run.smithi163.stdout: osd open classes on start = true 2024-01-24T13:02:57.225 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug pg log writeout = true 2024-01-24T13:02:57.225 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.225 INFO:teuthology.orchestra.run.smithi163.stdout: osd deep scrub update digest min age = 30 2024-01-24T13:02:57.225 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.225 INFO:teuthology.orchestra.run.smithi163.stdout: osd map max advance = 10 2024-01-24T13:02:57.225 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.225 INFO:teuthology.orchestra.run.smithi163.stdout: journal zero on create = true 2024-01-24T13:02:57.226 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.226 INFO:teuthology.orchestra.run.smithi163.stdout: filestore ondisk finisher threads = 3 2024-01-24T13:02:57.226 INFO:teuthology.orchestra.run.smithi163.stdout: filestore apply finisher threads = 3 2024-01-24T13:02:57.226 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.226 INFO:teuthology.orchestra.run.smithi163.stdout: bdev debug aio = true 2024-01-24T13:02:57.226 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug misdirected ops = true 2024-01-24T13:02:57.226 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore block size = 96636764160 2024-01-24T13:02:57.226 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore fsck on mount = True 2024-01-24T13:02:57.226 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluefs = 20 2024-01-24T13:02:57.227 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluestore = 20 2024-01-24T13:02:57.227 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-01-24T13:02:57.227 INFO:teuthology.orchestra.run.smithi163.stdout: debug osd = 20 2024-01-24T13:02:57.227 INFO:teuthology.orchestra.run.smithi163.stdout: debug rocksdb = 10 2024-01-24T13:02:57.227 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd backfillfull_ratio = 0.85 2024-01-24T13:02:57.227 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd full ratio = 0.9 2024-01-24T13:02:57.227 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd nearfull ratio = 0.8 2024-01-24T13:02:57.227 INFO:teuthology.orchestra.run.smithi163.stdout: osd failsafe full ratio = 0.95 2024-01-24T13:02:57.228 INFO:teuthology.orchestra.run.smithi163.stdout: osd objectstore = bluestore 2024-01-24T13:02:57.228 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2024-01-24T13:02:57.228 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.228 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr] 2024-01-24T13:02:57.228 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-01-24T13:02:57.228 INFO:teuthology.orchestra.run.smithi163.stdout: debug mgr = 20 2024-01-24T13:02:57.228 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-01-24T13:02:57.228 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-01-24T13:02:57.229 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-01-24T13:02:57.229 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-01-24T13:02:57.229 INFO:teuthology.orchestra.run.smithi163.stdout: mgr/telemetry/nag = false 2024-01-24T13:02:57.229 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.229 INFO:teuthology.orchestra.run.smithi163.stdout:[mon] 2024-01-24T13:02:57.229 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-01-24T13:02:57.229 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-01-24T13:02:57.229 INFO:teuthology.orchestra.run.smithi163.stdout: debug paxos = 20 2024-01-24T13:02:57.230 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-01-24T13:02:57.230 INFO:teuthology.orchestra.run.smithi163.stdout: mon data avail warn = 5 2024-01-24T13:02:57.230 INFO:teuthology.orchestra.run.smithi163.stdout: mon mgr mkfs grace = 240 2024-01-24T13:02:57.230 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-01-24T13:02:57.230 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd reporter subtree level = osd 2024-01-24T13:02:57.230 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd prime pg temp = true 2024-01-24T13:02:57.230 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-01-24T13:02:57.230 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.231 INFO:teuthology.orchestra.run.smithi163.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-24T13:02:57.231 INFO:teuthology.orchestra.run.smithi163.stdout: auth mon ticket ttl = 660 # 11m 2024-01-24T13:02:57.231 INFO:teuthology.orchestra.run.smithi163.stdout: auth service ticket ttl = 240 # 4m 2024-01-24T13:02:57.231 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.231 INFO:teuthology.orchestra.run.smithi163.stdout: # don't complain about insecure global_id in the test suite 2024-01-24T13:02:57.231 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-24T13:02:57.231 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-24T13:02:57.231 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.232 INFO:teuthology.orchestra.run.smithi163.stdout: # 1m isn't quite enough 2024-01-24T13:02:57.232 INFO:teuthology.orchestra.run.smithi163.stdout: mon_down_mkfs_grace = 2m 2024-01-24T13:02:57.232 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.232 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_filestore_osds = false 2024-01-24T13:02:57.232 INFO:teuthology.orchestra.run.smithi163.stdout: mon op complaint time = 120 2024-01-24T13:02:57.232 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-01-24T13:02:57.232 INFO:teuthology.orchestra.run.smithi163.stdout:[client] 2024-01-24T13:02:57.232 INFO:teuthology.orchestra.run.smithi163.stdout: rgw cache enabled = true 2024-01-24T13:02:57.233 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable ops log = true 2024-01-24T13:02:57.233 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable usage log = true 2024-01-24T13:02:57.233 INFO:teuthology.orchestra.run.smithi163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-24T13:02:57.233 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-24T13:02:57.233 INFO:teuthology.orchestra.run.smithi163.stdout: client mount timeout = 600 2024-01-24T13:02:57.233 INFO:teuthology.orchestra.run.smithi163.stdout: debug client = 20 2024-01-24T13:02:57.233 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-01-24T13:02:57.233 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = "" 2024-01-24T13:02:57.233 INFO:teuthology.orchestra.run.smithi163.stdout: rados mon op timeout = 900 2024-01-24T13:02:57.233 INFO:teuthology.orchestra.run.smithi163.stdout: rados osd op timeout = 900 2024-01-24T13:02:57.233 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.a] 2024-01-24T13:02:57.234 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.b] 2024-01-24T13:02:57.234 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.c] 2024-01-24T13:02:57.234 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2024-01-24T13:02:57.234 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.c] 2024-01-24T13:02:57.234 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.b] 2024-01-24T13:02:57.234 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.d] 2024-01-24T13:02:57.234 INFO:teuthology.orchestra.run.smithi163.stdout:[mds] 2024-01-24T13:02:57.234 INFO:teuthology.orchestra.run.smithi163.stdout: debug mds = 20 2024-01-24T13:02:57.234 INFO:teuthology.orchestra.run.smithi163.stdout: debug mds balancer = 20 2024-01-24T13:02:57.234 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-01-24T13:02:57.234 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug frag = True 2024-01-24T13:02:57.234 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug scatterstat = True 2024-01-24T13:02:57.234 INFO:teuthology.orchestra.run.smithi163.stdout: mds op complaint time = 180 2024-01-24T13:02:57.234 INFO:teuthology.orchestra.run.smithi163.stdout: mds verify scatter = True 2024-01-24T13:02:57.235 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2024-01-24T13:02:57.235 INFO:teuthology.orchestra.run.smithi163.stdout: rados mon op timeout = 900 2024-01-24T13:02:57.235 INFO:teuthology.orchestra.run.smithi163.stdout: rados osd op timeout = 900 2024-01-24T13:02:57.235 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-24T13:02:57.235 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-24T13:02:57.321 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-24T13:02:57.321 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:02:57.321 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-24T13:02:57.330 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:02:57.330 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-24T13:02:57.379 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:02:57.379 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:02:57.379 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-24T13:02:57.379 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-24T13:02:57.455 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:02:57.455 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-24T13:02:57.507 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:02:57.507 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:02:57.507 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-24T13:02:57.507 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-24T13:02:57.542 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:02:57.542 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-24T13:02:57.596 INFO:tasks.ceph:Setting up mon nodes... 2024-01-24T13:02:57.596 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-24T13:02:57.596 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-24T13:02:57.652 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-24T13:02:57.658 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-24T13:02:57.716 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-24T13:02:57.732 INFO:tasks.ceph:Setting up mds nodes... 2024-01-24T13:02:57.733 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-24T13:02:57.789 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-24T13:02:57.794 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-24T13:02:57.814 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-24T13:02:57.910 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-24T13:02:57.914 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-24T13:02:57.934 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-24T13:02:57.993 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-24T13:02:57.998 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-24T13:02:58.018 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-24T13:02:58.115 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-24T13:02:58.119 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-24T13:02:58.139 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-24T13:02:58.139 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-24T13:02:58.181 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-24T13:02:58.199 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-01-24T13:02:58.289 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-01-24T13:02:58.306 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-24T13:02:58.348 INFO:teuthology.orchestra.run.smithi163.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-01-24T13:02:58.365 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-01-24T13:02:58.448 INFO:teuthology.orchestra.run.smithi163.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-01-24T13:02:58.465 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-24T13:02:58.465 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-24T13:02:58.465 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-24T13:02:58.485 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-24T13:02:58.485 INFO:tasks.ceph:role: osd.0 2024-01-24T13:02:58.485 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:02:58.485 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-24T13:02:58.545 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T13:02:58.545 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T13:02:58.545 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T13:02:58.546 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T13:02:58.546 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T13:02:58.546 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-01-24T13:02:58.546 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T13:02:58.546 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T13:02:58.546 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T13:02:58.546 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T13:02:58.569 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-01-24T13:02:58.571 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-01-24T13:02:58.571 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-24T13:02:58.644 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-24T13:02:58.706 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T13:02:58.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:02:58.707 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-24T13:02:58.774 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-24T13:02:58.774 INFO:tasks.ceph:role: osd.1 2024-01-24T13:02:58.774 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:02:58.774 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-24T13:02:58.833 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T13:02:58.834 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T13:02:58.834 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T13:02:58.834 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T13:02:58.834 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T13:02:58.834 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-01-24T13:02:58.834 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T13:02:58.834 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T13:02:58.834 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T13:02:58.834 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T13:02:58.858 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-01-24T13:02:58.860 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-01-24T13:02:58.861 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-24T13:02:58.927 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-24T13:02:58.987 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T13:02:58.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:02:58.988 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-24T13:02:59.050 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-24T13:02:59.051 INFO:tasks.ceph:role: osd.2 2024-01-24T13:02:59.051 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:02:59.051 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-24T13:02:59.113 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T13:02:59.114 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T13:02:59.114 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T13:02:59.114 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T13:02:59.114 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T13:02:59.114 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-01-24T13:02:59.114 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T13:02:59.114 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T13:02:59.114 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T13:02:59.114 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T13:02:59.138 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-01-24T13:02:59.140 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-01-24T13:02:59.141 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-24T13:02:59.211 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-24T13:02:59.270 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T13:02:59.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:02:59.272 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-24T13:02:59.334 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-24T13:02:59.334 INFO:tasks.ceph:role: osd.3 2024-01-24T13:02:59.334 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:02:59.335 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-24T13:02:59.393 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T13:02:59.394 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T13:02:59.394 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T13:02:59.394 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T13:02:59.394 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T13:02:59.394 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-01-24T13:02:59.394 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T13:02:59.394 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T13:02:59.394 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T13:02:59.394 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T13:02:59.418 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-01-24T13:02:59.421 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-01-24T13:02:59.421 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-24T13:02:59.487 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-24T13:02:59.546 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T13:02:59.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:02:59.547 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T13:02:59.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:02:59.678+0000 7f7ba9996640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-24T13:02:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:02:59.678+0000 7f7ba9996640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-24T13:02:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:02:59.678+0000 7f7ba9996640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-24T13:02:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:02:59.678+0000 7f7ba9996640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-24T13:02:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:02:59.678+0000 7f7ba9996640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-24T13:02:59.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:02:59.678+0000 7f7ba9996640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-24T13:03:02.686 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-24T13:03:02.707 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T13:03:02.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:02.802+0000 7fc5bb02d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-24T13:03:02.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:02.802+0000 7fc5bb02d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-24T13:03:02.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:02.802+0000 7fc5bb02d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-24T13:03:02.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:02.802+0000 7fc5bb02d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-24T13:03:02.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:02.802+0000 7fc5bb02d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-24T13:03:02.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:02.806+0000 7fc5bb02d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-24T13:03:05.790 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-24T13:03:05.811 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T13:03:05.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:05.906+0000 7fefbc61e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-24T13:03:05.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:05.906+0000 7fefbc61e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-24T13:03:05.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:05.906+0000 7fefbc61e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-24T13:03:05.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:05.906+0000 7fefbc61e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-24T13:03:05.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:05.906+0000 7fefbc61e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-24T13:03:05.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:05.906+0000 7fefbc61e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-24T13:03:08.894 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-24T13:03:08.915 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T13:03:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:09.010+0000 7fc74202b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-24T13:03:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:09.010+0000 7fc74202b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-24T13:03:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:09.010+0000 7fc74202b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-24T13:03:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:09.010+0000 7fc74202b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-24T13:03:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:09.010+0000 7fc74202b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-24T13:03:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:09.010+0000 7fc74202b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-24T13:03:12.013 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-24T13:03:12.033 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-24T13:03:12.056 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-24T13:03:12.056 INFO:tasks.ceph:role: osd.4 2024-01-24T13:03:12.056 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:03:12.056 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-24T13:03:12.128 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T13:03:12.128 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T13:03:12.128 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T13:03:12.128 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T13:03:12.128 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T13:03:12.128 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-01-24T13:03:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T13:03:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T13:03:12.129 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T13:03:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T13:03:12.613 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-01-24T13:03:12.616 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-01-24T13:03:12.616 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-24T13:03:12.780 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-24T13:03:12.798 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T13:03:12.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:03:12.799 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-24T13:03:12.864 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-24T13:03:12.864 INFO:tasks.ceph:role: osd.5 2024-01-24T13:03:12.864 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:03:12.864 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-24T13:03:12.936 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T13:03:12.936 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T13:03:12.936 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T13:03:12.937 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T13:03:12.937 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T13:03:12.937 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-01-24T13:03:12.937 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T13:03:12.937 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T13:03:12.937 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T13:03:12.937 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T13:03:13.368 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-01-24T13:03:13.371 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-01-24T13:03:13.371 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-24T13:03:13.473 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-24T13:03:13.491 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T13:03:13.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:03:13.493 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-24T13:03:13.556 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-24T13:03:13.556 INFO:tasks.ceph:role: osd.6 2024-01-24T13:03:13.556 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:03:13.556 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-24T13:03:13.628 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T13:03:13.628 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T13:03:13.628 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T13:03:13.628 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T13:03:13.628 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T13:03:13.628 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-01-24T13:03:13.628 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T13:03:13.628 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T13:03:13.628 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T13:03:13.628 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T13:03:14.089 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-01-24T13:03:14.092 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-01-24T13:03:14.092 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-24T13:03:14.242 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-24T13:03:14.258 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T13:03:14.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:03:14.260 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-24T13:03:14.327 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-24T13:03:14.327 INFO:tasks.ceph:role: osd.7 2024-01-24T13:03:14.327 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:03:14.328 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-24T13:03:14.404 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T13:03:14.404 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T13:03:14.404 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T13:03:14.404 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T13:03:14.404 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T13:03:14.404 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-01-24T13:03:14.405 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T13:03:14.405 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T13:03:14.405 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T13:03:14.405 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T13:03:14.913 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-01-24T13:03:14.916 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-01-24T13:03:14.917 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-24T13:03:15.058 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-24T13:03:15.075 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T13:03:15.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:03:15.076 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T13:03:15.200 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:15.202+0000 7f1aebc60640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-24T13:03:15.206 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:15.206+0000 7f1aebc60640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-24T13:03:15.206 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:15.206+0000 7f1aebc60640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-24T13:03:15.206 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:15.206+0000 7f1aebc60640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-24T13:03:15.206 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:15.206+0000 7f1aebc60640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-24T13:03:15.208 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:15.210+0000 7f1aebc60640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-24T13:03:18.191 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-24T13:03:18.212 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T13:03:18.309 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:18.310+0000 7f948da9e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-24T13:03:18.310 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:18.310+0000 7f948da9e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-24T13:03:18.310 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:18.310+0000 7f948da9e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-24T13:03:18.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:18.310+0000 7f948da9e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-24T13:03:18.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:18.310+0000 7f948da9e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-24T13:03:18.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:18.310+0000 7f948da9e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-24T13:03:21.303 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-24T13:03:21.323 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T13:03:21.417 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:21.417+0000 7f69c5d8f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-24T13:03:21.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:21.417+0000 7f69c5d8f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-24T13:03:21.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:21.417+0000 7f69c5d8f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-24T13:03:21.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:21.417+0000 7f69c5d8f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-24T13:03:21.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:21.417+0000 7f69c5d8f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-24T13:03:21.419 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:21.417+0000 7f69c5d8f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-24T13:03:24.410 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-24T13:03:24.430 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T13:03:24.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:24.525+0000 7ff669155640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-24T13:03:24.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:24.529+0000 7ff669155640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-24T13:03:24.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:24.529+0000 7ff669155640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-24T13:03:24.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:24.529+0000 7ff669155640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-24T13:03:24.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:24.529+0000 7ff669155640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-24T13:03:24.530 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:24.529+0000 7ff669155640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-24T13:03:25.072 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:03:25.076 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:03:27.517 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-24T13:03:27.537 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-24T13:03:27.537 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:03:27.537 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-24T13:03:27.560 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:03:27.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-24T13:03:27.624 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:03:27.625 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-24T13:03:27.692 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:03:27.692 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-24T13:03:27.760 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:03:27.760 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-24T13:03:27.828 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:03:27.828 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-24T13:03:27.892 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:03:27.892 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-24T13:03:27.957 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:03:27.957 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-24T13:03:27.979 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:03:27.979 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-24T13:03:28.040 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:03:28.040 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-24T13:03:28.103 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:03:28.103 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-24T13:03:28.163 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:03:28.163 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-24T13:03:28.227 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:03:28.227 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-24T13:03:28.291 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:03:28.291 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-24T13:03:28.352 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:03:28.352 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-24T13:03:28.362 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:03:28.363 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-01-24T13:03:28.412 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:03:28.412 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-01-24T13:03:28.421 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:03:28.421 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-01-24T13:03:28.472 INFO:tasks.ceph:Adding keys to all mons... 2024-01-24T13:03:28.472 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-24T13:03:28.475 DEBUG:teuthology.orchestra.run.smithi163:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-24T13:03:28.516 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.y] 2024-01-24T13:03:28.516 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCBCrFl07wJJxAA9zO/ZHwphgGeFXCrWFYJKA== 2024-01-24T13:03:28.516 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2024-01-24T13:03:28.516 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCBCrFlfcc0LxAAcfzIx22lqaFU0QzMcxcnsA== 2024-01-24T13:03:28.516 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2024-01-24T13:03:28.516 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCBCrFlmpRhNhAAQAXfv9fO1+pk6zLArr63uw== 2024-01-24T13:03:28.516 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2024-01-24T13:03:28.516 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCDCrFlA2upKBAA/lD3Zf4Zwuct9CuHohEY4Q== 2024-01-24T13:03:28.516 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2024-01-24T13:03:28.517 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCGCrFlPxMuMBAAX00zw2rQ5p4gj+6qr8joLQ== 2024-01-24T13:03:28.517 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2024-01-24T13:03:28.517 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCJCrFlX09NNhAAs0XO4DOuWxSde/FX27SAlQ== 2024-01-24T13:03:28.517 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.3] 2024-01-24T13:03:28.517 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCNCrFlYQPpABAAwXMaiadTeodv89ipFnbtfw== 2024-01-24T13:03:28.517 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2024-01-24T13:03:28.517 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCBCrFlL3vuKhAASZI1JPwrC06IrY+iYb6jvA== 2024-01-24T13:03:28.517 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2024-01-24T13:03:28.517 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCBCrFlejZvOxAAg3f/x3idsEKvMP7TkC/XVg== 2024-01-24T13:03:28.517 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2024-01-24T13:03:28.517 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCCCrFl8fcPBxAAUGmu768hahYetBTAMaaOqw== 2024-01-24T13:03:28.517 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.4] 2024-01-24T13:03:28.518 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCTCrFlkicqDBAAwNHahMGIHvoUyoTiGYMipQ== 2024-01-24T13:03:28.518 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.5] 2024-01-24T13:03:28.518 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCWCrFlOjajEhAAI8zgPXBucICda0RviagEzg== 2024-01-24T13:03:28.518 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.6] 2024-01-24T13:03:28.518 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCZCrFlp/ISGRAADWHsw5NUXfuuT6mK++jfyQ== 2024-01-24T13:03:28.518 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.7] 2024-01-24T13:03:28.518 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCcCrFlUUSsHxAASrwuwRULMRoJ8N5268ifPA== 2024-01-24T13:03:28.518 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-01-24T13:03:28.518 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCCCrFlb6/4ChAAXuhDbbXWzUiqLFkxjl338w== 2024-01-24T13:03:28.518 INFO:teuthology.orchestra.run.smithi029.stdout:[client.2] 2024-01-24T13:03:28.518 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCCCrFlgpxlERAAQtpVfRyxSqXBmfFO2TMiuw== 2024-01-24T13:03:28.518 INFO:teuthology.orchestra.run.smithi029.stdout:[client.1] 2024-01-24T13:03:28.518 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCCCrFlAr33FBAAa9i6dmMB95s9F6uS9H29Tw== 2024-01-24T13:03:28.519 INFO:teuthology.orchestra.run.smithi029.stdout:[client.3] 2024-01-24T13:03:28.519 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCCCrFli6DxGhAAvXbTcKz7CyokwecCpCRAhg== 2024-01-24T13:03:28.530 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr.y] 2024-01-24T13:03:28.530 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCBCrFl07wJJxAA9zO/ZHwphgGeFXCrWFYJKA== 2024-01-24T13:03:28.530 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2024-01-24T13:03:28.530 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCBCrFlfcc0LxAAcfzIx22lqaFU0QzMcxcnsA== 2024-01-24T13:03:28.530 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.c] 2024-01-24T13:03:28.530 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCBCrFlmpRhNhAAQAXfv9fO1+pk6zLArr63uw== 2024-01-24T13:03:28.530 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.0] 2024-01-24T13:03:28.530 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCDCrFlA2upKBAA/lD3Zf4Zwuct9CuHohEY4Q== 2024-01-24T13:03:28.530 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.1] 2024-01-24T13:03:28.530 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCGCrFlPxMuMBAAX00zw2rQ5p4gj+6qr8joLQ== 2024-01-24T13:03:28.530 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.2] 2024-01-24T13:03:28.530 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCJCrFlX09NNhAAs0XO4DOuWxSde/FX27SAlQ== 2024-01-24T13:03:28.530 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.3] 2024-01-24T13:03:28.530 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCNCrFlYQPpABAAwXMaiadTeodv89ipFnbtfw== 2024-01-24T13:03:28.531 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr.x] 2024-01-24T13:03:28.531 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCBCrFlL3vuKhAASZI1JPwrC06IrY+iYb6jvA== 2024-01-24T13:03:28.531 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.b] 2024-01-24T13:03:28.531 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCBCrFlejZvOxAAg3f/x3idsEKvMP7TkC/XVg== 2024-01-24T13:03:28.531 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.d] 2024-01-24T13:03:28.531 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCCCrFl8fcPBxAAUGmu768hahYetBTAMaaOqw== 2024-01-24T13:03:28.531 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.4] 2024-01-24T13:03:28.531 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCTCrFlkicqDBAAwNHahMGIHvoUyoTiGYMipQ== 2024-01-24T13:03:28.531 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.5] 2024-01-24T13:03:28.531 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCWCrFlOjajEhAAI8zgPXBucICda0RviagEzg== 2024-01-24T13:03:28.531 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.6] 2024-01-24T13:03:28.531 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCZCrFlp/ISGRAADWHsw5NUXfuuT6mK++jfyQ== 2024-01-24T13:03:28.531 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.7] 2024-01-24T13:03:28.532 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCcCrFlUUSsHxAASrwuwRULMRoJ8N5268ifPA== 2024-01-24T13:03:28.532 INFO:teuthology.orchestra.run.smithi163.stdout:[client.0] 2024-01-24T13:03:28.532 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCCCrFlb6/4ChAAXuhDbbXWzUiqLFkxjl338w== 2024-01-24T13:03:28.532 INFO:teuthology.orchestra.run.smithi163.stdout:[client.2] 2024-01-24T13:03:28.532 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCCCrFlgpxlERAAQtpVfRyxSqXBmfFO2TMiuw== 2024-01-24T13:03:28.532 INFO:teuthology.orchestra.run.smithi163.stdout:[client.1] 2024-01-24T13:03:28.532 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCCCrFlAr33FBAAa9i6dmMB95s9F6uS9H29Tw== 2024-01-24T13:03:28.532 INFO:teuthology.orchestra.run.smithi163.stdout:[client.3] 2024-01-24T13:03:28.532 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCCCrFli6DxGhAAvXbTcKz7CyokwecCpCRAhg== 2024-01-24T13:03:28.533 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-24T13:03:28.566 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-24T13:03:28.634 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-24T13:03:28.637 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-24T13:03:28.696 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-24T13:03:28.699 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-24T13:03:28.756 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:28.759 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:28.813 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:28.816 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:28.870 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:28.874 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:28.928 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:28.931 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:28.985 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-24T13:03:28.988 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-24T13:03:29.042 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-24T13:03:29.045 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-24T13:03:29.102 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-24T13:03:29.105 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-24T13:03:29.162 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:29.165 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:29.219 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:29.223 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:29.277 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:29.280 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:29.334 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:29.337 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T13:03:29.390 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-24T13:03:29.393 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-24T13:03:29.449 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-24T13:03:29.453 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-24T13:03:29.509 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-24T13:03:29.512 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-24T13:03:29.568 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-24T13:03:29.572 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-24T13:03:29.627 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-24T13:03:29.627 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-24T13:03:29.649 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-24T13:03:29.765 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-24T13:03:29.785 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-24T13:03:29.804 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-24T13:03:29.918 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-24T13:03:29.937 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-24T13:03:30.002 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-24T13:03:30.115 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-24T13:03:30.135 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-24T13:03:30.138 DEBUG:teuthology.orchestra.run.smithi163:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-24T13:03:30.183 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-24T13:03:30.184 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-24T13:03:30.184 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-24T13:03:30.190 INFO:tasks.ceph.mon.a:Started 2024-01-24T13:03:30.190 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-24T13:03:30.190 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-24T13:03:30.227 INFO:tasks.ceph.mon.b:Started 2024-01-24T13:03:30.227 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-24T13:03:30.227 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-24T13:03:30.230 INFO:tasks.ceph.mon.c:Started 2024-01-24T13:03:30.230 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-24T13:03:30.230 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-24T13:03:30.230 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-24T13:03:30.234 INFO:tasks.ceph.mgr.y:Started 2024-01-24T13:03:30.234 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-24T13:03:30.234 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-24T13:03:30.237 INFO:tasks.ceph.mgr.x:Started 2024-01-24T13:03:30.237 INFO:tasks.ceph:Setting crush tunables to default 2024-01-24T13:03:30.238 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd crush tunables default 2024-01-24T13:03:30.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5fac00640 1 Processor -- start 2024-01-24T13:03:30.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5fac00640 1 -- start start 2024-01-24T13:03:30.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5fac00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f40ccdb0 0x7fd5f40cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:30.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5fac00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd5f415d070 0x7fd5f415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:30.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5fac00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f406bdf0 con 0x7fd5f4160420 2024-01-24T13:03:30.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5fac00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f4157380 con 0x7fd5f415d070 2024-01-24T13:03:30.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5fac00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40d0040 con 0x7fd5f40ccdb0 2024-01-24T13:03:30.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5f3400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd5f415d070 0x7fd5f415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:30.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5f3e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f40ccdb0 0x7fd5f40cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:30.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5f3400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd5f415d070 0x7fd5f415d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:60746/0 (socket says 172.21.15.29:60746) 2024-01-24T13:03:30.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5f3400640 1 -- 172.21.15.29:0/1806692811 learned_addr learned my addr 172.21.15.29:0/1806692811 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:30.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5f3400640 1 -- 172.21.15.29:0/1806692811 >> v2:172.21.15.163:3300/0 conn(0x7fd5f415d070 msgr2=0x7fd5f415d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-24T13:03:30.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5f3400640 1 -- 172.21.15.29:0/1806692811 >> v2:172.21.15.163:3300/0 conn(0x7fd5f415d070 msgr2=0x7fd5f415d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-24T13:03:30.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5f3400640 1 --2- 172.21.15.29:0/1806692811 >> v2:172.21.15.163:3300/0 conn(0x7fd5f415d070 0x7fd5f415d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-24T13:03:30.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5f3e00640 1 -- 172.21.15.29:0/1806692811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f40ccdb0 msgr2=0x7fd5f40cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-24T13:03:30.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5f3e00640 1 -- 172.21.15.29:0/1806692811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f40ccdb0 msgr2=0x7fd5f40cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-24T13:03:30.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5f3e00640 1 --2- 172.21.15.29:0/1806692811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f40ccdb0 0x7fd5f40cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-24T13:03:30.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5f3400640 1 --2- 172.21.15.29:0/1806692811 >> v2:172.21.15.163:3300/0 conn(0x7fd5f415d070 0x7fd5f415d4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-24T13:03:30.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.381+0000 7fd5f3e00640 1 --2- 172.21.15.29:0/1806692811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f40ccdb0 0x7fd5f40cd190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-24T13:03:30.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 -- 172.21.15.29:0/1806692811 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539939601 0 0) 0x7fd5f406bdf0 con 0x7fd5f4160420 2024-01-24T13:03:30.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 -- 172.21.15.29:0/1806692811 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5d4003530 con 0x7fd5f4160420 2024-01-24T13:03:30.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 -- 172.21.15.29:0/1806692811 <== mon.1 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3540375233 0 0) 0x7fd5d4003530 con 0x7fd5f4160420 2024-01-24T13:03:30.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 -- 172.21.15.29:0/1806692811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f40ccdb0 msgr2=0x7fd5f40cd190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-24T13:03:30.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 --2- 172.21.15.29:0/1806692811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f40ccdb0 0x7fd5f40cd190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:30.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 -- 172.21.15.29:0/1806692811 >> v2:172.21.15.163:3300/0 conn(0x7fd5f415d070 msgr2=0x7fd5f415d4f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-24T13:03:30.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 --2- 172.21.15.29:0/1806692811 >> v2:172.21.15.163:3300/0 conn(0x7fd5f415d070 0x7fd5f415d4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:30.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 -- 172.21.15.29:0/1806692811 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f415de00 con 0x7fd5f4160420 2024-01-24T13:03:30.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 -- 172.21.15.29:0/1806692811 <== mon.1 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7fd5ec001a00 con 0x7fd5f4160420 2024-01-24T13:03:30.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 -- 172.21.15.29:0/1806692811 >> v1:172.21.15.163:6789/0 conn(0x7fd5f4160420 legacy=0x7fd5f4160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:30.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 --2- 172.21.15.29:0/1806692811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5d4003980 0x7fd5d4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:30.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 --2- 172.21.15.29:0/1806692811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5d40047d0 0x7fd5d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:30.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 --2- 172.21.15.29:0/1806692811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f40ccdb0 0x7fd5d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:30.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 -- 172.21.15.29:0/1806692811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f4157380 con 0x7fd5d40047d0 2024-01-24T13:03:30.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 -- 172.21.15.29:0/1806692811 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40d0040 con 0x7fd5d4003980 2024-01-24T13:03:30.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f2a00640 1 -- 172.21.15.29:0/1806692811 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d400ba90 con 0x7fd5f40ccdb0 2024-01-24T13:03:30.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f3400640 1 --2- 172.21.15.29:0/1806692811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5d40047d0 0x7fd5d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:30.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f3e00640 1 --2- 172.21.15.29:0/1806692811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5d4003980 0x7fd5d4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:30.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f8c00640 1 --2- 172.21.15.29:0/1806692811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f40ccdb0 0x7fd5d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:30.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f3400640 1 -- 172.21.15.29:0/1806692811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f40ccdb0 msgr2=0x7fd5d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:30.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f3400640 1 --2- 172.21.15.29:0/1806692811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f40ccdb0 0x7fd5d4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:30.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f3400640 1 -- 172.21.15.29:0/1806692811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5d4003980 msgr2=0x7fd5d4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:30.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f3400640 1 --2- 172.21.15.29:0/1806692811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5d4003980 0x7fd5d4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:30.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.537+0000 7fd5f3400640 1 -- 172.21.15.29:0/1806692811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d4003530 con 0x7fd5d40047d0 2024-01-24T13:03:30.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.541+0000 7fd5f3400640 1 --2- 172.21.15.29:0/1806692811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5d40047d0 0x7fd5d4004c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009100 tx=0x7fd5dc01c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2540ce58ee7eef3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:30.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.541+0000 7fd5f2a00640 1 -- 172.21.15.29:0/1806692811 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc0aa430 con 0x7fd5d40047d0 2024-01-24T13:03:30.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.541+0000 7fd5f2a00640 1 -- 172.21.15.29:0/1806692811 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc0aa590 con 0x7fd5d40047d0 2024-01-24T13:03:30.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.541+0000 7fd5f2a00640 1 -- 172.21.15.29:0/1806692811 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc0aa940 con 0x7fd5d40047d0 2024-01-24T13:03:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.541+0000 7fd5fac00640 1 -- 172.21.15.29:0/1806692811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5d40047d0 msgr2=0x7fd5d4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.541+0000 7fd5fac00640 1 --2- 172.21.15.29:0/1806692811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5d40047d0 0x7fd5d4004c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009100 tx=0x7fd5dc01c590 comp rx=0 tx=0).stop 2024-01-24T13:03:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.541+0000 7fd5f8c00640 1 -- 172.21.15.29:0/1806692811 reap_dead start 2024-01-24T13:03:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.541+0000 7fd5fac00640 1 -- 172.21.15.29:0/1806692811 shutdown_connections 2024-01-24T13:03:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.541+0000 7fd5fac00640 1 -- 172.21.15.29:0/1806692811 >> 172.21.15.29:0/1806692811 conn(0x7fd5f40705d0 msgr2=0x7fd5f4069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.541+0000 7fd5fac00640 1 -- 172.21.15.29:0/1806692811 shutdown_connections 2024-01-24T13:03:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.541+0000 7fd5fac00640 1 -- 172.21.15.29:0/1806692811 wait complete. 2024-01-24T13:03:30.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5fac00640 1 Processor -- start 2024-01-24T13:03:30.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5fac00640 1 -- start start 2024-01-24T13:03:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5fac00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5d40047d0 0x7fd5f414c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5fac00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5f40c6490 0x7fd5f414d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5fac00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5f40c6910 0x7fd5f414d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5fac00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40c4880 con 0x7fd5f40c6910 2024-01-24T13:03:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5fac00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40c56e0 con 0x7fd5f40c6490 2024-01-24T13:03:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5fac00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f414df10 con 0x7fd5d40047d0 2024-01-24T13:03:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5f8c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5f40c6910 0x7fd5f414d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5f3e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5d40047d0 0x7fd5f414c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5f3e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5d40047d0 0x7fd5f414c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:38860/0 (socket says 172.21.15.29:38860) 2024-01-24T13:03:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5f3e00640 1 -- 172.21.15.29:0/2687461389 learned_addr learned my addr 172.21.15.29:0/2687461389 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5f3400640 1 --2- 172.21.15.29:0/2687461389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5f40c6490 0x7fd5f414d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:30.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5f8c00640 1 -- 172.21.15.29:0/2687461389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5d40047d0 msgr2=0x7fd5f414c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:30.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.545+0000 7fd5f8c00640 1 --2- 172.21.15.29:0/2687461389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5d40047d0 0x7fd5f414c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:30.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.549+0000 7fd5f8c00640 1 -- 172.21.15.29:0/2687461389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5f40c6490 msgr2=0x7fd5f414d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:30.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.549+0000 7fd5f8c00640 1 --2- 172.21.15.29:0/2687461389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5f40c6490 0x7fd5f414d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:30.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.549+0000 7fd5f8c00640 1 -- 172.21.15.29:0/2687461389 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f414cdc0 con 0x7fd5f40c6910 2024-01-24T13:03:30.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.549+0000 7fd5f3e00640 1 --2- 172.21.15.29:0/2687461389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5d40047d0 0x7fd5f414c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:30.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.549+0000 7fd5f8c00640 1 --2- 172.21.15.29:0/2687461389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5f40c6910 0x7fd5f414d5f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40b64e0 tx=0x7fd5ec010b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.549+0000 7fd5ebe00640 1 -- 172.21.15.29:0/2687461389 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec003b80 con 0x7fd5f40c6910 2024-01-24T13:03:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.549+0000 7fd5ebe00640 1 -- 172.21.15.29:0/2687461389 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec00d070 con 0x7fd5f40c6910 2024-01-24T13:03:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.549+0000 7fd5ebe00640 1 -- 172.21.15.29:0/2687461389 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec00e710 con 0x7fd5f40c6910 2024-01-24T13:03:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.549+0000 7fd5fac00640 1 -- 172.21.15.29:0/2687461389 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f40c4ad0 con 0x7fd5f40c6910 2024-01-24T13:03:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.549+0000 7fd5fac00640 1 -- 172.21.15.29:0/2687461389 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f40c5090 con 0x7fd5f40c6910 2024-01-24T13:03:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.549+0000 7fd5ebe00640 1 -- 172.21.15.29:0/2687461389 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd5ec00eb70 con 0x7fd5f40c6910 2024-01-24T13:03:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.549+0000 7fd5ebe00640 1 -- 172.21.15.29:0/2687461389 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd5ec01e460 con 0x7fd5f40c6910 2024-01-24T13:03:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.549+0000 7fd5fac00640 1 -- 172.21.15.29:0/2687461389 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f404e850 con 0x7fd5f40c6910 2024-01-24T13:03:30.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.553+0000 7fd5ebe00640 1 -- 172.21.15.29:0/2687461389 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fd5ec005070 con 0x7fd5f40c6910 2024-01-24T13:03:30.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.613+0000 7fd5fac00640 1 -- 172.21.15.29:0/2687461389 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd5f40b29c0 con 0x7fd5f40c6910 2024-01-24T13:03:30.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.617+0000 7fd5ebe00640 1 -- 172.21.15.29:0/2687461389 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd5ec005210 con 0x7fd5f40c6910 2024-01-24T13:03:30.618 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2024-01-24T13:03:30.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.617+0000 7fd5fac00640 1 -- 172.21.15.29:0/2687461389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5f40c6910 msgr2=0x7fd5f414d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:30.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.617+0000 7fd5fac00640 1 --2- 172.21.15.29:0/2687461389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5f40c6910 0x7fd5f414d5f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40b64e0 tx=0x7fd5ec010b50 comp rx=0 tx=0).stop 2024-01-24T13:03:30.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.617+0000 7fd5fac00640 1 -- 172.21.15.29:0/2687461389 shutdown_connections 2024-01-24T13:03:30.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.617+0000 7fd5fac00640 1 --2- 172.21.15.29:0/2687461389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5f40c6910 0x7fd5f414d5f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:30.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.617+0000 7fd5fac00640 1 --2- 172.21.15.29:0/2687461389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5f40c6490 0x7fd5f414d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:30.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.617+0000 7fd5fac00640 1 --2- 172.21.15.29:0/2687461389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5d40047d0 0x7fd5f414c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:30.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.617+0000 7fd5fac00640 1 -- 172.21.15.29:0/2687461389 >> 172.21.15.29:0/2687461389 conn(0x7fd5f40705d0 msgr2=0x7fd5f40b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:30.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.621+0000 7fd5fac00640 1 -- 172.21.15.29:0/2687461389 shutdown_connections 2024-01-24T13:03:30.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:30.621+0000 7fd5fac00640 1 -- 172.21.15.29:0/2687461389 wait complete. 2024-01-24T13:03:30.639 INFO:tasks.ceph:check_enable_crimson: False 2024-01-24T13:03:30.639 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-24T13:03:30.639 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:03:30.639 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-24T13:03:30.659 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:03:30.659 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-24T13:03:30.723 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:03:30.723 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-24T13:03:30.758 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:30.757+0000 7f37cd44b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-24T13:03:30.777 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:30.777+0000 7fe45a655180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-24T13:03:30.782 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:03:30.783 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-24T13:03:30.843 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:03:30.844 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-24T13:03:30.864 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:03:30.864 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-24T13:03:30.929 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:03:30.929 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-24T13:03:30.992 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:03:30.993 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-24T13:03:31.056 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 7d693f07-513d-4097-bb94-24b39fe37a5d 0 2024-01-24T13:03:31.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8fa00640 1 Processor -- start 2024-01-24T13:03:31.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8fa00640 1 -- start start 2024-01-24T13:03:31.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8fa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3c8815a710 0x7f3c8815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8fa00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3c880ca9f0 0x7f3c880cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8fa00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8815e420 con 0x7f3c880cd3f0 2024-01-24T13:03:31.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8fa00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c880cb360 con 0x7f3c8815a710 2024-01-24T13:03:31.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8fa00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8815e0f0 con 0x7f3c880ca9f0 2024-01-24T13:03:31.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8da00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3c880ca9f0 0x7f3c880cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8da00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3c880ca9f0 0x7f3c880cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:53982/0 (socket says 172.21.15.163:53982) 2024-01-24T13:03:31.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8da00640 1 -- 172.21.15.163:0/1466096166 learned_addr learned my addr 172.21.15.163:0/1466096166 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:31.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8d000640 1 --2- 172.21.15.163:0/1466096166 >> v2:172.21.15.29:3300/0 conn(0x7f3c8815a710 0x7f3c8815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8da00640 1 -- 172.21.15.163:0/1466096166 >> v2:172.21.15.29:3300/0 conn(0x7f3c8815a710 msgr2=0x7f3c8815ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:31.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8da00640 1 --2- 172.21.15.163:0/1466096166 >> v2:172.21.15.29:3300/0 conn(0x7f3c8815a710 0x7f3c8815ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8da00640 1 -- 172.21.15.163:0/1466096166 >> v1:172.21.15.29:6789/0 conn(0x7f3c880cd3f0 legacy=0x7f3c8815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.229+0000 7f3c8da00640 1 -- 172.21.15.163:0/1466096166 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8815b3c0 con 0x7f3c880ca9f0 2024-01-24T13:03:31.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.233+0000 7f3c8da00640 1 --2- 172.21.15.163:0/1466096166 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c880ca9f0 0x7f3c880cae20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3c880cdd40 tx=0x7f3c8001c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26ac1f96c1ebcff8 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:31.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.233+0000 7f3c87400640 1 -- 172.21.15.163:0/1466096166 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800a56e0 con 0x7f3c880ca9f0 2024-01-24T13:03:31.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.233+0000 7f3c87400640 1 -- 172.21.15.163:0/1466096166 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c800a5840 con 0x7f3c880ca9f0 2024-01-24T13:03:31.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.233+0000 7f3c87400640 1 -- 172.21.15.163:0/1466096166 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800a5bd0 con 0x7f3c880ca9f0 2024-01-24T13:03:31.236 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.233+0000 7f3c8fa00640 1 -- 172.21.15.163:0/1466096166 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c880ca9f0 msgr2=0x7f3c880cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.236 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.233+0000 7f3c8fa00640 1 --2- 172.21.15.163:0/1466096166 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c880ca9f0 0x7f3c880cae20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3c880cdd40 tx=0x7f3c8001c910 comp rx=0 tx=0).stop 2024-01-24T13:03:31.236 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.233+0000 7f3c8fa00640 1 -- 172.21.15.163:0/1466096166 shutdown_connections 2024-01-24T13:03:31.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.233+0000 7f3c8fa00640 1 --2- 172.21.15.163:0/1466096166 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c880ca9f0 0x7f3c880cae20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.233+0000 7f3c8fa00640 1 --2- 172.21.15.163:0/1466096166 >> v2:172.21.15.29:3300/0 conn(0x7f3c8815a710 0x7f3c8815ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.233+0000 7f3c8fa00640 1 -- 172.21.15.163:0/1466096166 >> 172.21.15.163:0/1466096166 conn(0x7f3c880705d0 msgr2=0x7f3c88069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:31.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8fa00640 1 -- 172.21.15.163:0/1466096166 shutdown_connections 2024-01-24T13:03:31.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8fa00640 1 -- 172.21.15.163:0/1466096166 wait complete. 2024-01-24T13:03:31.238 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8fa00640 1 Processor -- start 2024-01-24T13:03:31.238 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8fa00640 1 -- start start 2024-01-24T13:03:31.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8fa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c880ca9f0 0x7f3c88146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8fa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c880cd3f0 0x7f3c88163550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8fa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c881474a0 0x7f3c8806bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8fa00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8806b2f0 con 0x7f3c880ca9f0 2024-01-24T13:03:31.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8fa00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88150b00 con 0x7f3c880cd3f0 2024-01-24T13:03:31.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8fa00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8806b4d0 con 0x7f3c881474a0 2024-01-24T13:03:31.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8da00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c881474a0 0x7f3c8806bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c87e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c880cd3f0 0x7f3c88163550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c87e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c880cd3f0 0x7f3c88163550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:53994/0 (socket says 172.21.15.163:53994) 2024-01-24T13:03:31.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8d000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c880ca9f0 0x7f3c88146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c87e00640 1 -- 172.21.15.163:0/2889870875 learned_addr learned my addr 172.21.15.163:0/2889870875 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:31.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8da00640 1 -- 172.21.15.163:0/2889870875 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c880cd3f0 msgr2=0x7f3c88163550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8da00640 1 --2- 172.21.15.163:0/2889870875 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c880cd3f0 0x7f3c88163550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8da00640 1 -- 172.21.15.163:0/2889870875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c880ca9f0 msgr2=0x7f3c88146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8da00640 1 --2- 172.21.15.163:0/2889870875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c880ca9f0 0x7f3c88146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8da00640 1 -- 172.21.15.163:0/2889870875 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c80009b30 con 0x7f3c881474a0 2024-01-24T13:03:31.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.237+0000 7f3c8d000640 1 --2- 172.21.15.163:0/2889870875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c880ca9f0 0x7f3c88146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:31.242 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.241+0000 7f3c8da00640 1 --2- 172.21.15.163:0/2889870875 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c881474a0 0x7f3c8806bbe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3c8815e230 tx=0x7f3c800196b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:31.242 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.241+0000 7f3c84c00640 1 -- 172.21.15.163:0/2889870875 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800bd070 con 0x7f3c881474a0 2024-01-24T13:03:31.242 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.241+0000 7f3c84c00640 1 -- 172.21.15.163:0/2889870875 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c80009510 con 0x7f3c881474a0 2024-01-24T13:03:31.243 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.241+0000 7f3c8fa00640 1 -- 172.21.15.163:0/2889870875 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8806b7b0 con 0x7f3c881474a0 2024-01-24T13:03:31.243 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.241+0000 7f3c84c00640 1 -- 172.21.15.163:0/2889870875 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800b86b0 con 0x7f3c881474a0 2024-01-24T13:03:31.243 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.241+0000 7f3c8fa00640 1 -- 172.21.15.163:0/2889870875 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8806ccd0 con 0x7f3c881474a0 2024-01-24T13:03:31.243 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.241+0000 7f3c84c00640 1 -- 172.21.15.163:0/2889870875 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3c800b8b10 con 0x7f3c881474a0 2024-01-24T13:03:31.243 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.241+0000 7f3c84c00640 1 -- 172.21.15.163:0/2889870875 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3c800c2a90 con 0x7f3c881474a0 2024-01-24T13:03:31.243 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.241+0000 7f3c8fa00640 1 -- 172.21.15.163:0/2889870875 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8804e850 con 0x7f3c881474a0 2024-01-24T13:03:31.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.253+0000 7f3c84c00640 1 -- 172.21.15.163:0/2889870875 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f3c800c2410 con 0x7f3c881474a0 2024-01-24T13:03:31.275 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:31.273+0000 7f37cd44b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-24T13:03:31.313 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:31.313+0000 7fe45a655180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-24T13:03:31.320 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.317+0000 7f3c8fa00640 1 -- 172.21.15.163:0/2889870875 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7d693f07-513d-4097-bb94-24b39fe37a5d", "id": 0} v 0) v1 -- 0x7f3c880b2980 con 0x7f3c881474a0 2024-01-24T13:03:31.325 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.325+0000 7f3c84c00640 1 -- 172.21.15.163:0/2889870875 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7d693f07-513d-4097-bb94-24b39fe37a5d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3c800c25b0 con 0x7f3c881474a0 2024-01-24T13:03:31.325 INFO:teuthology.orchestra.run.smithi163.stdout:0 2024-01-24T13:03:31.326 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.325+0000 7f3c8fa00640 1 -- 172.21.15.163:0/2889870875 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c881474a0 msgr2=0x7f3c8806bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.326 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.325+0000 7f3c8fa00640 1 --2- 172.21.15.163:0/2889870875 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c881474a0 0x7f3c8806bbe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3c8815e230 tx=0x7f3c800196b0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.326 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.325+0000 7f3c8fa00640 1 -- 172.21.15.163:0/2889870875 shutdown_connections 2024-01-24T13:03:31.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.325+0000 7f3c8fa00640 1 --2- 172.21.15.163:0/2889870875 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c881474a0 0x7f3c8806bbe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.325+0000 7f3c8fa00640 1 --2- 172.21.15.163:0/2889870875 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c880cd3f0 0x7f3c88163550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.325+0000 7f3c8fa00640 1 --2- 172.21.15.163:0/2889870875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c880ca9f0 0x7f3c88146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.325+0000 7f3c8fa00640 1 -- 172.21.15.163:0/2889870875 >> 172.21.15.163:0/2889870875 conn(0x7f3c880705d0 msgr2=0x7f3c8806e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:31.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.325+0000 7f3c8fa00640 1 -- 172.21.15.163:0/2889870875 shutdown_connections 2024-01-24T13:03:31.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.325+0000 7f3c8fa00640 1 -- 172.21.15.163:0/2889870875 wait complete. 2024-01-24T13:03:31.345 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 98c792e9-7d74-4d6f-889e-5859b024ca09 1 2024-01-24T13:03:31.480 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.477+0000 7f74a2c00640 1 Processor -- start 2024-01-24T13:03:31.480 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.477+0000 7f74a2c00640 1 -- start start 2024-01-24T13:03:31.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f74a2c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f749c15a710 0x7f749c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f74a2c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f749c0cd3f0 0x7f749c15e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f74a2c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f749c15edf0 0x7f749c0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f74a2c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749c15e420 con 0x7f749c15edf0 2024-01-24T13:03:31.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f74a2c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749c15e0f0 con 0x7f749c0cd3f0 2024-01-24T13:03:31.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f74a2c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c15b3c0 con 0x7f749c15a710 2024-01-24T13:03:31.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f749b400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f749c0cd3f0 0x7f749c15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f749be00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f749c15a710 0x7f749c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f749be00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f749c15a710 0x7f749c15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:38152/0 (socket says 172.21.15.163:38152) 2024-01-24T13:03:31.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f749b400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f749c0cd3f0 0x7f749c15e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54006/0 (socket says 172.21.15.163:54006) 2024-01-24T13:03:31.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f749be00640 1 -- 172.21.15.163:0/369542955 learned_addr learned my addr 172.21.15.163:0/369542955 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:31.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f74a0c00640 1 --2- 172.21.15.163:0/369542955 >> v2:172.21.15.29:3300/0 conn(0x7f749c15edf0 0x7f749c0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f749be00640 1 -- 172.21.15.163:0/369542955 >> v2:172.21.15.163:3300/0 conn(0x7f749c0cd3f0 msgr2=0x7f749c15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:31.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f749be00640 1 --2- 172.21.15.163:0/369542955 >> v2:172.21.15.163:3300/0 conn(0x7f749c0cd3f0 0x7f749c15e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f749be00640 1 -- 172.21.15.163:0/369542955 >> v2:172.21.15.29:3300/0 conn(0x7f749c15edf0 msgr2=0x7f749c0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:31.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f749be00640 1 --2- 172.21.15.163:0/369542955 >> v2:172.21.15.29:3300/0 conn(0x7f749c15edf0 0x7f749c0ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.481+0000 7f749be00640 1 -- 172.21.15.163:0/369542955 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c15b6a0 con 0x7f749c15a710 2024-01-24T13:03:31.484 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f749be00640 1 --2- 172.21.15.163:0/369542955 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f749c15a710 0x7f749c15ab00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f749c06ab20 tx=0x7f748c01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2d4997fdc045829 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:31.485 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f749aa00640 1 -- 172.21.15.163:0/369542955 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c0ac640 con 0x7f749c15a710 2024-01-24T13:03:31.485 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f749aa00640 1 -- 172.21.15.163:0/369542955 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c0ac7a0 con 0x7f749c15a710 2024-01-24T13:03:31.485 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f749aa00640 1 -- 172.21.15.163:0/369542955 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c0acb30 con 0x7f749c15a710 2024-01-24T13:03:31.485 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f74a2c00640 1 -- 172.21.15.163:0/369542955 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f749c15a710 msgr2=0x7f749c15ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.486 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f74a2c00640 1 --2- 172.21.15.163:0/369542955 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f749c15a710 0x7f749c15ab00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f749c06ab20 tx=0x7f748c01c440 comp rx=0 tx=0).stop 2024-01-24T13:03:31.486 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f74a2c00640 1 -- 172.21.15.163:0/369542955 shutdown_connections 2024-01-24T13:03:31.486 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f74a2c00640 1 --2- 172.21.15.163:0/369542955 >> v2:172.21.15.29:3300/0 conn(0x7f749c15edf0 0x7f749c0ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.486 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f74a2c00640 1 --2- 172.21.15.163:0/369542955 >> v2:172.21.15.163:3300/0 conn(0x7f749c0cd3f0 0x7f749c15e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.486 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f74a2c00640 1 --2- 172.21.15.163:0/369542955 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f749c15a710 0x7f749c15ab00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.487 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f74a2c00640 1 -- 172.21.15.163:0/369542955 >> 172.21.15.163:0/369542955 conn(0x7f749c0705d0 msgr2=0x7f749c069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:31.487 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f74a2c00640 1 -- 172.21.15.163:0/369542955 shutdown_connections 2024-01-24T13:03:31.487 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f74a2c00640 1 -- 172.21.15.163:0/369542955 wait complete. 2024-01-24T13:03:31.488 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f74a2c00640 1 Processor -- start 2024-01-24T13:03:31.488 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.485+0000 7f74a2c00640 1 -- start start 2024-01-24T13:03:31.489 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f74a2c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f749c0cd3f0 0x7f749c0c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.489 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f74a2c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f749c15edf0 0x7f749c14fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.489 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f74a2c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f749c1500e0 0x7f749c0ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.489 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f74a2c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c150c70 con 0x7f749c15edf0 2024-01-24T13:03:31.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f74a2c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c0c4410 con 0x7f749c1500e0 2024-01-24T13:03:31.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f74a2c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c0c4640 con 0x7f749c0cd3f0 2024-01-24T13:03:31.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f749be00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f749c0cd3f0 0x7f749c0c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f74a0c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f749c1500e0 0x7f749c0ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f749be00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f749c0cd3f0 0x7f749c0c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:38162/0 (socket says 172.21.15.163:38162) 2024-01-24T13:03:31.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f749be00640 1 -- 172.21.15.163:0/2290224785 learned_addr learned my addr 172.21.15.163:0/2290224785 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:31.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f749b400640 1 --2- 172.21.15.163:0/2290224785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f749c15edf0 0x7f749c14fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f749be00640 1 -- 172.21.15.163:0/2290224785 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f749c1500e0 msgr2=0x7f749c0ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f749be00640 1 --2- 172.21.15.163:0/2290224785 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f749c1500e0 0x7f749c0ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f749be00640 1 -- 172.21.15.163:0/2290224785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f749c15edf0 msgr2=0x7f749c14fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f749be00640 1 --2- 172.21.15.163:0/2290224785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f749c15edf0 0x7f749c14fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f749be00640 1 -- 172.21.15.163:0/2290224785 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0094d0 con 0x7f749c0cd3f0 2024-01-24T13:03:31.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f74a0c00640 1 --2- 172.21.15.163:0/2290224785 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f749c1500e0 0x7f749c0ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:31.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f749be00640 1 --2- 172.21.15.163:0/2290224785 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f749c0cd3f0 0x7f749c0c3ed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f748c0af040 tx=0x7f748c01ac80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:31.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f7493e00640 1 -- 172.21.15.163:0/2290224785 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c0b7620 con 0x7f749c0cd3f0 2024-01-24T13:03:31.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f7493e00640 1 -- 172.21.15.163:0/2290224785 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c0b77a0 con 0x7f749c0cd3f0 2024-01-24T13:03:31.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f7493e00640 1 -- 172.21.15.163:0/2290224785 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c0b7b50 con 0x7f749c0cd3f0 2024-01-24T13:03:31.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f74a2c00640 1 -- 172.21.15.163:0/2290224785 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749c0c4920 con 0x7f749c0cd3f0 2024-01-24T13:03:31.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f74a2c00640 1 -- 172.21.15.163:0/2290224785 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749c150890 con 0x7f749c0cd3f0 2024-01-24T13:03:31.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f7493e00640 1 -- 172.21.15.163:0/2290224785 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f748c0b3040 con 0x7f749c0cd3f0 2024-01-24T13:03:31.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f7493e00640 1 -- 172.21.15.163:0/2290224785 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f748c0b57a0 con 0x7f749c0cd3f0 2024-01-24T13:03:31.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.489+0000 7f74a2c00640 1 -- 172.21.15.163:0/2290224785 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749c0cdd90 con 0x7f749c0cd3f0 2024-01-24T13:03:31.494 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.493+0000 7f7493e00640 1 -- 172.21.15.163:0/2290224785 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f748c0dfb50 con 0x7f749c0cd3f0 2024-01-24T13:03:31.504 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:31.501+0000 7f37cd44b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-24T13:03:31.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.561+0000 7f74a2c00640 1 -- 172.21.15.163:0/2290224785 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "98c792e9-7d74-4d6f-889e-5859b024ca09", "id": 1} v 0) v1 -- 0x7f749c150db0 con 0x7f749c0cd3f0 2024-01-24T13:03:31.569 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.569+0000 7f7493e00640 1 -- 172.21.15.163:0/2290224785 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "98c792e9-7d74-4d6f-889e-5859b024ca09", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f749c150db0 con 0x7f749c0cd3f0 2024-01-24T13:03:31.569 INFO:teuthology.orchestra.run.smithi163.stdout:1 2024-01-24T13:03:31.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.569+0000 7f74a2c00640 1 -- 172.21.15.163:0/2290224785 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f749c0cd3f0 msgr2=0x7f749c0c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.569+0000 7f74a2c00640 1 --2- 172.21.15.163:0/2290224785 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f749c0cd3f0 0x7f749c0c3ed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f748c0af040 tx=0x7f748c01ac80 comp rx=0 tx=0).stop 2024-01-24T13:03:31.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.569+0000 7f74a2c00640 1 -- 172.21.15.163:0/2290224785 shutdown_connections 2024-01-24T13:03:31.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.569+0000 7f74a2c00640 1 --2- 172.21.15.163:0/2290224785 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f749c1500e0 0x7f749c0ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.569+0000 7f74a2c00640 1 --2- 172.21.15.163:0/2290224785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f749c15edf0 0x7f749c14fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.569+0000 7f74a2c00640 1 --2- 172.21.15.163:0/2290224785 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f749c0cd3f0 0x7f749c0c3ed0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.569+0000 7f74a2c00640 1 -- 172.21.15.163:0/2290224785 >> 172.21.15.163:0/2290224785 conn(0x7f749c0705d0 msgr2=0x7f749c15c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:31.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.569+0000 7f74a2c00640 1 -- 172.21.15.163:0/2290224785 shutdown_connections 2024-01-24T13:03:31.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.569+0000 7f74a2c00640 1 -- 172.21.15.163:0/2290224785 wait complete. 2024-01-24T13:03:31.584 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:31.585+0000 7fe45a655180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-24T13:03:31.589 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 7bee7edd-48e1-4dc2-ac4b-8abc08e4166c 2 2024-01-24T13:03:31.723 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.721+0000 7f0816600640 1 Processor -- start 2024-01-24T13:03:31.724 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.721+0000 7f0816600640 1 -- start start 2024-01-24T13:03:31.725 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.725+0000 7f0816600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f08100ce950 0x7f08100ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.725 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.725+0000 7f0816600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08100cd2f0 0x7f081015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.725 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.725+0000 7f0816600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08100d0b80 con 0x7f081015d5e0 2024-01-24T13:03:31.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.725+0000 7f0816600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100cd7a0 con 0x7f08100ce950 2024-01-24T13:03:31.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.725+0000 7f0816600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08100d0040 con 0x7f08100cd2f0 2024-01-24T13:03:31.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.725+0000 7f080ea00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08100cd2f0 0x7f081015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.725+0000 7f080fe00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f081015d5e0 0x7f0810152f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:54276/0 (socket says 172.21.15.163:54276) 2024-01-24T13:03:31.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.725+0000 7f080fe00640 1 -- 172.21.15.163:0/796657694 learned_addr learned my addr 172.21.15.163:0/796657694 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-01-24T13:03:31.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.725+0000 7f080f400640 1 --2- 172.21.15.163:0/796657694 >> v2:172.21.15.29:3300/0 conn(0x7f08100ce950 0x7f08100ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.725+0000 7f080ea00640 1 -- 172.21.15.163:0/796657694 >> v2:172.21.15.29:3300/0 conn(0x7f08100ce950 msgr2=0x7f08100ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:31.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.725+0000 7f080ea00640 1 --2- 172.21.15.163:0/796657694 >> v2:172.21.15.29:3300/0 conn(0x7f08100ce950 0x7f08100ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.725+0000 7f080ea00640 1 -- 172.21.15.163:0/796657694 >> v1:172.21.15.163:6789/0 conn(0x7f081015d5e0 legacy=0x7f0810152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.725+0000 7f080ea00640 1 -- 172.21.15.163:0/796657694 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081006bdf0 con 0x7f08100cd2f0 2024-01-24T13:03:31.728 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.725+0000 7f080ea00640 1 --2- 172.21.15.163:0/796657694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08100cd2f0 0x7f081015d0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f07f80097c0 tx=0x7f07f801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37453dd768a9e2c9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:31.729 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.729+0000 7f080e000640 1 -- 172.21.15.163:0/796657694 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f80ab600 con 0x7f08100cd2f0 2024-01-24T13:03:31.729 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.729+0000 7f080e000640 1 -- 172.21.15.163:0/796657694 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f80a7050 con 0x7f08100cd2f0 2024-01-24T13:03:31.729 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.729+0000 7f080e000640 1 -- 172.21.15.163:0/796657694 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f80ab980 con 0x7f08100cd2f0 2024-01-24T13:03:31.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.729+0000 7f0816600640 1 -- 172.21.15.163:0/796657694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08100cd2f0 msgr2=0x7f081015d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.729+0000 7f0816600640 1 --2- 172.21.15.163:0/796657694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08100cd2f0 0x7f081015d0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f07f80097c0 tx=0x7f07f801c3f0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.729+0000 7f0816600640 1 -- 172.21.15.163:0/796657694 shutdown_connections 2024-01-24T13:03:31.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.729+0000 7f0816600640 1 --2- 172.21.15.163:0/796657694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08100cd2f0 0x7f081015d0a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.729+0000 7f0816600640 1 --2- 172.21.15.163:0/796657694 >> v2:172.21.15.29:3300/0 conn(0x7f08100ce950 0x7f08100ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.729+0000 7f0816600640 1 -- 172.21.15.163:0/796657694 >> 172.21.15.163:0/796657694 conn(0x7f08100705d0 msgr2=0x7f0810069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:31.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.729+0000 7f0816600640 1 -- 172.21.15.163:0/796657694 shutdown_connections 2024-01-24T13:03:31.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.729+0000 7f0816600640 1 -- 172.21.15.163:0/796657694 wait complete. 2024-01-24T13:03:31.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.729+0000 7f0816600640 1 Processor -- start 2024-01-24T13:03:31.732 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.729+0000 7f0816600640 1 -- start start 2024-01-24T13:03:31.734 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f0816600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08100cd2f0 0x7f0810148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.734 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f0816600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08100ce950 0x7f081015f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.734 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f0816600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f081015d5e0 0x7f081014a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.734 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f0816600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081015f8a0 con 0x7f08100cd2f0 2024-01-24T13:03:31.734 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f0816600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081014aed0 con 0x7f081015d5e0 2024-01-24T13:03:31.735 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f0816600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081015e2c0 con 0x7f08100ce950 2024-01-24T13:03:31.735 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f080fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f081015d5e0 0x7f081014a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.735 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f080ea00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08100ce950 0x7f081015f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.735 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f080f400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08100cd2f0 0x7f0810148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.735 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f080fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f081015d5e0 0x7f081014a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54024/0 (socket says 172.21.15.163:54024) 2024-01-24T13:03:31.735 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f080fe00640 1 -- 172.21.15.163:0/2191271390 learned_addr learned my addr 172.21.15.163:0/2191271390 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:31.735 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f080fe00640 1 -- 172.21.15.163:0/2191271390 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08100ce950 msgr2=0x7f081015f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.735 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f080fe00640 1 --2- 172.21.15.163:0/2191271390 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08100ce950 0x7f081015f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.735 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f080fe00640 1 -- 172.21.15.163:0/2191271390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08100cd2f0 msgr2=0x7f0810148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.735 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f080fe00640 1 --2- 172.21.15.163:0/2191271390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08100cd2f0 0x7f0810148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.735 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f080fe00640 1 -- 172.21.15.163:0/2191271390 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f8009420 con 0x7f081015d5e0 2024-01-24T13:03:31.735 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f080f400640 1 --2- 172.21.15.163:0/2191271390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08100cd2f0 0x7f0810148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:31.736 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f080fe00640 1 --2- 172.21.15.163:0/2191271390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f081015d5e0 0x7f081014a990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f080800ca80 tx=0x7f080800cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:31.736 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f0807400640 1 -- 172.21.15.163:0/2191271390 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080800ac30 con 0x7f081015d5e0 2024-01-24T13:03:31.736 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f0807400640 1 -- 172.21.15.163:0/2191271390 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080800ad90 con 0x7f081015d5e0 2024-01-24T13:03:31.736 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f0807400640 1 -- 172.21.15.163:0/2191271390 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808012600 con 0x7f081015d5e0 2024-01-24T13:03:31.736 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f0816600640 1 -- 172.21.15.163:0/2191271390 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081015e5a0 con 0x7f081015d5e0 2024-01-24T13:03:31.736 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f0816600640 1 -- 172.21.15.163:0/2191271390 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081015eb60 con 0x7f081015d5e0 2024-01-24T13:03:31.736 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f0807400640 1 -- 172.21.15.163:0/2191271390 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0808012a60 con 0x7f081015d5e0 2024-01-24T13:03:31.736 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f0807400640 1 -- 172.21.15.163:0/2191271390 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0808012d10 con 0x7f081015d5e0 2024-01-24T13:03:31.736 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.733+0000 7f0816600640 1 -- 172.21.15.163:0/2191271390 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081004e850 con 0x7f081015d5e0 2024-01-24T13:03:31.738 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.737+0000 7f0807400640 1 -- 172.21.15.163:0/2191271390 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f0808021060 con 0x7f081015d5e0 2024-01-24T13:03:31.805 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.805+0000 7f0816600640 1 -- 172.21.15.163:0/2191271390 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7bee7edd-48e1-4dc2-ac4b-8abc08e4166c", "id": 2} v 0) v1 -- 0x7f08100b29c0 con 0x7f081015d5e0 2024-01-24T13:03:31.810 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.809+0000 7f0807400640 1 -- 172.21.15.163:0/2191271390 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7bee7edd-48e1-4dc2-ac4b-8abc08e4166c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0808017070 con 0x7f081015d5e0 2024-01-24T13:03:31.810 INFO:teuthology.orchestra.run.smithi163.stdout:2 2024-01-24T13:03:31.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.809+0000 7f0816600640 1 -- 172.21.15.163:0/2191271390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f081015d5e0 msgr2=0x7f081014a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.809+0000 7f0816600640 1 --2- 172.21.15.163:0/2191271390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f081015d5e0 0x7f081014a990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f080800ca80 tx=0x7f080800cf40 comp rx=0 tx=0).stop 2024-01-24T13:03:31.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.809+0000 7f0816600640 1 -- 172.21.15.163:0/2191271390 shutdown_connections 2024-01-24T13:03:31.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.809+0000 7f0816600640 1 --2- 172.21.15.163:0/2191271390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f081015d5e0 0x7f081014a990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.809+0000 7f0816600640 1 --2- 172.21.15.163:0/2191271390 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08100ce950 0x7f081015f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.809+0000 7f0816600640 1 --2- 172.21.15.163:0/2191271390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08100cd2f0 0x7f0810148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.809+0000 7f0816600640 1 -- 172.21.15.163:0/2191271390 >> 172.21.15.163:0/2191271390 conn(0x7f08100705d0 msgr2=0x7f08100b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:31.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.809+0000 7f0816600640 1 -- 172.21.15.163:0/2191271390 shutdown_connections 2024-01-24T13:03:31.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.809+0000 7f0816600640 1 -- 172.21.15.163:0/2191271390 wait complete. 2024-01-24T13:03:31.830 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new c2bef51a-c7c8-454c-8de7-1a61f17bef59 3 2024-01-24T13:03:31.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.961+0000 7f9874200640 1 Processor -- start 2024-01-24T13:03:31.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.961+0000 7f9874200640 1 -- start start 2024-01-24T13:03:31.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9874200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f986c15a710 0x7f986c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9874200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c0ca9f0 0x7f986c0cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9874200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c15e420 con 0x7f986c0cd3f0 2024-01-24T13:03:31.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9874200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c0cb3a0 con 0x7f986c15a710 2024-01-24T13:03:31.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9874200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c15e0f0 con 0x7f986c0ca9f0 2024-01-24T13:03:31.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9871800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f986c15a710 0x7f986c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9872200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c0ca9f0 0x7f986c0cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9871800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f986c15a710 0x7f986c15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54030/0 (socket says 172.21.15.163:54030) 2024-01-24T13:03:31.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9870e00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f986c0cd3f0 0x7f986c15e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:54290/0 (socket says 172.21.15.163:54290) 2024-01-24T13:03:31.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9871800640 1 -- 172.21.15.163:0/1741865660 learned_addr learned my addr 172.21.15.163:0/1741865660 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:31.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9872200640 1 -- 172.21.15.163:0/1741865660 >> v2:172.21.15.163:3300/0 conn(0x7f986c15a710 msgr2=0x7f986c15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:31.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9872200640 1 --2- 172.21.15.163:0/1741865660 >> v2:172.21.15.163:3300/0 conn(0x7f986c15a710 0x7f986c15ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9872200640 1 -- 172.21.15.163:0/1741865660 >> v1:172.21.15.163:6789/0 conn(0x7f986c0cd3f0 legacy=0x7f986c15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f986be00640 1 -- 172.21.15.163:0/1741865660 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031771396 0 0) 0x7f986c15e420 con 0x7f986c0cd3f0 2024-01-24T13:03:31.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9872200640 1 -- 172.21.15.163:0/1741865660 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c15b3c0 con 0x7f986c0ca9f0 2024-01-24T13:03:31.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.965+0000 7f9871800640 1 --2- 172.21.15.163:0/1741865660 >> v2:172.21.15.163:3300/0 conn(0x7f986c15a710 0x7f986c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:31.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.969+0000 7f9872200640 1 --2- 172.21.15.163:0/1741865660 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c0ca9f0 0x7f986c0cae60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9864009d90 tx=0x7f986401c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a6be955bb998626 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:31.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.969+0000 7f986be00640 1 -- 172.21.15.163:0/1741865660 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640a5950 con 0x7f986c0ca9f0 2024-01-24T13:03:31.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.969+0000 7f986be00640 1 -- 172.21.15.163:0/1741865660 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98640a5ab0 con 0x7f986c0ca9f0 2024-01-24T13:03:31.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.969+0000 7f986be00640 1 -- 172.21.15.163:0/1741865660 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640a5e40 con 0x7f986c0ca9f0 2024-01-24T13:03:31.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.969+0000 7f9874200640 1 -- 172.21.15.163:0/1741865660 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c0ca9f0 msgr2=0x7f986c0cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.969+0000 7f9874200640 1 --2- 172.21.15.163:0/1741865660 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c0ca9f0 0x7f986c0cae60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9864009d90 tx=0x7f986401c890 comp rx=0 tx=0).stop 2024-01-24T13:03:31.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.969+0000 7f9874200640 1 -- 172.21.15.163:0/1741865660 shutdown_connections 2024-01-24T13:03:31.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.969+0000 7f9874200640 1 --2- 172.21.15.163:0/1741865660 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c0ca9f0 0x7f986c0cae60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.969+0000 7f9874200640 1 --2- 172.21.15.163:0/1741865660 >> v2:172.21.15.163:3300/0 conn(0x7f986c15a710 0x7f986c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.969+0000 7f9874200640 1 -- 172.21.15.163:0/1741865660 >> 172.21.15.163:0/1741865660 conn(0x7f986c0705d0 msgr2=0x7f986c069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:31.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.969+0000 7f9874200640 1 -- 172.21.15.163:0/1741865660 shutdown_connections 2024-01-24T13:03:31.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.969+0000 7f9874200640 1 -- 172.21.15.163:0/1741865660 wait complete. 2024-01-24T13:03:31.974 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9874200640 1 Processor -- start 2024-01-24T13:03:31.974 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9874200640 1 -- start start 2024-01-24T13:03:31.976 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9874200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c0ca9f0 0x7f986c159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.976 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9874200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c0cd3f0 0x7f986c147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.976 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9874200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f986c0cf3d0 0x7f986c163f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:31.976 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9874200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c157740 con 0x7f986c0cf3d0 2024-01-24T13:03:31.976 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9874200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c157a20 con 0x7f986c0cd3f0 2024-01-24T13:03:31.976 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9874200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c1558b0 con 0x7f986c0ca9f0 2024-01-24T13:03:31.976 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9871800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c0ca9f0 0x7f986c159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.977 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9870e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c0cd3f0 0x7f986c147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.977 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9871800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c0ca9f0 0x7f986c159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:38208/0 (socket says 172.21.15.163:38208) 2024-01-24T13:03:31.977 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9871800640 1 -- 172.21.15.163:0/1478995579 learned_addr learned my addr 172.21.15.163:0/1478995579 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:31.977 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9872200640 1 --2- 172.21.15.163:0/1478995579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f986c0cf3d0 0x7f986c163f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:31.977 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9871800640 1 -- 172.21.15.163:0/1478995579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c0cd3f0 msgr2=0x7f986c147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.977 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9871800640 1 --2- 172.21.15.163:0/1478995579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c0cd3f0 0x7f986c147780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.977 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9871800640 1 -- 172.21.15.163:0/1478995579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f986c0cf3d0 msgr2=0x7f986c163f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:31.977 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9871800640 1 --2- 172.21.15.163:0/1478995579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f986c0cf3d0 0x7f986c163f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:31.977 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9871800640 1 -- 172.21.15.163:0/1478995579 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c0094d0 con 0x7f986c0ca9f0 2024-01-24T13:03:31.978 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.973+0000 7f9871800640 1 --2- 172.21.15.163:0/1478995579 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c0ca9f0 0x7f986c159920 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f985c00e9d0 tx=0x7f985c00ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:31.978 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.977+0000 7f9869600640 1 -- 172.21.15.163:0/1478995579 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c00ca60 con 0x7f986c0ca9f0 2024-01-24T13:03:31.978 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.977+0000 7f9869600640 1 -- 172.21.15.163:0/1478995579 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c00cbc0 con 0x7f986c0ca9f0 2024-01-24T13:03:31.978 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.977+0000 7f9869600640 1 -- 172.21.15.163:0/1478995579 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c013470 con 0x7f986c0ca9f0 2024-01-24T13:03:31.978 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.977+0000 7f9874200640 1 -- 172.21.15.163:0/1478995579 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9864009a70 con 0x7f986c0ca9f0 2024-01-24T13:03:31.979 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.977+0000 7f9874200640 1 -- 172.21.15.163:0/1478995579 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c157d00 con 0x7f986c0ca9f0 2024-01-24T13:03:31.979 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.977+0000 7f9869600640 1 -- 172.21.15.163:0/1478995579 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f985c005ca0 con 0x7f986c0ca9f0 2024-01-24T13:03:31.979 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.977+0000 7f9869600640 1 -- 172.21.15.163:0/1478995579 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f985c0064b0 con 0x7f986c0ca9f0 2024-01-24T13:03:31.979 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.977+0000 7f9874200640 1 -- 172.21.15.163:0/1478995579 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986c04e850 con 0x7f986c0ca9f0 2024-01-24T13:03:31.982 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:31.981+0000 7f9869600640 1 -- 172.21.15.163:0/1478995579 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f985c021060 con 0x7f986c0ca9f0 2024-01-24T13:03:32.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.045+0000 7f9874200640 1 -- 172.21.15.163:0/1478995579 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c2bef51a-c7c8-454c-8de7-1a61f17bef59", "id": 3} v 0) v1 -- 0x7f986c0b2980 con 0x7f986c0ca9f0 2024-01-24T13:03:32.052 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.049+0000 7f9869600640 1 -- 172.21.15.163:0/1478995579 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c2bef51a-c7c8-454c-8de7-1a61f17bef59", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f985c029020 con 0x7f986c0ca9f0 2024-01-24T13:03:32.052 INFO:teuthology.orchestra.run.smithi163.stdout:3 2024-01-24T13:03:32.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.053+0000 7f9874200640 1 -- 172.21.15.163:0/1478995579 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c0ca9f0 msgr2=0x7f986c159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.053+0000 7f9874200640 1 --2- 172.21.15.163:0/1478995579 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c0ca9f0 0x7f986c159920 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f985c00e9d0 tx=0x7f985c00ee90 comp rx=0 tx=0).stop 2024-01-24T13:03:32.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.053+0000 7f9874200640 1 -- 172.21.15.163:0/1478995579 shutdown_connections 2024-01-24T13:03:32.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.053+0000 7f9874200640 1 --2- 172.21.15.163:0/1478995579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f986c0cf3d0 0x7f986c163f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.053+0000 7f9874200640 1 --2- 172.21.15.163:0/1478995579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c0cd3f0 0x7f986c147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.053+0000 7f9874200640 1 --2- 172.21.15.163:0/1478995579 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c0ca9f0 0x7f986c159920 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.053+0000 7f9874200640 1 -- 172.21.15.163:0/1478995579 >> 172.21.15.163:0/1478995579 conn(0x7f986c0705d0 msgr2=0x7f986c15e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:32.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.053+0000 7f9874200640 1 -- 172.21.15.163:0/1478995579 shutdown_connections 2024-01-24T13:03:32.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.053+0000 7f9874200640 1 -- 172.21.15.163:0/1478995579 wait complete. 2024-01-24T13:03:32.073 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new bcedd366-9488-44ff-8f18-1e0e8f7c914e 4 2024-01-24T13:03:32.168 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:32.165+0000 7f37cd44b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-24T13:03:32.208 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.205+0000 7f00dda00640 1 Processor -- start 2024-01-24T13:03:32.208 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.205+0000 7f00dda00640 1 -- start start 2024-01-24T13:03:32.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00dda00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00d80ce950 0x7f00d80ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00dda00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f00d80cd2f0 0x7f00d815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00dda00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d80d0b80 con 0x7f00d815d5e0 2024-01-24T13:03:32.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00dda00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d80d0040 con 0x7f00d80cd2f0 2024-01-24T13:03:32.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00dda00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d80cd770 con 0x7f00d80ce950 2024-01-24T13:03:32.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00d6a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00d80ce950 0x7f00d80ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00d6000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f00d80cd2f0 0x7f00d815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00d6a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00d80ce950 0x7f00d80ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:42142/0 (socket says 172.21.15.163:42142) 2024-01-24T13:03:32.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00d6a00640 1 -- 172.21.15.163:0/3777319443 learned_addr learned my addr 172.21.15.163:0/3777319443 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:32.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00d6000640 1 -- 172.21.15.163:0/3777319443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00d80ce950 msgr2=0x7f00d80ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:32.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00d6000640 1 --2- 172.21.15.163:0/3777319443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00d80ce950 0x7f00d80ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00d6000640 1 -- 172.21.15.163:0/3777319443 >> v1:172.21.15.163:6789/0 conn(0x7f00d815d5e0 legacy=0x7f00d8152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00d6000640 1 -- 172.21.15.163:0/3777319443 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d806bdf0 con 0x7f00d80cd2f0 2024-01-24T13:03:32.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00d5600640 1 -- 172.21.15.163:0/3777319443 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013383669 0 0) 0x7f00d80d0b80 con 0x7f00d815d5e0 2024-01-24T13:03:32.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.209+0000 7f00d6a00640 1 --2- 172.21.15.163:0/3777319443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00d80ce950 0x7f00d80ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:32.213 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.213+0000 7f00d6000640 1 --2- 172.21.15.163:0/3777319443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00d80cd2f0 0x7f00d815d0a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f00c00097c0 tx=0x7f00c001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8caf12324125e0a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:32.214 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.213+0000 7f00d5600640 1 -- 172.21.15.163:0/3777319443 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c00ab600 con 0x7f00d80cd2f0 2024-01-24T13:03:32.214 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.213+0000 7f00d5600640 1 -- 172.21.15.163:0/3777319443 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c00a7050 con 0x7f00d80cd2f0 2024-01-24T13:03:32.214 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.213+0000 7f00d5600640 1 -- 172.21.15.163:0/3777319443 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c00ab980 con 0x7f00d80cd2f0 2024-01-24T13:03:32.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.213+0000 7f00dda00640 1 -- 172.21.15.163:0/3777319443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00d80cd2f0 msgr2=0x7f00d815d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.213+0000 7f00dda00640 1 --2- 172.21.15.163:0/3777319443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00d80cd2f0 0x7f00d815d0a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f00c00097c0 tx=0x7f00c001c3f0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.213+0000 7f00dda00640 1 -- 172.21.15.163:0/3777319443 shutdown_connections 2024-01-24T13:03:32.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.213+0000 7f00dda00640 1 --2- 172.21.15.163:0/3777319443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00d80cd2f0 0x7f00d815d0a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.213+0000 7f00dda00640 1 --2- 172.21.15.163:0/3777319443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00d80ce950 0x7f00d80ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.213+0000 7f00dda00640 1 -- 172.21.15.163:0/3777319443 >> 172.21.15.163:0/3777319443 conn(0x7f00d80705d0 msgr2=0x7f00d8069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:32.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.213+0000 7f00dda00640 1 -- 172.21.15.163:0/3777319443 shutdown_connections 2024-01-24T13:03:32.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.213+0000 7f00dda00640 1 -- 172.21.15.163:0/3777319443 wait complete. 2024-01-24T13:03:32.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00dda00640 1 Processor -- start 2024-01-24T13:03:32.217 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00dda00640 1 -- start start 2024-01-24T13:03:32.218 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00dda00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00d80cd2f0 0x7f00d814ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.218 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00dda00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00d80ce950 0x7f00d8155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.218 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00dda00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00d815d5e0 0x7f00d8156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.218 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00dda00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d814b0c0 con 0x7f00d815d5e0 2024-01-24T13:03:32.218 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00dda00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d8152ab0 con 0x7f00d80ce950 2024-01-24T13:03:32.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00dda00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d8150860 con 0x7f00d80cd2f0 2024-01-24T13:03:32.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00d6000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00d80ce950 0x7f00d8155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00d6000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00d80ce950 0x7f00d8155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:46430/0 (socket says 172.21.15.163:46430) 2024-01-24T13:03:32.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00d6000640 1 -- 172.21.15.163:0/966195648 learned_addr learned my addr 172.21.15.163:0/966195648 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:32.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00d6a00640 1 --2- 172.21.15.163:0/966195648 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00d80cd2f0 0x7f00d814ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00d7400640 1 --2- 172.21.15.163:0/966195648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00d815d5e0 0x7f00d8156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00d6000640 1 -- 172.21.15.163:0/966195648 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00d80cd2f0 msgr2=0x7f00d814ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00d6000640 1 --2- 172.21.15.163:0/966195648 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00d80cd2f0 0x7f00d814ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00d6000640 1 -- 172.21.15.163:0/966195648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00d815d5e0 msgr2=0x7f00d8156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00d6000640 1 --2- 172.21.15.163:0/966195648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00d815d5e0 0x7f00d8156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00d6000640 1 -- 172.21.15.163:0/966195648 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c80094d0 con 0x7f00d80ce950 2024-01-24T13:03:32.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00d6a00640 1 --2- 172.21.15.163:0/966195648 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00d80cd2f0 0x7f00d814ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:32.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00d6000640 1 --2- 172.21.15.163:0/966195648 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00d80ce950 0x7f00d8155ec0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f00c001a020 tx=0x7f00c0019190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:32.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00cea00640 1 -- 172.21.15.163:0/966195648 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c00abea0 con 0x7f00d80ce950 2024-01-24T13:03:32.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00cea00640 1 -- 172.21.15.163:0/966195648 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c00b4410 con 0x7f00d80ce950 2024-01-24T13:03:32.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00dda00640 1 -- 172.21.15.163:0/966195648 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c0009420 con 0x7f00d80ce950 2024-01-24T13:03:32.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00cea00640 1 -- 172.21.15.163:0/966195648 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c00b47a0 con 0x7f00d80ce950 2024-01-24T13:03:32.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00dda00640 1 -- 172.21.15.163:0/966195648 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d8156d10 con 0x7f00d80ce950 2024-01-24T13:03:32.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00cea00640 1 -- 172.21.15.163:0/966195648 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f00c00b2040 con 0x7f00d80ce950 2024-01-24T13:03:32.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00cea00640 1 -- 172.21.15.163:0/966195648 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f00c00bd450 con 0x7f00d80ce950 2024-01-24T13:03:32.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.217+0000 7f00dda00640 1 -- 172.21.15.163:0/966195648 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d804e850 con 0x7f00d80ce950 2024-01-24T13:03:32.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.221+0000 7f00cea00640 1 -- 172.21.15.163:0/966195648 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f00c00c2060 con 0x7f00d80ce950 2024-01-24T13:03:32.235 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:32.233+0000 7f37cd44b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-24T13:03:32.246 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:32.245+0000 7fe45a655180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-24T13:03:32.288 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.285+0000 7f00dda00640 1 -- 172.21.15.163:0/966195648 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bcedd366-9488-44ff-8f18-1e0e8f7c914e", "id": 4} v 0) v1 -- 0x7f00d814e650 con 0x7f00d80ce950 2024-01-24T13:03:32.293 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.293+0000 7f00cea00640 1 -- 172.21.15.163:0/966195648 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bcedd366-9488-44ff-8f18-1e0e8f7c914e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f00c00b8070 con 0x7f00d80ce950 2024-01-24T13:03:32.293 INFO:teuthology.orchestra.run.smithi163.stdout:4 2024-01-24T13:03:32.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.293+0000 7f00dda00640 1 -- 172.21.15.163:0/966195648 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00d80ce950 msgr2=0x7f00d8155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.293+0000 7f00dda00640 1 --2- 172.21.15.163:0/966195648 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00d80ce950 0x7f00d8155ec0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f00c001a020 tx=0x7f00c0019190 comp rx=0 tx=0).stop 2024-01-24T13:03:32.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.293+0000 7f00dda00640 1 -- 172.21.15.163:0/966195648 shutdown_connections 2024-01-24T13:03:32.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.293+0000 7f00dda00640 1 --2- 172.21.15.163:0/966195648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00d815d5e0 0x7f00d8156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.293+0000 7f00dda00640 1 --2- 172.21.15.163:0/966195648 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00d80ce950 0x7f00d8155ec0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.293+0000 7f00dda00640 1 --2- 172.21.15.163:0/966195648 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00d80cd2f0 0x7f00d814ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.293+0000 7f00dda00640 1 -- 172.21.15.163:0/966195648 >> 172.21.15.163:0/966195648 conn(0x7f00d80705d0 msgr2=0x7f00d815b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:32.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.293+0000 7f00dda00640 1 -- 172.21.15.163:0/966195648 shutdown_connections 2024-01-24T13:03:32.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.293+0000 7f00dda00640 1 -- 172.21.15.163:0/966195648 wait complete. 2024-01-24T13:03:32.297 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:32.297+0000 7f37cd44b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-24T13:03:32.311 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:32.309+0000 7fe45a655180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-24T13:03:32.313 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212 5 2024-01-24T13:03:32.374 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:32.373+0000 7fe45a655180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-24T13:03:32.389 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:32.389+0000 7f37cd44b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-24T13:03:32.447 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.445+0000 7fb16ce00640 1 Processor -- start 2024-01-24T13:03:32.448 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.445+0000 7fb16ce00640 1 -- start start 2024-01-24T13:03:32.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb16ce00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb1680cd4c0 0x7fb16815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb16ce00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb16815d5e0 0x7fb168152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb16ce00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1680d0b80 con 0x7fb1680ce950 2024-01-24T13:03:32.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb16ce00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1680d0040 con 0x7fb1680cd4c0 2024-01-24T13:03:32.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb16ce00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16806bdf0 con 0x7fb16815d5e0 2024-01-24T13:03:32.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb166800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb16815d5e0 0x7fb168152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.450 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb166800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb16815d5e0 0x7fb168152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:42152/0 (socket says 172.21.15.163:42152) 2024-01-24T13:03:32.450 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb166800640 1 -- 172.21.15.163:0/1805820580 learned_addr learned my addr 172.21.15.163:0/1805820580 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:32.450 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb165400640 1 --2- 172.21.15.163:0/1805820580 >> v2:172.21.15.29:3300/0 conn(0x7fb1680cd4c0 0x7fb16815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.450 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb166800640 1 -- 172.21.15.163:0/1805820580 >> v2:172.21.15.29:3300/0 conn(0x7fb1680cd4c0 msgr2=0x7fb16815d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:32.450 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb166800640 1 --2- 172.21.15.163:0/1805820580 >> v2:172.21.15.29:3300/0 conn(0x7fb1680cd4c0 0x7fb16815d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.450 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb166800640 1 -- 172.21.15.163:0/1805820580 >> v1:172.21.15.29:6789/0 conn(0x7fb1680ce950 legacy=0x7fb1680ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.450 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb166800640 1 -- 172.21.15.163:0/1805820580 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16815de00 con 0x7fb16815d5e0 2024-01-24T13:03:32.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb166800640 1 --2- 172.21.15.163:0/1805820580 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb16815d5e0 0x7fb168152f80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb160009e50 tx=0x7fb16001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f54b1c2e57393c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:32.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.449+0000 7fb164a00640 1 -- 172.21.15.163:0/1805820580 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1600a5810 con 0x7fb16815d5e0 2024-01-24T13:03:32.453 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb164a00640 1 -- 172.21.15.163:0/1805820580 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1600a5970 con 0x7fb16815d5e0 2024-01-24T13:03:32.453 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb164a00640 1 -- 172.21.15.163:0/1805820580 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1600a5d00 con 0x7fb16815d5e0 2024-01-24T13:03:32.453 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:32.453+0000 7f37cd44b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-24T13:03:32.454 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 -- 172.21.15.163:0/1805820580 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb16815d5e0 msgr2=0x7fb168152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.454 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 --2- 172.21.15.163:0/1805820580 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb16815d5e0 0x7fb168152f80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb160009e50 tx=0x7fb16001c950 comp rx=0 tx=0).stop 2024-01-24T13:03:32.454 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 -- 172.21.15.163:0/1805820580 shutdown_connections 2024-01-24T13:03:32.454 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 --2- 172.21.15.163:0/1805820580 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb16815d5e0 0x7fb168152f80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.454 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 --2- 172.21.15.163:0/1805820580 >> v2:172.21.15.29:3300/0 conn(0x7fb1680cd4c0 0x7fb16815d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.454 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 -- 172.21.15.163:0/1805820580 >> 172.21.15.163:0/1805820580 conn(0x7fb1680705d0 msgr2=0x7fb168069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:32.454 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 -- 172.21.15.163:0/1805820580 shutdown_connections 2024-01-24T13:03:32.454 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 -- 172.21.15.163:0/1805820580 wait complete. 2024-01-24T13:03:32.455 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 Processor -- start 2024-01-24T13:03:32.455 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 -- start start 2024-01-24T13:03:32.457 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1680cd4c0 0x7fb1680c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.457 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1680ce950 0x7fb168147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.457 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb16815d5e0 0x7fb16814a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.457 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168153f50 con 0x7fb1680ce950 2024-01-24T13:03:32.457 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.453+0000 7fb16ce00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168158da0 con 0x7fb1680cd4c0 2024-01-24T13:03:32.457 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb16ce00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680c8720 con 0x7fb16815d5e0 2024-01-24T13:03:32.457 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb166800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb16815d5e0 0x7fb16814a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.457 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb165e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1680cd4c0 0x7fb1680c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.457 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb166800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb16815d5e0 0x7fb16814a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:42164/0 (socket says 172.21.15.163:42164) 2024-01-24T13:03:32.457 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb166800640 1 -- 172.21.15.163:0/3481647709 learned_addr learned my addr 172.21.15.163:0/3481647709 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:32.457 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb165400640 1 --2- 172.21.15.163:0/3481647709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1680ce950 0x7fb168147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.459 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb165e00640 1 -- 172.21.15.163:0/3481647709 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb16815d5e0 msgr2=0x7fb16814a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.459 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb165e00640 1 --2- 172.21.15.163:0/3481647709 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb16815d5e0 0x7fb16814a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.459 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb165e00640 1 -- 172.21.15.163:0/3481647709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1680ce950 msgr2=0x7fb168147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.459 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb165e00640 1 --2- 172.21.15.163:0/3481647709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1680ce950 0x7fb168147e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.459 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb165e00640 1 -- 172.21.15.163:0/3481647709 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb160009b30 con 0x7fb1680cd4c0 2024-01-24T13:03:32.459 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb166800640 1 --2- 172.21.15.163:0/3481647709 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb16815d5e0 0x7fb16814a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:32.459 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb165400640 1 --2- 172.21.15.163:0/3481647709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1680ce950 0x7fb168147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:32.459 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb165e00640 1 --2- 172.21.15.163:0/3481647709 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1680cd4c0 0x7fb1680c9f20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb158000f70 tx=0x7fb15800c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:32.460 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb15e000640 1 -- 172.21.15.163:0/3481647709 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1580052d0 con 0x7fb1680cd4c0 2024-01-24T13:03:32.460 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb15e000640 1 -- 172.21.15.163:0/3481647709 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb158005430 con 0x7fb1680cd4c0 2024-01-24T13:03:32.460 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb15e000640 1 -- 172.21.15.163:0/3481647709 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158003840 con 0x7fb1680cd4c0 2024-01-24T13:03:32.460 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb16ce00640 1 -- 172.21.15.163:0/3481647709 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb168158750 con 0x7fb1680cd4c0 2024-01-24T13:03:32.460 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb16ce00640 1 -- 172.21.15.163:0/3481647709 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1681483c0 con 0x7fb1680cd4c0 2024-01-24T13:03:32.460 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb15e000640 1 -- 172.21.15.163:0/3481647709 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb158003ca0 con 0x7fb1680cd4c0 2024-01-24T13:03:32.460 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb15e000640 1 -- 172.21.15.163:0/3481647709 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fb158012420 con 0x7fb1680cd4c0 2024-01-24T13:03:32.460 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.457+0000 7fb16ce00640 1 -- 172.21.15.163:0/3481647709 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1680d07c0 con 0x7fb1680cd4c0 2024-01-24T13:03:32.461 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.461+0000 7fb15e000640 1 -- 172.21.15.163:0/3481647709 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fb158017070 con 0x7fb1680cd4c0 2024-01-24T13:03:32.466 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:32.465+0000 7fe45a655180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-24T13:03:32.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.525+0000 7fb16ce00640 1 -- 172.21.15.163:0/3481647709 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212", "id": 5} v 0) v1 -- 0x7fb16804e850 con 0x7fb1680cd4c0 2024-01-24T13:03:32.529 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:32.529+0000 7fe45a655180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-24T13:03:32.536 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.537+0000 7fb15e000640 1 -- 172.21.15.163:0/3481647709 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb158011590 con 0x7fb1680cd4c0 2024-01-24T13:03:32.537 INFO:teuthology.orchestra.run.smithi163.stdout:5 2024-01-24T13:03:32.538 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.537+0000 7fb16ce00640 1 -- 172.21.15.163:0/3481647709 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1680cd4c0 msgr2=0x7fb1680c9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.538 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.537+0000 7fb16ce00640 1 --2- 172.21.15.163:0/3481647709 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1680cd4c0 0x7fb1680c9f20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb158000f70 tx=0x7fb15800c890 comp rx=0 tx=0).stop 2024-01-24T13:03:32.538 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.537+0000 7fb16ce00640 1 -- 172.21.15.163:0/3481647709 shutdown_connections 2024-01-24T13:03:32.538 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.537+0000 7fb16ce00640 1 --2- 172.21.15.163:0/3481647709 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb16815d5e0 0x7fb16814a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.538 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.537+0000 7fb16ce00640 1 --2- 172.21.15.163:0/3481647709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1680ce950 0x7fb168147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.539 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.537+0000 7fb16ce00640 1 --2- 172.21.15.163:0/3481647709 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1680cd4c0 0x7fb1680c9f20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.539 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.537+0000 7fb16ce00640 1 -- 172.21.15.163:0/3481647709 >> 172.21.15.163:0/3481647709 conn(0x7fb1680705d0 msgr2=0x7fb16815bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:32.539 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.537+0000 7fb16ce00640 1 -- 172.21.15.163:0/3481647709 shutdown_connections 2024-01-24T13:03:32.539 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.537+0000 7fb16ce00640 1 -- 172.21.15.163:0/3481647709 wait complete. 2024-01-24T13:03:32.551 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:32.549+0000 7f37cd44b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-24T13:03:32.557 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 0470be49-3213-499e-8d70-6e5244fec32f 6 2024-01-24T13:03:32.612 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:32.609+0000 7f37cd44b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-24T13:03:32.622 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:32.621+0000 7fe45a655180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-24T13:03:32.685 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:32.685+0000 7fe45a655180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-24T13:03:32.691 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.689+0000 7f046f400640 1 Processor -- start 2024-01-24T13:03:32.692 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.689+0000 7f046f400640 1 -- start start 2024-01-24T13:03:32.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.693+0000 7f046f400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f04680cf580 0x7f04680cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.693+0000 7f046f400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f046815cb80 0x7f046815cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.693+0000 7f046f400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046815d6d0 con 0x7f0468156c10 2024-01-24T13:03:32.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.693+0000 7f046f400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046806b5e0 con 0x7f04680cf580 2024-01-24T13:03:32.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.693+0000 7f046f400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046815d4d0 con 0x7f046815cb80 2024-01-24T13:03:32.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.693+0000 7f046d400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f046815cb80 0x7f046815cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.693+0000 7f046d400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f046815cb80 0x7f046815cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:46450/0 (socket says 172.21.15.163:46450) 2024-01-24T13:03:32.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.693+0000 7f046d400640 1 -- 172.21.15.163:0/3614231519 learned_addr learned my addr 172.21.15.163:0/3614231519 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:32.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.693+0000 7f0467e00640 1 --2- 172.21.15.163:0/3614231519 >> v2:172.21.15.29:3300/0 conn(0x7f04680cf580 0x7f04680cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.693+0000 7f046d400640 1 -- 172.21.15.163:0/3614231519 >> v2:172.21.15.29:3300/0 conn(0x7f04680cf580 msgr2=0x7f04680cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:32.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.693+0000 7f046d400640 1 --2- 172.21.15.163:0/3614231519 >> v2:172.21.15.29:3300/0 conn(0x7f04680cf580 0x7f04680cfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.693+0000 7f046d400640 1 -- 172.21.15.163:0/3614231519 >> v1:172.21.15.163:6789/0 conn(0x7f0468156c10 legacy=0x7f046806ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.693+0000 7f046d400640 1 -- 172.21.15.163:0/3614231519 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046815d9b0 con 0x7f046815cb80 2024-01-24T13:03:32.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.697+0000 7f046d400640 1 --2- 172.21.15.163:0/3614231519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f046815cb80 0x7f046815cf90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f04680cf320 tx=0x7f046001c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26c527f418701399 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:32.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.697+0000 7f0467400640 1 -- 172.21.15.163:0/3614231519 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04600a5600 con 0x7f046815cb80 2024-01-24T13:03:32.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.697+0000 7f0467400640 1 -- 172.21.15.163:0/3614231519 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04600a5760 con 0x7f046815cb80 2024-01-24T13:03:32.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.697+0000 7f0467400640 1 -- 172.21.15.163:0/3614231519 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04600a5af0 con 0x7f046815cb80 2024-01-24T13:03:32.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.697+0000 7f046f400640 1 -- 172.21.15.163:0/3614231519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f046815cb80 msgr2=0x7f046815cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.697+0000 7f046f400640 1 --2- 172.21.15.163:0/3614231519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f046815cb80 0x7f046815cf90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f04680cf320 tx=0x7f046001c8b0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.697+0000 7f046f400640 1 -- 172.21.15.163:0/3614231519 shutdown_connections 2024-01-24T13:03:32.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.697+0000 7f046f400640 1 --2- 172.21.15.163:0/3614231519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f046815cb80 0x7f046815cf90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.697+0000 7f046f400640 1 --2- 172.21.15.163:0/3614231519 >> v2:172.21.15.29:3300/0 conn(0x7f04680cf580 0x7f04680cfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.697+0000 7f046f400640 1 -- 172.21.15.163:0/3614231519 >> 172.21.15.163:0/3614231519 conn(0x7f046806a0d0 msgr2=0x7f046806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:32.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.697+0000 7f046f400640 1 -- 172.21.15.163:0/3614231519 shutdown_connections 2024-01-24T13:03:32.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.697+0000 7f046f400640 1 -- 172.21.15.163:0/3614231519 wait complete. 2024-01-24T13:03:32.700 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.697+0000 7f046f400640 1 Processor -- start 2024-01-24T13:03:32.700 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.697+0000 7f046f400640 1 -- start start 2024-01-24T13:03:32.702 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046f400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04680cf580 0x7f04680cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046f400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0468156c10 0x7f04681535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f046815cb80 0x7f0468157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046f400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046815e3c0 con 0x7f0468156c10 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046f400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0468153b20 con 0x7f046815cb80 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046f400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04681581d0 con 0x7f04680cf580 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046d400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f046815cb80 0x7f0468157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046ca00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04680cf580 0x7f04680cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046d400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f046815cb80 0x7f0468157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:46460/0 (socket says 172.21.15.163:46460) 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046d400640 1 -- 172.21.15.163:0/192802825 learned_addr learned my addr 172.21.15.163:0/192802825 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f0467e00640 1 --2- 172.21.15.163:0/192802825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0468156c10 0x7f04681535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046d400640 1 -- 172.21.15.163:0/192802825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04680cf580 msgr2=0x7f04680cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046d400640 1 --2- 172.21.15.163:0/192802825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04680cf580 0x7f04680cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046d400640 1 -- 172.21.15.163:0/192802825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0468156c10 msgr2=0x7f04681535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046d400640 1 --2- 172.21.15.163:0/192802825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0468156c10 0x7f04681535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046d400640 1 -- 172.21.15.163:0/192802825 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0460009b30 con 0x7f046815cb80 2024-01-24T13:03:32.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046ca00640 1 --2- 172.21.15.163:0/192802825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04680cf580 0x7f04680cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:32.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f0467e00640 1 --2- 172.21.15.163:0/192802825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0468156c10 0x7f04681535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:32.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046d400640 1 --2- 172.21.15.163:0/192802825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f046815cb80 0x7f0468157c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f04600af040 tx=0x7f0460019650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:32.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f0464c00640 1 -- 172.21.15.163:0/192802825 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04600b8670 con 0x7f046815cb80 2024-01-24T13:03:32.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f0464c00640 1 -- 172.21.15.163:0/192802825 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04600b87d0 con 0x7f046815cb80 2024-01-24T13:03:32.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046f400640 1 -- 172.21.15.163:0/192802825 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0468158400 con 0x7f046815cb80 2024-01-24T13:03:32.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f0464c00640 1 -- 172.21.15.163:0/192802825 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04600b8b80 con 0x7f046815cb80 2024-01-24T13:03:32.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046f400640 1 -- 172.21.15.163:0/192802825 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046815dfe0 con 0x7f046815cb80 2024-01-24T13:03:32.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f0464c00640 1 -- 172.21.15.163:0/192802825 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f04600c1400 con 0x7f046815cb80 2024-01-24T13:03:32.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f0464c00640 1 -- 172.21.15.163:0/192802825 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f04600b6a30 con 0x7f046815cb80 2024-01-24T13:03:32.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.701+0000 7f046f400640 1 -- 172.21.15.163:0/192802825 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046815e500 con 0x7f046815cb80 2024-01-24T13:03:32.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.705+0000 7f0464c00640 1 -- 172.21.15.163:0/192802825 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f04600dfb50 con 0x7f046815cb80 2024-01-24T13:03:32.772 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.769+0000 7f046f400640 1 -- 172.21.15.163:0/192802825 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0470be49-3213-499e-8d70-6e5244fec32f", "id": 6} v 0) v1 -- 0x7f04680736c0 con 0x7f046815cb80 2024-01-24T13:03:32.775 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:32.773+0000 7f37cd44b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-24T13:03:32.777 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.777+0000 7f0464c00640 1 -- 172.21.15.163:0/192802825 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0470be49-3213-499e-8d70-6e5244fec32f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f04600ce030 con 0x7f046815cb80 2024-01-24T13:03:32.777 INFO:teuthology.orchestra.run.smithi163.stdout:6 2024-01-24T13:03:32.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.777+0000 7f046f400640 1 -- 172.21.15.163:0/192802825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f046815cb80 msgr2=0x7f0468157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.777+0000 7f046f400640 1 --2- 172.21.15.163:0/192802825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f046815cb80 0x7f0468157c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f04600af040 tx=0x7f0460019650 comp rx=0 tx=0).stop 2024-01-24T13:03:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.777+0000 7f046f400640 1 -- 172.21.15.163:0/192802825 shutdown_connections 2024-01-24T13:03:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.777+0000 7f046f400640 1 --2- 172.21.15.163:0/192802825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f046815cb80 0x7f0468157c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.777+0000 7f046f400640 1 --2- 172.21.15.163:0/192802825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0468156c10 0x7f04681535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.777+0000 7f046f400640 1 --2- 172.21.15.163:0/192802825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04680cf580 0x7f04680cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.777+0000 7f046f400640 1 -- 172.21.15.163:0/192802825 >> 172.21.15.163:0/192802825 conn(0x7f046806a0d0 msgr2=0x7f046806a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.777+0000 7f046f400640 1 -- 172.21.15.163:0/192802825 shutdown_connections 2024-01-24T13:03:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.777+0000 7f046f400640 1 -- 172.21.15.163:0/192802825 wait complete. 2024-01-24T13:03:32.799 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 36b884b5-d9f6-417c-a5f1-9fccbe0b556c 7 2024-01-24T13:03:32.847 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:32.845+0000 7f37cd44b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-24T13:03:32.849 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:32.849+0000 7fe45a655180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-24T13:03:32.921 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:32.921+0000 7fe45a655180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-24T13:03:32.933 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa463e00640 1 Processor -- start 2024-01-24T13:03:32.934 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa463e00640 1 -- start start 2024-01-24T13:03:32.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa463e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa45c15c800 0x7fa45c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa463e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa45c0cfdc0 0x7fa45c070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa463e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45c0cce80 con 0x7fa45c0ceb30 2024-01-24T13:03:32.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa463e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45c0cd0d0 con 0x7fa45c0cfdc0 2024-01-24T13:03:32.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa463e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c0cd3b0 con 0x7fa45c15c800 2024-01-24T13:03:32.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa461e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa45c0cfdc0 0x7fa45c070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa461400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa45c15c800 0x7fa45c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa461e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa45c0cfdc0 0x7fa45c070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:46466/0 (socket says 172.21.15.163:46466) 2024-01-24T13:03:32.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa461e00640 1 -- 172.21.15.163:0/2431228437 learned_addr learned my addr 172.21.15.163:0/2431228437 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:32.937 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa461400640 1 -- 172.21.15.163:0/2431228437 >> v2:172.21.15.163:3300/0 conn(0x7fa45c0cfdc0 msgr2=0x7fa45c070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:32.937 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa461400640 1 --2- 172.21.15.163:0/2431228437 >> v2:172.21.15.163:3300/0 conn(0x7fa45c0cfdc0 0x7fa45c070d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.937 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa461400640 1 -- 172.21.15.163:0/2431228437 >> v1:172.21.15.29:6789/0 conn(0x7fa45c0ceb30 legacy=0x7fa45c0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.937 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa461400640 1 -- 172.21.15.163:0/2431228437 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c0cd690 con 0x7fa45c15c800 2024-01-24T13:03:32.937 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.933+0000 7fa461e00640 1 --2- 172.21.15.163:0/2431228437 >> v2:172.21.15.163:3300/0 conn(0x7fa45c0cfdc0 0x7fa45c070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:32.939 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.937+0000 7fa461400640 1 --2- 172.21.15.163:0/2431228437 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa45c15c800 0x7fa45c06d2a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0097c0 tx=0x7fa44c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58f7f26f18bc42f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:32.939 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.937+0000 7fa45be00640 1 -- 172.21.15.163:0/2431228437 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c0ab600 con 0x7fa45c15c800 2024-01-24T13:03:32.939 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.937+0000 7fa45be00640 1 -- 172.21.15.163:0/2431228437 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c0a7050 con 0x7fa45c15c800 2024-01-24T13:03:32.939 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.937+0000 7fa45be00640 1 -- 172.21.15.163:0/2431228437 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c0ab980 con 0x7fa45c15c800 2024-01-24T13:03:32.940 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.937+0000 7fa463e00640 1 -- 172.21.15.163:0/2431228437 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa45c15c800 msgr2=0x7fa45c06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.940 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.937+0000 7fa463e00640 1 --2- 172.21.15.163:0/2431228437 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa45c15c800 0x7fa45c06d2a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0097c0 tx=0x7fa44c01c480 comp rx=0 tx=0).stop 2024-01-24T13:03:32.940 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.937+0000 7fa463e00640 1 -- 172.21.15.163:0/2431228437 shutdown_connections 2024-01-24T13:03:32.940 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.937+0000 7fa463e00640 1 --2- 172.21.15.163:0/2431228437 >> v2:172.21.15.163:3300/0 conn(0x7fa45c0cfdc0 0x7fa45c070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.940 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.937+0000 7fa463e00640 1 --2- 172.21.15.163:0/2431228437 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa45c15c800 0x7fa45c06d2a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.940 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.937+0000 7fa463e00640 1 -- 172.21.15.163:0/2431228437 >> 172.21.15.163:0/2431228437 conn(0x7fa45c06b1e0 msgr2=0x7fa45c06b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:32.940 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.937+0000 7fa463e00640 1 -- 172.21.15.163:0/2431228437 shutdown_connections 2024-01-24T13:03:32.940 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.937+0000 7fa463e00640 1 -- 172.21.15.163:0/2431228437 wait complete. 2024-01-24T13:03:32.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa463e00640 1 Processor -- start 2024-01-24T13:03:32.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa463e00640 1 -- start start 2024-01-24T13:03:32.944 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa463e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa45c0ceb30 0x7fa45c159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.944 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa463e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa45c0cfdc0 0x7fa45c150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.944 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa463e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa45c15c800 0x7fa45c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:32.944 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa463e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c15a0b0 con 0x7fa45c15c800 2024-01-24T13:03:32.944 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa463e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c15a390 con 0x7fa45c0ceb30 2024-01-24T13:03:32.944 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa463e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c15a670 con 0x7fa45c0cfdc0 2024-01-24T13:03:32.944 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa461400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa45c0ceb30 0x7fa45c159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa460a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa45c0cfdc0 0x7fa45c150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa460a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa45c0cfdc0 0x7fa45c150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:42194/0 (socket says 172.21.15.163:42194) 2024-01-24T13:03:32.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa461400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa45c0ceb30 0x7fa45c159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:46472/0 (socket says 172.21.15.163:46472) 2024-01-24T13:03:32.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa460a00640 1 -- 172.21.15.163:0/2437463118 learned_addr learned my addr 172.21.15.163:0/2437463118 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-01-24T13:03:32.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa461e00640 1 --2- 172.21.15.163:0/2437463118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa45c15c800 0x7fa45c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:32.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa460a00640 1 -- 172.21.15.163:0/2437463118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa45c0ceb30 msgr2=0x7fa45c159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa460a00640 1 --2- 172.21.15.163:0/2437463118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa45c0ceb30 0x7fa45c159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa460a00640 1 -- 172.21.15.163:0/2437463118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa45c15c800 msgr2=0x7fa45c0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:32.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa460a00640 1 --2- 172.21.15.163:0/2437463118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa45c15c800 0x7fa45c0b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:32.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa460a00640 1 -- 172.21.15.163:0/2437463118 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa454009b30 con 0x7fa45c0cfdc0 2024-01-24T13:03:32.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa461400640 1 --2- 172.21.15.163:0/2437463118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa45c0ceb30 0x7fa45c159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:32.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa460a00640 1 --2- 172.21.15.163:0/2437463118 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa45c0cfdc0 0x7fa45c150290 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa44400c3c0 tx=0x7fa44400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:32.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa459600640 1 -- 172.21.15.163:0/2437463118 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4440052d0 con 0x7fa45c0cfdc0 2024-01-24T13:03:32.946 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa459600640 1 -- 172.21.15.163:0/2437463118 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa444005430 con 0x7fa45c0cfdc0 2024-01-24T13:03:32.946 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa459600640 1 -- 172.21.15.163:0/2437463118 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa444003840 con 0x7fa45c0cfdc0 2024-01-24T13:03:32.946 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa463e00640 1 -- 172.21.15.163:0/2437463118 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44c009420 con 0x7fa45c0cfdc0 2024-01-24T13:03:32.946 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa463e00640 1 -- 172.21.15.163:0/2437463118 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45c0b3740 con 0x7fa45c0cfdc0 2024-01-24T13:03:32.946 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa459600640 1 -- 172.21.15.163:0/2437463118 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa444003ca0 con 0x7fa45c0cfdc0 2024-01-24T13:03:32.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.941+0000 7fa459600640 1 -- 172.21.15.163:0/2437463118 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa444012a80 con 0x7fa45c0cfdc0 2024-01-24T13:03:32.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.945+0000 7fa463e00640 1 -- 172.21.15.163:0/2437463118 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45c0b3960 con 0x7fa45c0cfdc0 2024-01-24T13:03:32.948 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:32.945+0000 7fa459600640 1 -- 172.21.15.163:0/2437463118 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fa444017070 con 0x7fa45c0cfdc0 2024-01-24T13:03:33.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:33.017+0000 7fa463e00640 1 -- 172.21.15.163:0/2437463118 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "36b884b5-d9f6-417c-a5f1-9fccbe0b556c", "id": 7} v 0) v1 -- 0x7fa45c15ab90 con 0x7fa45c0cfdc0 2024-01-24T13:03:33.022 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:33.021+0000 7fa459600640 1 -- 172.21.15.163:0/2437463118 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "36b884b5-d9f6-417c-a5f1-9fccbe0b556c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa444012420 con 0x7fa45c0cfdc0 2024-01-24T13:03:33.022 INFO:teuthology.orchestra.run.smithi163.stdout:7 2024-01-24T13:03:33.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:33.021+0000 7fa463e00640 1 -- 172.21.15.163:0/2437463118 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa45c0cfdc0 msgr2=0x7fa45c150290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:33.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:33.021+0000 7fa463e00640 1 --2- 172.21.15.163:0/2437463118 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa45c0cfdc0 0x7fa45c150290 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa44400c3c0 tx=0x7fa44400c880 comp rx=0 tx=0).stop 2024-01-24T13:03:33.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:33.021+0000 7fa463e00640 1 -- 172.21.15.163:0/2437463118 shutdown_connections 2024-01-24T13:03:33.025 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:33.021+0000 7fa463e00640 1 --2- 172.21.15.163:0/2437463118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa45c15c800 0x7fa45c0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:33.025 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:33.021+0000 7fa463e00640 1 --2- 172.21.15.163:0/2437463118 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa45c0cfdc0 0x7fa45c150290 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:33.025 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:33.021+0000 7fa463e00640 1 --2- 172.21.15.163:0/2437463118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa45c0ceb30 0x7fa45c159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:33.025 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:33.021+0000 7fa463e00640 1 -- 172.21.15.163:0/2437463118 >> 172.21.15.163:0/2437463118 conn(0x7fa45c06b1e0 msgr2=0x7fa45c15fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:33.025 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:33.021+0000 7fa463e00640 1 -- 172.21.15.163:0/2437463118 shutdown_connections 2024-01-24T13:03:33.025 INFO:teuthology.orchestra.run.smithi163.stderr:2024-01-24T13:03:33.021+0000 7fa463e00640 1 -- 172.21.15.163:0/2437463118 wait complete. 2024-01-24T13:03:33.042 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-24T13:03:33.043 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-24T13:03:33.046 INFO:tasks.ceph.osd.0:Started 2024-01-24T13:03:33.047 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-24T13:03:33.047 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-24T13:03:33.050 INFO:tasks.ceph.osd.1:Started 2024-01-24T13:03:33.051 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-24T13:03:33.051 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-24T13:03:33.054 INFO:tasks.ceph.osd.2:Started 2024-01-24T13:03:33.054 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-24T13:03:33.054 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-24T13:03:33.058 INFO:tasks.ceph.osd.3:Started 2024-01-24T13:03:33.058 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-24T13:03:33.058 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-24T13:03:33.062 INFO:tasks.ceph.osd.4:Started 2024-01-24T13:03:33.062 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-24T13:03:33.062 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-24T13:03:33.065 INFO:tasks.ceph.osd.5:Started 2024-01-24T13:03:33.065 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-24T13:03:33.065 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-24T13:03:33.068 INFO:tasks.ceph.osd.6:Started 2024-01-24T13:03:33.068 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-24T13:03:33.069 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-24T13:03:33.071 INFO:tasks.ceph.osd.7:Started 2024-01-24T13:03:33.072 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:03:33.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.233+0000 7f99e5c00640 1 Processor -- start 2024-01-24T13:03:33.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.233+0000 7f99e5c00640 1 -- start start 2024-01-24T13:03:33.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.237+0000 7f99e5c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99e015a630 0x7f99e00cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:33.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.237+0000 7f99e5c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99e00cb100 0x7f99e00ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:33.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.237+0000 7f99e5c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e00cfe50 con 0x7f99e00c3ef0 2024-01-24T13:03:33.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.237+0000 7f99e5c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e00cf380 con 0x7f99e00cb100 2024-01-24T13:03:33.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.237+0000 7f99e5c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e015aa10 con 0x7f99e015a630 2024-01-24T13:03:33.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.237+0000 7f99df400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99e00cb100 0x7f99e00ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:33.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.237+0000 7f99df400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99e00cb100 0x7f99e00ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56446/0 (socket says 172.21.15.29:56446) 2024-01-24T13:03:33.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.237+0000 7f99df400640 1 -- 172.21.15.29:0/1242422740 learned_addr learned my addr 172.21.15.29:0/1242422740 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:33.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.237+0000 7f99df400640 1 -- 172.21.15.29:0/1242422740 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99e015a630 msgr2=0x7f99e00cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:33.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.237+0000 7f99df400640 1 --2- 172.21.15.29:0/1242422740 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99e015a630 0x7f99e00cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:33.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.237+0000 7f99df400640 1 -- 172.21.15.29:0/1242422740 >> v1:172.21.15.163:6789/0 conn(0x7f99e00c3ef0 legacy=0x7f99e00ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:33.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.237+0000 7f99df400640 1 -- 172.21.15.29:0/1242422740 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e00b2b70 con 0x7f99e00cb100 2024-01-24T13:03:33.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.241+0000 7f99df400640 1 --2- 172.21.15.29:0/1242422740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e00cb100 0x7f99e00ce4b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009e50 tx=0x7f99d801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986a5882fa0b06c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:33.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.241+0000 7f99dd600640 1 -- 172.21.15.29:0/1242422740 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d80a5820 con 0x7f99e00cb100 2024-01-24T13:03:33.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.241+0000 7f99dd600640 1 -- 172.21.15.29:0/1242422740 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d80a5980 con 0x7f99e00cb100 2024-01-24T13:03:33.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.241+0000 7f99dd600640 1 -- 172.21.15.29:0/1242422740 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d80a5d10 con 0x7f99e00cb100 2024-01-24T13:03:33.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.241+0000 7f99e5c00640 1 -- 172.21.15.29:0/1242422740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e00cb100 msgr2=0x7f99e00ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:33.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.241+0000 7f99e5c00640 1 --2- 172.21.15.29:0/1242422740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e00cb100 0x7f99e00ce4b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009e50 tx=0x7f99d801c9a0 comp rx=0 tx=0).stop 2024-01-24T13:03:33.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.241+0000 7f99e5c00640 1 -- 172.21.15.29:0/1242422740 shutdown_connections 2024-01-24T13:03:33.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.241+0000 7f99e5c00640 1 --2- 172.21.15.29:0/1242422740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e00cb100 0x7f99e00ce4b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:33.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.241+0000 7f99e5c00640 1 --2- 172.21.15.29:0/1242422740 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99e015a630 0x7f99e00cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:33.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.241+0000 7f99e5c00640 1 -- 172.21.15.29:0/1242422740 >> 172.21.15.29:0/1242422740 conn(0x7f99e0070570 msgr2=0x7f99e0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:33.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.241+0000 7f99e5c00640 1 -- 172.21.15.29:0/1242422740 shutdown_connections 2024-01-24T13:03:33.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.241+0000 7f99e5c00640 1 -- 172.21.15.29:0/1242422740 wait complete. 2024-01-24T13:03:33.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.241+0000 7f99e5c00640 1 Processor -- start 2024-01-24T13:03:33.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.241+0000 7f99e5c00640 1 -- start start 2024-01-24T13:03:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99e5c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e00c3ef0 0x7f99e014e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99e5c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e00cb100 0x7f99e00c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99e5c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99e015a630 0x7f99e015d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99e5c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00c43f0 con 0x7f99e00cb100 2024-01-24T13:03:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99e5c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00c4640 con 0x7f99e00c3ef0 2024-01-24T13:03:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99e5c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00c4920 con 0x7f99e015a630 2024-01-24T13:03:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99de000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e00cb100 0x7f99e00c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99de000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e00cb100 0x7f99e00c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56454/0 (socket says 172.21.15.29:56454) 2024-01-24T13:03:33.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99de000640 1 -- 172.21.15.29:0/4160248801 learned_addr learned my addr 172.21.15.29:0/4160248801 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99df400640 1 --2- 172.21.15.29:0/4160248801 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99e015a630 0x7f99e015d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99de000640 1 -- 172.21.15.29:0/4160248801 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99e015a630 msgr2=0x7f99e015d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99de000640 1 --2- 172.21.15.29:0/4160248801 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99e015a630 0x7f99e015d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99de000640 1 -- 172.21.15.29:0/4160248801 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e00c3ef0 msgr2=0x7f99e014e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99de000640 1 --2- 172.21.15.29:0/4160248801 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e00c3ef0 0x7f99e014e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99de000640 1 -- 172.21.15.29:0/4160248801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d8009b30 con 0x7f99e00cb100 2024-01-24T13:03:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99de000640 1 --2- 172.21.15.29:0/4160248801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e00cb100 0x7f99e00c7470 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f99c800c490 tx=0x7f99c8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99d6a00640 1 -- 172.21.15.29:0/4160248801 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8003600 con 0x7f99e00cb100 2024-01-24T13:03:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99d6a00640 1 -- 172.21.15.29:0/4160248801 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c8003780 con 0x7f99e00cb100 2024-01-24T13:03:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99d6a00640 1 -- 172.21.15.29:0/4160248801 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8003b70 con 0x7f99e00cb100 2024-01-24T13:03:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99e5c00640 1 -- 172.21.15.29:0/4160248801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e00c4c00 con 0x7f99e00cb100 2024-01-24T13:03:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99e5c00640 1 -- 172.21.15.29:0/4160248801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e00c51c0 con 0x7f99e00cb100 2024-01-24T13:03:33.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99d6a00640 1 -- 172.21.15.29:0/4160248801 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f99c8007020 con 0x7f99e00cb100 2024-01-24T13:03:33.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99d6a00640 1 -- 172.21.15.29:0/4160248801 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f99c8006c50 con 0x7f99e00cb100 2024-01-24T13:03:33.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.245+0000 7f99e5c00640 1 -- 172.21.15.29:0/4160248801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e00c53e0 con 0x7f99e00cb100 2024-01-24T13:03:33.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.249+0000 7f99d6a00640 1 -- 172.21.15.29:0/4160248801 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f99c8017070 con 0x7f99e00cb100 2024-01-24T13:03:33.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.349+0000 7f99e5c00640 1 -- 172.21.15.29:0/4160248801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99e004e850 con 0x7f99e00cb100 2024-01-24T13:03:33.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.349+0000 7f99d6a00640 1 -- 172.21.15.29:0/4160248801 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f99c80067a0 con 0x7f99e00cb100 2024-01-24T13:03:33.352 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:03:33.352 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":10,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:03:33.020270+0000","last_up_change":"0.000000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:03:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.353+0000 7f99e5c00640 1 -- 172.21.15.29:0/4160248801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e00cb100 msgr2=0x7f99e00c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.353+0000 7f99e5c00640 1 --2- 172.21.15.29:0/4160248801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e00cb100 0x7f99e00c7470 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f99c800c490 tx=0x7f99c8001e80 comp rx=0 tx=0).stop 2024-01-24T13:03:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.353+0000 7f99e5c00640 1 -- 172.21.15.29:0/4160248801 shutdown_connections 2024-01-24T13:03:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.353+0000 7f99e5c00640 1 --2- 172.21.15.29:0/4160248801 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99e015a630 0x7f99e015d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.353+0000 7f99e5c00640 1 --2- 172.21.15.29:0/4160248801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e00cb100 0x7f99e00c7470 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.353+0000 7f99e5c00640 1 --2- 172.21.15.29:0/4160248801 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e00c3ef0 0x7f99e014e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.353+0000 7f99e5c00640 1 -- 172.21.15.29:0/4160248801 >> 172.21.15.29:0/4160248801 conn(0x7f99e0070570 msgr2=0x7f99e0155400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.353+0000 7f99e5c00640 1 -- 172.21.15.29:0/4160248801 shutdown_connections 2024-01-24T13:03:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:33.353+0000 7f99e5c00640 1 -- 172.21.15.29:0/4160248801 wait complete. 2024-01-24T13:03:33.373 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-24T13:03:33.373 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-24T13:03:33.520 INFO:tasks.ceph.mgr.x.smithi163.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-24T13:03:33.521 INFO:tasks.ceph.mgr.x.smithi163.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-24T13:03:33.521 INFO:tasks.ceph.mgr.x.smithi163.stderr: from numpy import show_config as show_numpy_config 2024-01-24T13:03:33.559 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:33.557+0000 7f37cd44b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-24T13:03:33.677 INFO:tasks.ceph.mgr.y.smithi029.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-24T13:03:33.677 INFO:tasks.ceph.mgr.y.smithi029.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-24T13:03:33.677 INFO:tasks.ceph.mgr.y.smithi029.stderr: from numpy import show_config as show_numpy_config 2024-01-24T13:03:33.694 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:33.693+0000 7f37cd44b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-24T13:03:33.701 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-01-24T13:03:33.701+0000 7f705bfda640 -1 Falling back to public interface 2024-01-24T13:03:33.710 INFO:tasks.ceph.osd.5.smithi163.stderr:2024-01-24T13:03:33.709+0000 7f33bcb09640 -1 Falling back to public interface 2024-01-24T13:03:33.713 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-01-24T13:03:33.713+0000 7f28fce5d640 -1 Falling back to public interface 2024-01-24T13:03:33.718 INFO:tasks.ceph.osd.7.smithi163.stderr:2024-01-24T13:03:33.717+0000 7f07f763d640 -1 Falling back to public interface 2024-01-24T13:03:33.721 INFO:tasks.ceph.osd.4.smithi163.stderr:2024-01-24T13:03:33.721+0000 7fa359e95640 -1 Falling back to public interface 2024-01-24T13:03:33.733 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-01-24T13:03:33.733+0000 7fcb9bd67640 -1 Falling back to public interface 2024-01-24T13:03:33.733 INFO:tasks.ceph.osd.6.smithi163.stderr:2024-01-24T13:03:33.733+0000 7f06e5788640 -1 Falling back to public interface 2024-01-24T13:03:33.736 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-01-24T13:03:33.737+0000 7f17b31ef640 -1 Falling back to public interface 2024-01-24T13:03:33.757 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:33.757+0000 7fe45a655180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-24T13:03:33.874 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:33.873+0000 7f37cd44b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-24T13:03:33.899 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:33.897+0000 7fe45a655180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-24T13:03:33.947 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:33.945+0000 7f37cd44b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-24T13:03:34.087 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:34.085+0000 7f37cd44b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-24T13:03:34.131 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:34.129+0000 7fe45a655180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-24T13:03:34.178 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-24T13:03:34.217 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:34.217+0000 7fe45a655180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-24T13:03:34.309 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe160e00640 1 Processor -- start 2024-01-24T13:03:34.309 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe160e00640 1 -- start start 2024-01-24T13:03:34.311 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe160e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe15c151480 0x7fe15c0ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:34.311 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe160e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe15c15e090 0x7fe15c0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:34.311 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe160e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe15c0ca9f0 0x7fe15c0cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:34.311 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe160e00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15c0cb3c0 con 0x7fe15c151480 2024-01-24T13:03:34.311 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe160e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15c15aa50 con 0x7fe15c15e090 2024-01-24T13:03:34.312 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe160e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0ce6d0 con 0x7fe15c0ca9f0 2024-01-24T13:03:34.312 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe159e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe15c151480 0x7fe15c0ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:34.312 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe159e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe15c151480 0x7fe15c0ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56460/0 (socket says 172.21.15.29:56460) 2024-01-24T13:03:34.312 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe159e00640 1 -- 172.21.15.29:0/1012165824 learned_addr learned my addr 172.21.15.29:0/1012165824 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:34.312 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe159400640 1 --2- 172.21.15.29:0/1012165824 >> v2:172.21.15.163:3300/0 conn(0x7fe15c15e090 0x7fe15c0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:34.312 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe159e00640 1 -- 172.21.15.29:0/1012165824 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe15c0ca9f0 msgr2=0x7fe15c0cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:34.312 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe159e00640 1 --2- 172.21.15.29:0/1012165824 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe15c0ca9f0 0x7fe15c0cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:34.312 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe159e00640 1 -- 172.21.15.29:0/1012165824 >> v2:172.21.15.163:3300/0 conn(0x7fe15c15e090 msgr2=0x7fe15c0cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:34.312 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe159e00640 1 --2- 172.21.15.29:0/1012165824 >> v2:172.21.15.163:3300/0 conn(0x7fe15c15e090 0x7fe15c0cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:34.312 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe159e00640 1 -- 172.21.15.29:0/1012165824 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c15e520 con 0x7fe15c151480 2024-01-24T13:03:34.312 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.309+0000 7fe159400640 1 --2- 172.21.15.29:0/1012165824 >> v2:172.21.15.163:3300/0 conn(0x7fe15c15e090 0x7fe15c0cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:03:34.314 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.313+0000 7fe159e00640 1 --2- 172.21.15.29:0/1012165824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe15c151480 0x7fe15c0ce190 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe15c070150 tx=0x7fe14c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd36194be0c9817 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:34.314 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.313+0000 7fe158a00640 1 -- 172.21.15.29:0/1012165824 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0aa620 con 0x7fe15c151480 2024-01-24T13:03:34.314 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.313+0000 7fe158a00640 1 -- 172.21.15.29:0/1012165824 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c0aa780 con 0x7fe15c151480 2024-01-24T13:03:34.314 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.313+0000 7fe158a00640 1 -- 172.21.15.29:0/1012165824 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0aab10 con 0x7fe15c151480 2024-01-24T13:03:34.315 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.313+0000 7fe160e00640 1 -- 172.21.15.29:0/1012165824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe15c151480 msgr2=0x7fe15c0ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:34.315 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.313+0000 7fe160e00640 1 --2- 172.21.15.29:0/1012165824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe15c151480 0x7fe15c0ce190 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe15c070150 tx=0x7fe14c01c500 comp rx=0 tx=0).stop 2024-01-24T13:03:34.315 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.313+0000 7fe160e00640 1 -- 172.21.15.29:0/1012165824 shutdown_connections 2024-01-24T13:03:34.315 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.313+0000 7fe160e00640 1 --2- 172.21.15.29:0/1012165824 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe15c0ca9f0 0x7fe15c0cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:34.316 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.313+0000 7fe160e00640 1 --2- 172.21.15.29:0/1012165824 >> v2:172.21.15.163:3300/0 conn(0x7fe15c15e090 0x7fe15c0cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:34.316 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.313+0000 7fe160e00640 1 --2- 172.21.15.29:0/1012165824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe15c151480 0x7fe15c0ce190 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:34.316 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.313+0000 7fe160e00640 1 -- 172.21.15.29:0/1012165824 >> 172.21.15.29:0/1012165824 conn(0x7fe15c06e070 msgr2=0x7fe15c06e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:34.316 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.313+0000 7fe160e00640 1 -- 172.21.15.29:0/1012165824 shutdown_connections 2024-01-24T13:03:34.316 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.313+0000 7fe160e00640 1 -- 172.21.15.29:0/1012165824 wait complete. 2024-01-24T13:03:34.317 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe160e00640 1 Processor -- start 2024-01-24T13:03:34.317 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe160e00640 1 -- start start 2024-01-24T13:03:34.318 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe160e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe15c0ca9f0 0x7fe15c14f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:34.319 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe160e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe15c151480 0x7fe15c146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:34.319 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe160e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe15c1503e0 0x7fe15c150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:34.319 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe160e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c150db0 con 0x7fe15c1503e0 2024-01-24T13:03:34.319 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe160e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c14f030 con 0x7fe15c0ca9f0 2024-01-24T13:03:34.319 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe160e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c152a80 con 0x7fe15c151480 2024-01-24T13:03:34.319 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe15a800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe15c1503e0 0x7fe15c150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:34.319 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe159e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe15c0ca9f0 0x7fe15c14f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:34.319 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe159400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe15c151480 0x7fe15c146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:34.319 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe15a800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe15c1503e0 0x7fe15c150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56462/0 (socket says 172.21.15.29:56462) 2024-01-24T13:03:34.319 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe15a800640 1 -- 172.21.15.29:0/2677187878 learned_addr learned my addr 172.21.15.29:0/2677187878 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:34.320 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe159e00640 1 -- 172.21.15.29:0/2677187878 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe15c151480 msgr2=0x7fe15c146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:34.321 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe159e00640 1 --2- 172.21.15.29:0/2677187878 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe15c151480 0x7fe15c146890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:34.321 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe159e00640 1 -- 172.21.15.29:0/2677187878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe15c1503e0 msgr2=0x7fe15c150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:34.321 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe159e00640 1 --2- 172.21.15.29:0/2677187878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe15c1503e0 0x7fe15c150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:34.321 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe159e00640 1 -- 172.21.15.29:0/2677187878 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0094d0 con 0x7fe15c0ca9f0 2024-01-24T13:03:34.321 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe15a800640 1 --2- 172.21.15.29:0/2677187878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe15c1503e0 0x7fe15c150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:34.321 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.317+0000 7fe159e00640 1 --2- 172.21.15.29:0/2677187878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe15c0ca9f0 0x7fe15c14f4c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0ab000 tx=0x7fe14c01ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:34.321 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.321+0000 7fe152000640 1 -- 172.21.15.29:0/2677187878 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0bd3f0 con 0x7fe15c0ca9f0 2024-01-24T13:03:34.321 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.321+0000 7fe152000640 1 -- 172.21.15.29:0/2677187878 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c0bd570 con 0x7fe15c0ca9f0 2024-01-24T13:03:34.321 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.321+0000 7fe152000640 1 -- 172.21.15.29:0/2677187878 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0bd920 con 0x7fe15c0ca9f0 2024-01-24T13:03:34.321 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.321+0000 7fe160e00640 1 -- 172.21.15.29:0/2677187878 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15c14e9e0 con 0x7fe15c0ca9f0 2024-01-24T13:03:34.321 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.321+0000 7fe160e00640 1 -- 172.21.15.29:0/2677187878 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15c14fa00 con 0x7fe15c0ca9f0 2024-01-24T13:03:34.321 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.321+0000 7fe152000640 1 -- 172.21.15.29:0/2677187878 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe14c0b33f0 con 0x7fe15c0ca9f0 2024-01-24T13:03:34.321 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.321+0000 7fe152000640 1 -- 172.21.15.29:0/2677187878 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe14c0bdd80 con 0x7fe15c0ca9f0 2024-01-24T13:03:34.322 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.321+0000 7fe160e00640 1 -- 172.21.15.29:0/2677187878 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15c073270 con 0x7fe15c0ca9f0 2024-01-24T13:03:34.324 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.325+0000 7fe152000640 1 -- 172.21.15.29:0/2677187878 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fe14c0c3060 con 0x7fe15c0ca9f0 2024-01-24T13:03:34.366 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:34.365+0000 7fe45a655180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-24T13:03:34.382 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.381+0000 7fe160e00640 1 -- 172.21.15.29:0/2677187878 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe15c14e840 con 0x7fe15c0ca9f0 2024-01-24T13:03:34.383 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.381+0000 7fe152000640 1 -- 172.21.15.29:0/2677187878 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe15c14e840 con 0x7fe15c0ca9f0 2024-01-24T13:03:34.383 INFO:teuthology.misc.health.smithi029.stdout: 2024-01-24T13:03:34.383 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":10,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:03:33.020270+0000","last_up_change":"0.000000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:03:34.384 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.385+0000 7fe160e00640 1 -- 172.21.15.29:0/2677187878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe15c0ca9f0 msgr2=0x7fe15c14f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:34.385 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.385+0000 7fe160e00640 1 --2- 172.21.15.29:0/2677187878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe15c0ca9f0 0x7fe15c14f4c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0ab000 tx=0x7fe14c01ad40 comp rx=0 tx=0).stop 2024-01-24T13:03:34.385 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.385+0000 7fe160e00640 1 -- 172.21.15.29:0/2677187878 shutdown_connections 2024-01-24T13:03:34.385 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.385+0000 7fe160e00640 1 --2- 172.21.15.29:0/2677187878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe15c1503e0 0x7fe15c150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:34.385 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.385+0000 7fe160e00640 1 --2- 172.21.15.29:0/2677187878 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe15c151480 0x7fe15c146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:34.385 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.385+0000 7fe160e00640 1 --2- 172.21.15.29:0/2677187878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe15c0ca9f0 0x7fe15c14f4c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:34.385 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.385+0000 7fe160e00640 1 -- 172.21.15.29:0/2677187878 >> 172.21.15.29:0/2677187878 conn(0x7fe15c06e070 msgr2=0x7fe15c15bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:34.385 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.385+0000 7fe160e00640 1 -- 172.21.15.29:0/2677187878 shutdown_connections 2024-01-24T13:03:34.385 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:34.385+0000 7fe160e00640 1 -- 172.21.15.29:0/2677187878 wait complete. 2024-01-24T13:03:34.402 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-24T13:03:34.757 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:34.756+0000 7f37cd44b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-24T13:03:34.843 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:34.840+0000 7f37cd44b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-24T13:03:35.034 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:35.032+0000 7f37cd44b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-24T13:03:35.078 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:35.077+0000 7fe45a655180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-24T13:03:35.118 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:35.116+0000 7f37cd44b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-24T13:03:35.170 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:35.169+0000 7fe45a655180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-24T13:03:35.377 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:35.377+0000 7fe45a655180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-24T13:03:35.446 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:35.444+0000 7f37cd44b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-24T13:03:35.466 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:35.465+0000 7fe45a655180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-24T13:03:35.515 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:35.512+0000 7f37cd44b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-24T13:03:35.812 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:35.813+0000 7fe45a655180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-24T13:03:35.883 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-24T13:03:35.881+0000 7fe45a655180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-24T13:03:36.540 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:36.536+0000 7f3772e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-24T13:03:36.541 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-01-24T13:03:36.536+0000 7f3772e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-24T13:03:37.494 INFO:tasks.ceph.osd.5.smithi163.stderr:2024-01-24T13:03:37.492+0000 7f33bcb09640 -1 osd.5 0 log_to_monitors true 2024-01-24T13:03:37.532 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-01-24T13:03:37.533+0000 7f705bfda640 -1 osd.3 0 log_to_monitors true 2024-01-24T13:03:37.593 INFO:tasks.ceph.osd.7.smithi163.stderr:2024-01-24T13:03:37.592+0000 7f07f763d640 -1 osd.7 0 log_to_monitors true 2024-01-24T13:03:37.604 INFO:tasks.ceph.osd.6.smithi163.stderr:2024-01-24T13:03:37.600+0000 7f06e5788640 -1 osd.6 0 log_to_monitors true 2024-01-24T13:03:37.678 INFO:tasks.ceph.osd.4.smithi163.stderr:2024-01-24T13:03:37.676+0000 7fa359e95640 -1 osd.4 0 log_to_monitors true 2024-01-24T13:03:37.701 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-01-24T13:03:37.701+0000 7fcb9bd67640 -1 osd.2 0 log_to_monitors true 2024-01-24T13:03:37.717 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-01-24T13:03:37.717+0000 7f17b31ef640 -1 osd.1 0 log_to_monitors true 2024-01-24T13:03:37.728 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-01-24T13:03:37.729+0000 7f28fce5d640 -1 osd.0 0 log_to_monitors true 2024-01-24T13:03:39.510 INFO:tasks.ceph.osd.5.smithi163.stderr:2024-01-24T13:03:39.508+0000 7f33b8400640 -1 osd.5 0 waiting for initial osdmap 2024-01-24T13:03:39.533 INFO:tasks.ceph.osd.5.smithi163.stderr:2024-01-24T13:03:39.532+0000 7f33ada00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T13:03:41.209 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-24T13:03:41.362 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-01-24T13:03:41.361+0000 7f7056e00640 -1 osd.3 0 waiting for initial osdmap 2024-01-24T13:03:41.384 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-01-24T13:03:41.385+0000 7f17ae000640 -1 osd.1 0 waiting for initial osdmap 2024-01-24T13:03:41.408 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f704ce00640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T13:03:41.409 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f2125400640 1 Processor -- start 2024-01-24T13:03:41.409 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f2125400640 1 -- start start 2024-01-24T13:03:41.410 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f2125400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f212015e090 0x7f21200cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:41.411 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f2125400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212015aa50 con 0x7f21200ca9f0 2024-01-24T13:03:41.411 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f2125400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212015e520 con 0x7f2120151480 2024-01-24T13:03:41.411 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f2125400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212015e800 con 0x7f212015e090 2024-01-24T13:03:41.411 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f211f200640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f21200ca9f0 0x7f212015aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37816/0 (socket says 172.21.15.29:37816) 2024-01-24T13:03:41.412 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f211f200640 1 -- 172.21.15.29:0/3814641357 learned_addr learned my addr 172.21.15.29:0/3814641357 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:03:41.412 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f211de00640 1 --2- 172.21.15.29:0/3814641357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f212015e090 0x7f21200cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:41.412 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f211d400640 1 -- 172.21.15.29:0/3814641357 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433487633 0 0) 0x7f21180014a0 con 0x7f21200ca9f0 2024-01-24T13:03:41.412 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f211d400640 1 -- 172.21.15.29:0/3814641357 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2100003530 con 0x7f21200ca9f0 2024-01-24T13:03:41.412 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f211de00640 1 -- 172.21.15.29:0/3814641357 >> v1:172.21.15.163:6789/0 conn(0x7f2120151480 legacy=0x7f21200ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:41.412 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f211de00640 1 -- 172.21.15.29:0/3814641357 >> v1:172.21.15.29:6789/0 conn(0x7f21200ca9f0 legacy=0x7f212015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:41.412 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.409+0000 7f211de00640 1 -- 172.21.15.29:0/3814641357 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212015eae0 con 0x7f212015e090 2024-01-24T13:03:41.415 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.413+0000 7f211de00640 1 --2- 172.21.15.29:0/3814641357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f212015e090 0x7f21200cfaa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f21080097f0 tx=0x7f210801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db331457002fd77b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:41.415 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.413+0000 7f211d400640 1 -- 172.21.15.29:0/3814641357 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080aa620 con 0x7f212015e090 2024-01-24T13:03:41.415 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.413+0000 7f211d400640 1 -- 172.21.15.29:0/3814641357 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21080aa780 con 0x7f212015e090 2024-01-24T13:03:41.415 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.413+0000 7f211d400640 1 -- 172.21.15.29:0/3814641357 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080aab10 con 0x7f212015e090 2024-01-24T13:03:41.416 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.413+0000 7f2125400640 1 -- 172.21.15.29:0/3814641357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f212015e090 msgr2=0x7f21200cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:41.416 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.413+0000 7f2125400640 1 --2- 172.21.15.29:0/3814641357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f212015e090 0x7f21200cfaa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f21080097f0 tx=0x7f210801c4e0 comp rx=0 tx=0).stop 2024-01-24T13:03:41.416 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f2125400640 1 -- 172.21.15.29:0/3814641357 shutdown_connections 2024-01-24T13:03:41.416 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f2125400640 1 --2- 172.21.15.29:0/3814641357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f212015e090 0x7f21200cfaa0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:41.416 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f2125400640 1 -- 172.21.15.29:0/3814641357 >> 172.21.15.29:0/3814641357 conn(0x7f212006e070 msgr2=0x7f212006e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:41.416 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f2125400640 1 -- 172.21.15.29:0/3814641357 shutdown_connections 2024-01-24T13:03:41.417 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f2125400640 1 -- 172.21.15.29:0/3814641357 wait complete. 2024-01-24T13:03:41.418 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f2125400640 1 Processor -- start 2024-01-24T13:03:41.418 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f2125400640 1 -- start start 2024-01-24T13:03:41.419 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f2125400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21200ca9f0 0x7f2120154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:41.420 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f2125400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2120151480 0x7f21200b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:41.420 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f2125400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21200b5a70 0x7f212006b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:41.420 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f2125400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2120154c90 con 0x7f21200b5a70 2024-01-24T13:03:41.420 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f2125400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2120153dc0 con 0x7f21200ca9f0 2024-01-24T13:03:41.420 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f2125400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21200b1e60 con 0x7f2120151480 2024-01-24T13:03:41.420 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f211e800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21200ca9f0 0x7f2120154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:41.420 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f211e800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21200ca9f0 0x7f2120154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:55792/0 (socket says 172.21.15.29:55792) 2024-01-24T13:03:41.421 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f211e800640 1 -- 172.21.15.29:0/3274480090 learned_addr learned my addr 172.21.15.29:0/3274480090 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:41.421 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f211de00640 1 --2- 172.21.15.29:0/3274480090 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2120151480 0x7f21200b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:41.421 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.417+0000 7f211f200640 1 --2- 172.21.15.29:0/3274480090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21200b5a70 0x7f212006b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:41.422 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.421+0000 7f211de00640 1 -- 172.21.15.29:0/3274480090 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21200ca9f0 msgr2=0x7f2120154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:41.422 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.421+0000 7f211de00640 1 --2- 172.21.15.29:0/3274480090 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21200ca9f0 0x7f2120154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:41.422 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.421+0000 7f211de00640 1 -- 172.21.15.29:0/3274480090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21200b5a70 msgr2=0x7f212006b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:41.422 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.421+0000 7f211de00640 1 --2- 172.21.15.29:0/3274480090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21200b5a70 0x7f212006b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:41.422 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.421+0000 7f211de00640 1 -- 172.21.15.29:0/3274480090 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108009420 con 0x7f2120151480 2024-01-24T13:03:41.422 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.421+0000 7f211de00640 1 --2- 172.21.15.29:0/3274480090 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2120151480 0x7f21200b5530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f21080ab000 tx=0x7f210801ad20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:41.422 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.421+0000 7f2116a00640 1 -- 172.21.15.29:0/3274480090 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080aadc0 con 0x7f2120151480 2024-01-24T13:03:41.422 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.421+0000 7f2116a00640 1 -- 172.21.15.29:0/3274480090 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21080be410 con 0x7f2120151480 2024-01-24T13:03:41.422 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.421+0000 7f2116a00640 1 -- 172.21.15.29:0/3274480090 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080be7c0 con 0x7f2120151480 2024-01-24T13:03:41.422 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.421+0000 7f2125400640 1 -- 172.21.15.29:0/3274480090 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21200b2420 con 0x7f2120151480 2024-01-24T13:03:41.423 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.421+0000 7f2125400640 1 -- 172.21.15.29:0/3274480090 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21201542f0 con 0x7f2120151480 2024-01-24T13:03:41.423 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.421+0000 7f2125400640 1 -- 172.21.15.29:0/3274480090 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2120073270 con 0x7f2120151480 2024-01-24T13:03:41.424 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.421+0000 7f2116a00640 1 -- 172.21.15.29:0/3274480090 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 4) v1 ==== 85172+0+0 (secure 0 0 0) 0x7f21080be920 con 0x7f2120151480 2024-01-24T13:03:41.424 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-01-24T13:03:41.425+0000 7f17a4000640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T13:03:41.425 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.425+0000 7f2116a00640 1 --2- 172.21.15.29:0/3274480090 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f20f8065a50 0x7f20f8067f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:41.425 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.425+0000 7f2116a00640 1 -- 172.21.15.29:0/3274480090 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f210811ca50 con 0x7f2120151480 2024-01-24T13:03:41.425 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.425+0000 7f211e800640 1 --2- 172.21.15.29:0/3274480090 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f20f8065a50 0x7f20f8067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:41.426 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.425+0000 7f211e800640 1 --2- 172.21.15.29:0/3274480090 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f20f8065a50 0x7f20f8067f10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f21100018b0 tx=0x7f2110009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:41.430 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.429+0000 7f2116a00640 1 -- 172.21.15.29:0/3274480090 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f21080eb200 con 0x7f2120151480 2024-01-24T13:03:41.435 INFO:tasks.ceph.osd.4.smithi163.stderr:2024-01-24T13:03:41.432+0000 7fa355800640 -1 osd.4 0 waiting for initial osdmap 2024-01-24T13:03:41.445 INFO:tasks.ceph.osd.7.smithi163.stderr:2024-01-24T13:03:41.440+0000 7f07f2600640 -1 osd.7 0 waiting for initial osdmap 2024-01-24T13:03:41.471 INFO:tasks.ceph.osd.6.smithi163.stderr:2024-01-24T13:03:41.468+0000 7f06e0600640 -1 osd.6 0 waiting for initial osdmap 2024-01-24T13:03:41.477 INFO:tasks.ceph.osd.7.smithi163.stderr:2024-01-24T13:03:41.476+0000 7f07e8600640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T13:03:41.477 INFO:tasks.ceph.osd.4.smithi163.stderr:2024-01-24T13:03:41.476+0000 7fa34ae00640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T13:03:41.489 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-01-24T13:03:41.489+0000 7fcb96c00640 -1 osd.2 0 waiting for initial osdmap 2024-01-24T13:03:41.497 INFO:tasks.ceph.osd.6.smithi163.stderr:2024-01-24T13:03:41.496+0000 7f06d6600640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T13:03:41.500 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-01-24T13:03:41.501+0000 7f28f7e00640 -1 osd.0 0 waiting for initial osdmap 2024-01-24T13:03:41.520 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-01-24T13:03:41.521+0000 7fcb8cc00640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T13:03:41.536 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-01-24T13:03:41.537+0000 7f28ede00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T13:03:41.598 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.597+0000 7f2125400640 1 -- 172.21.15.29:0/3274480090 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21200b25b0 con 0x7f2120151480 2024-01-24T13:03:41.599 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.597+0000 7f2116a00640 1 -- 172.21.15.29:0/3274480090 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7529 (secure 0 0 0) 0x7f21080ee820 con 0x7f2120151480 2024-01-24T13:03:41.599 INFO:teuthology.misc.health.smithi029.stdout: 2024-01-24T13:03:41.599 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":14,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:03:41.376054+0000","last_up_change":"2024-01-24T13:03:39.547207+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:03:41.601 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.601+0000 7f2125400640 1 -- 172.21.15.29:0/3274480090 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f20f8065a50 msgr2=0x7f20f8067f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:41.601 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.601+0000 7f2125400640 1 --2- 172.21.15.29:0/3274480090 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f20f8065a50 0x7f20f8067f10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f21100018b0 tx=0x7f2110009040 comp rx=0 tx=0).stop 2024-01-24T13:03:41.601 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.601+0000 7f2125400640 1 -- 172.21.15.29:0/3274480090 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2120151480 msgr2=0x7f21200b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:41.601 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.601+0000 7f2125400640 1 --2- 172.21.15.29:0/3274480090 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2120151480 0x7f21200b5530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f21080ab000 tx=0x7f210801ad20 comp rx=0 tx=0).stop 2024-01-24T13:03:41.601 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.601+0000 7f2125400640 1 -- 172.21.15.29:0/3274480090 shutdown_connections 2024-01-24T13:03:41.601 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.601+0000 7f2125400640 1 --2- 172.21.15.29:0/3274480090 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f20f8065a50 0x7f20f8067f10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:41.602 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.601+0000 7f2125400640 1 --2- 172.21.15.29:0/3274480090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21200b5a70 0x7f212006b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:41.602 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.601+0000 7f2125400640 1 --2- 172.21.15.29:0/3274480090 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2120151480 0x7f21200b5530 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:41.602 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.601+0000 7f2125400640 1 --2- 172.21.15.29:0/3274480090 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21200ca9f0 0x7f2120154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:41.602 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.601+0000 7f2125400640 1 -- 172.21.15.29:0/3274480090 >> 172.21.15.29:0/3274480090 conn(0x7f212006e070 msgr2=0x7f21200cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:41.602 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.601+0000 7f2125400640 1 -- 172.21.15.29:0/3274480090 shutdown_connections 2024-01-24T13:03:41.602 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:41.601+0000 7f2125400640 1 -- 172.21.15.29:0/3274480090 wait complete. 2024-01-24T13:03:41.618 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-01-24T13:03:48.425 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-24T13:03:48.573 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7adee00640 1 Processor -- start 2024-01-24T13:03:48.573 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7adee00640 1 -- start start 2024-01-24T13:03:48.573 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7adee00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ad815c8b0 0x7f7ad80b2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:48.574 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7adee00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7ad80b2c20 0x7f7ad80b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:48.574 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7adee00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad815cc90 con 0x7f7ad80b0d60 2024-01-24T13:03:48.574 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7adee00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad80b35a0 con 0x7f7ad80b2c20 2024-01-24T13:03:48.574 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7adee00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8161260 con 0x7f7ad815c8b0 2024-01-24T13:03:48.574 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7ad7e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ad815c8b0 0x7f7ad80b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:48.574 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7ad7400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7ad80b2c20 0x7f7ad80b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:48.574 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7ad7400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7ad80b2c20 0x7f7ad80b3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:55794/0 (socket says 172.21.15.29:55794) 2024-01-24T13:03:48.574 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7ad7400640 1 -- 172.21.15.29:0/3062737760 learned_addr learned my addr 172.21.15.29:0/3062737760 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:48.574 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7ad7e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ad815c8b0 0x7f7ad80b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:37746/0 (socket says 172.21.15.29:37746) 2024-01-24T13:03:48.574 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7adce00640 1 --1- 172.21.15.29:0/3062737760 >> v1:172.21.15.163:6789/0 conn(0x7f7ad80b0d60 0x7f7ad80b11b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:39022/0 (socket says 172.21.15.29:39022) 2024-01-24T13:03:48.574 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7ad7e00640 1 -- 172.21.15.29:0/3062737760 >> v2:172.21.15.163:3300/0 conn(0x7f7ad80b2c20 msgr2=0x7f7ad80b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:48.574 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7ad7e00640 1 --2- 172.21.15.29:0/3062737760 >> v2:172.21.15.163:3300/0 conn(0x7f7ad80b2c20 0x7f7ad80b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:48.574 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7ad7e00640 1 -- 172.21.15.29:0/3062737760 >> v1:172.21.15.163:6789/0 conn(0x7f7ad80b0d60 legacy=0x7f7ad80b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:48.574 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7ad7e00640 1 -- 172.21.15.29:0/3062737760 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad8072090 con 0x7f7ad815c8b0 2024-01-24T13:03:48.575 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7ad6a00640 1 -- 172.21.15.29:0/3062737760 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144842580 0 0) 0x7f7ad815cc90 con 0x7f7ad80b0d60 2024-01-24T13:03:48.575 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.568+0000 7f7ad7400640 1 --2- 172.21.15.29:0/3062737760 >> v2:172.21.15.163:3300/0 conn(0x7f7ad80b2c20 0x7f7ad80b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:48.575 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.572+0000 7f7ad7e00640 1 --2- 172.21.15.29:0/3062737760 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ad815c8b0 0x7f7ad80b2440 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80097a0 tx=0x7f7ac801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c425ef4e1c6f703c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:48.576 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.572+0000 7f7ad6a00640 1 -- 172.21.15.29:0/3062737760 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8004230 con 0x7f7ad815c8b0 2024-01-24T13:03:48.576 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.572+0000 7f7ad6a00640 1 -- 172.21.15.29:0/3062737760 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac80a7050 con 0x7f7ad815c8b0 2024-01-24T13:03:48.576 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.572+0000 7f7ad6a00640 1 -- 172.21.15.29:0/3062737760 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8003620 con 0x7f7ad815c8b0 2024-01-24T13:03:48.576 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.572+0000 7f7adee00640 1 -- 172.21.15.29:0/3062737760 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ad815c8b0 msgr2=0x7f7ad80b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:48.576 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.572+0000 7f7adee00640 1 --2- 172.21.15.29:0/3062737760 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ad815c8b0 0x7f7ad80b2440 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80097a0 tx=0x7f7ac801c460 comp rx=0 tx=0).stop 2024-01-24T13:03:48.576 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.572+0000 7f7adee00640 1 -- 172.21.15.29:0/3062737760 shutdown_connections 2024-01-24T13:03:48.576 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.572+0000 7f7adee00640 1 --2- 172.21.15.29:0/3062737760 >> v2:172.21.15.163:3300/0 conn(0x7f7ad80b2c20 0x7f7ad80b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:48.576 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.572+0000 7f7adee00640 1 --2- 172.21.15.29:0/3062737760 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ad815c8b0 0x7f7ad80b2440 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:48.576 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.572+0000 7f7adee00640 1 -- 172.21.15.29:0/3062737760 >> 172.21.15.29:0/3062737760 conn(0x7f7ad80cbd60 msgr2=0x7f7ad80cc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:48.576 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.572+0000 7f7adee00640 1 -- 172.21.15.29:0/3062737760 shutdown_connections 2024-01-24T13:03:48.576 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.572+0000 7f7adee00640 1 -- 172.21.15.29:0/3062737760 wait complete. 2024-01-24T13:03:48.578 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7adee00640 1 Processor -- start 2024-01-24T13:03:48.578 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7adee00640 1 -- start start 2024-01-24T13:03:48.578 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7adee00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ad80b0d60 0x7f7ad8157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:48.578 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7adee00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad80b2c20 0x7f7ad815ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:48.578 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7adee00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ad815c8b0 0x7f7ad80c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:48.578 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7adee00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad81596d0 con 0x7f7ad80b2c20 2024-01-24T13:03:48.578 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7adee00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8158030 con 0x7f7ad815c8b0 2024-01-24T13:03:48.578 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7adee00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad815f550 con 0x7f7ad80b0d60 2024-01-24T13:03:48.578 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7ad7400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad80b2c20 0x7f7ad815ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:48.578 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7ad7400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad80b2c20 0x7f7ad815ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46826/0 (socket says 172.21.15.29:46826) 2024-01-24T13:03:48.578 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7adce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ad815c8b0 0x7f7ad80c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:48.579 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7ad7400640 1 -- 172.21.15.29:0/4125902494 learned_addr learned my addr 172.21.15.29:0/4125902494 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:48.579 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7ad7e00640 1 --2- 172.21.15.29:0/4125902494 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ad80b0d60 0x7f7ad8157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:48.580 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7ad7400640 1 -- 172.21.15.29:0/4125902494 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ad80b0d60 msgr2=0x7f7ad8157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:48.580 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7ad7400640 1 --2- 172.21.15.29:0/4125902494 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ad80b0d60 0x7f7ad8157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:48.581 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7ad7400640 1 -- 172.21.15.29:0/4125902494 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ad815c8b0 msgr2=0x7f7ad80c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:48.581 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7ad7400640 1 --2- 172.21.15.29:0/4125902494 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ad815c8b0 0x7f7ad80c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:48.581 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7ad7400640 1 -- 172.21.15.29:0/4125902494 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac00094d0 con 0x7f7ad80b2c20 2024-01-24T13:03:48.581 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7ad7400640 1 --2- 172.21.15.29:0/4125902494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad80b2c20 0x7f7ad815ed20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000e930 tx=0x7f7ac000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:48.581 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7acfe00640 1 -- 172.21.15.29:0/4125902494 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000ca00 con 0x7f7ad80b2c20 2024-01-24T13:03:48.581 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7acfe00640 1 -- 172.21.15.29:0/4125902494 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac000cb60 con 0x7f7ad80b2c20 2024-01-24T13:03:48.581 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7acfe00640 1 -- 172.21.15.29:0/4125902494 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0013470 con 0x7f7ad80b2c20 2024-01-24T13:03:48.581 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7adee00640 1 -- 172.21.15.29:0/4125902494 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac80093b0 con 0x7f7ad80b2c20 2024-01-24T13:03:48.581 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.576+0000 7f7adee00640 1 -- 172.21.15.29:0/4125902494 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad815fb10 con 0x7f7ad80b2c20 2024-01-24T13:03:48.581 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.580+0000 7f7adee00640 1 -- 172.21.15.29:0/4125902494 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad804e070 con 0x7f7ad80b2c20 2024-01-24T13:03:48.582 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.580+0000 7f7acfe00640 1 -- 172.21.15.29:0/4125902494 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7ac00135d0 con 0x7f7ad80b2c20 2024-01-24T13:03:48.582 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.580+0000 7f7acfe00640 1 --2- 172.21.15.29:0/4125902494 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ab0065a60 0x7f7ab0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:48.582 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.580+0000 7f7acfe00640 1 -- 172.21.15.29:0/4125902494 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7ac00830b0 con 0x7f7ad80b2c20 2024-01-24T13:03:48.583 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.580+0000 7f7ad7e00640 1 --2- 172.21.15.29:0/4125902494 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ab0065a60 0x7f7ab0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:48.583 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.580+0000 7f7ad7e00640 1 --2- 172.21.15.29:0/4125902494 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ab0065a60 0x7f7ab0067f20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80ad000 tx=0x7f7ac80a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:48.587 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.584+0000 7f7acfe00640 1 -- 172.21.15.29:0/4125902494 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7ac0050dd0 con 0x7f7ad80b2c20 2024-01-24T13:03:48.746 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.744+0000 7f7adee00640 1 -- 172.21.15.29:0/4125902494 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ad80cb730 con 0x7f7ad80b2c20 2024-01-24T13:03:48.747 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.744+0000 7f7acfe00640 1 -- 172.21.15.29:0/4125902494 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f7ac00543f0 con 0x7f7ad80b2c20 2024-01-24T13:03:48.747 INFO:teuthology.misc.health.smithi029.stdout: 2024-01-24T13:03:48.747 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":19,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:03:46.523205+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:03:48.749 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.748+0000 7f7adee00640 1 -- 172.21.15.29:0/4125902494 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ab0065a60 msgr2=0x7f7ab0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:48.749 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.748+0000 7f7adee00640 1 --2- 172.21.15.29:0/4125902494 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ab0065a60 0x7f7ab0067f20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80ad000 tx=0x7f7ac80a6000 comp rx=0 tx=0).stop 2024-01-24T13:03:48.749 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.748+0000 7f7adee00640 1 -- 172.21.15.29:0/4125902494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad80b2c20 msgr2=0x7f7ad815ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:48.749 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.748+0000 7f7adee00640 1 --2- 172.21.15.29:0/4125902494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad80b2c20 0x7f7ad815ed20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000e930 tx=0x7f7ac000edf0 comp rx=0 tx=0).stop 2024-01-24T13:03:48.749 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.748+0000 7f7adee00640 1 -- 172.21.15.29:0/4125902494 shutdown_connections 2024-01-24T13:03:48.750 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.748+0000 7f7adee00640 1 --2- 172.21.15.29:0/4125902494 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ab0065a60 0x7f7ab0067f20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:48.750 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.748+0000 7f7adee00640 1 --2- 172.21.15.29:0/4125902494 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ad815c8b0 0x7f7ad80c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:48.750 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.748+0000 7f7adee00640 1 --2- 172.21.15.29:0/4125902494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad80b2c20 0x7f7ad815ed20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:48.750 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.748+0000 7f7adee00640 1 --2- 172.21.15.29:0/4125902494 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ad80b0d60 0x7f7ad8157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:48.750 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.748+0000 7f7adee00640 1 -- 172.21.15.29:0/4125902494 >> 172.21.15.29:0/4125902494 conn(0x7f7ad80cbd60 msgr2=0x7f7ad81582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:48.750 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.748+0000 7f7adee00640 1 -- 172.21.15.29:0/4125902494 shutdown_connections 2024-01-24T13:03:48.750 INFO:teuthology.misc.health.smithi029.stderr:2024-01-24T13:03:48.748+0000 7f7adee00640 1 -- 172.21.15.29:0/4125902494 wait complete. 2024-01-24T13:03:48.767 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-24T13:03:48.767 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-24T13:03:48.767 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-24T13:03:48.767 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-24T13:03:48.771 INFO:tasks.ceph.mds.a:Started 2024-01-24T13:03:48.771 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-24T13:03:48.771 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-24T13:03:48.774 INFO:tasks.ceph.mds.c:Started 2024-01-24T13:03:48.774 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-24T13:03:48.774 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-24T13:03:48.778 INFO:tasks.ceph.mds.b:Started 2024-01-24T13:03:48.778 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-24T13:03:48.778 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-24T13:03:48.781 INFO:tasks.ceph.mds.d:Started 2024-01-24T13:03:48.781 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-24T13:03:48.782 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:03:48.875 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-01-24T13:03:48.876 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2024-01-24T13:03:48.879 INFO:tasks.ceph.mds.d.smithi163.stdout:starting mds.d at 2024-01-24T13:03:48.879 INFO:tasks.ceph.mds.b.smithi163.stdout:starting mds.b at 2024-01-24T13:03:48.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.924+0000 7f4f2dc00640 1 Processor -- start 2024-01-24T13:03:48.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.924+0000 7f4f2dc00640 1 -- start start 2024-01-24T13:03:48.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.924+0000 7f4f2dc00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f28165790 0x7f4f28167b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:48.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.924+0000 7f4f2dc00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2806bdf0 con 0x7f4f2815d130 2024-01-24T13:03:48.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.924+0000 7f4f2dc00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f280d0bf0 con 0x7f4f280ccdb0 2024-01-24T13:03:48.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.924+0000 7f4f2dc00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f280cec60 con 0x7f4f28165790 2024-01-24T13:03:48.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.928+0000 7f4f27400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f28165790 0x7f4f28167b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:48.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.928+0000 7f4f27400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f28165790 0x7f4f28167b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46876/0 (socket says 172.21.15.29:46876) 2024-01-24T13:03:48.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.928+0000 7f4f27400640 1 -- 172.21.15.29:0/4137914675 learned_addr learned my addr 172.21.15.29:0/4137914675 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:48.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.928+0000 7f4f27400640 1 -- 172.21.15.29:0/4137914675 >> v1:172.21.15.163:6789/0 conn(0x7f4f280ccdb0 legacy=0x7f4f280cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:48.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.928+0000 7f4f27400640 1 -- 172.21.15.29:0/4137914675 >> v1:172.21.15.29:6789/0 conn(0x7f4f2815d130 legacy=0x7f4f2815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:48.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.928+0000 7f4f27400640 1 -- 172.21.15.29:0/4137914675 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280d0040 con 0x7f4f28165790 2024-01-24T13:03:48.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.928+0000 7f4f27400640 1 --2- 172.21.15.29:0/4137914675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f28165790 0x7f4f28167b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009e50 tx=0x7f4f2001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40914d9784b63d1f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:48.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.928+0000 7f4f25600640 1 -- 172.21.15.29:0/4137914675 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f200a5660 con 0x7f4f28165790 2024-01-24T13:03:48.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.928+0000 7f4f25600640 1 -- 172.21.15.29:0/4137914675 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f200a57c0 con 0x7f4f28165790 2024-01-24T13:03:48.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.928+0000 7f4f25600640 1 -- 172.21.15.29:0/4137914675 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f200a5b50 con 0x7f4f28165790 2024-01-24T13:03:48.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 -- 172.21.15.29:0/4137914675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f28165790 msgr2=0x7f4f28167b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:48.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 --2- 172.21.15.29:0/4137914675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f28165790 0x7f4f28167b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009e50 tx=0x7f4f2001c8b0 comp rx=0 tx=0).stop 2024-01-24T13:03:48.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 -- 172.21.15.29:0/4137914675 shutdown_connections 2024-01-24T13:03:48.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 --2- 172.21.15.29:0/4137914675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f28165790 0x7f4f28167b80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:48.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 -- 172.21.15.29:0/4137914675 >> 172.21.15.29:0/4137914675 conn(0x7f4f28070570 msgr2=0x7f4f28069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:48.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 -- 172.21.15.29:0/4137914675 shutdown_connections 2024-01-24T13:03:48.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 -- 172.21.15.29:0/4137914675 wait complete. 2024-01-24T13:03:48.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 Processor -- start 2024-01-24T13:03:48.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 -- start start 2024-01-24T13:03:48.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f280ccdb0 0x7f4f280c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:48.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f2815d130 0x7f4f280c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:48.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f28165790 0x7f4f280b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:48.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280c5b60 con 0x7f4f280ccdb0 2024-01-24T13:03:48.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280b4300 con 0x7f4f2815d130 2024-01-24T13:03:48.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f2dc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280b45e0 con 0x7f4f28165790 2024-01-24T13:03:48.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f26a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f280ccdb0 0x7f4f280c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:48.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f26a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f280ccdb0 0x7f4f280c5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46886/0 (socket says 172.21.15.29:46886) 2024-01-24T13:03:48.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f26a00640 1 -- 172.21.15.29:0/2044651907 learned_addr learned my addr 172.21.15.29:0/2044651907 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:48.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f27400640 1 --2- 172.21.15.29:0/2044651907 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f28165790 0x7f4f280b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:48.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f26000640 1 --2- 172.21.15.29:0/2044651907 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f2815d130 0x7f4f280c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:48.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f26a00640 1 -- 172.21.15.29:0/2044651907 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f28165790 msgr2=0x7f4f280b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:48.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f26a00640 1 --2- 172.21.15.29:0/2044651907 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f28165790 0x7f4f280b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:48.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f26a00640 1 -- 172.21.15.29:0/2044651907 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f2815d130 msgr2=0x7f4f280c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:48.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f26a00640 1 --2- 172.21.15.29:0/2044651907 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f2815d130 0x7f4f280c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:48.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.932+0000 7f4f26a00640 1 -- 172.21.15.29:0/2044651907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20009b30 con 0x7f4f280ccdb0 2024-01-24T13:03:48.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.936+0000 7f4f26a00640 1 --2- 172.21.15.29:0/2044651907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f280ccdb0 0x7f4f280c5620 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800b410 tx=0x7f4f1800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:48.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.936+0000 7f4f1ea00640 1 -- 172.21.15.29:0/2044651907 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18004020 con 0x7f4f280ccdb0 2024-01-24T13:03:48.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.936+0000 7f4f1ea00640 1 -- 172.21.15.29:0/2044651907 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f18004180 con 0x7f4f280ccdb0 2024-01-24T13:03:48.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.936+0000 7f4f2dc00640 1 -- 172.21.15.29:0/2044651907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f280b48c0 con 0x7f4f280ccdb0 2024-01-24T13:03:48.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.936+0000 7f4f1ea00640 1 -- 172.21.15.29:0/2044651907 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18011630 con 0x7f4f280ccdb0 2024-01-24T13:03:48.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.936+0000 7f4f2dc00640 1 -- 172.21.15.29:0/2044651907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f280b4e80 con 0x7f4f280ccdb0 2024-01-24T13:03:48.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.936+0000 7f4f2dc00640 1 -- 172.21.15.29:0/2044651907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f280d1060 con 0x7f4f280ccdb0 2024-01-24T13:03:48.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.936+0000 7f4f1ea00640 1 -- 172.21.15.29:0/2044651907 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4f18011790 con 0x7f4f280ccdb0 2024-01-24T13:03:48.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.936+0000 7f4f1ea00640 1 --2- 172.21.15.29:0/2044651907 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4f00065a60 0x7f4f00067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:48.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.936+0000 7f4f1ea00640 1 -- 172.21.15.29:0/2044651907 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4f18082bf0 con 0x7f4f280ccdb0 2024-01-24T13:03:48.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.940+0000 7f4f26000640 1 --2- 172.21.15.29:0/2044651907 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4f00065a60 0x7f4f00067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:48.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.940+0000 7f4f26000640 1 --2- 172.21.15.29:0/2044651907 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4f00065a60 0x7f4f00067f20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4f280cbd30 tx=0x7f4f10009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:48.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:48.944+0000 7f4f1ea00640 1 -- 172.21.15.29:0/2044651907 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4f280d1060 con 0x7f4f280ccdb0 2024-01-24T13:03:49.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.100+0000 7f4f2dc00640 1 -- 172.21.15.29:0/2044651907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f280d1060 con 0x7f4f280ccdb0 2024-01-24T13:03:49.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.100+0000 7f4f1ea00640 1 -- 172.21.15.29:0/2044651907 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f4f280d1060 con 0x7f4f280ccdb0 2024-01-24T13:03:49.103 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:03:49.103 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":19,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:03:46.523205+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:03:49.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.104+0000 7f4f2dc00640 1 -- 172.21.15.29:0/2044651907 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4f00065a60 msgr2=0x7f4f00067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.104+0000 7f4f2dc00640 1 --2- 172.21.15.29:0/2044651907 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4f00065a60 0x7f4f00067f20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4f280cbd30 tx=0x7f4f10009040 comp rx=0 tx=0).stop 2024-01-24T13:03:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.104+0000 7f4f2dc00640 1 -- 172.21.15.29:0/2044651907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f280ccdb0 msgr2=0x7f4f280c5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.104+0000 7f4f2dc00640 1 --2- 172.21.15.29:0/2044651907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f280ccdb0 0x7f4f280c5620 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800b410 tx=0x7f4f1800b8d0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.104+0000 7f4f2dc00640 1 -- 172.21.15.29:0/2044651907 shutdown_connections 2024-01-24T13:03:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.104+0000 7f4f2dc00640 1 --2- 172.21.15.29:0/2044651907 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4f00065a60 0x7f4f00067f20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.104+0000 7f4f2dc00640 1 --2- 172.21.15.29:0/2044651907 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f28165790 0x7f4f280b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.104+0000 7f4f2dc00640 1 --2- 172.21.15.29:0/2044651907 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f2815d130 0x7f4f280c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.104+0000 7f4f2dc00640 1 --2- 172.21.15.29:0/2044651907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f280ccdb0 0x7f4f280c5620 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.104+0000 7f4f2dc00640 1 -- 172.21.15.29:0/2044651907 >> 172.21.15.29:0/2044651907 conn(0x7f4f28070570 msgr2=0x7f4f28069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.104+0000 7f4f2dc00640 1 -- 172.21.15.29:0/2044651907 shutdown_connections 2024-01-24T13:03:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.104+0000 7f4f2dc00640 1 -- 172.21.15.29:0/2044651907 wait complete. 2024-01-24T13:03:49.124 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:03:49.124 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:03:49.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.264+0000 7f7955800640 1 Processor -- start 2024-01-24T13:03:49.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.264+0000 7f7955800640 1 -- start start 2024-01-24T13:03:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f7955800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f795006bbc0 0x7f795006c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f7955800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f795006fe50 0x7f79500702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f7955800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795006c560 con 0x7f7950158ca0 2024-01-24T13:03:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f7955800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7950159080 con 0x7f795006bbc0 2024-01-24T13:03:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f7955800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7950070ba0 con 0x7f795006fe50 2024-01-24T13:03:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f794ea00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7950158ca0 0x7f79500b2680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37842/0 (socket says 172.21.15.29:37842) 2024-01-24T13:03:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f794ea00640 1 -- 172.21.15.29:0/2952236952 learned_addr learned my addr 172.21.15.29:0/2952236952 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:03:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f794e000640 1 --2- 172.21.15.29:0/2952236952 >> v2:172.21.15.163:3300/0 conn(0x7f795006bbc0 0x7f795006c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f794f400640 1 --2- 172.21.15.29:0/2952236952 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f795006fe50 0x7f79500702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f794d600640 1 -- 172.21.15.29:0/2952236952 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255308867 0 0) 0x7f795006c560 con 0x7f7950158ca0 2024-01-24T13:03:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f794d600640 1 -- 172.21.15.29:0/2952236952 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7930003530 con 0x7f7950158ca0 2024-01-24T13:03:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f794e000640 1 -- 172.21.15.29:0/2952236952 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f795006fe50 msgr2=0x7f79500702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f794e000640 1 --2- 172.21.15.29:0/2952236952 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f795006fe50 0x7f79500702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f794e000640 1 -- 172.21.15.29:0/2952236952 >> v1:172.21.15.29:6789/0 conn(0x7f7950158ca0 legacy=0x7f79500b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f794e000640 1 -- 172.21.15.29:0/2952236952 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500b18c0 con 0x7f795006bbc0 2024-01-24T13:03:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.268+0000 7f794f400640 1 --2- 172.21.15.29:0/2952236952 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f795006fe50 0x7f79500702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:49.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.272+0000 7f794e000640 1 --2- 172.21.15.29:0/2952236952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f795006bbc0 0x7f795006c020 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f79380097c0 tx=0x7f793801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8766ea6ecde3bad server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:49.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.272+0000 7f794d600640 1 -- 172.21.15.29:0/2952236952 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79380ab600 con 0x7f795006bbc0 2024-01-24T13:03:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.272+0000 7f794d600640 1 -- 172.21.15.29:0/2952236952 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79380ab760 con 0x7f795006bbc0 2024-01-24T13:03:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.272+0000 7f794d600640 1 -- 172.21.15.29:0/2952236952 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79380abaf0 con 0x7f795006bbc0 2024-01-24T13:03:49.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.272+0000 7f7955800640 1 -- 172.21.15.29:0/2952236952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f795006bbc0 msgr2=0x7f795006c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:49.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.272+0000 7f7955800640 1 --2- 172.21.15.29:0/2952236952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f795006bbc0 0x7f795006c020 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f79380097c0 tx=0x7f793801c480 comp rx=0 tx=0).stop 2024-01-24T13:03:49.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.272+0000 7f7955800640 1 -- 172.21.15.29:0/2952236952 shutdown_connections 2024-01-24T13:03:49.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.272+0000 7f7955800640 1 --2- 172.21.15.29:0/2952236952 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f795006fe50 0x7f79500702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.272+0000 7f7955800640 1 --2- 172.21.15.29:0/2952236952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f795006bbc0 0x7f795006c020 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.272+0000 7f7955800640 1 -- 172.21.15.29:0/2952236952 >> 172.21.15.29:0/2952236952 conn(0x7f795006d700 msgr2=0x7f7950069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:49.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.272+0000 7f7955800640 1 -- 172.21.15.29:0/2952236952 shutdown_connections 2024-01-24T13:03:49.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.272+0000 7f7955800640 1 -- 172.21.15.29:0/2952236952 wait complete. 2024-01-24T13:03:49.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f7955800640 1 Processor -- start 2024-01-24T13:03:49.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f7955800640 1 -- start start 2024-01-24T13:03:49.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f7955800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f795006bbc0 0x7f795013de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:49.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f7955800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f795006fe50 0x7f79500c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f7955800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7950158ca0 0x7f7950159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f7955800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7950150ab0 con 0x7f795006fe50 2024-01-24T13:03:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f7955800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500c79f0 con 0x7f7950158ca0 2024-01-24T13:03:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f7955800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79501578f0 con 0x7f795006bbc0 2024-01-24T13:03:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f794e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f795006fe50 0x7f79500c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f794ea00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f795006bbc0 0x7f795013de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f794f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7950158ca0 0x7f7950159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f794ea00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f795006bbc0 0x7f795013de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:37786/0 (socket says 172.21.15.29:37786) 2024-01-24T13:03:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f794e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f795006fe50 0x7f79500c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46898/0 (socket says 172.21.15.29:46898) 2024-01-24T13:03:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f794ea00640 1 -- 172.21.15.29:0/4247643233 learned_addr learned my addr 172.21.15.29:0/4247643233 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f794ea00640 1 -- 172.21.15.29:0/4247643233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7950158ca0 msgr2=0x7f7950159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f794ea00640 1 --2- 172.21.15.29:0/4247643233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7950158ca0 0x7f7950159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f794ea00640 1 -- 172.21.15.29:0/4247643233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f795006fe50 msgr2=0x7f79500c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f794ea00640 1 --2- 172.21.15.29:0/4247643233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f795006fe50 0x7f79500c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f794ea00640 1 -- 172.21.15.29:0/4247643233 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7948009a70 con 0x7f795006bbc0 2024-01-24T13:03:49.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f794ea00640 1 --2- 172.21.15.29:0/4247643233 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f795006bbc0 0x7f795013de10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f794000c420 tx=0x7f794000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:49.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f7946a00640 1 -- 172.21.15.29:0/4247643233 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940005cf0 con 0x7f795006bbc0 2024-01-24T13:03:49.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f7946a00640 1 -- 172.21.15.29:0/4247643233 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7940005e50 con 0x7f795006bbc0 2024-01-24T13:03:49.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f7946a00640 1 -- 172.21.15.29:0/4247643233 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79400072d0 con 0x7f795006bbc0 2024-01-24T13:03:49.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f7955800640 1 -- 172.21.15.29:0/4247643233 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7938009420 con 0x7f795006bbc0 2024-01-24T13:03:49.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.276+0000 7f7955800640 1 -- 172.21.15.29:0/4247643233 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7950157eb0 con 0x7f795006bbc0 2024-01-24T13:03:49.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.280+0000 7f7955800640 1 -- 172.21.15.29:0/4247643233 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795004e850 con 0x7f795006bbc0 2024-01-24T13:03:49.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.280+0000 7f7946a00640 1 -- 172.21.15.29:0/4247643233 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7940007430 con 0x7f795006bbc0 2024-01-24T13:03:49.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.280+0000 7f7946a00640 1 --2- 172.21.15.29:0/4247643233 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7928065a60 0x7f7928067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:49.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.280+0000 7f7946a00640 1 -- 172.21.15.29:0/4247643233 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7940082270 con 0x7f795006bbc0 2024-01-24T13:03:49.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.280+0000 7f794e000640 1 --2- 172.21.15.29:0/4247643233 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7928065a60 0x7f7928067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:49.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.280+0000 7f794e000640 1 --2- 172.21.15.29:0/4247643233 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7928065a60 0x7f7928067f20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f79380af000 tx=0x7f79380a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:49.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.284+0000 7f7946a00640 1 -- 172.21.15.29:0/4247643233 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f79400500a0 con 0x7f795006bbc0 2024-01-24T13:03:49.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.444+0000 7f7955800640 1 -- 172.21.15.29:0/4247643233 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7950066580 con 0x7f795006bbc0 2024-01-24T13:03:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.444+0000 7f7946a00640 1 -- 172.21.15.29:0/4247643233 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79400536c0 con 0x7f795006bbc0 2024-01-24T13:03:49.445 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:03:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.444+0000 7f7955800640 1 -- 172.21.15.29:0/4247643233 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7928065a60 msgr2=0x7f7928067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.444+0000 7f7955800640 1 --2- 172.21.15.29:0/4247643233 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7928065a60 0x7f7928067f20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f79380af000 tx=0x7f79380a7000 comp rx=0 tx=0).stop 2024-01-24T13:03:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.444+0000 7f7955800640 1 -- 172.21.15.29:0/4247643233 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f795006bbc0 msgr2=0x7f795013de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.444+0000 7f7955800640 1 --2- 172.21.15.29:0/4247643233 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f795006bbc0 0x7f795013de10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f794000c420 tx=0x7f794000c820 comp rx=0 tx=0).stop 2024-01-24T13:03:49.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.444+0000 7f7955800640 1 -- 172.21.15.29:0/4247643233 shutdown_connections 2024-01-24T13:03:49.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.444+0000 7f7955800640 1 --2- 172.21.15.29:0/4247643233 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7928065a60 0x7f7928067f20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.444+0000 7f7955800640 1 --2- 172.21.15.29:0/4247643233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7950158ca0 0x7f7950159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.444+0000 7f7955800640 1 --2- 172.21.15.29:0/4247643233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f795006fe50 0x7f79500c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.444+0000 7f7955800640 1 --2- 172.21.15.29:0/4247643233 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f795006bbc0 0x7f795013de10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.444+0000 7f7955800640 1 -- 172.21.15.29:0/4247643233 >> 172.21.15.29:0/4247643233 conn(0x7f795006d700 msgr2=0x7f795006bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:49.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.444+0000 7f7955800640 1 -- 172.21.15.29:0/4247643233 shutdown_connections 2024-01-24T13:03:49.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.444+0000 7f7955800640 1 -- 172.21.15.29:0/4247643233 wait complete. 2024-01-24T13:03:49.467 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:03:49.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.604+0000 7f0e22000640 1 Processor -- start 2024-01-24T13:03:49.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.608+0000 7f0e22000640 1 -- start start 2024-01-24T13:03:49.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.608+0000 7f0e22000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e1c15c730 0x7f0e1c06b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:49.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.608+0000 7f0e22000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0e1c0b2700 0x7f0e1c0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:49.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.608+0000 7f0e22000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1c06cc10 con 0x7f0e1c0ccdb0 2024-01-24T13:03:49.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.608+0000 7f0e22000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1c06b7a0 con 0x7f0e1c15c730 2024-01-24T13:03:49.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.608+0000 7f0e22000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1c06ba80 con 0x7f0e1c0b2700 2024-01-24T13:03:49.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.608+0000 7f0e1b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e1c15c730 0x7f0e1c06b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:49.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.608+0000 7f0e1b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e1c15c730 0x7f0e1c06b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46912/0 (socket says 172.21.15.29:46912) 2024-01-24T13:03:49.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.608+0000 7f0e1b400640 1 -- 172.21.15.29:0/4077504392 learned_addr learned my addr 172.21.15.29:0/4077504392 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:49.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.608+0000 7f0e1aa00640 1 --2- 172.21.15.29:0/4077504392 >> v2:172.21.15.163:3300/0 conn(0x7f0e1c0b2700 0x7f0e1c0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:49.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.608+0000 7f0e1b400640 1 -- 172.21.15.29:0/4077504392 >> v2:172.21.15.163:3300/0 conn(0x7f0e1c0b2700 msgr2=0x7f0e1c0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:49.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.608+0000 7f0e1b400640 1 --2- 172.21.15.29:0/4077504392 >> v2:172.21.15.163:3300/0 conn(0x7f0e1c0b2700 0x7f0e1c0ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.608+0000 7f0e1b400640 1 -- 172.21.15.29:0/4077504392 >> v1:172.21.15.29:6789/0 conn(0x7f0e1c0ccdb0 legacy=0x7f0e1c0d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:49.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.608+0000 7f0e1b400640 1 -- 172.21.15.29:0/4077504392 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c06bd60 con 0x7f0e1c15c730 2024-01-24T13:03:49.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.612+0000 7f0e1b400640 1 --2- 172.21.15.29:0/4077504392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e1c15c730 0x7f0e1c06b110 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0cdd00 tx=0x7f0e0c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d1b558466e2500 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:49.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.612+0000 7f0e1a000640 1 -- 172.21.15.29:0/4077504392 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0ac640 con 0x7f0e1c15c730 2024-01-24T13:03:49.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.612+0000 7f0e1a000640 1 -- 172.21.15.29:0/4077504392 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c0ac7a0 con 0x7f0e1c15c730 2024-01-24T13:03:49.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.612+0000 7f0e1a000640 1 -- 172.21.15.29:0/4077504392 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0acb30 con 0x7f0e1c15c730 2024-01-24T13:03:49.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.612+0000 7f0e22000640 1 -- 172.21.15.29:0/4077504392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e1c15c730 msgr2=0x7f0e1c06b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:49.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.612+0000 7f0e22000640 1 --2- 172.21.15.29:0/4077504392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e1c15c730 0x7f0e1c06b110 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0cdd00 tx=0x7f0e0c01c4d0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.612+0000 7f0e22000640 1 -- 172.21.15.29:0/4077504392 shutdown_connections 2024-01-24T13:03:49.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.612+0000 7f0e22000640 1 --2- 172.21.15.29:0/4077504392 >> v2:172.21.15.163:3300/0 conn(0x7f0e1c0b2700 0x7f0e1c0ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.612+0000 7f0e22000640 1 --2- 172.21.15.29:0/4077504392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e1c15c730 0x7f0e1c06b110 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.612+0000 7f0e22000640 1 -- 172.21.15.29:0/4077504392 >> 172.21.15.29:0/4077504392 conn(0x7f0e1c070570 msgr2=0x7f0e1c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:49.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.612+0000 7f0e22000640 1 -- 172.21.15.29:0/4077504392 shutdown_connections 2024-01-24T13:03:49.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.612+0000 7f0e22000640 1 -- 172.21.15.29:0/4077504392 wait complete. 2024-01-24T13:03:49.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.612+0000 7f0e22000640 1 Processor -- start 2024-01-24T13:03:49.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.612+0000 7f0e22000640 1 -- start start 2024-01-24T13:03:49.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e22000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e1c0b2700 0x7f0e1c0b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:49.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e22000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e1c0ccdb0 0x7f0e1c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:49.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e22000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0e1c15c730 0x7f0e1c15b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:49.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e22000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c14b970 con 0x7f0e1c0b2700 2024-01-24T13:03:49.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e22000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c14a0a0 con 0x7f0e1c0ccdb0 2024-01-24T13:03:49.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e22000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c14a380 con 0x7f0e1c15c730 2024-01-24T13:03:49.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e1b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e1c0b2700 0x7f0e1c0b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e1b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e1c0b2700 0x7f0e1c0b56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46928/0 (socket says 172.21.15.29:46928) 2024-01-24T13:03:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e1b400640 1 -- 172.21.15.29:0/3965117630 learned_addr learned my addr 172.21.15.29:0/3965117630 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e1be00640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0e1c15c730 0x7f0e1c15b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e1b400640 1 -- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0e1c15c730 msgr2=0x7f0e1c15b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e1aa00640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e1c0ccdb0 0x7f0e1c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e1b400640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0e1c15c730 0x7f0e1c15b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e1b400640 1 -- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e1c0ccdb0 msgr2=0x7f0e1c0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e1b400640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e1c0ccdb0 0x7f0e1c0b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e1b400640 1 -- 172.21.15.29:0/3965117630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c0094d0 con 0x7f0e1c0b2700 2024-01-24T13:03:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e1be00640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0e1c15c730 0x7f0e1c15b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:03:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e1aa00640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e1c0ccdb0 0x7f0e1c0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:03:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e1b400640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e1c0b2700 0x7f0e1c0b56b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c01a100 tx=0x7f0e0c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e13400640 1 -- 172.21.15.29:0/3965117630 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0bc070 con 0x7f0e1c0b2700 2024-01-24T13:03:49.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e13400640 1 -- 172.21.15.29:0/3965117630 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c0b7450 con 0x7f0e1c0b2700 2024-01-24T13:03:49.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e13400640 1 -- 172.21.15.29:0/3965117630 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0b77e0 con 0x7f0e1c0b2700 2024-01-24T13:03:49.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e22000640 1 -- 172.21.15.29:0/3965117630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1c14a660 con 0x7f0e1c0b2700 2024-01-24T13:03:49.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e22000640 1 -- 172.21.15.29:0/3965117630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1c14ac20 con 0x7f0e1c0b2700 2024-01-24T13:03:49.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.616+0000 7f0e22000640 1 -- 172.21.15.29:0/3965117630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1c0cf430 con 0x7f0e1c0b2700 2024-01-24T13:03:49.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.620+0000 7f0e13400640 1 -- 172.21.15.29:0/3965117630 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0e0c0b3070 con 0x7f0e1c0b2700 2024-01-24T13:03:49.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.620+0000 7f0e13400640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0df4065a60 0x7f0df4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:49.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.620+0000 7f0e13400640 1 -- 172.21.15.29:0/3965117630 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0e0c11ce30 con 0x7f0e1c0b2700 2024-01-24T13:03:49.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.620+0000 7f0e1aa00640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0df4065a60 0x7f0df4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:49.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.620+0000 7f0e1aa00640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0df4065a60 0x7f0df4067f20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0b5bf0 tx=0x7f0e04008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:49.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.624+0000 7f0e13400640 1 -- 172.21.15.29:0/3965117630 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f0e0c0eab30 con 0x7f0e1c0b2700 2024-01-24T13:03:49.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.808+0000 7f0e22000640 1 -- 172.21.15.29:0/3965117630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e1c14ae10 con 0x7f0e1c0b2700 2024-01-24T13:03:49.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.812+0000 7f0e13400640 1 -- 172.21.15.29:0/3965117630 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f0e0c0b1500 con 0x7f0e1c0b2700 2024-01-24T13:03:49.813 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:03:49.813 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2390785325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2390785325},{"type":"v1","addr":"172.21.15.29:6835","nonce":2390785325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-01-24T13:03:49.813 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 2 2024-01-24T13:03:49.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.812+0000 7f0e22000640 1 -- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0df4065a60 msgr2=0x7f0df4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:49.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.812+0000 7f0e22000640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0df4065a60 0x7f0df4067f20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0b5bf0 tx=0x7f0e04008040 comp rx=0 tx=0).stop 2024-01-24T13:03:49.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.812+0000 7f0e22000640 1 -- 172.21.15.29:0/3965117630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e1c0b2700 msgr2=0x7f0e1c0b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:49.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.812+0000 7f0e22000640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e1c0b2700 0x7f0e1c0b56b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c01a100 tx=0x7f0e0c01ad10 comp rx=0 tx=0).stop 2024-01-24T13:03:49.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.812+0000 7f0e22000640 1 -- 172.21.15.29:0/3965117630 shutdown_connections 2024-01-24T13:03:49.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.812+0000 7f0e22000640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0df4065a60 0x7f0df4067f20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.812+0000 7f0e22000640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0e1c15c730 0x7f0e1c15b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.812+0000 7f0e22000640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e1c0ccdb0 0x7f0e1c0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.812+0000 7f0e22000640 1 --2- 172.21.15.29:0/3965117630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e1c0b2700 0x7f0e1c0b56b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:49.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.812+0000 7f0e22000640 1 -- 172.21.15.29:0/3965117630 >> 172.21.15.29:0/3965117630 conn(0x7f0e1c070570 msgr2=0x7f0e1c0cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:49.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.812+0000 7f0e22000640 1 -- 172.21.15.29:0/3965117630 shutdown_connections 2024-01-24T13:03:49.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:49.812+0000 7f0e22000640 1 -- 172.21.15.29:0/3965117630 wait complete. 2024-01-24T13:03:51.835 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:03:51.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.984+0000 7f1d88c00640 1 Processor -- start 2024-01-24T13:03:51.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.984+0000 7f1d88c00640 1 -- start start 2024-01-24T13:03:51.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d88c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1d8415c450 0x7f1d840cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:51.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d88c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d840b1f50 0x7f1d840ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:51.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d88c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1d840b1030 0x7f1d8406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:51.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d88c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d840712d0 con 0x7f1d840b1030 2024-01-24T13:03:51.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d88c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d84070230 con 0x7f1d8415c450 2024-01-24T13:03:51.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d88c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d84070510 con 0x7f1d840b1f50 2024-01-24T13:03:51.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d82800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1d840b1030 0x7f1d8406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:51.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d82800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1d840b1030 0x7f1d8406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40882/0 (socket says 172.21.15.29:40882) 2024-01-24T13:03:51.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d82800640 1 -- 172.21.15.29:0/1764114824 learned_addr learned my addr 172.21.15.29:0/1764114824 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:51.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d81e00640 1 --2- 172.21.15.29:0/1764114824 >> v2:172.21.15.163:3300/0 conn(0x7f1d8415c450 0x7f1d840cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:51.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d81400640 1 --2- 172.21.15.29:0/1764114824 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d840b1f50 0x7f1d840ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:51.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d82800640 1 -- 172.21.15.29:0/1764114824 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d840b1f50 msgr2=0x7f1d840ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:51.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d82800640 1 --2- 172.21.15.29:0/1764114824 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d840b1f50 0x7f1d840ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:51.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d82800640 1 -- 172.21.15.29:0/1764114824 >> v2:172.21.15.163:3300/0 conn(0x7f1d8415c450 msgr2=0x7f1d840cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:51.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d82800640 1 --2- 172.21.15.29:0/1764114824 >> v2:172.21.15.163:3300/0 conn(0x7f1d8415c450 0x7f1d840cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:51.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.988+0000 7f1d82800640 1 -- 172.21.15.29:0/1764114824 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d840707f0 con 0x7f1d840b1030 2024-01-24T13:03:51.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.992+0000 7f1d82800640 1 --2- 172.21.15.29:0/1764114824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d840b1030 0x7f1d8406bc10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1d8406e0f0 tx=0x7f1d7c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553a99981f8a8bf5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:51.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.992+0000 7f1d80a00640 1 -- 172.21.15.29:0/1764114824 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0a5850 con 0x7f1d840b1030 2024-01-24T13:03:51.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.992+0000 7f1d80a00640 1 -- 172.21.15.29:0/1764114824 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c0a59b0 con 0x7f1d840b1030 2024-01-24T13:03:51.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.992+0000 7f1d80a00640 1 -- 172.21.15.29:0/1764114824 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0a5d40 con 0x7f1d840b1030 2024-01-24T13:03:51.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.992+0000 7f1d88c00640 1 -- 172.21.15.29:0/1764114824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d840b1030 msgr2=0x7f1d8406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:51.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.992+0000 7f1d88c00640 1 --2- 172.21.15.29:0/1764114824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d840b1030 0x7f1d8406bc10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1d8406e0f0 tx=0x7f1d7c01c9d0 comp rx=0 tx=0).stop 2024-01-24T13:03:51.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.992+0000 7f1d88c00640 1 -- 172.21.15.29:0/1764114824 shutdown_connections 2024-01-24T13:03:51.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.992+0000 7f1d88c00640 1 --2- 172.21.15.29:0/1764114824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d840b1030 0x7f1d8406bc10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:51.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.992+0000 7f1d88c00640 1 --2- 172.21.15.29:0/1764114824 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d840b1f50 0x7f1d840ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:51.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.992+0000 7f1d88c00640 1 --2- 172.21.15.29:0/1764114824 >> v2:172.21.15.163:3300/0 conn(0x7f1d8415c450 0x7f1d840cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:51.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.992+0000 7f1d88c00640 1 -- 172.21.15.29:0/1764114824 >> 172.21.15.29:0/1764114824 conn(0x7f1d840b3950 msgr2=0x7f1d84069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:51.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.992+0000 7f1d88c00640 1 -- 172.21.15.29:0/1764114824 shutdown_connections 2024-01-24T13:03:51.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.992+0000 7f1d88c00640 1 -- 172.21.15.29:0/1764114824 wait complete. 2024-01-24T13:03:51.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.992+0000 7f1d88c00640 1 Processor -- start 2024-01-24T13:03:51.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d88c00640 1 -- start start 2024-01-24T13:03:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d88c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d840b1030 0x7f1d84150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d88c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d840b1f50 0x7f1d84156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d88c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d8415c450 0x7f1d840ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d88c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d84155a00 con 0x7f1d840b1030 2024-01-24T13:03:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d88c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d84155ce0 con 0x7f1d840b1f50 2024-01-24T13:03:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d88c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d84155fc0 con 0x7f1d8415c450 2024-01-24T13:03:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d81e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d840b1030 0x7f1d84150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d81e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d840b1030 0x7f1d84150e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40888/0 (socket says 172.21.15.29:40888) 2024-01-24T13:03:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d81e00640 1 -- 172.21.15.29:0/3577483985 learned_addr learned my addr 172.21.15.29:0/3577483985 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d82800640 1 --2- 172.21.15.29:0/3577483985 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d8415c450 0x7f1d840ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d81400640 1 --2- 172.21.15.29:0/3577483985 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d840b1f50 0x7f1d84156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d81e00640 1 -- 172.21.15.29:0/3577483985 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d8415c450 msgr2=0x7f1d840ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d81e00640 1 --2- 172.21.15.29:0/3577483985 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d8415c450 0x7f1d840ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d81e00640 1 -- 172.21.15.29:0/3577483985 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d840b1f50 msgr2=0x7f1d84156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d81e00640 1 --2- 172.21.15.29:0/3577483985 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d840b1f50 0x7f1d84156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d81e00640 1 -- 172.21.15.29:0/3577483985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c009b30 con 0x7f1d840b1030 2024-01-24T13:03:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d81e00640 1 --2- 172.21.15.29:0/3577483985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d840b1030 0x7f1d84150e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400e870 tx=0x7f1d7400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d7a000640 1 -- 172.21.15.29:0/3577483985 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74009510 con 0x7f1d840b1030 2024-01-24T13:03:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d7a000640 1 -- 172.21.15.29:0/3577483985 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7400eec0 con 0x7f1d840b1030 2024-01-24T13:03:52.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d88c00640 1 -- 172.21.15.29:0/3577483985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d841562a0 con 0x7f1d840b1030 2024-01-24T13:03:52.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d7a000640 1 -- 172.21.15.29:0/3577483985 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7400cb40 con 0x7f1d840b1030 2024-01-24T13:03:52.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d88c00640 1 -- 172.21.15.29:0/3577483985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d84155690 con 0x7f1d840b1030 2024-01-24T13:03:52.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:51.996+0000 7f1d88c00640 1 -- 172.21.15.29:0/3577483985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8404e850 con 0x7f1d840b1030 2024-01-24T13:03:52.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.000+0000 7f1d7a000640 1 -- 172.21.15.29:0/3577483985 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1d7400cca0 con 0x7f1d840b1030 2024-01-24T13:03:52.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.000+0000 7f1d7a000640 1 --2- 172.21.15.29:0/3577483985 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1d5c065a60 0x7f1d5c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:52.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.000+0000 7f1d7a000640 1 -- 172.21.15.29:0/3577483985 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1d74082fa0 con 0x7f1d840b1030 2024-01-24T13:03:52.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.000+0000 7f1d81400640 1 --2- 172.21.15.29:0/3577483985 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1d5c065a60 0x7f1d5c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:52.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.000+0000 7f1d81400640 1 --2- 172.21.15.29:0/3577483985 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1d5c065a60 0x7f1d5c067f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d84157b50 tx=0x7f1d6c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:52.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.004+0000 7f1d7a000640 1 -- 172.21.15.29:0/3577483985 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1d74050c10 con 0x7f1d840b1030 2024-01-24T13:03:52.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.192+0000 7f1d88c00640 1 -- 172.21.15.29:0/3577483985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d84069ee0 con 0x7f1d840b1030 2024-01-24T13:03:52.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.192+0000 7f1d7a000640 1 -- 172.21.15.29:0/3577483985 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f1d74021de0 con 0x7f1d840b1030 2024-01-24T13:03:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:03:52.194 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1485056573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1485056573},{"type":"v1","addr":"172.21.15.29:6834","nonce":1485056573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/447431893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":447431893},{"type":"v1","addr":"172.21.15.163:6836","nonce":447431893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2390785325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2390785325},{"type":"v1","addr":"172.21.15.29:6835","nonce":2390785325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1191601563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1191601563},{"type":"v1","addr":"172.21.15.163:6837","nonce":1191601563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-01-24T13:03:52.194 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 3 2024-01-24T13:03:52.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.192+0000 7f1d88c00640 1 -- 172.21.15.29:0/3577483985 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1d5c065a60 msgr2=0x7f1d5c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.192+0000 7f1d88c00640 1 --2- 172.21.15.29:0/3577483985 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1d5c065a60 0x7f1d5c067f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d84157b50 tx=0x7f1d6c008040 comp rx=0 tx=0).stop 2024-01-24T13:03:52.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.192+0000 7f1d88c00640 1 -- 172.21.15.29:0/3577483985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d840b1030 msgr2=0x7f1d84150e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.192+0000 7f1d88c00640 1 --2- 172.21.15.29:0/3577483985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d840b1030 0x7f1d84150e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400e870 tx=0x7f1d7400ec70 comp rx=0 tx=0).stop 2024-01-24T13:03:52.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.192+0000 7f1d88c00640 1 -- 172.21.15.29:0/3577483985 shutdown_connections 2024-01-24T13:03:52.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.192+0000 7f1d88c00640 1 --2- 172.21.15.29:0/3577483985 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1d5c065a60 0x7f1d5c067f20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.192+0000 7f1d88c00640 1 --2- 172.21.15.29:0/3577483985 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d8415c450 0x7f1d840ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.192+0000 7f1d88c00640 1 --2- 172.21.15.29:0/3577483985 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d840b1f50 0x7f1d84156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.192+0000 7f1d88c00640 1 --2- 172.21.15.29:0/3577483985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d840b1030 0x7f1d84150e80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.192+0000 7f1d88c00640 1 -- 172.21.15.29:0/3577483985 >> 172.21.15.29:0/3577483985 conn(0x7f1d840b3950 msgr2=0x7f1d8415b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:52.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.192+0000 7f1d88c00640 1 -- 172.21.15.29:0/3577483985 shutdown_connections 2024-01-24T13:03:52.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.192+0000 7f1d88c00640 1 -- 172.21.15.29:0/3577483985 wait complete. 2024-01-24T13:03:52.216 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:03:52.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.352+0000 7fb2ae400640 1 Processor -- start 2024-01-24T13:03:52.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.356+0000 7fb2ae400640 1 -- start start 2024-01-24T13:03:52.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.356+0000 7fb2ae400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb2a8143d30 0x7fb2a806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:52.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.356+0000 7fb2ae400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2a806c150 0x7fb2a80cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:52.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.356+0000 7fb2ae400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a815aa30 con 0x7fb2a8143910 2024-01-24T13:03:52.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.356+0000 7fb2ae400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a806c5c0 con 0x7fb2a806c150 2024-01-24T13:03:52.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.356+0000 7fb2ae400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a80712a0 con 0x7fb2a8143d30 2024-01-24T13:03:52.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.356+0000 7fb2a7e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2a806c150 0x7fb2a80cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:52.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.356+0000 7fb2a7e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2a806c150 0x7fb2a80cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40896/0 (socket says 172.21.15.29:40896) 2024-01-24T13:03:52.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.356+0000 7fb2a7e00640 1 -- 172.21.15.29:0/1347708113 learned_addr learned my addr 172.21.15.29:0/1347708113 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:52.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.356+0000 7fb2a6a00640 1 --2- 172.21.15.29:0/1347708113 >> v2:172.21.15.163:3300/0 conn(0x7fb2a8143d30 0x7fb2a806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:52.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.356+0000 7fb2a7e00640 1 -- 172.21.15.29:0/1347708113 >> v2:172.21.15.163:3300/0 conn(0x7fb2a8143d30 msgr2=0x7fb2a806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:52.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.356+0000 7fb2a7e00640 1 --2- 172.21.15.29:0/1347708113 >> v2:172.21.15.163:3300/0 conn(0x7fb2a8143d30 0x7fb2a806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.356+0000 7fb2a7e00640 1 -- 172.21.15.29:0/1347708113 >> v1:172.21.15.29:6789/0 conn(0x7fb2a8143910 legacy=0x7fb2a8070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.356+0000 7fb2a7e00640 1 -- 172.21.15.29:0/1347708113 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a8071580 con 0x7fb2a806c150 2024-01-24T13:03:52.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.360+0000 7fb2a7e00640 1 --2- 172.21.15.29:0/1347708113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a806c150 0x7fb2a80cd890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb2a806e0f0 tx=0x7fb2a001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebe6d873556a2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:52.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.360+0000 7fb2a6000640 1 -- 172.21.15.29:0/1347708113 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00a5780 con 0x7fb2a806c150 2024-01-24T13:03:52.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.360+0000 7fb2a6000640 1 -- 172.21.15.29:0/1347708113 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a00a58e0 con 0x7fb2a806c150 2024-01-24T13:03:52.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.360+0000 7fb2a6000640 1 -- 172.21.15.29:0/1347708113 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00a5c70 con 0x7fb2a806c150 2024-01-24T13:03:52.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.360+0000 7fb2ae400640 1 -- 172.21.15.29:0/1347708113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a806c150 msgr2=0x7fb2a80cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.360+0000 7fb2ae400640 1 --2- 172.21.15.29:0/1347708113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a806c150 0x7fb2a80cd890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb2a806e0f0 tx=0x7fb2a001c9d0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.360+0000 7fb2ae400640 1 -- 172.21.15.29:0/1347708113 shutdown_connections 2024-01-24T13:03:52.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.360+0000 7fb2ae400640 1 --2- 172.21.15.29:0/1347708113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a806c150 0x7fb2a80cd890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.360+0000 7fb2ae400640 1 --2- 172.21.15.29:0/1347708113 >> v2:172.21.15.163:3300/0 conn(0x7fb2a8143d30 0x7fb2a806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.360+0000 7fb2ae400640 1 -- 172.21.15.29:0/1347708113 >> 172.21.15.29:0/1347708113 conn(0x7fb2a80b3950 msgr2=0x7fb2a8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:52.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.360+0000 7fb2ae400640 1 -- 172.21.15.29:0/1347708113 shutdown_connections 2024-01-24T13:03:52.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.360+0000 7fb2ae400640 1 -- 172.21.15.29:0/1347708113 wait complete. 2024-01-24T13:03:52.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.360+0000 7fb2ae400640 1 Processor -- start 2024-01-24T13:03:52.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.360+0000 7fb2ae400640 1 -- start start 2024-01-24T13:03:52.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2ae400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2a806c150 0x7fb2a80ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:52.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2ae400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2a8143910 0x7fb2a8139630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:52.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2ae400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a8143d30 0x7fb2a8139b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:52.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2ae400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a813abe0 con 0x7fb2a8143d30 2024-01-24T13:03:52.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2ae400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a813a0b0 con 0x7fb2a8143910 2024-01-24T13:03:52.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2ae400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a8158e60 con 0x7fb2a806c150 2024-01-24T13:03:52.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2a7e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a8143d30 0x7fb2a8139b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:52.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2a7e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a8143d30 0x7fb2a8139b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40912/0 (socket says 172.21.15.29:40912) 2024-01-24T13:03:52.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2a7e00640 1 -- 172.21.15.29:0/716517144 learned_addr learned my addr 172.21.15.29:0/716517144 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:52.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2a6a00640 1 --2- 172.21.15.29:0/716517144 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2a8143910 0x7fb2a8139630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:52.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2a7400640 1 --2- 172.21.15.29:0/716517144 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2a806c150 0x7fb2a80ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:52.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2a7e00640 1 -- 172.21.15.29:0/716517144 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2a806c150 msgr2=0x7fb2a80ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2a7e00640 1 --2- 172.21.15.29:0/716517144 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2a806c150 0x7fb2a80ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2a7e00640 1 -- 172.21.15.29:0/716517144 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2a8143910 msgr2=0x7fb2a8139630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2a7e00640 1 --2- 172.21.15.29:0/716517144 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2a8143910 0x7fb2a8139630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2a7e00640 1 -- 172.21.15.29:0/716517144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a0009b30 con 0x7fb2a8143d30 2024-01-24T13:03:52.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2a7e00640 1 --2- 172.21.15.29:0/716517144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a8143d30 0x7fb2a8139b70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb2a001a600 tx=0x7fb2a0019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:52.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb29f400640 1 -- 172.21.15.29:0/716517144 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00b6680 con 0x7fb2a8143d30 2024-01-24T13:03:52.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb29f400640 1 -- 172.21.15.29:0/716517144 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a00b67e0 con 0x7fb2a8143d30 2024-01-24T13:03:52.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb29f400640 1 -- 172.21.15.29:0/716517144 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00b6b90 con 0x7fb2a8143d30 2024-01-24T13:03:52.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2ae400640 1 -- 172.21.15.29:0/716517144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a81f5bf0 con 0x7fb2a8143d30 2024-01-24T13:03:52.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2ae400640 1 -- 172.21.15.29:0/716517144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a813a520 con 0x7fb2a8143d30 2024-01-24T13:03:52.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.364+0000 7fb2ae400640 1 -- 172.21.15.29:0/716517144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a813ad20 con 0x7fb2a8143d30 2024-01-24T13:03:52.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.368+0000 7fb29f400640 1 -- 172.21.15.29:0/716517144 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb2a00b6cf0 con 0x7fb2a8143d30 2024-01-24T13:03:52.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.368+0000 7fb29f400640 1 --2- 172.21.15.29:0/716517144 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb280065a60 0x7fb280067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:52.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.368+0000 7fb29f400640 1 -- 172.21.15.29:0/716517144 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb2a011def0 con 0x7fb2a8143d30 2024-01-24T13:03:52.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.368+0000 7fb2a7400640 1 --2- 172.21.15.29:0/716517144 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb280065a60 0x7fb280067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:52.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.368+0000 7fb2a7400640 1 --2- 172.21.15.29:0/716517144 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb280065a60 0x7fb280067f20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80cc5d0 tx=0x7fb298009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:52.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.372+0000 7fb29f400640 1 -- 172.21.15.29:0/716517144 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb2a813ad20 con 0x7fb2a8143d30 2024-01-24T13:03:52.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.528+0000 7fb2ae400640 1 -- 172.21.15.29:0/716517144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2a813ad20 con 0x7fb2a8143d30 2024-01-24T13:03:52.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.528+0000 7fb29f400640 1 -- 172.21.15.29:0/716517144 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12382 (secure 0 0 0) 0x7fb2a813ad20 con 0x7fb2a8143d30 2024-01-24T13:03:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:03:52.531 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":19,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:03:46.523205+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:03:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.532+0000 7fb2ae400640 1 -- 172.21.15.29:0/716517144 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb280065a60 msgr2=0x7fb280067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.532+0000 7fb2ae400640 1 --2- 172.21.15.29:0/716517144 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb280065a60 0x7fb280067f20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80cc5d0 tx=0x7fb298009040 comp rx=0 tx=0).stop 2024-01-24T13:03:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.532+0000 7fb2ae400640 1 -- 172.21.15.29:0/716517144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a8143d30 msgr2=0x7fb2a8139b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.532+0000 7fb2ae400640 1 --2- 172.21.15.29:0/716517144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a8143d30 0x7fb2a8139b70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb2a001a600 tx=0x7fb2a0019770 comp rx=0 tx=0).stop 2024-01-24T13:03:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.532+0000 7fb2ae400640 1 -- 172.21.15.29:0/716517144 shutdown_connections 2024-01-24T13:03:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.532+0000 7fb2ae400640 1 --2- 172.21.15.29:0/716517144 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb280065a60 0x7fb280067f20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.532+0000 7fb2ae400640 1 --2- 172.21.15.29:0/716517144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a8143d30 0x7fb2a8139b70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.532+0000 7fb2ae400640 1 --2- 172.21.15.29:0/716517144 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2a8143910 0x7fb2a8139630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.532+0000 7fb2ae400640 1 --2- 172.21.15.29:0/716517144 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2a806c150 0x7fb2a80ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.532+0000 7fb2ae400640 1 -- 172.21.15.29:0/716517144 >> 172.21.15.29:0/716517144 conn(0x7fb2a80b3950 msgr2=0x7fb2a80acb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.532+0000 7fb2ae400640 1 -- 172.21.15.29:0/716517144 shutdown_connections 2024-01-24T13:03:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.532+0000 7fb2ae400640 1 -- 172.21.15.29:0/716517144 wait complete. 2024-01-24T13:03:52.553 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:03:52.553 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:03:52.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.696+0000 7fca3a200640 1 Processor -- start 2024-01-24T13:03:52.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.696+0000 7fca3a200640 1 -- start start 2024-01-24T13:03:52.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.696+0000 7fca3a200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3413d4b0 0x7fca34165130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:52.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.696+0000 7fca3a200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3415b4f0 con 0x7fca3406be20 2024-01-24T13:03:52.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.696+0000 7fca3a200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3415b7d0 con 0x7fca3406c200 2024-01-24T13:03:52.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.696+0000 7fca3a200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca340cd0c0 con 0x7fca3413d4b0 2024-01-24T13:03:52.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.696+0000 7fca33400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fca3406be20 0x7fca3415a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33360/0 (socket says 172.21.15.29:33360) 2024-01-24T13:03:52.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.696+0000 7fca33400640 1 -- 172.21.15.29:0/1156303473 learned_addr learned my addr 172.21.15.29:0/1156303473 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:03:52.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.696+0000 7fca33e00640 1 --2- 172.21.15.29:0/1156303473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3413d4b0 0x7fca34165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:52.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.696+0000 7fca32000640 1 -- 172.21.15.29:0/1156303473 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716582886 0 0) 0x7fca3415b4f0 con 0x7fca3406be20 2024-01-24T13:03:52.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.696+0000 7fca32000640 1 -- 172.21.15.29:0/1156303473 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca14003530 con 0x7fca3406be20 2024-01-24T13:03:52.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.696+0000 7fca32000640 1 -- 172.21.15.29:0/1156303473 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141330378 0 0) 0x7fca3415b7d0 con 0x7fca3406c200 2024-01-24T13:03:52.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.696+0000 7fca32000640 1 -- 172.21.15.29:0/1156303473 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca3415b4f0 con 0x7fca3406c200 2024-01-24T13:03:52.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.700+0000 7fca33e00640 1 -- 172.21.15.29:0/1156303473 >> v1:172.21.15.163:6789/0 conn(0x7fca3406c200 legacy=0x7fca3413cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.700+0000 7fca33e00640 1 -- 172.21.15.29:0/1156303473 >> v1:172.21.15.29:6789/0 conn(0x7fca3406be20 legacy=0x7fca3415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.700+0000 7fca33e00640 1 -- 172.21.15.29:0/1156303473 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca340cd3a0 con 0x7fca3413d4b0 2024-01-24T13:03:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.700+0000 7fca33e00640 1 --2- 172.21.15.29:0/1156303473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3413d4b0 0x7fca34165130 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009dc0 tx=0x7fca2c01c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a855e27e9bc0c6b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.700+0000 7fca32000640 1 -- 172.21.15.29:0/1156303473 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0a5a50 con 0x7fca3413d4b0 2024-01-24T13:03:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.700+0000 7fca32000640 1 -- 172.21.15.29:0/1156303473 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c0a5bb0 con 0x7fca3413d4b0 2024-01-24T13:03:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.700+0000 7fca32000640 1 -- 172.21.15.29:0/1156303473 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0ad440 con 0x7fca3413d4b0 2024-01-24T13:03:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.700+0000 7fca3a200640 1 -- 172.21.15.29:0/1156303473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3413d4b0 msgr2=0x7fca34165130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.700+0000 7fca3a200640 1 --2- 172.21.15.29:0/1156303473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3413d4b0 0x7fca34165130 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009dc0 tx=0x7fca2c01c930 comp rx=0 tx=0).stop 2024-01-24T13:03:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca3a200640 1 -- 172.21.15.29:0/1156303473 shutdown_connections 2024-01-24T13:03:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca3a200640 1 --2- 172.21.15.29:0/1156303473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3413d4b0 0x7fca34165130 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca3a200640 1 -- 172.21.15.29:0/1156303473 >> 172.21.15.29:0/1156303473 conn(0x7fca3406d700 msgr2=0x7fca34069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca3a200640 1 -- 172.21.15.29:0/1156303473 shutdown_connections 2024-01-24T13:03:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca3a200640 1 -- 172.21.15.29:0/1156303473 wait complete. 2024-01-24T13:03:52.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca3a200640 1 Processor -- start 2024-01-24T13:03:52.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca3a200640 1 -- start start 2024-01-24T13:03:52.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca3a200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3406be20 0x7fca34071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:52.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca3a200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3406c200 0x7fca34137fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:52.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca3a200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca3413d4b0 0x7fca3415c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:52.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca3a200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3414de00 con 0x7fca3406c200 2024-01-24T13:03:52.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca3a200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3415bb40 con 0x7fca3413d4b0 2024-01-24T13:03:52.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca3a200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3406fdc0 con 0x7fca3406be20 2024-01-24T13:03:52.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca32a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3406c200 0x7fca34137fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:52.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca32a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3406c200 0x7fca34137fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40918/0 (socket says 172.21.15.29:40918) 2024-01-24T13:03:52.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca32a00640 1 -- 172.21.15.29:0/3158847537 learned_addr learned my addr 172.21.15.29:0/3158847537 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:52.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca33400640 1 --2- 172.21.15.29:0/3158847537 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3406be20 0x7fca34071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:52.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca33e00640 1 --2- 172.21.15.29:0/3158847537 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca3413d4b0 0x7fca3415c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:52.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca32a00640 1 -- 172.21.15.29:0/3158847537 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3406be20 msgr2=0x7fca34071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca32a00640 1 --2- 172.21.15.29:0/3158847537 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3406be20 0x7fca34071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca32a00640 1 -- 172.21.15.29:0/3158847537 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca3413d4b0 msgr2=0x7fca3415c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca32a00640 1 --2- 172.21.15.29:0/3158847537 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca3413d4b0 0x7fca3415c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.704+0000 7fca32a00640 1 -- 172.21.15.29:0/3158847537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c009a70 con 0x7fca3406c200 2024-01-24T13:03:52.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.708+0000 7fca32a00640 1 --2- 172.21.15.29:0/3158847537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3406c200 0x7fca34137fb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00c500 tx=0x7fca1c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:52.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.708+0000 7fca2b400640 1 -- 172.21.15.29:0/3158847537 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0052d0 con 0x7fca3406c200 2024-01-24T13:03:52.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.708+0000 7fca3a200640 1 -- 172.21.15.29:0/3158847537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca340700a0 con 0x7fca3406c200 2024-01-24T13:03:52.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.708+0000 7fca2b400640 1 -- 172.21.15.29:0/3158847537 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c005450 con 0x7fca3406c200 2024-01-24T13:03:52.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.708+0000 7fca2b400640 1 -- 172.21.15.29:0/3158847537 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c012870 con 0x7fca3406c200 2024-01-24T13:03:52.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.708+0000 7fca3a200640 1 -- 172.21.15.29:0/3158847537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca341384f0 con 0x7fca3406c200 2024-01-24T13:03:52.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.708+0000 7fca3a200640 1 -- 172.21.15.29:0/3158847537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3415bfd0 con 0x7fca3406c200 2024-01-24T13:03:52.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.708+0000 7fca2b400640 1 -- 172.21.15.29:0/3158847537 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fca1c0129d0 con 0x7fca3406c200 2024-01-24T13:03:52.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.708+0000 7fca2b400640 1 --2- 172.21.15.29:0/3158847537 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca0c065a90 0x7fca0c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:52.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.708+0000 7fca2b400640 1 -- 172.21.15.29:0/3158847537 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fca1c0828d0 con 0x7fca3406c200 2024-01-24T13:03:52.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.708+0000 7fca33400640 1 --2- 172.21.15.29:0/3158847537 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca0c065a90 0x7fca0c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:52.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.712+0000 7fca33400640 1 --2- 172.21.15.29:0/3158847537 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca0c065a90 0x7fca0c067f50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca240011f0 tx=0x7fca24007d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:52.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.712+0000 7fca2b400640 1 -- 172.21.15.29:0/3158847537 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fca3415bfd0 con 0x7fca3406c200 2024-01-24T13:03:52.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.868+0000 7fca3a200640 1 -- 172.21.15.29:0/3158847537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca3415bfd0 con 0x7fca3406c200 2024-01-24T13:03:52.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.868+0000 7fca2b400640 1 -- 172.21.15.29:0/3158847537 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca3415bfd0 con 0x7fca3406c200 2024-01-24T13:03:52.872 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:03:52.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.872+0000 7fca3a200640 1 -- 172.21.15.29:0/3158847537 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca0c065a90 msgr2=0x7fca0c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.872+0000 7fca3a200640 1 --2- 172.21.15.29:0/3158847537 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca0c065a90 0x7fca0c067f50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca240011f0 tx=0x7fca24007d40 comp rx=0 tx=0).stop 2024-01-24T13:03:52.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.872+0000 7fca3a200640 1 -- 172.21.15.29:0/3158847537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3406c200 msgr2=0x7fca34137fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:52.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.872+0000 7fca3a200640 1 --2- 172.21.15.29:0/3158847537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3406c200 0x7fca34137fb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00c500 tx=0x7fca1c00c9c0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.872+0000 7fca3a200640 1 -- 172.21.15.29:0/3158847537 shutdown_connections 2024-01-24T13:03:52.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.872+0000 7fca3a200640 1 --2- 172.21.15.29:0/3158847537 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca0c065a90 0x7fca0c067f50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.872+0000 7fca3a200640 1 --2- 172.21.15.29:0/3158847537 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca3413d4b0 0x7fca3415c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.872+0000 7fca3a200640 1 --2- 172.21.15.29:0/3158847537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3406c200 0x7fca34137fb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.872+0000 7fca3a200640 1 --2- 172.21.15.29:0/3158847537 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3406be20 0x7fca34071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:52.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.872+0000 7fca3a200640 1 -- 172.21.15.29:0/3158847537 >> 172.21.15.29:0/3158847537 conn(0x7fca3406d700 msgr2=0x7fca34159490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:52.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.872+0000 7fca3a200640 1 -- 172.21.15.29:0/3158847537 shutdown_connections 2024-01-24T13:03:52.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:52.872+0000 7fca3a200640 1 -- 172.21.15.29:0/3158847537 wait complete. 2024-01-24T13:03:52.895 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-24T13:03:53.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.036+0000 7f13daa00640 1 Processor -- start 2024-01-24T13:03:53.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.036+0000 7f13daa00640 1 -- start start 2024-01-24T13:03:53.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.036+0000 7f13daa00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f13d40c3ef0 0x7f13d40ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:53.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.036+0000 7f13daa00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d40cfe50 con 0x7f13d415a630 2024-01-24T13:03:53.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.036+0000 7f13daa00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d40cb3c0 con 0x7f13d40caf30 2024-01-24T13:03:53.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.036+0000 7f13daa00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d40cf380 con 0x7f13d40c3ef0 2024-01-24T13:03:53.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.036+0000 7f13d3e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f13d415a630 0x7f13d40cdf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33370/0 (socket says 172.21.15.29:33370) 2024-01-24T13:03:53.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.036+0000 7f13d3e00640 1 -- 172.21.15.29:0/370684031 learned_addr learned my addr 172.21.15.29:0/370684031 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:03:53.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.036+0000 7f13d3400640 1 --2- 172.21.15.29:0/370684031 >> v2:172.21.15.163:3300/0 conn(0x7f13d40c3ef0 0x7f13d40ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:53.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.036+0000 7f13d2a00640 1 -- 172.21.15.29:0/370684031 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66878769 0 0) 0x7f13d40cfe50 con 0x7f13d415a630 2024-01-24T13:03:53.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.036+0000 7f13d2a00640 1 -- 172.21.15.29:0/370684031 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b4003530 con 0x7f13d415a630 2024-01-24T13:03:53.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.036+0000 7f13d3400640 1 -- 172.21.15.29:0/370684031 >> v1:172.21.15.163:6789/0 conn(0x7f13d40caf30 legacy=0x7f13d40d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:53.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.036+0000 7f13d3400640 1 -- 172.21.15.29:0/370684031 >> v1:172.21.15.29:6789/0 conn(0x7f13d415a630 legacy=0x7f13d40cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:53.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.036+0000 7f13d3400640 1 -- 172.21.15.29:0/370684031 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d415aa10 con 0x7f13d40c3ef0 2024-01-24T13:03:53.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.040+0000 7f13d3400640 1 --2- 172.21.15.29:0/370684031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d40c3ef0 0x7f13d40ca9f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0097c0 tx=0x7f13bc01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4ff3bd28d675ce8 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:53.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.040+0000 7f13d2a00640 1 -- 172.21.15.29:0/370684031 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0ab660 con 0x7f13d40c3ef0 2024-01-24T13:03:53.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.040+0000 7f13d2a00640 1 -- 172.21.15.29:0/370684031 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc0ab7c0 con 0x7f13d40c3ef0 2024-01-24T13:03:53.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.040+0000 7f13d2a00640 1 -- 172.21.15.29:0/370684031 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0abb50 con 0x7f13d40c3ef0 2024-01-24T13:03:53.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.040+0000 7f13daa00640 1 -- 172.21.15.29:0/370684031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d40c3ef0 msgr2=0x7f13d40ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:53.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.040+0000 7f13daa00640 1 --2- 172.21.15.29:0/370684031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d40c3ef0 0x7f13d40ca9f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0097c0 tx=0x7f13bc01c460 comp rx=0 tx=0).stop 2024-01-24T13:03:53.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.040+0000 7f13daa00640 1 -- 172.21.15.29:0/370684031 shutdown_connections 2024-01-24T13:03:53.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.040+0000 7f13daa00640 1 --2- 172.21.15.29:0/370684031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d40c3ef0 0x7f13d40ca9f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:53.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.040+0000 7f13daa00640 1 -- 172.21.15.29:0/370684031 >> 172.21.15.29:0/370684031 conn(0x7f13d4070570 msgr2=0x7f13d4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:53.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13daa00640 1 -- 172.21.15.29:0/370684031 shutdown_connections 2024-01-24T13:03:53.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13daa00640 1 -- 172.21.15.29:0/370684031 wait complete. 2024-01-24T13:03:53.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13daa00640 1 Processor -- start 2024-01-24T13:03:53.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13daa00640 1 -- start start 2024-01-24T13:03:53.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13daa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d40c3ef0 0x7f13d40c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:53.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13daa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f13d40caf30 0x7f13d414d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:53.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13daa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13d415a630 0x7f13d414b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:53.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13daa00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40c8380 con 0x7f13d415a630 2024-01-24T13:03:53.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13daa00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40c48b0 con 0x7f13d40c3ef0 2024-01-24T13:03:53.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13daa00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40c4b90 con 0x7f13d40caf30 2024-01-24T13:03:53.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13d8a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13d415a630 0x7f13d414b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13d8a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13d415a630 0x7f13d414b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40924/0 (socket says 172.21.15.29:40924) 2024-01-24T13:03:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13d8a00640 1 -- 172.21.15.29:0/3980231021 learned_addr learned my addr 172.21.15.29:0/3980231021 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13d3e00640 1 --2- 172.21.15.29:0/3980231021 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d40c3ef0 0x7f13d40c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13d3400640 1 --2- 172.21.15.29:0/3980231021 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f13d40caf30 0x7f13d414d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13d8a00640 1 -- 172.21.15.29:0/3980231021 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f13d40caf30 msgr2=0x7f13d414d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13d8a00640 1 --2- 172.21.15.29:0/3980231021 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f13d40caf30 0x7f13d414d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13d8a00640 1 -- 172.21.15.29:0/3980231021 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d40c3ef0 msgr2=0x7f13d40c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13d8a00640 1 --2- 172.21.15.29:0/3980231021 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d40c3ef0 0x7f13d40c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13d8a00640 1 -- 172.21.15.29:0/3980231021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc009420 con 0x7f13d415a630 2024-01-24T13:03:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13d8a00640 1 --2- 172.21.15.29:0/3980231021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13d415a630 0x7f13d414b9a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00c770 tx=0x7f13cc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13cbe00640 1 -- 172.21.15.29:0/3980231021 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc003b80 con 0x7f13d415a630 2024-01-24T13:03:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13cbe00640 1 -- 172.21.15.29:0/3980231021 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc003ce0 con 0x7f13d415a630 2024-01-24T13:03:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13cbe00640 1 -- 172.21.15.29:0/3980231021 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc00aa90 con 0x7f13d415a630 2024-01-24T13:03:53.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.044+0000 7f13daa00640 1 -- 172.21.15.29:0/3980231021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d40c4e70 con 0x7f13d415a630 2024-01-24T13:03:53.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.048+0000 7f13daa00640 1 -- 172.21.15.29:0/3980231021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d414ccb0 con 0x7f13d415a630 2024-01-24T13:03:53.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.048+0000 7f13daa00640 1 -- 172.21.15.29:0/3980231021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d404e850 con 0x7f13d415a630 2024-01-24T13:03:53.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.048+0000 7f13cbe00640 1 -- 172.21.15.29:0/3980231021 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f13cc00abf0 con 0x7f13d415a630 2024-01-24T13:03:53.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.048+0000 7f13cbe00640 1 --2- 172.21.15.29:0/3980231021 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f13ac065a90 0x7f13ac067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:53.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.048+0000 7f13cbe00640 1 -- 172.21.15.29:0/3980231021 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f13cc082b90 con 0x7f13d415a630 2024-01-24T13:03:53.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.048+0000 7f13d3e00640 1 --2- 172.21.15.29:0/3980231021 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f13ac065a90 0x7f13ac067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:53.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.052+0000 7f13d3e00640 1 --2- 172.21.15.29:0/3980231021 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f13ac065a90 0x7f13ac067f50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f13c40011f0 tx=0x7f13c4007d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.052+0000 7f13cbe00640 1 -- 172.21.15.29:0/3980231021 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f13cc0508b0 con 0x7f13d415a630 2024-01-24T13:03:53.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.212+0000 7f13daa00640 1 -- 172.21.15.29:0/3980231021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f13d40c3cd0 con 0x7f13d415a630 2024-01-24T13:03:53.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.212+0000 7f13cbe00640 1 -- 172.21.15.29:0/3980231021 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7f13cc053ed0 con 0x7f13d415a630 2024-01-24T13:03:53.215 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:03:53.215 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2024-01-24T13:03:53.215 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:03:53.215 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2024-01-24T13:03:53.215 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2024-01-24T13:03:53.215 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:03:53.215 INFO:teuthology.orchestra.run.smithi029.stdout:] 2024-01-24T13:03:53.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.216+0000 7f13daa00640 1 -- 172.21.15.29:0/3980231021 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f13ac065a90 msgr2=0x7f13ac067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:53.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.216+0000 7f13daa00640 1 --2- 172.21.15.29:0/3980231021 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f13ac065a90 0x7f13ac067f50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f13c40011f0 tx=0x7f13c4007d40 comp rx=0 tx=0).stop 2024-01-24T13:03:53.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.216+0000 7f13daa00640 1 -- 172.21.15.29:0/3980231021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13d415a630 msgr2=0x7f13d414b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:53.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.216+0000 7f13daa00640 1 --2- 172.21.15.29:0/3980231021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13d415a630 0x7f13d414b9a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00c770 tx=0x7f13cc00cc30 comp rx=0 tx=0).stop 2024-01-24T13:03:53.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.216+0000 7f13daa00640 1 -- 172.21.15.29:0/3980231021 shutdown_connections 2024-01-24T13:03:53.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.216+0000 7f13daa00640 1 --2- 172.21.15.29:0/3980231021 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f13ac065a90 0x7f13ac067f50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:53.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.216+0000 7f13daa00640 1 --2- 172.21.15.29:0/3980231021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13d415a630 0x7f13d414b9a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:53.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.216+0000 7f13daa00640 1 --2- 172.21.15.29:0/3980231021 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f13d40caf30 0x7f13d414d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:53.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.216+0000 7f13daa00640 1 --2- 172.21.15.29:0/3980231021 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d40c3ef0 0x7f13d40c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:53.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.216+0000 7f13daa00640 1 -- 172.21.15.29:0/3980231021 >> 172.21.15.29:0/3980231021 conn(0x7f13d4070570 msgr2=0x7f13d40b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:53.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.216+0000 7f13daa00640 1 -- 172.21.15.29:0/3980231021 shutdown_connections 2024-01-24T13:03:53.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.216+0000 7f13daa00640 1 -- 172.21.15.29:0/3980231021 wait complete. 2024-01-24T13:03:53.236 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-24T13:03:53.237 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-24T13:03:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5bb000640 1 Processor -- start 2024-01-24T13:03:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5bb000640 1 -- start start 2024-01-24T13:03:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5bb000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff5b41532d0 0x7ff5b40c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5bb000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b40c8d40 0x7ff5b415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5bb000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b4070910 con 0x7ff5b415cd30 2024-01-24T13:03:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5bb000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b41536b0 con 0x7ff5b41532d0 2024-01-24T13:03:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5bb000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b415d2b0 con 0x7ff5b40c8d40 2024-01-24T13:03:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5b3400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b40c8d40 0x7ff5b415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5b3e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff5b41532d0 0x7ff5b40c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5b3e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff5b41532d0 0x7ff5b40c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:46246/0 (socket says 172.21.15.29:46246) 2024-01-24T13:03:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5b3e00640 1 -- 172.21.15.29:0/2630186798 learned_addr learned my addr 172.21.15.29:0/2630186798 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5b9000640 1 --1- 172.21.15.29:0/2630186798 >> v1:172.21.15.163:6789/0 conn(0x7ff5b415cd30 0x7ff5b4070da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:37174/0 (socket says 172.21.15.29:37174) 2024-01-24T13:03:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5b3e00640 1 -- 172.21.15.29:0/2630186798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b40c8d40 msgr2=0x7ff5b415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5b3e00640 1 --2- 172.21.15.29:0/2630186798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b40c8d40 0x7ff5b415c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5b3e00640 1 -- 172.21.15.29:0/2630186798 >> v1:172.21.15.163:6789/0 conn(0x7ff5b415cd30 legacy=0x7ff5b4070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.380+0000 7ff5b3e00640 1 -- 172.21.15.29:0/2630186798 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b415d590 con 0x7ff5b41532d0 2024-01-24T13:03:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.384+0000 7ff5b3e00640 1 --2- 172.21.15.29:0/2630186798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b41532d0 0x7ff5b40c8800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4008120 tx=0x7ff5a401c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1497c2269c382967 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.384+0000 7ff5b2a00640 1 -- 172.21.15.29:0/2630186798 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4004230 con 0x7ff5b41532d0 2024-01-24T13:03:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.384+0000 7ff5b2a00640 1 -- 172.21.15.29:0/2630186798 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4004390 con 0x7ff5b41532d0 2024-01-24T13:03:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.384+0000 7ff5b2a00640 1 -- 172.21.15.29:0/2630186798 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4003820 con 0x7ff5b41532d0 2024-01-24T13:03:53.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.384+0000 7ff5bb000640 1 -- 172.21.15.29:0/2630186798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b41532d0 msgr2=0x7ff5b40c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:53.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.384+0000 7ff5bb000640 1 --2- 172.21.15.29:0/2630186798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b41532d0 0x7ff5b40c8800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4008120 tx=0x7ff5a401c7b0 comp rx=0 tx=0).stop 2024-01-24T13:03:53.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.384+0000 7ff5bb000640 1 -- 172.21.15.29:0/2630186798 shutdown_connections 2024-01-24T13:03:53.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.384+0000 7ff5bb000640 1 --2- 172.21.15.29:0/2630186798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b40c8d40 0x7ff5b415c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:53.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.384+0000 7ff5bb000640 1 --2- 172.21.15.29:0/2630186798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b41532d0 0x7ff5b40c8800 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:53.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.384+0000 7ff5bb000640 1 -- 172.21.15.29:0/2630186798 >> 172.21.15.29:0/2630186798 conn(0x7ff5b406a0d0 msgr2=0x7ff5b406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:53.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.384+0000 7ff5bb000640 1 -- 172.21.15.29:0/2630186798 shutdown_connections 2024-01-24T13:03:53.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.384+0000 7ff5bb000640 1 -- 172.21.15.29:0/2630186798 wait complete. 2024-01-24T13:03:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5bb000640 1 Processor -- start 2024-01-24T13:03:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5bb000640 1 -- start start 2024-01-24T13:03:53.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5bb000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b40c8d40 0x7ff5b414faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:53.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5bb000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b41532d0 0x7ff5b414f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:53.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5bb000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b415cd30 0x7ff5b4157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:53.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5bb000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b415bc00 con 0x7ff5b40c8d40 2024-01-24T13:03:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5bb000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b415bee0 con 0x7ff5b41532d0 2024-01-24T13:03:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5bb000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b415c1c0 con 0x7ff5b415cd30 2024-01-24T13:03:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5b3e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b40c8d40 0x7ff5b414faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5b3e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b40c8d40 0x7ff5b414faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40926/0 (socket says 172.21.15.29:40926) 2024-01-24T13:03:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5b3e00640 1 -- 172.21.15.29:0/815742181 learned_addr learned my addr 172.21.15.29:0/815742181 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5b3400640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b41532d0 0x7ff5b414f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5b9000640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b415cd30 0x7ff5b4157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5b3e00640 1 -- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b415cd30 msgr2=0x7ff5b4157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5b3e00640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b415cd30 0x7ff5b4157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5b3e00640 1 -- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b41532d0 msgr2=0x7ff5b414f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5b3e00640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b41532d0 0x7ff5b414f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:53.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5b3e00640 1 -- 172.21.15.29:0/815742181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a400a580 con 0x7ff5b40c8d40 2024-01-24T13:03:53.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5b3400640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b41532d0 0x7ff5b414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:03:53.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5b3e00640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b40c8d40 0x7ff5b414faa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff5a401a3e0 tx=0x7ff5a4019550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:53.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5abe00640 1 -- 172.21.15.29:0/815742181 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40bd070 con 0x7ff5b40c8d40 2024-01-24T13:03:53.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5abe00640 1 -- 172.21.15.29:0/815742181 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4003e80 con 0x7ff5b40c8d40 2024-01-24T13:03:53.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5bb000640 1 -- 172.21.15.29:0/815742181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b40c6170 con 0x7ff5b40c8d40 2024-01-24T13:03:53.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5abe00640 1 -- 172.21.15.29:0/815742181 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4004500 con 0x7ff5b40c8d40 2024-01-24T13:03:53.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.388+0000 7ff5bb000640 1 -- 172.21.15.29:0/815742181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b414f8f0 con 0x7ff5b40c8d40 2024-01-24T13:03:53.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.392+0000 7ff5bb000640 1 -- 172.21.15.29:0/815742181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b404e000 con 0x7ff5b40c8d40 2024-01-24T13:03:53.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.392+0000 7ff5abe00640 1 -- 172.21.15.29:0/815742181 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff5a4004030 con 0x7ff5b40c8d40 2024-01-24T13:03:53.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.392+0000 7ff5abe00640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff58c065a90 0x7ff58c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:53.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.392+0000 7ff5abe00640 1 -- 172.21.15.29:0/815742181 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff5a411d640 con 0x7ff5b40c8d40 2024-01-24T13:03:53.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.392+0000 7ff5b3400640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff58c065a90 0x7ff58c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:53.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.392+0000 7ff5b3400640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff58c065a90 0x7ff58c067f50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5b41f8450 tx=0x7ff59c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:53.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.396+0000 7ff5abe00640 1 -- 172.21.15.29:0/815742181 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff5a40eb2d0 con 0x7ff5b40c8d40 2024-01-24T13:03:53.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:53.556+0000 7ff5bb000640 1 -- 172.21.15.29:0/815742181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff5b415bd40 con 0x7ff5b40c8d40 2024-01-24T13:03:54.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.560+0000 7ff5abe00640 1 -- 172.21.15.29:0/815742181 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff5b415bd40 con 0x7ff5b40c8d40 2024-01-24T13:03:54.561 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2024-01-24T13:03:54.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.564+0000 7ff5bb000640 1 -- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff58c065a90 msgr2=0x7ff58c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:54.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.564+0000 7ff5bb000640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff58c065a90 0x7ff58c067f50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5b41f8450 tx=0x7ff59c008040 comp rx=0 tx=0).stop 2024-01-24T13:03:54.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.564+0000 7ff5bb000640 1 -- 172.21.15.29:0/815742181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b40c8d40 msgr2=0x7ff5b414faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:54.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.564+0000 7ff5bb000640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b40c8d40 0x7ff5b414faa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff5a401a3e0 tx=0x7ff5a4019550 comp rx=0 tx=0).stop 2024-01-24T13:03:54.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.564+0000 7ff5bb000640 1 -- 172.21.15.29:0/815742181 shutdown_connections 2024-01-24T13:03:54.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.564+0000 7ff5bb000640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff58c065a90 0x7ff58c067f50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:54.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.564+0000 7ff5bb000640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b415cd30 0x7ff5b4157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:54.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.564+0000 7ff5bb000640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b41532d0 0x7ff5b414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:54.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.564+0000 7ff5bb000640 1 --2- 172.21.15.29:0/815742181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b40c8d40 0x7ff5b414faa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:54.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.564+0000 7ff5bb000640 1 -- 172.21.15.29:0/815742181 >> 172.21.15.29:0/815742181 conn(0x7ff5b406a0d0 msgr2=0x7ff5b40c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:54.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.564+0000 7ff5bb000640 1 -- 172.21.15.29:0/815742181 shutdown_connections 2024-01-24T13:03:54.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.564+0000 7ff5bb000640 1 -- 172.21.15.29:0/815742181 wait complete. 2024-01-24T13:03:54.594 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-01-24T13:03:54.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.744+0000 7f35a0e00640 1 Processor -- start 2024-01-24T13:03:54.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.744+0000 7f35a0e00640 1 -- start start 2024-01-24T13:03:54.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.744+0000 7f35a0e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f359c06be20 0x7f359c15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:54.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.744+0000 7f35a0e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c15b4f0 con 0x7f359c13d4b0 2024-01-24T13:03:54.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.744+0000 7f35a0e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c15b7d0 con 0x7f359c06c200 2024-01-24T13:03:54.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.744+0000 7f35a0e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0cd0c0 con 0x7f359c06be20 2024-01-24T13:03:54.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.744+0000 7f359a800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f359c13d4b0 0x7f359c0cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33386/0 (socket says 172.21.15.29:33386) 2024-01-24T13:03:54.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.744+0000 7f359a800640 1 -- 172.21.15.29:0/609315568 learned_addr learned my addr 172.21.15.29:0/609315568 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:03:54.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.748+0000 7f3599e00640 1 --2- 172.21.15.29:0/609315568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f359c06be20 0x7f359c15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:54.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.748+0000 7f3598a00640 1 -- 172.21.15.29:0/609315568 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692047634 0 0) 0x7f359c15b4f0 con 0x7f359c13d4b0 2024-01-24T13:03:54.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.748+0000 7f3598a00640 1 -- 172.21.15.29:0/609315568 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f357c003530 con 0x7f359c13d4b0 2024-01-24T13:03:54.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.748+0000 7f3598a00640 1 -- 172.21.15.29:0/609315568 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834299042 0 0) 0x7f359c15b7d0 con 0x7f359c06c200 2024-01-24T13:03:54.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.748+0000 7f3598a00640 1 -- 172.21.15.29:0/609315568 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f359c15b4f0 con 0x7f359c06c200 2024-01-24T13:03:54.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.748+0000 7f3599e00640 1 -- 172.21.15.29:0/609315568 >> v1:172.21.15.163:6789/0 conn(0x7f359c06c200 legacy=0x7f359c13cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:54.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.748+0000 7f3599e00640 1 -- 172.21.15.29:0/609315568 >> v1:172.21.15.29:6789/0 conn(0x7f359c13d4b0 legacy=0x7f359c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:54.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.748+0000 7f3599e00640 1 -- 172.21.15.29:0/609315568 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c0cd3a0 con 0x7f359c06be20 2024-01-24T13:03:54.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.748+0000 7f3599e00640 1 --2- 172.21.15.29:0/609315568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f359c06be20 0x7f359c15a9c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f358c0097f0 tx=0x7f358c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6046b65d03c3f8e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:54.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.748+0000 7f3598a00640 1 -- 172.21.15.29:0/609315568 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0ac630 con 0x7f359c06be20 2024-01-24T13:03:54.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.748+0000 7f3598a00640 1 -- 172.21.15.29:0/609315568 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c0ac790 con 0x7f359c06be20 2024-01-24T13:03:54.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.748+0000 7f3598a00640 1 -- 172.21.15.29:0/609315568 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0acb20 con 0x7f359c06be20 2024-01-24T13:03:54.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 -- 172.21.15.29:0/609315568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f359c06be20 msgr2=0x7f359c15a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:54.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 --2- 172.21.15.29:0/609315568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f359c06be20 0x7f359c15a9c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f358c0097f0 tx=0x7f358c01c480 comp rx=0 tx=0).stop 2024-01-24T13:03:54.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 -- 172.21.15.29:0/609315568 shutdown_connections 2024-01-24T13:03:54.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 --2- 172.21.15.29:0/609315568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f359c06be20 0x7f359c15a9c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:54.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 -- 172.21.15.29:0/609315568 >> 172.21.15.29:0/609315568 conn(0x7f359c06d700 msgr2=0x7f359c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:54.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 -- 172.21.15.29:0/609315568 shutdown_connections 2024-01-24T13:03:54.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 -- 172.21.15.29:0/609315568 wait complete. 2024-01-24T13:03:54.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 Processor -- start 2024-01-24T13:03:54.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 -- start start 2024-01-24T13:03:54.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c06be20 0x7f359c14a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:54.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f359c06c200 0x7f359c070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:54.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f359c13d4b0 0x7f359c0711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:54.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c14b950 con 0x7f359c06be20 2024-01-24T13:03:54.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c14b0b0 con 0x7f359c06c200 2024-01-24T13:03:54.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f35a0e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c14b390 con 0x7f359c13d4b0 2024-01-24T13:03:54.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f3599e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c06be20 0x7f359c14a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:54.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f3599e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c06be20 0x7f359c14a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40938/0 (socket says 172.21.15.29:40938) 2024-01-24T13:03:54.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.752+0000 7f3599e00640 1 -- 172.21.15.29:0/595465069 learned_addr learned my addr 172.21.15.29:0/595465069 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:54.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f359a800640 1 --2- 172.21.15.29:0/595465069 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f359c13d4b0 0x7f359c0711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:54.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f3599400640 1 --2- 172.21.15.29:0/595465069 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f359c06c200 0x7f359c070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:54.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f3599e00640 1 -- 172.21.15.29:0/595465069 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f359c13d4b0 msgr2=0x7f359c0711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:54.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f3599e00640 1 --2- 172.21.15.29:0/595465069 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f359c13d4b0 0x7f359c0711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:54.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f3599e00640 1 -- 172.21.15.29:0/595465069 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f359c06c200 msgr2=0x7f359c070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:54.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f3599e00640 1 --2- 172.21.15.29:0/595465069 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f359c06c200 0x7f359c070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:54.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f3599e00640 1 -- 172.21.15.29:0/595465069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c009420 con 0x7f359c06be20 2024-01-24T13:03:54.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f3599e00640 1 --2- 172.21.15.29:0/595465069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c06be20 0x7f359c14a760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f358c019090 tx=0x7f358c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:54.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f3592000640 1 -- 172.21.15.29:0/595465069 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0b8650 con 0x7f359c06be20 2024-01-24T13:03:54.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f3592000640 1 -- 172.21.15.29:0/595465069 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c0b87d0 con 0x7f359c06be20 2024-01-24T13:03:54.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f35a0e00640 1 -- 172.21.15.29:0/595465069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c14b670 con 0x7f359c06be20 2024-01-24T13:03:54.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f3592000640 1 -- 172.21.15.29:0/595465069 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0b8b80 con 0x7f359c06be20 2024-01-24T13:03:54.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f35a0e00640 1 -- 172.21.15.29:0/595465069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c14aca0 con 0x7f359c06be20 2024-01-24T13:03:54.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f35a0e00640 1 -- 172.21.15.29:0/595465069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c04e850 con 0x7f359c06be20 2024-01-24T13:03:54.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.756+0000 7f3592000640 1 -- 172.21.15.29:0/595465069 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f358c0b8ce0 con 0x7f359c06be20 2024-01-24T13:03:54.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.760+0000 7f3592000640 1 --2- 172.21.15.29:0/595465069 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3574065a60 0x7f3574067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:54.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.760+0000 7f3592000640 1 -- 172.21.15.29:0/595465069 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f358c11d970 con 0x7f359c06be20 2024-01-24T13:03:54.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.760+0000 7f3599400640 1 --2- 172.21.15.29:0/595465069 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3574065a60 0x7f3574067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:54.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.760+0000 7f3599400640 1 --2- 172.21.15.29:0/595465069 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3574065a60 0x7f3574067f20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f359c14ee00 tx=0x7f3584009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:54.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.764+0000 7f3592000640 1 -- 172.21.15.29:0/595465069 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f358c0eb620 con 0x7f359c06be20 2024-01-24T13:03:54.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:54.920+0000 7f35a0e00640 1 -- 172.21.15.29:0/595465069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f359c159fe0 con 0x7f359c06be20 2024-01-24T13:03:55.166 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:03:55.170 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:03:55.576 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2024-01-24T13:03:55.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.572+0000 7f3592000640 1 -- 172.21.15.29:0/595465069 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f358c0a80d0 con 0x7f359c06be20 2024-01-24T13:03:55.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.584+0000 7f35a0e00640 1 -- 172.21.15.29:0/595465069 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3574065a60 msgr2=0x7f3574067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:55.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.584+0000 7f35a0e00640 1 --2- 172.21.15.29:0/595465069 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3574065a60 0x7f3574067f20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f359c14ee00 tx=0x7f3584009040 comp rx=0 tx=0).stop 2024-01-24T13:03:55.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.584+0000 7f35a0e00640 1 -- 172.21.15.29:0/595465069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c06be20 msgr2=0x7f359c14a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:55.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.584+0000 7f35a0e00640 1 --2- 172.21.15.29:0/595465069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c06be20 0x7f359c14a760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f358c019090 tx=0x7f358c01acc0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.588+0000 7f35a0e00640 1 -- 172.21.15.29:0/595465069 shutdown_connections 2024-01-24T13:03:55.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.588+0000 7f35a0e00640 1 --2- 172.21.15.29:0/595465069 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3574065a60 0x7f3574067f20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.588+0000 7f35a0e00640 1 --2- 172.21.15.29:0/595465069 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f359c13d4b0 0x7f359c0711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.588+0000 7f35a0e00640 1 --2- 172.21.15.29:0/595465069 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f359c06c200 0x7f359c070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.588+0000 7f35a0e00640 1 --2- 172.21.15.29:0/595465069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c06be20 0x7f359c14a760 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.588+0000 7f35a0e00640 1 -- 172.21.15.29:0/595465069 >> 172.21.15.29:0/595465069 conn(0x7f359c06d700 msgr2=0x7f359c15bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:55.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.588+0000 7f35a0e00640 1 -- 172.21.15.29:0/595465069 shutdown_connections 2024-01-24T13:03:55.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.588+0000 7f35a0e00640 1 -- 172.21.15.29:0/595465069 wait complete. 2024-01-24T13:03:55.624 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-24T13:03:55.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.768+0000 7f325b800640 1 Processor -- start 2024-01-24T13:03:55.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.768+0000 7f325b800640 1 -- start start 2024-01-24T13:03:55.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.768+0000 7f325b800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f32540cd300 0x7f325415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:55.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.768+0000 7f325b800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f32540ce4e0 0x7f32540d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:55.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.768+0000 7f325b800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3254161130 con 0x7f32540ce050 2024-01-24T13:03:55.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.768+0000 7f325b800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325415dbe0 con 0x7f32540cd300 2024-01-24T13:03:55.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.768+0000 7f325b800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32541605b0 con 0x7f32540ce4e0 2024-01-24T13:03:55.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.768+0000 7f3253e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f32540ce050 0x7f32540d0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33398/0 (socket says 172.21.15.29:33398) 2024-01-24T13:03:55.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.768+0000 7f3253e00640 1 -- 172.21.15.29:0/3878887213 learned_addr learned my addr 172.21.15.29:0/3878887213 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:03:55.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.768+0000 7f3258e00640 1 --2- 172.21.15.29:0/3878887213 >> v2:172.21.15.163:3300/0 conn(0x7f32540cd300 0x7f325415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.768+0000 7f3259800640 1 --2- 172.21.15.29:0/3878887213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f32540ce4e0 0x7f32540d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.768+0000 7f3253400640 1 -- 172.21.15.29:0/3878887213 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474706591 0 0) 0x7f3254161130 con 0x7f32540ce050 2024-01-24T13:03:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.768+0000 7f3253400640 1 -- 172.21.15.29:0/3878887213 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3234003530 con 0x7f32540ce050 2024-01-24T13:03:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253400640 1 -- 172.21.15.29:0/3878887213 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2440874620 0 0) 0x7f3234003530 con 0x7f32540ce050 2024-01-24T13:03:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253400640 1 -- 172.21.15.29:0/3878887213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f32540ce4e0 msgr2=0x7f32540d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253400640 1 --2- 172.21.15.29:0/3878887213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f32540ce4e0 0x7f32540d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253400640 1 -- 172.21.15.29:0/3878887213 >> v2:172.21.15.163:3300/0 conn(0x7f32540cd300 msgr2=0x7f325415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253400640 1 --2- 172.21.15.29:0/3878887213 >> v2:172.21.15.163:3300/0 conn(0x7f32540cd300 0x7f325415d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253400640 1 -- 172.21.15.29:0/3878887213 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3254160890 con 0x7f32540ce050 2024-01-24T13:03:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253400640 1 -- 172.21.15.29:0/3878887213 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f323c001680 con 0x7f32540ce050 2024-01-24T13:03:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3258e00640 1 --2- 172.21.15.29:0/3878887213 >> v2:172.21.15.163:3300/0 conn(0x7f32540cd300 0x7f325415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:03:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253400640 1 -- 172.21.15.29:0/3878887213 >> v1:172.21.15.29:6789/0 conn(0x7f32540ce050 legacy=0x7f32540d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253400640 1 --2- 172.21.15.29:0/3878887213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f32540ce4e0 0x7f3234003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253400640 1 --2- 172.21.15.29:0/3878887213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3234003f50 0x7f32340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253400640 1 --2- 172.21.15.29:0/3878887213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3234004d10 0x7f3234005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253400640 1 -- 172.21.15.29:0/3878887213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325415dbe0 con 0x7f3234003f50 2024-01-24T13:03:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253400640 1 -- 172.21.15.29:0/3878887213 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32541605b0 con 0x7f3234004d10 2024-01-24T13:03:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253400640 1 -- 172.21.15.29:0/3878887213 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323400b990 con 0x7f32540ce4e0 2024-01-24T13:03:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253e00640 1 --2- 172.21.15.29:0/3878887213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3234003f50 0x7f32340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3258e00640 1 --2- 172.21.15.29:0/3878887213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f32540ce4e0 0x7f3234003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3259800640 1 --2- 172.21.15.29:0/3878887213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3234004d10 0x7f3234005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253e00640 1 -- 172.21.15.29:0/3878887213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f32540ce4e0 msgr2=0x7f3234003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253e00640 1 --2- 172.21.15.29:0/3878887213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f32540ce4e0 0x7f3234003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253e00640 1 -- 172.21.15.29:0/3878887213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3234004d10 msgr2=0x7f3234005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253e00640 1 --2- 172.21.15.29:0/3878887213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3234004d10 0x7f3234005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253e00640 1 -- 172.21.15.29:0/3878887213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3234003530 con 0x7f3234003f50 2024-01-24T13:03:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3259800640 1 --2- 172.21.15.29:0/3878887213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3234004d10 0x7f3234005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:03:55.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.772+0000 7f3253e00640 1 --2- 172.21.15.29:0/3878887213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3234003f50 0x7f32340047d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c140 tx=0x7f323c01f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6cf6b5cdc249b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:55.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.776+0000 7f3253400640 1 -- 172.21.15.29:0/3878887213 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c005ae0 con 0x7f3234003f50 2024-01-24T13:03:55.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.776+0000 7f3253400640 1 -- 172.21.15.29:0/3878887213 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c0ab070 con 0x7f3234003f50 2024-01-24T13:03:55.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.776+0000 7f3253400640 1 -- 172.21.15.29:0/3878887213 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c007070 con 0x7f3234003f50 2024-01-24T13:03:55.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.776+0000 7f325b800640 1 -- 172.21.15.29:0/3878887213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3234003f50 msgr2=0x7f32340047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:55.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.776+0000 7f325b800640 1 --2- 172.21.15.29:0/3878887213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3234003f50 0x7f32340047d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c140 tx=0x7f323c01f2f0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.776+0000 7f3259800640 1 -- 172.21.15.29:0/3878887213 reap_dead start 2024-01-24T13:03:55.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.776+0000 7f325b800640 1 -- 172.21.15.29:0/3878887213 shutdown_connections 2024-01-24T13:03:55.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.776+0000 7f325b800640 1 -- 172.21.15.29:0/3878887213 >> 172.21.15.29:0/3878887213 conn(0x7f3254069cd0 msgr2=0x7f325406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:55.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.776+0000 7f325b800640 1 -- 172.21.15.29:0/3878887213 shutdown_connections 2024-01-24T13:03:55.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.776+0000 7f325b800640 1 -- 172.21.15.29:0/3878887213 wait complete. 2024-01-24T13:03:55.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.776+0000 7f325b800640 1 Processor -- start 2024-01-24T13:03:55.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.776+0000 7f325b800640 1 -- start start 2024-01-24T13:03:55.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f325b800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3234003f50 0x7f3254151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:55.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f325b800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f32540c6c20 0x7f32540b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:55.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f325b800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32540c70a0 0x7f32540b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f325b800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32541f2e50 con 0x7f32540c70a0 2024-01-24T13:03:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f325b800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32540c5e60 con 0x7f32540c6c20 2024-01-24T13:03:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f325b800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32540c6140 con 0x7f3234003f50 2024-01-24T13:03:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3259800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32540c70a0 0x7f32540b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3259800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32540c70a0 0x7f32540b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40966/0 (socket says 172.21.15.29:40966) 2024-01-24T13:03:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3259800640 1 -- 172.21.15.29:0/2678715961 learned_addr learned my addr 172.21.15.29:0/2678715961 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3253e00640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f32540c6c20 0x7f32540b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3258e00640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3234003f50 0x7f3254151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3259800640 1 -- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3234003f50 msgr2=0x7f3254151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3259800640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3234003f50 0x7f3254151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3259800640 1 -- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f32540c6c20 msgr2=0x7f32540b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3259800640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f32540c6c20 0x7f32540b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3259800640 1 -- 172.21.15.29:0/2678715961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32540c6420 con 0x7f32540c70a0 2024-01-24T13:03:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3258e00640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3234003f50 0x7f3254151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:03:55.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3259800640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32540c70a0 0x7f32540b50e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32541606f0 tx=0x7f324c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:55.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3250c00640 1 -- 172.21.15.29:0/2678715961 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00e050 con 0x7f32540c70a0 2024-01-24T13:03:55.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3250c00640 1 -- 172.21.15.29:0/2678715961 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c00f040 con 0x7f32540c70a0 2024-01-24T13:03:55.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f325b800640 1 -- 172.21.15.29:0/2678715961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32540c6700 con 0x7f32540c70a0 2024-01-24T13:03:55.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3250c00640 1 -- 172.21.15.29:0/2678715961 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c0039a0 con 0x7f32540c70a0 2024-01-24T13:03:55.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f325b800640 1 -- 172.21.15.29:0/2678715961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3254152060 con 0x7f32540c70a0 2024-01-24T13:03:55.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f325b800640 1 -- 172.21.15.29:0/2678715961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325404e850 con 0x7f32540c70a0 2024-01-24T13:03:55.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.780+0000 7f3250c00640 1 -- 172.21.15.29:0/2678715961 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f324c015440 con 0x7f32540c70a0 2024-01-24T13:03:55.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.784+0000 7f3250c00640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f322c065a90 0x7f322c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:55.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.784+0000 7f3250c00640 1 -- 172.21.15.29:0/2678715961 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f324c083660 con 0x7f32540c70a0 2024-01-24T13:03:55.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.784+0000 7f3258e00640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f322c065a90 0x7f322c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:55.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.784+0000 7f3258e00640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f322c065a90 0x7f322c067f50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3244009ce0 tx=0x7f3244008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:55.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.788+0000 7f3250c00640 1 -- 172.21.15.29:0/2678715961 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f324c051070 con 0x7f32540c70a0 2024-01-24T13:03:55.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.976+0000 7f325b800640 1 -- 172.21.15.29:0/2678715961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f325406a5b0 con 0x7f32540c70a0 2024-01-24T13:03:55.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.984+0000 7f3250c00640 1 -- 172.21.15.29:0/2678715961 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f324c054690 con 0x7f32540c70a0 2024-01-24T13:03:55.988 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 2 and data pool 3 2024-01-24T13:03:55.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.992+0000 7f325b800640 1 -- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f322c065a90 msgr2=0x7f322c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:55.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.992+0000 7f325b800640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f322c065a90 0x7f322c067f50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3244009ce0 tx=0x7f3244008040 comp rx=0 tx=0).stop 2024-01-24T13:03:55.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.992+0000 7f325b800640 1 -- 172.21.15.29:0/2678715961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32540c70a0 msgr2=0x7f32540b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:55.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.992+0000 7f325b800640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32540c70a0 0x7f32540b50e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32541606f0 tx=0x7f324c010590 comp rx=0 tx=0).stop 2024-01-24T13:03:55.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.992+0000 7f325b800640 1 -- 172.21.15.29:0/2678715961 shutdown_connections 2024-01-24T13:03:55.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.992+0000 7f325b800640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f322c065a90 0x7f322c067f50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.992+0000 7f325b800640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32540c70a0 0x7f32540b50e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.992+0000 7f325b800640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f32540c6c20 0x7f32540b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.992+0000 7f325b800640 1 --2- 172.21.15.29:0/2678715961 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3234003f50 0x7f3254151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:55.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.992+0000 7f325b800640 1 -- 172.21.15.29:0/2678715961 >> 172.21.15.29:0/2678715961 conn(0x7f3254069cd0 msgr2=0x7f32540c3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:55.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.996+0000 7f325b800640 1 -- 172.21.15.29:0/2678715961 shutdown_connections 2024-01-24T13:03:55.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:55.996+0000 7f325b800640 1 -- 172.21.15.29:0/2678715961 wait complete. 2024-01-24T13:03:56.035 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-01-24T13:03:56.036 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-01-24T13:03:56.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24c3800640 1 Processor -- start 2024-01-24T13:03:56.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24c3800640 1 -- start start 2024-01-24T13:03:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24c3800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f24bc15a340 0x7f24bc15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24c3800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f24bc0b00c0 0x7f24bc0b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24c3800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24bc0c8a10 0x7f24bc0c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24c3800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24bc0b0a90 con 0x7f24bc0b00c0 2024-01-24T13:03:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24c3800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24bc15b6f0 con 0x7f24bc15a340 2024-01-24T13:03:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24c3800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc15b9d0 con 0x7f24bc0c8a10 2024-01-24T13:03:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24bbe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f24bc0b00c0 0x7f24bc0b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24bbe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f24bc0b00c0 0x7f24bc0b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40970/0 (socket says 172.21.15.29:40970) 2024-01-24T13:03:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24bbe00640 1 -- 172.21.15.29:0/471882885 learned_addr learned my addr 172.21.15.29:0/471882885 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24c1800640 1 --2- 172.21.15.29:0/471882885 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24bc0c8a10 0x7f24bc0c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24c0e00640 1 --2- 172.21.15.29:0/471882885 >> v2:172.21.15.163:3300/0 conn(0x7f24bc15a340 0x7f24bc15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24bbe00640 1 -- 172.21.15.29:0/471882885 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24bc0c8a10 msgr2=0x7f24bc0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24bbe00640 1 --2- 172.21.15.29:0/471882885 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24bc0c8a10 0x7f24bc0c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24bbe00640 1 -- 172.21.15.29:0/471882885 >> v2:172.21.15.163:3300/0 conn(0x7f24bc15a340 msgr2=0x7f24bc15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24bbe00640 1 --2- 172.21.15.29:0/471882885 >> v2:172.21.15.163:3300/0 conn(0x7f24bc15a340 0x7f24bc15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:56.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.180+0000 7f24bbe00640 1 -- 172.21.15.29:0/471882885 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc15e100 con 0x7f24bc0b00c0 2024-01-24T13:03:56.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.184+0000 7f24bbe00640 1 --2- 172.21.15.29:0/471882885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24bc0b00c0 0x7f24bc0b0550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f24bc06dda0 tx=0x7f24a401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c03dd0ab34dad6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:56.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.184+0000 7f24bb400640 1 -- 172.21.15.29:0/471882885 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a40aa5f0 con 0x7f24bc0b00c0 2024-01-24T13:03:56.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.184+0000 7f24bb400640 1 -- 172.21.15.29:0/471882885 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a40aa750 con 0x7f24bc0b00c0 2024-01-24T13:03:56.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.184+0000 7f24bb400640 1 -- 172.21.15.29:0/471882885 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a40aaae0 con 0x7f24bc0b00c0 2024-01-24T13:03:56.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.184+0000 7f24c3800640 1 -- 172.21.15.29:0/471882885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24bc0b00c0 msgr2=0x7f24bc0b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:56.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.184+0000 7f24c3800640 1 --2- 172.21.15.29:0/471882885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24bc0b00c0 0x7f24bc0b0550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f24bc06dda0 tx=0x7f24a401c4d0 comp rx=0 tx=0).stop 2024-01-24T13:03:56.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.184+0000 7f24c3800640 1 -- 172.21.15.29:0/471882885 shutdown_connections 2024-01-24T13:03:56.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.184+0000 7f24c3800640 1 --2- 172.21.15.29:0/471882885 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24bc0c8a10 0x7f24bc0c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:56.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.184+0000 7f24c3800640 1 --2- 172.21.15.29:0/471882885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24bc0b00c0 0x7f24bc0b0550 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:56.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.184+0000 7f24c3800640 1 --2- 172.21.15.29:0/471882885 >> v2:172.21.15.163:3300/0 conn(0x7f24bc15a340 0x7f24bc15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:56.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.184+0000 7f24c3800640 1 -- 172.21.15.29:0/471882885 >> 172.21.15.29:0/471882885 conn(0x7f24bc06a0d0 msgr2=0x7f24bc06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:56.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.184+0000 7f24c3800640 1 -- 172.21.15.29:0/471882885 shutdown_connections 2024-01-24T13:03:56.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.184+0000 7f24c3800640 1 -- 172.21.15.29:0/471882885 wait complete. 2024-01-24T13:03:56.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24c3800640 1 Processor -- start 2024-01-24T13:03:56.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24c3800640 1 -- start start 2024-01-24T13:03:56.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24c3800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24bc0b00c0 0x7f24bc0aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:56.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24c3800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24bc0c8a10 0x7f24bc140520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:56.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24c3800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24bc15a340 0x7f24bc0aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:56.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24c3800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc140a90 con 0x7f24bc0c8a10 2024-01-24T13:03:56.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24c3800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc0ac800 con 0x7f24bc0b00c0 2024-01-24T13:03:56.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24c3800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc0c5320 con 0x7f24bc15a340 2024-01-24T13:03:56.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24bbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24bc0c8a10 0x7f24bc140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:56.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24bbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24bc0c8a10 0x7f24bc140520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40980/0 (socket says 172.21.15.29:40980) 2024-01-24T13:03:56.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24bbe00640 1 -- 172.21.15.29:0/3871255019 learned_addr learned my addr 172.21.15.29:0/3871255019 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:56.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24c1800640 1 --2- 172.21.15.29:0/3871255019 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24bc15a340 0x7f24bc0aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:56.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24c0e00640 1 --2- 172.21.15.29:0/3871255019 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24bc0b00c0 0x7f24bc0aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:56.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24bbe00640 1 -- 172.21.15.29:0/3871255019 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24bc15a340 msgr2=0x7f24bc0aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:56.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24bbe00640 1 --2- 172.21.15.29:0/3871255019 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24bc15a340 0x7f24bc0aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:56.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24bbe00640 1 -- 172.21.15.29:0/3871255019 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24bc0b00c0 msgr2=0x7f24bc0aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:56.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24bbe00640 1 --2- 172.21.15.29:0/3871255019 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24bc0b00c0 0x7f24bc0aca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:56.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24bbe00640 1 -- 172.21.15.29:0/3871255019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a40094d0 con 0x7f24bc0c8a10 2024-01-24T13:03:56.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24bbe00640 1 --2- 172.21.15.29:0/3871255019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24bc0c8a10 0x7f24bc140520 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f24a401ab80 tx=0x7f24a401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:56.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24b8c00640 1 -- 172.21.15.29:0/3871255019 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a40bd5f0 con 0x7f24bc0c8a10 2024-01-24T13:03:56.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24b8c00640 1 -- 172.21.15.29:0/3871255019 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a40bd750 con 0x7f24bc0c8a10 2024-01-24T13:03:56.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24b8c00640 1 -- 172.21.15.29:0/3871255019 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a40bdac0 con 0x7f24bc0c8a10 2024-01-24T13:03:56.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.188+0000 7f24c3800640 1 -- 172.21.15.29:0/3871255019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24bc0c5600 con 0x7f24bc0c8a10 2024-01-24T13:03:56.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.192+0000 7f24c3800640 1 -- 172.21.15.29:0/3871255019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24bc146790 con 0x7f24bc0c8a10 2024-01-24T13:03:56.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.192+0000 7f24c3800640 1 -- 172.21.15.29:0/3871255019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24bc071f70 con 0x7f24bc0c8a10 2024-01-24T13:03:56.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.192+0000 7f24b8c00640 1 -- 172.21.15.29:0/3871255019 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f24a40b33f0 con 0x7f24bc0c8a10 2024-01-24T13:03:56.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.192+0000 7f24b8c00640 1 --2- 172.21.15.29:0/3871255019 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2494065a60 0x7f2494067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:56.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.192+0000 7f24b8c00640 1 -- 172.21.15.29:0/3871255019 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24a40a7070 con 0x7f24bc0c8a10 2024-01-24T13:03:56.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.192+0000 7f24c0e00640 1 --2- 172.21.15.29:0/3871255019 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2494065a60 0x7f2494067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:56.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.196+0000 7f24c0e00640 1 --2- 172.21.15.29:0/3871255019 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2494065a60 0x7f2494067f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009ac0 tx=0x7f24ac009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:56.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.196+0000 7f24b8c00640 1 -- 172.21.15.29:0/3871255019 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f24a40eb7e0 con 0x7f24bc0c8a10 2024-01-24T13:03:56.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.360+0000 7f24c3800640 1 -- 172.21.15.29:0/3871255019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f24bc0c5460 con 0x7f24bc0c8a10 2024-01-24T13:03:56.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.992+0000 7f24b8c00640 1 -- 172.21.15.29:0/3871255019 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7f24bc0c5460 con 0x7f24bc0c8a10 2024-01-24T13:03:56.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.992+0000 7f24c3800640 1 -- 172.21.15.29:0/3871255019 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2494065a60 msgr2=0x7f2494067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:56.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.992+0000 7f24c3800640 1 --2- 172.21.15.29:0/3871255019 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2494065a60 0x7f2494067f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009ac0 tx=0x7f24ac009190 comp rx=0 tx=0).stop 2024-01-24T13:03:56.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.992+0000 7f24c3800640 1 -- 172.21.15.29:0/3871255019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24bc0c8a10 msgr2=0x7f24bc140520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:56.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.992+0000 7f24c3800640 1 --2- 172.21.15.29:0/3871255019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24bc0c8a10 0x7f24bc140520 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f24a401ab80 tx=0x7f24a401ad10 comp rx=0 tx=0).stop 2024-01-24T13:03:56.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.996+0000 7f24c3800640 1 -- 172.21.15.29:0/3871255019 shutdown_connections 2024-01-24T13:03:56.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.996+0000 7f24c3800640 1 --2- 172.21.15.29:0/3871255019 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2494065a60 0x7f2494067f20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:56.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.996+0000 7f24c3800640 1 --2- 172.21.15.29:0/3871255019 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24bc15a340 0x7f24bc0aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:56.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.996+0000 7f24c3800640 1 --2- 172.21.15.29:0/3871255019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24bc0c8a10 0x7f24bc140520 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:56.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.996+0000 7f24c3800640 1 --2- 172.21.15.29:0/3871255019 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24bc0b00c0 0x7f24bc0aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:56.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.996+0000 7f24c3800640 1 -- 172.21.15.29:0/3871255019 >> 172.21.15.29:0/3871255019 conn(0x7f24bc06a0d0 msgr2=0x7f24bc06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:56.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.996+0000 7f24c3800640 1 -- 172.21.15.29:0/3871255019 shutdown_connections 2024-01-24T13:03:56.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:56.996+0000 7f24c3800640 1 -- 172.21.15.29:0/3871255019 wait complete. 2024-01-24T13:03:57.019 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-01-24T13:03:57.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffae2e00640 1 Processor -- start 2024-01-24T13:03:57.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffae2e00640 1 -- start start 2024-01-24T13:03:57.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffae2e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ffadc15a710 0x7ffadc0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:57.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffae2e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffadc0cfc50 0x7ffadc0cac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffae2e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffadc0cb1c0 0x7ffadc06f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffae2e00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffadc0cb650 con 0x7ffadc0cfc50 2024-01-24T13:03:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffae2e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffadc15aaf0 con 0x7ffadc15a710 2024-01-24T13:03:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffae2e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0b20b0 con 0x7ffadc0cb1c0 2024-01-24T13:03:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffadb400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffadc0cfc50 0x7ffadc0cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffadb400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffadc0cfc50 0x7ffadc0cac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40992/0 (socket says 172.21.15.29:40992) 2024-01-24T13:03:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffadb400640 1 -- 172.21.15.29:0/1929602769 learned_addr learned my addr 172.21.15.29:0/1929602769 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffadbe00640 1 --2- 172.21.15.29:0/1929602769 >> v2:172.21.15.163:3300/0 conn(0x7ffadc15a710 0x7ffadc0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffae0e00640 1 --2- 172.21.15.29:0/1929602769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffadc0cb1c0 0x7ffadc06f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffadb400640 1 -- 172.21.15.29:0/1929602769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffadc0cb1c0 msgr2=0x7ffadc06f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:57.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffadb400640 1 --2- 172.21.15.29:0/1929602769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffadc0cb1c0 0x7ffadc06f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:57.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffadb400640 1 -- 172.21.15.29:0/1929602769 >> v2:172.21.15.163:3300/0 conn(0x7ffadc15a710 msgr2=0x7ffadc0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:03:57.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffadb400640 1 --2- 172.21.15.29:0/1929602769 >> v2:172.21.15.163:3300/0 conn(0x7ffadc15a710 0x7ffadc0cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:57.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffadb400640 1 -- 172.21.15.29:0/1929602769 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc0b6630 con 0x7ffadc0cfc50 2024-01-24T13:03:57.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffadbe00640 1 --2- 172.21.15.29:0/1929602769 >> v2:172.21.15.163:3300/0 conn(0x7ffadc15a710 0x7ffadc0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:03:57.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.168+0000 7ffae0e00640 1 --2- 172.21.15.29:0/1929602769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffadc0cb1c0 0x7ffadc06f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:03:57.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.172+0000 7ffadb400640 1 --2- 172.21.15.29:0/1929602769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffadc0cfc50 0x7ffadc0cac80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffadc06ac60 tx=0x7ffac401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acb68cb956d6e94 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:57.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.172+0000 7ffadaa00640 1 -- 172.21.15.29:0/1929602769 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac40ab600 con 0x7ffadc0cfc50 2024-01-24T13:03:57.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.172+0000 7ffadaa00640 1 -- 172.21.15.29:0/1929602769 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac40a7050 con 0x7ffadc0cfc50 2024-01-24T13:03:57.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.172+0000 7ffadaa00640 1 -- 172.21.15.29:0/1929602769 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac40ab980 con 0x7ffadc0cfc50 2024-01-24T13:03:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.172+0000 7ffae2e00640 1 -- 172.21.15.29:0/1929602769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffadc0cfc50 msgr2=0x7ffadc0cac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.172+0000 7ffae2e00640 1 --2- 172.21.15.29:0/1929602769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffadc0cfc50 0x7ffadc0cac80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffadc06ac60 tx=0x7ffac401c240 comp rx=0 tx=0).stop 2024-01-24T13:03:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.172+0000 7ffae2e00640 1 -- 172.21.15.29:0/1929602769 shutdown_connections 2024-01-24T13:03:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.172+0000 7ffae2e00640 1 --2- 172.21.15.29:0/1929602769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffadc0cb1c0 0x7ffadc06f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.172+0000 7ffae2e00640 1 --2- 172.21.15.29:0/1929602769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffadc0cfc50 0x7ffadc0cac80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.172+0000 7ffae2e00640 1 --2- 172.21.15.29:0/1929602769 >> v2:172.21.15.163:3300/0 conn(0x7ffadc15a710 0x7ffadc0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.172+0000 7ffae2e00640 1 -- 172.21.15.29:0/1929602769 >> 172.21.15.29:0/1929602769 conn(0x7ffadc0cd0b0 msgr2=0x7ffadc0cd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffae2e00640 1 -- 172.21.15.29:0/1929602769 shutdown_connections 2024-01-24T13:03:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffae2e00640 1 -- 172.21.15.29:0/1929602769 wait complete. 2024-01-24T13:03:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffae2e00640 1 Processor -- start 2024-01-24T13:03:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffae2e00640 1 -- start start 2024-01-24T13:03:57.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffae2e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffadc0cb1c0 0x7ffadc155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:57.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffae2e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffadc0cfc50 0x7ffadc14d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:57.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffae2e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffadc15a710 0x7ffadc158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:57.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffae2e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc1f4a50 con 0x7ffadc0cfc50 2024-01-24T13:03:57.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffae2e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc156010 con 0x7ffadc15a710 2024-01-24T13:03:57.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffae2e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc1f4cd0 con 0x7ffadc0cb1c0 2024-01-24T13:03:57.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffadb400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffadc0cfc50 0x7ffadc14d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:57.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffadb400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffadc0cfc50 0x7ffadc14d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40996/0 (socket says 172.21.15.29:40996) 2024-01-24T13:03:57.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffadb400640 1 -- 172.21.15.29:0/1003868365 learned_addr learned my addr 172.21.15.29:0/1003868365 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:57.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffae0e00640 1 --2- 172.21.15.29:0/1003868365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffadc15a710 0x7ffadc158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:57.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffadbe00640 1 --2- 172.21.15.29:0/1003868365 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffadc0cb1c0 0x7ffadc155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:57.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffadb400640 1 -- 172.21.15.29:0/1003868365 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffadc0cb1c0 msgr2=0x7ffadc155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffadb400640 1 --2- 172.21.15.29:0/1003868365 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffadc0cb1c0 0x7ffadc155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffadb400640 1 -- 172.21.15.29:0/1003868365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffadc15a710 msgr2=0x7ffadc158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffadb400640 1 --2- 172.21.15.29:0/1003868365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffadc15a710 0x7ffadc158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffadb400640 1 -- 172.21.15.29:0/1003868365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac40094d0 con 0x7ffadc0cfc50 2024-01-24T13:03:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.176+0000 7ffadb400640 1 --2- 172.21.15.29:0/1003868365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffadc0cfc50 0x7ffadc14d1f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffac401a8f0 tx=0x7ffac4018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.180+0000 7ffad3e00640 1 -- 172.21.15.29:0/1003868365 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac40b37d0 con 0x7ffadc0cfc50 2024-01-24T13:03:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.180+0000 7ffad3e00640 1 -- 172.21.15.29:0/1003868365 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac40a4e90 con 0x7ffadc0cfc50 2024-01-24T13:03:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.180+0000 7ffad3e00640 1 -- 172.21.15.29:0/1003868365 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac40b3b70 con 0x7ffadc0cfc50 2024-01-24T13:03:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.180+0000 7ffae2e00640 1 -- 172.21.15.29:0/1003868365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffadc1f4fb0 con 0x7ffadc0cfc50 2024-01-24T13:03:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.180+0000 7ffae2e00640 1 -- 172.21.15.29:0/1003868365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffadc1f5570 con 0x7ffadc0cfc50 2024-01-24T13:03:57.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.180+0000 7ffae2e00640 1 -- 172.21.15.29:0/1003868365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffadc04e850 con 0x7ffadc0cfc50 2024-01-24T13:03:57.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.180+0000 7ffad3e00640 1 -- 172.21.15.29:0/1003868365 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffac40b2070 con 0x7ffadc0cfc50 2024-01-24T13:03:57.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.180+0000 7ffad3e00640 1 --2- 172.21.15.29:0/1003868365 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ffab4065a60 0x7ffab4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:57.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.180+0000 7ffad3e00640 1 -- 172.21.15.29:0/1003868365 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5935+0+0 (secure 0 0 0) 0x7ffac411d170 con 0x7ffadc0cfc50 2024-01-24T13:03:57.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.180+0000 7ffadbe00640 1 --2- 172.21.15.29:0/1003868365 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ffab4065a60 0x7ffab4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:57.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.184+0000 7ffadbe00640 1 --2- 172.21.15.29:0/1003868365 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ffab4065a60 0x7ffab4067f20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffacc006fd0 tx=0x7ffacc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:57.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.184+0000 7ffad3e00640 1 -- 172.21.15.29:0/1003868365 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ffac40eab00 con 0x7ffadc0cfc50 2024-01-24T13:03:57.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:57.344+0000 7ffae2e00640 1 -- 172.21.15.29:0/1003868365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ffadc066dd0 con 0x7ffadc0cfc50 2024-01-24T13:03:59.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.000+0000 7ffad3e00640 1 -- 172.21.15.29:0/1003868365 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7ffadc066dd0 con 0x7ffadc0cfc50 2024-01-24T13:03:59.003 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data_ec' created 2024-01-24T13:03:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.004+0000 7ffae2e00640 1 -- 172.21.15.29:0/1003868365 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ffab4065a60 msgr2=0x7ffab4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.004+0000 7ffae2e00640 1 --2- 172.21.15.29:0/1003868365 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ffab4065a60 0x7ffab4067f20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffacc006fd0 tx=0x7ffacc008040 comp rx=0 tx=0).stop 2024-01-24T13:03:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.004+0000 7ffae2e00640 1 -- 172.21.15.29:0/1003868365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffadc0cfc50 msgr2=0x7ffadc14d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.004+0000 7ffae2e00640 1 --2- 172.21.15.29:0/1003868365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffadc0cfc50 0x7ffadc14d1f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffac401a8f0 tx=0x7ffac4018fe0 comp rx=0 tx=0).stop 2024-01-24T13:03:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.004+0000 7ffae2e00640 1 -- 172.21.15.29:0/1003868365 shutdown_connections 2024-01-24T13:03:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.004+0000 7ffae2e00640 1 --2- 172.21.15.29:0/1003868365 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ffab4065a60 0x7ffab4067f20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.004+0000 7ffae2e00640 1 --2- 172.21.15.29:0/1003868365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffadc15a710 0x7ffadc158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.004+0000 7ffae2e00640 1 --2- 172.21.15.29:0/1003868365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffadc0cfc50 0x7ffadc14d1f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.004+0000 7ffae2e00640 1 --2- 172.21.15.29:0/1003868365 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffadc0cb1c0 0x7ffadc155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.004+0000 7ffae2e00640 1 -- 172.21.15.29:0/1003868365 >> 172.21.15.29:0/1003868365 conn(0x7ffadc0cd0b0 msgr2=0x7ffadc0b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.008+0000 7ffae2e00640 1 -- 172.21.15.29:0/1003868365 shutdown_connections 2024-01-24T13:03:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.008+0000 7ffae2e00640 1 -- 172.21.15.29:0/1003868365 wait complete. 2024-01-24T13:03:59.038 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-01-24T13:03:59.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.184+0000 7fef21800640 1 Processor -- start 2024-01-24T13:03:59.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.184+0000 7fef21800640 1 -- start start 2024-01-24T13:03:59.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.184+0000 7fef21800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fef1c0d0150 0x7fef1c0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:59.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.184+0000 7fef21800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1c0d05e0 con 0x7fef1c0cd460 2024-01-24T13:03:59.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.184+0000 7fef21800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1c0ce9e0 con 0x7fef1c0ce5c0 2024-01-24T13:03:59.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.184+0000 7fef21800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1c0d0830 con 0x7fef1c0d0150 2024-01-24T13:03:59.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.188+0000 7fef1aa00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fef1c0cd460 0x7fef1c15d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33408/0 (socket says 172.21.15.29:33408) 2024-01-24T13:03:59.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.188+0000 7fef1aa00640 1 -- 172.21.15.29:0/1588408301 learned_addr learned my addr 172.21.15.29:0/1588408301 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:03:59.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.188+0000 7fef1a000640 1 --2- 172.21.15.29:0/1588408301 >> v2:172.21.15.163:3300/0 conn(0x7fef1c0d0150 0x7fef1c0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:59.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.188+0000 7fef19600640 1 -- 172.21.15.29:0/1588408301 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658295726 0 0) 0x7fef1c0d05e0 con 0x7fef1c0cd460 2024-01-24T13:03:59.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.188+0000 7fef19600640 1 -- 172.21.15.29:0/1588408301 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feefc003530 con 0x7fef1c0cd460 2024-01-24T13:03:59.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.188+0000 7fef1a000640 1 -- 172.21.15.29:0/1588408301 >> v1:172.21.15.163:6789/0 conn(0x7fef1c0ce5c0 legacy=0x7fef1c06b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:59.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.188+0000 7fef1a000640 1 -- 172.21.15.29:0/1588408301 >> v1:172.21.15.29:6789/0 conn(0x7fef1c0cd460 legacy=0x7fef1c15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:59.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.188+0000 7fef19600640 1 -- 172.21.15.29:0/1588408301 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2475853647 0 0) 0x7feefc003530 con 0x7fef1c0cd460 2024-01-24T13:03:59.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.188+0000 7fef1a000640 1 -- 172.21.15.29:0/1588408301 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c0d0b10 con 0x7fef1c0d0150 2024-01-24T13:03:59.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.192+0000 7fef1a000640 1 --2- 172.21.15.29:0/1588408301 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c0d0150 0x7fef1c0ce080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef040097c0 tx=0x7fef0401c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31cace8dac52d3c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:59.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.192+0000 7fef19600640 1 -- 172.21.15.29:0/1588408301 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c001680 con 0x7fef1c0d0150 2024-01-24T13:03:59.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.192+0000 7fef19600640 1 -- 172.21.15.29:0/1588408301 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef040a7050 con 0x7fef1c0d0150 2024-01-24T13:03:59.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.192+0000 7fef19600640 1 -- 172.21.15.29:0/1588408301 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef040ab620 con 0x7fef1c0d0150 2024-01-24T13:03:59.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.192+0000 7fef21800640 1 -- 172.21.15.29:0/1588408301 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c0d0150 msgr2=0x7fef1c0ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:59.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.192+0000 7fef21800640 1 --2- 172.21.15.29:0/1588408301 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c0d0150 0x7fef1c0ce080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef040097c0 tx=0x7fef0401c2e0 comp rx=0 tx=0).stop 2024-01-24T13:03:59.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.192+0000 7fef21800640 1 -- 172.21.15.29:0/1588408301 shutdown_connections 2024-01-24T13:03:59.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.192+0000 7fef21800640 1 --2- 172.21.15.29:0/1588408301 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c0d0150 0x7fef1c0ce080 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:59.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.192+0000 7fef21800640 1 -- 172.21.15.29:0/1588408301 >> 172.21.15.29:0/1588408301 conn(0x7fef1c069cd0 msgr2=0x7fef1c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:03:59.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.192+0000 7fef21800640 1 -- 172.21.15.29:0/1588408301 shutdown_connections 2024-01-24T13:03:59.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.192+0000 7fef21800640 1 -- 172.21.15.29:0/1588408301 wait complete. 2024-01-24T13:03:59.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.192+0000 7fef21800640 1 Processor -- start 2024-01-24T13:03:59.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.192+0000 7fef21800640 1 -- start start 2024-01-24T13:03:59.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef21800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef1c0cd460 0x7fef1c0b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:59.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef21800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fef1c0ce5c0 0x7fef1c14ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:59.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef21800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c0d0150 0x7fef1c0b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:59.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef21800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c158aa0 con 0x7fef1c0cd460 2024-01-24T13:03:59.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef21800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c155190 con 0x7fef1c0d0150 2024-01-24T13:03:59.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef21800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c155470 con 0x7fef1c0ce5c0 2024-01-24T13:03:59.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef1aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef1c0cd460 0x7fef1c0b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:59.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef1aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef1c0cd460 0x7fef1c0b5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41010/0 (socket says 172.21.15.29:41010) 2024-01-24T13:03:59.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef1aa00640 1 -- 172.21.15.29:0/3694295694 learned_addr learned my addr 172.21.15.29:0/3694295694 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:03:59.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef1a000640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fef1c0ce5c0 0x7fef1c14ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:59.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef1b400640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c0d0150 0x7fef1c0b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:59.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef1aa00640 1 -- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fef1c0ce5c0 msgr2=0x7fef1c14ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:59.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef1aa00640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fef1c0ce5c0 0x7fef1c14ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:59.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef1aa00640 1 -- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c0d0150 msgr2=0x7fef1c0b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:03:59.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef1aa00640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c0d0150 0x7fef1c0b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:03:59.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef1aa00640 1 -- 172.21.15.29:0/3694295694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef04009420 con 0x7fef1c0cd460 2024-01-24T13:03:59.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef1a000640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fef1c0ce5c0 0x7fef1c14ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:03:59.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef1b400640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c0d0150 0x7fef1c0b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:03:59.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef1aa00640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef1c0cd460 0x7fef1c0b5ec0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00c730 tx=0x7fef0c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:59.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef12a00640 1 -- 172.21.15.29:0/3694295694 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c005ae0 con 0x7fef1c0cd460 2024-01-24T13:03:59.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef12a00640 1 -- 172.21.15.29:0/3694295694 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0c005c40 con 0x7fef1c0cd460 2024-01-24T13:03:59.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef21800640 1 -- 172.21.15.29:0/3694295694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1c155750 con 0x7fef1c0cd460 2024-01-24T13:03:59.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef12a00640 1 -- 172.21.15.29:0/3694295694 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0072b0 con 0x7fef1c0cd460 2024-01-24T13:03:59.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef21800640 1 -- 172.21.15.29:0/3694295694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1c156560 con 0x7fef1c0cd460 2024-01-24T13:03:59.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef21800640 1 -- 172.21.15.29:0/3694295694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1c04e000 con 0x7fef1c0cd460 2024-01-24T13:03:59.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.196+0000 7fef12a00640 1 -- 172.21.15.29:0/3694295694 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fef0c007410 con 0x7fef1c0cd460 2024-01-24T13:03:59.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.200+0000 7fef12a00640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feef4065a60 0x7feef4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:03:59.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.200+0000 7fef12a00640 1 -- 172.21.15.29:0/3694295694 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fef0c082c50 con 0x7fef1c0cd460 2024-01-24T13:03:59.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.200+0000 7fef1a000640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feef4065a60 0x7feef4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:03:59.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.200+0000 7fef1a000640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feef4065a60 0x7feef4067f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fef040ad000 tx=0x7fef04008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:03:59.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.204+0000 7fef12a00640 1 -- 172.21.15.29:0/3694295694 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fef0c088020 con 0x7fef1c0cd460 2024-01-24T13:03:59.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:03:59.364+0000 7fef21800640 1 -- 172.21.15.29:0/3694295694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fef1c158ec0 con 0x7fef1c0cd460 2024-01-24T13:04:00.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.008+0000 7fef12a00640 1 -- 172.21.15.29:0/3694295694 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fef0c0170c0 con 0x7fef1c0cd460 2024-01-24T13:04:00.014 INFO:teuthology.orchestra.run.smithi029.stderr:set pool 4 allow_ec_overwrites to true 2024-01-24T13:04:00.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.024+0000 7fef21800640 1 -- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feef4065a60 msgr2=0x7feef4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:00.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.024+0000 7fef21800640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feef4065a60 0x7feef4067f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fef040ad000 tx=0x7fef04008040 comp rx=0 tx=0).stop 2024-01-24T13:04:00.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.024+0000 7fef21800640 1 -- 172.21.15.29:0/3694295694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef1c0cd460 msgr2=0x7fef1c0b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:00.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.024+0000 7fef21800640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef1c0cd460 0x7fef1c0b5ec0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00c730 tx=0x7fef0c00cbf0 comp rx=0 tx=0).stop 2024-01-24T13:04:00.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.032+0000 7fef21800640 1 -- 172.21.15.29:0/3694295694 shutdown_connections 2024-01-24T13:04:00.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.032+0000 7fef21800640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feef4065a60 0x7feef4067f20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:00.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.032+0000 7fef21800640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c0d0150 0x7fef1c0b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:00.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.032+0000 7fef21800640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fef1c0ce5c0 0x7fef1c14ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:00.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.032+0000 7fef21800640 1 --2- 172.21.15.29:0/3694295694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef1c0cd460 0x7fef1c0b5ec0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:00.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.032+0000 7fef21800640 1 -- 172.21.15.29:0/3694295694 >> 172.21.15.29:0/3694295694 conn(0x7fef1c069cd0 msgr2=0x7fef1c15ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.032+0000 7fef21800640 1 -- 172.21.15.29:0/3694295694 shutdown_connections 2024-01-24T13:04:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.032+0000 7fef21800640 1 -- 172.21.15.29:0/3694295694 wait complete. 2024-01-24T13:04:00.068 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-01-24T13:04:00.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.212+0000 7ff9e0000640 1 Processor -- start 2024-01-24T13:04:00.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.212+0000 7ff9e0000640 1 -- start start 2024-01-24T13:04:00.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9e0000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9d815d070 0x7ff9d815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:00.895 INFO:tasks.ceph.mds.b.smithi163.stderr:2024-01-24T13:04:00.891+0000 7f5284800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-24T13:04:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9e0000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d815de00 con 0x7ff9d80ccdb0 2024-01-24T13:04:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9e0000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d80d0250 con 0x7ff9d806ade0 2024-01-24T13:04:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9e0000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d8157380 con 0x7ff9d815d070 2024-01-24T13:04:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9dd600640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff9d80ccdb0 0x7ff9d80cd190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33424/0 (socket says 172.21.15.29:33424) 2024-01-24T13:04:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9dd600640 1 -- 172.21.15.29:0/1747980979 learned_addr learned my addr 172.21.15.29:0/1747980979 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9dcc00640 1 --2- 172.21.15.29:0/1747980979 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9d815d070 0x7ff9d815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9d7e00640 1 -- 172.21.15.29:0/1747980979 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892327681 0 0) 0x7ff9d815de00 con 0x7ff9d80ccdb0 2024-01-24T13:04:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9d7e00640 1 -- 172.21.15.29:0/1747980979 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b8003530 con 0x7ff9d80ccdb0 2024-01-24T13:04:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9d7e00640 1 -- 172.21.15.29:0/1747980979 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826891763 0 0) 0x7ff9d80d0250 con 0x7ff9d806ade0 2024-01-24T13:04:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9d7e00640 1 -- 172.21.15.29:0/1747980979 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9d815de00 con 0x7ff9d806ade0 2024-01-24T13:04:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9dcc00640 1 -- 172.21.15.29:0/1747980979 >> v1:172.21.15.163:6789/0 conn(0x7ff9d806ade0 legacy=0x7ff9d806b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9dcc00640 1 -- 172.21.15.29:0/1747980979 >> v1:172.21.15.29:6789/0 conn(0x7ff9d80ccdb0 legacy=0x7ff9d80cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9d7e00640 1 -- 172.21.15.29:0/1747980979 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1345717142 0 0) 0x7ff9b8003530 con 0x7ff9d80ccdb0 2024-01-24T13:04:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.216+0000 7ff9dcc00640 1 -- 172.21.15.29:0/1747980979 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d80d0530 con 0x7ff9d815d070 2024-01-24T13:04:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.220+0000 7ff9dcc00640 1 --2- 172.21.15.29:0/1747980979 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9d815d070 0x7ff9d815d4f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0013de0 tx=0x7ff9c002d2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb19dd3bd1b37b0c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.220+0000 7ff9d7e00640 1 -- 172.21.15.29:0/1747980979 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8001680 con 0x7ff9d815d070 2024-01-24T13:04:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.220+0000 7ff9d7e00640 1 -- 172.21.15.29:0/1747980979 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c00b8050 con 0x7ff9d815d070 2024-01-24T13:04:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.220+0000 7ff9d7e00640 1 -- 172.21.15.29:0/1747980979 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c00bc600 con 0x7ff9d815d070 2024-01-24T13:04:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.220+0000 7ff9e0000640 1 -- 172.21.15.29:0/1747980979 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9d815d070 msgr2=0x7ff9d815d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.220+0000 7ff9e0000640 1 --2- 172.21.15.29:0/1747980979 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9d815d070 0x7ff9d815d4f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0013de0 tx=0x7ff9c002d2e0 comp rx=0 tx=0).stop 2024-01-24T13:04:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.220+0000 7ff9e0000640 1 -- 172.21.15.29:0/1747980979 shutdown_connections 2024-01-24T13:04:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.220+0000 7ff9e0000640 1 --2- 172.21.15.29:0/1747980979 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9d815d070 0x7ff9d815d4f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.220+0000 7ff9e0000640 1 -- 172.21.15.29:0/1747980979 >> 172.21.15.29:0/1747980979 conn(0x7ff9d80705d0 msgr2=0x7ff9d8069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.220+0000 7ff9e0000640 1 -- 172.21.15.29:0/1747980979 shutdown_connections 2024-01-24T13:04:00.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.220+0000 7ff9e0000640 1 -- 172.21.15.29:0/1747980979 wait complete. 2024-01-24T13:04:00.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.924+0000 7ff9e0000640 1 Processor -- start 2024-01-24T13:04:00.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.924+0000 7ff9e0000640 1 -- start start 2024-01-24T13:04:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9e0000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9d806ade0 0x7ff9d81f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9e0000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9d80ccdb0 0x7ff9d80c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9e0000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9d815d070 0x7ff9d80c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9e0000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80c7960 con 0x7ff9d806ade0 2024-01-24T13:04:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9e0000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80b4d30 con 0x7ff9d80ccdb0 2024-01-24T13:04:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9e0000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80b5010 con 0x7ff9d815d070 2024-01-24T13:04:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9dd600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9d806ade0 0x7ff9d81f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9dd600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9d806ade0 0x7ff9d81f0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36274/0 (socket says 172.21.15.29:36274) 2024-01-24T13:04:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9dd600640 1 -- 172.21.15.29:0/3256500188 learned_addr learned my addr 172.21.15.29:0/3256500188 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9dcc00640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9d80ccdb0 0x7ff9d80c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9de000640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9d815d070 0x7ff9d80c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9dd600640 1 -- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9d815d070 msgr2=0x7ff9d80c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9dd600640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9d815d070 0x7ff9d80c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9dd600640 1 -- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9d80ccdb0 msgr2=0x7ff9d80c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9dd600640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9d80ccdb0 0x7ff9d80c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9dd600640 1 -- 172.21.15.29:0/3256500188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c0013a10 con 0x7ff9d806ade0 2024-01-24T13:04:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9dcc00640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9d80ccdb0 0x7ff9d80c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9dd600640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9d806ade0 0x7ff9d81f0940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800c750 tx=0x7ff9c800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9d5600640 1 -- 172.21.15.29:0/3256500188 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8005af0 con 0x7ff9d806ade0 2024-01-24T13:04:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9d5600640 1 -- 172.21.15.29:0/3256500188 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c8005c50 con 0x7ff9d806ade0 2024-01-24T13:04:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9d5600640 1 -- 172.21.15.29:0/3256500188 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8007070 con 0x7ff9d806ade0 2024-01-24T13:04:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9e0000640 1 -- 172.21.15.29:0/3256500188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d80d1190 con 0x7ff9d806ade0 2024-01-24T13:04:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9e0000640 1 -- 172.21.15.29:0/3256500188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d81574f0 con 0x7ff9d806ade0 2024-01-24T13:04:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.928+0000 7ff9e0000640 1 -- 172.21.15.29:0/3256500188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d80c7450 con 0x7ff9d806ade0 2024-01-24T13:04:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.932+0000 7ff9d5600640 1 -- 172.21.15.29:0/3256500188 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff9c80071d0 con 0x7ff9d806ade0 2024-01-24T13:04:00.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.932+0000 7ff9d5600640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff9b0065a60 0x7ff9b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:00.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.932+0000 7ff9d5600640 1 -- 172.21.15.29:0/3256500188 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6428+0+0 (secure 0 0 0) 0x7ff9c8083240 con 0x7ff9d806ade0 2024-01-24T13:04:00.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.932+0000 7ff9dcc00640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff9b0065a60 0x7ff9b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.932+0000 7ff9dcc00640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff9b0065a60 0x7ff9b0067f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00be000 tx=0x7ff9c00b7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:00.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:00.936+0000 7ff9d5600640 1 -- 172.21.15.29:0/3256500188 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff9d80c7450 con 0x7ff9d806ade0 2024-01-24T13:04:01.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.136+0000 7ff9e0000640 1 -- 172.21.15.29:0/3256500188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7ff9d80c7450 con 0x7ff9d806ade0 2024-01-24T13:04:01.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.140+0000 7ff9d5600640 1 -- 172.21.15.29:0/3256500188 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7ff9d80c7450 con 0x7ff9d806ade0 2024-01-24T13:04:01.144 INFO:teuthology.orchestra.run.smithi029.stderr:added data pool 4 to fsmap 2024-01-24T13:04:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.144+0000 7ff9e0000640 1 -- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff9b0065a60 msgr2=0x7ff9b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.144+0000 7ff9e0000640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff9b0065a60 0x7ff9b0067f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00be000 tx=0x7ff9c00b7000 comp rx=0 tx=0).stop 2024-01-24T13:04:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.144+0000 7ff9e0000640 1 -- 172.21.15.29:0/3256500188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9d806ade0 msgr2=0x7ff9d81f0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.144+0000 7ff9e0000640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9d806ade0 0x7ff9d81f0940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800c750 tx=0x7ff9c800cc10 comp rx=0 tx=0).stop 2024-01-24T13:04:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.144+0000 7ff9e0000640 1 -- 172.21.15.29:0/3256500188 shutdown_connections 2024-01-24T13:04:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.144+0000 7ff9e0000640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff9b0065a60 0x7ff9b0067f20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.144+0000 7ff9e0000640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9d815d070 0x7ff9d80c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.144+0000 7ff9e0000640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9d80ccdb0 0x7ff9d80c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.144+0000 7ff9e0000640 1 --2- 172.21.15.29:0/3256500188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9d806ade0 0x7ff9d81f0940 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.144+0000 7ff9e0000640 1 -- 172.21.15.29:0/3256500188 >> 172.21.15.29:0/3256500188 conn(0x7ff9d80705d0 msgr2=0x7ff9d8155bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:01.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.144+0000 7ff9e0000640 1 -- 172.21.15.29:0/3256500188 shutdown_connections 2024-01-24T13:04:01.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.144+0000 7ff9e0000640 1 -- 172.21.15.29:0/3256500188 wait complete. 2024-01-24T13:04:01.166 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:04:01.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.304+0000 7f558a800640 1 Processor -- start 2024-01-24T13:04:01.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.304+0000 7f558a800640 1 -- start start 2024-01-24T13:04:01.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f558a800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f558415c6f0 0x7f55840d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:01.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f558a800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f55840d0c20 0x7f55840b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:01.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f558a800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55840b4540 0x7f558406ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:01.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f558a800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55840b4970 con 0x7f558415c6f0 2024-01-24T13:04:01.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f558a800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55840d10c0 con 0x7f55840d0c20 2024-01-24T13:04:01.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f558a800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55840d13a0 con 0x7f55840b4540 2024-01-24T13:04:01.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f5583400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f558415c6f0 0x7f55840d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:01.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f5583400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f558415c6f0 0x7f55840d06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36280/0 (socket says 172.21.15.29:36280) 2024-01-24T13:04:01.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f5583400640 1 -- 172.21.15.29:0/830706681 learned_addr learned my addr 172.21.15.29:0/830706681 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:01.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f5583e00640 1 --2- 172.21.15.29:0/830706681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55840b4540 0x7f558406ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:01.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f5582a00640 1 --2- 172.21.15.29:0/830706681 >> v2:172.21.15.163:3300/0 conn(0x7f55840d0c20 0x7f55840b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:01.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f5583400640 1 -- 172.21.15.29:0/830706681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55840b4540 msgr2=0x7f558406ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:01.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f5583400640 1 --2- 172.21.15.29:0/830706681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55840b4540 0x7f558406ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f5583400640 1 -- 172.21.15.29:0/830706681 >> v2:172.21.15.163:3300/0 conn(0x7f55840d0c20 msgr2=0x7f55840b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:01.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f5583400640 1 --2- 172.21.15.29:0/830706681 >> v2:172.21.15.163:3300/0 conn(0x7f55840d0c20 0x7f55840b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f5583400640 1 -- 172.21.15.29:0/830706681 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55840d1680 con 0x7f558415c6f0 2024-01-24T13:04:01.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.308+0000 7f5583400640 1 --2- 172.21.15.29:0/830706681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f558415c6f0 0x7f55840d06e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f55840d0480 tx=0x7f557401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136ff46de8714763 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:01.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f5582000640 1 -- 172.21.15.29:0/830706681 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55740ab600 con 0x7f558415c6f0 2024-01-24T13:04:01.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f5582000640 1 -- 172.21.15.29:0/830706681 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55740a7050 con 0x7f558415c6f0 2024-01-24T13:04:01.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f5582000640 1 -- 172.21.15.29:0/830706681 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55740ab980 con 0x7f558415c6f0 2024-01-24T13:04:01.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 -- 172.21.15.29:0/830706681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f558415c6f0 msgr2=0x7f55840d06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:01.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 --2- 172.21.15.29:0/830706681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f558415c6f0 0x7f55840d06e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f55840d0480 tx=0x7f557401c210 comp rx=0 tx=0).stop 2024-01-24T13:04:01.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 -- 172.21.15.29:0/830706681 shutdown_connections 2024-01-24T13:04:01.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 --2- 172.21.15.29:0/830706681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55840b4540 0x7f558406ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 --2- 172.21.15.29:0/830706681 >> v2:172.21.15.163:3300/0 conn(0x7f55840d0c20 0x7f55840b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 --2- 172.21.15.29:0/830706681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f558415c6f0 0x7f55840d06e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 -- 172.21.15.29:0/830706681 >> 172.21.15.29:0/830706681 conn(0x7f5584071a00 msgr2=0x7f55840cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:01.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 -- 172.21.15.29:0/830706681 shutdown_connections 2024-01-24T13:04:01.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 -- 172.21.15.29:0/830706681 wait complete. 2024-01-24T13:04:01.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 Processor -- start 2024-01-24T13:04:01.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 -- start start 2024-01-24T13:04:01.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55840b4540 0x7f558415a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:01.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55840d0c20 0x7f558415b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:01.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f558415c6f0 0x7f55840b6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:01.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558414eee0 con 0x7f55840d0c20 2024-01-24T13:04:01.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55840c8b60 con 0x7f558415c6f0 2024-01-24T13:04:01.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.312+0000 7f558a800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55840c8880 con 0x7f55840b4540 2024-01-24T13:04:01.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f5582a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55840d0c20 0x7f558415b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:01.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f5582a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55840d0c20 0x7f558415b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36292/0 (socket says 172.21.15.29:36292) 2024-01-24T13:04:01.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f5582a00640 1 -- 172.21.15.29:0/4161609456 learned_addr learned my addr 172.21.15.29:0/4161609456 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:01.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f5583400640 1 --2- 172.21.15.29:0/4161609456 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55840b4540 0x7f558415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:01.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f5583e00640 1 --2- 172.21.15.29:0/4161609456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f558415c6f0 0x7f55840b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:01.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f5582a00640 1 -- 172.21.15.29:0/4161609456 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55840b4540 msgr2=0x7f558415a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:01.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f5582a00640 1 --2- 172.21.15.29:0/4161609456 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55840b4540 0x7f558415a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f5582a00640 1 -- 172.21.15.29:0/4161609456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f558415c6f0 msgr2=0x7f55840b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:01.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f5582a00640 1 --2- 172.21.15.29:0/4161609456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f558415c6f0 0x7f55840b6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f5582a00640 1 -- 172.21.15.29:0/4161609456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55740094d0 con 0x7f55840d0c20 2024-01-24T13:04:01.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f5582a00640 1 --2- 172.21.15.29:0/4161609456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55840d0c20 0x7f558415b170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f556c00d800 tx=0x7f556c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:01.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f557b400640 1 -- 172.21.15.29:0/4161609456 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c00b6c0 con 0x7f55840d0c20 2024-01-24T13:04:01.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f557b400640 1 -- 172.21.15.29:0/4161609456 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c00b820 con 0x7f55840d0c20 2024-01-24T13:04:01.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f558a800640 1 -- 172.21.15.29:0/4161609456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5584159670 con 0x7f55840d0c20 2024-01-24T13:04:01.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f557b400640 1 -- 172.21.15.29:0/4161609456 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c00bb90 con 0x7f55840d0c20 2024-01-24T13:04:01.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f558a800640 1 -- 172.21.15.29:0/4161609456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5584159c30 con 0x7f55840d0c20 2024-01-24T13:04:01.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f558a800640 1 -- 172.21.15.29:0/4161609456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5584159df0 con 0x7f55840d0c20 2024-01-24T13:04:01.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.316+0000 7f557b400640 1 -- 172.21.15.29:0/4161609456 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f556c00bcf0 con 0x7f55840d0c20 2024-01-24T13:04:01.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.320+0000 7f557b400640 1 --2- 172.21.15.29:0/4161609456 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f555c065a90 0x7f555c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:01.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.320+0000 7f557b400640 1 -- 172.21.15.29:0/4161609456 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f556c0837d0 con 0x7f55840d0c20 2024-01-24T13:04:01.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.320+0000 7f5583400640 1 --2- 172.21.15.29:0/4161609456 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f555c065a90 0x7f555c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:01.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.320+0000 7f5583400640 1 --2- 172.21.15.29:0/4161609456 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f555c065a90 0x7f555c067f50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f55740ad000 tx=0x7f5574008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:01.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.320+0000 7f557b400640 1 -- 172.21.15.29:0/4161609456 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f556c050f40 con 0x7f55840d0c20 2024-01-24T13:04:01.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.512+0000 7f558a800640 1 -- 172.21.15.29:0/4161609456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f558404e850 con 0x7f55840d0c20 2024-01-24T13:04:01.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.512+0000 7f557b400640 1 -- 172.21.15.29:0/4161609456 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f556c054560 con 0x7f55840d0c20 2024-01-24T13:04:01.515 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:01.515 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1485056573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1485056573},{"type":"v1","addr":"172.21.15.29:6834","nonce":1485056573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/447431893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":447431893},{"type":"v1","addr":"172.21.15.163:6836","nonce":447431893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2390785325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2390785325},{"type":"v1","addr":"172.21.15.29:6835","nonce":2390785325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:03:55.981917+0000","modified":"2024-01-24T13:04:01.140249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/1191601563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1191601563},{"type":"v1","addr":"172.21.15.163:6837","nonce":1191601563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-24T13:04:01.515 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2024-01-24T13:04:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.516+0000 7f558a800640 1 -- 172.21.15.29:0/4161609456 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f555c065a90 msgr2=0x7f555c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.516+0000 7f558a800640 1 --2- 172.21.15.29:0/4161609456 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f555c065a90 0x7f555c067f50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f55740ad000 tx=0x7f5574008040 comp rx=0 tx=0).stop 2024-01-24T13:04:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.516+0000 7f558a800640 1 -- 172.21.15.29:0/4161609456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55840d0c20 msgr2=0x7f558415b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.516+0000 7f558a800640 1 --2- 172.21.15.29:0/4161609456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55840d0c20 0x7f558415b170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f556c00d800 tx=0x7f556c00dcc0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.516+0000 7f558a800640 1 -- 172.21.15.29:0/4161609456 shutdown_connections 2024-01-24T13:04:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.516+0000 7f558a800640 1 --2- 172.21.15.29:0/4161609456 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f555c065a90 0x7f555c067f50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.516+0000 7f558a800640 1 --2- 172.21.15.29:0/4161609456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f558415c6f0 0x7f55840b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.516+0000 7f558a800640 1 --2- 172.21.15.29:0/4161609456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55840d0c20 0x7f558415b170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.516+0000 7f558a800640 1 --2- 172.21.15.29:0/4161609456 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55840b4540 0x7f558415a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.516+0000 7f558a800640 1 -- 172.21.15.29:0/4161609456 >> 172.21.15.29:0/4161609456 conn(0x7f5584071a00 msgr2=0x7f55840b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.516+0000 7f558a800640 1 -- 172.21.15.29:0/4161609456 shutdown_connections 2024-01-24T13:04:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.516+0000 7f558a800640 1 -- 172.21.15.29:0/4161609456 wait complete. 2024-01-24T13:04:01.537 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:01.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.676+0000 7fd6ed600640 1 Processor -- start 2024-01-24T13:04:01.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.676+0000 7fd6ed600640 1 -- start start 2024-01-24T13:04:01.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.676+0000 7fd6ed600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd6e815a630 0x7fd6e80cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:01.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.676+0000 7fd6ed600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6e80c3ef0 0x7fd6e80ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:01.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.676+0000 7fd6ed600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e80cfe50 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.676+0000 7fd6ed600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e80cf380 con 0x7fd6e815a630 2024-01-24T13:04:01.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.676+0000 7fd6ed600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e815aa10 con 0x7fd6e80c3ef0 2024-01-24T13:04:01.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.676+0000 7fd6e7400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd6e80ca9f0 0x7fd6e815e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:48910/0 (socket says 172.21.15.29:48910) 2024-01-24T13:04:01.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.676+0000 7fd6e7400640 1 -- 172.21.15.29:0/2286871248 learned_addr learned my addr 172.21.15.29:0/2286871248 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:01.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.676+0000 7fd6e6000640 1 --2- 172.21.15.29:0/2286871248 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6e80c3ef0 0x7fd6e80ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:01.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.676+0000 7fd6e6a00640 1 --2- 172.21.15.29:0/2286871248 >> v2:172.21.15.163:3300/0 conn(0x7fd6e815a630 0x7fd6e80cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:01.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.680+0000 7fd6e5600640 1 -- 172.21.15.29:0/2286871248 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289366770 0 0) 0x7fd6e80cfe50 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.680+0000 7fd6e5600640 1 -- 172.21.15.29:0/2286871248 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c8003530 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.680+0000 7fd6e6000640 1 -- 172.21.15.29:0/2286871248 >> v2:172.21.15.163:3300/0 conn(0x7fd6e815a630 msgr2=0x7fd6e80cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:01.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.680+0000 7fd6e6000640 1 --2- 172.21.15.29:0/2286871248 >> v2:172.21.15.163:3300/0 conn(0x7fd6e815a630 0x7fd6e80cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.680+0000 7fd6e6000640 1 -- 172.21.15.29:0/2286871248 >> v1:172.21.15.29:6789/0 conn(0x7fd6e80ca9f0 legacy=0x7fd6e815e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:01.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.680+0000 7fd6e6000640 1 -- 172.21.15.29:0/2286871248 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e80b2b70 con 0x7fd6e80c3ef0 2024-01-24T13:04:01.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.680+0000 7fd6e6a00640 1 --2- 172.21.15.29:0/2286871248 >> v2:172.21.15.163:3300/0 conn(0x7fd6e815a630 0x7fd6e80cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:01.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.680+0000 7fd6e6000640 1 --2- 172.21.15.29:0/2286871248 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6e80c3ef0 0x7fd6e80ce4b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00097c0 tx=0x7fd6d001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae03d753444e76ad server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:01.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.680+0000 7fd6e5600640 1 -- 172.21.15.29:0/2286871248 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00ab650 con 0x7fd6e80c3ef0 2024-01-24T13:04:01.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.680+0000 7fd6e5600640 1 -- 172.21.15.29:0/2286871248 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d00ab7b0 con 0x7fd6e80c3ef0 2024-01-24T13:04:01.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.680+0000 7fd6e5600640 1 -- 172.21.15.29:0/2286871248 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00abb40 con 0x7fd6e80c3ef0 2024-01-24T13:04:01.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.684+0000 7fd6ed600640 1 -- 172.21.15.29:0/2286871248 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6e80c3ef0 msgr2=0x7fd6e80ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:01.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.684+0000 7fd6ed600640 1 --2- 172.21.15.29:0/2286871248 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6e80c3ef0 0x7fd6e80ce4b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00097c0 tx=0x7fd6d001c450 comp rx=0 tx=0).stop 2024-01-24T13:04:01.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.684+0000 7fd6ed600640 1 -- 172.21.15.29:0/2286871248 shutdown_connections 2024-01-24T13:04:01.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.684+0000 7fd6ed600640 1 --2- 172.21.15.29:0/2286871248 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6e80c3ef0 0x7fd6e80ce4b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.684+0000 7fd6ed600640 1 --2- 172.21.15.29:0/2286871248 >> v2:172.21.15.163:3300/0 conn(0x7fd6e815a630 0x7fd6e80cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.684+0000 7fd6ed600640 1 -- 172.21.15.29:0/2286871248 >> 172.21.15.29:0/2286871248 conn(0x7fd6e8070570 msgr2=0x7fd6e8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:01.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.684+0000 7fd6ed600640 1 -- 172.21.15.29:0/2286871248 shutdown_connections 2024-01-24T13:04:01.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.684+0000 7fd6ed600640 1 -- 172.21.15.29:0/2286871248 wait complete. 2024-01-24T13:04:01.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.684+0000 7fd6ed600640 1 Processor -- start 2024-01-24T13:04:01.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.684+0000 7fd6ed600640 1 -- start start 2024-01-24T13:04:01.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6ed600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd6e80c3ef0 0x7fd6e80c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:01.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6ed600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6e80ca9f0 0x7fd6e815d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:01.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6ed600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6e815a630 0x7fd6e8154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:01.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6ed600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e80c6640 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6ed600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e80c59c0 con 0x7fd6e80c3ef0 2024-01-24T13:04:01.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6ed600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e80c5ca0 con 0x7fd6e815a630 2024-01-24T13:04:01.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6e6000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6e80ca9f0 0x7fd6e815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:01.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6e6000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6e80ca9f0 0x7fd6e815d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36304/0 (socket says 172.21.15.29:36304) 2024-01-24T13:04:01.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6e6000640 1 -- 172.21.15.29:0/1304691923 learned_addr learned my addr 172.21.15.29:0/1304691923 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:01.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6e6a00640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd6e80c3ef0 0x7fd6e80c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:01.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6e7400640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6e815a630 0x7fd6e8154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:01.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6e6000640 1 -- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6e815a630 msgr2=0x7fd6e8154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:01.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6e6000640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6e815a630 0x7fd6e8154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6e6000640 1 -- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd6e80c3ef0 msgr2=0x7fd6e80c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:01.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6e6000640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd6e80c3ef0 0x7fd6e80c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6e6000640 1 -- 172.21.15.29:0/1304691923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d8009420 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6e7400640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6e815a630 0x7fd6e8154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:01.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6e6000640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6e80ca9f0 0x7fd6e815d460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00ad040 tx=0x7fd6d001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:01.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6dea00640 1 -- 172.21.15.29:0/1304691923 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00bf610 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6dea00640 1 -- 172.21.15.29:0/1304691923 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d00bf790 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6ed600640 1 -- 172.21.15.29:0/1304691923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d0009420 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6dea00640 1 -- 172.21.15.29:0/1304691923 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00bfb40 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6ed600640 1 -- 172.21.15.29:0/1304691923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e80c6260 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6ed600640 1 -- 172.21.15.29:0/1304691923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e80c6780 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.688+0000 7fd6dea00640 1 -- 172.21.15.29:0/1304691923 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd6d00bfca0 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.692+0000 7fd6dea00640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd6c0065a60 0x7fd6c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:01.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.692+0000 7fd6dea00640 1 -- 172.21.15.29:0/1304691923 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd6d011e3b0 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.692+0000 7fd6e6a00640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd6c0065a60 0x7fd6c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:01.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.692+0000 7fd6e6a00640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd6c0065a60 0x7fd6c0067f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009be0 tx=0x7fd6d8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:01.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.696+0000 7fd6dea00640 1 -- 172.21.15.29:0/1304691923 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd6e80c6780 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.856+0000 7fd6ed600640 1 -- 172.21.15.29:0/1304691923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6e80c6780 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.856+0000 7fd6dea00640 1 -- 172.21.15.29:0/1304691923 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+17882 (secure 0 0 0) 0x7fd6e80c6780 con 0x7fd6e80ca9f0 2024-01-24T13:04:01.859 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:01.859 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:01.140044+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.860+0000 7fd6ed600640 1 -- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd6c0065a60 msgr2=0x7fd6c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.860+0000 7fd6ed600640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd6c0065a60 0x7fd6c0067f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009be0 tx=0x7fd6d8008040 comp rx=0 tx=0).stop 2024-01-24T13:04:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.860+0000 7fd6ed600640 1 -- 172.21.15.29:0/1304691923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6e80ca9f0 msgr2=0x7fd6e815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.860+0000 7fd6ed600640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6e80ca9f0 0x7fd6e815d460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00ad040 tx=0x7fd6d001ac90 comp rx=0 tx=0).stop 2024-01-24T13:04:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.860+0000 7fd6ed600640 1 -- 172.21.15.29:0/1304691923 shutdown_connections 2024-01-24T13:04:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.860+0000 7fd6ed600640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd6c0065a60 0x7fd6c0067f20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.860+0000 7fd6ed600640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6e815a630 0x7fd6e8154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.860+0000 7fd6ed600640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6e80ca9f0 0x7fd6e815d460 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.860+0000 7fd6ed600640 1 --2- 172.21.15.29:0/1304691923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd6e80c3ef0 0x7fd6e80c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.860+0000 7fd6ed600640 1 -- 172.21.15.29:0/1304691923 >> 172.21.15.29:0/1304691923 conn(0x7fd6e8070570 msgr2=0x7fd6e8155b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.860+0000 7fd6ed600640 1 -- 172.21.15.29:0/1304691923 shutdown_connections 2024-01-24T13:04:01.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:01.860+0000 7fd6ed600640 1 -- 172.21.15.29:0/1304691923 wait complete. 2024-01-24T13:04:01.881 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:02.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.020+0000 7fad0dc00640 1 Processor -- start 2024-01-24T13:04:02.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.020+0000 7fad0dc00640 1 -- start start 2024-01-24T13:04:02.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.020+0000 7fad0dc00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad080c3ef0 0x7fad080ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.020+0000 7fad0dc00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fad080caf30 0x7fad080d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.020+0000 7fad0dc00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad080cfe50 con 0x7fad0815a630 2024-01-24T13:04:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.020+0000 7fad0dc00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad080cf380 con 0x7fad080c3ef0 2024-01-24T13:04:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.020+0000 7fad0dc00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad080cb3c0 con 0x7fad080caf30 2024-01-24T13:04:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.020+0000 7fad06000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad080c3ef0 0x7fad080ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.020+0000 7fad06000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad080c3ef0 0x7fad080ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36308/0 (socket says 172.21.15.29:36308) 2024-01-24T13:04:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.020+0000 7fad06000640 1 -- 172.21.15.29:0/1037069743 learned_addr learned my addr 172.21.15.29:0/1037069743 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.024+0000 7fad07400640 1 --2- 172.21.15.29:0/1037069743 >> v2:172.21.15.163:3300/0 conn(0x7fad080caf30 0x7fad080d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.024+0000 7fad06000640 1 -- 172.21.15.29:0/1037069743 >> v2:172.21.15.163:3300/0 conn(0x7fad080caf30 msgr2=0x7fad080d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.024+0000 7fad06000640 1 --2- 172.21.15.29:0/1037069743 >> v2:172.21.15.163:3300/0 conn(0x7fad080caf30 0x7fad080d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.024+0000 7fad06000640 1 -- 172.21.15.29:0/1037069743 >> v1:172.21.15.29:6789/0 conn(0x7fad0815a630 legacy=0x7fad080cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.024+0000 7fad06000640 1 -- 172.21.15.29:0/1037069743 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0815aa10 con 0x7fad080c3ef0 2024-01-24T13:04:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.024+0000 7fad06000640 1 --2- 172.21.15.29:0/1037069743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad080c3ef0 0x7fad080ca9f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad080cdc90 tx=0x7facf001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584b3848038c7dfa server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.024+0000 7fad05600640 1 -- 172.21.15.29:0/1037069743 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00aa640 con 0x7fad080c3ef0 2024-01-24T13:04:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.024+0000 7fad05600640 1 -- 172.21.15.29:0/1037069743 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf00aa7a0 con 0x7fad080c3ef0 2024-01-24T13:04:02.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.024+0000 7fad05600640 1 -- 172.21.15.29:0/1037069743 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00aab30 con 0x7fad080c3ef0 2024-01-24T13:04:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 -- 172.21.15.29:0/1037069743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad080c3ef0 msgr2=0x7fad080ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 --2- 172.21.15.29:0/1037069743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad080c3ef0 0x7fad080ca9f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad080cdc90 tx=0x7facf001c4e0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 -- 172.21.15.29:0/1037069743 shutdown_connections 2024-01-24T13:04:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 --2- 172.21.15.29:0/1037069743 >> v2:172.21.15.163:3300/0 conn(0x7fad080caf30 0x7fad080d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 --2- 172.21.15.29:0/1037069743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad080c3ef0 0x7fad080ca9f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 -- 172.21.15.29:0/1037069743 >> 172.21.15.29:0/1037069743 conn(0x7fad08070570 msgr2=0x7fad08069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 -- 172.21.15.29:0/1037069743 shutdown_connections 2024-01-24T13:04:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 -- 172.21.15.29:0/1037069743 wait complete. 2024-01-24T13:04:02.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 Processor -- start 2024-01-24T13:04:02.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 -- start start 2024-01-24T13:04:02.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad080c3ef0 0x7fad081499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad080caf30 0x7fad081553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad0815a630 0x7fad081478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad080ca0b0 con 0x7fad080caf30 2024-01-24T13:04:02.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad080c7f00 con 0x7fad080c3ef0 2024-01-24T13:04:02.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad0dc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad080c81e0 con 0x7fad0815a630 2024-01-24T13:04:02.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad06000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad080caf30 0x7fad081553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad06000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad080caf30 0x7fad081553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36310/0 (socket says 172.21.15.29:36310) 2024-01-24T13:04:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad06000640 1 -- 172.21.15.29:0/1593823892 learned_addr learned my addr 172.21.15.29:0/1593823892 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad06a00640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad080c3ef0 0x7fad081499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad07400640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad0815a630 0x7fad081478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad06000640 1 -- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad0815a630 msgr2=0x7fad081478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.028+0000 7fad06000640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad0815a630 0x7fad081478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.032+0000 7fad06000640 1 -- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad080c3ef0 msgr2=0x7fad081499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.032+0000 7fad06000640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad080c3ef0 0x7fad081499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.032+0000 7fad06000640 1 -- 172.21.15.29:0/1593823892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf00094d0 con 0x7fad080caf30 2024-01-24T13:04:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.032+0000 7fad07400640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad0815a630 0x7fad081478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.032+0000 7fad06000640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad080caf30 0x7fad081553d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7facf00ac040 tx=0x7facf001ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:02.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.032+0000 7facfea00640 1 -- 172.21.15.29:0/1593823892 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00aa640 con 0x7fad080caf30 2024-01-24T13:04:02.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.032+0000 7facfea00640 1 -- 172.21.15.29:0/1593823892 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf00bd610 con 0x7fad080caf30 2024-01-24T13:04:02.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.032+0000 7fad0dc00640 1 -- 172.21.15.29:0/1593823892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad080c84c0 con 0x7fad080caf30 2024-01-24T13:04:02.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.032+0000 7facfea00640 1 -- 172.21.15.29:0/1593823892 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00bd9c0 con 0x7fad080caf30 2024-01-24T13:04:02.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.032+0000 7fad0dc00640 1 -- 172.21.15.29:0/1593823892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad08155ae0 con 0x7fad080caf30 2024-01-24T13:04:02.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.032+0000 7fad0dc00640 1 -- 172.21.15.29:0/1593823892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad080c7d60 con 0x7fad080caf30 2024-01-24T13:04:02.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.032+0000 7facfea00640 1 -- 172.21.15.29:0/1593823892 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7facf00a8050 con 0x7fad080caf30 2024-01-24T13:04:02.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.032+0000 7facfea00640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7face0065a60 0x7face0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.032+0000 7facfea00640 1 -- 172.21.15.29:0/1593823892 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7facf011da10 con 0x7fad080caf30 2024-01-24T13:04:02.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.036+0000 7fad06a00640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7face0065a60 0x7face0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.036+0000 7fad06a00640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7face0065a60 0x7face0067f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fad080c6dc0 tx=0x7facf8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:02.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.036+0000 7facfea00640 1 -- 172.21.15.29:0/1593823892 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fad080c7d60 con 0x7fad080caf30 2024-01-24T13:04:02.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.196+0000 7fad0dc00640 1 -- 172.21.15.29:0/1593823892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad080c8320 con 0x7fad080caf30 2024-01-24T13:04:02.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.196+0000 7facfea00640 1 -- 172.21.15.29:0/1593823892 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+17882 (secure 0 0 0) 0x7fad080c8320 con 0x7fad080caf30 2024-01-24T13:04:02.199 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:02.199 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:01.140044+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:02.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.200+0000 7fad0dc00640 1 -- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7face0065a60 msgr2=0x7face0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.200+0000 7fad0dc00640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7face0065a60 0x7face0067f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fad080c6dc0 tx=0x7facf8009040 comp rx=0 tx=0).stop 2024-01-24T13:04:02.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.200+0000 7fad0dc00640 1 -- 172.21.15.29:0/1593823892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad080caf30 msgr2=0x7fad081553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.200+0000 7fad0dc00640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad080caf30 0x7fad081553d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7facf00ac040 tx=0x7facf001ad20 comp rx=0 tx=0).stop 2024-01-24T13:04:02.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.200+0000 7fad0dc00640 1 -- 172.21.15.29:0/1593823892 shutdown_connections 2024-01-24T13:04:02.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.200+0000 7fad0dc00640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7face0065a60 0x7face0067f20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.200+0000 7fad0dc00640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad0815a630 0x7fad081478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.200+0000 7fad0dc00640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad080caf30 0x7fad081553d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.200+0000 7fad0dc00640 1 --2- 172.21.15.29:0/1593823892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad080c3ef0 0x7fad081499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.200+0000 7fad0dc00640 1 -- 172.21.15.29:0/1593823892 >> 172.21.15.29:0/1593823892 conn(0x7fad08070570 msgr2=0x7fad080cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:02.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.200+0000 7fad0dc00640 1 -- 172.21.15.29:0/1593823892 shutdown_connections 2024-01-24T13:04:02.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.200+0000 7fad0dc00640 1 -- 172.21.15.29:0/1593823892 wait complete. 2024-01-24T13:04:02.237 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:04:02.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.376+0000 7f98ce000640 1 Processor -- start 2024-01-24T13:04:02.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.376+0000 7f98ce000640 1 -- start start 2024-01-24T13:04:02.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.376+0000 7f98ce000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98c80c3ef0 0x7f98c80ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.376+0000 7f98ce000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c80cfe50 con 0x7f98c80caf30 2024-01-24T13:04:02.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.376+0000 7f98ce000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c80cb3c0 con 0x7f98c815a630 2024-01-24T13:04:02.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.376+0000 7f98ce000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c80cf380 con 0x7f98c80c3ef0 2024-01-24T13:04:02.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.376+0000 7f98c6a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98c80c3ef0 0x7f98c80ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.376+0000 7f98c6a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98c80c3ef0 0x7f98c80ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36326/0 (socket says 172.21.15.29:36326) 2024-01-24T13:04:02.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.376+0000 7f98c6a00640 1 -- 172.21.15.29:0/613489943 learned_addr learned my addr 172.21.15.29:0/613489943 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:02.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.376+0000 7f98c6a00640 1 -- 172.21.15.29:0/613489943 >> v1:172.21.15.163:6789/0 conn(0x7f98c815a630 legacy=0x7f98c80cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:02.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.376+0000 7f98c6a00640 1 -- 172.21.15.29:0/613489943 >> v1:172.21.15.29:6789/0 conn(0x7f98c80caf30 legacy=0x7f98c80d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.376+0000 7f98c6a00640 1 -- 172.21.15.29:0/613489943 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c815aa10 con 0x7f98c80c3ef0 2024-01-24T13:04:02.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.380+0000 7f98c6a00640 1 --2- 172.21.15.29:0/613489943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c80c3ef0 0x7f98c80ca9f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009870 tx=0x7f98b001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fbf6039fba9757 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:02.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.380+0000 7f98c6000640 1 -- 172.21.15.29:0/613489943 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b00aa640 con 0x7f98c80c3ef0 2024-01-24T13:04:02.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.380+0000 7f98c6000640 1 -- 172.21.15.29:0/613489943 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b00aa7a0 con 0x7f98c80c3ef0 2024-01-24T13:04:02.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.380+0000 7f98c6000640 1 -- 172.21.15.29:0/613489943 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b00aab30 con 0x7f98c80c3ef0 2024-01-24T13:04:02.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.380+0000 7f98ce000640 1 -- 172.21.15.29:0/613489943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c80c3ef0 msgr2=0x7f98c80ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.380+0000 7f98ce000640 1 --2- 172.21.15.29:0/613489943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c80c3ef0 0x7f98c80ca9f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009870 tx=0x7f98b001c4e0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.380+0000 7f98ce000640 1 -- 172.21.15.29:0/613489943 shutdown_connections 2024-01-24T13:04:02.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.380+0000 7f98ce000640 1 --2- 172.21.15.29:0/613489943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c80c3ef0 0x7f98c80ca9f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.380+0000 7f98ce000640 1 -- 172.21.15.29:0/613489943 >> 172.21.15.29:0/613489943 conn(0x7f98c8070570 msgr2=0x7f98c8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:02.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.380+0000 7f98ce000640 1 -- 172.21.15.29:0/613489943 shutdown_connections 2024-01-24T13:04:02.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.380+0000 7f98ce000640 1 -- 172.21.15.29:0/613489943 wait complete. 2024-01-24T13:04:02.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98ce000640 1 Processor -- start 2024-01-24T13:04:02.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98ce000640 1 -- start start 2024-01-24T13:04:02.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98ce000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c80c3ef0 0x7f98c80c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98ce000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98c80caf30 0x7f98c80b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98ce000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98c815a630 0x7f98c815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98ce000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c815b6a0 con 0x7f98c80c3ef0 2024-01-24T13:04:02.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98ce000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c8150fe0 con 0x7f98c815a630 2024-01-24T13:04:02.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98ce000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c81512c0 con 0x7f98c80caf30 2024-01-24T13:04:02.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98c7400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c80c3ef0 0x7f98c80c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98c7400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c80c3ef0 0x7f98c80c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36334/0 (socket says 172.21.15.29:36334) 2024-01-24T13:04:02.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98c7400640 1 -- 172.21.15.29:0/619167317 learned_addr learned my addr 172.21.15.29:0/619167317 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:02.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98c6a00640 1 --2- 172.21.15.29:0/619167317 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98c80caf30 0x7f98c80b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98c7e00640 1 --2- 172.21.15.29:0/619167317 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98c815a630 0x7f98c815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98c7400640 1 -- 172.21.15.29:0/619167317 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98c80caf30 msgr2=0x7f98c80b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98c7400640 1 --2- 172.21.15.29:0/619167317 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98c80caf30 0x7f98c80b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98c7400640 1 -- 172.21.15.29:0/619167317 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98c815a630 msgr2=0x7f98c815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98c7400640 1 --2- 172.21.15.29:0/619167317 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98c815a630 0x7f98c815baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98c7400640 1 -- 172.21.15.29:0/619167317 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b00094d0 con 0x7f98c80c3ef0 2024-01-24T13:04:02.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98c7400640 1 --2- 172.21.15.29:0/619167317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c80c3ef0 0x7f98c80c7520 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98b800b410 tx=0x7f98b800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:02.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.384+0000 7f98bf400640 1 -- 172.21.15.29:0/619167317 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8004020 con 0x7f98c80c3ef0 2024-01-24T13:04:02.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.388+0000 7f98bf400640 1 -- 172.21.15.29:0/619167317 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b8004180 con 0x7f98c80c3ef0 2024-01-24T13:04:02.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.388+0000 7f98bf400640 1 -- 172.21.15.29:0/619167317 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8011630 con 0x7f98c80c3ef0 2024-01-24T13:04:02.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.388+0000 7f98ce000640 1 -- 172.21.15.29:0/619167317 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c81515a0 con 0x7f98c80c3ef0 2024-01-24T13:04:02.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.388+0000 7f98ce000640 1 -- 172.21.15.29:0/619167317 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c815b2c0 con 0x7f98c80c3ef0 2024-01-24T13:04:02.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.388+0000 7f98ce000640 1 -- 172.21.15.29:0/619167317 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c804e850 con 0x7f98c80c3ef0 2024-01-24T13:04:02.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.388+0000 7f98bf400640 1 -- 172.21.15.29:0/619167317 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f98b8011790 con 0x7f98c80c3ef0 2024-01-24T13:04:02.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.388+0000 7f98bf400640 1 --2- 172.21.15.29:0/619167317 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f98a0065a60 0x7f98a0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.388+0000 7f98bf400640 1 -- 172.21.15.29:0/619167317 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f98b8083150 con 0x7f98c80c3ef0 2024-01-24T13:04:02.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.388+0000 7f98c6a00640 1 --2- 172.21.15.29:0/619167317 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f98a0065a60 0x7f98a0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.392+0000 7f98c6a00640 1 --2- 172.21.15.29:0/619167317 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f98a0065a60 0x7f98a0067f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f98b00ae000 tx=0x7f98b00b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:02.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.392+0000 7f98bf400640 1 -- 172.21.15.29:0/619167317 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f98b8050830 con 0x7f98c80c3ef0 2024-01-24T13:04:02.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.580+0000 7f98ce000640 1 -- 172.21.15.29:0/619167317 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98c8151e20 con 0x7f98c80c3ef0 2024-01-24T13:04:02.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.584+0000 7f98bf400640 1 -- 172.21.15.29:0/619167317 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f98b8053e50 con 0x7f98c80c3ef0 2024-01-24T13:04:02.585 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:02.585 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1485056573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1485056573},{"type":"v1","addr":"172.21.15.29:6834","nonce":1485056573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/447431893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":447431893},{"type":"v1","addr":"172.21.15.163:6836","nonce":447431893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2390785325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2390785325},{"type":"v1","addr":"172.21.15.29:6835","nonce":2390785325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:03:55.981917+0000","modified":"2024-01-24T13:04:01.140249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/1191601563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1191601563},{"type":"v1","addr":"172.21.15.163:6837","nonce":1191601563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-24T13:04:02.585 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2024-01-24T13:04:02.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.584+0000 7f98ce000640 1 -- 172.21.15.29:0/619167317 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f98a0065a60 msgr2=0x7f98a0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.584+0000 7f98ce000640 1 --2- 172.21.15.29:0/619167317 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f98a0065a60 0x7f98a0067f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f98b00ae000 tx=0x7f98b00b5040 comp rx=0 tx=0).stop 2024-01-24T13:04:02.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.584+0000 7f98ce000640 1 -- 172.21.15.29:0/619167317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c80c3ef0 msgr2=0x7f98c80c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.584+0000 7f98ce000640 1 --2- 172.21.15.29:0/619167317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c80c3ef0 0x7f98c80c7520 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98b800b410 tx=0x7f98b800b8d0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.584+0000 7f98ce000640 1 -- 172.21.15.29:0/619167317 shutdown_connections 2024-01-24T13:04:02.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.584+0000 7f98ce000640 1 --2- 172.21.15.29:0/619167317 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f98a0065a60 0x7f98a0067f20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.584+0000 7f98ce000640 1 --2- 172.21.15.29:0/619167317 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98c815a630 0x7f98c815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.584+0000 7f98ce000640 1 --2- 172.21.15.29:0/619167317 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98c80caf30 0x7f98c80b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.584+0000 7f98ce000640 1 --2- 172.21.15.29:0/619167317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c80c3ef0 0x7f98c80c7520 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.584+0000 7f98ce000640 1 -- 172.21.15.29:0/619167317 >> 172.21.15.29:0/619167317 conn(0x7f98c8070570 msgr2=0x7f98c80cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:02.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.584+0000 7f98ce000640 1 -- 172.21.15.29:0/619167317 shutdown_connections 2024-01-24T13:04:02.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.584+0000 7f98ce000640 1 -- 172.21.15.29:0/619167317 wait complete. 2024-01-24T13:04:02.607 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:02.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.744+0000 7f788b800640 1 Processor -- start 2024-01-24T13:04:02.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.744+0000 7f788b800640 1 -- start start 2024-01-24T13:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.748+0000 7f788b800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f788406bc10 0x7f788406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.748+0000 7f788b800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788406c5b0 con 0x7f7884159300 2024-01-24T13:04:02.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.748+0000 7f788b800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788415de10 con 0x7f788415cf50 2024-01-24T13:04:02.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.748+0000 7f788b800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7884071140 con 0x7f788406bc10 2024-01-24T13:04:02.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.748+0000 7f7888e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7884159300 0x7f78840b1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:48926/0 (socket says 172.21.15.29:48926) 2024-01-24T13:04:02.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.748+0000 7f7888e00640 1 -- 172.21.15.29:0/1853938430 learned_addr learned my addr 172.21.15.29:0/1853938430 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:02.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.748+0000 7f7883e00640 1 --2- 172.21.15.29:0/1853938430 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f788406bc10 0x7f788406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.748+0000 7f7883400640 1 -- 172.21.15.29:0/1853938430 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453814223 0 0) 0x7f788406c5b0 con 0x7f7884159300 2024-01-24T13:04:02.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.748+0000 7f7883400640 1 -- 172.21.15.29:0/1853938430 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7864003530 con 0x7f7884159300 2024-01-24T13:04:02.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.748+0000 7f7883400640 1 -- 172.21.15.29:0/1853938430 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420563312 0 0) 0x7f788415de10 con 0x7f788415cf50 2024-01-24T13:04:02.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.748+0000 7f7883400640 1 -- 172.21.15.29:0/1853938430 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f788406c5b0 con 0x7f788415cf50 2024-01-24T13:04:02.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.748+0000 7f7883e00640 1 -- 172.21.15.29:0/1853938430 >> v1:172.21.15.163:6789/0 conn(0x7f788415cf50 legacy=0x7f78840cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.748+0000 7f7883e00640 1 -- 172.21.15.29:0/1853938430 >> v1:172.21.15.29:6789/0 conn(0x7f7884159300 legacy=0x7f78840b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.748+0000 7f7883e00640 1 -- 172.21.15.29:0/1853938430 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788415db30 con 0x7f788406bc10 2024-01-24T13:04:02.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.752+0000 7f7883e00640 1 --2- 172.21.15.29:0/1853938430 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f788406bc10 0x7f788406c070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f786c0097f0 tx=0x7f786c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=176409aaf3dda613 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.752+0000 7f7883400640 1 -- 172.21.15.29:0/1853938430 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c0ab600 con 0x7f788406bc10 2024-01-24T13:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.752+0000 7f7883400640 1 -- 172.21.15.29:0/1853938430 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c0a7050 con 0x7f788406bc10 2024-01-24T13:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.752+0000 7f7883400640 1 -- 172.21.15.29:0/1853938430 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c0ab980 con 0x7f788406bc10 2024-01-24T13:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.752+0000 7f788b800640 1 -- 172.21.15.29:0/1853938430 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f788406bc10 msgr2=0x7f788406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.752+0000 7f788b800640 1 --2- 172.21.15.29:0/1853938430 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f788406bc10 0x7f788406c070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f786c0097f0 tx=0x7f786c01c400 comp rx=0 tx=0).stop 2024-01-24T13:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.752+0000 7f788b800640 1 -- 172.21.15.29:0/1853938430 shutdown_connections 2024-01-24T13:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.752+0000 7f788b800640 1 --2- 172.21.15.29:0/1853938430 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f788406bc10 0x7f788406c070 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.752+0000 7f788b800640 1 -- 172.21.15.29:0/1853938430 >> 172.21.15.29:0/1853938430 conn(0x7f78840b3950 msgr2=0x7f7884069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:02.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.752+0000 7f788b800640 1 -- 172.21.15.29:0/1853938430 shutdown_connections 2024-01-24T13:04:02.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.752+0000 7f788b800640 1 -- 172.21.15.29:0/1853938430 wait complete. 2024-01-24T13:04:02.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.752+0000 7f788b800640 1 Processor -- start 2024-01-24T13:04:02.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f788b800640 1 -- start start 2024-01-24T13:04:02.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f788b800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f788406bc10 0x7f7884139bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f788b800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7884159300 0x7f788414f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f788b800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f788415cf50 0x7f788413b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f788b800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788413a100 con 0x7f7884159300 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f788b800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788413a380 con 0x7f788406bc10 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f788b800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788413b1e0 con 0x7f788415cf50 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f7883e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7884159300 0x7f788414f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f7883e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7884159300 0x7f788414f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36344/0 (socket says 172.21.15.29:36344) 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f7883e00640 1 -- 172.21.15.29:0/3474241563 learned_addr learned my addr 172.21.15.29:0/3474241563 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f7888e00640 1 --2- 172.21.15.29:0/3474241563 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f788406bc10 0x7f7884139bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f7889800640 1 --2- 172.21.15.29:0/3474241563 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f788415cf50 0x7f788413b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f7883e00640 1 -- 172.21.15.29:0/3474241563 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f788415cf50 msgr2=0x7f788413b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f7883e00640 1 --2- 172.21.15.29:0/3474241563 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f788415cf50 0x7f788413b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f7883e00640 1 -- 172.21.15.29:0/3474241563 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f788406bc10 msgr2=0x7f7884139bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f7883e00640 1 --2- 172.21.15.29:0/3474241563 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f788406bc10 0x7f7884139bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f7883e00640 1 -- 172.21.15.29:0/3474241563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c009420 con 0x7f7884159300 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f7883e00640 1 --2- 172.21.15.29:0/3474241563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7884159300 0x7f788414f530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f786c0097f0 tx=0x7f786c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:02.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f7880c00640 1 -- 172.21.15.29:0/3474241563 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c0b4430 con 0x7f7884159300 2024-01-24T13:04:02.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f7880c00640 1 -- 172.21.15.29:0/3474241563 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c0b4590 con 0x7f7884159300 2024-01-24T13:04:02.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f7880c00640 1 -- 172.21.15.29:0/3474241563 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c0b4940 con 0x7f7884159300 2024-01-24T13:04:02.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f788b800640 1 -- 172.21.15.29:0/3474241563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788413a5d0 con 0x7f7884159300 2024-01-24T13:04:02.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f788b800640 1 -- 172.21.15.29:0/3474241563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788413ab90 con 0x7f7884159300 2024-01-24T13:04:02.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.756+0000 7f788b800640 1 -- 172.21.15.29:0/3474241563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f788404e850 con 0x7f7884159300 2024-01-24T13:04:02.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.760+0000 7f7880c00640 1 -- 172.21.15.29:0/3474241563 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f786c0b2040 con 0x7f7884159300 2024-01-24T13:04:02.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.760+0000 7f7880c00640 1 --2- 172.21.15.29:0/3474241563 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f785c065a60 0x7f785c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:02.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.760+0000 7f7880c00640 1 -- 172.21.15.29:0/3474241563 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f786c11d210 con 0x7f7884159300 2024-01-24T13:04:02.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.760+0000 7f7888e00640 1 --2- 172.21.15.29:0/3474241563 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f785c065a60 0x7f785c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:02.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.760+0000 7f7888e00640 1 --2- 172.21.15.29:0/3474241563 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f785c065a60 0x7f785c067f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7874007fd0 tx=0x7f7874007d80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:02.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.764+0000 7f7880c00640 1 -- 172.21.15.29:0/3474241563 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f786c0ea8f0 con 0x7f7884159300 2024-01-24T13:04:02.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.920+0000 7f788b800640 1 -- 172.21.15.29:0/3474241563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f788413b320 con 0x7f7884159300 2024-01-24T13:04:02.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.924+0000 7f7880c00640 1 -- 172.21.15.29:0/3474241563 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f786c0edf10 con 0x7f7884159300 2024-01-24T13:04:02.924 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:02.925 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:01.140044+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.924+0000 7f788b800640 1 -- 172.21.15.29:0/3474241563 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f785c065a60 msgr2=0x7f785c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.924+0000 7f788b800640 1 --2- 172.21.15.29:0/3474241563 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f785c065a60 0x7f785c067f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7874007fd0 tx=0x7f7874007d80 comp rx=0 tx=0).stop 2024-01-24T13:04:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.924+0000 7f788b800640 1 -- 172.21.15.29:0/3474241563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7884159300 msgr2=0x7f788414f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.924+0000 7f788b800640 1 --2- 172.21.15.29:0/3474241563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7884159300 0x7f788414f530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f786c0097f0 tx=0x7f786c0191a0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.924+0000 7f788b800640 1 -- 172.21.15.29:0/3474241563 shutdown_connections 2024-01-24T13:04:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.924+0000 7f788b800640 1 --2- 172.21.15.29:0/3474241563 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f785c065a60 0x7f785c067f20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.924+0000 7f788b800640 1 --2- 172.21.15.29:0/3474241563 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f788415cf50 0x7f788413b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.924+0000 7f788b800640 1 --2- 172.21.15.29:0/3474241563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7884159300 0x7f788414f530 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.924+0000 7f788b800640 1 --2- 172.21.15.29:0/3474241563 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f788406bc10 0x7f7884139bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.924+0000 7f788b800640 1 -- 172.21.15.29:0/3474241563 >> 172.21.15.29:0/3474241563 conn(0x7f78840b3950 msgr2=0x7f7884069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.924+0000 7f788b800640 1 -- 172.21.15.29:0/3474241563 shutdown_connections 2024-01-24T13:04:02.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:02.924+0000 7f788b800640 1 -- 172.21.15.29:0/3474241563 wait complete. 2024-01-24T13:04:03.350 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-24T13:03:55.981917+0000', 'modified': '2024-01-24T13:04:01.140249+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.163:6837/1191601563', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6835', 'nonce': 1191601563}, {'type': 'v1', 'addr': '172.21.15.163:6837', 'nonce': 1191601563}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-01-24T13:04:03.351 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-24T13:04:03.351 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-24T13:04:03.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.492+0000 7f6f0ba00640 1 Processor -- start 2024-01-24T13:04:03.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.492+0000 7f6f0ba00640 1 -- start start 2024-01-24T13:04:03.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.492+0000 7f6f0ba00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6f040cd540 0x7f6f0415b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.492+0000 7f6f0ba00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0415e920 con 0x7f6f040cd160 2024-01-24T13:04:03.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.492+0000 7f6f0ba00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0415ec00 con 0x7f6f0415b8b0 2024-01-24T13:04:03.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.492+0000 7f6f0ba00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f0415eee0 con 0x7f6f040cd540 2024-01-24T13:04:03.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.492+0000 7f6f09000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6f040cd160 0x7f6f0415e0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:48928/0 (socket says 172.21.15.29:48928) 2024-01-24T13:04:03.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.492+0000 7f6f09000640 1 -- 172.21.15.29:0/3101118224 learned_addr learned my addr 172.21.15.29:0/3101118224 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.492+0000 7f6f03e00640 1 --2- 172.21.15.29:0/3101118224 >> v2:172.21.15.163:3300/0 conn(0x7f6f040cd540 0x7f6f0415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.492+0000 7f6f03400640 1 -- 172.21.15.29:0/3101118224 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407763566 0 0) 0x7f6f0415e920 con 0x7f6f040cd160 2024-01-24T13:04:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.492+0000 7f6f03400640 1 -- 172.21.15.29:0/3101118224 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ee4003530 con 0x7f6f040cd160 2024-01-24T13:04:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.492+0000 7f6f03400640 1 -- 172.21.15.29:0/3101118224 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3511949521 0 0) 0x7f6ee4003530 con 0x7f6f040cd160 2024-01-24T13:04:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03400640 1 -- 172.21.15.29:0/3101118224 >> v2:172.21.15.163:3300/0 conn(0x7f6f040cd540 msgr2=0x7f6f0415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03400640 1 --2- 172.21.15.29:0/3101118224 >> v2:172.21.15.163:3300/0 conn(0x7f6f040cd540 0x7f6f0415b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03400640 1 -- 172.21.15.29:0/3101118224 >> v1:172.21.15.163:6789/0 conn(0x7f6f0415b8b0 legacy=0x7f6f040cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03400640 1 -- 172.21.15.29:0/3101118224 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0415ae50 con 0x7f6f040cd160 2024-01-24T13:04:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03400640 1 -- 172.21.15.29:0/3101118224 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f6ef4001680 con 0x7f6f040cd160 2024-01-24T13:04:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03400640 1 -- 172.21.15.29:0/3101118224 >> v1:172.21.15.29:6789/0 conn(0x7f6f040cd160 legacy=0x7f6f0415e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03400640 1 --2- 172.21.15.29:0/3101118224 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ee4003980 0x7f6ee4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03400640 1 --2- 172.21.15.29:0/3101118224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee40047d0 0x7f6ee4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03400640 1 --2- 172.21.15.29:0/3101118224 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ee4005190 0x7f6ee400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03400640 1 -- 172.21.15.29:0/3101118224 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0415eee0 con 0x7f6ee40047d0 2024-01-24T13:04:03.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03400640 1 -- 172.21.15.29:0/3101118224 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee400c030 con 0x7f6ee4003980 2024-01-24T13:04:03.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03400640 1 -- 172.21.15.29:0/3101118224 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee400c1f0 con 0x7f6ee4005190 2024-01-24T13:04:03.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03e00640 1 --2- 172.21.15.29:0/3101118224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee40047d0 0x7f6ee4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f09000640 1 --2- 172.21.15.29:0/3101118224 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ee4003980 0x7f6ee4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f09a00640 1 --2- 172.21.15.29:0/3101118224 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ee4005190 0x7f6ee400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03e00640 1 -- 172.21.15.29:0/3101118224 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ee4005190 msgr2=0x7f6ee400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:03.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03e00640 1 --2- 172.21.15.29:0/3101118224 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ee4005190 0x7f6ee400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03e00640 1 -- 172.21.15.29:0/3101118224 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ee4003980 msgr2=0x7f6ee4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:03.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03e00640 1 --2- 172.21.15.29:0/3101118224 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ee4003980 0x7f6ee4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03e00640 1 -- 172.21.15.29:0/3101118224 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee4003530 con 0x7f6ee40047d0 2024-01-24T13:04:03.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f09a00640 1 --2- 172.21.15.29:0/3101118224 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ee4005190 0x7f6ee400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:03.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f09a00640 1 -- 172.21.15.29:0/3101118224 reap_dead start 2024-01-24T13:04:03.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.496+0000 7f6f03e00640 1 --2- 172.21.15.29:0/3101118224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee40047d0 0x7f6ee4004c50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009ae0 tx=0x7f6eec01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b183cbcfc3f486 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:03.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f03400640 1 -- 172.21.15.29:0/3101118224 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0a6440 con 0x7f6ee40047d0 2024-01-24T13:04:03.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f03400640 1 -- 172.21.15.29:0/3101118224 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec0a65a0 con 0x7f6ee40047d0 2024-01-24T13:04:03.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f03400640 1 -- 172.21.15.29:0/3101118224 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0a6950 con 0x7f6ee40047d0 2024-01-24T13:04:03.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 -- 172.21.15.29:0/3101118224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee40047d0 msgr2=0x7f6ee4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 --2- 172.21.15.29:0/3101118224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee40047d0 0x7f6ee4004c50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009ae0 tx=0x7f6eec01ca50 comp rx=0 tx=0).stop 2024-01-24T13:04:03.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 -- 172.21.15.29:0/3101118224 shutdown_connections 2024-01-24T13:04:03.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 --2- 172.21.15.29:0/3101118224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee40047d0 0x7f6ee4004c50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 -- 172.21.15.29:0/3101118224 >> 172.21.15.29:0/3101118224 conn(0x7f6f04069cd0 msgr2=0x7f6f0406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:03.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 -- 172.21.15.29:0/3101118224 shutdown_connections 2024-01-24T13:04:03.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 -- 172.21.15.29:0/3101118224 wait complete. 2024-01-24T13:04:03.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 Processor -- start 2024-01-24T13:04:03.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 -- start start 2024-01-24T13:04:03.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ee40047d0 0x7f6f04152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f041f2080 0x7f6f040c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f040c8b10 0x7f6f0406af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f041f25f0 con 0x7f6f040c8b10 2024-01-24T13:04:03.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f041f28d0 con 0x7f6ee40047d0 2024-01-24T13:04:03.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.500+0000 7f6f0ba00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f041f2bb0 con 0x7f6f041f2080 2024-01-24T13:04:03.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f09a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f040c8b10 0x7f6f0406af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f09a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f040c8b10 0x7f6f0406af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36358/0 (socket says 172.21.15.29:36358) 2024-01-24T13:04:03.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f09a00640 1 -- 172.21.15.29:0/1071058937 learned_addr learned my addr 172.21.15.29:0/1071058937 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:03.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f09000640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ee40047d0 0x7f6f04152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f03e00640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f041f2080 0x7f6f040c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f09a00640 1 -- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f041f2080 msgr2=0x7f6f040c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f09a00640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f041f2080 0x7f6f040c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f09a00640 1 -- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ee40047d0 msgr2=0x7f6f04152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f09a00640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ee40047d0 0x7f6f04152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f09a00640 1 -- 172.21.15.29:0/1071058937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f041f2e90 con 0x7f6f040c8b10 2024-01-24T13:04:03.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f09000640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ee40047d0 0x7f6f04152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:03.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f09a00640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f040c8b10 0x7f6f0406af70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6f040b65d0 tx=0x7f6efc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:03.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f00c00640 1 -- 172.21.15.29:0/1071058937 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc00eed0 con 0x7f6f040c8b10 2024-01-24T13:04:03.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f00c00640 1 -- 172.21.15.29:0/1071058937 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc003980 con 0x7f6f040c8b10 2024-01-24T13:04:03.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f00c00640 1 -- 172.21.15.29:0/1071058937 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc003d30 con 0x7f6f040c8b10 2024-01-24T13:04:03.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f0ba00640 1 -- 172.21.15.29:0/1071058937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f041f5650 con 0x7f6f040c8b10 2024-01-24T13:04:03.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f0ba00640 1 -- 172.21.15.29:0/1071058937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0406b4b0 con 0x7f6f040c8b10 2024-01-24T13:04:03.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.504+0000 7f6f00c00640 1 -- 172.21.15.29:0/1071058937 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6efc0050d0 con 0x7f6f040c8b10 2024-01-24T13:04:03.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f00c00640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6edc065a60 0x7f6edc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f00c00640 1 -- 172.21.15.29:0/1071058937 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6efc082ea0 con 0x7f6f040c8b10 2024-01-24T13:04:03.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f09000640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6edc065a60 0x7f6edc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f0ef5e000 1 Processor -- start 2024-01-24T13:04:03.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f0ef5e000 1 -- start start 2024-01-24T13:04:03.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f09000640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6edc065a60 0x7f6edc067f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4007cc0 tx=0x7f6ef4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:03.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f0ef5e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0e1ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f0ef5e000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0dce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f0ef5e000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0dcf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f0ef5e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b0c26350 con 0x55d6b0e1a980 2024-01-24T13:04:03.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f0ef5e000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b0c23920 con 0x55d6b0dced30 2024-01-24T13:04:03.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f0ef5e000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6b0c1f210 con 0x55d6b0e1b2a0 2024-01-24T13:04:03.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f09000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0e1ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f09000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0e1ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36368/0 (socket says 172.21.15.29:36368) 2024-01-24T13:04:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f09000640 1 -- 172.21.15.29:0/1662640140 learned_addr learned my addr 172.21.15.29:0/1662640140 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f03e00640 1 --2- 172.21.15.29:0/1662640140 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0dce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f09a00640 1 --2- 172.21.15.29:0/1662640140 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0dcf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f09000640 1 -- 172.21.15.29:0/1662640140 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 msgr2=0x55d6b0dce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f09000640 1 --2- 172.21.15.29:0/1662640140 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0dce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f09000640 1 -- 172.21.15.29:0/1662640140 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 msgr2=0x55d6b0dcf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f09000640 1 --2- 172.21.15.29:0/1662640140 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0dcf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f09000640 1 -- 172.21.15.29:0/1662640140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6b0bbfff0 con 0x55d6b0e1a980 2024-01-24T13:04:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f09a00640 1 --2- 172.21.15.29:0/1662640140 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0dcf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.508+0000 7f6f09000640 1 --2- 172.21.15.29:0/1662640140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0e1ad60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4014a60 tx=0x7f6ef4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b89888df6a3d999 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6ef9600640 1 -- 172.21.15.29:0/1662640140 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef401c040 con 0x55d6b0e1a980 2024-01-24T13:04:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6ef9600640 1 -- 172.21.15.29:0/1662640140 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef4017a20 con 0x55d6b0e1a980 2024-01-24T13:04:03.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6ef9600640 1 -- 172.21.15.29:0/1662640140 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4017d90 con 0x55d6b0e1a980 2024-01-24T13:04:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/1662640140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 msgr2=0x55d6b0e1ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/1662640140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0e1ad60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4014a60 tx=0x7f6ef4017000 comp rx=0 tx=0).stop 2024-01-24T13:04:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/1662640140 shutdown_connections 2024-01-24T13:04:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/1662640140 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0dcf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/1662640140 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0dce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/1662640140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0e1ad60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/1662640140 >> 172.21.15.29:0/1662640140 conn(0x55d6b0cd4430 msgr2=0x55d6b0dfdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/1662640140 shutdown_connections 2024-01-24T13:04:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/1662640140 wait complete. 2024-01-24T13:04:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 -- start start 2024-01-24T13:04:03.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 Processor -- start 2024-01-24T13:04:03.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0dced30 0x55d6b0e212f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0e1a980 0x55d6b0e21830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0dd5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b0bbe420 con 0x55d6b0dced30 2024-01-24T13:04:03.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b0bdc890 con 0x55d6b0e1a980 2024-01-24T13:04:03.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6b08dc940 con 0x55d6b0e1b2a0 2024-01-24T13:04:03.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f0ef5e000 10 client.0 _ll_register_callbacks cb 0x55d6b0c13f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-24T13:04:03.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f09000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0dced30 0x55d6b0e212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f09000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0dced30 0x55d6b0e212f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36370/0 (socket says 172.21.15.29:36370) 2024-01-24T13:04:03.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f09000640 1 -- 172.21.15.29:0/312379894 learned_addr learned my addr 172.21.15.29:0/312379894 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:03.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f03e00640 1 --2- 172.21.15.29:0/312379894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0e1a980 0x55d6b0e21830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f09a00640 1 --2- 172.21.15.29:0/312379894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0dd5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f09000640 1 -- 172.21.15.29:0/312379894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 msgr2=0x55d6b0dd5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:03.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f09000640 1 --2- 172.21.15.29:0/312379894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0dd5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f09000640 1 -- 172.21.15.29:0/312379894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0e1a980 msgr2=0x55d6b0e21830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:03.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f09000640 1 --2- 172.21.15.29:0/312379894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0e1a980 0x55d6b0e21830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f09000640 1 -- 172.21.15.29:0/312379894 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0415ae50 con 0x55d6b0dced30 2024-01-24T13:04:03.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.512+0000 7f6f03e00640 1 --2- 172.21.15.29:0/312379894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0e1a980 0x55d6b0e21830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:03.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f09000640 1 --2- 172.21.15.29:0/312379894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0dced30 0x55d6b0e212f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009010 tx=0x7f6ef4001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faac95fcc6a7a566 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:03.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6ef2000640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-01-24T13:04:03.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6ef2000640 1 -- 172.21.15.29:0/312379894 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4024830 con 0x55d6b0dced30 2024-01-24T13:04:03.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6ef2000640 1 -- 172.21.15.29:0/312379894 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ef4024990 con 0x55d6b0dced30 2024-01-24T13:04:03.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/312379894 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6b0be4cc0 con 0x55d6b0dced30 2024-01-24T13:04:03.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6ef2000640 1 -- 172.21.15.29:0/312379894 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ef4017e50 con 0x55d6b0dced30 2024-01-24T13:04:03.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 10 client.4416 fetch_fsmap learned FSMap version 7 2024-01-24T13:04:03.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/312379894 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55d6b091b890 con 0x55d6b0dced30 2024-01-24T13:04:03.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6ef2000640 1 -- 172.21.15.29:0/312379894 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d6b0be4cc0 con 0x55d6b0dced30 2024-01-24T13:04:03.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6ef2000640 1 -- 172.21.15.29:0/312379894 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f6ef401d070 con 0x55d6b0dced30 2024-01-24T13:04:03.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 10 client.4416 fetch_fsmap finished waiting for FSMap version 7 2024-01-24T13:04:03.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 10 client.4416 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-24T13:04:03.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 20 client.4416 populate_metadata read hostname 'smithi029' 2024-01-24T13:04:03.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/312379894 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x55d6b0dd67f0 0x55d6b0dd6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 4 client.4416 mds_command: new command op to 4284 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-24T13:04:03.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/312379894 --> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6b0c1db60 con 0x55d6b0dd67f0 2024-01-24T13:04:03.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f03e00640 1 --2- 172.21.15.29:0/312379894 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x55d6b0dd67f0 0x55d6b0dd6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f03e00640 1 --2- 172.21.15.29:0/312379894 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x55d6b0dd67f0 0x55d6b0dd6bd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b829517460a7d2a server_cookie=35f340a812676333 in_seq=0 out_seq=0 2024-01-24T13:04:03.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6ef2000640 10 client.4416 ms_handle_connect on v2:172.21.15.163:6835/1191601563 2024-01-24T13:04:03.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6ef2000640 1 -- 172.21.15.29:0/312379894 <== mds.0 v2:172.21.15.163:6835/1191601563 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55d6b0c1db60 con 0x55d6b0dd67f0 2024-01-24T13:04:03.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6ef2000640 10 client.4416 handle_command_reply: tid=0 2024-01-24T13:04:03.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 1 client.4416 shutdown 2024-01-24T13:04:03.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/312379894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0dced30 msgr2=0x55d6b0e212f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/312379894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0dced30 0x55d6b0e212f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009010 tx=0x7f6ef4001a10 comp rx=0 tx=0).stop 2024-01-24T13:04:03.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/312379894 shutdown_connections 2024-01-24T13:04:03.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/312379894 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x55d6b0dd67f0 0x55d6b0dd6bd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/312379894 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0dd5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/312379894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0e1a980 0x55d6b0e21830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/312379894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0dced30 0x55d6b0e212f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/312379894 >> 172.21.15.29:0/312379894 conn(0x55d6b0cd4430 msgr2=0x55d6b0dcdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:03.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.516+0000 7f6ef2000640 0 client.4416 ms_handle_reset on v2:172.21.15.163:6835/1191601563 2024-01-24T13:04:03.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.520+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/312379894 shutdown_connections 2024-01-24T13:04:03.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.520+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/312379894 wait complete. 2024-01-24T13:04:03.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.520+0000 7f6f0ef5e000 20 client.4416 trim_cache size 0 max 16384 2024-01-24T13:04:03.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.532+0000 7f6f0ef5e000 1 Processor -- start 2024-01-24T13:04:03.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.532+0000 7f6f0ef5e000 1 -- start start 2024-01-24T13:04:03.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0dd3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0dccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0dcd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b0ba5fe0 con 0x55d6b0e1a980 2024-01-24T13:04:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b0dd81b0 con 0x55d6b0dced30 2024-01-24T13:04:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6b0c21d70 con 0x55d6b0e1b2a0 2024-01-24T13:04:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f03e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0dccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f03e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0dccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36376/0 (socket says 172.21.15.29:36376) 2024-01-24T13:04:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f03e00640 1 -- 172.21.15.29:0/1926436948 learned_addr learned my addr 172.21.15.29:0/1926436948 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f09a00640 1 --2- 172.21.15.29:0/1926436948 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0dcd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f09000640 1 --2- 172.21.15.29:0/1926436948 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0dd3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f03e00640 1 -- 172.21.15.29:0/1926436948 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 msgr2=0x55d6b0dcd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f03e00640 1 --2- 172.21.15.29:0/1926436948 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0dcd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f03e00640 1 -- 172.21.15.29:0/1926436948 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 msgr2=0x55d6b0dd3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f03e00640 1 --2- 172.21.15.29:0/1926436948 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0dd3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f03e00640 1 -- 172.21.15.29:0/1926436948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6b0be42d0 con 0x55d6b0e1a980 2024-01-24T13:04:03.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f09000640 1 --2- 172.21.15.29:0/1926436948 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0dd3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:03.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f03e00640 1 --2- 172.21.15.29:0/1926436948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0dccf50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6eec006f90 tx=0x7f6eec004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1590f480e9050810 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:03.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6efa000640 1 -- 172.21.15.29:0/1926436948 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0b5040 con 0x55d6b0e1a980 2024-01-24T13:04:03.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6efa000640 1 -- 172.21.15.29:0/1926436948 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec0bd270 con 0x55d6b0e1a980 2024-01-24T13:04:03.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6efa000640 1 -- 172.21.15.29:0/1926436948 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0042e0 con 0x55d6b0e1a980 2024-01-24T13:04:03.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/1926436948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 msgr2=0x55d6b0dccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/1926436948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0dccf50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6eec006f90 tx=0x7f6eec004740 comp rx=0 tx=0).stop 2024-01-24T13:04:03.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/1926436948 shutdown_connections 2024-01-24T13:04:03.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/1926436948 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0dcd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/1926436948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0dccf50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/1926436948 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0dd3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/1926436948 >> 172.21.15.29:0/1926436948 conn(0x55d6b0cd4430 msgr2=0x55d6b0dd4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/1926436948 shutdown_connections 2024-01-24T13:04:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/1926436948 wait complete. 2024-01-24T13:04:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 -- start start 2024-01-24T13:04:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 Processor -- start 2024-01-24T13:04:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.536+0000 7f6f0ef5e000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0e779b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0e79f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0e7c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b0cbbc00 con 0x55d6b0e1a980 2024-01-24T13:04:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6b0c275e0 con 0x55d6b0dced30 2024-01-24T13:04:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6b0c18830 con 0x55d6b0e1b2a0 2024-01-24T13:04:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 10 client.0 _ll_register_callbacks cb 0x55d6b0d9d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-24T13:04:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f03e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0e79f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f09000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0e779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f09000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0e779b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:42532/0 (socket says 172.21.15.29:42532) 2024-01-24T13:04:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f09000640 1 -- 172.21.15.29:0/2632607192 learned_addr learned my addr 172.21.15.29:0/2632607192 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f03e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0e79f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36392/0 (socket says 172.21.15.29:36392) 2024-01-24T13:04:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f09a00640 1 --2- 172.21.15.29:0/2632607192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0e7c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f09000640 1 -- 172.21.15.29:0/2632607192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 msgr2=0x55d6b0e7c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f09000640 1 --2- 172.21.15.29:0/2632607192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0e7c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f09000640 1 -- 172.21.15.29:0/2632607192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 msgr2=0x55d6b0e79f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f09000640 1 --2- 172.21.15.29:0/2632607192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0e79f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f09000640 1 -- 172.21.15.29:0/2632607192 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee4003530 con 0x55d6b0dced30 2024-01-24T13:04:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f03e00640 1 --2- 172.21.15.29:0/2632607192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0e79f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:03.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f09000640 1 --2- 172.21.15.29:0/2632607192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0e779b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4014750 tx=0x7f6ef400c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f85804ecd40dc01 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:03.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6ef2000640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-01-24T13:04:03.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6ef2000640 1 -- 172.21.15.29:0/2632607192 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40385f0 con 0x55d6b0dced30 2024-01-24T13:04:03.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6ef2000640 1 -- 172.21.15.29:0/2632607192 <== mon.1 v2:172.21.15.163:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ef4017830 con 0x55d6b0dced30 2024-01-24T13:04:03.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/2632607192 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6b0bd8a00 con 0x55d6b0dced30 2024-01-24T13:04:03.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6ef2000640 1 -- 172.21.15.29:0/2632607192 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ef4024cd0 con 0x55d6b0dced30 2024-01-24T13:04:03.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 10 client.4408 fetch_fsmap learned FSMap version 7 2024-01-24T13:04:03.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/2632607192 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55d6b0bca420 con 0x55d6b0dced30 2024-01-24T13:04:03.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6ef2000640 1 -- 172.21.15.29:0/2632607192 <== mon.1 v2:172.21.15.163:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d6b0bd8a00 con 0x55d6b0dced30 2024-01-24T13:04:03.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6ef2000640 1 -- 172.21.15.29:0/2632607192 <== mon.1 v2:172.21.15.163:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f6ef4022040 con 0x55d6b0dced30 2024-01-24T13:04:03.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 10 client.4408 fetch_fsmap finished waiting for FSMap version 7 2024-01-24T13:04:03.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 10 client.4408 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-24T13:04:03.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 20 client.4408 populate_metadata read hostname 'smithi029' 2024-01-24T13:04:03.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/2632607192 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x55d6b0e7c990 0x55d6b0e7ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 4 client.4408 mds_command: new command op to 4284 tid=0[{"prefix": "status"}] 2024-01-24T13:04:03.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/2632607192 --> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d6b0c18290 con 0x55d6b0e7c990 2024-01-24T13:04:03.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f03e00640 1 --2- 172.21.15.29:0/2632607192 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x55d6b0e7c990 0x55d6b0e7ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6ef2000640 10 client.4408 ms_handle_connect on v2:172.21.15.163:6835/1191601563 2024-01-24T13:04:03.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f03e00640 1 --2- 172.21.15.29:0/2632607192 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x55d6b0e7c990 0x55d6b0e7ed80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7337294d081615af server_cookie=2c36365f857f46c1 in_seq=0 out_seq=0 2024-01-24T13:04:03.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6ef2000640 1 -- 172.21.15.29:0/2632607192 <== mds.0 v2:172.21.15.163:6835/1191601563 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55d6b0c18290 con 0x55d6b0e7c990 2024-01-24T13:04:03.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6ef2000640 10 client.4408 handle_command_reply: tid=0 2024-01-24T13:04:03.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 1 client.4408 shutdown 2024-01-24T13:04:03.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/2632607192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 msgr2=0x55d6b0e779b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.540+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/2632607192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0e779b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4014750 tx=0x7f6ef400c000 comp rx=0 tx=0).stop 2024-01-24T13:04:03.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/2632607192 shutdown_connections 2024-01-24T13:04:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/2632607192 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x55d6b0e7c990 0x55d6b0e7ed80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/2632607192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d6b0e1b2a0 0x55d6b0e7c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/2632607192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d6b0e1a980 0x55d6b0e79f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ef5e000 1 --2- 172.21.15.29:0/2632607192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d6b0dced30 0x55d6b0e779b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/2632607192 >> 172.21.15.29:0/2632607192 conn(0x55d6b0cd4430 msgr2=0x55d6b0dd4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6ef2000640 0 client.4408 ms_handle_reset on v2:172.21.15.163:6835/1191601563 2024-01-24T13:04:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/2632607192 shutdown_connections 2024-01-24T13:04:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ef5e000 1 -- 172.21.15.29:0/2632607192 wait complete. 2024-01-24T13:04:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ef5e000 20 client.4408 trim_cache size 0 max 16384 2024-01-24T13:04:03.549 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:04:03.549 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "065451ff-9152-4ec9-a888-63a66559ccfb", 2024-01-24T13:04:03.549 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-01-24T13:04:03.549 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4284, 2024-01-24T13:04:03.549 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-01-24T13:04:03.549 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-01-24T13:04:03.549 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-01-24T13:04:03.549 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 7.5601471030000003, 2024-01-24T13:04:03.549 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 7, 2024-01-24T13:04:03.549 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 28, 2024-01-24T13:04:03.549 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 27, 2024-01-24T13:04:03.549 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 14.660087763 2024-01-24T13:04:03.549 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:04:03.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ba00640 1 -- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6edc065a60 msgr2=0x7f6edc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ba00640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6edc065a60 0x7f6edc067f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4007cc0 tx=0x7f6ef4009040 comp rx=0 tx=0).stop 2024-01-24T13:04:03.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ba00640 1 -- 172.21.15.29:0/1071058937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f040c8b10 msgr2=0x7f6f0406af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ba00640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f040c8b10 0x7f6f0406af70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6f040b65d0 tx=0x7f6efc00eb90 comp rx=0 tx=0).stop 2024-01-24T13:04:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ba00640 1 -- 172.21.15.29:0/1071058937 shutdown_connections 2024-01-24T13:04:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ba00640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6edc065a60 0x7f6edc067f20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ba00640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f040c8b10 0x7f6f0406af70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ba00640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f041f2080 0x7f6f040c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ba00640 1 --2- 172.21.15.29:0/1071058937 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ee40047d0 0x7f6f04152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ba00640 1 -- 172.21.15.29:0/1071058937 >> 172.21.15.29:0/1071058937 conn(0x7f6f04069cd0 msgr2=0x7f6f0406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ba00640 1 -- 172.21.15.29:0/1071058937 shutdown_connections 2024-01-24T13:04:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.544+0000 7f6f0ba00640 1 -- 172.21.15.29:0/1071058937 wait complete. 2024-01-24T13:04:03.565 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-24T13:04:03.565 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-24T13:04:03.566 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-24T13:04:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.704+0000 7f5345e00640 1 Processor -- start 2024-01-24T13:04:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.704+0000 7f5345e00640 1 -- start start 2024-01-24T13:04:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f5345e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53400cb100 0x7f5340165280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f5345e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53400cfe50 con 0x7f53400c3ef0 2024-01-24T13:04:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f5345e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534015aa10 con 0x7f534015a630 2024-01-24T13:04:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f5345e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53400cf380 con 0x7f53400cb100 2024-01-24T13:04:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533e000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f53400c3ef0 0x7f53400ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:48942/0 (socket says 172.21.15.29:48942) 2024-01-24T13:04:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533e000640 1 -- 172.21.15.29:0/2926077287 learned_addr learned my addr 172.21.15.29:0/2926077287 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:03.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533f400640 1 --2- 172.21.15.29:0/2926077287 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53400cb100 0x7f5340165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 -- 172.21.15.29:0/2926077287 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820968018 0 0) 0x7f53400cfe50 con 0x7f53400c3ef0 2024-01-24T13:04:03.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 -- 172.21.15.29:0/2926077287 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5320003530 con 0x7f53400c3ef0 2024-01-24T13:04:03.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 -- 172.21.15.29:0/2926077287 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3004897282 0 0) 0x7f5320003530 con 0x7f53400c3ef0 2024-01-24T13:04:03.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 -- 172.21.15.29:0/2926077287 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53400cb100 msgr2=0x7f5340165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:03.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 --2- 172.21.15.29:0/2926077287 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53400cb100 0x7f5340165280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 -- 172.21.15.29:0/2926077287 >> v1:172.21.15.163:6789/0 conn(0x7f534015a630 legacy=0x7f53400cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 -- 172.21.15.29:0/2926077287 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53400b2b70 con 0x7f53400c3ef0 2024-01-24T13:04:03.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 -- 172.21.15.29:0/2926077287 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f5328001680 con 0x7f53400c3ef0 2024-01-24T13:04:03.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 -- 172.21.15.29:0/2926077287 >> v1:172.21.15.29:6789/0 conn(0x7f53400c3ef0 legacy=0x7f53400ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 --2- 172.21.15.29:0/2926077287 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53200039b0 0x7f5320003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 --2- 172.21.15.29:0/2926077287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53200047d0 0x7f5320004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 --2- 172.21.15.29:0/2926077287 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53400cb100 0x7f5320005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 -- 172.21.15.29:0/2926077287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53400cf380 con 0x7f53200047d0 2024-01-24T13:04:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 -- 172.21.15.29:0/2926077287 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532000ba70 con 0x7f53200039b0 2024-01-24T13:04:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533d600640 1 -- 172.21.15.29:0/2926077287 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532000bc30 con 0x7f53400cb100 2024-01-24T13:04:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533e000640 1 --2- 172.21.15.29:0/2926077287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53200047d0 0x7f5320004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533ea00640 1 --2- 172.21.15.29:0/2926077287 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53200039b0 0x7f5320003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533f400640 1 --2- 172.21.15.29:0/2926077287 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53400cb100 0x7f5320005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533e000640 1 -- 172.21.15.29:0/2926077287 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53400cb100 msgr2=0x7f5320005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533e000640 1 --2- 172.21.15.29:0/2926077287 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53400cb100 0x7f5320005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533e000640 1 -- 172.21.15.29:0/2926077287 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53200039b0 msgr2=0x7f5320003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533e000640 1 --2- 172.21.15.29:0/2926077287 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53200039b0 0x7f5320003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.708+0000 7f533e000640 1 -- 172.21.15.29:0/2926077287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5320003530 con 0x7f53200047d0 2024-01-24T13:04:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.712+0000 7f533e000640 1 --2- 172.21.15.29:0/2926077287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53200047d0 0x7f5320004c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f532800c190 tx=0x7f532801f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d3004370230757 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.712+0000 7f533d600640 1 -- 172.21.15.29:0/2926077287 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328005ae0 con 0x7f53200047d0 2024-01-24T13:04:03.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.712+0000 7f533d600640 1 -- 172.21.15.29:0/2926077287 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53280ab070 con 0x7f53200047d0 2024-01-24T13:04:03.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.712+0000 7f533d600640 1 -- 172.21.15.29:0/2926077287 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328005e80 con 0x7f53200047d0 2024-01-24T13:04:03.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.712+0000 7f5345e00640 1 -- 172.21.15.29:0/2926077287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53200047d0 msgr2=0x7f5320004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.712+0000 7f5345e00640 1 --2- 172.21.15.29:0/2926077287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53200047d0 0x7f5320004c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f532800c190 tx=0x7f532801f330 comp rx=0 tx=0).stop 2024-01-24T13:04:03.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.712+0000 7f533f400640 1 -- 172.21.15.29:0/2926077287 reap_dead start 2024-01-24T13:04:03.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.712+0000 7f5345e00640 1 -- 172.21.15.29:0/2926077287 shutdown_connections 2024-01-24T13:04:03.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.712+0000 7f5345e00640 1 -- 172.21.15.29:0/2926077287 >> 172.21.15.29:0/2926077287 conn(0x7f5340070570 msgr2=0x7f5340069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:03.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.712+0000 7f5345e00640 1 -- 172.21.15.29:0/2926077287 shutdown_connections 2024-01-24T13:04:03.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.712+0000 7f5345e00640 1 -- 172.21.15.29:0/2926077287 wait complete. 2024-01-24T13:04:03.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.712+0000 7f5345e00640 1 Processor -- start 2024-01-24T13:04:03.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f5345e00640 1 -- start start 2024-01-24T13:04:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f5345e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53200047d0 0x7f53401518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f5345e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53401f1e40 0x7f53400b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f5345e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53400b5a60 0x7f53400c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f5345e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53400b5fa0 con 0x7f53200047d0 2024-01-24T13:04:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f5345e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534015ae10 con 0x7f53400b5a60 2024-01-24T13:04:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f5345e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534015b0f0 con 0x7f53401f1e40 2024-01-24T13:04:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f533ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53200047d0 0x7f53401518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f533ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53200047d0 0x7f53401518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36410/0 (socket says 172.21.15.29:36410) 2024-01-24T13:04:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f533ea00640 1 -- 172.21.15.29:0/1979907895 learned_addr learned my addr 172.21.15.29:0/1979907895 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f533e000640 1 --2- 172.21.15.29:0/1979907895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53401f1e40 0x7f53400b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f533f400640 1 --2- 172.21.15.29:0/1979907895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53400b5a60 0x7f53400c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f533ea00640 1 -- 172.21.15.29:0/1979907895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53401f1e40 msgr2=0x7f53400b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f533ea00640 1 --2- 172.21.15.29:0/1979907895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53401f1e40 0x7f53400b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f533ea00640 1 -- 172.21.15.29:0/1979907895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53400b5a60 msgr2=0x7f53400c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f533ea00640 1 --2- 172.21.15.29:0/1979907895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53400b5a60 0x7f53400c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f533ea00640 1 -- 172.21.15.29:0/1979907895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534015b3d0 con 0x7f53200047d0 2024-01-24T13:04:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f533ea00640 1 --2- 172.21.15.29:0/1979907895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53200047d0 0x7f53401518d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f533000f7f0 tx=0x7f533000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f5337400640 1 -- 172.21.15.29:0/1979907895 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53300050d0 con 0x7f53200047d0 2024-01-24T13:04:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f5337400640 1 -- 172.21.15.29:0/1979907895 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5330005230 con 0x7f53200047d0 2024-01-24T13:04:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f5337400640 1 -- 172.21.15.29:0/1979907895 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533000d730 con 0x7f53200047d0 2024-01-24T13:04:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f5345e00640 1 -- 172.21.15.29:0/1979907895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534015b6b0 con 0x7f53200047d0 2024-01-24T13:04:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f5345e00640 1 -- 172.21.15.29:0/1979907895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534015d670 con 0x7f53200047d0 2024-01-24T13:04:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.716+0000 7f5345e00640 1 -- 172.21.15.29:0/1979907895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534015b840 con 0x7f53200047d0 2024-01-24T13:04:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.720+0000 7f5337400640 1 -- 172.21.15.29:0/1979907895 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f533000d890 con 0x7f53200047d0 2024-01-24T13:04:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.720+0000 7f5337400640 1 --2- 172.21.15.29:0/1979907895 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5318065a90 0x7f5318067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.720+0000 7f5337400640 1 -- 172.21.15.29:0/1979907895 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53300832a0 con 0x7f53200047d0 2024-01-24T13:04:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.720+0000 7f533e000640 1 --2- 172.21.15.29:0/1979907895 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5318065a90 0x7f5318067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.720+0000 7f533e000640 1 --2- 172.21.15.29:0/1979907895 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5318065a90 0x7f5318067f50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f53280af000 tx=0x7f53280aa000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.724+0000 7f5337400640 1 -- 172.21.15.29:0/1979907895 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f5330050a10 con 0x7f53200047d0 2024-01-24T13:04:03.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.916+0000 7f5345e00640 1 -- 172.21.15.29:0/1979907895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f534004e850 con 0x7f53200047d0 2024-01-24T13:04:03.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.916+0000 7f5337400640 1 -- 172.21.15.29:0/1979907895 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5330054030 con 0x7f53200047d0 2024-01-24T13:04:03.918 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-24T13:04:03.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.916+0000 7f5345e00640 1 -- 172.21.15.29:0/1979907895 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5318065a90 msgr2=0x7f5318067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.916+0000 7f5345e00640 1 --2- 172.21.15.29:0/1979907895 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5318065a90 0x7f5318067f50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f53280af000 tx=0x7f53280aa000 comp rx=0 tx=0).stop 2024-01-24T13:04:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.916+0000 7f5345e00640 1 -- 172.21.15.29:0/1979907895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53200047d0 msgr2=0x7f53401518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.916+0000 7f5345e00640 1 --2- 172.21.15.29:0/1979907895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53200047d0 0x7f53401518d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f533000f7f0 tx=0x7f533000fcb0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.916+0000 7f5345e00640 1 -- 172.21.15.29:0/1979907895 shutdown_connections 2024-01-24T13:04:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.916+0000 7f5345e00640 1 --2- 172.21.15.29:0/1979907895 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5318065a90 0x7f5318067f50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.916+0000 7f5345e00640 1 --2- 172.21.15.29:0/1979907895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53400b5a60 0x7f53400c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.916+0000 7f5345e00640 1 --2- 172.21.15.29:0/1979907895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53401f1e40 0x7f53400b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.916+0000 7f5345e00640 1 --2- 172.21.15.29:0/1979907895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53200047d0 0x7f53401518d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.916+0000 7f5345e00640 1 -- 172.21.15.29:0/1979907895 >> 172.21.15.29:0/1979907895 conn(0x7f5340070570 msgr2=0x7f53400cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.916+0000 7f5345e00640 1 -- 172.21.15.29:0/1979907895 shutdown_connections 2024-01-24T13:04:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:03.916+0000 7f5345e00640 1 -- 172.21.15.29:0/1979907895 wait complete. 2024-01-24T13:04:03.939 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-24T13:04:03.939 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-24T13:04:03.939 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-01-24T13:04:03.939 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-01-24T13:04:03.939 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-24T13:04:03.939 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-24T13:04:03.939 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-24T13:04:03.939 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-24T13:04:03.939 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-01-24T13:04:03.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:03.940 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-01-24T13:04:03.949 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:04:03.949 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:04:03.949 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:04:03.949 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:03.949 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-24T13:04:03.949 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:03.949 INFO:teuthology.orchestra.run.smithi029.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-24T13:04:03.949 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:03.949 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-01-24T13:04:03.949 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-24T13:04:03.949 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42454sec preferred_lft 42454sec 2024-01-24T13:04:03.949 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-01-24T13:04:03.949 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:03.949 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:03.950 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:03.950 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-01-24T13:04:03.950 INFO:teuthology.orchestra.run.smithi029.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:03.950 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:03.950 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-01-24T13:04:03.950 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:03.950 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:03.950 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-01-24T13:04:03.950 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-24T13:04:03.950 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:b4:3c:c7:07 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:03.950 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-24T13:04:03.951 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:03.952 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-24T13:04:03.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:03.952 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:04:03.952 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:04:03.952 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2024-01-24T13:04:03.952 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2024-01-24T13:04:03.952 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2024-01-24T13:04:03.952 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-24T13:04:03.952 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:04:04.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:04.069 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-24T13:04:04.087 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-01-24T13:04:04.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:04.089 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-01-24T13:04:04.167 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-01-24T13:04:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-24T13:04:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-24T13:04:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-24T13:04:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-24T13:04:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-24T13:04:04.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:04.169 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:04:04.169 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:04:04.169 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-24T13:04:04.169 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-24T13:04:04.169 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-24T13:04:04.169 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:04:04.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:04.262 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-24T13:04:04.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:04.272 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-01-24T13:04:04.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:04.320 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:04:04.320 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:04:04.321 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-24T13:04:04.321 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-01-24T13:04:04.321 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:04:04.404 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-01-24T13:04:04.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:04.404 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:04:04.404 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:04:04.404 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-01-24T13:04:04.405 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-24T13:04:04.405 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-01-24T13:04:04.405 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-01-24T13:04:04.405 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-01-24T13:04:04.405 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:04:04.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:04.564 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:04:04.564 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:04:04.564 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-01-24T13:04:04.564 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2024-01-24T13:04:04.564 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:04:04.604 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-01-24T13:04:04.605 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:04:04.605 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-01-24T13:04:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-01-24T13:04:04.656 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:04:04.656 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-01-24T13:04:04.707 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:04:04.768 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:04:04.769 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:04:04.830 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:04:04.832 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:04:04.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:04.833 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:04:04.884 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-24T13:04:04.884 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-01-24T13:04:04.935 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:04:04.955 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:04:04.956 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:04:05.022 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:04:05.024 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:04:05.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:05.024 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:04:05.044 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:2024-01-24T13:04:05.040+0000 7f1e9e96e580 -1 init, newargv = 0x5601452551d0 newargc=15 2024-01-24T13:04:05.044 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[31815]: starting ceph client 2024-01-24T13:04:05.055 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[31815]: starting fuse 2024-01-24T13:04:06.155 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:04:06.179 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:04:06.179 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:04:06.244 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:04:06.245 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:04:06.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:06.246 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:04:06.301 INFO:teuthology.orchestra.run.smithi029.stdout:43 2024-01-24T13:04:06.301 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-24T13:04:06.301 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-24T13:04:06.301 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-01-24T13:04:06.301 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-01-24T13:04:06.301 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-01-24T13:04:06.301 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-01-24T13:04:06.301 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:04:06.302 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-01-24T13:04:06.302 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-01-24T13:04:06.302 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-01-24T13:04:06.302 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-01-24T13:04:06.302 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:04:06.302 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-01-24T13:04:06.302 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-01-24T13:04:06.302 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-01-24T13:04:06.302 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-01-24T13:04:06.302 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:04:06.302 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-01-24T13:04:06.302 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-24T13:04:06.302 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-24T13:04:06.302 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-24T13:04:06.303 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-01-24T13:04:06.303 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-01-24T13:04:06.303 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-01-24T13:04:06.303 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-24T13:04:06.303 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:04:06.303 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.admin")) 2024-01-24T13:04:06.303 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-01-24T13:04:06.433 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.admin.31815.asok 2024-01-24T13:04:06.615 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.31815.asok 2024-01-24T13:04:06.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:06.616 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.31815.asok status 2024-01-24T13:04:06.791 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:04:06.791 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-01-24T13:04:06.791 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "4e3182a65800aed6d4aa2f6b86da3cfd72188134", 2024-01-24T13:04:06.791 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable)", 2024-01-24T13:04:06.791 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "admin", 2024-01-24T13:04:06.791 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-01-24T13:04:06.791 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-01-24T13:04:06.791 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "31815", 2024-01-24T13:04:06.792 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-01-24T13:04:06.792 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:04:06.792 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-01-24T13:04:06.792 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-01-24T13:04:06.792 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4431, 2024-01-24T13:04:06.792 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-01-24T13:04:06.792 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-01-24T13:04:06.792 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-01-24T13:04:06.792 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 4431 2024-01-24T13:04:06.792 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:04:06.792 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:04:06.792 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:04:06.792 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:04:06.792 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 1732834752 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 1732834752 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.4431 192.168.0.1:0/1732834752", 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/1732834752", 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 7, 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 28, 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-01-24T13:04:06.793 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-01-24T13:04:06.794 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:04:06.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:06.806 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-01-24T13:04:06.806 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-01-24T13:04:06.815 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-01-24T13:04:06.815 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-01-24T13:04:06.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:06.816 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-01-24T13:04:06.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:06.877 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-01-24T13:04:06.960 INFO:teuthology.orchestra.run.smithi029.stdout:# file: . 2024-01-24T13:04:06.960 INFO:teuthology.orchestra.run.smithi029.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-01-24T13:04:06.960 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:06.961 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:04:06.961 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:04:07.016 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:07.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d9800640 1 Processor -- start 2024-01-24T13:04:07.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d9800640 1 -- start start 2024-01-24T13:04:07.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d9800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f90d40b2700 0x7f90d406b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d9800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f90d40ccdb0 0x7f90d40cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d9800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d40cd720 con 0x7f90d415c730 2024-01-24T13:04:07.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d9800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d406cc10 con 0x7f90d40b2700 2024-01-24T13:04:07.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d9800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d406b7a0 con 0x7f90d40ccdb0 2024-01-24T13:04:07.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d2000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f90d40b2700 0x7f90d406b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d2000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f90d40b2700 0x7f90d406b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36412/0 (socket says 172.21.15.29:36412) 2024-01-24T13:04:07.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d2000640 1 -- 172.21.15.29:0/3967794814 learned_addr learned my addr 172.21.15.29:0/3967794814 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:07.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d2a00640 1 --1- 172.21.15.29:0/3967794814 >> v1:172.21.15.29:6789/0 conn(0x7f90d415c730 0x7f90d40ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:48944/0 (socket says 172.21.15.29:48944) 2024-01-24T13:04:07.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d2000640 1 -- 172.21.15.29:0/3967794814 >> v2:172.21.15.163:3300/0 conn(0x7f90d40ccdb0 msgr2=0x7f90d40cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:07.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d2000640 1 --2- 172.21.15.29:0/3967794814 >> v2:172.21.15.163:3300/0 conn(0x7f90d40ccdb0 0x7f90d40cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d2000640 1 -- 172.21.15.29:0/3967794814 >> v1:172.21.15.29:6789/0 conn(0x7f90d415c730 legacy=0x7f90d40ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:07.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d1600640 1 -- 172.21.15.29:0/3967794814 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885880465 0 0) 0x7f90d40cd720 con 0x7f90d415c730 2024-01-24T13:04:07.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.204+0000 7f90d2000640 1 -- 172.21.15.29:0/3967794814 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d406ba80 con 0x7f90d40b2700 2024-01-24T13:04:07.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.208+0000 7f90d2000640 1 --2- 172.21.15.29:0/3967794814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40b2700 0x7f90d406b110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f90d41602d0 tx=0x7f90bc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c979352e43434872 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:07.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.208+0000 7f90d1600640 1 -- 172.21.15.29:0/3967794814 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0ab5f0 con 0x7f90d40b2700 2024-01-24T13:04:07.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.208+0000 7f90d1600640 1 -- 172.21.15.29:0/3967794814 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc0ab750 con 0x7f90d40b2700 2024-01-24T13:04:07.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.208+0000 7f90d1600640 1 -- 172.21.15.29:0/3967794814 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0abae0 con 0x7f90d40b2700 2024-01-24T13:04:07.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.208+0000 7f90d9800640 1 -- 172.21.15.29:0/3967794814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40b2700 msgr2=0x7f90d406b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:07.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.208+0000 7f90d9800640 1 --2- 172.21.15.29:0/3967794814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40b2700 0x7f90d406b110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f90d41602d0 tx=0x7f90bc01c500 comp rx=0 tx=0).stop 2024-01-24T13:04:07.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.208+0000 7f90d9800640 1 -- 172.21.15.29:0/3967794814 shutdown_connections 2024-01-24T13:04:07.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.208+0000 7f90d9800640 1 --2- 172.21.15.29:0/3967794814 >> v2:172.21.15.163:3300/0 conn(0x7f90d40ccdb0 0x7f90d40cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.208+0000 7f90d9800640 1 --2- 172.21.15.29:0/3967794814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40b2700 0x7f90d406b110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.208+0000 7f90d9800640 1 -- 172.21.15.29:0/3967794814 >> 172.21.15.29:0/3967794814 conn(0x7f90d4070570 msgr2=0x7f90d4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:07.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.208+0000 7f90d9800640 1 -- 172.21.15.29:0/3967794814 shutdown_connections 2024-01-24T13:04:07.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.208+0000 7f90d9800640 1 -- 172.21.15.29:0/3967794814 wait complete. 2024-01-24T13:04:07.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.208+0000 7f90d9800640 1 Processor -- start 2024-01-24T13:04:07.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d9800640 1 -- start start 2024-01-24T13:04:07.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d9800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40b2700 0x7f90d415b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d9800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90d40ccdb0 0x7f90d40af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d9800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d415c730 0x7f90d40c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d9800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40c6430 con 0x7f90d40b2700 2024-01-24T13:04:07.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d9800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40b1690 con 0x7f90d40ccdb0 2024-01-24T13:04:07.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d9800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40c5860 con 0x7f90d415c730 2024-01-24T13:04:07.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d2a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40b2700 0x7f90d415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d2a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40b2700 0x7f90d415b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36428/0 (socket says 172.21.15.29:36428) 2024-01-24T13:04:07.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d2a00640 1 -- 172.21.15.29:0/3847022312 learned_addr learned my addr 172.21.15.29:0/3847022312 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:07.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d2000640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90d40ccdb0 0x7f90d40af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d3400640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d415c730 0x7f90d40c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d2a00640 1 -- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d415c730 msgr2=0x7f90d40c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:07.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d2a00640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d415c730 0x7f90d40c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d2a00640 1 -- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90d40ccdb0 msgr2=0x7f90d40af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:07.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d2a00640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90d40ccdb0 0x7f90d40af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d2a00640 1 -- 172.21.15.29:0/3847022312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc0094d0 con 0x7f90d40b2700 2024-01-24T13:04:07.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d3400640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d415c730 0x7f90d40c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:07.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d2a00640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40b2700 0x7f90d415b080 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90c400c450 tx=0x7f90c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:07.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90caa00640 1 -- 172.21.15.29:0/3847022312 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4007480 con 0x7f90d40b2700 2024-01-24T13:04:07.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90caa00640 1 -- 172.21.15.29:0/3847022312 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c4007600 con 0x7f90d40b2700 2024-01-24T13:04:07.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d9800640 1 -- 172.21.15.29:0/3847022312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d40c5b00 con 0x7f90d40b2700 2024-01-24T13:04:07.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90caa00640 1 -- 172.21.15.29:0/3847022312 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4004a30 con 0x7f90d40b2700 2024-01-24T13:04:07.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d9800640 1 -- 172.21.15.29:0/3847022312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d40c60c0 con 0x7f90d40b2700 2024-01-24T13:04:07.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.212+0000 7f90d9800640 1 -- 172.21.15.29:0/3847022312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d40cf430 con 0x7f90d40b2700 2024-01-24T13:04:07.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.216+0000 7f90caa00640 1 -- 172.21.15.29:0/3847022312 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f90c4004b90 con 0x7f90d40b2700 2024-01-24T13:04:07.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.216+0000 7f90caa00640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f90ac065a90 0x7f90ac067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.216+0000 7f90caa00640 1 -- 172.21.15.29:0/3847022312 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f90c40827f0 con 0x7f90d40b2700 2024-01-24T13:04:07.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.216+0000 7f90d2000640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f90ac065a90 0x7f90ac067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.216+0000 7f90d2000640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f90ac065a90 0x7f90ac067f50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0af000 tx=0x7f90bc0b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:07.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.220+0000 7f90caa00640 1 -- 172.21.15.29:0/3847022312 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f90c404ff70 con 0x7f90d40b2700 2024-01-24T13:04:07.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.376+0000 7f90d9800640 1 -- 172.21.15.29:0/3847022312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90d404e850 con 0x7f90d40b2700 2024-01-24T13:04:07.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.380+0000 7f90caa00640 1 -- 172.21.15.29:0/3847022312 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f90c4053590 con 0x7f90d40b2700 2024-01-24T13:04:07.381 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:07.381 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:01.140044+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:07.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.380+0000 7f90d9800640 1 -- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f90ac065a90 msgr2=0x7f90ac067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:07.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.380+0000 7f90d9800640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f90ac065a90 0x7f90ac067f50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0af000 tx=0x7f90bc0b6040 comp rx=0 tx=0).stop 2024-01-24T13:04:07.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.380+0000 7f90d9800640 1 -- 172.21.15.29:0/3847022312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40b2700 msgr2=0x7f90d415b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:07.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.380+0000 7f90d9800640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40b2700 0x7f90d415b080 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90c400c450 tx=0x7f90c400c910 comp rx=0 tx=0).stop 2024-01-24T13:04:07.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.380+0000 7f90d9800640 1 -- 172.21.15.29:0/3847022312 shutdown_connections 2024-01-24T13:04:07.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.380+0000 7f90d9800640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f90ac065a90 0x7f90ac067f50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.380+0000 7f90d9800640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d415c730 0x7f90d40c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.380+0000 7f90d9800640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90d40ccdb0 0x7f90d40af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.380+0000 7f90d9800640 1 --2- 172.21.15.29:0/3847022312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40b2700 0x7f90d415b080 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.380+0000 7f90d9800640 1 -- 172.21.15.29:0/3847022312 >> 172.21.15.29:0/3847022312 conn(0x7f90d4070570 msgr2=0x7f90d40b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:07.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.380+0000 7f90d9800640 1 -- 172.21.15.29:0/3847022312 shutdown_connections 2024-01-24T13:04:07.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.380+0000 7f90d9800640 1 -- 172.21.15.29:0/3847022312 wait complete. 2024-01-24T13:04:07.403 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:04:07.403 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:04:07.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.544+0000 7f9239000640 1 Processor -- start 2024-01-24T13:04:07.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.544+0000 7f9239000640 1 -- start start 2024-01-24T13:04:07.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.548+0000 7f9239000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92340cd300 0x7f923415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.548+0000 7f9239000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f92340ce4e0 0x7f92340d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.548+0000 7f9239000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9234161130 con 0x7f92340ce050 2024-01-24T13:04:07.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.548+0000 7f9239000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923415dbe0 con 0x7f92340cd300 2024-01-24T13:04:07.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.548+0000 7f9239000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92341605b0 con 0x7f92340ce4e0 2024-01-24T13:04:07.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.548+0000 7f9231e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92340cd300 0x7f923415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.548+0000 7f9231e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92340cd300 0x7f923415d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36434/0 (socket says 172.21.15.29:36434) 2024-01-24T13:04:07.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.548+0000 7f9231e00640 1 -- 172.21.15.29:0/1724594819 learned_addr learned my addr 172.21.15.29:0/1724594819 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:07.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.548+0000 7f9232800640 1 --2- 172.21.15.29:0/1724594819 >> v2:172.21.15.163:3300/0 conn(0x7f92340ce4e0 0x7f92340d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.548+0000 7f9231e00640 1 -- 172.21.15.29:0/1724594819 >> v2:172.21.15.163:3300/0 conn(0x7f92340ce4e0 msgr2=0x7f92340d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:07.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.548+0000 7f9231e00640 1 --2- 172.21.15.29:0/1724594819 >> v2:172.21.15.163:3300/0 conn(0x7f92340ce4e0 0x7f92340d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.548+0000 7f9231e00640 1 -- 172.21.15.29:0/1724594819 >> v1:172.21.15.163:6789/0 conn(0x7f92340ce050 legacy=0x7f92340d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:07.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.548+0000 7f9231e00640 1 -- 172.21.15.29:0/1724594819 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9234160890 con 0x7f92340cd300 2024-01-24T13:04:07.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.552+0000 7f9231e00640 1 --2- 172.21.15.29:0/1724594819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92340cd300 0x7f923415d6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f923406cf00 tx=0x7f922401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be32d8997f8bf928 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:07.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.552+0000 7f9230a00640 1 -- 172.21.15.29:0/1724594819 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92240aa620 con 0x7f92340cd300 2024-01-24T13:04:07.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.552+0000 7f9230a00640 1 -- 172.21.15.29:0/1724594819 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92240aa780 con 0x7f92340cd300 2024-01-24T13:04:07.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.552+0000 7f9230a00640 1 -- 172.21.15.29:0/1724594819 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92240aab10 con 0x7f92340cd300 2024-01-24T13:04:07.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.552+0000 7f9239000640 1 -- 172.21.15.29:0/1724594819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92340cd300 msgr2=0x7f923415d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:07.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.552+0000 7f9239000640 1 --2- 172.21.15.29:0/1724594819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92340cd300 0x7f923415d6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f923406cf00 tx=0x7f922401c4c0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.552+0000 7f9239000640 1 -- 172.21.15.29:0/1724594819 shutdown_connections 2024-01-24T13:04:07.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.552+0000 7f9239000640 1 --2- 172.21.15.29:0/1724594819 >> v2:172.21.15.163:3300/0 conn(0x7f92340ce4e0 0x7f92340d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.552+0000 7f9239000640 1 --2- 172.21.15.29:0/1724594819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92340cd300 0x7f923415d6a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.552+0000 7f9239000640 1 -- 172.21.15.29:0/1724594819 >> 172.21.15.29:0/1724594819 conn(0x7f9234069cd0 msgr2=0x7f923406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:07.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.552+0000 7f9239000640 1 -- 172.21.15.29:0/1724594819 shutdown_connections 2024-01-24T13:04:07.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.552+0000 7f9239000640 1 -- 172.21.15.29:0/1724594819 wait complete. 2024-01-24T13:04:07.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.552+0000 7f9239000640 1 Processor -- start 2024-01-24T13:04:07.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.552+0000 7f9239000640 1 -- start start 2024-01-24T13:04:07.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9239000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f92340cd300 0x7f92340ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9239000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92340ce050 0x7f92340b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9239000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92340ce4e0 0x7f9234152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9239000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92340b4200 con 0x7f92340ce4e0 2024-01-24T13:04:07.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9239000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92340b44e0 con 0x7f92340ce050 2024-01-24T13:04:07.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9239000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92340b2c40 con 0x7f92340cd300 2024-01-24T13:04:07.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9232800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92340ce4e0 0x7f9234152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9232800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92340ce4e0 0x7f9234152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36440/0 (socket says 172.21.15.29:36440) 2024-01-24T13:04:07.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9232800640 1 -- 172.21.15.29:0/3338738934 learned_addr learned my addr 172.21.15.29:0/3338738934 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:07.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9231e00640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f92340cd300 0x7f92340ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9231400640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92340ce050 0x7f92340b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9232800640 1 -- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f92340cd300 msgr2=0x7f92340ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:07.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9232800640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f92340cd300 0x7f92340ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9232800640 1 -- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92340ce050 msgr2=0x7f92340b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:07.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9232800640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92340ce050 0x7f92340b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9232800640 1 -- 172.21.15.29:0/3338738934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92240094d0 con 0x7f92340ce4e0 2024-01-24T13:04:07.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9231e00640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f92340cd300 0x7f92340ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:07.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9232800640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92340ce4e0 0x7f9234152e60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f922c007e40 tx=0x7f922c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:07.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f922a000640 1 -- 172.21.15.29:0/3338738934 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c014620 con 0x7f92340ce4e0 2024-01-24T13:04:07.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f922a000640 1 -- 172.21.15.29:0/3338738934 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922c00ee90 con 0x7f92340ce4e0 2024-01-24T13:04:07.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f922a000640 1 -- 172.21.15.29:0/3338738934 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c0149e0 con 0x7f92340ce4e0 2024-01-24T13:04:07.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9239000640 1 -- 172.21.15.29:0/3338738934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92340b2f20 con 0x7f92340ce4e0 2024-01-24T13:04:07.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9239000640 1 -- 172.21.15.29:0/3338738934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92340b3c60 con 0x7f92340ce4e0 2024-01-24T13:04:07.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.556+0000 7f9239000640 1 -- 172.21.15.29:0/3338738934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92340b3440 con 0x7f92340ce4e0 2024-01-24T13:04:07.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.560+0000 7f922a000640 1 -- 172.21.15.29:0/3338738934 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f922c014b40 con 0x7f92340ce4e0 2024-01-24T13:04:07.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.560+0000 7f922a000640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f920c065a60 0x7f920c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.560+0000 7f922a000640 1 -- 172.21.15.29:0/3338738934 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f922c083ee0 con 0x7f92340ce4e0 2024-01-24T13:04:07.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.560+0000 7f9231e00640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f920c065a60 0x7f920c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.560+0000 7f9231e00640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f920c065a60 0x7f920c067f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92240ae000 tx=0x7f92240a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:07.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.564+0000 7f922a000640 1 -- 172.21.15.29:0/3338738934 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f92340b3440 con 0x7f92340ce4e0 2024-01-24T13:04:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.720+0000 7f9239000640 1 -- 172.21.15.29:0/3338738934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92340b3440 con 0x7f92340ce4e0 2024-01-24T13:04:07.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.720+0000 7f922a000640 1 -- 172.21.15.29:0/3338738934 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92340b3440 con 0x7f92340ce4e0 2024-01-24T13:04:07.724 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:04:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.724+0000 7f9239000640 1 -- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f920c065a60 msgr2=0x7f920c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.724+0000 7f9239000640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f920c065a60 0x7f920c067f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92240ae000 tx=0x7f92240a7000 comp rx=0 tx=0).stop 2024-01-24T13:04:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.724+0000 7f9239000640 1 -- 172.21.15.29:0/3338738934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92340ce4e0 msgr2=0x7f9234152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.724+0000 7f9239000640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92340ce4e0 0x7f9234152e60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f922c007e40 tx=0x7f922c00e4b0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.724+0000 7f9239000640 1 -- 172.21.15.29:0/3338738934 shutdown_connections 2024-01-24T13:04:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.724+0000 7f9239000640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f920c065a60 0x7f920c067f20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.724+0000 7f9239000640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92340ce4e0 0x7f9234152e60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.724+0000 7f9239000640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92340ce050 0x7f92340b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.724+0000 7f9239000640 1 --2- 172.21.15.29:0/3338738934 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f92340cd300 0x7f92340ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.724+0000 7f9239000640 1 -- 172.21.15.29:0/3338738934 >> 172.21.15.29:0/3338738934 conn(0x7f9234069cd0 msgr2=0x7f923415ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:07.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.724+0000 7f9239000640 1 -- 172.21.15.29:0/3338738934 shutdown_connections 2024-01-24T13:04:07.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.724+0000 7f9239000640 1 -- 172.21.15.29:0/3338738934 wait complete. 2024-01-24T13:04:07.746 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:04:07.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96eac00640 1 Processor -- start 2024-01-24T13:04:07.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96eac00640 1 -- start start 2024-01-24T13:04:07.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96eac00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e4153a00 0x7f96e4071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96eac00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f96e40b2760 0x7f96e40b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96eac00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96e40b1130 0x7f96e40b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96eac00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e40b3120 con 0x7f96e40b1130 2024-01-24T13:04:07.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96eac00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e4153de0 con 0x7f96e40b2760 2024-01-24T13:04:07.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96eac00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e4159900 con 0x7f96e4153a00 2024-01-24T13:04:07.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96e8c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96e40b1130 0x7f96e40b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96e8c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96e40b1130 0x7f96e40b15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36444/0 (socket says 172.21.15.29:36444) 2024-01-24T13:04:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96e8c00640 1 -- 172.21.15.29:0/1593034825 learned_addr learned my addr 172.21.15.29:0/1593034825 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96e3400640 1 --2- 172.21.15.29:0/1593034825 >> v2:172.21.15.163:3300/0 conn(0x7f96e40b2760 0x7f96e40b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96e3e00640 1 --2- 172.21.15.29:0/1593034825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e4153a00 0x7f96e4071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96e8c00640 1 -- 172.21.15.29:0/1593034825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e4153a00 msgr2=0x7f96e4071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96e8c00640 1 --2- 172.21.15.29:0/1593034825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e4153a00 0x7f96e4071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96e8c00640 1 -- 172.21.15.29:0/1593034825 >> v2:172.21.15.163:3300/0 conn(0x7f96e40b2760 msgr2=0x7f96e40b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96e8c00640 1 --2- 172.21.15.29:0/1593034825 >> v2:172.21.15.163:3300/0 conn(0x7f96e40b2760 0x7f96e40b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96e8c00640 1 -- 172.21.15.29:0/1593034825 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e4159bc0 con 0x7f96e40b1130 2024-01-24T13:04:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.888+0000 7f96e3400640 1 --2- 172.21.15.29:0/1593034825 >> v2:172.21.15.163:3300/0 conn(0x7f96e40b2760 0x7f96e40b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.892+0000 7f96e8c00640 1 --2- 172.21.15.29:0/1593034825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e40b1130 0x7f96e40b15c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f96e406a8f0 tx=0x7f96dc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49aa1bb4d75ab1d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.892+0000 7f96e2a00640 1 -- 172.21.15.29:0/1593034825 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0a5790 con 0x7f96e40b1130 2024-01-24T13:04:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.892+0000 7f96e2a00640 1 -- 172.21.15.29:0/1593034825 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc0a58f0 con 0x7f96e40b1130 2024-01-24T13:04:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.892+0000 7f96e2a00640 1 -- 172.21.15.29:0/1593034825 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0a5c80 con 0x7f96e40b1130 2024-01-24T13:04:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.892+0000 7f96eac00640 1 -- 172.21.15.29:0/1593034825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e40b1130 msgr2=0x7f96e40b15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.892+0000 7f96eac00640 1 --2- 172.21.15.29:0/1593034825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e40b1130 0x7f96e40b15c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f96e406a8f0 tx=0x7f96dc01c910 comp rx=0 tx=0).stop 2024-01-24T13:04:07.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.892+0000 7f96eac00640 1 -- 172.21.15.29:0/1593034825 shutdown_connections 2024-01-24T13:04:07.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.892+0000 7f96eac00640 1 --2- 172.21.15.29:0/1593034825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e40b1130 0x7f96e40b15c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.892+0000 7f96eac00640 1 --2- 172.21.15.29:0/1593034825 >> v2:172.21.15.163:3300/0 conn(0x7f96e40b2760 0x7f96e40b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.892+0000 7f96eac00640 1 --2- 172.21.15.29:0/1593034825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e4153a00 0x7f96e4071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.892+0000 7f96eac00640 1 -- 172.21.15.29:0/1593034825 >> 172.21.15.29:0/1593034825 conn(0x7f96e406d700 msgr2=0x7f96e4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:07.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96eac00640 1 -- 172.21.15.29:0/1593034825 shutdown_connections 2024-01-24T13:04:07.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96eac00640 1 -- 172.21.15.29:0/1593034825 wait complete. 2024-01-24T13:04:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96eac00640 1 Processor -- start 2024-01-24T13:04:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96eac00640 1 -- start start 2024-01-24T13:04:07.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96eac00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e40b1130 0x7f96e40b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96eac00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e40b2760 0x7f96e41417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96eac00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e4153a00 0x7f96e4145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96eac00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e4146ff0 con 0x7f96e40b1130 2024-01-24T13:04:07.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96eac00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e4141d20 con 0x7f96e40b2760 2024-01-24T13:04:07.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96eac00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e4146140 con 0x7f96e4153a00 2024-01-24T13:04:07.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96e3e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e40b1130 0x7f96e40b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96e3e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e40b1130 0x7f96e40b07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36450/0 (socket says 172.21.15.29:36450) 2024-01-24T13:04:07.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96e3e00640 1 -- 172.21.15.29:0/1456856008 learned_addr learned my addr 172.21.15.29:0/1456856008 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:07.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96e3400640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e40b2760 0x7f96e41417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96e8c00640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e4153a00 0x7f96e4145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96e3e00640 1 -- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e4153a00 msgr2=0x7f96e4145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:07.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96e3e00640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e4153a00 0x7f96e4145c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96e3e00640 1 -- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e40b2760 msgr2=0x7f96e41417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:07.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96e3e00640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e40b2760 0x7f96e41417e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:07.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96e3e00640 1 -- 172.21.15.29:0/1456856008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc009b30 con 0x7f96e40b1130 2024-01-24T13:04:07.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96e3400640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e40b2760 0x7f96e41417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:07.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.896+0000 7f96e3e00640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e40b1130 0x7f96e40b07c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96d400d800 tx=0x7f96d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:07.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.900+0000 7f96dbe00640 1 -- 172.21.15.29:0/1456856008 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d400b6c0 con 0x7f96e40b1130 2024-01-24T13:04:07.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.900+0000 7f96dbe00640 1 -- 172.21.15.29:0/1456856008 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d400b820 con 0x7f96e40b1130 2024-01-24T13:04:07.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.900+0000 7f96eac00640 1 -- 172.21.15.29:0/1456856008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e41463e0 con 0x7f96e40b1130 2024-01-24T13:04:07.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.900+0000 7f96dbe00640 1 -- 172.21.15.29:0/1456856008 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d400bb90 con 0x7f96e40b1130 2024-01-24T13:04:07.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.900+0000 7f96eac00640 1 -- 172.21.15.29:0/1456856008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e41469a0 con 0x7f96e40b1130 2024-01-24T13:04:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.900+0000 7f96eac00640 1 -- 172.21.15.29:0/1456856008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e415a160 con 0x7f96e40b1130 2024-01-24T13:04:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.900+0000 7f96dbe00640 1 -- 172.21.15.29:0/1456856008 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f96d400bcf0 con 0x7f96e40b1130 2024-01-24T13:04:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.900+0000 7f96dbe00640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f96bc065a60 0x7f96bc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.900+0000 7f96dbe00640 1 -- 172.21.15.29:0/1456856008 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f96d4083a70 con 0x7f96e40b1130 2024-01-24T13:04:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.900+0000 7f96e3400640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f96bc065a60 0x7f96bc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.904+0000 7f96e3400640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f96bc065a60 0x7f96bc067f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f96e4164250 tx=0x7f96cc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:07.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:07.904+0000 7f96dbe00640 1 -- 172.21.15.29:0/1456856008 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f96e415a160 con 0x7f96e40b1130 2024-01-24T13:04:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.068+0000 7f96eac00640 1 -- 172.21.15.29:0/1456856008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96e415a160 con 0x7f96e40b1130 2024-01-24T13:04:08.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.068+0000 7f96dbe00640 1 -- 172.21.15.29:0/1456856008 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96e415a160 con 0x7f96e40b1130 2024-01-24T13:04:08.069 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:08.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.068+0000 7f96eac00640 1 -- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f96bc065a60 msgr2=0x7f96bc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.068+0000 7f96eac00640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f96bc065a60 0x7f96bc067f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f96e4164250 tx=0x7f96cc008040 comp rx=0 tx=0).stop 2024-01-24T13:04:08.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.068+0000 7f96eac00640 1 -- 172.21.15.29:0/1456856008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e40b1130 msgr2=0x7f96e40b07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.068+0000 7f96eac00640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e40b1130 0x7f96e40b07c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96d400d800 tx=0x7f96d400dcc0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.068+0000 7f96eac00640 1 -- 172.21.15.29:0/1456856008 shutdown_connections 2024-01-24T13:04:08.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.068+0000 7f96eac00640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f96bc065a60 0x7f96bc067f20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.068+0000 7f96eac00640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e4153a00 0x7f96e4145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.068+0000 7f96eac00640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e40b2760 0x7f96e41417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.068+0000 7f96eac00640 1 --2- 172.21.15.29:0/1456856008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e40b1130 0x7f96e40b07c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.068+0000 7f96eac00640 1 -- 172.21.15.29:0/1456856008 >> 172.21.15.29:0/1456856008 conn(0x7f96e406d700 msgr2=0x7f96e4072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:08.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.068+0000 7f96eac00640 1 -- 172.21.15.29:0/1456856008 shutdown_connections 2024-01-24T13:04:08.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.068+0000 7f96eac00640 1 -- 172.21.15.29:0/1456856008 wait complete. 2024-01-24T13:04:08.092 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:04:08.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.232+0000 7f8005c00640 1 Processor -- start 2024-01-24T13:04:08.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.232+0000 7f8005c00640 1 -- start start 2024-01-24T13:04:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f8005c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8000153a00 0x7f8000071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f8005c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f80000b2c10 0x7f80000b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f8005c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8000153de0 con 0x7f80000b2760 2024-01-24T13:04:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f8005c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800015df00 con 0x7f8000153a00 2024-01-24T13:04:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f8005c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80000b30a0 con 0x7f80000b2c10 2024-01-24T13:04:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f7ffe000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f80000b2760 0x7f80000b1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:48948/0 (socket says 172.21.15.29:48948) 2024-01-24T13:04:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f7ffe000640 1 -- 172.21.15.29:0/2378078531 learned_addr learned my addr 172.21.15.29:0/2378078531 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f7ffea00640 1 --2- 172.21.15.29:0/2378078531 >> v2:172.21.15.163:3300/0 conn(0x7f8000153a00 0x7f8000071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f7fff400640 1 --2- 172.21.15.29:0/2378078531 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f80000b2c10 0x7f80000b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f7ffd600640 1 -- 172.21.15.29:0/2378078531 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279506255 0 0) 0x7f8000153de0 con 0x7f80000b2760 2024-01-24T13:04:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f7ffd600640 1 -- 172.21.15.29:0/2378078531 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fe0003530 con 0x7f80000b2760 2024-01-24T13:04:08.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f7ffea00640 1 -- 172.21.15.29:0/2378078531 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f80000b2c10 msgr2=0x7f80000b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:08.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f7ffea00640 1 --2- 172.21.15.29:0/2378078531 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f80000b2c10 0x7f80000b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f7ffea00640 1 -- 172.21.15.29:0/2378078531 >> v1:172.21.15.29:6789/0 conn(0x7f80000b2760 legacy=0x7f80000b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.236+0000 7f7ffea00640 1 -- 172.21.15.29:0/2378078531 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8000159900 con 0x7f8000153a00 2024-01-24T13:04:08.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.240+0000 7f7ffea00640 1 --2- 172.21.15.29:0/2378078531 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8000153a00 0x7f8000071600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00097c0 tx=0x7f7ff001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82cac3e910df2e0e server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:08.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.240+0000 7f7ffd600640 1 -- 172.21.15.29:0/2378078531 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00ac620 con 0x7f8000153a00 2024-01-24T13:04:08.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.240+0000 7f7ffd600640 1 -- 172.21.15.29:0/2378078531 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff00ac780 con 0x7f8000153a00 2024-01-24T13:04:08.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.240+0000 7f7ffd600640 1 -- 172.21.15.29:0/2378078531 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00acaf0 con 0x7f8000153a00 2024-01-24T13:04:08.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.240+0000 7f8005c00640 1 -- 172.21.15.29:0/2378078531 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8000153a00 msgr2=0x7f8000071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.240+0000 7f8005c00640 1 --2- 172.21.15.29:0/2378078531 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8000153a00 0x7f8000071600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00097c0 tx=0x7f7ff001c3c0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.240+0000 7f8005c00640 1 -- 172.21.15.29:0/2378078531 shutdown_connections 2024-01-24T13:04:08.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.240+0000 7f8005c00640 1 --2- 172.21.15.29:0/2378078531 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f80000b2c10 0x7f80000b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.240+0000 7f8005c00640 1 --2- 172.21.15.29:0/2378078531 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8000153a00 0x7f8000071600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.240+0000 7f8005c00640 1 -- 172.21.15.29:0/2378078531 >> 172.21.15.29:0/2378078531 conn(0x7f800006d700 msgr2=0x7f8000069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:08.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.240+0000 7f8005c00640 1 -- 172.21.15.29:0/2378078531 shutdown_connections 2024-01-24T13:04:08.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.240+0000 7f8005c00640 1 -- 172.21.15.29:0/2378078531 wait complete. 2024-01-24T13:04:08.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.240+0000 7f8005c00640 1 Processor -- start 2024-01-24T13:04:08.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f8005c00640 1 -- start start 2024-01-24T13:04:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f8005c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80000b2760 0x7f800013cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f8005c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000b2c10 0x7f800013d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f8005c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8000153a00 0x7f800013dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f8005c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80001438d0 con 0x7f80000b2760 2024-01-24T13:04:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f8005c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80001512b0 con 0x7f80000b2c10 2024-01-24T13:04:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f8005c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800015d080 con 0x7f8000153a00 2024-01-24T13:04:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f7ffea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80000b2760 0x7f800013cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f7ffea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80000b2760 0x7f800013cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36456/0 (socket says 172.21.15.29:36456) 2024-01-24T13:04:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f7ffea00640 1 -- 172.21.15.29:0/2239550150 learned_addr learned my addr 172.21.15.29:0/2239550150 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f7fff400640 1 --2- 172.21.15.29:0/2239550150 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8000153a00 0x7f800013dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f7ffe000640 1 --2- 172.21.15.29:0/2239550150 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000b2c10 0x7f800013d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f7ffea00640 1 -- 172.21.15.29:0/2239550150 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8000153a00 msgr2=0x7f800013dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f7ffea00640 1 --2- 172.21.15.29:0/2239550150 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8000153a00 0x7f800013dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f7ffea00640 1 -- 172.21.15.29:0/2239550150 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000b2c10 msgr2=0x7f800013d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f7ffea00640 1 --2- 172.21.15.29:0/2239550150 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000b2c10 0x7f800013d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f7ffea00640 1 -- 172.21.15.29:0/2239550150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff0009420 con 0x7f80000b2760 2024-01-24T13:04:08.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f7ffea00640 1 --2- 172.21.15.29:0/2239550150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80000b2760 0x7f800013cf00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0019ff0 tx=0x7f7ff0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:08.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f7ff6a00640 1 -- 172.21.15.29:0/2239550150 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00ac620 con 0x7f80000b2760 2024-01-24T13:04:08.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f7ff6a00640 1 -- 172.21.15.29:0/2239550150 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff0006e20 con 0x7f80000b2760 2024-01-24T13:04:08.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f8005c00640 1 -- 172.21.15.29:0/2239550150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8000150910 con 0x7f80000b2760 2024-01-24T13:04:08.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f7ff6a00640 1 -- 172.21.15.29:0/2239550150 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00b5600 con 0x7f80000b2760 2024-01-24T13:04:08.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f8005c00640 1 -- 172.21.15.29:0/2239550150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8000150ed0 con 0x7f80000b2760 2024-01-24T13:04:08.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.244+0000 7f8005c00640 1 -- 172.21.15.29:0/2239550150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800004e850 con 0x7f80000b2760 2024-01-24T13:04:08.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.248+0000 7f7ff6a00640 1 -- 172.21.15.29:0/2239550150 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7ff00b3040 con 0x7f80000b2760 2024-01-24T13:04:08.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.248+0000 7f7ff6a00640 1 --2- 172.21.15.29:0/2239550150 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7fd8065a90 0x7f7fd8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.248+0000 7f7ff6a00640 1 -- 172.21.15.29:0/2239550150 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ff011d8c0 con 0x7f80000b2760 2024-01-24T13:04:08.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.248+0000 7f7ffe000640 1 --2- 172.21.15.29:0/2239550150 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7fd8065a90 0x7f7fd8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.248+0000 7f7ffe000640 1 --2- 172.21.15.29:0/2239550150 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7fd8065a90 0x7f7fd8067f50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8000164250 tx=0x7f7fe8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:08.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.252+0000 7f7ff6a00640 1 -- 172.21.15.29:0/2239550150 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7ff00eaef0 con 0x7f80000b2760 2024-01-24T13:04:08.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.412+0000 7f8005c00640 1 -- 172.21.15.29:0/2239550150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8000070ed0 con 0x7f80000b2760 2024-01-24T13:04:08.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.412+0000 7f7ff6a00640 1 -- 172.21.15.29:0/2239550150 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7ff00ee510 con 0x7f80000b2760 2024-01-24T13:04:08.416 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:04:08.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.416+0000 7f8005c00640 1 -- 172.21.15.29:0/2239550150 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7fd8065a90 msgr2=0x7f7fd8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.416+0000 7f8005c00640 1 --2- 172.21.15.29:0/2239550150 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7fd8065a90 0x7f7fd8067f50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8000164250 tx=0x7f7fe8009040 comp rx=0 tx=0).stop 2024-01-24T13:04:08.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.416+0000 7f8005c00640 1 -- 172.21.15.29:0/2239550150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80000b2760 msgr2=0x7f800013cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.416+0000 7f8005c00640 1 --2- 172.21.15.29:0/2239550150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80000b2760 0x7f800013cf00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0019ff0 tx=0x7f7ff0019160 comp rx=0 tx=0).stop 2024-01-24T13:04:08.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.416+0000 7f8005c00640 1 -- 172.21.15.29:0/2239550150 shutdown_connections 2024-01-24T13:04:08.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.416+0000 7f8005c00640 1 --2- 172.21.15.29:0/2239550150 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7fd8065a90 0x7f7fd8067f50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.416+0000 7f8005c00640 1 --2- 172.21.15.29:0/2239550150 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8000153a00 0x7f800013dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.416+0000 7f8005c00640 1 --2- 172.21.15.29:0/2239550150 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000b2c10 0x7f800013d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.416+0000 7f8005c00640 1 --2- 172.21.15.29:0/2239550150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80000b2760 0x7f800013cf00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.416+0000 7f8005c00640 1 -- 172.21.15.29:0/2239550150 >> 172.21.15.29:0/2239550150 conn(0x7f800006d700 msgr2=0x7f80000aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:08.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.416+0000 7f8005c00640 1 -- 172.21.15.29:0/2239550150 shutdown_connections 2024-01-24T13:04:08.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.416+0000 7f8005c00640 1 -- 172.21.15.29:0/2239550150 wait complete. 2024-01-24T13:04:08.439 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:04:08.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7cae200640 1 Processor -- start 2024-01-24T13:04:08.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7cae200640 1 -- start start 2024-01-24T13:04:08.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7cae200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7ca806c860 0x7f7ca806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7cae200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7ca8142980 0x7f7ca80cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7cae200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca806b320 con 0x7f7ca80cd350 2024-01-24T13:04:08.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7cae200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca80cd7e0 con 0x7f7ca8142980 2024-01-24T13:04:08.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7cae200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca81611b0 con 0x7f7ca806c860 2024-01-24T13:04:08.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7ca6a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7ca8142980 0x7f7ca80cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7ca6a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7ca8142980 0x7f7ca80cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36468/0 (socket says 172.21.15.29:36468) 2024-01-24T13:04:08.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7ca6a00640 1 -- 172.21.15.29:0/2796075415 learned_addr learned my addr 172.21.15.29:0/2796075415 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:08.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7ca7e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7ca80cd350 0x7f7ca815d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:48960/0 (socket says 172.21.15.29:48960) 2024-01-24T13:04:08.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7ca7400640 1 --2- 172.21.15.29:0/2796075415 >> v2:172.21.15.163:3300/0 conn(0x7f7ca806c860 0x7f7ca806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7ca6a00640 1 -- 172.21.15.29:0/2796075415 >> v2:172.21.15.163:3300/0 conn(0x7f7ca806c860 msgr2=0x7f7ca806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:08.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7ca6000640 1 -- 172.21.15.29:0/2796075415 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649111229 0 0) 0x7f7ca806b320 con 0x7f7ca80cd350 2024-01-24T13:04:08.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7ca6a00640 1 --2- 172.21.15.29:0/2796075415 >> v2:172.21.15.163:3300/0 conn(0x7f7ca806c860 0x7f7ca806ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7ca6a00640 1 -- 172.21.15.29:0/2796075415 >> v1:172.21.15.29:6789/0 conn(0x7f7ca80cd350 legacy=0x7f7ca815d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7ca6a00640 1 -- 172.21.15.29:0/2796075415 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca8160630 con 0x7f7ca8142980 2024-01-24T13:04:08.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.580+0000 7f7ca7400640 1 --2- 172.21.15.29:0/2796075415 >> v2:172.21.15.163:3300/0 conn(0x7f7ca806c860 0x7f7ca806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:08.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.584+0000 7f7ca6a00640 1 --2- 172.21.15.29:0/2796075415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ca8142980 0x7f7ca80cce10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80d14c0 tx=0x7f7c9001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7816867a3da2c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:08.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.584+0000 7f7ca6000640 1 -- 172.21.15.29:0/2796075415 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c900aa430 con 0x7f7ca8142980 2024-01-24T13:04:08.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.584+0000 7f7ca6000640 1 -- 172.21.15.29:0/2796075415 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c900aa590 con 0x7f7ca8142980 2024-01-24T13:04:08.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.584+0000 7f7ca6000640 1 -- 172.21.15.29:0/2796075415 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c900aa920 con 0x7f7ca8142980 2024-01-24T13:04:08.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.584+0000 7f7cae200640 1 -- 172.21.15.29:0/2796075415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ca8142980 msgr2=0x7f7ca80cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.584+0000 7f7cae200640 1 --2- 172.21.15.29:0/2796075415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ca8142980 0x7f7ca80cce10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80d14c0 tx=0x7f7c9001c4d0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.584+0000 7f7cae200640 1 -- 172.21.15.29:0/2796075415 shutdown_connections 2024-01-24T13:04:08.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.584+0000 7f7cae200640 1 --2- 172.21.15.29:0/2796075415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ca8142980 0x7f7ca80cce10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.584+0000 7f7cae200640 1 --2- 172.21.15.29:0/2796075415 >> v2:172.21.15.163:3300/0 conn(0x7f7ca806c860 0x7f7ca806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.584+0000 7f7cae200640 1 -- 172.21.15.29:0/2796075415 >> 172.21.15.29:0/2796075415 conn(0x7f7ca8069cd0 msgr2=0x7f7ca806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:08.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.584+0000 7f7cae200640 1 -- 172.21.15.29:0/2796075415 shutdown_connections 2024-01-24T13:04:08.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.584+0000 7f7cae200640 1 -- 172.21.15.29:0/2796075415 wait complete. 2024-01-24T13:04:08.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7cae200640 1 Processor -- start 2024-01-24T13:04:08.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7cae200640 1 -- start start 2024-01-24T13:04:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7cae200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ca806c860 0x7f7ca80c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7cae200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ca80cd350 0x7f7ca80b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7cae200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ca8142980 0x7f7ca8157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7cae200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80b4e70 con 0x7f7ca8142980 2024-01-24T13:04:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7cae200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80b48a0 con 0x7f7ca806c860 2024-01-24T13:04:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7cae200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80b5290 con 0x7f7ca80cd350 2024-01-24T13:04:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7ca7e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ca8142980 0x7f7ca8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7ca7e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ca8142980 0x7f7ca8157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36480/0 (socket says 172.21.15.29:36480) 2024-01-24T13:04:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7ca7e00640 1 -- 172.21.15.29:0/2741548539 learned_addr learned my addr 172.21.15.29:0/2741548539 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7ca7400640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ca806c860 0x7f7ca80c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7ca6a00640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ca80cd350 0x7f7ca80b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7ca7e00640 1 -- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ca80cd350 msgr2=0x7f7ca80b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7ca7e00640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ca80cd350 0x7f7ca80b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7ca7e00640 1 -- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ca806c860 msgr2=0x7f7ca80c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7ca7e00640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ca806c860 0x7f7ca80c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7ca7e00640 1 -- 172.21.15.29:0/2741548539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c900094d0 con 0x7f7ca8142980 2024-01-24T13:04:08.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7ca6a00640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ca80cd350 0x7f7ca80b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:08.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7ca7e00640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ca8142980 0x7f7ca8157770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000c810 tx=0x7f7ca000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:08.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7c9f400640 1 -- 172.21.15.29:0/2741548539 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca000a640 con 0x7f7ca8142980 2024-01-24T13:04:08.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7c9f400640 1 -- 172.21.15.29:0/2741548539 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca000a7c0 con 0x7f7ca8142980 2024-01-24T13:04:08.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7c9f400640 1 -- 172.21.15.29:0/2741548539 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca000ab70 con 0x7f7ca8142980 2024-01-24T13:04:08.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7cae200640 1 -- 172.21.15.29:0/2741548539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca80b5e80 con 0x7f7ca8142980 2024-01-24T13:04:08.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.588+0000 7f7cae200640 1 -- 172.21.15.29:0/2741548539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca80b4a90 con 0x7f7ca8142980 2024-01-24T13:04:08.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.592+0000 7f7cae200640 1 -- 172.21.15.29:0/2741548539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca80b63a0 con 0x7f7ca8142980 2024-01-24T13:04:08.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.592+0000 7f7c9f400640 1 -- 172.21.15.29:0/2741548539 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7ca000acd0 con 0x7f7ca8142980 2024-01-24T13:04:08.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.592+0000 7f7c9f400640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7c80065a90 0x7f7c80067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.592+0000 7f7c9f400640 1 -- 172.21.15.29:0/2741548539 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ca0082810 con 0x7f7ca8142980 2024-01-24T13:04:08.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.592+0000 7f7ca7400640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7c80065a90 0x7f7c80067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.596+0000 7f7ca7400640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7c80065a90 0x7f7c80067f50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800ab60 tx=0x7f7c98008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:08.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.596+0000 7f7c9f400640 1 -- 172.21.15.29:0/2741548539 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7ca80b63a0 con 0x7f7ca8142980 2024-01-24T13:04:08.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.756+0000 7f7cae200640 1 -- 172.21.15.29:0/2741548539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7ca80b4fb0 con 0x7f7ca8142980 2024-01-24T13:04:08.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.756+0000 7f7c9f400640 1 -- 172.21.15.29:0/2741548539 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7ca0018020 con 0x7f7ca8142980 2024-01-24T13:04:08.758 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:08.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.756+0000 7f7cae200640 1 -- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7c80065a90 msgr2=0x7f7c80067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.756+0000 7f7cae200640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7c80065a90 0x7f7c80067f50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800ab60 tx=0x7f7c98008040 comp rx=0 tx=0).stop 2024-01-24T13:04:08.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.756+0000 7f7cae200640 1 -- 172.21.15.29:0/2741548539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ca8142980 msgr2=0x7f7ca8157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.756+0000 7f7cae200640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ca8142980 0x7f7ca8157770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000c810 tx=0x7f7ca000ccd0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.756+0000 7f7cae200640 1 -- 172.21.15.29:0/2741548539 shutdown_connections 2024-01-24T13:04:08.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.756+0000 7f7cae200640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7c80065a90 0x7f7c80067f50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.756+0000 7f7cae200640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ca8142980 0x7f7ca8157770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.756+0000 7f7cae200640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ca80cd350 0x7f7ca80b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.756+0000 7f7cae200640 1 --2- 172.21.15.29:0/2741548539 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ca806c860 0x7f7ca80c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.756+0000 7f7cae200640 1 -- 172.21.15.29:0/2741548539 >> 172.21.15.29:0/2741548539 conn(0x7f7ca8069cd0 msgr2=0x7f7ca815b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:08.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.756+0000 7f7cae200640 1 -- 172.21.15.29:0/2741548539 shutdown_connections 2024-01-24T13:04:08.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.756+0000 7f7cae200640 1 -- 172.21.15.29:0/2741548539 wait complete. 2024-01-24T13:04:08.780 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:04:08.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.920+0000 7f1fbd200640 1 Processor -- start 2024-01-24T13:04:08.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.920+0000 7f1fbd200640 1 -- start start 2024-01-24T13:04:08.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.920+0000 7f1fbd200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1fb80cd540 0x7f1fb815b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.920+0000 7f1fbd200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb815b8b0 0x7f1fb80cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.920+0000 7f1fbd200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb815e920 con 0x7f1fb80cd160 2024-01-24T13:04:08.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.920+0000 7f1fbd200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb815ec00 con 0x7f1fb80cd540 2024-01-24T13:04:08.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.920+0000 7f1fbd200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb815eee0 con 0x7f1fb815b8b0 2024-01-24T13:04:08.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.920+0000 7f1fb5400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1fb80cd540 0x7f1fb815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.920+0000 7f1fb5400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1fb80cd540 0x7f1fb815b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36490/0 (socket says 172.21.15.29:36490) 2024-01-24T13:04:08.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.920+0000 7f1fb5400640 1 -- 172.21.15.29:0/407098068 learned_addr learned my addr 172.21.15.29:0/407098068 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:08.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.920+0000 7f1fb5e00640 1 --1- 172.21.15.29:0/407098068 >> v1:172.21.15.29:6789/0 conn(0x7f1fb80cd160 0x7f1fb815e0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:48962/0 (socket says 172.21.15.29:48962) 2024-01-24T13:04:08.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.920+0000 7f1fb6800640 1 --2- 172.21.15.29:0/407098068 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb815b8b0 0x7f1fb80cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.924+0000 7f1fb5400640 1 -- 172.21.15.29:0/407098068 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb815b8b0 msgr2=0x7f1fb80cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:08.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.924+0000 7f1fb5400640 1 --2- 172.21.15.29:0/407098068 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb815b8b0 0x7f1fb80cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.924+0000 7f1fb5400640 1 -- 172.21.15.29:0/407098068 >> v1:172.21.15.29:6789/0 conn(0x7f1fb80cd160 legacy=0x7f1fb815e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.924+0000 7f1fb5400640 1 -- 172.21.15.29:0/407098068 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb815ae50 con 0x7f1fb80cd540 2024-01-24T13:04:08.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.924+0000 7f1fb5400640 1 --2- 172.21.15.29:0/407098068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd540 0x7f1fb815b370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0009870 tx=0x7f1fa001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e496ef184ffe218c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:08.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.924+0000 7f1fb4a00640 1 -- 172.21.15.29:0/407098068 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00ab600 con 0x7f1fb80cd540 2024-01-24T13:04:08.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.924+0000 7f1fb4a00640 1 -- 172.21.15.29:0/407098068 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa00a7050 con 0x7f1fb80cd540 2024-01-24T13:04:08.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.924+0000 7f1fb4a00640 1 -- 172.21.15.29:0/407098068 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00ab980 con 0x7f1fb80cd540 2024-01-24T13:04:08.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 -- 172.21.15.29:0/407098068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd540 msgr2=0x7f1fb815b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 --2- 172.21.15.29:0/407098068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd540 0x7f1fb815b370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0009870 tx=0x7f1fa001c540 comp rx=0 tx=0).stop 2024-01-24T13:04:08.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 -- 172.21.15.29:0/407098068 shutdown_connections 2024-01-24T13:04:08.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 --2- 172.21.15.29:0/407098068 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb815b8b0 0x7f1fb80cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 --2- 172.21.15.29:0/407098068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd540 0x7f1fb815b370 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 -- 172.21.15.29:0/407098068 >> 172.21.15.29:0/407098068 conn(0x7f1fb8069cd0 msgr2=0x7f1fb806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:08.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 -- 172.21.15.29:0/407098068 shutdown_connections 2024-01-24T13:04:08.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 -- 172.21.15.29:0/407098068 wait complete. 2024-01-24T13:04:08.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 Processor -- start 2024-01-24T13:04:08.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 -- start start 2024-01-24T13:04:08.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb80cd160 0x7f1fb814ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fb80cd540 0x7f1fb8150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80c49d0 0x7f1fb80c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80c5220 con 0x7f1fb80c49d0 2024-01-24T13:04:08.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80c3fe0 con 0x7f1fb80cd540 2024-01-24T13:04:08.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fbd200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb81514d0 con 0x7f1fb80cd160 2024-01-24T13:04:08.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fb6800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80c49d0 0x7f1fb80c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fb6800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80c49d0 0x7f1fb80c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36502/0 (socket says 172.21.15.29:36502) 2024-01-24T13:04:08.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fb6800640 1 -- 172.21.15.29:0/2797062270 learned_addr learned my addr 172.21.15.29:0/2797062270 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:08.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fb5e00640 1 --2- 172.21.15.29:0/2797062270 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb80cd160 0x7f1fb814ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.928+0000 7f1fb5400640 1 --2- 172.21.15.29:0/2797062270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fb80cd540 0x7f1fb8150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.932+0000 7f1fb6800640 1 -- 172.21.15.29:0/2797062270 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb80cd160 msgr2=0x7f1fb814ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.932+0000 7f1fb6800640 1 --2- 172.21.15.29:0/2797062270 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb80cd160 0x7f1fb814ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.932+0000 7f1fb6800640 1 -- 172.21.15.29:0/2797062270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fb80cd540 msgr2=0x7f1fb8150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:08.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.932+0000 7f1fb6800640 1 --2- 172.21.15.29:0/2797062270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fb80cd540 0x7f1fb8150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:08.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.932+0000 7f1fb6800640 1 -- 172.21.15.29:0/2797062270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa00094d0 con 0x7f1fb80c49d0 2024-01-24T13:04:08.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.932+0000 7f1fb6800640 1 --2- 172.21.15.29:0/2797062270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80c49d0 0x7f1fb80c6780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009cb0 tx=0x7f1fb000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:08.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.932+0000 7f1fae000640 1 -- 172.21.15.29:0/2797062270 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0009b20 con 0x7f1fb80c49d0 2024-01-24T13:04:08.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.932+0000 7f1fae000640 1 -- 172.21.15.29:0/2797062270 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb000f040 con 0x7f1fb80c49d0 2024-01-24T13:04:08.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.932+0000 7f1fbd200640 1 -- 172.21.15.29:0/2797062270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb80c4f40 con 0x7f1fb80c49d0 2024-01-24T13:04:08.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.932+0000 7f1fae000640 1 -- 172.21.15.29:0/2797062270 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00146c0 con 0x7f1fb80c49d0 2024-01-24T13:04:08.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.932+0000 7f1fbd200640 1 -- 172.21.15.29:0/2797062270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb80c44d0 con 0x7f1fb80c49d0 2024-01-24T13:04:08.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.932+0000 7f1fbd200640 1 -- 172.21.15.29:0/2797062270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb8150cb0 con 0x7f1fb80c49d0 2024-01-24T13:04:08.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.932+0000 7f1fae000640 1 -- 172.21.15.29:0/2797062270 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1fb0014820 con 0x7f1fb80c49d0 2024-01-24T13:04:08.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.936+0000 7f1fae000640 1 --2- 172.21.15.29:0/2797062270 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f90065a60 0x7f1f90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:08.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.936+0000 7f1fae000640 1 -- 172.21.15.29:0/2797062270 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1fb00840f0 con 0x7f1fb80c49d0 2024-01-24T13:04:08.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.936+0000 7f1fb5e00640 1 --2- 172.21.15.29:0/2797062270 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f90065a60 0x7f1f90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:08.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.936+0000 7f1fb5e00640 1 --2- 172.21.15.29:0/2797062270 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f90065a60 0x7f1f90067f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8000f70 tx=0x7f1fa8007e50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:08.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:08.936+0000 7f1fae000640 1 -- 172.21.15.29:0/2797062270 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1fb8150cb0 con 0x7f1fb80c49d0 2024-01-24T13:04:09.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.108+0000 7f1fbd200640 1 -- 172.21.15.29:0/2797062270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1fb8150cb0 con 0x7f1fb80c49d0 2024-01-24T13:04:09.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.108+0000 7f1fae000640 1 -- 172.21.15.29:0/2797062270 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1fb8150cb0 con 0x7f1fb80c49d0 2024-01-24T13:04:09.110 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:04:09.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.108+0000 7f1fbd200640 1 -- 172.21.15.29:0/2797062270 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f90065a60 msgr2=0x7f1f90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.108+0000 7f1fbd200640 1 --2- 172.21.15.29:0/2797062270 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f90065a60 0x7f1f90067f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8000f70 tx=0x7f1fa8007e50 comp rx=0 tx=0).stop 2024-01-24T13:04:09.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.108+0000 7f1fbd200640 1 -- 172.21.15.29:0/2797062270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80c49d0 msgr2=0x7f1fb80c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.108+0000 7f1fbd200640 1 --2- 172.21.15.29:0/2797062270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80c49d0 0x7f1fb80c6780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009cb0 tx=0x7f1fb000c490 comp rx=0 tx=0).stop 2024-01-24T13:04:09.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.108+0000 7f1fbd200640 1 -- 172.21.15.29:0/2797062270 shutdown_connections 2024-01-24T13:04:09.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.108+0000 7f1fbd200640 1 --2- 172.21.15.29:0/2797062270 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f90065a60 0x7f1f90067f20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.108+0000 7f1fbd200640 1 --2- 172.21.15.29:0/2797062270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80c49d0 0x7f1fb80c6780 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.108+0000 7f1fbd200640 1 --2- 172.21.15.29:0/2797062270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fb80cd540 0x7f1fb8150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.108+0000 7f1fbd200640 1 --2- 172.21.15.29:0/2797062270 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb80cd160 0x7f1fb814ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.108+0000 7f1fbd200640 1 -- 172.21.15.29:0/2797062270 >> 172.21.15.29:0/2797062270 conn(0x7f1fb8069cd0 msgr2=0x7f1fb815bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:09.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.108+0000 7f1fbd200640 1 -- 172.21.15.29:0/2797062270 shutdown_connections 2024-01-24T13:04:09.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.108+0000 7f1fbd200640 1 -- 172.21.15.29:0/2797062270 wait complete. 2024-01-24T13:04:09.132 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:04:09.132 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:04:09.141 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:09.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.320+0000 7f6bb9200640 1 Processor -- start 2024-01-24T13:04:09.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.320+0000 7f6bb9200640 1 -- start start 2024-01-24T13:04:09.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.324+0000 7f6bb9200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bb4159300 0x7f6bb40b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:09.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.324+0000 7f6bb9200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6bb415d660 0x7f6bb406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:09.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.324+0000 7f6bb9200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb415de10 con 0x7f6bb406bc10 2024-01-24T13:04:09.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.324+0000 7f6bb9200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb4071140 con 0x7f6bb4159300 2024-01-24T13:04:09.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.324+0000 7f6bb9200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb406c5e0 con 0x7f6bb415d660 2024-01-24T13:04:09.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.324+0000 7f6bb1e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bb4159300 0x7f6bb40b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:09.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.324+0000 7f6bb1e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bb4159300 0x7f6bb40b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36508/0 (socket says 172.21.15.29:36508) 2024-01-24T13:04:09.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.324+0000 7f6bb1e00640 1 -- 172.21.15.29:0/136536961 learned_addr learned my addr 172.21.15.29:0/136536961 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:09.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.324+0000 7f6bb2800640 1 --2- 172.21.15.29:0/136536961 >> v2:172.21.15.163:3300/0 conn(0x7f6bb415d660 0x7f6bb406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:09.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.324+0000 7f6bb1e00640 1 -- 172.21.15.29:0/136536961 >> v2:172.21.15.163:3300/0 conn(0x7f6bb415d660 msgr2=0x7f6bb406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:09.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.324+0000 7f6bb1e00640 1 --2- 172.21.15.29:0/136536961 >> v2:172.21.15.163:3300/0 conn(0x7f6bb415d660 0x7f6bb406c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.324+0000 7f6bb1e00640 1 -- 172.21.15.29:0/136536961 >> v1:172.21.15.163:6789/0 conn(0x7f6bb406bc10 legacy=0x7f6bb415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.324+0000 7f6bb1e00640 1 -- 172.21.15.29:0/136536961 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb415db30 con 0x7f6bb4159300 2024-01-24T13:04:09.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.328+0000 7f6bb1e00640 1 --2- 172.21.15.29:0/136536961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb4159300 0x7f6bb40b1c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40cb530 tx=0x7f6ba401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e460508a4d11a248 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:09.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.328+0000 7f6bb0a00640 1 -- 172.21.15.29:0/136536961 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40ab640 con 0x7f6bb4159300 2024-01-24T13:04:09.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.328+0000 7f6bb0a00640 1 -- 172.21.15.29:0/136536961 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba40a7070 con 0x7f6bb4159300 2024-01-24T13:04:09.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.328+0000 7f6bb0a00640 1 -- 172.21.15.29:0/136536961 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40ab9c0 con 0x7f6bb4159300 2024-01-24T13:04:09.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.328+0000 7f6bb9200640 1 -- 172.21.15.29:0/136536961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb4159300 msgr2=0x7f6bb40b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.328+0000 7f6bb9200640 1 --2- 172.21.15.29:0/136536961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb4159300 0x7f6bb40b1c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40cb530 tx=0x7f6ba401c440 comp rx=0 tx=0).stop 2024-01-24T13:04:09.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.328+0000 7f6bb9200640 1 -- 172.21.15.29:0/136536961 shutdown_connections 2024-01-24T13:04:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.328+0000 7f6bb9200640 1 --2- 172.21.15.29:0/136536961 >> v2:172.21.15.163:3300/0 conn(0x7f6bb415d660 0x7f6bb406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.328+0000 7f6bb9200640 1 --2- 172.21.15.29:0/136536961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb4159300 0x7f6bb40b1c40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.328+0000 7f6bb9200640 1 -- 172.21.15.29:0/136536961 >> 172.21.15.29:0/136536961 conn(0x7f6bb40b3950 msgr2=0x7f6bb4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.328+0000 7f6bb9200640 1 -- 172.21.15.29:0/136536961 shutdown_connections 2024-01-24T13:04:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.328+0000 7f6bb9200640 1 -- 172.21.15.29:0/136536961 wait complete. 2024-01-24T13:04:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.328+0000 7f6bb9200640 1 Processor -- start 2024-01-24T13:04:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.328+0000 7f6bb9200640 1 -- start start 2024-01-24T13:04:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb9200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bb406bc10 0x7f6bb4153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb9200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6bb4159300 0x7f6bb40b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb9200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb415d660 0x7f6bb40b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb9200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb415b1c0 con 0x7f6bb415d660 2024-01-24T13:04:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb9200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb415a640 con 0x7f6bb4159300 2024-01-24T13:04:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb9200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb415a920 con 0x7f6bb406bc10 2024-01-24T13:04:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb2800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb415d660 0x7f6bb40b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb2800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb415d660 0x7f6bb40b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36518/0 (socket says 172.21.15.29:36518) 2024-01-24T13:04:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb2800640 1 -- 172.21.15.29:0/4260298005 learned_addr learned my addr 172.21.15.29:0/4260298005 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb1400640 1 --2- 172.21.15.29:0/4260298005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6bb4159300 0x7f6bb40b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb1e00640 1 --2- 172.21.15.29:0/4260298005 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bb406bc10 0x7f6bb4153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb2800640 1 -- 172.21.15.29:0/4260298005 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bb406bc10 msgr2=0x7f6bb4153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb2800640 1 --2- 172.21.15.29:0/4260298005 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bb406bc10 0x7f6bb4153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb2800640 1 -- 172.21.15.29:0/4260298005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6bb4159300 msgr2=0x7f6bb40b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb2800640 1 --2- 172.21.15.29:0/4260298005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6bb4159300 0x7f6bb40b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb2800640 1 -- 172.21.15.29:0/4260298005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40094d0 con 0x7f6bb415d660 2024-01-24T13:04:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb2800640 1 --2- 172.21.15.29:0/4260298005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb415d660 0x7f6bb40b2d30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6bac007d40 tx=0x7f6bac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6baa000640 1 -- 172.21.15.29:0/4260298005 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac014420 con 0x7f6bb415d660 2024-01-24T13:04:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6baa000640 1 -- 172.21.15.29:0/4260298005 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac0145a0 con 0x7f6bb415d660 2024-01-24T13:04:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6baa000640 1 -- 172.21.15.29:0/4260298005 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac014950 con 0x7f6bb415d660 2024-01-24T13:04:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb9200640 1 -- 172.21.15.29:0/4260298005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb415ac00 con 0x7f6bb415d660 2024-01-24T13:04:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb9200640 1 -- 172.21.15.29:0/4260298005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb4153cc0 con 0x7f6bb415d660 2024-01-24T13:04:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6bb9200640 1 -- 172.21.15.29:0/4260298005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb404e850 con 0x7f6bb415d660 2024-01-24T13:04:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.332+0000 7f6baa000640 1 -- 172.21.15.29:0/4260298005 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6bac014ab0 con 0x7f6bb415d660 2024-01-24T13:04:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.336+0000 7f6baa000640 1 --2- 172.21.15.29:0/4260298005 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6b8c065a90 0x7f6b8c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:09.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.336+0000 7f6baa000640 1 -- 172.21.15.29:0/4260298005 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6bac083bd0 con 0x7f6bb415d660 2024-01-24T13:04:09.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.336+0000 7f6bb1e00640 1 --2- 172.21.15.29:0/4260298005 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6b8c065a90 0x7f6b8c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:09.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.336+0000 7f6bb1e00640 1 --2- 172.21.15.29:0/4260298005 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6b8c065a90 0x7f6b8c067f50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40af000 tx=0x7f6ba40b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:09.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.340+0000 7f6baa000640 1 -- 172.21.15.29:0/4260298005 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f6bac051340 con 0x7f6bb415d660 2024-01-24T13:04:09.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.500+0000 7f6bb9200640 1 -- 172.21.15.29:0/4260298005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bb40ce0a0 con 0x7f6bb415d660 2024-01-24T13:04:09.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.500+0000 7f6baa000640 1 -- 172.21.15.29:0/4260298005 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f6bac054960 con 0x7f6bb415d660 2024-01-24T13:04:09.504 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:09.504 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:01.140044+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:09.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.504+0000 7f6bb9200640 1 -- 172.21.15.29:0/4260298005 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6b8c065a90 msgr2=0x7f6b8c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.504+0000 7f6bb9200640 1 --2- 172.21.15.29:0/4260298005 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6b8c065a90 0x7f6b8c067f50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40af000 tx=0x7f6ba40b6040 comp rx=0 tx=0).stop 2024-01-24T13:04:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.504+0000 7f6bb9200640 1 -- 172.21.15.29:0/4260298005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb415d660 msgr2=0x7f6bb40b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.504+0000 7f6bb9200640 1 --2- 172.21.15.29:0/4260298005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb415d660 0x7f6bb40b2d30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6bac007d40 tx=0x7f6bac00e4b0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.504+0000 7f6bb9200640 1 -- 172.21.15.29:0/4260298005 shutdown_connections 2024-01-24T13:04:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.504+0000 7f6bb9200640 1 --2- 172.21.15.29:0/4260298005 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6b8c065a90 0x7f6b8c067f50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.504+0000 7f6bb9200640 1 --2- 172.21.15.29:0/4260298005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb415d660 0x7f6bb40b2d30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.504+0000 7f6bb9200640 1 --2- 172.21.15.29:0/4260298005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6bb4159300 0x7f6bb40b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.504+0000 7f6bb9200640 1 --2- 172.21.15.29:0/4260298005 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6bb406bc10 0x7f6bb4153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.504+0000 7f6bb9200640 1 -- 172.21.15.29:0/4260298005 >> 172.21.15.29:0/4260298005 conn(0x7f6bb40b3950 msgr2=0x7f6bb40ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.504+0000 7f6bb9200640 1 -- 172.21.15.29:0/4260298005 shutdown_connections 2024-01-24T13:04:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.504+0000 7f6bb9200640 1 -- 172.21.15.29:0/4260298005 wait complete. 2024-01-24T13:04:09.526 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:04:09.526 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:04:09.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.668+0000 7f6b51e00640 1 Processor -- start 2024-01-24T13:04:09.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.668+0000 7f6b51e00640 1 -- start start 2024-01-24T13:04:09.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.668+0000 7f6b51e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6b4c0cd300 0x7f6b4c15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:09.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.668+0000 7f6b51e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4c161130 con 0x7f6b4c0ce050 2024-01-24T13:04:09.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.668+0000 7f6b51e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4c15dbe0 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.668+0000 7f6b51e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4c0d1230 con 0x7f6b4c0cd300 2024-01-24T13:04:09.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.668+0000 7f6b4a000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6b4c0ce050 0x7f6b4c0d0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:48974/0 (socket says 172.21.15.29:48974) 2024-01-24T13:04:09.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.668+0000 7f6b4a000640 1 -- 172.21.15.29:0/4095025930 learned_addr learned my addr 172.21.15.29:0/4095025930 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:09.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.668+0000 7f6b4aa00640 1 --2- 172.21.15.29:0/4095025930 >> v2:172.21.15.163:3300/0 conn(0x7f6b4c0cd300 0x7f6b4c15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:09.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.668+0000 7f6b49600640 1 -- 172.21.15.29:0/4095025930 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362043900 0 0) 0x7f6b4c161130 con 0x7f6b4c0ce050 2024-01-24T13:04:09.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.672+0000 7f6b49600640 1 -- 172.21.15.29:0/4095025930 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b2c003530 con 0x7f6b4c0ce050 2024-01-24T13:04:09.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.672+0000 7f6b49600640 1 -- 172.21.15.29:0/4095025930 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732545036 0 0) 0x7f6b4c15dbe0 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.672+0000 7f6b49600640 1 -- 172.21.15.29:0/4095025930 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b4c161130 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.672+0000 7f6b49600640 1 -- 172.21.15.29:0/4095025930 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3071573123 0 0) 0x7f6b2c003530 con 0x7f6b4c0ce050 2024-01-24T13:04:09.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.672+0000 7f6b4aa00640 1 -- 172.21.15.29:0/4095025930 >> v1:172.21.15.163:6789/0 conn(0x7f6b4c0ce4e0 legacy=0x7f6b4c0d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.672+0000 7f6b4aa00640 1 -- 172.21.15.29:0/4095025930 >> v1:172.21.15.29:6789/0 conn(0x7f6b4c0ce050 legacy=0x7f6b4c0d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.672+0000 7f6b4aa00640 1 -- 172.21.15.29:0/4095025930 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c1605b0 con 0x7f6b4c0cd300 2024-01-24T13:04:09.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.672+0000 7f6b4aa00640 1 --2- 172.21.15.29:0/4095025930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b4c0cd300 0x7f6b4c15d6a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0097c0 tx=0x7f6b3c01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfa4a84ca7badf07 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:09.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.672+0000 7f6b49600640 1 -- 172.21.15.29:0/4095025930 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b34001680 con 0x7f6b4c0cd300 2024-01-24T13:04:09.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.672+0000 7f6b49600640 1 -- 172.21.15.29:0/4095025930 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c0a7050 con 0x7f6b4c0cd300 2024-01-24T13:04:09.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.672+0000 7f6b49600640 1 -- 172.21.15.29:0/4095025930 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0ab600 con 0x7f6b4c0cd300 2024-01-24T13:04:09.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 -- 172.21.15.29:0/4095025930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b4c0cd300 msgr2=0x7f6b4c15d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 --2- 172.21.15.29:0/4095025930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b4c0cd300 0x7f6b4c15d6a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0097c0 tx=0x7f6b3c01c3a0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 -- 172.21.15.29:0/4095025930 shutdown_connections 2024-01-24T13:04:09.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 --2- 172.21.15.29:0/4095025930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b4c0cd300 0x7f6b4c15d6a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 -- 172.21.15.29:0/4095025930 >> 172.21.15.29:0/4095025930 conn(0x7f6b4c069cd0 msgr2=0x7f6b4c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:09.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 -- 172.21.15.29:0/4095025930 shutdown_connections 2024-01-24T13:04:09.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 -- 172.21.15.29:0/4095025930 wait complete. 2024-01-24T13:04:09.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 Processor -- start 2024-01-24T13:04:09.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 -- start start 2024-01-24T13:04:09.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b4c0cd300 0x7f6b4c1f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:09.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b4c0ce050 0x7f6b4c1f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:09.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b4c0ce4e0 0x7f6b4c06afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:09.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c1f8370 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c1f5430 con 0x7f6b4c0cd300 2024-01-24T13:04:09.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b51e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c1f5710 con 0x7f6b4c0ce050 2024-01-24T13:04:09.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b4b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b4c0ce4e0 0x7f6b4c06afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:09.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b4b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b4c0ce4e0 0x7f6b4c06afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36532/0 (socket says 172.21.15.29:36532) 2024-01-24T13:04:09.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.676+0000 7f6b4b400640 1 -- 172.21.15.29:0/556192570 learned_addr learned my addr 172.21.15.29:0/556192570 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:09.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b4a000640 1 --2- 172.21.15.29:0/556192570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b4c0ce050 0x7f6b4c1f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:09.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b4aa00640 1 --2- 172.21.15.29:0/556192570 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b4c0cd300 0x7f6b4c1f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:09.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b4b400640 1 -- 172.21.15.29:0/556192570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b4c0ce050 msgr2=0x7f6b4c1f7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b4b400640 1 --2- 172.21.15.29:0/556192570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b4c0ce050 0x7f6b4c1f7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b4b400640 1 -- 172.21.15.29:0/556192570 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b4c0cd300 msgr2=0x7f6b4c1f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b4b400640 1 --2- 172.21.15.29:0/556192570 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b4c0cd300 0x7f6b4c1f6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b4b400640 1 -- 172.21.15.29:0/556192570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c009420 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b4b400640 1 --2- 172.21.15.29:0/556192570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b4c0ce4e0 0x7f6b4c06afc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400c730 tx=0x7f6b4400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:09.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b43400640 1 -- 172.21.15.29:0/556192570 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44003b80 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b43400640 1 -- 172.21.15.29:0/556192570 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b44003ce0 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b43400640 1 -- 172.21.15.29:0/556192570 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4400aa90 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b51e00640 1 -- 172.21.15.29:0/556192570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4c1f59f0 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b51e00640 1 -- 172.21.15.29:0/556192570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4c1f5000 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b51e00640 1 -- 172.21.15.29:0/556192570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4c14a140 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b43400640 1 -- 172.21.15.29:0/556192570 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6b4400abf0 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b43400640 1 --2- 172.21.15.29:0/556192570 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6b24065a60 0x7f6b24067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:09.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.680+0000 7f6b43400640 1 -- 172.21.15.29:0/556192570 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6b44083300 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.684+0000 7f6b4aa00640 1 --2- 172.21.15.29:0/556192570 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6b24065a60 0x7f6b24067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:09.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.684+0000 7f6b4aa00640 1 --2- 172.21.15.29:0/556192570 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6b24065a60 0x7f6b24067f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0ad000 tx=0x7f6b3c0a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:09.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.684+0000 7f6b43400640 1 -- 172.21.15.29:0/556192570 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f6b440509c0 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.844+0000 7f6b51e00640 1 -- 172.21.15.29:0/556192570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b4c1f51f0 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.844+0000 7f6b43400640 1 -- 172.21.15.29:0/556192570 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b4c1f51f0 con 0x7f6b4c0ce4e0 2024-01-24T13:04:09.845 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:04:09.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.844+0000 7f6b51e00640 1 -- 172.21.15.29:0/556192570 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6b24065a60 msgr2=0x7f6b24067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.844+0000 7f6b51e00640 1 --2- 172.21.15.29:0/556192570 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6b24065a60 0x7f6b24067f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0ad000 tx=0x7f6b3c0a6000 comp rx=0 tx=0).stop 2024-01-24T13:04:09.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.844+0000 7f6b51e00640 1 -- 172.21.15.29:0/556192570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b4c0ce4e0 msgr2=0x7f6b4c06afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:09.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.844+0000 7f6b51e00640 1 --2- 172.21.15.29:0/556192570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b4c0ce4e0 0x7f6b4c06afc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400c730 tx=0x7f6b4400cbf0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.844+0000 7f6b51e00640 1 -- 172.21.15.29:0/556192570 shutdown_connections 2024-01-24T13:04:09.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.844+0000 7f6b51e00640 1 --2- 172.21.15.29:0/556192570 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6b24065a60 0x7f6b24067f20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.844+0000 7f6b51e00640 1 --2- 172.21.15.29:0/556192570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b4c0ce4e0 0x7f6b4c06afc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.844+0000 7f6b51e00640 1 --2- 172.21.15.29:0/556192570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b4c0ce050 0x7f6b4c1f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.844+0000 7f6b51e00640 1 --2- 172.21.15.29:0/556192570 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b4c0cd300 0x7f6b4c1f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:09.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.844+0000 7f6b51e00640 1 -- 172.21.15.29:0/556192570 >> 172.21.15.29:0/556192570 conn(0x7f6b4c069cd0 msgr2=0x7f6b4c0c51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:09.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.844+0000 7f6b51e00640 1 -- 172.21.15.29:0/556192570 shutdown_connections 2024-01-24T13:04:09.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:09.844+0000 7f6b51e00640 1 -- 172.21.15.29:0/556192570 wait complete. 2024-01-24T13:04:09.867 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:04:10.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.008+0000 7f45e8400640 1 Processor -- start 2024-01-24T13:04:10.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.008+0000 7f45e8400640 1 -- start start 2024-01-24T13:04:10.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45e8400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e015a6f0 0x7f45e00c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45e8400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f45e00cb1e0 0x7f45e00cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45e8400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e00cd1e0 con 0x7f45e00ceb10 2024-01-24T13:04:10.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45e8400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e015aad0 con 0x7f45e00cb1e0 2024-01-24T13:04:10.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45e8400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00cd4c0 con 0x7f45e015a6f0 2024-01-24T13:04:10.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45e5000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f45e00ceb10 0x7f45e00caad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:48988/0 (socket says 172.21.15.29:48988) 2024-01-24T13:04:10.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45e5000640 1 -- 172.21.15.29:0/998143459 learned_addr learned my addr 172.21.15.29:0/998143459 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:10.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45e5a00640 1 --2- 172.21.15.29:0/998143459 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e015a6f0 0x7f45e00c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45e6400640 1 --2- 172.21.15.29:0/998143459 >> v2:172.21.15.163:3300/0 conn(0x7f45e00cb1e0 0x7f45e00cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45dfe00640 1 -- 172.21.15.29:0/998143459 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769630359 0 0) 0x7f45e00cd1e0 con 0x7f45e00ceb10 2024-01-24T13:04:10.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45dfe00640 1 -- 172.21.15.29:0/998143459 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45c0003530 con 0x7f45e00ceb10 2024-01-24T13:04:10.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45e5a00640 1 -- 172.21.15.29:0/998143459 >> v2:172.21.15.163:3300/0 conn(0x7f45e00cb1e0 msgr2=0x7f45e00cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:10.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45e5a00640 1 --2- 172.21.15.29:0/998143459 >> v2:172.21.15.163:3300/0 conn(0x7f45e00cb1e0 0x7f45e00cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45e5a00640 1 -- 172.21.15.29:0/998143459 >> v1:172.21.15.29:6789/0 conn(0x7f45e00ceb10 legacy=0x7f45e00caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45e5a00640 1 -- 172.21.15.29:0/998143459 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e00cd7a0 con 0x7f45e015a6f0 2024-01-24T13:04:10.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.012+0000 7f45e6400640 1 --2- 172.21.15.29:0/998143459 >> v2:172.21.15.163:3300/0 conn(0x7f45e00cb1e0 0x7f45e00cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:10.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.016+0000 7f45e5a00640 1 --2- 172.21.15.29:0/998143459 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e015a6f0 0x7f45e00c3fd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f45d00097c0 tx=0x7f45d001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17aa6eee0e0834b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:10.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.016+0000 7f45dfe00640 1 -- 172.21.15.29:0/998143459 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d00ac620 con 0x7f45e015a6f0 2024-01-24T13:04:10.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.016+0000 7f45dfe00640 1 -- 172.21.15.29:0/998143459 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d00ac780 con 0x7f45e015a6f0 2024-01-24T13:04:10.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.016+0000 7f45dfe00640 1 -- 172.21.15.29:0/998143459 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d00acb10 con 0x7f45e015a6f0 2024-01-24T13:04:10.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.016+0000 7f45e8400640 1 -- 172.21.15.29:0/998143459 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e015a6f0 msgr2=0x7f45e00c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.016+0000 7f45e8400640 1 --2- 172.21.15.29:0/998143459 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e015a6f0 0x7f45e00c3fd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f45d00097c0 tx=0x7f45d001c3c0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.016+0000 7f45e8400640 1 -- 172.21.15.29:0/998143459 shutdown_connections 2024-01-24T13:04:10.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.016+0000 7f45e8400640 1 --2- 172.21.15.29:0/998143459 >> v2:172.21.15.163:3300/0 conn(0x7f45e00cb1e0 0x7f45e00cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.016+0000 7f45e8400640 1 --2- 172.21.15.29:0/998143459 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e015a6f0 0x7f45e00c3fd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.016+0000 7f45e8400640 1 -- 172.21.15.29:0/998143459 >> 172.21.15.29:0/998143459 conn(0x7f45e0069cd0 msgr2=0x7f45e006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:10.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.016+0000 7f45e8400640 1 -- 172.21.15.29:0/998143459 shutdown_connections 2024-01-24T13:04:10.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.016+0000 7f45e8400640 1 -- 172.21.15.29:0/998143459 wait complete. 2024-01-24T13:04:10.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.016+0000 7f45e8400640 1 Processor -- start 2024-01-24T13:04:10.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e8400640 1 -- start start 2024-01-24T13:04:10.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e8400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45e00cb1e0 0x7f45e00c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e8400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e00ceb10 0x7f45e01566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e8400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45e015a6f0 0x7f45e0156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e8400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00c4630 con 0x7f45e00cb1e0 2024-01-24T13:04:10.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e8400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0152ef0 con 0x7f45e015a6f0 2024-01-24T13:04:10.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e8400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00c4880 con 0x7f45e00ceb10 2024-01-24T13:04:10.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e5a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45e00cb1e0 0x7f45e00c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e5a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45e00cb1e0 0x7f45e00c2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36538/0 (socket says 172.21.15.29:36538) 2024-01-24T13:04:10.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e5a00640 1 -- 172.21.15.29:0/3485154220 learned_addr learned my addr 172.21.15.29:0/3485154220 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:10.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e5000640 1 --2- 172.21.15.29:0/3485154220 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e00ceb10 0x7f45e01566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e6400640 1 --2- 172.21.15.29:0/3485154220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45e015a6f0 0x7f45e0156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e5a00640 1 -- 172.21.15.29:0/3485154220 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e00ceb10 msgr2=0x7f45e01566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e5a00640 1 --2- 172.21.15.29:0/3485154220 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e00ceb10 0x7f45e01566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e5a00640 1 -- 172.21.15.29:0/3485154220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45e015a6f0 msgr2=0x7f45e0156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e5a00640 1 --2- 172.21.15.29:0/3485154220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45e015a6f0 0x7f45e0156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e5a00640 1 -- 172.21.15.29:0/3485154220 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d8009a70 con 0x7f45e00cb1e0 2024-01-24T13:04:10.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e5a00640 1 --2- 172.21.15.29:0/3485154220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45e00cb1e0 0x7f45e00c2aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f45d0019ff0 tx=0x7f45d0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45dd600640 1 -- 172.21.15.29:0/3485154220 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d00ac620 con 0x7f45e00cb1e0 2024-01-24T13:04:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45dd600640 1 -- 172.21.15.29:0/3485154220 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d00b5410 con 0x7f45e00cb1e0 2024-01-24T13:04:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45dd600640 1 -- 172.21.15.29:0/3485154220 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d00b57a0 con 0x7f45e00cb1e0 2024-01-24T13:04:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e8400640 1 -- 172.21.15.29:0/3485154220 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d0009420 con 0x7f45e00cb1e0 2024-01-24T13:04:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e8400640 1 -- 172.21.15.29:0/3485154220 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e00c4e40 con 0x7f45e00cb1e0 2024-01-24T13:04:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.020+0000 7f45e8400640 1 -- 172.21.15.29:0/3485154220 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e004e850 con 0x7f45e00cb1e0 2024-01-24T13:04:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.024+0000 7f45dd600640 1 -- 172.21.15.29:0/3485154220 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f45d00b3040 con 0x7f45e00cb1e0 2024-01-24T13:04:10.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.024+0000 7f45dd600640 1 --2- 172.21.15.29:0/3485154220 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f45b8065a60 0x7f45b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.024+0000 7f45dd600640 1 -- 172.21.15.29:0/3485154220 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45d011d2a0 con 0x7f45e00cb1e0 2024-01-24T13:04:10.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.024+0000 7f45e5000640 1 --2- 172.21.15.29:0/3485154220 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f45b8065a60 0x7f45b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.024+0000 7f45e5000640 1 --2- 172.21.15.29:0/3485154220 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f45b8065a60 0x7f45b8067f20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f45e0153410 tx=0x7f45c8007d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:10.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.028+0000 7f45dd600640 1 -- 172.21.15.29:0/3485154220 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f45d00ea9f0 con 0x7f45e00cb1e0 2024-01-24T13:04:10.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.184+0000 7f45e8400640 1 -- 172.21.15.29:0/3485154220 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45e00b29c0 con 0x7f45e00cb1e0 2024-01-24T13:04:10.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.184+0000 7f45dd600640 1 -- 172.21.15.29:0/3485154220 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45d00ee010 con 0x7f45e00cb1e0 2024-01-24T13:04:10.188 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:10.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.188+0000 7f45e8400640 1 -- 172.21.15.29:0/3485154220 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f45b8065a60 msgr2=0x7f45b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.188+0000 7f45e8400640 1 --2- 172.21.15.29:0/3485154220 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f45b8065a60 0x7f45b8067f20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f45e0153410 tx=0x7f45c8007d40 comp rx=0 tx=0).stop 2024-01-24T13:04:10.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.188+0000 7f45e8400640 1 -- 172.21.15.29:0/3485154220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45e00cb1e0 msgr2=0x7f45e00c2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.188+0000 7f45e8400640 1 --2- 172.21.15.29:0/3485154220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45e00cb1e0 0x7f45e00c2aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f45d0019ff0 tx=0x7f45d0019160 comp rx=0 tx=0).stop 2024-01-24T13:04:10.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.188+0000 7f45e8400640 1 -- 172.21.15.29:0/3485154220 shutdown_connections 2024-01-24T13:04:10.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.188+0000 7f45e8400640 1 --2- 172.21.15.29:0/3485154220 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f45b8065a60 0x7f45b8067f20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.188+0000 7f45e8400640 1 --2- 172.21.15.29:0/3485154220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45e015a6f0 0x7f45e0156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.188+0000 7f45e8400640 1 --2- 172.21.15.29:0/3485154220 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45e00ceb10 0x7f45e01566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.188+0000 7f45e8400640 1 --2- 172.21.15.29:0/3485154220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45e00cb1e0 0x7f45e00c2aa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.188+0000 7f45e8400640 1 -- 172.21.15.29:0/3485154220 >> 172.21.15.29:0/3485154220 conn(0x7f45e0069cd0 msgr2=0x7f45e0157bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:10.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.188+0000 7f45e8400640 1 -- 172.21.15.29:0/3485154220 shutdown_connections 2024-01-24T13:04:10.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.188+0000 7f45e8400640 1 -- 172.21.15.29:0/3485154220 wait complete. 2024-01-24T13:04:10.209 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:04:10.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2d0a00640 1 Processor -- start 2024-01-24T13:04:10.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2d0a00640 1 -- start start 2024-01-24T13:04:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2d0a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2c8142980 0x7fe2c80cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2d0a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe2c80cd350 0x7fe2c815d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2d0a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c80cd7e0 con 0x7fe2c806c860 2024-01-24T13:04:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2d0a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c81611b0 con 0x7fe2c80cd350 2024-01-24T13:04:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2d0a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8160630 con 0x7fe2c8142980 2024-01-24T13:04:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2ce000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe2c806c860 0x7fe2c806ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49004/0 (socket says 172.21.15.29:49004) 2024-01-24T13:04:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2ce000640 1 -- 172.21.15.29:0/2779460830 learned_addr learned my addr 172.21.15.29:0/2779460830 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2cd600640 1 --2- 172.21.15.29:0/2779460830 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2c8142980 0x7fe2c80cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2cea00640 1 --2- 172.21.15.29:0/2779460830 >> v2:172.21.15.163:3300/0 conn(0x7fe2c80cd350 0x7fe2c815d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2ccc00640 1 -- 172.21.15.29:0/2779460830 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8784457 0 0) 0x7fe2c80cd7e0 con 0x7fe2c806c860 2024-01-24T13:04:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2ccc00640 1 -- 172.21.15.29:0/2779460830 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2a8003530 con 0x7fe2c806c860 2024-01-24T13:04:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2ccc00640 1 -- 172.21.15.29:0/2779460830 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3092735410 0 0) 0x7fe2a8003530 con 0x7fe2c806c860 2024-01-24T13:04:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2ccc00640 1 -- 172.21.15.29:0/2779460830 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2c8142980 msgr2=0x7fe2c80cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2ccc00640 1 --2- 172.21.15.29:0/2779460830 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2c8142980 0x7fe2c80cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2ccc00640 1 -- 172.21.15.29:0/2779460830 >> v2:172.21.15.163:3300/0 conn(0x7fe2c80cd350 msgr2=0x7fe2c815d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2ccc00640 1 --2- 172.21.15.29:0/2779460830 >> v2:172.21.15.163:3300/0 conn(0x7fe2c80cd350 0x7fe2c815d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2ccc00640 1 -- 172.21.15.29:0/2779460830 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c8160910 con 0x7fe2c806c860 2024-01-24T13:04:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2ccc00640 1 -- 172.21.15.29:0/2779460830 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7fe2b8001680 con 0x7fe2c806c860 2024-01-24T13:04:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.352+0000 7fe2cd600640 1 --2- 172.21.15.29:0/2779460830 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2c8142980 0x7fe2c80cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2ccc00640 1 -- 172.21.15.29:0/2779460830 >> v1:172.21.15.29:6789/0 conn(0x7fe2c806c860 legacy=0x7fe2c806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2ccc00640 1 --2- 172.21.15.29:0/2779460830 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2a8003980 0x7fe2a8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2ccc00640 1 --2- 172.21.15.29:0/2779460830 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2a80047d0 0x7fe2a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2ccc00640 1 --2- 172.21.15.29:0/2779460830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2a8005190 0x7fe2a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2ccc00640 1 -- 172.21.15.29:0/2779460830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c81611b0 con 0x7fe2a8005190 2024-01-24T13:04:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2ccc00640 1 -- 172.21.15.29:0/2779460830 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8160630 con 0x7fe2a80047d0 2024-01-24T13:04:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2ccc00640 1 -- 172.21.15.29:0/2779460830 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a800bed0 con 0x7fe2a8003980 2024-01-24T13:04:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2cea00640 1 --2- 172.21.15.29:0/2779460830 >> v2:172.21.15.163:3300/0 conn(0x7fe2c80cd350 0x7fe2c815d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2cd600640 1 --2- 172.21.15.29:0/2779460830 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2a80047d0 0x7fe2a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2cea00640 1 --2- 172.21.15.29:0/2779460830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2a8005190 0x7fe2a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2ce000640 1 --2- 172.21.15.29:0/2779460830 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2a8003980 0x7fe2a8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2cea00640 1 -- 172.21.15.29:0/2779460830 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2a8003980 msgr2=0x7fe2a8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2cea00640 1 --2- 172.21.15.29:0/2779460830 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2a8003980 0x7fe2a8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2cea00640 1 -- 172.21.15.29:0/2779460830 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2a80047d0 msgr2=0x7fe2a8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2cea00640 1 --2- 172.21.15.29:0/2779460830 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2a80047d0 0x7fe2a8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2cea00640 1 -- 172.21.15.29:0/2779460830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a8003530 con 0x7fe2a8005190 2024-01-24T13:04:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2cea00640 1 --2- 172.21.15.29:0/2779460830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2a8005190 0x7fe2a800b990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000e380 tx=0x7fe2c001ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9adfff19697d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2ccc00640 1 -- 172.21.15.29:0/2779460830 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00a5e30 con 0x7fe2a8005190 2024-01-24T13:04:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2ccc00640 1 -- 172.21.15.29:0/2779460830 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c000f040 con 0x7fe2a8005190 2024-01-24T13:04:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.356+0000 7fe2ccc00640 1 -- 172.21.15.29:0/2779460830 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0003ba0 con 0x7fe2a8005190 2024-01-24T13:04:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2d0a00640 1 -- 172.21.15.29:0/2779460830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2a8005190 msgr2=0x7fe2a800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2d0a00640 1 --2- 172.21.15.29:0/2779460830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2a8005190 0x7fe2a800b990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000e380 tx=0x7fe2c001ce20 comp rx=0 tx=0).stop 2024-01-24T13:04:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2cea00640 1 -- 172.21.15.29:0/2779460830 reap_dead start 2024-01-24T13:04:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2d0a00640 1 -- 172.21.15.29:0/2779460830 shutdown_connections 2024-01-24T13:04:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2d0a00640 1 -- 172.21.15.29:0/2779460830 >> 172.21.15.29:0/2779460830 conn(0x7fe2c8069cd0 msgr2=0x7fe2c806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2d0a00640 1 -- 172.21.15.29:0/2779460830 shutdown_connections 2024-01-24T13:04:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2d0a00640 1 -- 172.21.15.29:0/2779460830 wait complete. 2024-01-24T13:04:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2d0a00640 1 Processor -- start 2024-01-24T13:04:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2d0a00640 1 -- start start 2024-01-24T13:04:10.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2d0a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2a8005190 0x7fe2c81f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2d0a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c80c7550 0x7fe2c80c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2d0a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c80c55a0 0x7fe2c80c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2d0a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c80c7f10 con 0x7fe2c80c7550 2024-01-24T13:04:10.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2d0a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c80c6ea0 con 0x7fe2c80c55a0 2024-01-24T13:04:10.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.360+0000 7fe2d0a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c81f5040 con 0x7fe2a8005190 2024-01-24T13:04:10.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2cd600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c80c7550 0x7fe2c80c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2cd600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c80c7550 0x7fe2c80c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36568/0 (socket says 172.21.15.29:36568) 2024-01-24T13:04:10.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2cd600640 1 -- 172.21.15.29:0/73004357 learned_addr learned my addr 172.21.15.29:0/73004357 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:10.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2cea00640 1 --2- 172.21.15.29:0/73004357 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c80c55a0 0x7fe2c80c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2ce000640 1 --2- 172.21.15.29:0/73004357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2a8005190 0x7fe2c81f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2cd600640 1 -- 172.21.15.29:0/73004357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2a8005190 msgr2=0x7fe2c81f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2cd600640 1 --2- 172.21.15.29:0/73004357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2a8005190 0x7fe2c81f4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2cd600640 1 -- 172.21.15.29:0/73004357 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c80c55a0 msgr2=0x7fe2c80c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2cd600640 1 --2- 172.21.15.29:0/73004357 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c80c55a0 0x7fe2c80c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2cd600640 1 -- 172.21.15.29:0/73004357 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c80c6290 con 0x7fe2c80c7550 2024-01-24T13:04:10.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2cd600640 1 --2- 172.21.15.29:0/73004357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c80c7550 0x7fe2c80c79d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0011c30 tx=0x7fe2b000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:10.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2c6000640 1 -- 172.21.15.29:0/73004357 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000fd20 con 0x7fe2c80c7550 2024-01-24T13:04:10.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2c6000640 1 -- 172.21.15.29:0/73004357 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b000fe80 con 0x7fe2c80c7550 2024-01-24T13:04:10.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2c6000640 1 -- 172.21.15.29:0/73004357 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0014640 con 0x7fe2c80c7550 2024-01-24T13:04:10.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2d0a00640 1 -- 172.21.15.29:0/73004357 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c80c6570 con 0x7fe2c80c7550 2024-01-24T13:04:10.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2d0a00640 1 -- 172.21.15.29:0/73004357 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c80c6b30 con 0x7fe2c80c7550 2024-01-24T13:04:10.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2d0a00640 1 -- 172.21.15.29:0/73004357 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c804e850 con 0x7fe2c80c7550 2024-01-24T13:04:10.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.364+0000 7fe2c6000640 1 -- 172.21.15.29:0/73004357 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe2b00147a0 con 0x7fe2c80c7550 2024-01-24T13:04:10.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.368+0000 7fe2c6000640 1 --2- 172.21.15.29:0/73004357 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2a0065a90 0x7fe2a0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.368+0000 7fe2c6000640 1 -- 172.21.15.29:0/73004357 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe2b0083cd0 con 0x7fe2c80c7550 2024-01-24T13:04:10.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.368+0000 7fe2ce000640 1 --2- 172.21.15.29:0/73004357 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2a0065a90 0x7fe2a0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.368+0000 7fe2ce000640 1 --2- 172.21.15.29:0/73004357 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2a0065a90 0x7fe2a0067f50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe2c81ef890 tx=0x7fe2b8001de0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:10.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.372+0000 7fe2c6000640 1 -- 172.21.15.29:0/73004357 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe2b0051440 con 0x7fe2c80c7550 2024-01-24T13:04:10.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.528+0000 7fe2d0a00640 1 -- 172.21.15.29:0/73004357 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2c8160bc0 con 0x7fe2c80c7550 2024-01-24T13:04:10.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.528+0000 7fe2c6000640 1 -- 172.21.15.29:0/73004357 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe2b00220a0 con 0x7fe2c80c7550 2024-01-24T13:04:10.531 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:04:10.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.532+0000 7fe2d0a00640 1 -- 172.21.15.29:0/73004357 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2a0065a90 msgr2=0x7fe2a0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.532+0000 7fe2d0a00640 1 --2- 172.21.15.29:0/73004357 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2a0065a90 0x7fe2a0067f50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe2c81ef890 tx=0x7fe2b8001de0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.532+0000 7fe2d0a00640 1 -- 172.21.15.29:0/73004357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c80c7550 msgr2=0x7fe2c80c79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.532+0000 7fe2d0a00640 1 --2- 172.21.15.29:0/73004357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c80c7550 0x7fe2c80c79d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0011c30 tx=0x7fe2b000f610 comp rx=0 tx=0).stop 2024-01-24T13:04:10.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.532+0000 7fe2d0a00640 1 -- 172.21.15.29:0/73004357 shutdown_connections 2024-01-24T13:04:10.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.532+0000 7fe2d0a00640 1 --2- 172.21.15.29:0/73004357 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2a0065a90 0x7fe2a0067f50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.532+0000 7fe2d0a00640 1 --2- 172.21.15.29:0/73004357 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c80c55a0 0x7fe2c80c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.532+0000 7fe2d0a00640 1 --2- 172.21.15.29:0/73004357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c80c7550 0x7fe2c80c79d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.532+0000 7fe2d0a00640 1 --2- 172.21.15.29:0/73004357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2a8005190 0x7fe2c81f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.532+0000 7fe2d0a00640 1 -- 172.21.15.29:0/73004357 >> 172.21.15.29:0/73004357 conn(0x7fe2c8069cd0 msgr2=0x7fe2c815d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:10.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.532+0000 7fe2d0a00640 1 -- 172.21.15.29:0/73004357 shutdown_connections 2024-01-24T13:04:10.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.532+0000 7fe2d0a00640 1 -- 172.21.15.29:0/73004357 wait complete. 2024-01-24T13:04:10.553 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:04:10.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2bca00640 1 Processor -- start 2024-01-24T13:04:10.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2bca00640 1 -- start start 2024-01-24T13:04:10.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2bca00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2b4153a00 0x7fd2b4071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2bca00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd2b40b2760 0x7fd2b40b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2bca00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b4153de0 con 0x7fd2b40b1130 2024-01-24T13:04:10.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2bca00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b415df00 con 0x7fd2b40b2760 2024-01-24T13:04:10.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2bca00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b40b3120 con 0x7fd2b4153a00 2024-01-24T13:04:10.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2b9600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd2b40b2760 0x7fd2b40b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2baa00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd2b40b1130 0x7fd2b40b15c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49012/0 (socket says 172.21.15.29:49012) 2024-01-24T13:04:10.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2baa00640 1 -- 172.21.15.29:0/342051276 learned_addr learned my addr 172.21.15.29:0/342051276 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:10.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2ba000640 1 --2- 172.21.15.29:0/342051276 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2b4153a00 0x7fd2b4071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2b8c00640 1 -- 172.21.15.29:0/342051276 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112166439 0 0) 0x7fd2b4153de0 con 0x7fd2b40b1130 2024-01-24T13:04:10.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2b9600640 1 -- 172.21.15.29:0/342051276 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2b4153a00 msgr2=0x7fd2b4071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:10.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2b9600640 1 --2- 172.21.15.29:0/342051276 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2b4153a00 0x7fd2b4071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2b9600640 1 -- 172.21.15.29:0/342051276 >> v1:172.21.15.29:6789/0 conn(0x7fd2b40b1130 legacy=0x7fd2b40b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.696+0000 7fd2b9600640 1 -- 172.21.15.29:0/342051276 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b4159900 con 0x7fd2b40b2760 2024-01-24T13:04:10.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.700+0000 7fd2b9600640 1 --2- 172.21.15.29:0/342051276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2b40b2760 0x7fd2b40b2be0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0097c0 tx=0x7fd29c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27448e21ee8d2768 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:10.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.700+0000 7fd2b8c00640 1 -- 172.21.15.29:0/342051276 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0ac620 con 0x7fd2b40b2760 2024-01-24T13:04:10.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.700+0000 7fd2b8c00640 1 -- 172.21.15.29:0/342051276 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c0ac780 con 0x7fd2b40b2760 2024-01-24T13:04:10.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.700+0000 7fd2b8c00640 1 -- 172.21.15.29:0/342051276 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0acb10 con 0x7fd2b40b2760 2024-01-24T13:04:10.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.700+0000 7fd2bca00640 1 -- 172.21.15.29:0/342051276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2b40b2760 msgr2=0x7fd2b40b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.700+0000 7fd2bca00640 1 --2- 172.21.15.29:0/342051276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2b40b2760 0x7fd2b40b2be0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0097c0 tx=0x7fd29c01c3c0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.700+0000 7fd2bca00640 1 -- 172.21.15.29:0/342051276 shutdown_connections 2024-01-24T13:04:10.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.700+0000 7fd2bca00640 1 --2- 172.21.15.29:0/342051276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2b40b2760 0x7fd2b40b2be0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.700+0000 7fd2bca00640 1 --2- 172.21.15.29:0/342051276 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2b4153a00 0x7fd2b4071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.700+0000 7fd2bca00640 1 -- 172.21.15.29:0/342051276 >> 172.21.15.29:0/342051276 conn(0x7fd2b406d700 msgr2=0x7fd2b4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:10.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.700+0000 7fd2bca00640 1 -- 172.21.15.29:0/342051276 shutdown_connections 2024-01-24T13:04:10.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.700+0000 7fd2bca00640 1 -- 172.21.15.29:0/342051276 wait complete. 2024-01-24T13:04:10.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2bca00640 1 Processor -- start 2024-01-24T13:04:10.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2bca00640 1 -- start start 2024-01-24T13:04:10.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2bca00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2b40b1130 0x7fd2b413bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2bca00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2b40b2760 0x7fd2b415d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2bca00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2b4153a00 0x7fd2b4145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2bca00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b415c670 con 0x7fd2b40b2760 2024-01-24T13:04:10.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2bca00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b415c950 con 0x7fd2b40b1130 2024-01-24T13:04:10.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2bca00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b415cc30 con 0x7fd2b4153a00 2024-01-24T13:04:10.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2b9600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2b40b2760 0x7fd2b415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2b9600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2b40b2760 0x7fd2b415d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36588/0 (socket says 172.21.15.29:36588) 2024-01-24T13:04:10.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2b9600640 1 -- 172.21.15.29:0/1833085425 learned_addr learned my addr 172.21.15.29:0/1833085425 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:10.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2baa00640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2b4153a00 0x7fd2b4145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2ba000640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2b40b1130 0x7fd2b413bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2b9600640 1 -- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2b4153a00 msgr2=0x7fd2b4145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2b9600640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2b4153a00 0x7fd2b4145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2b9600640 1 -- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2b40b1130 msgr2=0x7fd2b413bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2b9600640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2b40b1130 0x7fd2b413bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2b9600640 1 -- 172.21.15.29:0/1833085425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c009420 con 0x7fd2b40b2760 2024-01-24T13:04:10.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2ba000640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2b40b1130 0x7fd2b413bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:10.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2b9600640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2b40b2760 0x7fd2b415d430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd29c019ff0 tx=0x7fd29c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:10.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2b2000640 1 -- 172.21.15.29:0/1833085425 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0b5410 con 0x7fd2b40b2760 2024-01-24T13:04:10.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2b2000640 1 -- 172.21.15.29:0/1833085425 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c0b5590 con 0x7fd2b40b2760 2024-01-24T13:04:10.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2b2000640 1 -- 172.21.15.29:0/1833085425 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0b5940 con 0x7fd2b40b2760 2024-01-24T13:04:10.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2bca00640 1 -- 172.21.15.29:0/1833085425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b415cf10 con 0x7fd2b40b2760 2024-01-24T13:04:10.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.704+0000 7fd2bca00640 1 -- 172.21.15.29:0/1833085425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b415c290 con 0x7fd2b40b2760 2024-01-24T13:04:10.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.708+0000 7fd2bca00640 1 -- 172.21.15.29:0/1833085425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b404e850 con 0x7fd2b40b2760 2024-01-24T13:04:10.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.708+0000 7fd2b2000640 1 -- 172.21.15.29:0/1833085425 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd29c0b3040 con 0x7fd2b40b2760 2024-01-24T13:04:10.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.708+0000 7fd2b2000640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd28c065a60 0x7fd28c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:10.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.708+0000 7fd2b2000640 1 -- 172.21.15.29:0/1833085425 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd29c11d0a0 con 0x7fd2b40b2760 2024-01-24T13:04:10.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.708+0000 7fd2ba000640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd28c065a60 0x7fd28c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:10.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.708+0000 7fd2ba000640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd28c065a60 0x7fd28c067f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009bb0 tx=0x7fd2a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:10.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.712+0000 7fd2b2000640 1 -- 172.21.15.29:0/1833085425 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd29c0ea6d0 con 0x7fd2b40b2760 2024-01-24T13:04:10.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.868+0000 7fd2bca00640 1 -- 172.21.15.29:0/1833085425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd2b415c7b0 con 0x7fd2b40b2760 2024-01-24T13:04:10.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.868+0000 7fd2b2000640 1 -- 172.21.15.29:0/1833085425 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd2b415c7b0 con 0x7fd2b40b2760 2024-01-24T13:04:10.870 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:10.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.868+0000 7fd2bca00640 1 -- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd28c065a60 msgr2=0x7fd28c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.868+0000 7fd2bca00640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd28c065a60 0x7fd28c067f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009bb0 tx=0x7fd2a4008040 comp rx=0 tx=0).stop 2024-01-24T13:04:10.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.872+0000 7fd2bca00640 1 -- 172.21.15.29:0/1833085425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2b40b2760 msgr2=0x7fd2b415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:10.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.872+0000 7fd2bca00640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2b40b2760 0x7fd2b415d430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd29c019ff0 tx=0x7fd29c019160 comp rx=0 tx=0).stop 2024-01-24T13:04:10.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.872+0000 7fd2bca00640 1 -- 172.21.15.29:0/1833085425 shutdown_connections 2024-01-24T13:04:10.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.872+0000 7fd2bca00640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd28c065a60 0x7fd28c067f20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.872+0000 7fd2bca00640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2b4153a00 0x7fd2b4145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.872+0000 7fd2bca00640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2b40b2760 0x7fd2b415d430 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.872+0000 7fd2bca00640 1 --2- 172.21.15.29:0/1833085425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2b40b1130 0x7fd2b413bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:10.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.872+0000 7fd2bca00640 1 -- 172.21.15.29:0/1833085425 >> 172.21.15.29:0/1833085425 conn(0x7fd2b406d700 msgr2=0x7fd2b4149ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:10.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.872+0000 7fd2bca00640 1 -- 172.21.15.29:0/1833085425 shutdown_connections 2024-01-24T13:04:10.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:10.872+0000 7fd2bca00640 1 -- 172.21.15.29:0/1833085425 wait complete. 2024-01-24T13:04:10.892 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:04:11.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f4400640 1 Processor -- start 2024-01-24T13:04:11.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f4400640 1 -- start start 2024-01-24T13:04:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f4400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f40ec0ca110 0x7f40ec13ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f4400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f40ec15a0d0 0x7f40ec15a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f4400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ec159980 con 0x7f40ec15d9a0 2024-01-24T13:04:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f4400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec13fc60 con 0x7f40ec15a0d0 2024-01-24T13:04:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f4400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec0711a0 con 0x7f40ec0ca110 2024-01-24T13:04:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f2400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f40ec15a0d0 0x7f40ec15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f2400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f40ec15a0d0 0x7f40ec15a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35322/0 (socket says 172.21.15.29:35322) 2024-01-24T13:04:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f2400640 1 -- 172.21.15.29:0/8290494 learned_addr learned my addr 172.21.15.29:0/8290494 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f1a00640 1 --2- 172.21.15.29:0/8290494 >> v2:172.21.15.163:3300/0 conn(0x7f40ec0ca110 0x7f40ec13ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f2400640 1 -- 172.21.15.29:0/8290494 >> v2:172.21.15.163:3300/0 conn(0x7f40ec0ca110 msgr2=0x7f40ec13ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f2400640 1 --2- 172.21.15.29:0/8290494 >> v2:172.21.15.163:3300/0 conn(0x7f40ec0ca110 0x7f40ec13ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f2400640 1 -- 172.21.15.29:0/8290494 >> v1:172.21.15.163:6789/0 conn(0x7f40ec15d9a0 legacy=0x7f40ec070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:11.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f2400640 1 -- 172.21.15.29:0/8290494 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec0713e0 con 0x7f40ec15a0d0 2024-01-24T13:04:11.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.032+0000 7f40f1a00640 1 --2- 172.21.15.29:0/8290494 >> v2:172.21.15.163:3300/0 conn(0x7f40ec0ca110 0x7f40ec13ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:11.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.036+0000 7f40f2400640 1 --2- 172.21.15.29:0/8290494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40ec15a0d0 0x7f40ec15a560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0c8790 tx=0x7f40e401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72a4d34b7bf8b75 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:11.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.036+0000 7f40ebe00640 1 -- 172.21.15.29:0/8290494 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40a5890 con 0x7f40ec15a0d0 2024-01-24T13:04:11.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.036+0000 7f40ebe00640 1 -- 172.21.15.29:0/8290494 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e40a59f0 con 0x7f40ec15a0d0 2024-01-24T13:04:11.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.036+0000 7f40ebe00640 1 -- 172.21.15.29:0/8290494 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40a5d80 con 0x7f40ec15a0d0 2024-01-24T13:04:11.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.036+0000 7f40f4400640 1 -- 172.21.15.29:0/8290494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40ec15a0d0 msgr2=0x7f40ec15a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:11.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.036+0000 7f40f4400640 1 --2- 172.21.15.29:0/8290494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40ec15a0d0 0x7f40ec15a560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0c8790 tx=0x7f40e401c9d0 comp rx=0 tx=0).stop 2024-01-24T13:04:11.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.036+0000 7f40f4400640 1 -- 172.21.15.29:0/8290494 shutdown_connections 2024-01-24T13:04:11.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.036+0000 7f40f4400640 1 --2- 172.21.15.29:0/8290494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40ec15a0d0 0x7f40ec15a560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:11.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.036+0000 7f40f4400640 1 --2- 172.21.15.29:0/8290494 >> v2:172.21.15.163:3300/0 conn(0x7f40ec0ca110 0x7f40ec13ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:11.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.036+0000 7f40f4400640 1 -- 172.21.15.29:0/8290494 >> 172.21.15.29:0/8290494 conn(0x7f40ec06a2d0 msgr2=0x7f40ec0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:11.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.036+0000 7f40f4400640 1 -- 172.21.15.29:0/8290494 shutdown_connections 2024-01-24T13:04:11.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.036+0000 7f40f4400640 1 -- 172.21.15.29:0/8290494 wait complete. 2024-01-24T13:04:11.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f4400640 1 Processor -- start 2024-01-24T13:04:11.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f4400640 1 -- start start 2024-01-24T13:04:11.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f4400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40ec0ca110 0x7f40ec14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:11.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f4400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40ec15a0d0 0x7f40ec14da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:11.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f4400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f40ec15d9a0 0x7f40ec0c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:11.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f4400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec14eb30 con 0x7f40ec0ca110 2024-01-24T13:04:11.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f4400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec1528e0 con 0x7f40ec15a0d0 2024-01-24T13:04:11.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f4400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec152b80 con 0x7f40ec15d9a0 2024-01-24T13:04:11.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f1a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40ec0ca110 0x7f40ec14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:11.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f1a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40ec0ca110 0x7f40ec14fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35334/0 (socket says 172.21.15.29:35334) 2024-01-24T13:04:11.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f1a00640 1 -- 172.21.15.29:0/3365443610 learned_addr learned my addr 172.21.15.29:0/3365443610 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:11.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f1000640 1 --2- 172.21.15.29:0/3365443610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40ec15a0d0 0x7f40ec14da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:11.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f2400640 1 --2- 172.21.15.29:0/3365443610 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f40ec15d9a0 0x7f40ec0c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:11.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f1a00640 1 -- 172.21.15.29:0/3365443610 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f40ec15d9a0 msgr2=0x7f40ec0c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:11.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f1a00640 1 --2- 172.21.15.29:0/3365443610 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f40ec15d9a0 0x7f40ec0c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:11.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f1a00640 1 -- 172.21.15.29:0/3365443610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40ec15a0d0 msgr2=0x7f40ec14da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:11.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f1a00640 1 --2- 172.21.15.29:0/3365443610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40ec15a0d0 0x7f40ec14da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:11.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f1a00640 1 -- 172.21.15.29:0/3365443610 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e4009b30 con 0x7f40ec0ca110 2024-01-24T13:04:11.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f1a00640 1 --2- 172.21.15.29:0/3365443610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40ec0ca110 0x7f40ec14fbd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00d7d0 tx=0x7f40dc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:11.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40e9600640 1 -- 172.21.15.29:0/3365443610 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0059a0 con 0x7f40ec0ca110 2024-01-24T13:04:11.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40e9600640 1 -- 172.21.15.29:0/3365443610 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc005b00 con 0x7f40ec0ca110 2024-01-24T13:04:11.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40e9600640 1 -- 172.21.15.29:0/3365443610 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc005e90 con 0x7f40ec0ca110 2024-01-24T13:04:11.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f4400640 1 -- 172.21.15.29:0/3365443610 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec152e60 con 0x7f40ec0ca110 2024-01-24T13:04:11.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.040+0000 7f40f4400640 1 -- 172.21.15.29:0/3365443610 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec153420 con 0x7f40ec0ca110 2024-01-24T13:04:11.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.044+0000 7f40f4400640 1 -- 172.21.15.29:0/3365443610 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec04e850 con 0x7f40ec0ca110 2024-01-24T13:04:11.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.044+0000 7f40e9600640 1 -- 172.21.15.29:0/3365443610 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f40dc004030 con 0x7f40ec0ca110 2024-01-24T13:04:11.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.044+0000 7f40e9600640 1 --2- 172.21.15.29:0/3365443610 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f40c4065a60 0x7f40c4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:11.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.044+0000 7f40e9600640 1 -- 172.21.15.29:0/3365443610 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f40dc083310 con 0x7f40ec0ca110 2024-01-24T13:04:11.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.044+0000 7f40f1000640 1 --2- 172.21.15.29:0/3365443610 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f40c4065a60 0x7f40c4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:11.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.044+0000 7f40f1000640 1 --2- 172.21.15.29:0/3365443610 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f40c4065a60 0x7f40c4067f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0c4ce0 tx=0x7f40d4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:11.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.048+0000 7f40e9600640 1 -- 172.21.15.29:0/3365443610 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f40dc050a80 con 0x7f40ec0ca110 2024-01-24T13:04:11.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.220+0000 7f40f4400640 1 -- 172.21.15.29:0/3365443610 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f40ec0c79d0 con 0x7f40ec0ca110 2024-01-24T13:04:11.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.220+0000 7f40e9600640 1 -- 172.21.15.29:0/3365443610 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f40dc0540a0 con 0x7f40ec0ca110 2024-01-24T13:04:11.222 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:04:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.224+0000 7f40f4400640 1 -- 172.21.15.29:0/3365443610 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f40c4065a60 msgr2=0x7f40c4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.224+0000 7f40f4400640 1 --2- 172.21.15.29:0/3365443610 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f40c4065a60 0x7f40c4067f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0c4ce0 tx=0x7f40d4009040 comp rx=0 tx=0).stop 2024-01-24T13:04:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.224+0000 7f40f4400640 1 -- 172.21.15.29:0/3365443610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40ec0ca110 msgr2=0x7f40ec14fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.224+0000 7f40f4400640 1 --2- 172.21.15.29:0/3365443610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40ec0ca110 0x7f40ec14fbd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00d7d0 tx=0x7f40dc00dc90 comp rx=0 tx=0).stop 2024-01-24T13:04:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.224+0000 7f40f4400640 1 -- 172.21.15.29:0/3365443610 shutdown_connections 2024-01-24T13:04:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.224+0000 7f40f4400640 1 --2- 172.21.15.29:0/3365443610 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f40c4065a60 0x7f40c4067f20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.224+0000 7f40f4400640 1 --2- 172.21.15.29:0/3365443610 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f40ec15d9a0 0x7f40ec0c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.224+0000 7f40f4400640 1 --2- 172.21.15.29:0/3365443610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40ec15a0d0 0x7f40ec14da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.224+0000 7f40f4400640 1 --2- 172.21.15.29:0/3365443610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40ec0ca110 0x7f40ec14fbd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.224+0000 7f40f4400640 1 -- 172.21.15.29:0/3365443610 >> 172.21.15.29:0/3365443610 conn(0x7f40ec06a2d0 msgr2=0x7f40ec0adc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.224+0000 7f40f4400640 1 -- 172.21.15.29:0/3365443610 shutdown_connections 2024-01-24T13:04:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:11.224+0000 7f40f4400640 1 -- 172.21.15.29:0/3365443610 wait complete. 2024-01-24T13:04:11.244 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-01-24T13:04:11.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:11.244 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-01-24T13:04:11.273 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[31815]: fuse finished with error 0 and tester_r 0 2024-01-24T13:04:11.276 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:04:17.377 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:04:17.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:17.378 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-01-24T13:04:17.407 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:17.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7ca400640 1 Processor -- start 2024-01-24T13:04:17.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7ca400640 1 -- start start 2024-01-24T13:04:17.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7ca400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7c4143910 0x7ff7c4143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:17.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7ca400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff7c406c320 0x7ff7c40cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7ca400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c415aa30 con 0x7ff7c4070ac0 2024-01-24T13:04:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7ca400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c40712a0 con 0x7ff7c406c320 2024-01-24T13:04:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7ca400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4071580 con 0x7ff7c4143910 2024-01-24T13:04:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7c3e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff7c406c320 0x7ff7c40cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7c3e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff7c406c320 0x7ff7c40cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35350/0 (socket says 172.21.15.29:35350) 2024-01-24T13:04:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7c3e00640 1 -- 172.21.15.29:0/2957433114 learned_addr learned my addr 172.21.15.29:0/2957433114 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7c3400640 1 --2- 172.21.15.29:0/2957433114 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7c4143910 0x7ff7c4143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7c3e00640 1 -- 172.21.15.29:0/2957433114 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7c4143910 msgr2=0x7ff7c4143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7c3e00640 1 --2- 172.21.15.29:0/2957433114 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7c4143910 0x7ff7c4143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7c3e00640 1 -- 172.21.15.29:0/2957433114 >> v1:172.21.15.29:6789/0 conn(0x7ff7c4070ac0 legacy=0x7ff7c406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7c3e00640 1 -- 172.21.15.29:0/2957433114 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c40cd090 con 0x7ff7c406c320 2024-01-24T13:04:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.600+0000 7ff7c3400640 1 --2- 172.21.15.29:0/2957433114 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7c4143910 0x7ff7c4143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:17.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.604+0000 7ff7c3e00640 1 --2- 172.21.15.29:0/2957433114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406c320 0x7ff7c40cd890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009e50 tx=0x7ff7bc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a37ed7ad2b979f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:17.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.604+0000 7ff7c2000640 1 -- 172.21.15.29:0/2957433114 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc0a5890 con 0x7ff7c406c320 2024-01-24T13:04:17.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.604+0000 7ff7c2000640 1 -- 172.21.15.29:0/2957433114 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc0a59f0 con 0x7ff7c406c320 2024-01-24T13:04:17.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.604+0000 7ff7c2000640 1 -- 172.21.15.29:0/2957433114 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc0a5d80 con 0x7ff7c406c320 2024-01-24T13:04:17.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.604+0000 7ff7ca400640 1 -- 172.21.15.29:0/2957433114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406c320 msgr2=0x7ff7c40cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:17.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.604+0000 7ff7ca400640 1 --2- 172.21.15.29:0/2957433114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406c320 0x7ff7c40cd890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009e50 tx=0x7ff7bc01c9e0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.604+0000 7ff7ca400640 1 -- 172.21.15.29:0/2957433114 shutdown_connections 2024-01-24T13:04:17.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.604+0000 7ff7ca400640 1 --2- 172.21.15.29:0/2957433114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406c320 0x7ff7c40cd890 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.604+0000 7ff7ca400640 1 --2- 172.21.15.29:0/2957433114 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7c4143910 0x7ff7c4143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.604+0000 7ff7ca400640 1 -- 172.21.15.29:0/2957433114 >> 172.21.15.29:0/2957433114 conn(0x7ff7c40b3950 msgr2=0x7ff7c4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:17.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.604+0000 7ff7ca400640 1 -- 172.21.15.29:0/2957433114 shutdown_connections 2024-01-24T13:04:17.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.604+0000 7ff7ca400640 1 -- 172.21.15.29:0/2957433114 wait complete. 2024-01-24T13:04:17.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7ca400640 1 Processor -- start 2024-01-24T13:04:17.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7ca400640 1 -- start start 2024-01-24T13:04:17.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7ca400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406c320 0x7ff7c41f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:17.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7ca400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7c4070ac0 0x7ff7c413c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:17.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7ca400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7c4143910 0x7ff7c413ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:17.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7ca400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4156210 con 0x7ff7c406c320 2024-01-24T13:04:17.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7ca400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c413d0a0 con 0x7ff7c4070ac0 2024-01-24T13:04:17.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7ca400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4157a50 con 0x7ff7c4143910 2024-01-24T13:04:17.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7c3400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406c320 0x7ff7c41f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:17.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7c3400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406c320 0x7ff7c41f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35352/0 (socket says 172.21.15.29:35352) 2024-01-24T13:04:17.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7c3400640 1 -- 172.21.15.29:0/3570345954 learned_addr learned my addr 172.21.15.29:0/3570345954 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:17.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7c3e00640 1 --2- 172.21.15.29:0/3570345954 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7c4143910 0x7ff7c413ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:17.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7c2a00640 1 --2- 172.21.15.29:0/3570345954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7c4070ac0 0x7ff7c413c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:17.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7c3400640 1 -- 172.21.15.29:0/3570345954 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7c4143910 msgr2=0x7ff7c413ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:17.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7c3400640 1 --2- 172.21.15.29:0/3570345954 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7c4143910 0x7ff7c413ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7c3400640 1 -- 172.21.15.29:0/3570345954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7c4070ac0 msgr2=0x7ff7c413c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:17.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7c3400640 1 --2- 172.21.15.29:0/3570345954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7c4070ac0 0x7ff7c413c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7c3400640 1 -- 172.21.15.29:0/3570345954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc009b30 con 0x7ff7c406c320 2024-01-24T13:04:17.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7c3400640 1 --2- 172.21.15.29:0/3570345954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406c320 0x7ff7c41f5770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400d800 tx=0x7ff7b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:17.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7bb400640 1 -- 172.21.15.29:0/3570345954 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40096c0 con 0x7ff7c406c320 2024-01-24T13:04:17.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7bb400640 1 -- 172.21.15.29:0/3570345954 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b4009820 con 0x7ff7c406c320 2024-01-24T13:04:17.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7ca400640 1 -- 172.21.15.29:0/3570345954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c4157d30 con 0x7ff7c406c320 2024-01-24T13:04:17.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7bb400640 1 -- 172.21.15.29:0/3570345954 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4009bd0 con 0x7ff7c406c320 2024-01-24T13:04:17.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.608+0000 7ff7ca400640 1 -- 172.21.15.29:0/3570345954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c41582f0 con 0x7ff7c406c320 2024-01-24T13:04:17.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.612+0000 7ff7ca400640 1 -- 172.21.15.29:0/3570345954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c404e850 con 0x7ff7c406c320 2024-01-24T13:04:17.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.612+0000 7ff7bb400640 1 -- 172.21.15.29:0/3570345954 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff7b4009d30 con 0x7ff7c406c320 2024-01-24T13:04:17.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.612+0000 7ff7bb400640 1 --2- 172.21.15.29:0/3570345954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff79c065a60 0x7ff79c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:17.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.612+0000 7ff7bb400640 1 -- 172.21.15.29:0/3570345954 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff7b4083b10 con 0x7ff7c406c320 2024-01-24T13:04:17.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.612+0000 7ff7c2a00640 1 --2- 172.21.15.29:0/3570345954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff79c065a60 0x7ff79c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:17.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.612+0000 7ff7c2a00640 1 --2- 172.21.15.29:0/3570345954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff79c065a60 0x7ff79c067f20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff7c41378c0 tx=0x7ff7ac009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:17.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.616+0000 7ff7bb400640 1 -- 172.21.15.29:0/3570345954 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff7b40511f0 con 0x7ff7c406c320 2024-01-24T13:04:17.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.776+0000 7ff7ca400640 1 -- 172.21.15.29:0/3570345954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7c414a210 con 0x7ff7c406c320 2024-01-24T13:04:17.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.776+0000 7ff7bb400640 1 -- 172.21.15.29:0/3570345954 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+17882 (secure 0 0 0) 0x7ff7b4054810 con 0x7ff7c406c320 2024-01-24T13:04:17.778 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:17.778 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:01.140044+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:17.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.776+0000 7ff7ca400640 1 -- 172.21.15.29:0/3570345954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff79c065a60 msgr2=0x7ff79c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:17.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.776+0000 7ff7ca400640 1 --2- 172.21.15.29:0/3570345954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff79c065a60 0x7ff79c067f20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff7c41378c0 tx=0x7ff7ac009040 comp rx=0 tx=0).stop 2024-01-24T13:04:17.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.776+0000 7ff7ca400640 1 -- 172.21.15.29:0/3570345954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406c320 msgr2=0x7ff7c41f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:17.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.776+0000 7ff7ca400640 1 --2- 172.21.15.29:0/3570345954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406c320 0x7ff7c41f5770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400d800 tx=0x7ff7b400dcc0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.776+0000 7ff7ca400640 1 -- 172.21.15.29:0/3570345954 shutdown_connections 2024-01-24T13:04:17.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.776+0000 7ff7ca400640 1 --2- 172.21.15.29:0/3570345954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff79c065a60 0x7ff79c067f20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.776+0000 7ff7ca400640 1 --2- 172.21.15.29:0/3570345954 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7c4143910 0x7ff7c413ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.776+0000 7ff7ca400640 1 --2- 172.21.15.29:0/3570345954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7c4070ac0 0x7ff7c413c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.776+0000 7ff7ca400640 1 --2- 172.21.15.29:0/3570345954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406c320 0x7ff7c41f5770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.776+0000 7ff7ca400640 1 -- 172.21.15.29:0/3570345954 >> 172.21.15.29:0/3570345954 conn(0x7ff7c40b3950 msgr2=0x7ff7c40af520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:17.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.776+0000 7ff7ca400640 1 -- 172.21.15.29:0/3570345954 shutdown_connections 2024-01-24T13:04:17.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.780+0000 7ff7ca400640 1 -- 172.21.15.29:0/3570345954 wait complete. 2024-01-24T13:04:17.802 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:17.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.940+0000 7f37ff200640 1 Processor -- start 2024-01-24T13:04:17.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.940+0000 7f37ff200640 1 -- start start 2024-01-24T13:04:17.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.944+0000 7f37ff200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f37f81588d0 0x7f37f8158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:17.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.944+0000 7f37ff200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f37f8070950 0x7f37f80b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:17.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.944+0000 7f37ff200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f815c830 con 0x7f37f81591f0 2024-01-24T13:04:17.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.944+0000 7f37ff200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f815cb10 con 0x7f37f8070950 2024-01-24T13:04:17.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.944+0000 7f37ff200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f815cdf0 con 0x7f37f81588d0 2024-01-24T13:04:17.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.944+0000 7f37fd200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f37f8070950 0x7f37f80b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:17.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.944+0000 7f37fd200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f37f8070950 0x7f37f80b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35354/0 (socket says 172.21.15.29:35354) 2024-01-24T13:04:17.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.944+0000 7f37fd200640 1 -- 172.21.15.29:0/1404603126 learned_addr learned my addr 172.21.15.29:0/1404603126 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:17.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.944+0000 7f37f7e00640 1 --2- 172.21.15.29:0/1404603126 >> v2:172.21.15.163:3300/0 conn(0x7f37f81588d0 0x7f37f8158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:17.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.944+0000 7f37fd200640 1 -- 172.21.15.29:0/1404603126 >> v2:172.21.15.163:3300/0 conn(0x7f37f81588d0 msgr2=0x7f37f8158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:17.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.944+0000 7f37fd200640 1 --2- 172.21.15.29:0/1404603126 >> v2:172.21.15.163:3300/0 conn(0x7f37f81588d0 0x7f37f8158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.944+0000 7f37fd200640 1 -- 172.21.15.29:0/1404603126 >> v1:172.21.15.163:6789/0 conn(0x7f37f81591f0 legacy=0x7f37f8070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:17.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.944+0000 7f37fd200640 1 -- 172.21.15.29:0/1404603126 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f815d0d0 con 0x7f37f8070950 2024-01-24T13:04:17.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.944+0000 7f37fd200640 1 --2- 172.21.15.29:0/1404603126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37f8070950 0x7f37f80b1fb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f37f80cf260 tx=0x7f37f001d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91358a5edf4afcf4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:17.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.948+0000 7f37f6a00640 1 -- 172.21.15.29:0/1404603126 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f00a6710 con 0x7f37f8070950 2024-01-24T13:04:17.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.948+0000 7f37f6a00640 1 -- 172.21.15.29:0/1404603126 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f00a6870 con 0x7f37f8070950 2024-01-24T13:04:17.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.948+0000 7f37f6a00640 1 -- 172.21.15.29:0/1404603126 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f00a6c00 con 0x7f37f8070950 2024-01-24T13:04:17.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.948+0000 7f37ff200640 1 -- 172.21.15.29:0/1404603126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37f8070950 msgr2=0x7f37f80b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:17.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.948+0000 7f37ff200640 1 --2- 172.21.15.29:0/1404603126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37f8070950 0x7f37f80b1fb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f37f80cf260 tx=0x7f37f001d990 comp rx=0 tx=0).stop 2024-01-24T13:04:17.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.948+0000 7f37ff200640 1 -- 172.21.15.29:0/1404603126 shutdown_connections 2024-01-24T13:04:17.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.948+0000 7f37ff200640 1 --2- 172.21.15.29:0/1404603126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37f8070950 0x7f37f80b1fb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.948+0000 7f37ff200640 1 --2- 172.21.15.29:0/1404603126 >> v2:172.21.15.163:3300/0 conn(0x7f37f81588d0 0x7f37f8158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.948+0000 7f37ff200640 1 -- 172.21.15.29:0/1404603126 >> 172.21.15.29:0/1404603126 conn(0x7f37f80b3950 msgr2=0x7f37f8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:17.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.948+0000 7f37ff200640 1 -- 172.21.15.29:0/1404603126 shutdown_connections 2024-01-24T13:04:17.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.948+0000 7f37ff200640 1 -- 172.21.15.29:0/1404603126 wait complete. 2024-01-24T13:04:17.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.948+0000 7f37ff200640 1 Processor -- start 2024-01-24T13:04:17.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.948+0000 7f37ff200640 1 -- start start 2024-01-24T13:04:17.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37ff200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37f8070950 0x7f37f813c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:17.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37ff200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37f81588d0 0x7f37f80add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:17.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37ff200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37f80ae270 0x7f37f813e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:17.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37ff200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f80ae700 con 0x7f37f80ae270 2024-01-24T13:04:17.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37ff200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f815a570 con 0x7f37f81588d0 2024-01-24T13:04:17.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37ff200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f813ede0 con 0x7f37f8070950 2024-01-24T13:04:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37fd200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37f80ae270 0x7f37f813e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37fd200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37f80ae270 0x7f37f813e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35362/0 (socket says 172.21.15.29:35362) 2024-01-24T13:04:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37fd200640 1 -- 172.21.15.29:0/4292618685 learned_addr learned my addr 172.21.15.29:0/4292618685 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37f7e00640 1 --2- 172.21.15.29:0/4292618685 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37f8070950 0x7f37f813c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37f7400640 1 --2- 172.21.15.29:0/4292618685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37f81588d0 0x7f37f80add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37fd200640 1 -- 172.21.15.29:0/4292618685 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37f8070950 msgr2=0x7f37f813c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37fd200640 1 --2- 172.21.15.29:0/4292618685 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37f8070950 0x7f37f813c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37fd200640 1 -- 172.21.15.29:0/4292618685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37f81588d0 msgr2=0x7f37f80add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37fd200640 1 --2- 172.21.15.29:0/4292618685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37f81588d0 0x7f37f80add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37fd200640 1 -- 172.21.15.29:0/4292618685 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f0009b30 con 0x7f37f80ae270 2024-01-24T13:04:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37fd200640 1 --2- 172.21.15.29:0/4292618685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37f80ae270 0x7f37f813e0b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f37f00b0040 tx=0x7f37f001c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:17.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37efe00640 1 -- 172.21.15.29:0/4292618685 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f00b8600 con 0x7f37f80ae270 2024-01-24T13:04:17.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37efe00640 1 -- 172.21.15.29:0/4292618685 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f00b8760 con 0x7f37f80ae270 2024-01-24T13:04:17.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37ff200640 1 -- 172.21.15.29:0/4292618685 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f815a3e0 con 0x7f37f80ae270 2024-01-24T13:04:17.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37efe00640 1 -- 172.21.15.29:0/4292618685 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f00b8af0 con 0x7f37f80ae270 2024-01-24T13:04:17.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37ff200640 1 -- 172.21.15.29:0/4292618685 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f8156250 con 0x7f37f80ae270 2024-01-24T13:04:17.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37ff200640 1 -- 172.21.15.29:0/4292618685 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f804e850 con 0x7f37f80ae270 2024-01-24T13:04:17.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.952+0000 7f37efe00640 1 -- 172.21.15.29:0/4292618685 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f37f00b8c50 con 0x7f37f80ae270 2024-01-24T13:04:17.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.956+0000 7f37efe00640 1 --2- 172.21.15.29:0/4292618685 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f37d0065a90 0x7f37d0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.956+0000 7f37efe00640 1 -- 172.21.15.29:0/4292618685 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f37f011e320 con 0x7f37f80ae270 2024-01-24T13:04:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.956+0000 7f37f7e00640 1 --2- 172.21.15.29:0/4292618685 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f37d0065a90 0x7f37d0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.956+0000 7f37f7e00640 1 --2- 172.21.15.29:0/4292618685 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f37d0065a90 0x7f37d0067f50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009b60 tx=0x7f37e8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:17.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:17.960+0000 7f37efe00640 1 -- 172.21.15.29:0/4292618685 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f37f00eba00 con 0x7f37f80ae270 2024-01-24T13:04:18.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.120+0000 7f37ff200640 1 -- 172.21.15.29:0/4292618685 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37f80afaa0 con 0x7f37f80ae270 2024-01-24T13:04:18.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.120+0000 7f37efe00640 1 -- 172.21.15.29:0/4292618685 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f37f0009510 con 0x7f37f80ae270 2024-01-24T13:04:18.123 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:18.123 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:01.140044+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:18.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.124+0000 7f37ff200640 1 -- 172.21.15.29:0/4292618685 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f37d0065a90 msgr2=0x7f37d0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:18.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.124+0000 7f37ff200640 1 --2- 172.21.15.29:0/4292618685 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f37d0065a90 0x7f37d0067f50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009b60 tx=0x7f37e8009190 comp rx=0 tx=0).stop 2024-01-24T13:04:18.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.124+0000 7f37ff200640 1 -- 172.21.15.29:0/4292618685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37f80ae270 msgr2=0x7f37f813e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:18.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.124+0000 7f37ff200640 1 --2- 172.21.15.29:0/4292618685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37f80ae270 0x7f37f813e0b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f37f00b0040 tx=0x7f37f001c1d0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.124+0000 7f37ff200640 1 -- 172.21.15.29:0/4292618685 shutdown_connections 2024-01-24T13:04:18.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.124+0000 7f37ff200640 1 --2- 172.21.15.29:0/4292618685 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f37d0065a90 0x7f37d0067f50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.124+0000 7f37ff200640 1 --2- 172.21.15.29:0/4292618685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37f80ae270 0x7f37f813e0b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.124+0000 7f37ff200640 1 --2- 172.21.15.29:0/4292618685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37f81588d0 0x7f37f80add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.124+0000 7f37ff200640 1 --2- 172.21.15.29:0/4292618685 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37f8070950 0x7f37f813c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.124+0000 7f37ff200640 1 -- 172.21.15.29:0/4292618685 >> 172.21.15.29:0/4292618685 conn(0x7f37f80b3950 msgr2=0x7f37f80b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.124+0000 7f37ff200640 1 -- 172.21.15.29:0/4292618685 shutdown_connections 2024-01-24T13:04:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.124+0000 7f37ff200640 1 -- 172.21.15.29:0/4292618685 wait complete. 2024-01-24T13:04:18.145 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-24T13:04:18.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5c8000640 1 Processor -- start 2024-01-24T13:04:18.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5c8000640 1 -- start start 2024-01-24T13:04:18.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5c8000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe5c00b2c10 0x7fe5c015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:18.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5c8000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c0153de0 con 0x7fe5c00b2760 2024-01-24T13:04:18.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5c8000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c0071d10 con 0x7fe5c0153a00 2024-01-24T13:04:18.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5c8000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c0159900 con 0x7fe5c00b2c10 2024-01-24T13:04:18.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5c4c00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe5c00b2760 0x7fe5c015cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58568/0 (socket says 172.21.15.29:58568) 2024-01-24T13:04:18.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5c4c00640 1 -- 172.21.15.29:0/2434141339 learned_addr learned my addr 172.21.15.29:0/2434141339 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:18.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5c6000640 1 --2- 172.21.15.29:0/2434141339 >> v2:172.21.15.163:3300/0 conn(0x7fe5c00b2c10 0x7fe5c015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:18.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 -- 172.21.15.29:0/2434141339 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936944466 0 0) 0x7fe5c0153de0 con 0x7fe5c00b2760 2024-01-24T13:04:18.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 -- 172.21.15.29:0/2434141339 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a0005740 con 0x7fe5c00b2760 2024-01-24T13:04:18.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 -- 172.21.15.29:0/2434141339 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3642713112 0 0) 0x7fe5a0005740 con 0x7fe5c00b2760 2024-01-24T13:04:18.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 -- 172.21.15.29:0/2434141339 >> v2:172.21.15.163:3300/0 conn(0x7fe5c00b2c10 msgr2=0x7fe5c015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:18.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 --2- 172.21.15.29:0/2434141339 >> v2:172.21.15.163:3300/0 conn(0x7fe5c00b2c10 0x7fe5c015d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 -- 172.21.15.29:0/2434141339 >> v1:172.21.15.163:6789/0 conn(0x7fe5c0153a00 legacy=0x7fe5c0071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:18.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 -- 172.21.15.29:0/2434141339 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c00b3060 con 0x7fe5c00b2760 2024-01-24T13:04:18.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 -- 172.21.15.29:0/2434141339 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7fe5a8001680 con 0x7fe5c00b2760 2024-01-24T13:04:18.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 -- 172.21.15.29:0/2434141339 >> v1:172.21.15.29:6789/0 conn(0x7fe5c00b2760 legacy=0x7fe5c015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:18.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 --2- 172.21.15.29:0/2434141339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a0005b90 0x7fe5a0005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:18.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 --2- 172.21.15.29:0/2434141339 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5a00069e0 0x7fe5a0006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:18.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 --2- 172.21.15.29:0/2434141339 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5a00073a0 0x7fe5a000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:18.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 -- 172.21.15.29:0/2434141339 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0159900 con 0x7fe5a0005b90 2024-01-24T13:04:18.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 -- 172.21.15.29:0/2434141339 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a000e340 con 0x7fe5a00069e0 2024-01-24T13:04:18.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5bfe00640 1 -- 172.21.15.29:0/2434141339 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a000e500 con 0x7fe5a00073a0 2024-01-24T13:04:18.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5c5600640 1 --2- 172.21.15.29:0/2434141339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a0005b90 0x7fe5a0005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:18.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5c4c00640 1 --2- 172.21.15.29:0/2434141339 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5a00069e0 0x7fe5a0006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:18.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.288+0000 7fe5c6000640 1 --2- 172.21.15.29:0/2434141339 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5a00073a0 0x7fe5a000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:18.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5c5600640 1 -- 172.21.15.29:0/2434141339 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5a00073a0 msgr2=0x7fe5a000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:18.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5c5600640 1 --2- 172.21.15.29:0/2434141339 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5a00073a0 0x7fe5a000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5c5600640 1 -- 172.21.15.29:0/2434141339 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5a00069e0 msgr2=0x7fe5a0006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:18.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5c5600640 1 --2- 172.21.15.29:0/2434141339 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5a00069e0 0x7fe5a0006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5c5600640 1 -- 172.21.15.29:0/2434141339 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a0005740 con 0x7fe5a0005b90 2024-01-24T13:04:18.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5c4c00640 1 --2- 172.21.15.29:0/2434141339 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5a00069e0 0x7fe5a0006e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:18.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5c6000640 1 --2- 172.21.15.29:0/2434141339 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5a00073a0 0x7fe5a000dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:18.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5c6000640 1 -- 172.21.15.29:0/2434141339 reap_dead start 2024-01-24T13:04:18.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5c5600640 1 --2- 172.21.15.29:0/2434141339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a0005b90 0x7fe5a0005fb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0001780 tx=0x7fe5b001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7362d9b0f18465 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:18.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5bfe00640 1 -- 172.21.15.29:0/2434141339 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b00052d0 con 0x7fe5a0005b90 2024-01-24T13:04:18.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5bfe00640 1 -- 172.21.15.29:0/2434141339 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b00a7050 con 0x7fe5a0005b90 2024-01-24T13:04:18.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5bfe00640 1 -- 172.21.15.29:0/2434141339 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0003600 con 0x7fe5a0005b90 2024-01-24T13:04:18.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5c8000640 1 -- 172.21.15.29:0/2434141339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a0005b90 msgr2=0x7fe5a0005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:18.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5c8000640 1 --2- 172.21.15.29:0/2434141339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a0005b90 0x7fe5a0005fb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0001780 tx=0x7fe5b001c3b0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5c8000640 1 -- 172.21.15.29:0/2434141339 shutdown_connections 2024-01-24T13:04:18.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5c8000640 1 --2- 172.21.15.29:0/2434141339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a0005b90 0x7fe5a0005fb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.292+0000 7fe5c8000640 1 -- 172.21.15.29:0/2434141339 >> 172.21.15.29:0/2434141339 conn(0x7fe5c006d700 msgr2=0x7fe5c0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:18.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c8000640 1 -- 172.21.15.29:0/2434141339 shutdown_connections 2024-01-24T13:04:18.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c8000640 1 -- 172.21.15.29:0/2434141339 wait complete. 2024-01-24T13:04:18.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c8000640 1 Processor -- start 2024-01-24T13:04:18.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c8000640 1 -- start start 2024-01-24T13:04:18.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c8000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5a0005b90 0x7fe5c015b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:18.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c8000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c0148c30 0x7fe5c01f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:18.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c8000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5c014fe60 0x7fe5c01502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:18.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c8000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0150820 con 0x7fe5c014fe60 2024-01-24T13:04:18.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c8000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c00cec50 con 0x7fe5a0005b90 2024-01-24T13:04:18.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c8000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c01f8420 con 0x7fe5c0148c30 2024-01-24T13:04:18.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c6000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5c014fe60 0x7fe5c01502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:18.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c5600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5a0005b90 0x7fe5c015b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:18.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c4c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c0148c30 0x7fe5c01f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:18.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c6000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5c014fe60 0x7fe5c01502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35382/0 (socket says 172.21.15.29:35382) 2024-01-24T13:04:18.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c6000640 1 -- 172.21.15.29:0/3652705004 learned_addr learned my addr 172.21.15.29:0/3652705004 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:18.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c6000640 1 -- 172.21.15.29:0/3652705004 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c0148c30 msgr2=0x7fe5c01f8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:18.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c6000640 1 --2- 172.21.15.29:0/3652705004 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c0148c30 0x7fe5c01f8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c6000640 1 -- 172.21.15.29:0/3652705004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5a0005b90 msgr2=0x7fe5c015b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:18.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c6000640 1 --2- 172.21.15.29:0/3652705004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5a0005b90 0x7fe5c015b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.296+0000 7fe5c6000640 1 -- 172.21.15.29:0/3652705004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c015c5a0 con 0x7fe5c014fe60 2024-01-24T13:04:18.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.300+0000 7fe5c6000640 1 --2- 172.21.15.29:0/3652705004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5c014fe60 0x7fe5c01502e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00cf0c0 tx=0x7fe5b8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:18.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.300+0000 7fe5bd600640 1 -- 172.21.15.29:0/3652705004 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b801b070 con 0x7fe5c014fe60 2024-01-24T13:04:18.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.300+0000 7fe5bd600640 1 -- 172.21.15.29:0/3652705004 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b800f040 con 0x7fe5c014fe60 2024-01-24T13:04:18.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.300+0000 7fe5bd600640 1 -- 172.21.15.29:0/3652705004 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b800e050 con 0x7fe5c014fe60 2024-01-24T13:04:18.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.300+0000 7fe5c8000640 1 -- 172.21.15.29:0/3652705004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c015bfe0 con 0x7fe5c014fe60 2024-01-24T13:04:18.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.300+0000 7fe5c8000640 1 -- 172.21.15.29:0/3652705004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c01f86c0 con 0x7fe5c014fe60 2024-01-24T13:04:18.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.300+0000 7fe5c8000640 1 -- 172.21.15.29:0/3652705004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c01f8280 con 0x7fe5c014fe60 2024-01-24T13:04:18.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.300+0000 7fe5bd600640 1 -- 172.21.15.29:0/3652705004 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe5b8015440 con 0x7fe5c014fe60 2024-01-24T13:04:18.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.300+0000 7fe5bd600640 1 --2- 172.21.15.29:0/3652705004 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe598065a90 0x7fe598067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:18.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.300+0000 7fe5bd600640 1 -- 172.21.15.29:0/3652705004 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe5b8083500 con 0x7fe5c014fe60 2024-01-24T13:04:18.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.300+0000 7fe5c5600640 1 --2- 172.21.15.29:0/3652705004 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe598065a90 0x7fe598067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:18.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.304+0000 7fe5c5600640 1 --2- 172.21.15.29:0/3652705004 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe598065a90 0x7fe598067f50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0001750 tx=0x7fe5b00011a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:18.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.304+0000 7fe5bd600640 1 -- 172.21.15.29:0/3652705004 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe5c01f8280 con 0x7fe5c014fe60 2024-01-24T13:04:18.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.496+0000 7fe5c8000640 1 -- 172.21.15.29:0/3652705004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe5c01f8280 con 0x7fe5c014fe60 2024-01-24T13:04:18.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.616+0000 7fe5bd600640 1 -- 172.21.15.29:0/3652705004 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe5c01f8280 con 0x7fe5c014fe60 2024-01-24T13:04:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.616+0000 7fe5c8000640 1 -- 172.21.15.29:0/3652705004 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe598065a90 msgr2=0x7fe598067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.616+0000 7fe5c8000640 1 --2- 172.21.15.29:0/3652705004 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe598065a90 0x7fe598067f50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0001750 tx=0x7fe5b00011a0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.616+0000 7fe5c8000640 1 -- 172.21.15.29:0/3652705004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5c014fe60 msgr2=0x7fe5c01502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.616+0000 7fe5c8000640 1 --2- 172.21.15.29:0/3652705004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5c014fe60 0x7fe5c01502e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00cf0c0 tx=0x7fe5b8010590 comp rx=0 tx=0).stop 2024-01-24T13:04:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.616+0000 7fe5c8000640 1 -- 172.21.15.29:0/3652705004 shutdown_connections 2024-01-24T13:04:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.616+0000 7fe5c8000640 1 --2- 172.21.15.29:0/3652705004 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe598065a90 0x7fe598067f50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.616+0000 7fe5c8000640 1 --2- 172.21.15.29:0/3652705004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5c014fe60 0x7fe5c01502e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.616+0000 7fe5c8000640 1 --2- 172.21.15.29:0/3652705004 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c0148c30 0x7fe5c01f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.616+0000 7fe5c8000640 1 --2- 172.21.15.29:0/3652705004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5a0005b90 0x7fe5c015b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.616+0000 7fe5c8000640 1 -- 172.21.15.29:0/3652705004 >> 172.21.15.29:0/3652705004 conn(0x7fe5c006d700 msgr2=0x7fe5c00ae010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.616+0000 7fe5c8000640 1 -- 172.21.15.29:0/3652705004 shutdown_connections 2024-01-24T13:04:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.616+0000 7fe5c8000640 1 -- 172.21.15.29:0/3652705004 wait complete. 2024-01-24T13:04:18.640 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-01-24T13:04:18.640 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-24T13:04:18.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.784+0000 7f0eaa200640 1 Processor -- start 2024-01-24T13:04:18.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.784+0000 7f0eaa200640 1 -- start start 2024-01-24T13:04:18.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.784+0000 7f0eaa200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ea4153a00 0x7f0ea4071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:18.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.784+0000 7f0eaa200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0ea40b2760 0x7f0ea40b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:18.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.784+0000 7f0eaa200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea4153de0 con 0x7f0ea40b1130 2024-01-24T13:04:18.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.784+0000 7f0eaa200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea40b3150 con 0x7f0ea4153a00 2024-01-24T13:04:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.784+0000 7f0eaa200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea415df00 con 0x7f0ea40b2760 2024-01-24T13:04:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.784+0000 7f0ea3400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ea4153a00 0x7f0ea4071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.784+0000 7f0ea3400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ea4153a00 0x7f0ea4071600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35384/0 (socket says 172.21.15.29:35384) 2024-01-24T13:04:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.784+0000 7f0ea3400640 1 -- 172.21.15.29:0/2114351345 learned_addr learned my addr 172.21.15.29:0/2114351345 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.784+0000 7f0ea3400640 1 -- 172.21.15.29:0/2114351345 >> v2:172.21.15.163:3300/0 conn(0x7f0ea40b2760 msgr2=0x7f0ea40b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.784+0000 7f0ea3400640 1 --2- 172.21.15.29:0/2114351345 >> v2:172.21.15.163:3300/0 conn(0x7f0ea40b2760 0x7f0ea40b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.784+0000 7f0ea3400640 1 -- 172.21.15.29:0/2114351345 >> v1:172.21.15.163:6789/0 conn(0x7f0ea40b1130 legacy=0x7f0ea40b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.784+0000 7f0ea3400640 1 -- 172.21.15.29:0/2114351345 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea4159900 con 0x7f0ea4153a00 2024-01-24T13:04:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.788+0000 7f0ea3400640 1 --2- 172.21.15.29:0/2114351345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea4153a00 0x7f0ea4071600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0ea406a880 tx=0x7f0e9401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a741b544f8de9c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.788+0000 7f0ea2000640 1 -- 172.21.15.29:0/2114351345 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940ab600 con 0x7f0ea4153a00 2024-01-24T13:04:18.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.788+0000 7f0ea2000640 1 -- 172.21.15.29:0/2114351345 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e940ab760 con 0x7f0ea4153a00 2024-01-24T13:04:18.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.788+0000 7f0ea2000640 1 -- 172.21.15.29:0/2114351345 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940abaf0 con 0x7f0ea4153a00 2024-01-24T13:04:18.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.788+0000 7f0eaa200640 1 -- 172.21.15.29:0/2114351345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea4153a00 msgr2=0x7f0ea4071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:18.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.788+0000 7f0eaa200640 1 --2- 172.21.15.29:0/2114351345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea4153a00 0x7f0ea4071600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0ea406a880 tx=0x7f0e9401c400 comp rx=0 tx=0).stop 2024-01-24T13:04:18.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.788+0000 7f0eaa200640 1 -- 172.21.15.29:0/2114351345 shutdown_connections 2024-01-24T13:04:18.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.788+0000 7f0eaa200640 1 --2- 172.21.15.29:0/2114351345 >> v2:172.21.15.163:3300/0 conn(0x7f0ea40b2760 0x7f0ea40b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.788+0000 7f0eaa200640 1 --2- 172.21.15.29:0/2114351345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea4153a00 0x7f0ea4071600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.788+0000 7f0eaa200640 1 -- 172.21.15.29:0/2114351345 >> 172.21.15.29:0/2114351345 conn(0x7f0ea406d700 msgr2=0x7f0ea4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:18.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.788+0000 7f0eaa200640 1 -- 172.21.15.29:0/2114351345 shutdown_connections 2024-01-24T13:04:18.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.788+0000 7f0eaa200640 1 -- 172.21.15.29:0/2114351345 wait complete. 2024-01-24T13:04:18.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0eaa200640 1 Processor -- start 2024-01-24T13:04:18.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0eaa200640 1 -- start start 2024-01-24T13:04:18.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0eaa200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea40b1130 0x7f0ea4139d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:18.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0eaa200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea40b2760 0x7f0ea40a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:18.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0eaa200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ea4153a00 0x7f0ea40a8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:18.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0eaa200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea4147180 con 0x7f0ea40b2760 2024-01-24T13:04:18.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0eaa200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea413a260 con 0x7f0ea4153a00 2024-01-24T13:04:18.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0eaa200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea4149160 con 0x7f0ea40b1130 2024-01-24T13:04:18.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0ea2a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea40b2760 0x7f0ea40a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:18.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0ea2a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea40b2760 0x7f0ea40a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35394/0 (socket says 172.21.15.29:35394) 2024-01-24T13:04:18.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0ea2a00640 1 -- 172.21.15.29:0/3733604182 learned_addr learned my addr 172.21.15.29:0/3733604182 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:18.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0ea3400640 1 --2- 172.21.15.29:0/3733604182 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea40b1130 0x7f0ea4139d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:18.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0ea3e00640 1 --2- 172.21.15.29:0/3733604182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ea4153a00 0x7f0ea40a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:18.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0ea2a00640 1 -- 172.21.15.29:0/3733604182 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea40b1130 msgr2=0x7f0ea4139d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:18.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0ea2a00640 1 --2- 172.21.15.29:0/3733604182 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea40b1130 0x7f0ea4139d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0ea2a00640 1 -- 172.21.15.29:0/3733604182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ea4153a00 msgr2=0x7f0ea40a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:18.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0ea2a00640 1 --2- 172.21.15.29:0/3733604182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ea4153a00 0x7f0ea40a8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:18.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0ea2a00640 1 -- 172.21.15.29:0/3733604182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e940094d0 con 0x7f0ea40b2760 2024-01-24T13:04:18.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0ea2a00640 1 --2- 172.21.15.29:0/3733604182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea40b2760 0x7f0ea40a7dd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00b550 tx=0x7f0e8c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:18.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0e9b400640 1 -- 172.21.15.29:0/3733604182 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c010610 con 0x7f0ea40b2760 2024-01-24T13:04:18.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0e9b400640 1 -- 172.21.15.29:0/3733604182 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c010790 con 0x7f0ea40b2760 2024-01-24T13:04:18.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0e9b400640 1 -- 172.21.15.29:0/3733604182 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c010b40 con 0x7f0ea40b2760 2024-01-24T13:04:18.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0eaa200640 1 -- 172.21.15.29:0/3733604182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea4149440 con 0x7f0ea40b2760 2024-01-24T13:04:18.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0eaa200640 1 -- 172.21.15.29:0/3733604182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea4149a00 con 0x7f0ea40b2760 2024-01-24T13:04:18.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.792+0000 7f0eaa200640 1 -- 172.21.15.29:0/3733604182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea404e850 con 0x7f0ea40b2760 2024-01-24T13:04:18.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.796+0000 7f0e9b400640 1 -- 172.21.15.29:0/3733604182 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0e8c010ca0 con 0x7f0ea40b2760 2024-01-24T13:04:18.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.796+0000 7f0e9b400640 1 --2- 172.21.15.29:0/3733604182 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0e7c065a60 0x7f0e7c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:18.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.796+0000 7f0e9b400640 1 -- 172.21.15.29:0/3733604182 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e8c082ff0 con 0x7f0ea40b2760 2024-01-24T13:04:18.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.796+0000 7f0ea3400640 1 --2- 172.21.15.29:0/3733604182 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0e7c065a60 0x7f0e7c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:18.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.796+0000 7f0ea3400640 1 --2- 172.21.15.29:0/3733604182 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0e7c065a60 0x7f0e7c067f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e940af000 tx=0x7f0e940b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:18.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.800+0000 7f0e9b400640 1 -- 172.21.15.29:0/3733604182 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f0e8c050730 con 0x7f0ea40b2760 2024-01-24T13:04:18.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:18.988+0000 7f0eaa200640 1 -- 172.21.15.29:0/3733604182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0ea415a430 con 0x7f0ea40b2760 2024-01-24T13:04:19.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.624+0000 7f0e9b400640 1 -- 172.21.15.29:0/3733604182 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0e8c053d50 con 0x7f0ea40b2760 2024-01-24T13:04:19.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.624+0000 7f0eaa200640 1 -- 172.21.15.29:0/3733604182 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0e7c065a60 msgr2=0x7f0e7c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:19.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.624+0000 7f0eaa200640 1 --2- 172.21.15.29:0/3733604182 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0e7c065a60 0x7f0e7c067f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e940af000 tx=0x7f0e940b6040 comp rx=0 tx=0).stop 2024-01-24T13:04:19.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.624+0000 7f0eaa200640 1 -- 172.21.15.29:0/3733604182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea40b2760 msgr2=0x7f0ea40a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:19.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.624+0000 7f0eaa200640 1 --2- 172.21.15.29:0/3733604182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea40b2760 0x7f0ea40a7dd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00b550 tx=0x7f0e8c00ba10 comp rx=0 tx=0).stop 2024-01-24T13:04:19.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.624+0000 7f0eaa200640 1 -- 172.21.15.29:0/3733604182 shutdown_connections 2024-01-24T13:04:19.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.624+0000 7f0eaa200640 1 --2- 172.21.15.29:0/3733604182 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0e7c065a60 0x7f0e7c067f20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:19.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.624+0000 7f0eaa200640 1 --2- 172.21.15.29:0/3733604182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ea4153a00 0x7f0ea40a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:19.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.624+0000 7f0eaa200640 1 --2- 172.21.15.29:0/3733604182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea40b2760 0x7f0ea40a7dd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:19.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.624+0000 7f0eaa200640 1 --2- 172.21.15.29:0/3733604182 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea40b1130 0x7f0ea4139d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:19.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.624+0000 7f0eaa200640 1 -- 172.21.15.29:0/3733604182 >> 172.21.15.29:0/3733604182 conn(0x7f0ea406d700 msgr2=0x7f0ea4152cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:19.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.624+0000 7f0eaa200640 1 -- 172.21.15.29:0/3733604182 shutdown_connections 2024-01-24T13:04:19.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.624+0000 7f0eaa200640 1 -- 172.21.15.29:0/3733604182 wait complete. 2024-01-24T13:04:19.651 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-24T13:04:19.652 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:04:19.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f5724e00640 1 Processor -- start 2024-01-24T13:04:19.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f5724e00640 1 -- start start 2024-01-24T13:04:19.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f5724e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f572015a630 0x7f57200cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f5724e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57200cfe50 con 0x7f57200cb100 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f5724e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572015aa10 con 0x7f57200c3ef0 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f5724e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57200cf380 con 0x7f572015a630 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571e800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f57200cb100 0x7f57200d02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58574/0 (socket says 172.21.15.29:58574) 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571e800640 1 -- 172.21.15.29:0/288903570 learned_addr learned my addr 172.21.15.29:0/288903570 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571de00640 1 --2- 172.21.15.29:0/288903570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f572015a630 0x7f57200cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233061737 0 0) 0x7f57200cfe50 con 0x7f57200cb100 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5700003530 con 0x7f57200cb100 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307673039 0 0) 0x7f572015aa10 con 0x7f57200c3ef0 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57200cfe50 con 0x7f57200c3ef0 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3394559150 0 0) 0x7f5700003530 con 0x7f57200cb100 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f572015a630 msgr2=0x7f57200cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571ca00640 1 --2- 172.21.15.29:0/288903570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f572015a630 0x7f57200cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 >> v1:172.21.15.163:6789/0 conn(0x7f57200c3ef0 legacy=0x7f57200ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57200b2b70 con 0x7f57200cb100 2024-01-24T13:04:19.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f5718001a00 con 0x7f57200cb100 2024-01-24T13:04:19.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571de00640 1 --2- 172.21.15.29:0/288903570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f572015a630 0x7f57200cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:19.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.796+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 >> v1:172.21.15.29:6789/0 conn(0x7f57200cb100 legacy=0x7f57200d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:19.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571ca00640 1 --2- 172.21.15.29:0/288903570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f572015a630 0x7f5700003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:19.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571ca00640 1 --2- 172.21.15.29:0/288903570 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57000040d0 0x7f57000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:19.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571ca00640 1 --2- 172.21.15.29:0/288903570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5700004d10 0x7f5700005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:19.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57200cf380 con 0x7f5700004d10 2024-01-24T13:04:19.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570000baa0 con 0x7f57000040d0 2024-01-24T13:04:19.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570000bc60 con 0x7f572015a630 2024-01-24T13:04:19.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571e800640 1 --2- 172.21.15.29:0/288903570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5700004d10 0x7f5700005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:19.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571de00640 1 --2- 172.21.15.29:0/288903570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f572015a630 0x7f5700003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:19.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571d400640 1 --2- 172.21.15.29:0/288903570 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57000040d0 0x7f57000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:19.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571e800640 1 -- 172.21.15.29:0/288903570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f572015a630 msgr2=0x7f5700003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:19.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571e800640 1 --2- 172.21.15.29:0/288903570 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f572015a630 0x7f5700003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:19.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571e800640 1 -- 172.21.15.29:0/288903570 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57000040d0 msgr2=0x7f57000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:19.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571e800640 1 --2- 172.21.15.29:0/288903570 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57000040d0 0x7f57000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:19.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571e800640 1 -- 172.21.15.29:0/288903570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5710009420 con 0x7f5700004d10 2024-01-24T13:04:19.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571e800640 1 --2- 172.21.15.29:0/288903570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5700004d10 0x7f5700005190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f571800a6c0 tx=0x7f571801f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca0e015b92e84fa server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:19.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718007330 con 0x7f5700004d10 2024-01-24T13:04:19.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5718007490 con 0x7f5700004d10 2024-01-24T13:04:19.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.800+0000 7f571ca00640 1 -- 172.21.15.29:0/288903570 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57180078c0 con 0x7f5700004d10 2024-01-24T13:04:19.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f5724e00640 1 -- 172.21.15.29:0/288903570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5700004d10 msgr2=0x7f5700005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:19.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f5724e00640 1 --2- 172.21.15.29:0/288903570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5700004d10 0x7f5700005190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f571800a6c0 tx=0x7f571801f900 comp rx=0 tx=0).stop 2024-01-24T13:04:19.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f571e800640 1 -- 172.21.15.29:0/288903570 reap_dead start 2024-01-24T13:04:19.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f5724e00640 1 -- 172.21.15.29:0/288903570 shutdown_connections 2024-01-24T13:04:19.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f5724e00640 1 -- 172.21.15.29:0/288903570 >> 172.21.15.29:0/288903570 conn(0x7f5720070570 msgr2=0x7f5720069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:19.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f5724e00640 1 -- 172.21.15.29:0/288903570 shutdown_connections 2024-01-24T13:04:19.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f5724e00640 1 -- 172.21.15.29:0/288903570 wait complete. 2024-01-24T13:04:19.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f5724e00640 1 Processor -- start 2024-01-24T13:04:19.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f5724e00640 1 -- start start 2024-01-24T13:04:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f5724e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5700004d10 0x7f5720148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f5724e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57200c7470 0x7f57200c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f5724e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57200c5320 0x7f57200c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f5724e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57200c5ce0 con 0x7f57200c7470 2024-01-24T13:04:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f5724e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57200c7fe0 con 0x7f57200c5320 2024-01-24T13:04:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f5724e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57200c82c0 con 0x7f5700004d10 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f571d400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57200c7470 0x7f57200c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f571d400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57200c7470 0x7f57200c78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35414/0 (socket says 172.21.15.29:35414) 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.804+0000 7f571d400640 1 -- 172.21.15.29:0/3873863110 learned_addr learned my addr 172.21.15.29:0/3873863110 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f571de00640 1 --2- 172.21.15.29:0/3873863110 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5700004d10 0x7f5720148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f571e800640 1 --2- 172.21.15.29:0/3873863110 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57200c5320 0x7f57200c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f571d400640 1 -- 172.21.15.29:0/3873863110 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5700004d10 msgr2=0x7f5720148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f571d400640 1 --2- 172.21.15.29:0/3873863110 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5700004d10 0x7f5720148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f571d400640 1 -- 172.21.15.29:0/3873863110 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57200c5320 msgr2=0x7f57200c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f571d400640 1 --2- 172.21.15.29:0/3873863110 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57200c5320 0x7f57200c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f571d400640 1 -- 172.21.15.29:0/3873863110 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57200c85a0 con 0x7f57200c7470 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f571d400640 1 --2- 172.21.15.29:0/3873863110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57200c7470 0x7f57200c78f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f570800f7e0 tx=0x7f570800fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f5716000640 1 -- 172.21.15.29:0/3873863110 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57080014f0 con 0x7f57200c7470 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f5716000640 1 -- 172.21.15.29:0/3873863110 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57080052e0 con 0x7f57200c7470 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f5716000640 1 -- 172.21.15.29:0/3873863110 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570800d950 con 0x7f57200c7470 2024-01-24T13:04:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f5724e00640 1 -- 172.21.15.29:0/3873863110 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57200c8880 con 0x7f57200c7470 2024-01-24T13:04:19.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f5724e00640 1 -- 172.21.15.29:0/3873863110 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5720148670 con 0x7f57200c7470 2024-01-24T13:04:19.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f5724e00640 1 -- 172.21.15.29:0/3873863110 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57200c8da0 con 0x7f57200c7470 2024-01-24T13:04:19.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.808+0000 7f5716000640 1 -- 172.21.15.29:0/3873863110 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f570800dab0 con 0x7f57200c7470 2024-01-24T13:04:19.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.812+0000 7f5716000640 1 --2- 172.21.15.29:0/3873863110 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f56f8065a60 0x7f56f8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:19.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.812+0000 7f5716000640 1 -- 172.21.15.29:0/3873863110 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5708083610 con 0x7f57200c7470 2024-01-24T13:04:19.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.812+0000 7f571de00640 1 --2- 172.21.15.29:0/3873863110 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f56f8065a60 0x7f56f8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:19.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.812+0000 7f571de00640 1 --2- 172.21.15.29:0/3873863110 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f56f8065a60 0x7f56f8067f20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5710009cb0 tx=0x7f5710008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:19.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:19.816+0000 7f5716000640 1 -- 172.21.15.29:0/3873863110 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f57200c8da0 con 0x7f57200c7470 2024-01-24T13:04:20.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.008+0000 7f5724e00640 1 -- 172.21.15.29:0/3873863110 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57200c8da0 con 0x7f57200c7470 2024-01-24T13:04:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.008+0000 7f5716000640 1 -- 172.21.15.29:0/3873863110 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f57200c8da0 con 0x7f57200c7470 2024-01-24T13:04:20.010 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:20.010 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1485056573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1485056573},{"type":"v1","addr":"172.21.15.29:6834","nonce":1485056573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/447431893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":447431893},{"type":"v1","addr":"172.21.15.163:6836","nonce":447431893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2390785325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2390785325},{"type":"v1","addr":"172.21.15.29:6835","nonce":2390785325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:03:55.981917+0000","modified":"2024-01-24T13:04:19.618027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/1191601563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1191601563},{"type":"v1","addr":"172.21.15.163:6837","nonce":1191601563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T13:04:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-24T13:04:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.008+0000 7f5724e00640 1 -- 172.21.15.29:0/3873863110 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f56f8065a60 msgr2=0x7f56f8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.008+0000 7f5724e00640 1 --2- 172.21.15.29:0/3873863110 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f56f8065a60 0x7f56f8067f20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5710009cb0 tx=0x7f5710008040 comp rx=0 tx=0).stop 2024-01-24T13:04:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.008+0000 7f5724e00640 1 -- 172.21.15.29:0/3873863110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57200c7470 msgr2=0x7f57200c78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.008+0000 7f5724e00640 1 --2- 172.21.15.29:0/3873863110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57200c7470 0x7f57200c78f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f570800f7e0 tx=0x7f570800fca0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.012+0000 7f5724e00640 1 -- 172.21.15.29:0/3873863110 shutdown_connections 2024-01-24T13:04:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.012+0000 7f5724e00640 1 --2- 172.21.15.29:0/3873863110 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f56f8065a60 0x7f56f8067f20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.012+0000 7f5724e00640 1 --2- 172.21.15.29:0/3873863110 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57200c5320 0x7f57200c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.012+0000 7f5724e00640 1 --2- 172.21.15.29:0/3873863110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57200c7470 0x7f57200c78f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.012+0000 7f5724e00640 1 --2- 172.21.15.29:0/3873863110 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5700004d10 0x7f5720148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.012+0000 7f5724e00640 1 -- 172.21.15.29:0/3873863110 >> 172.21.15.29:0/3873863110 conn(0x7f5720070570 msgr2=0x7f57200d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.012+0000 7f5724e00640 1 -- 172.21.15.29:0/3873863110 shutdown_connections 2024-01-24T13:04:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.012+0000 7f5724e00640 1 -- 172.21.15.29:0/3873863110 wait complete. 2024-01-24T13:04:20.034 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:20.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.172+0000 7f8ac3400640 1 Processor -- start 2024-01-24T13:04:20.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.172+0000 7f8ac3400640 1 -- start start 2024-01-24T13:04:20.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.172+0000 7f8ac3400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8abc15c4a0 0x7f8abc15c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.172+0000 7f8ac3400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc15d8b0 con 0x7f8abc069cd0 2024-01-24T13:04:20.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.172+0000 7f8ac3400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc15cf80 con 0x7f8abc0ccb50 2024-01-24T13:04:20.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.172+0000 7f8ac3400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc0b24e0 con 0x7f8abc15c4a0 2024-01-24T13:04:20.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.172+0000 7f8ac0a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8abc15c4a0 0x7f8abc15c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.172+0000 7f8ac0a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8abc15c4a0 0x7f8abc15c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35428/0 (socket says 172.21.15.29:35428) 2024-01-24T13:04:20.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.172+0000 7f8ac0a00640 1 -- 172.21.15.29:0/426712631 learned_addr learned my addr 172.21.15.29:0/426712631 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:20.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.172+0000 7f8ac0a00640 1 -- 172.21.15.29:0/426712631 >> v1:172.21.15.163:6789/0 conn(0x7f8abc0ccb50 legacy=0x7f8abc0cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:20.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.172+0000 7f8ac0a00640 1 -- 172.21.15.29:0/426712631 >> v1:172.21.15.29:6789/0 conn(0x7f8abc069cd0 legacy=0x7f8abc0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.172+0000 7f8ac0a00640 1 -- 172.21.15.29:0/426712631 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc15d260 con 0x7f8abc15c4a0 2024-01-24T13:04:20.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.176+0000 7f8ac0a00640 1 --2- 172.21.15.29:0/426712631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc15c4a0 0x7f8abc15c880 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009870 tx=0x7f8aac01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33ad7b9cb68fcbe server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:20.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.176+0000 7f8abb400640 1 -- 172.21.15.29:0/426712631 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0aa5f0 con 0x7f8abc15c4a0 2024-01-24T13:04:20.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.176+0000 7f8abb400640 1 -- 172.21.15.29:0/426712631 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac0aa750 con 0x7f8abc15c4a0 2024-01-24T13:04:20.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.176+0000 7f8abb400640 1 -- 172.21.15.29:0/426712631 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0aaae0 con 0x7f8abc15c4a0 2024-01-24T13:04:20.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.176+0000 7f8ac3400640 1 -- 172.21.15.29:0/426712631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc15c4a0 msgr2=0x7f8abc15c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.176+0000 7f8ac3400640 1 --2- 172.21.15.29:0/426712631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc15c4a0 0x7f8abc15c880 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009870 tx=0x7f8aac01c470 comp rx=0 tx=0).stop 2024-01-24T13:04:20.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.176+0000 7f8ac3400640 1 -- 172.21.15.29:0/426712631 shutdown_connections 2024-01-24T13:04:20.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.176+0000 7f8ac3400640 1 --2- 172.21.15.29:0/426712631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc15c4a0 0x7f8abc15c880 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.176+0000 7f8ac3400640 1 -- 172.21.15.29:0/426712631 >> 172.21.15.29:0/426712631 conn(0x7f8abc0714a0 msgr2=0x7f8abc0718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:20.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac3400640 1 -- 172.21.15.29:0/426712631 shutdown_connections 2024-01-24T13:04:20.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac3400640 1 -- 172.21.15.29:0/426712631 wait complete. 2024-01-24T13:04:20.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac3400640 1 Processor -- start 2024-01-24T13:04:20.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac3400640 1 -- start start 2024-01-24T13:04:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac3400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc069cd0 0x7f8abc150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac3400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8abc0ccb50 0x7f8abc15b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac3400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8abc15c4a0 0x7f8abc15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac3400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0c63a0 con 0x7f8abc069cd0 2024-01-24T13:04:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac3400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0c5860 con 0x7f8abc0ccb50 2024-01-24T13:04:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac3400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0c5b00 con 0x7f8abc15c4a0 2024-01-24T13:04:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac0a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc069cd0 0x7f8abc150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac0a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc069cd0 0x7f8abc150630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35432/0 (socket says 172.21.15.29:35432) 2024-01-24T13:04:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac0a00640 1 -- 172.21.15.29:0/544212542 learned_addr learned my addr 172.21.15.29:0/544212542 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac1e00640 1 --2- 172.21.15.29:0/544212542 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8abc15c4a0 0x7f8abc15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8abbe00640 1 --2- 172.21.15.29:0/544212542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8abc0ccb50 0x7f8abc15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac0a00640 1 -- 172.21.15.29:0/544212542 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8abc15c4a0 msgr2=0x7f8abc15b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac0a00640 1 --2- 172.21.15.29:0/544212542 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8abc15c4a0 0x7f8abc15b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac0a00640 1 -- 172.21.15.29:0/544212542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8abc0ccb50 msgr2=0x7f8abc15b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac0a00640 1 --2- 172.21.15.29:0/544212542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8abc0ccb50 0x7f8abc15b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.180+0000 7f8ac0a00640 1 -- 172.21.15.29:0/544212542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0094d0 con 0x7f8abc069cd0 2024-01-24T13:04:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.184+0000 7f8ac0a00640 1 --2- 172.21.15.29:0/544212542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc069cd0 0x7f8abc150630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0ac040 tx=0x7f8aac01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.184+0000 7f8ab8c00640 1 -- 172.21.15.29:0/544212542 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0b38c0 con 0x7f8abc069cd0 2024-01-24T13:04:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.184+0000 7f8ab8c00640 1 -- 172.21.15.29:0/544212542 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac0b3a40 con 0x7f8abc069cd0 2024-01-24T13:04:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.184+0000 7f8ab8c00640 1 -- 172.21.15.29:0/544212542 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0b3df0 con 0x7f8abc069cd0 2024-01-24T13:04:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.184+0000 7f8ac3400640 1 -- 172.21.15.29:0/544212542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc0c5de0 con 0x7f8abc069cd0 2024-01-24T13:04:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.184+0000 7f8ac3400640 1 -- 172.21.15.29:0/544212542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc150b70 con 0x7f8abc069cd0 2024-01-24T13:04:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.184+0000 7f8ac3400640 1 -- 172.21.15.29:0/544212542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc0c5c40 con 0x7f8abc069cd0 2024-01-24T13:04:20.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.184+0000 7f8ab8c00640 1 -- 172.21.15.29:0/544212542 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8aac0c6440 con 0x7f8abc069cd0 2024-01-24T13:04:20.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.184+0000 7f8ab8c00640 1 --2- 172.21.15.29:0/544212542 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8a94065ae0 0x7f8a94067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.184+0000 7f8ab8c00640 1 -- 172.21.15.29:0/544212542 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8aac0a7070 con 0x7f8abc069cd0 2024-01-24T13:04:20.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.188+0000 7f8abbe00640 1 --2- 172.21.15.29:0/544212542 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8a94065ae0 0x7f8a94067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.188+0000 7f8abbe00640 1 --2- 172.21.15.29:0/544212542 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8a94065ae0 0x7f8a94067fa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8abc159b20 tx=0x7f8aa4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:20.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.188+0000 7f8ab8c00640 1 -- 172.21.15.29:0/544212542 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f8abc0c5c40 con 0x7f8abc069cd0 2024-01-24T13:04:20.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.352+0000 7f8ac3400640 1 -- 172.21.15.29:0/544212542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8abc0b2dd0 con 0x7f8abc069cd0 2024-01-24T13:04:20.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.352+0000 7f8ab8c00640 1 -- 172.21.15.29:0/544212542 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f8abc0b2dd0 con 0x7f8abc069cd0 2024-01-24T13:04:20.354 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:20.354 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:01.140044+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:20.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.352+0000 7f8ac3400640 1 -- 172.21.15.29:0/544212542 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8a94065ae0 msgr2=0x7f8a94067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.352+0000 7f8ac3400640 1 --2- 172.21.15.29:0/544212542 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8a94065ae0 0x7f8a94067fa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8abc159b20 tx=0x7f8aa4009040 comp rx=0 tx=0).stop 2024-01-24T13:04:20.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.352+0000 7f8ac3400640 1 -- 172.21.15.29:0/544212542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc069cd0 msgr2=0x7f8abc150630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.352+0000 7f8ac3400640 1 --2- 172.21.15.29:0/544212542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc069cd0 0x7f8abc150630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0ac040 tx=0x7f8aac01acb0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.356+0000 7f8ac3400640 1 -- 172.21.15.29:0/544212542 shutdown_connections 2024-01-24T13:04:20.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.356+0000 7f8ac3400640 1 --2- 172.21.15.29:0/544212542 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8a94065ae0 0x7f8a94067fa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.356+0000 7f8ac3400640 1 --2- 172.21.15.29:0/544212542 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8abc15c4a0 0x7f8abc15b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.356+0000 7f8ac3400640 1 --2- 172.21.15.29:0/544212542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8abc0ccb50 0x7f8abc15b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.356+0000 7f8ac3400640 1 --2- 172.21.15.29:0/544212542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc069cd0 0x7f8abc150630 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.356+0000 7f8ac3400640 1 -- 172.21.15.29:0/544212542 >> 172.21.15.29:0/544212542 conn(0x7f8abc0714a0 msgr2=0x7f8abc159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:20.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.356+0000 7f8ac3400640 1 -- 172.21.15.29:0/544212542 shutdown_connections 2024-01-24T13:04:20.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.356+0000 7f8ac3400640 1 -- 172.21.15.29:0/544212542 wait complete. 2024-01-24T13:04:20.377 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-24T13:04:20.377 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:04:20.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.516+0000 7fe4ab400640 1 Processor -- start 2024-01-24T13:04:20.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.516+0000 7fe4ab400640 1 -- start start 2024-01-24T13:04:20.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.516+0000 7fe4ab400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4a415d130 0x7fe4a415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.516+0000 7fe4ab400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe4a406ade0 0x7fe4a406b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.516+0000 7fe4ab400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a40d0bf0 con 0x7fe4a40ccdb0 2024-01-24T13:04:20.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.516+0000 7fe4ab400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a40cec60 con 0x7fe4a406ade0 2024-01-24T13:04:20.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.516+0000 7fe4ab400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a415de60 con 0x7fe4a415d130 2024-01-24T13:04:20.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.516+0000 7fe4a9400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe4a406ade0 0x7fe4a406b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.516+0000 7fe4a3e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4a415d130 0x7fe4a415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.516+0000 7fe4a9400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe4a406ade0 0x7fe4a406b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:55400/0 (socket says 172.21.15.29:55400) 2024-01-24T13:04:20.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.516+0000 7fe4a8a00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fe4a40ccdb0 0x7fe4a40cd190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:39342/0 (socket says 172.21.15.29:39342) 2024-01-24T13:04:20.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.516+0000 7fe4a9400640 1 -- 172.21.15.29:0/3050103766 learned_addr learned my addr 172.21.15.29:0/3050103766 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:20.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.520+0000 7fe4a3400640 1 -- 172.21.15.29:0/3050103766 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657218942 0 0) 0x7fe4a40d0bf0 con 0x7fe4a40ccdb0 2024-01-24T13:04:20.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.520+0000 7fe4a3e00640 1 -- 172.21.15.29:0/3050103766 >> v2:172.21.15.163:3300/0 conn(0x7fe4a406ade0 msgr2=0x7fe4a406b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:20.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.520+0000 7fe4a3e00640 1 --2- 172.21.15.29:0/3050103766 >> v2:172.21.15.163:3300/0 conn(0x7fe4a406ade0 0x7fe4a406b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.520+0000 7fe4a3e00640 1 -- 172.21.15.29:0/3050103766 >> v1:172.21.15.163:6789/0 conn(0x7fe4a40ccdb0 legacy=0x7fe4a40cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.520+0000 7fe4a3e00640 1 -- 172.21.15.29:0/3050103766 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a40d0040 con 0x7fe4a415d130 2024-01-24T13:04:20.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.520+0000 7fe4a3e00640 1 --2- 172.21.15.29:0/3050103766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4a415d130 0x7fe4a415d5b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0097c0 tx=0x7fe48c01c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efeecea98ecc41be server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:20.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4a3400640 1 -- 172.21.15.29:0/3050103766 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0ab600 con 0x7fe4a415d130 2024-01-24T13:04:20.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4a3400640 1 -- 172.21.15.29:0/3050103766 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c0a7050 con 0x7fe4a415d130 2024-01-24T13:04:20.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4a3400640 1 -- 172.21.15.29:0/3050103766 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0ab980 con 0x7fe4a415d130 2024-01-24T13:04:20.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 -- 172.21.15.29:0/3050103766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4a415d130 msgr2=0x7fe4a415d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 --2- 172.21.15.29:0/3050103766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4a415d130 0x7fe4a415d5b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0097c0 tx=0x7fe48c01c330 comp rx=0 tx=0).stop 2024-01-24T13:04:20.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 -- 172.21.15.29:0/3050103766 shutdown_connections 2024-01-24T13:04:20.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 --2- 172.21.15.29:0/3050103766 >> v2:172.21.15.163:3300/0 conn(0x7fe4a406ade0 0x7fe4a406b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 --2- 172.21.15.29:0/3050103766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4a415d130 0x7fe4a415d5b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 -- 172.21.15.29:0/3050103766 >> 172.21.15.29:0/3050103766 conn(0x7fe4a4070570 msgr2=0x7fe4a4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:20.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 -- 172.21.15.29:0/3050103766 shutdown_connections 2024-01-24T13:04:20.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 -- 172.21.15.29:0/3050103766 wait complete. 2024-01-24T13:04:20.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 Processor -- start 2024-01-24T13:04:20.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 -- start start 2024-01-24T13:04:20.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4a406ade0 0x7fe4a4150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4a40ccdb0 0x7fe4a4155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4a415d130 0x7fe4a4155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a414c760 con 0x7fe4a40ccdb0 2024-01-24T13:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a414c8f0 con 0x7fe4a406ade0 2024-01-24T13:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.524+0000 7fe4ab400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4152220 con 0x7fe4a415d130 2024-01-24T13:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a3e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4a40ccdb0 0x7fe4a4155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a3e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4a40ccdb0 0x7fe4a4155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35436/0 (socket says 172.21.15.29:35436) 2024-01-24T13:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a3e00640 1 -- 172.21.15.29:0/3772090426 learned_addr learned my addr 172.21.15.29:0/3772090426 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a9400640 1 --2- 172.21.15.29:0/3772090426 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4a415d130 0x7fe4a4155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a8a00640 1 --2- 172.21.15.29:0/3772090426 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4a406ade0 0x7fe4a4150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a3e00640 1 -- 172.21.15.29:0/3772090426 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4a415d130 msgr2=0x7fe4a4155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a3e00640 1 --2- 172.21.15.29:0/3772090426 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4a415d130 0x7fe4a4155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a3e00640 1 -- 172.21.15.29:0/3772090426 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4a406ade0 msgr2=0x7fe4a4150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a3e00640 1 --2- 172.21.15.29:0/3772090426 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4a406ade0 0x7fe4a4150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a3e00640 1 -- 172.21.15.29:0/3772090426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c009420 con 0x7fe4a40ccdb0 2024-01-24T13:04:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a3e00640 1 --2- 172.21.15.29:0/3772090426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4a40ccdb0 0x7fe4a4155500 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0097c0 tx=0x7fe48c0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a0c00640 1 -- 172.21.15.29:0/3772090426 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c004030 con 0x7fe4a40ccdb0 2024-01-24T13:04:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a0c00640 1 -- 172.21.15.29:0/3772090426 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c004190 con 0x7fe4a40ccdb0 2024-01-24T13:04:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a0c00640 1 -- 172.21.15.29:0/3772090426 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c004500 con 0x7fe4a40ccdb0 2024-01-24T13:04:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4ab400640 1 -- 172.21.15.29:0/3772090426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a4152500 con 0x7fe4a40ccdb0 2024-01-24T13:04:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4ab400640 1 -- 172.21.15.29:0/3772090426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a4152ac0 con 0x7fe4a40ccdb0 2024-01-24T13:04:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4ab400640 1 -- 172.21.15.29:0/3772090426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a414ca80 con 0x7fe4a40ccdb0 2024-01-24T13:04:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a0c00640 1 -- 172.21.15.29:0/3772090426 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe48c0b2050 con 0x7fe4a40ccdb0 2024-01-24T13:04:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.528+0000 7fe4a0c00640 1 --2- 172.21.15.29:0/3772090426 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe47c065a60 0x7fe47c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.532+0000 7fe4a0c00640 1 -- 172.21.15.29:0/3772090426 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe48c11d980 con 0x7fe4a40ccdb0 2024-01-24T13:04:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.532+0000 7fe4a8a00640 1 --2- 172.21.15.29:0/3772090426 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe47c065a60 0x7fe47c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.532+0000 7fe4a8a00640 1 --2- 172.21.15.29:0/3772090426 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe47c065a60 0x7fe47c067f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe494000f70 tx=0x7fe494007b60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:20.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.532+0000 7fe4a0c00640 1 -- 172.21.15.29:0/3772090426 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe48c0eafb0 con 0x7fe4a40ccdb0 2024-01-24T13:04:20.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.688+0000 7fe4ab400640 1 -- 172.21.15.29:0/3772090426 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4a4157220 con 0x7fe47c065a60 2024-01-24T13:04:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.700+0000 7fe4a0c00640 1 -- 172.21.15.29:0/3772090426 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345303 (secure 0 0 0) 0x7fe4940071f0 con 0x7fe47c065a60 2024-01-24T13:04:20.707 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:20.709 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:04:20.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.704+0000 7fe4ab400640 1 -- 172.21.15.29:0/3772090426 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe47c065a60 msgr2=0x7fe47c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.704+0000 7fe4ab400640 1 --2- 172.21.15.29:0/3772090426 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe47c065a60 0x7fe47c067f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe494000f70 tx=0x7fe494007b60 comp rx=0 tx=0).stop 2024-01-24T13:04:20.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.704+0000 7fe4ab400640 1 -- 172.21.15.29:0/3772090426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4a40ccdb0 msgr2=0x7fe4a4155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.704+0000 7fe4ab400640 1 --2- 172.21.15.29:0/3772090426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4a40ccdb0 0x7fe4a4155500 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0097c0 tx=0x7fe48c0190d0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.704+0000 7fe4ab400640 1 -- 172.21.15.29:0/3772090426 shutdown_connections 2024-01-24T13:04:20.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.704+0000 7fe4ab400640 1 --2- 172.21.15.29:0/3772090426 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe47c065a60 0x7fe47c067f20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.704+0000 7fe4ab400640 1 --2- 172.21.15.29:0/3772090426 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4a415d130 0x7fe4a4155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.704+0000 7fe4ab400640 1 --2- 172.21.15.29:0/3772090426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4a40ccdb0 0x7fe4a4155500 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.704+0000 7fe4ab400640 1 --2- 172.21.15.29:0/3772090426 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4a406ade0 0x7fe4a4150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.704+0000 7fe4ab400640 1 -- 172.21.15.29:0/3772090426 >> 172.21.15.29:0/3772090426 conn(0x7fe4a4070570 msgr2=0x7fe4a4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:20.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.704+0000 7fe4ab400640 1 -- 172.21.15.29:0/3772090426 shutdown_connections 2024-01-24T13:04:20.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.704+0000 7fe4ab400640 1 -- 172.21.15.29:0/3772090426 wait complete. 2024-01-24T13:04:20.727 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-01-24T13:04:19.541385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219700,"kb_used_data":3528,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755020,"statfs":{"total":773094113280,"available":772869140480,"internally_reserved":0,"allocated":3612672,"data_stored":2126578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003168"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020698+0000","last_change":"2024-01-24T13:03:55.606327+0000","last_active":"2024-01-24T13:04:00.020698+0000","last_peered":"2024-01-24T13:04:00.020698+0000","last_clean":"2024-01-24T13:04:00.020698+0000","last_became_active":"2024-01-24T13:03:55.606030+0000","last_became_peered":"2024-01-24T13:03:55.606030+0000","last_unstale":"2024-01-24T13:04:00.020698+0000","last_undegraded":"2024-01-24T13:04:00.020698+0000","last_fullsized":"2024-01-24T13:04:00.020698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:03:57.780901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017226+0000","last_change":"2024-01-24T13:03:56.018840+0000","last_active":"2024-01-24T13:04:01.017226+0000","last_peered":"2024-01-24T13:04:01.017226+0000","last_clean":"2024-01-24T13:04:01.017226+0000","last_became_active":"2024-01-24T13:03:56.018597+0000","last_became_peered":"2024-01-24T13:03:56.018597+0000","last_unstale":"2024-01-24T13:04:01.017226+0000","last_undegraded":"2024-01-24T13:04:01.017226+0000","last_fullsized":"2024-01-24T13:04:01.017226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:26:26.138489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806814+0000","last_change":"2024-01-24T13:04:00.044582+0000","last_active":"2024-01-24T13:04:01.806814+0000","last_peered":"2024-01-24T13:04:01.806814+0000","last_clean":"2024-01-24T13:04:01.806814+0000","last_became_active":"2024-01-24T13:04:00.044171+0000","last_became_peered":"2024-01-24T13:04:00.044171+0000","last_unstale":"2024-01-24T13:04:01.806814+0000","last_undegraded":"2024-01-24T13:04:01.806814+0000","last_fullsized":"2024-01-24T13:04:01.806814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:14:04.213076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017241+0000","last_change":"2024-01-24T13:03:55.596925+0000","last_active":"2024-01-24T13:04:01.017241+0000","last_peered":"2024-01-24T13:04:01.017241+0000","last_clean":"2024-01-24T13:04:01.017241+0000","last_became_active":"2024-01-24T13:03:55.596539+0000","last_became_peered":"2024-01-24T13:03:55.596539+0000","last_unstale":"2024-01-24T13:04:01.017241+0000","last_undegraded":"2024-01-24T13:04:01.017241+0000","last_fullsized":"2024-01-24T13:04:01.017241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:18.551398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017244+0000","last_change":"2024-01-24T13:03:56.010228+0000","last_active":"2024-01-24T13:04:01.017244+0000","last_peered":"2024-01-24T13:04:01.017244+0000","last_clean":"2024-01-24T13:04:01.017244+0000","last_became_active":"2024-01-24T13:03:56.009920+0000","last_became_peered":"2024-01-24T13:03:56.009920+0000","last_unstale":"2024-01-24T13:04:01.017244+0000","last_undegraded":"2024-01-24T13:04:01.017244+0000","last_fullsized":"2024-01-24T13:04:01.017244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:33:22.274202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805044+0000","last_change":"2024-01-24T13:04:00.036039+0000","last_active":"2024-01-24T13:04:01.805044+0000","last_peered":"2024-01-24T13:04:01.805044+0000","last_clean":"2024-01-24T13:04:01.805044+0000","last_became_active":"2024-01-24T13:04:00.035441+0000","last_became_peered":"2024-01-24T13:04:00.035441+0000","last_unstale":"2024-01-24T13:04:01.805044+0000","last_undegraded":"2024-01-24T13:04:01.805044+0000","last_fullsized":"2024-01-24T13:04:01.805044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:18:37.828066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.031062+0000","last_change":"2024-01-24T13:03:55.601607+0000","last_active":"2024-01-24T13:04:00.031062+0000","last_peered":"2024-01-24T13:04:00.031062+0000","last_clean":"2024-01-24T13:04:00.031062+0000","last_became_active":"2024-01-24T13:03:55.601320+0000","last_became_peered":"2024-01-24T13:03:55.601320+0000","last_unstale":"2024-01-24T13:04:00.031062+0000","last_undegraded":"2024-01-24T13:04:00.031062+0000","last_fullsized":"2024-01-24T13:04:00.031062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:12.091224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021279+0000","last_change":"2024-01-24T13:03:56.022848+0000","last_active":"2024-01-24T13:04:00.021279+0000","last_peered":"2024-01-24T13:04:00.021279+0000","last_clean":"2024-01-24T13:04:00.021279+0000","last_became_active":"2024-01-24T13:03:56.022529+0000","last_became_peered":"2024-01-24T13:03:56.022529+0000","last_unstale":"2024-01-24T13:04:00.021279+0000","last_undegraded":"2024-01-24T13:04:00.021279+0000","last_fullsized":"2024-01-24T13:04:00.021279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:02.421483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806130+0000","last_change":"2024-01-24T13:04:00.052590+0000","last_active":"2024-01-24T13:04:01.806130+0000","last_peered":"2024-01-24T13:04:01.806130+0000","last_clean":"2024-01-24T13:04:01.806130+0000","last_became_active":"2024-01-24T13:04:00.052118+0000","last_became_peered":"2024-01-24T13:04:00.052118+0000","last_unstale":"2024-01-24T13:04:01.806130+0000","last_undegraded":"2024-01-24T13:04:01.806130+0000","last_fullsized":"2024-01-24T13:04:01.806130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:50:50.867503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.026082+0000","last_change":"2024-01-24T13:03:55.605745+0000","last_active":"2024-01-24T13:04:00.026082+0000","last_peered":"2024-01-24T13:04:00.026082+0000","last_clean":"2024-01-24T13:04:00.026082+0000","last_became_active":"2024-01-24T13:03:55.605321+0000","last_became_peered":"2024-01-24T13:03:55.605321+0000","last_unstale":"2024-01-24T13:04:00.026082+0000","last_undegraded":"2024-01-24T13:04:00.026082+0000","last_fullsized":"2024-01-24T13:04:00.026082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:01.413713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013678+0000","last_change":"2024-01-24T13:03:56.024669+0000","last_active":"2024-01-24T13:04:00.013678+0000","last_peered":"2024-01-24T13:04:00.013678+0000","last_clean":"2024-01-24T13:04:00.013678+0000","last_became_active":"2024-01-24T13:03:56.024411+0000","last_became_peered":"2024-01-24T13:03:56.024411+0000","last_unstale":"2024-01-24T13:04:00.013678+0000","last_undegraded":"2024-01-24T13:04:00.013678+0000","last_fullsized":"2024-01-24T13:04:00.013678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:26:46.456477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805258+0000","last_change":"2024-01-24T13:04:00.051526+0000","last_active":"2024-01-24T13:04:01.805258+0000","last_peered":"2024-01-24T13:04:01.805258+0000","last_clean":"2024-01-24T13:04:01.805258+0000","last_became_active":"2024-01-24T13:04:00.046616+0000","last_became_peered":"2024-01-24T13:04:00.046616+0000","last_unstale":"2024-01-24T13:04:01.805258+0000","last_undegraded":"2024-01-24T13:04:01.805258+0000","last_fullsized":"2024-01-24T13:04:01.805258+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:04.738538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011521+0000","last_change":"2024-01-24T13:03:56.015309+0000","last_active":"2024-01-24T13:04:00.011521+0000","last_peered":"2024-01-24T13:04:00.011521+0000","last_clean":"2024-01-24T13:04:00.011521+0000","last_became_active":"2024-01-24T13:03:56.015046+0000","last_became_peered":"2024-01-24T13:03:56.015046+0000","last_unstale":"2024-01-24T13:04:00.011521+0000","last_undegraded":"2024-01-24T13:04:00.011521+0000","last_fullsized":"2024-01-24T13:04:00.011521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:25:17.038527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011674+0000","last_change":"2024-01-24T13:03:55.597378+0000","last_active":"2024-01-24T13:04:00.011674+0000","last_peered":"2024-01-24T13:04:00.011674+0000","last_clean":"2024-01-24T13:04:00.011674+0000","last_became_active":"2024-01-24T13:03:55.597128+0000","last_became_peered":"2024-01-24T13:03:55.597128+0000","last_unstale":"2024-01-24T13:04:00.011674+0000","last_undegraded":"2024-01-24T13:04:00.011674+0000","last_fullsized":"2024-01-24T13:04:00.011674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:41:52.439330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806109+0000","last_change":"2024-01-24T13:04:00.049793+0000","last_active":"2024-01-24T13:04:01.806109+0000","last_peered":"2024-01-24T13:04:01.806109+0000","last_clean":"2024-01-24T13:04:01.806109+0000","last_became_active":"2024-01-24T13:04:00.049395+0000","last_became_peered":"2024-01-24T13:04:00.049395+0000","last_unstale":"2024-01-24T13:04:01.806109+0000","last_undegraded":"2024-01-24T13:04:01.806109+0000","last_fullsized":"2024-01-24T13:04:01.806109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:31:27.768822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016628+0000","last_change":"2024-01-24T13:03:56.015127+0000","last_active":"2024-01-24T13:04:01.016628+0000","last_peered":"2024-01-24T13:04:01.016628+0000","last_clean":"2024-01-24T13:04:01.016628+0000","last_became_active":"2024-01-24T13:03:56.014713+0000","last_became_peered":"2024-01-24T13:03:56.014713+0000","last_unstale":"2024-01-24T13:04:01.016628+0000","last_undegraded":"2024-01-24T13:04:01.016628+0000","last_fullsized":"2024-01-24T13:04:01.016628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:13.098994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017134+0000","last_change":"2024-01-24T13:03:55.601999+0000","last_active":"2024-01-24T13:04:00.017134+0000","last_peered":"2024-01-24T13:04:00.017134+0000","last_clean":"2024-01-24T13:04:00.017134+0000","last_became_active":"2024-01-24T13:03:55.601673+0000","last_became_peered":"2024-01-24T13:03:55.601673+0000","last_unstale":"2024-01-24T13:04:00.017134+0000","last_undegraded":"2024-01-24T13:04:00.017134+0000","last_fullsized":"2024-01-24T13:04:00.017134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:45:36.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.146739+0000","last_change":"2024-01-24T13:04:00.044536+0000","last_active":"2024-01-24T13:04:01.146739+0000","last_peered":"2024-01-24T13:04:01.146739+0000","last_clean":"2024-01-24T13:04:01.146739+0000","last_became_active":"2024-01-24T13:04:00.044138+0000","last_became_peered":"2024-01-24T13:04:00.044138+0000","last_unstale":"2024-01-24T13:04:01.146739+0000","last_undegraded":"2024-01-24T13:04:01.146739+0000","last_fullsized":"2024-01-24T13:04:01.146739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017399+0000","last_change":"2024-01-24T13:03:56.012647+0000","last_active":"2024-01-24T13:04:00.017399+0000","last_peered":"2024-01-24T13:04:00.017399+0000","last_clean":"2024-01-24T13:04:00.017399+0000","last_became_active":"2024-01-24T13:03:56.012253+0000","last_became_peered":"2024-01-24T13:03:56.012253+0000","last_unstale":"2024-01-24T13:04:00.017399+0000","last_undegraded":"2024-01-24T13:04:00.017399+0000","last_fullsized":"2024-01-24T13:04:00.017399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:24:10.805392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019610+0000","last_change":"2024-01-24T13:03:55.607929+0000","last_active":"2024-01-24T13:04:00.019610+0000","last_peered":"2024-01-24T13:04:00.019610+0000","last_clean":"2024-01-24T13:04:00.019610+0000","last_became_active":"2024-01-24T13:03:55.607579+0000","last_became_peered":"2024-01-24T13:03:55.607579+0000","last_unstale":"2024-01-24T13:04:00.019610+0000","last_undegraded":"2024-01-24T13:04:00.019610+0000","last_fullsized":"2024-01-24T13:04:00.019610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:47:45.731340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806758+0000","last_change":"2024-01-24T13:04:00.042942+0000","last_active":"2024-01-24T13:04:01.806758+0000","last_peered":"2024-01-24T13:04:01.806758+0000","last_clean":"2024-01-24T13:04:01.806758+0000","last_became_active":"2024-01-24T13:04:00.042539+0000","last_became_peered":"2024-01-24T13:04:00.042539+0000","last_unstale":"2024-01-24T13:04:01.806758+0000","last_undegraded":"2024-01-24T13:04:01.806758+0000","last_fullsized":"2024-01-24T13:04:01.806758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:44:50.908587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011397+0000","last_change":"2024-01-24T13:03:56.012053+0000","last_active":"2024-01-24T13:04:00.011397+0000","last_peered":"2024-01-24T13:04:00.011397+0000","last_clean":"2024-01-24T13:04:00.011397+0000","last_became_active":"2024-01-24T13:03:56.011812+0000","last_became_peered":"2024-01-24T13:03:56.011812+0000","last_unstale":"2024-01-24T13:04:00.011397+0000","last_undegraded":"2024-01-24T13:04:00.011397+0000","last_fullsized":"2024-01-24T13:04:00.011397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:32.185320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021271+0000","last_change":"2024-01-24T13:03:55.595674+0000","last_active":"2024-01-24T13:04:00.021271+0000","last_peered":"2024-01-24T13:04:00.021271+0000","last_clean":"2024-01-24T13:04:00.021271+0000","last_became_active":"2024-01-24T13:03:55.594833+0000","last_became_peered":"2024-01-24T13:03:55.594833+0000","last_unstale":"2024-01-24T13:04:00.021271+0000","last_undegraded":"2024-01-24T13:04:00.021271+0000","last_fullsized":"2024-01-24T13:04:00.021271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:54:35.340555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806952+0000","last_change":"2024-01-24T13:04:00.042902+0000","last_active":"2024-01-24T13:04:01.806952+0000","last_peered":"2024-01-24T13:04:01.806952+0000","last_clean":"2024-01-24T13:04:01.806952+0000","last_became_active":"2024-01-24T13:04:00.042120+0000","last_became_peered":"2024-01-24T13:04:00.042120+0000","last_unstale":"2024-01-24T13:04:01.806952+0000","last_undegraded":"2024-01-24T13:04:01.806952+0000","last_fullsized":"2024-01-24T13:04:01.806952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:48:26.063259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020230+0000","last_change":"2024-01-24T13:03:56.012262+0000","last_active":"2024-01-24T13:04:00.020230+0000","last_peered":"2024-01-24T13:04:00.020230+0000","last_clean":"2024-01-24T13:04:00.020230+0000","last_became_active":"2024-01-24T13:03:56.011966+0000","last_became_peered":"2024-01-24T13:03:56.011966+0000","last_unstale":"2024-01-24T13:04:00.020230+0000","last_undegraded":"2024-01-24T13:04:00.020230+0000","last_fullsized":"2024-01-24T13:04:00.020230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:17:34.235081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.012933+0000","last_change":"2024-01-24T13:03:55.607257+0000","last_active":"2024-01-24T13:04:00.012933+0000","last_peered":"2024-01-24T13:04:00.012933+0000","last_clean":"2024-01-24T13:04:00.012933+0000","last_became_active":"2024-01-24T13:03:55.606021+0000","last_became_peered":"2024-01-24T13:03:55.606021+0000","last_unstale":"2024-01-24T13:04:00.012933+0000","last_undegraded":"2024-01-24T13:04:00.012933+0000","last_fullsized":"2024-01-24T13:04:00.012933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:45:36.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805293+0000","last_change":"2024-01-24T13:04:00.038690+0000","last_active":"2024-01-24T13:04:01.805293+0000","last_peered":"2024-01-24T13:04:01.805293+0000","last_clean":"2024-01-24T13:04:01.805293+0000","last_became_active":"2024-01-24T13:04:00.033603+0000","last_became_peered":"2024-01-24T13:04:00.033603+0000","last_unstale":"2024-01-24T13:04:01.805293+0000","last_undegraded":"2024-01-24T13:04:01.805293+0000","last_fullsized":"2024-01-24T13:04:01.805293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020685+0000","last_change":"2024-01-24T13:03:56.019251+0000","last_active":"2024-01-24T13:04:00.020685+0000","last_peered":"2024-01-24T13:04:00.020685+0000","last_clean":"2024-01-24T13:04:00.020685+0000","last_became_active":"2024-01-24T13:03:56.016877+0000","last_became_peered":"2024-01-24T13:03:56.016877+0000","last_unstale":"2024-01-24T13:04:00.020685+0000","last_undegraded":"2024-01-24T13:04:00.020685+0000","last_fullsized":"2024-01-24T13:04:00.020685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:02.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020421+0000","last_change":"2024-01-24T13:03:55.607924+0000","last_active":"2024-01-24T13:04:00.020421+0000","last_peered":"2024-01-24T13:04:00.020421+0000","last_clean":"2024-01-24T13:04:00.020421+0000","last_became_active":"2024-01-24T13:03:55.607591+0000","last_became_peered":"2024-01-24T13:03:55.607591+0000","last_unstale":"2024-01-24T13:04:00.020421+0000","last_undegraded":"2024-01-24T13:04:00.020421+0000","last_fullsized":"2024-01-24T13:04:00.020421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:13.842299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149029+0000","last_change":"2024-01-24T13:04:00.035477+0000","last_active":"2024-01-24T13:04:01.149029+0000","last_peered":"2024-01-24T13:04:01.149029+0000","last_clean":"2024-01-24T13:04:01.149029+0000","last_became_active":"2024-01-24T13:04:00.034981+0000","last_became_peered":"2024-01-24T13:04:00.034981+0000","last_unstale":"2024-01-24T13:04:01.149029+0000","last_undegraded":"2024-01-24T13:04:01.149029+0000","last_fullsized":"2024-01-24T13:04:01.149029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:04.738538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018375+0000","last_change":"2024-01-24T13:03:56.017993+0000","last_active":"2024-01-24T13:04:00.018375+0000","last_peered":"2024-01-24T13:04:00.018375+0000","last_clean":"2024-01-24T13:04:00.018375+0000","last_became_active":"2024-01-24T13:03:56.017682+0000","last_became_peered":"2024-01-24T13:03:56.017682+0000","last_unstale":"2024-01-24T13:04:00.018375+0000","last_undegraded":"2024-01-24T13:04:00.018375+0000","last_fullsized":"2024-01-24T13:04:00.018375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:46:24.457447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013622+0000","last_change":"2024-01-24T13:03:55.601678+0000","last_active":"2024-01-24T13:04:00.013622+0000","last_peered":"2024-01-24T13:04:00.013622+0000","last_clean":"2024-01-24T13:04:00.013622+0000","last_became_active":"2024-01-24T13:03:55.599824+0000","last_became_peered":"2024-01-24T13:03:55.599824+0000","last_unstale":"2024-01-24T13:04:00.013622+0000","last_undegraded":"2024-01-24T13:04:00.013622+0000","last_fullsized":"2024-01-24T13:04:00.013622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:01.413713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806924+0000","last_change":"2024-01-24T13:04:00.044489+0000","last_active":"2024-01-24T13:04:01.806924+0000","last_peered":"2024-01-24T13:04:01.806924+0000","last_clean":"2024-01-24T13:04:01.806924+0000","last_became_active":"2024-01-24T13:04:00.044090+0000","last_became_peered":"2024-01-24T13:04:00.044090+0000","last_unstale":"2024-01-24T13:04:01.806924+0000","last_undegraded":"2024-01-24T13:04:01.806924+0000","last_fullsized":"2024-01-24T13:04:01.806924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013877+0000","last_change":"2024-01-24T13:03:56.012608+0000","last_active":"2024-01-24T13:04:01.013877+0000","last_peered":"2024-01-24T13:04:01.013877+0000","last_clean":"2024-01-24T13:04:01.013877+0000","last_became_active":"2024-01-24T13:03:56.012369+0000","last_became_peered":"2024-01-24T13:03:56.012369+0000","last_unstale":"2024-01-24T13:04:01.013877+0000","last_undegraded":"2024-01-24T13:04:01.013877+0000","last_fullsized":"2024-01-24T13:04:01.013877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:02.421483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016565+0000","last_change":"2024-01-24T13:03:55.595049+0000","last_active":"2024-01-24T13:04:01.016565+0000","last_peered":"2024-01-24T13:04:01.016565+0000","last_clean":"2024-01-24T13:04:01.016565+0000","last_became_active":"2024-01-24T13:03:55.594748+0000","last_became_peered":"2024-01-24T13:03:55.594748+0000","last_unstale":"2024-01-24T13:04:01.016565+0000","last_undegraded":"2024-01-24T13:04:01.016565+0000","last_fullsized":"2024-01-24T13:04:01.016565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:54:02.325596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.807443+0000","last_change":"2024-01-24T13:04:00.052891+0000","last_active":"2024-01-24T13:04:01.807443+0000","last_peered":"2024-01-24T13:04:01.807443+0000","last_clean":"2024-01-24T13:04:01.807443+0000","last_became_active":"2024-01-24T13:04:00.051617+0000","last_became_peered":"2024-01-24T13:04:00.051617+0000","last_unstale":"2024-01-24T13:04:01.807443+0000","last_undegraded":"2024-01-24T13:04:01.807443+0000","last_fullsized":"2024-01-24T13:04:01.807443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:35.624217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.022993+0000","last_change":"2024-01-24T13:03:56.009995+0000","last_active":"2024-01-24T13:04:00.022993+0000","last_peered":"2024-01-24T13:04:00.022993+0000","last_clean":"2024-01-24T13:04:00.022993+0000","last_became_active":"2024-01-24T13:03:56.009662+0000","last_became_peered":"2024-01-24T13:03:56.009662+0000","last_unstale":"2024-01-24T13:04:00.022993+0000","last_undegraded":"2024-01-24T13:04:00.022993+0000","last_fullsized":"2024-01-24T13:04:00.022993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:28.956711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011686+0000","last_change":"2024-01-24T13:03:55.595933+0000","last_active":"2024-01-24T13:04:00.011686+0000","last_peered":"2024-01-24T13:04:00.011686+0000","last_clean":"2024-01-24T13:04:00.011686+0000","last_became_active":"2024-01-24T13:03:55.594957+0000","last_became_peered":"2024-01-24T13:03:55.594957+0000","last_unstale":"2024-01-24T13:04:00.011686+0000","last_undegraded":"2024-01-24T13:04:00.011686+0000","last_fullsized":"2024-01-24T13:04:00.011686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:12.091224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.808365+0000","last_change":"2024-01-24T13:04:00.045610+0000","last_active":"2024-01-24T13:04:01.808365+0000","last_peered":"2024-01-24T13:04:01.808365+0000","last_clean":"2024-01-24T13:04:01.808365+0000","last_became_active":"2024-01-24T13:04:00.044937+0000","last_became_peered":"2024-01-24T13:04:00.044937+0000","last_unstale":"2024-01-24T13:04:01.808365+0000","last_undegraded":"2024-01-24T13:04:01.808365+0000","last_fullsized":"2024-01-24T13:04:01.808365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T01:02:53.163148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015631+0000","last_change":"2024-01-24T13:03:56.016991+0000","last_active":"2024-01-24T13:04:01.015631+0000","last_peered":"2024-01-24T13:04:01.015631+0000","last_clean":"2024-01-24T13:04:01.015631+0000","last_became_active":"2024-01-24T13:03:56.016720+0000","last_became_peered":"2024-01-24T13:03:56.016720+0000","last_unstale":"2024-01-24T13:04:01.015631+0000","last_undegraded":"2024-01-24T13:04:01.015631+0000","last_fullsized":"2024-01-24T13:04:01.015631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:33:24.896330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016383+0000","last_change":"2024-01-24T13:03:55.598471+0000","last_active":"2024-01-24T13:04:01.016383+0000","last_peered":"2024-01-24T13:04:01.016383+0000","last_clean":"2024-01-24T13:04:01.016383+0000","last_became_active":"2024-01-24T13:03:55.598159+0000","last_became_peered":"2024-01-24T13:03:55.598159+0000","last_unstale":"2024-01-24T13:04:01.016383+0000","last_undegraded":"2024-01-24T13:04:01.016383+0000","last_fullsized":"2024-01-24T13:04:01.016383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:40:38.850663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806777+0000","last_change":"2024-01-24T13:04:00.040424+0000","last_active":"2024-01-24T13:04:01.806777+0000","last_peered":"2024-01-24T13:04:01.806777+0000","last_clean":"2024-01-24T13:04:01.806777+0000","last_became_active":"2024-01-24T13:04:00.038744+0000","last_became_peered":"2024-01-24T13:04:00.038744+0000","last_unstale":"2024-01-24T13:04:01.806777+0000","last_undegraded":"2024-01-24T13:04:01.806777+0000","last_fullsized":"2024-01-24T13:04:01.806777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:48:26.063259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018273+0000","last_change":"2024-01-24T13:03:56.014411+0000","last_active":"2024-01-24T13:04:00.018273+0000","last_peered":"2024-01-24T13:04:00.018273+0000","last_clean":"2024-01-24T13:04:00.018273+0000","last_became_active":"2024-01-24T13:03:56.014076+0000","last_became_peered":"2024-01-24T13:03:56.014076+0000","last_unstale":"2024-01-24T13:04:00.018273+0000","last_undegraded":"2024-01-24T13:04:00.018273+0000","last_fullsized":"2024-01-24T13:04:00.018273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:13.098994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011676+0000","last_change":"2024-01-24T13:03:55.603197+0000","last_active":"2024-01-24T13:04:00.011676+0000","last_peered":"2024-01-24T13:04:00.011676+0000","last_clean":"2024-01-24T13:04:00.011676+0000","last_became_active":"2024-01-24T13:03:55.600175+0000","last_became_peered":"2024-01-24T13:03:55.600175+0000","last_unstale":"2024-01-24T13:04:00.011676+0000","last_undegraded":"2024-01-24T13:04:00.011676+0000","last_fullsized":"2024-01-24T13:04:00.011676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:30:38.906451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016791+0000","last_change":"2024-01-24T13:04:00.049384+0000","last_active":"2024-01-24T13:04:01.016791+0000","last_peered":"2024-01-24T13:04:01.016791+0000","last_clean":"2024-01-24T13:04:01.016791+0000","last_became_active":"2024-01-24T13:04:00.048632+0000","last_became_peered":"2024-01-24T13:04:00.048632+0000","last_unstale":"2024-01-24T13:04:01.016791+0000","last_undegraded":"2024-01-24T13:04:01.016791+0000","last_fullsized":"2024-01-24T13:04:01.016791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:06:53.027528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019637+0000","last_change":"2024-01-24T13:03:56.018433+0000","last_active":"2024-01-24T13:04:00.019637+0000","last_peered":"2024-01-24T13:04:00.019637+0000","last_clean":"2024-01-24T13:04:00.019637+0000","last_became_active":"2024-01-24T13:03:56.018164+0000","last_became_peered":"2024-01-24T13:03:56.018164+0000","last_unstale":"2024-01-24T13:04:00.019637+0000","last_undegraded":"2024-01-24T13:04:00.019637+0000","last_fullsized":"2024-01-24T13:04:00.019637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:26:27.582337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011717+0000","last_change":"2024-01-24T13:03:55.597798+0000","last_active":"2024-01-24T13:04:00.011717+0000","last_peered":"2024-01-24T13:04:00.011717+0000","last_clean":"2024-01-24T13:04:00.011717+0000","last_became_active":"2024-01-24T13:03:55.597513+0000","last_became_peered":"2024-01-24T13:03:55.597513+0000","last_unstale":"2024-01-24T13:04:00.011717+0000","last_undegraded":"2024-01-24T13:04:00.011717+0000","last_fullsized":"2024-01-24T13:04:00.011717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:18:51.734678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.023086+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:04:00.023086+0000","last_peered":"2024-01-24T13:04:00.023086+0000","last_clean":"2024-01-24T13:04:00.023086+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:04:00.023086+0000","last_undegraded":"2024-01-24T13:04:00.023086+0000","last_fullsized":"2024-01-24T13:04:00.023086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806680+0000","last_change":"2024-01-24T13:04:00.038740+0000","last_active":"2024-01-24T13:04:01.806680+0000","last_peered":"2024-01-24T13:04:01.806680+0000","last_clean":"2024-01-24T13:04:01.806680+0000","last_became_active":"2024-01-24T13:04:00.038231+0000","last_became_peered":"2024-01-24T13:04:00.038231+0000","last_unstale":"2024-01-24T13:04:01.806680+0000","last_undegraded":"2024-01-24T13:04:01.806680+0000","last_fullsized":"2024-01-24T13:04:01.806680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:08:54.372154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.012909+0000","last_change":"2024-01-24T13:03:56.016055+0000","last_active":"2024-01-24T13:04:00.012909+0000","last_peered":"2024-01-24T13:04:00.012909+0000","last_clean":"2024-01-24T13:04:00.012909+0000","last_became_active":"2024-01-24T13:03:56.015784+0000","last_became_peered":"2024-01-24T13:03:56.015784+0000","last_unstale":"2024-01-24T13:04:00.012909+0000","last_undegraded":"2024-01-24T13:04:00.012909+0000","last_fullsized":"2024-01-24T13:04:00.012909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:37:02.929160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018991+0000","last_change":"2024-01-24T13:03:55.608578+0000","last_active":"2024-01-24T13:04:00.018991+0000","last_peered":"2024-01-24T13:04:00.018991+0000","last_clean":"2024-01-24T13:04:00.018991+0000","last_became_active":"2024-01-24T13:03:55.608223+0000","last_became_peered":"2024-01-24T13:03:55.608223+0000","last_unstale":"2024-01-24T13:04:00.018991+0000","last_undegraded":"2024-01-24T13:04:00.018991+0000","last_fullsized":"2024-01-24T13:04:00.018991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:40:38.850663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805871+0000","last_change":"2024-01-24T13:04:00.036185+0000","last_active":"2024-01-24T13:04:01.805871+0000","last_peered":"2024-01-24T13:04:01.805871+0000","last_clean":"2024-01-24T13:04:01.805871+0000","last_became_active":"2024-01-24T13:04:00.035683+0000","last_became_peered":"2024-01-24T13:04:00.035683+0000","last_unstale":"2024-01-24T13:04:01.805871+0000","last_undegraded":"2024-01-24T13:04:01.805871+0000","last_fullsized":"2024-01-24T13:04:01.805871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:35.010431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.025989+0000","last_change":"2024-01-24T13:03:56.010590+0000","last_active":"2024-01-24T13:04:00.025989+0000","last_peered":"2024-01-24T13:04:00.025989+0000","last_clean":"2024-01-24T13:04:00.025989+0000","last_became_active":"2024-01-24T13:03:56.010337+0000","last_became_peered":"2024-01-24T13:03:56.010337+0000","last_unstale":"2024-01-24T13:04:00.025989+0000","last_undegraded":"2024-01-24T13:04:00.025989+0000","last_fullsized":"2024-01-24T13:04:00.025989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:33:30.023414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016888+0000","last_change":"2024-01-24T13:03:55.598738+0000","last_active":"2024-01-24T13:04:01.016888+0000","last_peered":"2024-01-24T13:04:01.016888+0000","last_clean":"2024-01-24T13:04:01.016888+0000","last_became_active":"2024-01-24T13:03:55.598468+0000","last_became_peered":"2024-01-24T13:03:55.598468+0000","last_unstale":"2024-01-24T13:04:01.016888+0000","last_undegraded":"2024-01-24T13:04:01.016888+0000","last_fullsized":"2024-01-24T13:04:01.016888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:33:00.188281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016100+0000","last_change":"2024-01-24T13:04:00.047084+0000","last_active":"2024-01-24T13:04:01.016100+0000","last_peered":"2024-01-24T13:04:01.016100+0000","last_clean":"2024-01-24T13:04:01.016100+0000","last_became_active":"2024-01-24T13:04:00.046694+0000","last_became_peered":"2024-01-24T13:04:00.046694+0000","last_unstale":"2024-01-24T13:04:01.016100+0000","last_undegraded":"2024-01-24T13:04:01.016100+0000","last_fullsized":"2024-01-24T13:04:01.016100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:11:37.105076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.028935+0000","last_change":"2024-01-24T13:03:56.011152+0000","last_active":"2024-01-24T13:04:00.028935+0000","last_peered":"2024-01-24T13:04:00.028935+0000","last_clean":"2024-01-24T13:04:00.028935+0000","last_became_active":"2024-01-24T13:03:56.010924+0000","last_became_peered":"2024-01-24T13:03:56.010924+0000","last_unstale":"2024-01-24T13:04:00.028935+0000","last_undegraded":"2024-01-24T13:04:00.028935+0000","last_fullsized":"2024-01-24T13:04:00.028935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:14:00.774178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020323+0000","last_change":"2024-01-24T13:03:55.602406+0000","last_active":"2024-01-24T13:04:00.020323+0000","last_peered":"2024-01-24T13:04:00.020323+0000","last_clean":"2024-01-24T13:04:00.020323+0000","last_became_active":"2024-01-24T13:03:55.601915+0000","last_became_peered":"2024-01-24T13:03:55.601915+0000","last_unstale":"2024-01-24T13:04:00.020323+0000","last_undegraded":"2024-01-24T13:04:00.020323+0000","last_fullsized":"2024-01-24T13:04:00.020323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:02:25.134363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805322+0000","last_change":"2024-01-24T13:04:00.028655+0000","last_active":"2024-01-24T13:04:01.805322+0000","last_peered":"2024-01-24T13:04:01.805322+0000","last_clean":"2024-01-24T13:04:01.805322+0000","last_became_active":"2024-01-24T13:04:00.028105+0000","last_became_peered":"2024-01-24T13:04:00.028105+0000","last_unstale":"2024-01-24T13:04:01.805322+0000","last_undegraded":"2024-01-24T13:04:01.805322+0000","last_fullsized":"2024-01-24T13:04:01.805322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:54:22.271694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013786+0000","last_change":"2024-01-24T13:03:56.002044+0000","last_active":"2024-01-24T13:04:01.013786+0000","last_peered":"2024-01-24T13:04:01.013786+0000","last_clean":"2024-01-24T13:04:01.013786+0000","last_became_active":"2024-01-24T13:03:56.001772+0000","last_became_peered":"2024-01-24T13:03:56.001772+0000","last_unstale":"2024-01-24T13:04:01.013786+0000","last_undegraded":"2024-01-24T13:04:01.013786+0000","last_fullsized":"2024-01-24T13:04:01.013786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:54:36.348326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.029043+0000","last_change":"2024-01-24T13:03:55.601600+0000","last_active":"2024-01-24T13:04:00.029043+0000","last_peered":"2024-01-24T13:04:00.029043+0000","last_clean":"2024-01-24T13:04:00.029043+0000","last_became_active":"2024-01-24T13:03:55.601309+0000","last_became_peered":"2024-01-24T13:03:55.601309+0000","last_unstale":"2024-01-24T13:04:00.029043+0000","last_undegraded":"2024-01-24T13:04:00.029043+0000","last_fullsized":"2024-01-24T13:04:00.029043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:39.217211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.652527+0000","last_change":"2024-01-24T13:04:00.048932+0000","last_active":"2024-01-24T13:04:01.652527+0000","last_peered":"2024-01-24T13:04:01.652527+0000","last_clean":"2024-01-24T13:04:01.652527+0000","last_became_active":"2024-01-24T13:04:00.048532+0000","last_became_peered":"2024-01-24T13:04:00.048532+0000","last_unstale":"2024-01-24T13:04:01.652527+0000","last_undegraded":"2024-01-24T13:04:01.652527+0000","last_fullsized":"2024-01-24T13:04:01.652527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:46:41.343291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011316+0000","last_change":"2024-01-24T13:03:56.014290+0000","last_active":"2024-01-24T13:04:00.011316+0000","last_peered":"2024-01-24T13:04:00.011316+0000","last_clean":"2024-01-24T13:04:00.011316+0000","last_became_active":"2024-01-24T13:03:56.014029+0000","last_became_peered":"2024-01-24T13:03:56.014029+0000","last_unstale":"2024-01-24T13:04:00.011316+0000","last_undegraded":"2024-01-24T13:04:00.011316+0000","last_fullsized":"2024-01-24T13:04:00.011316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:09:08.217574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017500+0000","last_change":"2024-01-24T13:03:55.600217+0000","last_active":"2024-01-24T13:04:00.017500+0000","last_peered":"2024-01-24T13:04:00.017500+0000","last_clean":"2024-01-24T13:04:00.017500+0000","last_became_active":"2024-01-24T13:03:55.599923+0000","last_became_peered":"2024-01-24T13:03:55.599923+0000","last_unstale":"2024-01-24T13:04:00.017500+0000","last_undegraded":"2024-01-24T13:04:00.017500+0000","last_fullsized":"2024-01-24T13:04:00.017500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:23:39.711167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017117+0000","last_change":"2024-01-24T13:04:00.049088+0000","last_active":"2024-01-24T13:04:01.017117+0000","last_peered":"2024-01-24T13:04:01.017117+0000","last_clean":"2024-01-24T13:04:01.017117+0000","last_became_active":"2024-01-24T13:04:00.048038+0000","last_became_peered":"2024-01-24T13:04:00.048038+0000","last_unstale":"2024-01-24T13:04:01.017117+0000","last_undegraded":"2024-01-24T13:04:01.017117+0000","last_fullsized":"2024-01-24T13:04:01.017117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:25:56.475987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021646+0000","last_change":"2024-01-24T13:03:56.025258+0000","last_active":"2024-01-24T13:04:00.021646+0000","last_peered":"2024-01-24T13:04:00.021646+0000","last_clean":"2024-01-24T13:04:00.021646+0000","last_became_active":"2024-01-24T13:03:56.025008+0000","last_became_peered":"2024-01-24T13:03:56.025008+0000","last_unstale":"2024-01-24T13:04:00.021646+0000","last_undegraded":"2024-01-24T13:04:00.021646+0000","last_fullsized":"2024-01-24T13:04:00.021646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:13.098994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021114+0000","last_change":"2024-01-24T13:03:55.606138+0000","last_active":"2024-01-24T13:04:00.021114+0000","last_peered":"2024-01-24T13:04:00.021114+0000","last_clean":"2024-01-24T13:04:00.021114+0000","last_became_active":"2024-01-24T13:03:55.605730+0000","last_became_peered":"2024-01-24T13:03:55.605730+0000","last_unstale":"2024-01-24T13:04:00.021114+0000","last_undegraded":"2024-01-24T13:04:00.021114+0000","last_fullsized":"2024-01-24T13:04:00.021114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:13.842299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017136+0000","last_change":"2024-01-24T13:04:00.047326+0000","last_active":"2024-01-24T13:04:01.017136+0000","last_peered":"2024-01-24T13:04:01.017136+0000","last_clean":"2024-01-24T13:04:01.017136+0000","last_became_active":"2024-01-24T13:04:00.046914+0000","last_became_peered":"2024-01-24T13:04:00.046914+0000","last_unstale":"2024-01-24T13:04:01.017136+0000","last_undegraded":"2024-01-24T13:04:01.017136+0000","last_fullsized":"2024-01-24T13:04:01.017136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:55:11.375322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011611+0000","last_change":"2024-01-24T13:03:56.023957+0000","last_active":"2024-01-24T13:04:00.011611+0000","last_peered":"2024-01-24T13:04:00.011611+0000","last_clean":"2024-01-24T13:04:00.011611+0000","last_became_active":"2024-01-24T13:03:56.022133+0000","last_became_peered":"2024-01-24T13:03:56.022133+0000","last_unstale":"2024-01-24T13:04:00.011611+0000","last_undegraded":"2024-01-24T13:04:00.011611+0000","last_fullsized":"2024-01-24T13:04:00.011611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:14:00.774178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011695+0000","last_change":"2024-01-24T13:03:55.596366+0000","last_active":"2024-01-24T13:04:00.011695+0000","last_peered":"2024-01-24T13:04:00.011695+0000","last_clean":"2024-01-24T13:04:00.011695+0000","last_became_active":"2024-01-24T13:03:55.593651+0000","last_became_peered":"2024-01-24T13:03:55.593651+0000","last_unstale":"2024-01-24T13:04:00.011695+0000","last_undegraded":"2024-01-24T13:04:00.011695+0000","last_fullsized":"2024-01-24T13:04:00.011695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:39.217211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.807643+0000","last_change":"2024-01-24T13:04:00.045823+0000","last_active":"2024-01-24T13:04:01.807643+0000","last_peered":"2024-01-24T13:04:01.807643+0000","last_clean":"2024-01-24T13:04:01.807643+0000","last_became_active":"2024-01-24T13:04:00.045308+0000","last_became_peered":"2024-01-24T13:04:00.045308+0000","last_unstale":"2024-01-24T13:04:01.807643+0000","last_undegraded":"2024-01-24T13:04:01.807643+0000","last_fullsized":"2024-01-24T13:04:01.807643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:48:59.613697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017004+0000","last_change":"2024-01-24T13:03:56.006377+0000","last_active":"2024-01-24T13:04:00.017004+0000","last_peered":"2024-01-24T13:04:00.017004+0000","last_clean":"2024-01-24T13:04:00.017004+0000","last_became_active":"2024-01-24T13:03:56.006045+0000","last_became_peered":"2024-01-24T13:03:56.006045+0000","last_unstale":"2024-01-24T13:04:00.017004+0000","last_undegraded":"2024-01-24T13:04:00.017004+0000","last_fullsized":"2024-01-24T13:04:00.017004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:30:39.914222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016729+0000","last_change":"2024-01-24T13:03:55.606775+0000","last_active":"2024-01-24T13:04:01.016729+0000","last_peered":"2024-01-24T13:04:01.016729+0000","last_clean":"2024-01-24T13:04:01.016729+0000","last_became_active":"2024-01-24T13:03:55.606406+0000","last_became_peered":"2024-01-24T13:03:55.606406+0000","last_unstale":"2024-01-24T13:04:01.016729+0000","last_undegraded":"2024-01-24T13:04:01.016729+0000","last_fullsized":"2024-01-24T13:04:01.016729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:03:38.642654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806328+0000","last_change":"2024-01-24T13:04:00.049217+0000","last_active":"2024-01-24T13:04:01.806328+0000","last_peered":"2024-01-24T13:04:01.806328+0000","last_clean":"2024-01-24T13:04:01.806328+0000","last_became_active":"2024-01-24T13:04:00.048805+0000","last_became_peered":"2024-01-24T13:04:00.048805+0000","last_unstale":"2024-01-24T13:04:01.806328+0000","last_undegraded":"2024-01-24T13:04:01.806328+0000","last_fullsized":"2024-01-24T13:04:01.806328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:51:50.366250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.031010+0000","last_change":"2024-01-24T13:03:56.016870+0000","last_active":"2024-01-24T13:04:00.031010+0000","last_peered":"2024-01-24T13:04:00.031010+0000","last_clean":"2024-01-24T13:04:00.031010+0000","last_became_active":"2024-01-24T13:03:56.016600+0000","last_became_peered":"2024-01-24T13:03:56.016600+0000","last_unstale":"2024-01-24T13:04:00.031010+0000","last_undegraded":"2024-01-24T13:04:00.031010+0000","last_fullsized":"2024-01-24T13:04:00.031010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:50:02.158087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'10","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:11.278469+0000","last_change":"2024-01-24T13:03:55.600760+0000","last_active":"2024-01-24T13:04:11.278469+0000","last_peered":"2024-01-24T13:04:11.278469+0000","last_clean":"2024-01-24T13:04:11.278469+0000","last_became_active":"2024-01-24T13:03:55.600478+0000","last_became_peered":"2024-01-24T13:03:55.600478+0000","last_unstale":"2024-01-24T13:04:11.278469+0000","last_undegraded":"2024-01-24T13:04:11.278469+0000","last_fullsized":"2024-01-24T13:04:11.278469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:35:44.393474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149129+0000","last_change":"2024-01-24T13:04:00.047921+0000","last_active":"2024-01-24T13:04:01.149129+0000","last_peered":"2024-01-24T13:04:01.149129+0000","last_clean":"2024-01-24T13:04:01.149129+0000","last_became_active":"2024-01-24T13:04:00.047461+0000","last_became_peered":"2024-01-24T13:04:00.047461+0000","last_unstale":"2024-01-24T13:04:01.149129+0000","last_undegraded":"2024-01-24T13:04:01.149129+0000","last_fullsized":"2024-01-24T13:04:01.149129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:35.010431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011713+0000","last_change":"2024-01-24T13:03:56.019212+0000","last_active":"2024-01-24T13:04:00.011713+0000","last_peered":"2024-01-24T13:04:00.011713+0000","last_clean":"2024-01-24T13:04:00.011713+0000","last_became_active":"2024-01-24T13:03:56.018880+0000","last_became_peered":"2024-01-24T13:03:56.018880+0000","last_unstale":"2024-01-24T13:04:00.011713+0000","last_undegraded":"2024-01-24T13:04:00.011713+0000","last_fullsized":"2024-01-24T13:04:00.011713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T01:02:49.724251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017145+0000","last_change":"2024-01-24T13:03:55.599109+0000","last_active":"2024-01-24T13:04:01.017145+0000","last_peered":"2024-01-24T13:04:01.017145+0000","last_clean":"2024-01-24T13:04:01.017145+0000","last_became_active":"2024-01-24T13:03:55.598819+0000","last_became_peered":"2024-01-24T13:03:55.598819+0000","last_unstale":"2024-01-24T13:04:01.017145+0000","last_undegraded":"2024-01-24T13:04:01.017145+0000","last_fullsized":"2024-01-24T13:04:01.017145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:45:36.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806220+0000","last_change":"2024-01-24T13:04:00.039074+0000","last_active":"2024-01-24T13:04:01.806220+0000","last_peered":"2024-01-24T13:04:01.806220+0000","last_clean":"2024-01-24T13:04:01.806220+0000","last_became_active":"2024-01-24T13:04:00.038717+0000","last_became_peered":"2024-01-24T13:04:00.038717+0000","last_unstale":"2024-01-24T13:04:01.806220+0000","last_undegraded":"2024-01-24T13:04:01.806220+0000","last_fullsized":"2024-01-24T13:04:01.806220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:16:03.907815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017269+0000","last_change":"2024-01-24T13:03:56.012177+0000","last_active":"2024-01-24T13:04:01.017269+0000","last_peered":"2024-01-24T13:04:01.017269+0000","last_clean":"2024-01-24T13:04:01.017269+0000","last_became_active":"2024-01-24T13:03:56.011917+0000","last_became_peered":"2024-01-24T13:03:56.011917+0000","last_unstale":"2024-01-24T13:04:01.017269+0000","last_undegraded":"2024-01-24T13:04:01.017269+0000","last_fullsized":"2024-01-24T13:04:01.017269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:37.212289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.028063+0000","last_change":"2024-01-24T13:03:55.602617+0000","last_active":"2024-01-24T13:04:00.028063+0000","last_peered":"2024-01-24T13:04:00.028063+0000","last_clean":"2024-01-24T13:04:00.028063+0000","last_became_active":"2024-01-24T13:03:55.602297+0000","last_became_peered":"2024-01-24T13:03:55.602297+0000","last_unstale":"2024-01-24T13:04:00.028063+0000","last_undegraded":"2024-01-24T13:04:00.028063+0000","last_fullsized":"2024-01-24T13:04:00.028063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:08.959080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806443+0000","last_change":"2024-01-24T13:04:00.043082+0000","last_active":"2024-01-24T13:04:01.806443+0000","last_peered":"2024-01-24T13:04:01.806443+0000","last_clean":"2024-01-24T13:04:01.806443+0000","last_became_active":"2024-01-24T13:04:00.042663+0000","last_became_peered":"2024-01-24T13:04:00.042663+0000","last_unstale":"2024-01-24T13:04:01.806443+0000","last_undegraded":"2024-01-24T13:04:01.806443+0000","last_fullsized":"2024-01-24T13:04:01.806443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:13:01.067406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013739+0000","last_change":"2024-01-24T13:03:56.007996+0000","last_active":"2024-01-24T13:04:01.013739+0000","last_peered":"2024-01-24T13:04:01.013739+0000","last_clean":"2024-01-24T13:04:01.013739+0000","last_became_active":"2024-01-24T13:03:56.006784+0000","last_became_peered":"2024-01-24T13:03:56.006784+0000","last_unstale":"2024-01-24T13:04:01.013739+0000","last_undegraded":"2024-01-24T13:04:01.013739+0000","last_fullsized":"2024-01-24T13:04:01.013739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:18:52.742448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.022444+0000","last_change":"2024-01-24T13:03:55.598172+0000","last_active":"2024-01-24T13:04:00.022444+0000","last_peered":"2024-01-24T13:04:00.022444+0000","last_clean":"2024-01-24T13:04:00.022444+0000","last_became_active":"2024-01-24T13:03:55.597945+0000","last_became_peered":"2024-01-24T13:03:55.597945+0000","last_unstale":"2024-01-24T13:04:00.022444+0000","last_undegraded":"2024-01-24T13:04:00.022444+0000","last_fullsized":"2024-01-24T13:04:00.022444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:40:38.850663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149379+0000","last_change":"2024-01-24T13:04:00.033699+0000","last_active":"2024-01-24T13:04:01.149379+0000","last_peered":"2024-01-24T13:04:01.149379+0000","last_clean":"2024-01-24T13:04:01.149379+0000","last_became_active":"2024-01-24T13:04:00.032771+0000","last_became_peered":"2024-01-24T13:04:00.032771+0000","last_unstale":"2024-01-24T13:04:01.149379+0000","last_undegraded":"2024-01-24T13:04:01.149379+0000","last_fullsized":"2024-01-24T13:04:01.149379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:16:03.907815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.150744+0000","last_change":"2024-01-24T13:04:00.053152+0000","last_active":"2024-01-24T13:04:01.150744+0000","last_peered":"2024-01-24T13:04:01.150744+0000","last_clean":"2024-01-24T13:04:01.150744+0000","last_became_active":"2024-01-24T13:04:00.052760+0000","last_became_peered":"2024-01-24T13:04:00.052760+0000","last_unstale":"2024-01-24T13:04:01.150744+0000","last_undegraded":"2024-01-24T13:04:01.150744+0000","last_fullsized":"2024-01-24T13:04:01.150744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019513+0000","last_change":"2024-01-24T13:03:56.010008+0000","last_active":"2024-01-24T13:04:00.019513+0000","last_peered":"2024-01-24T13:04:00.019513+0000","last_clean":"2024-01-24T13:04:00.019513+0000","last_became_active":"2024-01-24T13:03:56.009750+0000","last_became_peered":"2024-01-24T13:03:56.009750+0000","last_unstale":"2024-01-24T13:04:00.019513+0000","last_undegraded":"2024-01-24T13:04:00.019513+0000","last_fullsized":"2024-01-24T13:04:00.019513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:46:37.904394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011569+0000","last_change":"2024-01-24T13:03:55.592274+0000","last_active":"2024-01-24T13:04:00.011569+0000","last_peered":"2024-01-24T13:04:00.011569+0000","last_clean":"2024-01-24T13:04:00.011569+0000","last_became_active":"2024-01-24T13:03:55.591994+0000","last_became_peered":"2024-01-24T13:03:55.591994+0000","last_unstale":"2024-01-24T13:04:00.011569+0000","last_undegraded":"2024-01-24T13:04:00.011569+0000","last_fullsized":"2024-01-24T13:04:00.011569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:08.959080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806986+0000","last_change":"2024-01-24T13:04:00.053348+0000","last_active":"2024-01-24T13:04:01.806986+0000","last_peered":"2024-01-24T13:04:01.806986+0000","last_clean":"2024-01-24T13:04:01.806986+0000","last_became_active":"2024-01-24T13:04:00.052859+0000","last_became_peered":"2024-01-24T13:04:00.052859+0000","last_unstale":"2024-01-24T13:04:01.806986+0000","last_undegraded":"2024-01-24T13:04:01.806986+0000","last_fullsized":"2024-01-24T13:04:01.806986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:31:55.847658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015772+0000","last_change":"2024-01-24T13:03:56.013494+0000","last_active":"2024-01-24T13:04:01.015772+0000","last_peered":"2024-01-24T13:04:01.015772+0000","last_clean":"2024-01-24T13:04:01.015772+0000","last_became_active":"2024-01-24T13:03:56.013241+0000","last_became_peered":"2024-01-24T13:03:56.013241+0000","last_unstale":"2024-01-24T13:04:01.015772+0000","last_undegraded":"2024-01-24T13:04:01.015772+0000","last_fullsized":"2024-01-24T13:04:01.015772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:09:52.534215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018229+0000","last_change":"2024-01-24T13:03:55.608610+0000","last_active":"2024-01-24T13:04:00.018229+0000","last_peered":"2024-01-24T13:04:00.018229+0000","last_clean":"2024-01-24T13:04:00.018229+0000","last_became_active":"2024-01-24T13:03:55.608272+0000","last_became_peered":"2024-01-24T13:03:55.608272+0000","last_unstale":"2024-01-24T13:04:00.018229+0000","last_undegraded":"2024-01-24T13:04:00.018229+0000","last_fullsized":"2024-01-24T13:04:00.018229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:03:38.642654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011518+0000","last_change":"2024-01-24T13:03:55.603336+0000","last_active":"2024-01-24T13:04:00.011518+0000","last_peered":"2024-01-24T13:04:00.011518+0000","last_clean":"2024-01-24T13:04:00.011518+0000","last_became_active":"2024-01-24T13:03:55.603034+0000","last_became_peered":"2024-01-24T13:03:55.603034+0000","last_unstale":"2024-01-24T13:04:00.011518+0000","last_undegraded":"2024-01-24T13:04:00.011518+0000","last_fullsized":"2024-01-24T13:04:00.011518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:54:35.340555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019760+0000","last_change":"2024-01-24T13:03:56.023712+0000","last_active":"2024-01-24T13:04:00.019760+0000","last_peered":"2024-01-24T13:04:00.019760+0000","last_clean":"2024-01-24T13:04:00.019760+0000","last_became_active":"2024-01-24T13:03:56.023037+0000","last_became_peered":"2024-01-24T13:03:56.023037+0000","last_unstale":"2024-01-24T13:04:00.019760+0000","last_undegraded":"2024-01-24T13:04:00.019760+0000","last_fullsized":"2024-01-24T13:04:00.019760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:10:17.205776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149525+0000","last_change":"2024-01-24T13:04:00.049354+0000","last_active":"2024-01-24T13:04:01.149525+0000","last_peered":"2024-01-24T13:04:01.149525+0000","last_clean":"2024-01-24T13:04:01.149525+0000","last_became_active":"2024-01-24T13:04:00.048648+0000","last_became_peered":"2024-01-24T13:04:00.048648+0000","last_unstale":"2024-01-24T13:04:01.149525+0000","last_undegraded":"2024-01-24T13:04:01.149525+0000","last_fullsized":"2024-01-24T13:04:01.149525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:37:19.983867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016202+0000","last_change":"2024-01-24T13:03:55.595499+0000","last_active":"2024-01-24T13:04:01.016202+0000","last_peered":"2024-01-24T13:04:01.016202+0000","last_clean":"2024-01-24T13:04:01.016202+0000","last_became_active":"2024-01-24T13:03:55.595229+0000","last_became_peered":"2024-01-24T13:03:55.595229+0000","last_unstale":"2024-01-24T13:04:01.016202+0000","last_undegraded":"2024-01-24T13:04:01.016202+0000","last_fullsized":"2024-01-24T13:04:01.016202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:33:37.210242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020904+0000","last_change":"2024-01-24T13:03:56.025558+0000","last_active":"2024-01-24T13:04:00.020904+0000","last_peered":"2024-01-24T13:04:00.020904+0000","last_clean":"2024-01-24T13:04:00.020904+0000","last_became_active":"2024-01-24T13:03:56.023819+0000","last_became_peered":"2024-01-24T13:03:56.023819+0000","last_unstale":"2024-01-24T13:04:00.020904+0000","last_undegraded":"2024-01-24T13:04:00.020904+0000","last_fullsized":"2024-01-24T13:04:00.020904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.807832+0000","last_change":"2024-01-24T13:04:00.050356+0000","last_active":"2024-01-24T13:04:01.807832+0000","last_peered":"2024-01-24T13:04:01.807832+0000","last_clean":"2024-01-24T13:04:01.807832+0000","last_became_active":"2024-01-24T13:04:00.049681+0000","last_became_peered":"2024-01-24T13:04:00.049681+0000","last_unstale":"2024-01-24T13:04:01.807832+0000","last_undegraded":"2024-01-24T13:04:01.807832+0000","last_fullsized":"2024-01-24T13:04:01.807832+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:37:06.368057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013232+0000","last_change":"2024-01-24T13:03:56.004498+0000","last_active":"2024-01-24T13:04:01.013232+0000","last_peered":"2024-01-24T13:04:01.013232+0000","last_clean":"2024-01-24T13:04:01.013232+0000","last_became_active":"2024-01-24T13:03:56.004175+0000","last_became_peered":"2024-01-24T13:03:56.004175+0000","last_unstale":"2024-01-24T13:04:01.013232+0000","last_undegraded":"2024-01-24T13:04:01.013232+0000","last_fullsized":"2024-01-24T13:04:01.013232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016280+0000","last_change":"2024-01-24T13:03:56.022795+0000","last_active":"2024-01-24T13:04:01.016280+0000","last_peered":"2024-01-24T13:04:01.016280+0000","last_clean":"2024-01-24T13:04:01.016280+0000","last_became_active":"2024-01-24T13:03:56.022534+0000","last_became_peered":"2024-01-24T13:03:56.022534+0000","last_unstale":"2024-01-24T13:04:01.016280+0000","last_undegraded":"2024-01-24T13:04:01.016280+0000","last_fullsized":"2024-01-24T13:04:01.016280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:14.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011421+0000","last_change":"2024-01-24T13:03:56.017677+0000","last_active":"2024-01-24T13:04:00.011421+0000","last_peered":"2024-01-24T13:04:00.011421+0000","last_clean":"2024-01-24T13:04:00.011421+0000","last_became_active":"2024-01-24T13:03:56.017371+0000","last_became_peered":"2024-01-24T13:03:56.017371+0000","last_unstale":"2024-01-24T13:04:00.011421+0000","last_undegraded":"2024-01-24T13:04:00.011421+0000","last_fullsized":"2024-01-24T13:04:00.011421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:33:30.023414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016121+0000","last_change":"2024-01-24T13:03:56.018818+0000","last_active":"2024-01-24T13:04:01.016121+0000","last_peered":"2024-01-24T13:04:01.016121+0000","last_clean":"2024-01-24T13:04:01.016121+0000","last_became_active":"2024-01-24T13:03:56.018526+0000","last_became_peered":"2024-01-24T13:03:56.018526+0000","last_unstale":"2024-01-24T13:04:01.016121+0000","last_undegraded":"2024-01-24T13:04:01.016121+0000","last_fullsized":"2024-01-24T13:04:01.016121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:03:08.353848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018278+0000","last_change":"2024-01-24T13:03:56.021986+0000","last_active":"2024-01-24T13:04:00.018278+0000","last_peered":"2024-01-24T13:04:00.018278+0000","last_clean":"2024-01-24T13:04:00.018278+0000","last_became_active":"2024-01-24T13:03:56.021722+0000","last_became_peered":"2024-01-24T13:03:56.021722+0000","last_unstale":"2024-01-24T13:04:00.018278+0000","last_undegraded":"2024-01-24T13:04:00.018278+0000","last_fullsized":"2024-01-24T13:04:00.018278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:41:53.447100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018684+0000","last_change":"2024-01-24T13:03:56.017766+0000","last_active":"2024-01-24T13:04:00.018684+0000","last_peered":"2024-01-24T13:04:00.018684+0000","last_clean":"2024-01-24T13:04:00.018684+0000","last_became_active":"2024-01-24T13:03:56.017460+0000","last_became_peered":"2024-01-24T13:03:56.017460+0000","last_unstale":"2024-01-24T13:04:00.018684+0000","last_undegraded":"2024-01-24T13:04:00.018684+0000","last_fullsized":"2024-01-24T13:04:00.018684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013764+0000","last_change":"2024-01-24T13:03:56.006732+0000","last_active":"2024-01-24T13:04:01.013764+0000","last_peered":"2024-01-24T13:04:01.013764+0000","last_clean":"2024-01-24T13:04:01.013764+0000","last_became_active":"2024-01-24T13:03:56.006500+0000","last_became_peered":"2024-01-24T13:03:56.006500+0000","last_unstale":"2024-01-24T13:04:01.013764+0000","last_undegraded":"2024-01-24T13:04:01.013764+0000","last_fullsized":"2024-01-24T13:04:01.013764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:41:53.447100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017053+0000","last_change":"2024-01-24T13:03:56.022835+0000","last_active":"2024-01-24T13:04:01.017053+0000","last_peered":"2024-01-24T13:04:01.017053+0000","last_clean":"2024-01-24T13:04:01.017053+0000","last_became_active":"2024-01-24T13:03:56.022521+0000","last_became_peered":"2024-01-24T13:03:56.022521+0000","last_unstale":"2024-01-24T13:04:01.017053+0000","last_undegraded":"2024-01-24T13:04:01.017053+0000","last_fullsized":"2024-01-24T13:04:01.017053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:50:36.168607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011457+0000","last_change":"2024-01-24T13:03:56.018264+0000","last_active":"2024-01-24T13:04:00.011457+0000","last_peered":"2024-01-24T13:04:00.011457+0000","last_clean":"2024-01-24T13:04:00.011457+0000","last_became_active":"2024-01-24T13:03:56.018005+0000","last_became_peered":"2024-01-24T13:03:56.018005+0000","last_unstale":"2024-01-24T13:04:00.011457+0000","last_undegraded":"2024-01-24T13:04:00.011457+0000","last_fullsized":"2024-01-24T13:04:00.011457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:28.956711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015611+0000","last_change":"2024-01-24T13:03:55.999869+0000","last_active":"2024-01-24T13:04:01.015611+0000","last_peered":"2024-01-24T13:04:01.015611+0000","last_clean":"2024-01-24T13:04:01.015611+0000","last_became_active":"2024-01-24T13:03:55.999485+0000","last_became_peered":"2024-01-24T13:03:55.999485+0000","last_unstale":"2024-01-24T13:04:01.015611+0000","last_undegraded":"2024-01-24T13:04:01.015611+0000","last_fullsized":"2024-01-24T13:04:01.015611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:30:44.114343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020828+0000","last_change":"2024-01-24T13:03:56.020510+0000","last_active":"2024-01-24T13:04:00.020828+0000","last_peered":"2024-01-24T13:04:00.020828+0000","last_clean":"2024-01-24T13:04:00.020828+0000","last_became_active":"2024-01-24T13:03:56.020184+0000","last_became_peered":"2024-01-24T13:03:56.020184+0000","last_unstale":"2024-01-24T13:04:00.020828+0000","last_undegraded":"2024-01-24T13:04:00.020828+0000","last_fullsized":"2024-01-24T13:04:00.020828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:40.224981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019636+0000","last_change":"2024-01-24T13:03:56.016392+0000","last_active":"2024-01-24T13:04:00.019636+0000","last_peered":"2024-01-24T13:04:00.019636+0000","last_clean":"2024-01-24T13:04:00.019636+0000","last_became_active":"2024-01-24T13:03:56.016151+0000","last_became_peered":"2024-01-24T13:03:56.016151+0000","last_unstale":"2024-01-24T13:04:00.019636+0000","last_undegraded":"2024-01-24T13:04:00.019636+0000","last_fullsized":"2024-01-24T13:04:00.019636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:40:18.485138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.025905+0000","last_change":"2024-01-24T13:03:56.012700+0000","last_active":"2024-01-24T13:04:00.025905+0000","last_peered":"2024-01-24T13:04:00.025905+0000","last_clean":"2024-01-24T13:04:00.025905+0000","last_became_active":"2024-01-24T13:03:56.012103+0000","last_became_peered":"2024-01-24T13:03:56.012103+0000","last_unstale":"2024-01-24T13:04:00.025905+0000","last_undegraded":"2024-01-24T13:04:00.025905+0000","last_fullsized":"2024-01-24T13:04:00.025905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:13:44.864520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013515+0000","last_change":"2024-01-24T13:03:56.012794+0000","last_active":"2024-01-24T13:04:00.013515+0000","last_peered":"2024-01-24T13:04:00.013515+0000","last_clean":"2024-01-24T13:04:00.013515+0000","last_became_active":"2024-01-24T13:03:56.012545+0000","last_became_peered":"2024-01-24T13:03:56.012545+0000","last_unstale":"2024-01-24T13:04:00.013515+0000","last_undegraded":"2024-01-24T13:04:00.013515+0000","last_fullsized":"2024-01-24T13:04:00.013515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:44:49.313400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017636+0000","last_change":"2024-01-24T13:03:56.024693+0000","last_active":"2024-01-24T13:04:01.017636+0000","last_peered":"2024-01-24T13:04:01.017636+0000","last_clean":"2024-01-24T13:04:01.017636+0000","last_became_active":"2024-01-24T13:03:56.024414+0000","last_became_peered":"2024-01-24T13:03:56.024414+0000","last_unstale":"2024-01-24T13:04:01.017636+0000","last_undegraded":"2024-01-24T13:04:01.017636+0000","last_fullsized":"2024-01-24T13:04:01.017636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013466+0000","last_change":"2024-01-24T13:03:56.022620+0000","last_active":"2024-01-24T13:04:00.013466+0000","last_peered":"2024-01-24T13:04:00.013466+0000","last_clean":"2024-01-24T13:04:00.013466+0000","last_became_active":"2024-01-24T13:03:56.022340+0000","last_became_peered":"2024-01-24T13:03:56.022340+0000","last_unstale":"2024-01-24T13:04:00.013466+0000","last_undegraded":"2024-01-24T13:04:00.013466+0000","last_fullsized":"2024-01-24T13:04:00.013466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:13:44.864520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011319+0000","last_change":"2024-01-24T13:03:56.021834+0000","last_active":"2024-01-24T13:04:00.011319+0000","last_peered":"2024-01-24T13:04:00.011319+0000","last_clean":"2024-01-24T13:04:00.011319+0000","last_became_active":"2024-01-24T13:03:56.021527+0000","last_became_peered":"2024-01-24T13:03:56.021527+0000","last_unstale":"2024-01-24T13:04:00.011319+0000","last_undegraded":"2024-01-24T13:04:00.011319+0000","last_fullsized":"2024-01-24T13:04:00.011319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:48:22.624362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015966+0000","last_change":"2024-01-24T13:03:56.009268+0000","last_active":"2024-01-24T13:04:01.015966+0000","last_peered":"2024-01-24T13:04:01.015966+0000","last_clean":"2024-01-24T13:04:01.015966+0000","last_became_active":"2024-01-24T13:03:56.009008+0000","last_became_peered":"2024-01-24T13:03:56.009008+0000","last_unstale":"2024-01-24T13:04:01.015966+0000","last_undegraded":"2024-01-24T13:04:01.015966+0000","last_fullsized":"2024-01-24T13:04:01.015966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:41:51.025201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.016927+0000","last_change":"2024-01-24T13:03:56.013449+0000","last_active":"2024-01-24T13:04:00.016927+0000","last_peered":"2024-01-24T13:04:00.016927+0000","last_clean":"2024-01-24T13:04:00.016927+0000","last_became_active":"2024-01-24T13:03:56.011189+0000","last_became_peered":"2024-01-24T13:03:56.011189+0000","last_unstale":"2024-01-24T13:04:00.016927+0000","last_undegraded":"2024-01-24T13:04:00.016927+0000","last_fullsized":"2024-01-24T13:04:00.016927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:02.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.016811+0000","last_change":"2024-01-24T13:03:56.024913+0000","last_active":"2024-01-24T13:04:00.016811+0000","last_peered":"2024-01-24T13:04:00.016811+0000","last_clean":"2024-01-24T13:04:00.016811+0000","last_became_active":"2024-01-24T13:03:56.024610+0000","last_became_peered":"2024-01-24T13:03:56.024610+0000","last_unstale":"2024-01-24T13:04:00.016811+0000","last_undegraded":"2024-01-24T13:04:00.016811+0000","last_fullsized":"2024-01-24T13:04:00.016811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:18:52.742448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.025821+0000","last_change":"2024-01-24T13:03:56.012889+0000","last_active":"2024-01-24T13:04:00.025821+0000","last_peered":"2024-01-24T13:04:00.025821+0000","last_clean":"2024-01-24T13:04:00.025821+0000","last_became_active":"2024-01-24T13:03:56.012457+0000","last_became_peered":"2024-01-24T13:03:56.012457+0000","last_unstale":"2024-01-24T13:04:00.025821+0000","last_undegraded":"2024-01-24T13:04:00.025821+0000","last_fullsized":"2024-01-24T13:04:00.025821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:25:17.038527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.030919+0000","last_change":"2024-01-24T13:03:56.007919+0000","last_active":"2024-01-24T13:04:00.030919+0000","last_peered":"2024-01-24T13:04:00.030919+0000","last_clean":"2024-01-24T13:04:00.030919+0000","last_became_active":"2024-01-24T13:03:56.007649+0000","last_became_peered":"2024-01-24T13:03:56.007649+0000","last_unstale":"2024-01-24T13:04:00.030919+0000","last_undegraded":"2024-01-24T13:04:00.030919+0000","last_fullsized":"2024-01-24T13:04:00.030919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:02:53.625968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.027982+0000","last_change":"2024-01-24T13:03:56.006823+0000","last_active":"2024-01-24T13:04:00.027982+0000","last_peered":"2024-01-24T13:04:00.027982+0000","last_clean":"2024-01-24T13:04:00.027982+0000","last_became_active":"2024-01-24T13:03:56.006551+0000","last_became_peered":"2024-01-24T13:03:56.006551+0000","last_unstale":"2024-01-24T13:04:00.027982+0000","last_undegraded":"2024-01-24T13:04:00.027982+0000","last_fullsized":"2024-01-24T13:04:00.027982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:44:47.469690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.022358+0000","last_change":"2024-01-24T13:03:56.011850+0000","last_active":"2024-01-24T13:04:00.022358+0000","last_peered":"2024-01-24T13:04:00.022358+0000","last_clean":"2024-01-24T13:04:00.022358+0000","last_became_active":"2024-01-24T13:03:56.011377+0000","last_became_peered":"2024-01-24T13:03:56.011377+0000","last_unstale":"2024-01-24T13:04:00.022358+0000","last_undegraded":"2024-01-24T13:04:00.022358+0000","last_fullsized":"2024-01-24T13:04:00.022358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:47:46.739111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015553+0000","last_change":"2024-01-24T13:03:56.009254+0000","last_active":"2024-01-24T13:04:01.015553+0000","last_peered":"2024-01-24T13:04:01.015553+0000","last_clean":"2024-01-24T13:04:01.015553+0000","last_became_active":"2024-01-24T13:03:56.008910+0000","last_became_peered":"2024-01-24T13:03:56.008910+0000","last_unstale":"2024-01-24T13:04:01.015553+0000","last_undegraded":"2024-01-24T13:04:01.015553+0000","last_fullsized":"2024-01-24T13:04:01.015553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:57:08.977681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021030+0000","last_change":"2024-01-24T13:03:56.008312+0000","last_active":"2024-01-24T13:04:00.021030+0000","last_peered":"2024-01-24T13:04:00.021030+0000","last_clean":"2024-01-24T13:04:00.021030+0000","last_became_active":"2024-01-24T13:03:56.008049+0000","last_became_peered":"2024-01-24T13:03:56.008049+0000","last_unstale":"2024-01-24T13:04:00.021030+0000","last_undegraded":"2024-01-24T13:04:00.021030+0000","last_fullsized":"2024-01-24T13:04:00.021030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:26:46.456477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013251+0000","last_change":"2024-01-24T13:03:56.007224+0000","last_active":"2024-01-24T13:04:01.013251+0000","last_peered":"2024-01-24T13:04:01.013251+0000","last_clean":"2024-01-24T13:04:01.013251+0000","last_became_active":"2024-01-24T13:03:56.006804+0000","last_became_peered":"2024-01-24T13:03:56.006804+0000","last_unstale":"2024-01-24T13:04:01.013251+0000","last_undegraded":"2024-01-24T13:04:01.013251+0000","last_fullsized":"2024-01-24T13:04:01.013251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:30:39.914222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.023149+0000","last_change":"2024-01-24T13:03:56.021601+0000","last_active":"2024-01-24T13:04:00.023149+0000","last_peered":"2024-01-24T13:04:00.023149+0000","last_clean":"2024-01-24T13:04:00.023149+0000","last_became_active":"2024-01-24T13:03:56.021378+0000","last_became_peered":"2024-01-24T13:03:56.021378+0000","last_unstale":"2024-01-24T13:04:00.023149+0000","last_undegraded":"2024-01-24T13:04:00.023149+0000","last_fullsized":"2024-01-24T13:04:00.023149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:26:27.582337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013386+0000","last_change":"2024-01-24T13:03:56.006893+0000","last_active":"2024-01-24T13:04:01.013386+0000","last_peered":"2024-01-24T13:04:01.013386+0000","last_clean":"2024-01-24T13:04:01.013386+0000","last_became_active":"2024-01-24T13:03:56.006553+0000","last_became_peered":"2024-01-24T13:03:56.006553+0000","last_unstale":"2024-01-24T13:04:01.013386+0000","last_undegraded":"2024-01-24T13:04:01.013386+0000","last_fullsized":"2024-01-24T13:04:01.013386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:40.224981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016663+0000","last_change":"2024-01-24T13:03:56.010902+0000","last_active":"2024-01-24T13:04:01.016663+0000","last_peered":"2024-01-24T13:04:01.016663+0000","last_clean":"2024-01-24T13:04:01.016663+0000","last_became_active":"2024-01-24T13:03:56.008359+0000","last_became_peered":"2024-01-24T13:03:56.008359+0000","last_unstale":"2024-01-24T13:04:01.016663+0000","last_undegraded":"2024-01-24T13:04:01.016663+0000","last_fullsized":"2024-01-24T13:04:01.016663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:01:35.209896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017095+0000","last_change":"2024-01-24T13:03:56.018292+0000","last_active":"2024-01-24T13:04:01.017095+0000","last_peered":"2024-01-24T13:04:01.017095+0000","last_clean":"2024-01-24T13:04:01.017095+0000","last_became_active":"2024-01-24T13:03:56.015689+0000","last_became_peered":"2024-01-24T13:03:56.015689+0000","last_unstale":"2024-01-24T13:04:01.017095+0000","last_undegraded":"2024-01-24T13:04:01.017095+0000","last_fullsized":"2024-01-24T13:04:01.017095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:15:57.223738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.028853+0000","last_change":"2024-01-24T13:03:56.010593+0000","last_active":"2024-01-24T13:04:00.028853+0000","last_peered":"2024-01-24T13:04:00.028853+0000","last_clean":"2024-01-24T13:04:00.028853+0000","last_became_active":"2024-01-24T13:03:56.010357+0000","last_became_peered":"2024-01-24T13:03:56.010357+0000","last_unstale":"2024-01-24T13:04:00.028853+0000","last_undegraded":"2024-01-24T13:04:00.028853+0000","last_fullsized":"2024-01-24T13:04:00.028853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:12:57.628509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":117206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":117082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":121549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":117664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":892928,"data_stored":707520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":303104,"data_stored":117138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":897024,"data_stored":707542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:04:20.733 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:04:20.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.904+0000 7f57b1000640 1 Processor -- start 2024-01-24T13:04:20.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.904+0000 7f57b1000640 1 -- start start 2024-01-24T13:04:20.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57b1000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57ac15fb50 0x7f57ac15dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57b1000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f57ac15d730 0x7f57ac0cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57b1000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f57ac0ce4b0 0x7f57ac152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57b1000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac0ce900 con 0x7f57ac15d730 2024-01-24T13:04:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57b1000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac06c0e0 con 0x7f57ac0ce4b0 2024-01-24T13:04:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57b1000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac06cb20 con 0x7f57ac15fb50 2024-01-24T13:04:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57a9400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f57ac15d730 0x7f57ac0cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57a9400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f57ac15d730 0x7f57ac0cdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37000/0 (socket says 172.21.15.29:37000) 2024-01-24T13:04:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57a9400640 1 -- 172.21.15.29:0/2166189759 learned_addr learned my addr 172.21.15.29:0/2166189759 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57aa800640 1 --2- 172.21.15.29:0/2166189759 >> v2:172.21.15.163:3300/0 conn(0x7f57ac0ce4b0 0x7f57ac152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57a9e00640 1 --2- 172.21.15.29:0/2166189759 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57ac15fb50 0x7f57ac15dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57a9400640 1 -- 172.21.15.29:0/2166189759 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57ac15fb50 msgr2=0x7f57ac15dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57a9400640 1 --2- 172.21.15.29:0/2166189759 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57ac15fb50 0x7f57ac15dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57a9400640 1 -- 172.21.15.29:0/2166189759 >> v2:172.21.15.163:3300/0 conn(0x7f57ac0ce4b0 msgr2=0x7f57ac152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57a9400640 1 --2- 172.21.15.29:0/2166189759 >> v2:172.21.15.163:3300/0 conn(0x7f57ac0ce4b0 0x7f57ac152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.908+0000 7f57a9400640 1 -- 172.21.15.29:0/2166189759 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac06b4d0 con 0x7f57ac15d730 2024-01-24T13:04:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57a9400640 1 --2- 172.21.15.29:0/2166189759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57ac15d730 0x7f57ac0cdf70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0b2630 tx=0x7f579401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788db6d35d9c63 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:20.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57a8a00640 1 -- 172.21.15.29:0/2166189759 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57940aa5f0 con 0x7f57ac15d730 2024-01-24T13:04:20.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57a8a00640 1 -- 172.21.15.29:0/2166189759 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57940aa750 con 0x7f57ac15d730 2024-01-24T13:04:20.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57a8a00640 1 -- 172.21.15.29:0/2166189759 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57940aaae0 con 0x7f57ac15d730 2024-01-24T13:04:20.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57b1000640 1 -- 172.21.15.29:0/2166189759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57ac15d730 msgr2=0x7f57ac0cdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57b1000640 1 --2- 172.21.15.29:0/2166189759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57ac15d730 0x7f57ac0cdf70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0b2630 tx=0x7f579401c4d0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57b1000640 1 -- 172.21.15.29:0/2166189759 shutdown_connections 2024-01-24T13:04:20.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57b1000640 1 --2- 172.21.15.29:0/2166189759 >> v2:172.21.15.163:3300/0 conn(0x7f57ac0ce4b0 0x7f57ac152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57b1000640 1 --2- 172.21.15.29:0/2166189759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57ac15d730 0x7f57ac0cdf70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57b1000640 1 --2- 172.21.15.29:0/2166189759 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57ac15fb50 0x7f57ac15dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57b1000640 1 -- 172.21.15.29:0/2166189759 >> 172.21.15.29:0/2166189759 conn(0x7f57ac070570 msgr2=0x7f57ac069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:20.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57b1000640 1 -- 172.21.15.29:0/2166189759 shutdown_connections 2024-01-24T13:04:20.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57b1000640 1 -- 172.21.15.29:0/2166189759 wait complete. 2024-01-24T13:04:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57b1000640 1 Processor -- start 2024-01-24T13:04:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.912+0000 7f57b1000640 1 -- start start 2024-01-24T13:04:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57b1000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57ac0ce4b0 0x7f57ac0c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57b1000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57ac15d730 0x7f57ac156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57b1000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57ac15fb50 0x7f57ac0abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57b1000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac153e00 con 0x7f57ac15fb50 2024-01-24T13:04:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57b1000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac1540a0 con 0x7f57ac0ce4b0 2024-01-24T13:04:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57b1000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac154380 con 0x7f57ac15d730 2024-01-24T13:04:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57aa800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57ac15fb50 0x7f57ac0abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57aa800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57ac15fb50 0x7f57ac0abf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37002/0 (socket says 172.21.15.29:37002) 2024-01-24T13:04:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57aa800640 1 -- 172.21.15.29:0/587477947 learned_addr learned my addr 172.21.15.29:0/587477947 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57a9400640 1 --2- 172.21.15.29:0/587477947 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57ac15d730 0x7f57ac156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57a9e00640 1 --2- 172.21.15.29:0/587477947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57ac0ce4b0 0x7f57ac0c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57aa800640 1 -- 172.21.15.29:0/587477947 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57ac15d730 msgr2=0x7f57ac156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57aa800640 1 --2- 172.21.15.29:0/587477947 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57ac15d730 0x7f57ac156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57aa800640 1 -- 172.21.15.29:0/587477947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57ac0ce4b0 msgr2=0x7f57ac0c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57aa800640 1 --2- 172.21.15.29:0/587477947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57ac0ce4b0 0x7f57ac0c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57aa800640 1 -- 172.21.15.29:0/587477947 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57940094d0 con 0x7f57ac15fb50 2024-01-24T13:04:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57aa800640 1 --2- 172.21.15.29:0/587477947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57ac15fb50 0x7f57ac0abf10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f57a4007d20 tx=0x7f57a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57a2000640 1 -- 172.21.15.29:0/587477947 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4014420 con 0x7f57ac15fb50 2024-01-24T13:04:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57a2000640 1 -- 172.21.15.29:0/587477947 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a40145a0 con 0x7f57ac15fb50 2024-01-24T13:04:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57b1000640 1 -- 172.21.15.29:0/587477947 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac154660 con 0x7f57ac15fb50 2024-01-24T13:04:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57a2000640 1 -- 172.21.15.29:0/587477947 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4014950 con 0x7f57ac15fb50 2024-01-24T13:04:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57b1000640 1 -- 172.21.15.29:0/587477947 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ac0c9800 con 0x7f57ac15fb50 2024-01-24T13:04:20.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57b1000640 1 -- 172.21.15.29:0/587477947 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ac04e850 con 0x7f57ac15fb50 2024-01-24T13:04:20.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.916+0000 7f57a2000640 1 -- 172.21.15.29:0/587477947 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f57a4014ab0 con 0x7f57ac15fb50 2024-01-24T13:04:20.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.920+0000 7f57a2000640 1 --2- 172.21.15.29:0/587477947 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5784065a90 0x7f5784067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:20.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.920+0000 7f57a2000640 1 -- 172.21.15.29:0/587477947 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f57a4083bc0 con 0x7f57ac15fb50 2024-01-24T13:04:20.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.920+0000 7f57a9e00640 1 --2- 172.21.15.29:0/587477947 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5784065a90 0x7f5784067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:20.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.920+0000 7f57a9e00640 1 --2- 172.21.15.29:0/587477947 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5784065a90 0x7f5784067f50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0b20b0 tx=0x7f579c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:20.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:20.924+0000 7f57a2000640 1 -- 172.21.15.29:0/587477947 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f57a4051340 con 0x7f57ac15fb50 2024-01-24T13:04:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.076+0000 7f57b1000640 1 -- 172.21.15.29:0/587477947 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57ac06bd70 con 0x7f5784065a90 2024-01-24T13:04:21.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.088+0000 7f57a2000640 1 -- 172.21.15.29:0/587477947 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345303 (secure 0 0 0) 0x7f579c010990 con 0x7f5784065a90 2024-01-24T13:04:21.093 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:21.095 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:04:21.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.092+0000 7f57b1000640 1 -- 172.21.15.29:0/587477947 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5784065a90 msgr2=0x7f5784067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.092+0000 7f57b1000640 1 --2- 172.21.15.29:0/587477947 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5784065a90 0x7f5784067f50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0b20b0 tx=0x7f579c008040 comp rx=0 tx=0).stop 2024-01-24T13:04:21.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.092+0000 7f57b1000640 1 -- 172.21.15.29:0/587477947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57ac15fb50 msgr2=0x7f57ac0abf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.092+0000 7f57b1000640 1 --2- 172.21.15.29:0/587477947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57ac15fb50 0x7f57ac0abf10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f57a4007d20 tx=0x7f57a400e4b0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.092+0000 7f57b1000640 1 -- 172.21.15.29:0/587477947 shutdown_connections 2024-01-24T13:04:21.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.092+0000 7f57b1000640 1 --2- 172.21.15.29:0/587477947 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5784065a90 0x7f5784067f50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.092+0000 7f57b1000640 1 --2- 172.21.15.29:0/587477947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57ac15fb50 0x7f57ac0abf10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.092+0000 7f57b1000640 1 --2- 172.21.15.29:0/587477947 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57ac15d730 0x7f57ac156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.092+0000 7f57b1000640 1 --2- 172.21.15.29:0/587477947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57ac0ce4b0 0x7f57ac0c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.092+0000 7f57b1000640 1 -- 172.21.15.29:0/587477947 >> 172.21.15.29:0/587477947 conn(0x7f57ac070570 msgr2=0x7f57ac0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:21.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.092+0000 7f57b1000640 1 -- 172.21.15.29:0/587477947 shutdown_connections 2024-01-24T13:04:21.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.092+0000 7f57b1000640 1 -- 172.21.15.29:0/587477947 wait complete. 2024-01-24T13:04:21.114 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-01-24T13:04:19.541385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219700,"kb_used_data":3528,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755020,"statfs":{"total":773094113280,"available":772869140480,"internally_reserved":0,"allocated":3612672,"data_stored":2126578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003168"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020698+0000","last_change":"2024-01-24T13:03:55.606327+0000","last_active":"2024-01-24T13:04:00.020698+0000","last_peered":"2024-01-24T13:04:00.020698+0000","last_clean":"2024-01-24T13:04:00.020698+0000","last_became_active":"2024-01-24T13:03:55.606030+0000","last_became_peered":"2024-01-24T13:03:55.606030+0000","last_unstale":"2024-01-24T13:04:00.020698+0000","last_undegraded":"2024-01-24T13:04:00.020698+0000","last_fullsized":"2024-01-24T13:04:00.020698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:03:57.780901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017226+0000","last_change":"2024-01-24T13:03:56.018840+0000","last_active":"2024-01-24T13:04:01.017226+0000","last_peered":"2024-01-24T13:04:01.017226+0000","last_clean":"2024-01-24T13:04:01.017226+0000","last_became_active":"2024-01-24T13:03:56.018597+0000","last_became_peered":"2024-01-24T13:03:56.018597+0000","last_unstale":"2024-01-24T13:04:01.017226+0000","last_undegraded":"2024-01-24T13:04:01.017226+0000","last_fullsized":"2024-01-24T13:04:01.017226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:26:26.138489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806814+0000","last_change":"2024-01-24T13:04:00.044582+0000","last_active":"2024-01-24T13:04:01.806814+0000","last_peered":"2024-01-24T13:04:01.806814+0000","last_clean":"2024-01-24T13:04:01.806814+0000","last_became_active":"2024-01-24T13:04:00.044171+0000","last_became_peered":"2024-01-24T13:04:00.044171+0000","last_unstale":"2024-01-24T13:04:01.806814+0000","last_undegraded":"2024-01-24T13:04:01.806814+0000","last_fullsized":"2024-01-24T13:04:01.806814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:14:04.213076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017241+0000","last_change":"2024-01-24T13:03:55.596925+0000","last_active":"2024-01-24T13:04:01.017241+0000","last_peered":"2024-01-24T13:04:01.017241+0000","last_clean":"2024-01-24T13:04:01.017241+0000","last_became_active":"2024-01-24T13:03:55.596539+0000","last_became_peered":"2024-01-24T13:03:55.596539+0000","last_unstale":"2024-01-24T13:04:01.017241+0000","last_undegraded":"2024-01-24T13:04:01.017241+0000","last_fullsized":"2024-01-24T13:04:01.017241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:18.551398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017244+0000","last_change":"2024-01-24T13:03:56.010228+0000","last_active":"2024-01-24T13:04:01.017244+0000","last_peered":"2024-01-24T13:04:01.017244+0000","last_clean":"2024-01-24T13:04:01.017244+0000","last_became_active":"2024-01-24T13:03:56.009920+0000","last_became_peered":"2024-01-24T13:03:56.009920+0000","last_unstale":"2024-01-24T13:04:01.017244+0000","last_undegraded":"2024-01-24T13:04:01.017244+0000","last_fullsized":"2024-01-24T13:04:01.017244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:33:22.274202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805044+0000","last_change":"2024-01-24T13:04:00.036039+0000","last_active":"2024-01-24T13:04:01.805044+0000","last_peered":"2024-01-24T13:04:01.805044+0000","last_clean":"2024-01-24T13:04:01.805044+0000","last_became_active":"2024-01-24T13:04:00.035441+0000","last_became_peered":"2024-01-24T13:04:00.035441+0000","last_unstale":"2024-01-24T13:04:01.805044+0000","last_undegraded":"2024-01-24T13:04:01.805044+0000","last_fullsized":"2024-01-24T13:04:01.805044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:18:37.828066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.031062+0000","last_change":"2024-01-24T13:03:55.601607+0000","last_active":"2024-01-24T13:04:00.031062+0000","last_peered":"2024-01-24T13:04:00.031062+0000","last_clean":"2024-01-24T13:04:00.031062+0000","last_became_active":"2024-01-24T13:03:55.601320+0000","last_became_peered":"2024-01-24T13:03:55.601320+0000","last_unstale":"2024-01-24T13:04:00.031062+0000","last_undegraded":"2024-01-24T13:04:00.031062+0000","last_fullsized":"2024-01-24T13:04:00.031062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:12.091224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021279+0000","last_change":"2024-01-24T13:03:56.022848+0000","last_active":"2024-01-24T13:04:00.021279+0000","last_peered":"2024-01-24T13:04:00.021279+0000","last_clean":"2024-01-24T13:04:00.021279+0000","last_became_active":"2024-01-24T13:03:56.022529+0000","last_became_peered":"2024-01-24T13:03:56.022529+0000","last_unstale":"2024-01-24T13:04:00.021279+0000","last_undegraded":"2024-01-24T13:04:00.021279+0000","last_fullsized":"2024-01-24T13:04:00.021279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:02.421483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806130+0000","last_change":"2024-01-24T13:04:00.052590+0000","last_active":"2024-01-24T13:04:01.806130+0000","last_peered":"2024-01-24T13:04:01.806130+0000","last_clean":"2024-01-24T13:04:01.806130+0000","last_became_active":"2024-01-24T13:04:00.052118+0000","last_became_peered":"2024-01-24T13:04:00.052118+0000","last_unstale":"2024-01-24T13:04:01.806130+0000","last_undegraded":"2024-01-24T13:04:01.806130+0000","last_fullsized":"2024-01-24T13:04:01.806130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:50:50.867503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.026082+0000","last_change":"2024-01-24T13:03:55.605745+0000","last_active":"2024-01-24T13:04:00.026082+0000","last_peered":"2024-01-24T13:04:00.026082+0000","last_clean":"2024-01-24T13:04:00.026082+0000","last_became_active":"2024-01-24T13:03:55.605321+0000","last_became_peered":"2024-01-24T13:03:55.605321+0000","last_unstale":"2024-01-24T13:04:00.026082+0000","last_undegraded":"2024-01-24T13:04:00.026082+0000","last_fullsized":"2024-01-24T13:04:00.026082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:01.413713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013678+0000","last_change":"2024-01-24T13:03:56.024669+0000","last_active":"2024-01-24T13:04:00.013678+0000","last_peered":"2024-01-24T13:04:00.013678+0000","last_clean":"2024-01-24T13:04:00.013678+0000","last_became_active":"2024-01-24T13:03:56.024411+0000","last_became_peered":"2024-01-24T13:03:56.024411+0000","last_unstale":"2024-01-24T13:04:00.013678+0000","last_undegraded":"2024-01-24T13:04:00.013678+0000","last_fullsized":"2024-01-24T13:04:00.013678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:26:46.456477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805258+0000","last_change":"2024-01-24T13:04:00.051526+0000","last_active":"2024-01-24T13:04:01.805258+0000","last_peered":"2024-01-24T13:04:01.805258+0000","last_clean":"2024-01-24T13:04:01.805258+0000","last_became_active":"2024-01-24T13:04:00.046616+0000","last_became_peered":"2024-01-24T13:04:00.046616+0000","last_unstale":"2024-01-24T13:04:01.805258+0000","last_undegraded":"2024-01-24T13:04:01.805258+0000","last_fullsized":"2024-01-24T13:04:01.805258+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:04.738538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011521+0000","last_change":"2024-01-24T13:03:56.015309+0000","last_active":"2024-01-24T13:04:00.011521+0000","last_peered":"2024-01-24T13:04:00.011521+0000","last_clean":"2024-01-24T13:04:00.011521+0000","last_became_active":"2024-01-24T13:03:56.015046+0000","last_became_peered":"2024-01-24T13:03:56.015046+0000","last_unstale":"2024-01-24T13:04:00.011521+0000","last_undegraded":"2024-01-24T13:04:00.011521+0000","last_fullsized":"2024-01-24T13:04:00.011521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:25:17.038527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011674+0000","last_change":"2024-01-24T13:03:55.597378+0000","last_active":"2024-01-24T13:04:00.011674+0000","last_peered":"2024-01-24T13:04:00.011674+0000","last_clean":"2024-01-24T13:04:00.011674+0000","last_became_active":"2024-01-24T13:03:55.597128+0000","last_became_peered":"2024-01-24T13:03:55.597128+0000","last_unstale":"2024-01-24T13:04:00.011674+0000","last_undegraded":"2024-01-24T13:04:00.011674+0000","last_fullsized":"2024-01-24T13:04:00.011674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:41:52.439330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806109+0000","last_change":"2024-01-24T13:04:00.049793+0000","last_active":"2024-01-24T13:04:01.806109+0000","last_peered":"2024-01-24T13:04:01.806109+0000","last_clean":"2024-01-24T13:04:01.806109+0000","last_became_active":"2024-01-24T13:04:00.049395+0000","last_became_peered":"2024-01-24T13:04:00.049395+0000","last_unstale":"2024-01-24T13:04:01.806109+0000","last_undegraded":"2024-01-24T13:04:01.806109+0000","last_fullsized":"2024-01-24T13:04:01.806109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:31:27.768822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016628+0000","last_change":"2024-01-24T13:03:56.015127+0000","last_active":"2024-01-24T13:04:01.016628+0000","last_peered":"2024-01-24T13:04:01.016628+0000","last_clean":"2024-01-24T13:04:01.016628+0000","last_became_active":"2024-01-24T13:03:56.014713+0000","last_became_peered":"2024-01-24T13:03:56.014713+0000","last_unstale":"2024-01-24T13:04:01.016628+0000","last_undegraded":"2024-01-24T13:04:01.016628+0000","last_fullsized":"2024-01-24T13:04:01.016628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:13.098994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017134+0000","last_change":"2024-01-24T13:03:55.601999+0000","last_active":"2024-01-24T13:04:00.017134+0000","last_peered":"2024-01-24T13:04:00.017134+0000","last_clean":"2024-01-24T13:04:00.017134+0000","last_became_active":"2024-01-24T13:03:55.601673+0000","last_became_peered":"2024-01-24T13:03:55.601673+0000","last_unstale":"2024-01-24T13:04:00.017134+0000","last_undegraded":"2024-01-24T13:04:00.017134+0000","last_fullsized":"2024-01-24T13:04:00.017134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:45:36.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.146739+0000","last_change":"2024-01-24T13:04:00.044536+0000","last_active":"2024-01-24T13:04:01.146739+0000","last_peered":"2024-01-24T13:04:01.146739+0000","last_clean":"2024-01-24T13:04:01.146739+0000","last_became_active":"2024-01-24T13:04:00.044138+0000","last_became_peered":"2024-01-24T13:04:00.044138+0000","last_unstale":"2024-01-24T13:04:01.146739+0000","last_undegraded":"2024-01-24T13:04:01.146739+0000","last_fullsized":"2024-01-24T13:04:01.146739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017399+0000","last_change":"2024-01-24T13:03:56.012647+0000","last_active":"2024-01-24T13:04:00.017399+0000","last_peered":"2024-01-24T13:04:00.017399+0000","last_clean":"2024-01-24T13:04:00.017399+0000","last_became_active":"2024-01-24T13:03:56.012253+0000","last_became_peered":"2024-01-24T13:03:56.012253+0000","last_unstale":"2024-01-24T13:04:00.017399+0000","last_undegraded":"2024-01-24T13:04:00.017399+0000","last_fullsized":"2024-01-24T13:04:00.017399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:24:10.805392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019610+0000","last_change":"2024-01-24T13:03:55.607929+0000","last_active":"2024-01-24T13:04:00.019610+0000","last_peered":"2024-01-24T13:04:00.019610+0000","last_clean":"2024-01-24T13:04:00.019610+0000","last_became_active":"2024-01-24T13:03:55.607579+0000","last_became_peered":"2024-01-24T13:03:55.607579+0000","last_unstale":"2024-01-24T13:04:00.019610+0000","last_undegraded":"2024-01-24T13:04:00.019610+0000","last_fullsized":"2024-01-24T13:04:00.019610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:47:45.731340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806758+0000","last_change":"2024-01-24T13:04:00.042942+0000","last_active":"2024-01-24T13:04:01.806758+0000","last_peered":"2024-01-24T13:04:01.806758+0000","last_clean":"2024-01-24T13:04:01.806758+0000","last_became_active":"2024-01-24T13:04:00.042539+0000","last_became_peered":"2024-01-24T13:04:00.042539+0000","last_unstale":"2024-01-24T13:04:01.806758+0000","last_undegraded":"2024-01-24T13:04:01.806758+0000","last_fullsized":"2024-01-24T13:04:01.806758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:44:50.908587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011397+0000","last_change":"2024-01-24T13:03:56.012053+0000","last_active":"2024-01-24T13:04:00.011397+0000","last_peered":"2024-01-24T13:04:00.011397+0000","last_clean":"2024-01-24T13:04:00.011397+0000","last_became_active":"2024-01-24T13:03:56.011812+0000","last_became_peered":"2024-01-24T13:03:56.011812+0000","last_unstale":"2024-01-24T13:04:00.011397+0000","last_undegraded":"2024-01-24T13:04:00.011397+0000","last_fullsized":"2024-01-24T13:04:00.011397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:32.185320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021271+0000","last_change":"2024-01-24T13:03:55.595674+0000","last_active":"2024-01-24T13:04:00.021271+0000","last_peered":"2024-01-24T13:04:00.021271+0000","last_clean":"2024-01-24T13:04:00.021271+0000","last_became_active":"2024-01-24T13:03:55.594833+0000","last_became_peered":"2024-01-24T13:03:55.594833+0000","last_unstale":"2024-01-24T13:04:00.021271+0000","last_undegraded":"2024-01-24T13:04:00.021271+0000","last_fullsized":"2024-01-24T13:04:00.021271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:54:35.340555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806952+0000","last_change":"2024-01-24T13:04:00.042902+0000","last_active":"2024-01-24T13:04:01.806952+0000","last_peered":"2024-01-24T13:04:01.806952+0000","last_clean":"2024-01-24T13:04:01.806952+0000","last_became_active":"2024-01-24T13:04:00.042120+0000","last_became_peered":"2024-01-24T13:04:00.042120+0000","last_unstale":"2024-01-24T13:04:01.806952+0000","last_undegraded":"2024-01-24T13:04:01.806952+0000","last_fullsized":"2024-01-24T13:04:01.806952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:48:26.063259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020230+0000","last_change":"2024-01-24T13:03:56.012262+0000","last_active":"2024-01-24T13:04:00.020230+0000","last_peered":"2024-01-24T13:04:00.020230+0000","last_clean":"2024-01-24T13:04:00.020230+0000","last_became_active":"2024-01-24T13:03:56.011966+0000","last_became_peered":"2024-01-24T13:03:56.011966+0000","last_unstale":"2024-01-24T13:04:00.020230+0000","last_undegraded":"2024-01-24T13:04:00.020230+0000","last_fullsized":"2024-01-24T13:04:00.020230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:17:34.235081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.012933+0000","last_change":"2024-01-24T13:03:55.607257+0000","last_active":"2024-01-24T13:04:00.012933+0000","last_peered":"2024-01-24T13:04:00.012933+0000","last_clean":"2024-01-24T13:04:00.012933+0000","last_became_active":"2024-01-24T13:03:55.606021+0000","last_became_peered":"2024-01-24T13:03:55.606021+0000","last_unstale":"2024-01-24T13:04:00.012933+0000","last_undegraded":"2024-01-24T13:04:00.012933+0000","last_fullsized":"2024-01-24T13:04:00.012933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:45:36.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805293+0000","last_change":"2024-01-24T13:04:00.038690+0000","last_active":"2024-01-24T13:04:01.805293+0000","last_peered":"2024-01-24T13:04:01.805293+0000","last_clean":"2024-01-24T13:04:01.805293+0000","last_became_active":"2024-01-24T13:04:00.033603+0000","last_became_peered":"2024-01-24T13:04:00.033603+0000","last_unstale":"2024-01-24T13:04:01.805293+0000","last_undegraded":"2024-01-24T13:04:01.805293+0000","last_fullsized":"2024-01-24T13:04:01.805293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020685+0000","last_change":"2024-01-24T13:03:56.019251+0000","last_active":"2024-01-24T13:04:00.020685+0000","last_peered":"2024-01-24T13:04:00.020685+0000","last_clean":"2024-01-24T13:04:00.020685+0000","last_became_active":"2024-01-24T13:03:56.016877+0000","last_became_peered":"2024-01-24T13:03:56.016877+0000","last_unstale":"2024-01-24T13:04:00.020685+0000","last_undegraded":"2024-01-24T13:04:00.020685+0000","last_fullsized":"2024-01-24T13:04:00.020685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:02.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020421+0000","last_change":"2024-01-24T13:03:55.607924+0000","last_active":"2024-01-24T13:04:00.020421+0000","last_peered":"2024-01-24T13:04:00.020421+0000","last_clean":"2024-01-24T13:04:00.020421+0000","last_became_active":"2024-01-24T13:03:55.607591+0000","last_became_peered":"2024-01-24T13:03:55.607591+0000","last_unstale":"2024-01-24T13:04:00.020421+0000","last_undegraded":"2024-01-24T13:04:00.020421+0000","last_fullsized":"2024-01-24T13:04:00.020421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:13.842299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149029+0000","last_change":"2024-01-24T13:04:00.035477+0000","last_active":"2024-01-24T13:04:01.149029+0000","last_peered":"2024-01-24T13:04:01.149029+0000","last_clean":"2024-01-24T13:04:01.149029+0000","last_became_active":"2024-01-24T13:04:00.034981+0000","last_became_peered":"2024-01-24T13:04:00.034981+0000","last_unstale":"2024-01-24T13:04:01.149029+0000","last_undegraded":"2024-01-24T13:04:01.149029+0000","last_fullsized":"2024-01-24T13:04:01.149029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:04.738538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018375+0000","last_change":"2024-01-24T13:03:56.017993+0000","last_active":"2024-01-24T13:04:00.018375+0000","last_peered":"2024-01-24T13:04:00.018375+0000","last_clean":"2024-01-24T13:04:00.018375+0000","last_became_active":"2024-01-24T13:03:56.017682+0000","last_became_peered":"2024-01-24T13:03:56.017682+0000","last_unstale":"2024-01-24T13:04:00.018375+0000","last_undegraded":"2024-01-24T13:04:00.018375+0000","last_fullsized":"2024-01-24T13:04:00.018375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:46:24.457447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013622+0000","last_change":"2024-01-24T13:03:55.601678+0000","last_active":"2024-01-24T13:04:00.013622+0000","last_peered":"2024-01-24T13:04:00.013622+0000","last_clean":"2024-01-24T13:04:00.013622+0000","last_became_active":"2024-01-24T13:03:55.599824+0000","last_became_peered":"2024-01-24T13:03:55.599824+0000","last_unstale":"2024-01-24T13:04:00.013622+0000","last_undegraded":"2024-01-24T13:04:00.013622+0000","last_fullsized":"2024-01-24T13:04:00.013622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:01.413713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806924+0000","last_change":"2024-01-24T13:04:00.044489+0000","last_active":"2024-01-24T13:04:01.806924+0000","last_peered":"2024-01-24T13:04:01.806924+0000","last_clean":"2024-01-24T13:04:01.806924+0000","last_became_active":"2024-01-24T13:04:00.044090+0000","last_became_peered":"2024-01-24T13:04:00.044090+0000","last_unstale":"2024-01-24T13:04:01.806924+0000","last_undegraded":"2024-01-24T13:04:01.806924+0000","last_fullsized":"2024-01-24T13:04:01.806924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013877+0000","last_change":"2024-01-24T13:03:56.012608+0000","last_active":"2024-01-24T13:04:01.013877+0000","last_peered":"2024-01-24T13:04:01.013877+0000","last_clean":"2024-01-24T13:04:01.013877+0000","last_became_active":"2024-01-24T13:03:56.012369+0000","last_became_peered":"2024-01-24T13:03:56.012369+0000","last_unstale":"2024-01-24T13:04:01.013877+0000","last_undegraded":"2024-01-24T13:04:01.013877+0000","last_fullsized":"2024-01-24T13:04:01.013877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:02.421483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016565+0000","last_change":"2024-01-24T13:03:55.595049+0000","last_active":"2024-01-24T13:04:01.016565+0000","last_peered":"2024-01-24T13:04:01.016565+0000","last_clean":"2024-01-24T13:04:01.016565+0000","last_became_active":"2024-01-24T13:03:55.594748+0000","last_became_peered":"2024-01-24T13:03:55.594748+0000","last_unstale":"2024-01-24T13:04:01.016565+0000","last_undegraded":"2024-01-24T13:04:01.016565+0000","last_fullsized":"2024-01-24T13:04:01.016565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:54:02.325596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.807443+0000","last_change":"2024-01-24T13:04:00.052891+0000","last_active":"2024-01-24T13:04:01.807443+0000","last_peered":"2024-01-24T13:04:01.807443+0000","last_clean":"2024-01-24T13:04:01.807443+0000","last_became_active":"2024-01-24T13:04:00.051617+0000","last_became_peered":"2024-01-24T13:04:00.051617+0000","last_unstale":"2024-01-24T13:04:01.807443+0000","last_undegraded":"2024-01-24T13:04:01.807443+0000","last_fullsized":"2024-01-24T13:04:01.807443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:35.624217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.022993+0000","last_change":"2024-01-24T13:03:56.009995+0000","last_active":"2024-01-24T13:04:00.022993+0000","last_peered":"2024-01-24T13:04:00.022993+0000","last_clean":"2024-01-24T13:04:00.022993+0000","last_became_active":"2024-01-24T13:03:56.009662+0000","last_became_peered":"2024-01-24T13:03:56.009662+0000","last_unstale":"2024-01-24T13:04:00.022993+0000","last_undegraded":"2024-01-24T13:04:00.022993+0000","last_fullsized":"2024-01-24T13:04:00.022993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:28.956711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011686+0000","last_change":"2024-01-24T13:03:55.595933+0000","last_active":"2024-01-24T13:04:00.011686+0000","last_peered":"2024-01-24T13:04:00.011686+0000","last_clean":"2024-01-24T13:04:00.011686+0000","last_became_active":"2024-01-24T13:03:55.594957+0000","last_became_peered":"2024-01-24T13:03:55.594957+0000","last_unstale":"2024-01-24T13:04:00.011686+0000","last_undegraded":"2024-01-24T13:04:00.011686+0000","last_fullsized":"2024-01-24T13:04:00.011686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:12.091224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.808365+0000","last_change":"2024-01-24T13:04:00.045610+0000","last_active":"2024-01-24T13:04:01.808365+0000","last_peered":"2024-01-24T13:04:01.808365+0000","last_clean":"2024-01-24T13:04:01.808365+0000","last_became_active":"2024-01-24T13:04:00.044937+0000","last_became_peered":"2024-01-24T13:04:00.044937+0000","last_unstale":"2024-01-24T13:04:01.808365+0000","last_undegraded":"2024-01-24T13:04:01.808365+0000","last_fullsized":"2024-01-24T13:04:01.808365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T01:02:53.163148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015631+0000","last_change":"2024-01-24T13:03:56.016991+0000","last_active":"2024-01-24T13:04:01.015631+0000","last_peered":"2024-01-24T13:04:01.015631+0000","last_clean":"2024-01-24T13:04:01.015631+0000","last_became_active":"2024-01-24T13:03:56.016720+0000","last_became_peered":"2024-01-24T13:03:56.016720+0000","last_unstale":"2024-01-24T13:04:01.015631+0000","last_undegraded":"2024-01-24T13:04:01.015631+0000","last_fullsized":"2024-01-24T13:04:01.015631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:33:24.896330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016383+0000","last_change":"2024-01-24T13:03:55.598471+0000","last_active":"2024-01-24T13:04:01.016383+0000","last_peered":"2024-01-24T13:04:01.016383+0000","last_clean":"2024-01-24T13:04:01.016383+0000","last_became_active":"2024-01-24T13:03:55.598159+0000","last_became_peered":"2024-01-24T13:03:55.598159+0000","last_unstale":"2024-01-24T13:04:01.016383+0000","last_undegraded":"2024-01-24T13:04:01.016383+0000","last_fullsized":"2024-01-24T13:04:01.016383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:40:38.850663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806777+0000","last_change":"2024-01-24T13:04:00.040424+0000","last_active":"2024-01-24T13:04:01.806777+0000","last_peered":"2024-01-24T13:04:01.806777+0000","last_clean":"2024-01-24T13:04:01.806777+0000","last_became_active":"2024-01-24T13:04:00.038744+0000","last_became_peered":"2024-01-24T13:04:00.038744+0000","last_unstale":"2024-01-24T13:04:01.806777+0000","last_undegraded":"2024-01-24T13:04:01.806777+0000","last_fullsized":"2024-01-24T13:04:01.806777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:48:26.063259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018273+0000","last_change":"2024-01-24T13:03:56.014411+0000","last_active":"2024-01-24T13:04:00.018273+0000","last_peered":"2024-01-24T13:04:00.018273+0000","last_clean":"2024-01-24T13:04:00.018273+0000","last_became_active":"2024-01-24T13:03:56.014076+0000","last_became_peered":"2024-01-24T13:03:56.014076+0000","last_unstale":"2024-01-24T13:04:00.018273+0000","last_undegraded":"2024-01-24T13:04:00.018273+0000","last_fullsized":"2024-01-24T13:04:00.018273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:13.098994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011676+0000","last_change":"2024-01-24T13:03:55.603197+0000","last_active":"2024-01-24T13:04:00.011676+0000","last_peered":"2024-01-24T13:04:00.011676+0000","last_clean":"2024-01-24T13:04:00.011676+0000","last_became_active":"2024-01-24T13:03:55.600175+0000","last_became_peered":"2024-01-24T13:03:55.600175+0000","last_unstale":"2024-01-24T13:04:00.011676+0000","last_undegraded":"2024-01-24T13:04:00.011676+0000","last_fullsized":"2024-01-24T13:04:00.011676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:30:38.906451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016791+0000","last_change":"2024-01-24T13:04:00.049384+0000","last_active":"2024-01-24T13:04:01.016791+0000","last_peered":"2024-01-24T13:04:01.016791+0000","last_clean":"2024-01-24T13:04:01.016791+0000","last_became_active":"2024-01-24T13:04:00.048632+0000","last_became_peered":"2024-01-24T13:04:00.048632+0000","last_unstale":"2024-01-24T13:04:01.016791+0000","last_undegraded":"2024-01-24T13:04:01.016791+0000","last_fullsized":"2024-01-24T13:04:01.016791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:06:53.027528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019637+0000","last_change":"2024-01-24T13:03:56.018433+0000","last_active":"2024-01-24T13:04:00.019637+0000","last_peered":"2024-01-24T13:04:00.019637+0000","last_clean":"2024-01-24T13:04:00.019637+0000","last_became_active":"2024-01-24T13:03:56.018164+0000","last_became_peered":"2024-01-24T13:03:56.018164+0000","last_unstale":"2024-01-24T13:04:00.019637+0000","last_undegraded":"2024-01-24T13:04:00.019637+0000","last_fullsized":"2024-01-24T13:04:00.019637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:26:27.582337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011717+0000","last_change":"2024-01-24T13:03:55.597798+0000","last_active":"2024-01-24T13:04:00.011717+0000","last_peered":"2024-01-24T13:04:00.011717+0000","last_clean":"2024-01-24T13:04:00.011717+0000","last_became_active":"2024-01-24T13:03:55.597513+0000","last_became_peered":"2024-01-24T13:03:55.597513+0000","last_unstale":"2024-01-24T13:04:00.011717+0000","last_undegraded":"2024-01-24T13:04:00.011717+0000","last_fullsized":"2024-01-24T13:04:00.011717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:18:51.734678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.023086+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:04:00.023086+0000","last_peered":"2024-01-24T13:04:00.023086+0000","last_clean":"2024-01-24T13:04:00.023086+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:04:00.023086+0000","last_undegraded":"2024-01-24T13:04:00.023086+0000","last_fullsized":"2024-01-24T13:04:00.023086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806680+0000","last_change":"2024-01-24T13:04:00.038740+0000","last_active":"2024-01-24T13:04:01.806680+0000","last_peered":"2024-01-24T13:04:01.806680+0000","last_clean":"2024-01-24T13:04:01.806680+0000","last_became_active":"2024-01-24T13:04:00.038231+0000","last_became_peered":"2024-01-24T13:04:00.038231+0000","last_unstale":"2024-01-24T13:04:01.806680+0000","last_undegraded":"2024-01-24T13:04:01.806680+0000","last_fullsized":"2024-01-24T13:04:01.806680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:08:54.372154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.012909+0000","last_change":"2024-01-24T13:03:56.016055+0000","last_active":"2024-01-24T13:04:00.012909+0000","last_peered":"2024-01-24T13:04:00.012909+0000","last_clean":"2024-01-24T13:04:00.012909+0000","last_became_active":"2024-01-24T13:03:56.015784+0000","last_became_peered":"2024-01-24T13:03:56.015784+0000","last_unstale":"2024-01-24T13:04:00.012909+0000","last_undegraded":"2024-01-24T13:04:00.012909+0000","last_fullsized":"2024-01-24T13:04:00.012909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:37:02.929160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018991+0000","last_change":"2024-01-24T13:03:55.608578+0000","last_active":"2024-01-24T13:04:00.018991+0000","last_peered":"2024-01-24T13:04:00.018991+0000","last_clean":"2024-01-24T13:04:00.018991+0000","last_became_active":"2024-01-24T13:03:55.608223+0000","last_became_peered":"2024-01-24T13:03:55.608223+0000","last_unstale":"2024-01-24T13:04:00.018991+0000","last_undegraded":"2024-01-24T13:04:00.018991+0000","last_fullsized":"2024-01-24T13:04:00.018991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:40:38.850663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805871+0000","last_change":"2024-01-24T13:04:00.036185+0000","last_active":"2024-01-24T13:04:01.805871+0000","last_peered":"2024-01-24T13:04:01.805871+0000","last_clean":"2024-01-24T13:04:01.805871+0000","last_became_active":"2024-01-24T13:04:00.035683+0000","last_became_peered":"2024-01-24T13:04:00.035683+0000","last_unstale":"2024-01-24T13:04:01.805871+0000","last_undegraded":"2024-01-24T13:04:01.805871+0000","last_fullsized":"2024-01-24T13:04:01.805871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:35.010431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.025989+0000","last_change":"2024-01-24T13:03:56.010590+0000","last_active":"2024-01-24T13:04:00.025989+0000","last_peered":"2024-01-24T13:04:00.025989+0000","last_clean":"2024-01-24T13:04:00.025989+0000","last_became_active":"2024-01-24T13:03:56.010337+0000","last_became_peered":"2024-01-24T13:03:56.010337+0000","last_unstale":"2024-01-24T13:04:00.025989+0000","last_undegraded":"2024-01-24T13:04:00.025989+0000","last_fullsized":"2024-01-24T13:04:00.025989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:33:30.023414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016888+0000","last_change":"2024-01-24T13:03:55.598738+0000","last_active":"2024-01-24T13:04:01.016888+0000","last_peered":"2024-01-24T13:04:01.016888+0000","last_clean":"2024-01-24T13:04:01.016888+0000","last_became_active":"2024-01-24T13:03:55.598468+0000","last_became_peered":"2024-01-24T13:03:55.598468+0000","last_unstale":"2024-01-24T13:04:01.016888+0000","last_undegraded":"2024-01-24T13:04:01.016888+0000","last_fullsized":"2024-01-24T13:04:01.016888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:33:00.188281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016100+0000","last_change":"2024-01-24T13:04:00.047084+0000","last_active":"2024-01-24T13:04:01.016100+0000","last_peered":"2024-01-24T13:04:01.016100+0000","last_clean":"2024-01-24T13:04:01.016100+0000","last_became_active":"2024-01-24T13:04:00.046694+0000","last_became_peered":"2024-01-24T13:04:00.046694+0000","last_unstale":"2024-01-24T13:04:01.016100+0000","last_undegraded":"2024-01-24T13:04:01.016100+0000","last_fullsized":"2024-01-24T13:04:01.016100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:11:37.105076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.028935+0000","last_change":"2024-01-24T13:03:56.011152+0000","last_active":"2024-01-24T13:04:00.028935+0000","last_peered":"2024-01-24T13:04:00.028935+0000","last_clean":"2024-01-24T13:04:00.028935+0000","last_became_active":"2024-01-24T13:03:56.010924+0000","last_became_peered":"2024-01-24T13:03:56.010924+0000","last_unstale":"2024-01-24T13:04:00.028935+0000","last_undegraded":"2024-01-24T13:04:00.028935+0000","last_fullsized":"2024-01-24T13:04:00.028935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:14:00.774178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020323+0000","last_change":"2024-01-24T13:03:55.602406+0000","last_active":"2024-01-24T13:04:00.020323+0000","last_peered":"2024-01-24T13:04:00.020323+0000","last_clean":"2024-01-24T13:04:00.020323+0000","last_became_active":"2024-01-24T13:03:55.601915+0000","last_became_peered":"2024-01-24T13:03:55.601915+0000","last_unstale":"2024-01-24T13:04:00.020323+0000","last_undegraded":"2024-01-24T13:04:00.020323+0000","last_fullsized":"2024-01-24T13:04:00.020323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:02:25.134363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805322+0000","last_change":"2024-01-24T13:04:00.028655+0000","last_active":"2024-01-24T13:04:01.805322+0000","last_peered":"2024-01-24T13:04:01.805322+0000","last_clean":"2024-01-24T13:04:01.805322+0000","last_became_active":"2024-01-24T13:04:00.028105+0000","last_became_peered":"2024-01-24T13:04:00.028105+0000","last_unstale":"2024-01-24T13:04:01.805322+0000","last_undegraded":"2024-01-24T13:04:01.805322+0000","last_fullsized":"2024-01-24T13:04:01.805322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:54:22.271694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013786+0000","last_change":"2024-01-24T13:03:56.002044+0000","last_active":"2024-01-24T13:04:01.013786+0000","last_peered":"2024-01-24T13:04:01.013786+0000","last_clean":"2024-01-24T13:04:01.013786+0000","last_became_active":"2024-01-24T13:03:56.001772+0000","last_became_peered":"2024-01-24T13:03:56.001772+0000","last_unstale":"2024-01-24T13:04:01.013786+0000","last_undegraded":"2024-01-24T13:04:01.013786+0000","last_fullsized":"2024-01-24T13:04:01.013786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:54:36.348326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.029043+0000","last_change":"2024-01-24T13:03:55.601600+0000","last_active":"2024-01-24T13:04:00.029043+0000","last_peered":"2024-01-24T13:04:00.029043+0000","last_clean":"2024-01-24T13:04:00.029043+0000","last_became_active":"2024-01-24T13:03:55.601309+0000","last_became_peered":"2024-01-24T13:03:55.601309+0000","last_unstale":"2024-01-24T13:04:00.029043+0000","last_undegraded":"2024-01-24T13:04:00.029043+0000","last_fullsized":"2024-01-24T13:04:00.029043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:39.217211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.652527+0000","last_change":"2024-01-24T13:04:00.048932+0000","last_active":"2024-01-24T13:04:01.652527+0000","last_peered":"2024-01-24T13:04:01.652527+0000","last_clean":"2024-01-24T13:04:01.652527+0000","last_became_active":"2024-01-24T13:04:00.048532+0000","last_became_peered":"2024-01-24T13:04:00.048532+0000","last_unstale":"2024-01-24T13:04:01.652527+0000","last_undegraded":"2024-01-24T13:04:01.652527+0000","last_fullsized":"2024-01-24T13:04:01.652527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:46:41.343291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011316+0000","last_change":"2024-01-24T13:03:56.014290+0000","last_active":"2024-01-24T13:04:00.011316+0000","last_peered":"2024-01-24T13:04:00.011316+0000","last_clean":"2024-01-24T13:04:00.011316+0000","last_became_active":"2024-01-24T13:03:56.014029+0000","last_became_peered":"2024-01-24T13:03:56.014029+0000","last_unstale":"2024-01-24T13:04:00.011316+0000","last_undegraded":"2024-01-24T13:04:00.011316+0000","last_fullsized":"2024-01-24T13:04:00.011316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:09:08.217574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017500+0000","last_change":"2024-01-24T13:03:55.600217+0000","last_active":"2024-01-24T13:04:00.017500+0000","last_peered":"2024-01-24T13:04:00.017500+0000","last_clean":"2024-01-24T13:04:00.017500+0000","last_became_active":"2024-01-24T13:03:55.599923+0000","last_became_peered":"2024-01-24T13:03:55.599923+0000","last_unstale":"2024-01-24T13:04:00.017500+0000","last_undegraded":"2024-01-24T13:04:00.017500+0000","last_fullsized":"2024-01-24T13:04:00.017500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:23:39.711167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017117+0000","last_change":"2024-01-24T13:04:00.049088+0000","last_active":"2024-01-24T13:04:01.017117+0000","last_peered":"2024-01-24T13:04:01.017117+0000","last_clean":"2024-01-24T13:04:01.017117+0000","last_became_active":"2024-01-24T13:04:00.048038+0000","last_became_peered":"2024-01-24T13:04:00.048038+0000","last_unstale":"2024-01-24T13:04:01.017117+0000","last_undegraded":"2024-01-24T13:04:01.017117+0000","last_fullsized":"2024-01-24T13:04:01.017117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:25:56.475987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021646+0000","last_change":"2024-01-24T13:03:56.025258+0000","last_active":"2024-01-24T13:04:00.021646+0000","last_peered":"2024-01-24T13:04:00.021646+0000","last_clean":"2024-01-24T13:04:00.021646+0000","last_became_active":"2024-01-24T13:03:56.025008+0000","last_became_peered":"2024-01-24T13:03:56.025008+0000","last_unstale":"2024-01-24T13:04:00.021646+0000","last_undegraded":"2024-01-24T13:04:00.021646+0000","last_fullsized":"2024-01-24T13:04:00.021646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:13.098994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021114+0000","last_change":"2024-01-24T13:03:55.606138+0000","last_active":"2024-01-24T13:04:00.021114+0000","last_peered":"2024-01-24T13:04:00.021114+0000","last_clean":"2024-01-24T13:04:00.021114+0000","last_became_active":"2024-01-24T13:03:55.605730+0000","last_became_peered":"2024-01-24T13:03:55.605730+0000","last_unstale":"2024-01-24T13:04:00.021114+0000","last_undegraded":"2024-01-24T13:04:00.021114+0000","last_fullsized":"2024-01-24T13:04:00.021114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:13.842299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017136+0000","last_change":"2024-01-24T13:04:00.047326+0000","last_active":"2024-01-24T13:04:01.017136+0000","last_peered":"2024-01-24T13:04:01.017136+0000","last_clean":"2024-01-24T13:04:01.017136+0000","last_became_active":"2024-01-24T13:04:00.046914+0000","last_became_peered":"2024-01-24T13:04:00.046914+0000","last_unstale":"2024-01-24T13:04:01.017136+0000","last_undegraded":"2024-01-24T13:04:01.017136+0000","last_fullsized":"2024-01-24T13:04:01.017136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:55:11.375322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011611+0000","last_change":"2024-01-24T13:03:56.023957+0000","last_active":"2024-01-24T13:04:00.011611+0000","last_peered":"2024-01-24T13:04:00.011611+0000","last_clean":"2024-01-24T13:04:00.011611+0000","last_became_active":"2024-01-24T13:03:56.022133+0000","last_became_peered":"2024-01-24T13:03:56.022133+0000","last_unstale":"2024-01-24T13:04:00.011611+0000","last_undegraded":"2024-01-24T13:04:00.011611+0000","last_fullsized":"2024-01-24T13:04:00.011611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:14:00.774178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011695+0000","last_change":"2024-01-24T13:03:55.596366+0000","last_active":"2024-01-24T13:04:00.011695+0000","last_peered":"2024-01-24T13:04:00.011695+0000","last_clean":"2024-01-24T13:04:00.011695+0000","last_became_active":"2024-01-24T13:03:55.593651+0000","last_became_peered":"2024-01-24T13:03:55.593651+0000","last_unstale":"2024-01-24T13:04:00.011695+0000","last_undegraded":"2024-01-24T13:04:00.011695+0000","last_fullsized":"2024-01-24T13:04:00.011695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:39.217211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.807643+0000","last_change":"2024-01-24T13:04:00.045823+0000","last_active":"2024-01-24T13:04:01.807643+0000","last_peered":"2024-01-24T13:04:01.807643+0000","last_clean":"2024-01-24T13:04:01.807643+0000","last_became_active":"2024-01-24T13:04:00.045308+0000","last_became_peered":"2024-01-24T13:04:00.045308+0000","last_unstale":"2024-01-24T13:04:01.807643+0000","last_undegraded":"2024-01-24T13:04:01.807643+0000","last_fullsized":"2024-01-24T13:04:01.807643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:48:59.613697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017004+0000","last_change":"2024-01-24T13:03:56.006377+0000","last_active":"2024-01-24T13:04:00.017004+0000","last_peered":"2024-01-24T13:04:00.017004+0000","last_clean":"2024-01-24T13:04:00.017004+0000","last_became_active":"2024-01-24T13:03:56.006045+0000","last_became_peered":"2024-01-24T13:03:56.006045+0000","last_unstale":"2024-01-24T13:04:00.017004+0000","last_undegraded":"2024-01-24T13:04:00.017004+0000","last_fullsized":"2024-01-24T13:04:00.017004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:30:39.914222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016729+0000","last_change":"2024-01-24T13:03:55.606775+0000","last_active":"2024-01-24T13:04:01.016729+0000","last_peered":"2024-01-24T13:04:01.016729+0000","last_clean":"2024-01-24T13:04:01.016729+0000","last_became_active":"2024-01-24T13:03:55.606406+0000","last_became_peered":"2024-01-24T13:03:55.606406+0000","last_unstale":"2024-01-24T13:04:01.016729+0000","last_undegraded":"2024-01-24T13:04:01.016729+0000","last_fullsized":"2024-01-24T13:04:01.016729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:03:38.642654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806328+0000","last_change":"2024-01-24T13:04:00.049217+0000","last_active":"2024-01-24T13:04:01.806328+0000","last_peered":"2024-01-24T13:04:01.806328+0000","last_clean":"2024-01-24T13:04:01.806328+0000","last_became_active":"2024-01-24T13:04:00.048805+0000","last_became_peered":"2024-01-24T13:04:00.048805+0000","last_unstale":"2024-01-24T13:04:01.806328+0000","last_undegraded":"2024-01-24T13:04:01.806328+0000","last_fullsized":"2024-01-24T13:04:01.806328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:51:50.366250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.031010+0000","last_change":"2024-01-24T13:03:56.016870+0000","last_active":"2024-01-24T13:04:00.031010+0000","last_peered":"2024-01-24T13:04:00.031010+0000","last_clean":"2024-01-24T13:04:00.031010+0000","last_became_active":"2024-01-24T13:03:56.016600+0000","last_became_peered":"2024-01-24T13:03:56.016600+0000","last_unstale":"2024-01-24T13:04:00.031010+0000","last_undegraded":"2024-01-24T13:04:00.031010+0000","last_fullsized":"2024-01-24T13:04:00.031010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:50:02.158087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'10","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:11.278469+0000","last_change":"2024-01-24T13:03:55.600760+0000","last_active":"2024-01-24T13:04:11.278469+0000","last_peered":"2024-01-24T13:04:11.278469+0000","last_clean":"2024-01-24T13:04:11.278469+0000","last_became_active":"2024-01-24T13:03:55.600478+0000","last_became_peered":"2024-01-24T13:03:55.600478+0000","last_unstale":"2024-01-24T13:04:11.278469+0000","last_undegraded":"2024-01-24T13:04:11.278469+0000","last_fullsized":"2024-01-24T13:04:11.278469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:35:44.393474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149129+0000","last_change":"2024-01-24T13:04:00.047921+0000","last_active":"2024-01-24T13:04:01.149129+0000","last_peered":"2024-01-24T13:04:01.149129+0000","last_clean":"2024-01-24T13:04:01.149129+0000","last_became_active":"2024-01-24T13:04:00.047461+0000","last_became_peered":"2024-01-24T13:04:00.047461+0000","last_unstale":"2024-01-24T13:04:01.149129+0000","last_undegraded":"2024-01-24T13:04:01.149129+0000","last_fullsized":"2024-01-24T13:04:01.149129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:35.010431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011713+0000","last_change":"2024-01-24T13:03:56.019212+0000","last_active":"2024-01-24T13:04:00.011713+0000","last_peered":"2024-01-24T13:04:00.011713+0000","last_clean":"2024-01-24T13:04:00.011713+0000","last_became_active":"2024-01-24T13:03:56.018880+0000","last_became_peered":"2024-01-24T13:03:56.018880+0000","last_unstale":"2024-01-24T13:04:00.011713+0000","last_undegraded":"2024-01-24T13:04:00.011713+0000","last_fullsized":"2024-01-24T13:04:00.011713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T01:02:49.724251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017145+0000","last_change":"2024-01-24T13:03:55.599109+0000","last_active":"2024-01-24T13:04:01.017145+0000","last_peered":"2024-01-24T13:04:01.017145+0000","last_clean":"2024-01-24T13:04:01.017145+0000","last_became_active":"2024-01-24T13:03:55.598819+0000","last_became_peered":"2024-01-24T13:03:55.598819+0000","last_unstale":"2024-01-24T13:04:01.017145+0000","last_undegraded":"2024-01-24T13:04:01.017145+0000","last_fullsized":"2024-01-24T13:04:01.017145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:45:36.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806220+0000","last_change":"2024-01-24T13:04:00.039074+0000","last_active":"2024-01-24T13:04:01.806220+0000","last_peered":"2024-01-24T13:04:01.806220+0000","last_clean":"2024-01-24T13:04:01.806220+0000","last_became_active":"2024-01-24T13:04:00.038717+0000","last_became_peered":"2024-01-24T13:04:00.038717+0000","last_unstale":"2024-01-24T13:04:01.806220+0000","last_undegraded":"2024-01-24T13:04:01.806220+0000","last_fullsized":"2024-01-24T13:04:01.806220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:16:03.907815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017269+0000","last_change":"2024-01-24T13:03:56.012177+0000","last_active":"2024-01-24T13:04:01.017269+0000","last_peered":"2024-01-24T13:04:01.017269+0000","last_clean":"2024-01-24T13:04:01.017269+0000","last_became_active":"2024-01-24T13:03:56.011917+0000","last_became_peered":"2024-01-24T13:03:56.011917+0000","last_unstale":"2024-01-24T13:04:01.017269+0000","last_undegraded":"2024-01-24T13:04:01.017269+0000","last_fullsized":"2024-01-24T13:04:01.017269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:37.212289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.028063+0000","last_change":"2024-01-24T13:03:55.602617+0000","last_active":"2024-01-24T13:04:00.028063+0000","last_peered":"2024-01-24T13:04:00.028063+0000","last_clean":"2024-01-24T13:04:00.028063+0000","last_became_active":"2024-01-24T13:03:55.602297+0000","last_became_peered":"2024-01-24T13:03:55.602297+0000","last_unstale":"2024-01-24T13:04:00.028063+0000","last_undegraded":"2024-01-24T13:04:00.028063+0000","last_fullsized":"2024-01-24T13:04:00.028063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:08.959080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806443+0000","last_change":"2024-01-24T13:04:00.043082+0000","last_active":"2024-01-24T13:04:01.806443+0000","last_peered":"2024-01-24T13:04:01.806443+0000","last_clean":"2024-01-24T13:04:01.806443+0000","last_became_active":"2024-01-24T13:04:00.042663+0000","last_became_peered":"2024-01-24T13:04:00.042663+0000","last_unstale":"2024-01-24T13:04:01.806443+0000","last_undegraded":"2024-01-24T13:04:01.806443+0000","last_fullsized":"2024-01-24T13:04:01.806443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:13:01.067406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013739+0000","last_change":"2024-01-24T13:03:56.007996+0000","last_active":"2024-01-24T13:04:01.013739+0000","last_peered":"2024-01-24T13:04:01.013739+0000","last_clean":"2024-01-24T13:04:01.013739+0000","last_became_active":"2024-01-24T13:03:56.006784+0000","last_became_peered":"2024-01-24T13:03:56.006784+0000","last_unstale":"2024-01-24T13:04:01.013739+0000","last_undegraded":"2024-01-24T13:04:01.013739+0000","last_fullsized":"2024-01-24T13:04:01.013739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:18:52.742448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.022444+0000","last_change":"2024-01-24T13:03:55.598172+0000","last_active":"2024-01-24T13:04:00.022444+0000","last_peered":"2024-01-24T13:04:00.022444+0000","last_clean":"2024-01-24T13:04:00.022444+0000","last_became_active":"2024-01-24T13:03:55.597945+0000","last_became_peered":"2024-01-24T13:03:55.597945+0000","last_unstale":"2024-01-24T13:04:00.022444+0000","last_undegraded":"2024-01-24T13:04:00.022444+0000","last_fullsized":"2024-01-24T13:04:00.022444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:40:38.850663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149379+0000","last_change":"2024-01-24T13:04:00.033699+0000","last_active":"2024-01-24T13:04:01.149379+0000","last_peered":"2024-01-24T13:04:01.149379+0000","last_clean":"2024-01-24T13:04:01.149379+0000","last_became_active":"2024-01-24T13:04:00.032771+0000","last_became_peered":"2024-01-24T13:04:00.032771+0000","last_unstale":"2024-01-24T13:04:01.149379+0000","last_undegraded":"2024-01-24T13:04:01.149379+0000","last_fullsized":"2024-01-24T13:04:01.149379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:16:03.907815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.150744+0000","last_change":"2024-01-24T13:04:00.053152+0000","last_active":"2024-01-24T13:04:01.150744+0000","last_peered":"2024-01-24T13:04:01.150744+0000","last_clean":"2024-01-24T13:04:01.150744+0000","last_became_active":"2024-01-24T13:04:00.052760+0000","last_became_peered":"2024-01-24T13:04:00.052760+0000","last_unstale":"2024-01-24T13:04:01.150744+0000","last_undegraded":"2024-01-24T13:04:01.150744+0000","last_fullsized":"2024-01-24T13:04:01.150744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019513+0000","last_change":"2024-01-24T13:03:56.010008+0000","last_active":"2024-01-24T13:04:00.019513+0000","last_peered":"2024-01-24T13:04:00.019513+0000","last_clean":"2024-01-24T13:04:00.019513+0000","last_became_active":"2024-01-24T13:03:56.009750+0000","last_became_peered":"2024-01-24T13:03:56.009750+0000","last_unstale":"2024-01-24T13:04:00.019513+0000","last_undegraded":"2024-01-24T13:04:00.019513+0000","last_fullsized":"2024-01-24T13:04:00.019513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:46:37.904394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011569+0000","last_change":"2024-01-24T13:03:55.592274+0000","last_active":"2024-01-24T13:04:00.011569+0000","last_peered":"2024-01-24T13:04:00.011569+0000","last_clean":"2024-01-24T13:04:00.011569+0000","last_became_active":"2024-01-24T13:03:55.591994+0000","last_became_peered":"2024-01-24T13:03:55.591994+0000","last_unstale":"2024-01-24T13:04:00.011569+0000","last_undegraded":"2024-01-24T13:04:00.011569+0000","last_fullsized":"2024-01-24T13:04:00.011569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:08.959080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806986+0000","last_change":"2024-01-24T13:04:00.053348+0000","last_active":"2024-01-24T13:04:01.806986+0000","last_peered":"2024-01-24T13:04:01.806986+0000","last_clean":"2024-01-24T13:04:01.806986+0000","last_became_active":"2024-01-24T13:04:00.052859+0000","last_became_peered":"2024-01-24T13:04:00.052859+0000","last_unstale":"2024-01-24T13:04:01.806986+0000","last_undegraded":"2024-01-24T13:04:01.806986+0000","last_fullsized":"2024-01-24T13:04:01.806986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:31:55.847658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015772+0000","last_change":"2024-01-24T13:03:56.013494+0000","last_active":"2024-01-24T13:04:01.015772+0000","last_peered":"2024-01-24T13:04:01.015772+0000","last_clean":"2024-01-24T13:04:01.015772+0000","last_became_active":"2024-01-24T13:03:56.013241+0000","last_became_peered":"2024-01-24T13:03:56.013241+0000","last_unstale":"2024-01-24T13:04:01.015772+0000","last_undegraded":"2024-01-24T13:04:01.015772+0000","last_fullsized":"2024-01-24T13:04:01.015772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:09:52.534215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018229+0000","last_change":"2024-01-24T13:03:55.608610+0000","last_active":"2024-01-24T13:04:00.018229+0000","last_peered":"2024-01-24T13:04:00.018229+0000","last_clean":"2024-01-24T13:04:00.018229+0000","last_became_active":"2024-01-24T13:03:55.608272+0000","last_became_peered":"2024-01-24T13:03:55.608272+0000","last_unstale":"2024-01-24T13:04:00.018229+0000","last_undegraded":"2024-01-24T13:04:00.018229+0000","last_fullsized":"2024-01-24T13:04:00.018229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:03:38.642654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011518+0000","last_change":"2024-01-24T13:03:55.603336+0000","last_active":"2024-01-24T13:04:00.011518+0000","last_peered":"2024-01-24T13:04:00.011518+0000","last_clean":"2024-01-24T13:04:00.011518+0000","last_became_active":"2024-01-24T13:03:55.603034+0000","last_became_peered":"2024-01-24T13:03:55.603034+0000","last_unstale":"2024-01-24T13:04:00.011518+0000","last_undegraded":"2024-01-24T13:04:00.011518+0000","last_fullsized":"2024-01-24T13:04:00.011518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:54:35.340555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019760+0000","last_change":"2024-01-24T13:03:56.023712+0000","last_active":"2024-01-24T13:04:00.019760+0000","last_peered":"2024-01-24T13:04:00.019760+0000","last_clean":"2024-01-24T13:04:00.019760+0000","last_became_active":"2024-01-24T13:03:56.023037+0000","last_became_peered":"2024-01-24T13:03:56.023037+0000","last_unstale":"2024-01-24T13:04:00.019760+0000","last_undegraded":"2024-01-24T13:04:00.019760+0000","last_fullsized":"2024-01-24T13:04:00.019760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:10:17.205776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149525+0000","last_change":"2024-01-24T13:04:00.049354+0000","last_active":"2024-01-24T13:04:01.149525+0000","last_peered":"2024-01-24T13:04:01.149525+0000","last_clean":"2024-01-24T13:04:01.149525+0000","last_became_active":"2024-01-24T13:04:00.048648+0000","last_became_peered":"2024-01-24T13:04:00.048648+0000","last_unstale":"2024-01-24T13:04:01.149525+0000","last_undegraded":"2024-01-24T13:04:01.149525+0000","last_fullsized":"2024-01-24T13:04:01.149525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:37:19.983867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016202+0000","last_change":"2024-01-24T13:03:55.595499+0000","last_active":"2024-01-24T13:04:01.016202+0000","last_peered":"2024-01-24T13:04:01.016202+0000","last_clean":"2024-01-24T13:04:01.016202+0000","last_became_active":"2024-01-24T13:03:55.595229+0000","last_became_peered":"2024-01-24T13:03:55.595229+0000","last_unstale":"2024-01-24T13:04:01.016202+0000","last_undegraded":"2024-01-24T13:04:01.016202+0000","last_fullsized":"2024-01-24T13:04:01.016202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:33:37.210242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020904+0000","last_change":"2024-01-24T13:03:56.025558+0000","last_active":"2024-01-24T13:04:00.020904+0000","last_peered":"2024-01-24T13:04:00.020904+0000","last_clean":"2024-01-24T13:04:00.020904+0000","last_became_active":"2024-01-24T13:03:56.023819+0000","last_became_peered":"2024-01-24T13:03:56.023819+0000","last_unstale":"2024-01-24T13:04:00.020904+0000","last_undegraded":"2024-01-24T13:04:00.020904+0000","last_fullsized":"2024-01-24T13:04:00.020904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.807832+0000","last_change":"2024-01-24T13:04:00.050356+0000","last_active":"2024-01-24T13:04:01.807832+0000","last_peered":"2024-01-24T13:04:01.807832+0000","last_clean":"2024-01-24T13:04:01.807832+0000","last_became_active":"2024-01-24T13:04:00.049681+0000","last_became_peered":"2024-01-24T13:04:00.049681+0000","last_unstale":"2024-01-24T13:04:01.807832+0000","last_undegraded":"2024-01-24T13:04:01.807832+0000","last_fullsized":"2024-01-24T13:04:01.807832+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:37:06.368057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013232+0000","last_change":"2024-01-24T13:03:56.004498+0000","last_active":"2024-01-24T13:04:01.013232+0000","last_peered":"2024-01-24T13:04:01.013232+0000","last_clean":"2024-01-24T13:04:01.013232+0000","last_became_active":"2024-01-24T13:03:56.004175+0000","last_became_peered":"2024-01-24T13:03:56.004175+0000","last_unstale":"2024-01-24T13:04:01.013232+0000","last_undegraded":"2024-01-24T13:04:01.013232+0000","last_fullsized":"2024-01-24T13:04:01.013232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016280+0000","last_change":"2024-01-24T13:03:56.022795+0000","last_active":"2024-01-24T13:04:01.016280+0000","last_peered":"2024-01-24T13:04:01.016280+0000","last_clean":"2024-01-24T13:04:01.016280+0000","last_became_active":"2024-01-24T13:03:56.022534+0000","last_became_peered":"2024-01-24T13:03:56.022534+0000","last_unstale":"2024-01-24T13:04:01.016280+0000","last_undegraded":"2024-01-24T13:04:01.016280+0000","last_fullsized":"2024-01-24T13:04:01.016280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:14.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011421+0000","last_change":"2024-01-24T13:03:56.017677+0000","last_active":"2024-01-24T13:04:00.011421+0000","last_peered":"2024-01-24T13:04:00.011421+0000","last_clean":"2024-01-24T13:04:00.011421+0000","last_became_active":"2024-01-24T13:03:56.017371+0000","last_became_peered":"2024-01-24T13:03:56.017371+0000","last_unstale":"2024-01-24T13:04:00.011421+0000","last_undegraded":"2024-01-24T13:04:00.011421+0000","last_fullsized":"2024-01-24T13:04:00.011421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:33:30.023414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016121+0000","last_change":"2024-01-24T13:03:56.018818+0000","last_active":"2024-01-24T13:04:01.016121+0000","last_peered":"2024-01-24T13:04:01.016121+0000","last_clean":"2024-01-24T13:04:01.016121+0000","last_became_active":"2024-01-24T13:03:56.018526+0000","last_became_peered":"2024-01-24T13:03:56.018526+0000","last_unstale":"2024-01-24T13:04:01.016121+0000","last_undegraded":"2024-01-24T13:04:01.016121+0000","last_fullsized":"2024-01-24T13:04:01.016121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:03:08.353848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018278+0000","last_change":"2024-01-24T13:03:56.021986+0000","last_active":"2024-01-24T13:04:00.018278+0000","last_peered":"2024-01-24T13:04:00.018278+0000","last_clean":"2024-01-24T13:04:00.018278+0000","last_became_active":"2024-01-24T13:03:56.021722+0000","last_became_peered":"2024-01-24T13:03:56.021722+0000","last_unstale":"2024-01-24T13:04:00.018278+0000","last_undegraded":"2024-01-24T13:04:00.018278+0000","last_fullsized":"2024-01-24T13:04:00.018278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:41:53.447100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018684+0000","last_change":"2024-01-24T13:03:56.017766+0000","last_active":"2024-01-24T13:04:00.018684+0000","last_peered":"2024-01-24T13:04:00.018684+0000","last_clean":"2024-01-24T13:04:00.018684+0000","last_became_active":"2024-01-24T13:03:56.017460+0000","last_became_peered":"2024-01-24T13:03:56.017460+0000","last_unstale":"2024-01-24T13:04:00.018684+0000","last_undegraded":"2024-01-24T13:04:00.018684+0000","last_fullsized":"2024-01-24T13:04:00.018684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013764+0000","last_change":"2024-01-24T13:03:56.006732+0000","last_active":"2024-01-24T13:04:01.013764+0000","last_peered":"2024-01-24T13:04:01.013764+0000","last_clean":"2024-01-24T13:04:01.013764+0000","last_became_active":"2024-01-24T13:03:56.006500+0000","last_became_peered":"2024-01-24T13:03:56.006500+0000","last_unstale":"2024-01-24T13:04:01.013764+0000","last_undegraded":"2024-01-24T13:04:01.013764+0000","last_fullsized":"2024-01-24T13:04:01.013764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:41:53.447100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017053+0000","last_change":"2024-01-24T13:03:56.022835+0000","last_active":"2024-01-24T13:04:01.017053+0000","last_peered":"2024-01-24T13:04:01.017053+0000","last_clean":"2024-01-24T13:04:01.017053+0000","last_became_active":"2024-01-24T13:03:56.022521+0000","last_became_peered":"2024-01-24T13:03:56.022521+0000","last_unstale":"2024-01-24T13:04:01.017053+0000","last_undegraded":"2024-01-24T13:04:01.017053+0000","last_fullsized":"2024-01-24T13:04:01.017053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:50:36.168607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011457+0000","last_change":"2024-01-24T13:03:56.018264+0000","last_active":"2024-01-24T13:04:00.011457+0000","last_peered":"2024-01-24T13:04:00.011457+0000","last_clean":"2024-01-24T13:04:00.011457+0000","last_became_active":"2024-01-24T13:03:56.018005+0000","last_became_peered":"2024-01-24T13:03:56.018005+0000","last_unstale":"2024-01-24T13:04:00.011457+0000","last_undegraded":"2024-01-24T13:04:00.011457+0000","last_fullsized":"2024-01-24T13:04:00.011457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:28.956711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015611+0000","last_change":"2024-01-24T13:03:55.999869+0000","last_active":"2024-01-24T13:04:01.015611+0000","last_peered":"2024-01-24T13:04:01.015611+0000","last_clean":"2024-01-24T13:04:01.015611+0000","last_became_active":"2024-01-24T13:03:55.999485+0000","last_became_peered":"2024-01-24T13:03:55.999485+0000","last_unstale":"2024-01-24T13:04:01.015611+0000","last_undegraded":"2024-01-24T13:04:01.015611+0000","last_fullsized":"2024-01-24T13:04:01.015611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:30:44.114343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020828+0000","last_change":"2024-01-24T13:03:56.020510+0000","last_active":"2024-01-24T13:04:00.020828+0000","last_peered":"2024-01-24T13:04:00.020828+0000","last_clean":"2024-01-24T13:04:00.020828+0000","last_became_active":"2024-01-24T13:03:56.020184+0000","last_became_peered":"2024-01-24T13:03:56.020184+0000","last_unstale":"2024-01-24T13:04:00.020828+0000","last_undegraded":"2024-01-24T13:04:00.020828+0000","last_fullsized":"2024-01-24T13:04:00.020828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:40.224981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019636+0000","last_change":"2024-01-24T13:03:56.016392+0000","last_active":"2024-01-24T13:04:00.019636+0000","last_peered":"2024-01-24T13:04:00.019636+0000","last_clean":"2024-01-24T13:04:00.019636+0000","last_became_active":"2024-01-24T13:03:56.016151+0000","last_became_peered":"2024-01-24T13:03:56.016151+0000","last_unstale":"2024-01-24T13:04:00.019636+0000","last_undegraded":"2024-01-24T13:04:00.019636+0000","last_fullsized":"2024-01-24T13:04:00.019636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:40:18.485138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.025905+0000","last_change":"2024-01-24T13:03:56.012700+0000","last_active":"2024-01-24T13:04:00.025905+0000","last_peered":"2024-01-24T13:04:00.025905+0000","last_clean":"2024-01-24T13:04:00.025905+0000","last_became_active":"2024-01-24T13:03:56.012103+0000","last_became_peered":"2024-01-24T13:03:56.012103+0000","last_unstale":"2024-01-24T13:04:00.025905+0000","last_undegraded":"2024-01-24T13:04:00.025905+0000","last_fullsized":"2024-01-24T13:04:00.025905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:13:44.864520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013515+0000","last_change":"2024-01-24T13:03:56.012794+0000","last_active":"2024-01-24T13:04:00.013515+0000","last_peered":"2024-01-24T13:04:00.013515+0000","last_clean":"2024-01-24T13:04:00.013515+0000","last_became_active":"2024-01-24T13:03:56.012545+0000","last_became_peered":"2024-01-24T13:03:56.012545+0000","last_unstale":"2024-01-24T13:04:00.013515+0000","last_undegraded":"2024-01-24T13:04:00.013515+0000","last_fullsized":"2024-01-24T13:04:00.013515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:44:49.313400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017636+0000","last_change":"2024-01-24T13:03:56.024693+0000","last_active":"2024-01-24T13:04:01.017636+0000","last_peered":"2024-01-24T13:04:01.017636+0000","last_clean":"2024-01-24T13:04:01.017636+0000","last_became_active":"2024-01-24T13:03:56.024414+0000","last_became_peered":"2024-01-24T13:03:56.024414+0000","last_unstale":"2024-01-24T13:04:01.017636+0000","last_undegraded":"2024-01-24T13:04:01.017636+0000","last_fullsized":"2024-01-24T13:04:01.017636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013466+0000","last_change":"2024-01-24T13:03:56.022620+0000","last_active":"2024-01-24T13:04:00.013466+0000","last_peered":"2024-01-24T13:04:00.013466+0000","last_clean":"2024-01-24T13:04:00.013466+0000","last_became_active":"2024-01-24T13:03:56.022340+0000","last_became_peered":"2024-01-24T13:03:56.022340+0000","last_unstale":"2024-01-24T13:04:00.013466+0000","last_undegraded":"2024-01-24T13:04:00.013466+0000","last_fullsized":"2024-01-24T13:04:00.013466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:13:44.864520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011319+0000","last_change":"2024-01-24T13:03:56.021834+0000","last_active":"2024-01-24T13:04:00.011319+0000","last_peered":"2024-01-24T13:04:00.011319+0000","last_clean":"2024-01-24T13:04:00.011319+0000","last_became_active":"2024-01-24T13:03:56.021527+0000","last_became_peered":"2024-01-24T13:03:56.021527+0000","last_unstale":"2024-01-24T13:04:00.011319+0000","last_undegraded":"2024-01-24T13:04:00.011319+0000","last_fullsized":"2024-01-24T13:04:00.011319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:48:22.624362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015966+0000","last_change":"2024-01-24T13:03:56.009268+0000","last_active":"2024-01-24T13:04:01.015966+0000","last_peered":"2024-01-24T13:04:01.015966+0000","last_clean":"2024-01-24T13:04:01.015966+0000","last_became_active":"2024-01-24T13:03:56.009008+0000","last_became_peered":"2024-01-24T13:03:56.009008+0000","last_unstale":"2024-01-24T13:04:01.015966+0000","last_undegraded":"2024-01-24T13:04:01.015966+0000","last_fullsized":"2024-01-24T13:04:01.015966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:41:51.025201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.016927+0000","last_change":"2024-01-24T13:03:56.013449+0000","last_active":"2024-01-24T13:04:00.016927+0000","last_peered":"2024-01-24T13:04:00.016927+0000","last_clean":"2024-01-24T13:04:00.016927+0000","last_became_active":"2024-01-24T13:03:56.011189+0000","last_became_peered":"2024-01-24T13:03:56.011189+0000","last_unstale":"2024-01-24T13:04:00.016927+0000","last_undegraded":"2024-01-24T13:04:00.016927+0000","last_fullsized":"2024-01-24T13:04:00.016927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:02.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.016811+0000","last_change":"2024-01-24T13:03:56.024913+0000","last_active":"2024-01-24T13:04:00.016811+0000","last_peered":"2024-01-24T13:04:00.016811+0000","last_clean":"2024-01-24T13:04:00.016811+0000","last_became_active":"2024-01-24T13:03:56.024610+0000","last_became_peered":"2024-01-24T13:03:56.024610+0000","last_unstale":"2024-01-24T13:04:00.016811+0000","last_undegraded":"2024-01-24T13:04:00.016811+0000","last_fullsized":"2024-01-24T13:04:00.016811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:18:52.742448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.025821+0000","last_change":"2024-01-24T13:03:56.012889+0000","last_active":"2024-01-24T13:04:00.025821+0000","last_peered":"2024-01-24T13:04:00.025821+0000","last_clean":"2024-01-24T13:04:00.025821+0000","last_became_active":"2024-01-24T13:03:56.012457+0000","last_became_peered":"2024-01-24T13:03:56.012457+0000","last_unstale":"2024-01-24T13:04:00.025821+0000","last_undegraded":"2024-01-24T13:04:00.025821+0000","last_fullsized":"2024-01-24T13:04:00.025821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:25:17.038527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.030919+0000","last_change":"2024-01-24T13:03:56.007919+0000","last_active":"2024-01-24T13:04:00.030919+0000","last_peered":"2024-01-24T13:04:00.030919+0000","last_clean":"2024-01-24T13:04:00.030919+0000","last_became_active":"2024-01-24T13:03:56.007649+0000","last_became_peered":"2024-01-24T13:03:56.007649+0000","last_unstale":"2024-01-24T13:04:00.030919+0000","last_undegraded":"2024-01-24T13:04:00.030919+0000","last_fullsized":"2024-01-24T13:04:00.030919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:02:53.625968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.027982+0000","last_change":"2024-01-24T13:03:56.006823+0000","last_active":"2024-01-24T13:04:00.027982+0000","last_peered":"2024-01-24T13:04:00.027982+0000","last_clean":"2024-01-24T13:04:00.027982+0000","last_became_active":"2024-01-24T13:03:56.006551+0000","last_became_peered":"2024-01-24T13:03:56.006551+0000","last_unstale":"2024-01-24T13:04:00.027982+0000","last_undegraded":"2024-01-24T13:04:00.027982+0000","last_fullsized":"2024-01-24T13:04:00.027982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:44:47.469690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.022358+0000","last_change":"2024-01-24T13:03:56.011850+0000","last_active":"2024-01-24T13:04:00.022358+0000","last_peered":"2024-01-24T13:04:00.022358+0000","last_clean":"2024-01-24T13:04:00.022358+0000","last_became_active":"2024-01-24T13:03:56.011377+0000","last_became_peered":"2024-01-24T13:03:56.011377+0000","last_unstale":"2024-01-24T13:04:00.022358+0000","last_undegraded":"2024-01-24T13:04:00.022358+0000","last_fullsized":"2024-01-24T13:04:00.022358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:47:46.739111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015553+0000","last_change":"2024-01-24T13:03:56.009254+0000","last_active":"2024-01-24T13:04:01.015553+0000","last_peered":"2024-01-24T13:04:01.015553+0000","last_clean":"2024-01-24T13:04:01.015553+0000","last_became_active":"2024-01-24T13:03:56.008910+0000","last_became_peered":"2024-01-24T13:03:56.008910+0000","last_unstale":"2024-01-24T13:04:01.015553+0000","last_undegraded":"2024-01-24T13:04:01.015553+0000","last_fullsized":"2024-01-24T13:04:01.015553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:57:08.977681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021030+0000","last_change":"2024-01-24T13:03:56.008312+0000","last_active":"2024-01-24T13:04:00.021030+0000","last_peered":"2024-01-24T13:04:00.021030+0000","last_clean":"2024-01-24T13:04:00.021030+0000","last_became_active":"2024-01-24T13:03:56.008049+0000","last_became_peered":"2024-01-24T13:03:56.008049+0000","last_unstale":"2024-01-24T13:04:00.021030+0000","last_undegraded":"2024-01-24T13:04:00.021030+0000","last_fullsized":"2024-01-24T13:04:00.021030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:26:46.456477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013251+0000","last_change":"2024-01-24T13:03:56.007224+0000","last_active":"2024-01-24T13:04:01.013251+0000","last_peered":"2024-01-24T13:04:01.013251+0000","last_clean":"2024-01-24T13:04:01.013251+0000","last_became_active":"2024-01-24T13:03:56.006804+0000","last_became_peered":"2024-01-24T13:03:56.006804+0000","last_unstale":"2024-01-24T13:04:01.013251+0000","last_undegraded":"2024-01-24T13:04:01.013251+0000","last_fullsized":"2024-01-24T13:04:01.013251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:30:39.914222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.023149+0000","last_change":"2024-01-24T13:03:56.021601+0000","last_active":"2024-01-24T13:04:00.023149+0000","last_peered":"2024-01-24T13:04:00.023149+0000","last_clean":"2024-01-24T13:04:00.023149+0000","last_became_active":"2024-01-24T13:03:56.021378+0000","last_became_peered":"2024-01-24T13:03:56.021378+0000","last_unstale":"2024-01-24T13:04:00.023149+0000","last_undegraded":"2024-01-24T13:04:00.023149+0000","last_fullsized":"2024-01-24T13:04:00.023149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:26:27.582337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013386+0000","last_change":"2024-01-24T13:03:56.006893+0000","last_active":"2024-01-24T13:04:01.013386+0000","last_peered":"2024-01-24T13:04:01.013386+0000","last_clean":"2024-01-24T13:04:01.013386+0000","last_became_active":"2024-01-24T13:03:56.006553+0000","last_became_peered":"2024-01-24T13:03:56.006553+0000","last_unstale":"2024-01-24T13:04:01.013386+0000","last_undegraded":"2024-01-24T13:04:01.013386+0000","last_fullsized":"2024-01-24T13:04:01.013386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:40.224981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016663+0000","last_change":"2024-01-24T13:03:56.010902+0000","last_active":"2024-01-24T13:04:01.016663+0000","last_peered":"2024-01-24T13:04:01.016663+0000","last_clean":"2024-01-24T13:04:01.016663+0000","last_became_active":"2024-01-24T13:03:56.008359+0000","last_became_peered":"2024-01-24T13:03:56.008359+0000","last_unstale":"2024-01-24T13:04:01.016663+0000","last_undegraded":"2024-01-24T13:04:01.016663+0000","last_fullsized":"2024-01-24T13:04:01.016663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:01:35.209896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017095+0000","last_change":"2024-01-24T13:03:56.018292+0000","last_active":"2024-01-24T13:04:01.017095+0000","last_peered":"2024-01-24T13:04:01.017095+0000","last_clean":"2024-01-24T13:04:01.017095+0000","last_became_active":"2024-01-24T13:03:56.015689+0000","last_became_peered":"2024-01-24T13:03:56.015689+0000","last_unstale":"2024-01-24T13:04:01.017095+0000","last_undegraded":"2024-01-24T13:04:01.017095+0000","last_fullsized":"2024-01-24T13:04:01.017095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:15:57.223738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.028853+0000","last_change":"2024-01-24T13:03:56.010593+0000","last_active":"2024-01-24T13:04:00.028853+0000","last_peered":"2024-01-24T13:04:00.028853+0000","last_clean":"2024-01-24T13:04:00.028853+0000","last_became_active":"2024-01-24T13:03:56.010357+0000","last_became_peered":"2024-01-24T13:03:56.010357+0000","last_unstale":"2024-01-24T13:04:00.028853+0000","last_undegraded":"2024-01-24T13:04:00.028853+0000","last_fullsized":"2024-01-24T13:04:00.028853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:12:57.628509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":117206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":117082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":121549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":117664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":892928,"data_stored":707520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":303104,"data_stored":117138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":897024,"data_stored":707542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:04:21.119 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-24T13:04:21.119 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-24T13:04:21.120 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-24T13:04:21.120 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-24T13:04:21.120 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-24T13:04:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.292+0000 7f93b9e00640 1 Processor -- start 2024-01-24T13:04:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.296+0000 7f93b9e00640 1 -- start start 2024-01-24T13:04:21.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.296+0000 7f93b9e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93b406bc10 0x7f93b406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:21.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.296+0000 7f93b9e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b406c5b0 con 0x7f93b4159300 2024-01-24T13:04:21.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.296+0000 7f93b9e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b415de10 con 0x7f93b415cf50 2024-01-24T13:04:21.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.296+0000 7f93b9e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4071140 con 0x7f93b406bc10 2024-01-24T13:04:21.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.296+0000 7f93b2a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f93b4159300 0x7f93b40b1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41482/0 (socket says 172.21.15.29:41482) 2024-01-24T13:04:21.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.296+0000 7f93b2a00640 1 -- 172.21.15.29:0/2788459197 learned_addr learned my addr 172.21.15.29:0/2788459197 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:21.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.296+0000 7f93b2000640 1 --2- 172.21.15.29:0/2788459197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93b406bc10 0x7f93b406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.296+0000 7f93b1600640 1 -- 172.21.15.29:0/2788459197 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444044120 0 0) 0x7f93b406c5b0 con 0x7f93b4159300 2024-01-24T13:04:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.296+0000 7f93b1600640 1 -- 172.21.15.29:0/2788459197 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9394005740 con 0x7f93b4159300 2024-01-24T13:04:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.296+0000 7f93b2000640 1 -- 172.21.15.29:0/2788459197 >> v1:172.21.15.163:6789/0 conn(0x7f93b415cf50 legacy=0x7f93b40cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.296+0000 7f93b1600640 1 -- 172.21.15.29:0/2788459197 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525137360 0 0) 0x7f93b415de10 con 0x7f93b415cf50 2024-01-24T13:04:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.296+0000 7f93b2000640 1 -- 172.21.15.29:0/2788459197 >> v1:172.21.15.29:6789/0 conn(0x7f93b4159300 legacy=0x7f93b40b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.296+0000 7f93b2000640 1 -- 172.21.15.29:0/2788459197 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b415db30 con 0x7f93b406bc10 2024-01-24T13:04:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.300+0000 7f93b2000640 1 --2- 172.21.15.29:0/2788459197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93b406bc10 0x7f93b406c070 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f939c0097f0 tx=0x7f939c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a8ce8ec47eec3f0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.300+0000 7f93b1600640 1 -- 172.21.15.29:0/2788459197 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0ab600 con 0x7f93b406bc10 2024-01-24T13:04:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.300+0000 7f93b1600640 1 -- 172.21.15.29:0/2788459197 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c0a7050 con 0x7f93b406bc10 2024-01-24T13:04:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.300+0000 7f93b1600640 1 -- 172.21.15.29:0/2788459197 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0ab980 con 0x7f93b406bc10 2024-01-24T13:04:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.300+0000 7f93b9e00640 1 -- 172.21.15.29:0/2788459197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93b406bc10 msgr2=0x7f93b406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.300+0000 7f93b9e00640 1 --2- 172.21.15.29:0/2788459197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93b406bc10 0x7f93b406c070 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f939c0097f0 tx=0x7f939c01c400 comp rx=0 tx=0).stop 2024-01-24T13:04:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.300+0000 7f93b9e00640 1 -- 172.21.15.29:0/2788459197 shutdown_connections 2024-01-24T13:04:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.300+0000 7f93b9e00640 1 --2- 172.21.15.29:0/2788459197 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93b406bc10 0x7f93b406c070 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.300+0000 7f93b9e00640 1 -- 172.21.15.29:0/2788459197 >> 172.21.15.29:0/2788459197 conn(0x7f93b40b3950 msgr2=0x7f93b4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.300+0000 7f93b9e00640 1 -- 172.21.15.29:0/2788459197 shutdown_connections 2024-01-24T13:04:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.300+0000 7f93b9e00640 1 -- 172.21.15.29:0/2788459197 wait complete. 2024-01-24T13:04:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b9e00640 1 Processor -- start 2024-01-24T13:04:21.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b9e00640 1 -- start start 2024-01-24T13:04:21.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b9e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93b406bc10 0x7f93b40cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:21.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b9e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93b4159300 0x7f93b40ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:21.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b9e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93b415cf50 0x7f93b4142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:21.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b9e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b415e410 con 0x7f93b415cf50 2024-01-24T13:04:21.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b9e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4141390 con 0x7f93b4159300 2024-01-24T13:04:21.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b9e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4140a60 con 0x7f93b406bc10 2024-01-24T13:04:21.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b3400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93b415cf50 0x7f93b4142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:21.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b3400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93b415cf50 0x7f93b4142c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37006/0 (socket says 172.21.15.29:37006) 2024-01-24T13:04:21.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b3400640 1 -- 172.21.15.29:0/951886515 learned_addr learned my addr 172.21.15.29:0/951886515 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:21.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b2a00640 1 --2- 172.21.15.29:0/951886515 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93b406bc10 0x7f93b40cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:21.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b2000640 1 --2- 172.21.15.29:0/951886515 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93b4159300 0x7f93b40ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:21.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b3400640 1 -- 172.21.15.29:0/951886515 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93b406bc10 msgr2=0x7f93b40cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b3400640 1 --2- 172.21.15.29:0/951886515 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93b406bc10 0x7f93b40cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b3400640 1 -- 172.21.15.29:0/951886515 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93b4159300 msgr2=0x7f93b40ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b3400640 1 --2- 172.21.15.29:0/951886515 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93b4159300 0x7f93b40ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b3400640 1 -- 172.21.15.29:0/951886515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c009420 con 0x7f93b415cf50 2024-01-24T13:04:21.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b3400640 1 --2- 172.21.15.29:0/951886515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93b415cf50 0x7f93b4142c10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f93ac001570 tx=0x7f93ac00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:21.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93ab400640 1 -- 172.21.15.29:0/951886515 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac003db0 con 0x7f93b415cf50 2024-01-24T13:04:21.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93ab400640 1 -- 172.21.15.29:0/951886515 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ac005070 con 0x7f93b415cf50 2024-01-24T13:04:21.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93ab400640 1 -- 172.21.15.29:0/951886515 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac005420 con 0x7f93b415cf50 2024-01-24T13:04:21.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b9e00640 1 -- 172.21.15.29:0/951886515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b4140d40 con 0x7f93b415cf50 2024-01-24T13:04:21.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b9e00640 1 -- 172.21.15.29:0/951886515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b40b0d90 con 0x7f93b415cf50 2024-01-24T13:04:21.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.304+0000 7f93b9e00640 1 -- 172.21.15.29:0/951886515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b4141500 con 0x7f93b415cf50 2024-01-24T13:04:21.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.308+0000 7f93ab400640 1 -- 172.21.15.29:0/951886515 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f93ac005580 con 0x7f93b415cf50 2024-01-24T13:04:21.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.308+0000 7f93ab400640 1 --2- 172.21.15.29:0/951886515 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f938c065a90 0x7f938c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:21.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.308+0000 7f93ab400640 1 -- 172.21.15.29:0/951886515 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f93ac082c40 con 0x7f93b415cf50 2024-01-24T13:04:21.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.308+0000 7f93b2a00640 1 --2- 172.21.15.29:0/951886515 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f938c065a90 0x7f938c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:21.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.308+0000 7f93b2a00640 1 --2- 172.21.15.29:0/951886515 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f938c065a90 0x7f938c067f50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93a4007fd0 tx=0x7f93a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:21.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.312+0000 7f93ab400640 1 -- 172.21.15.29:0/951886515 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f93ac0503c0 con 0x7f93b415cf50 2024-01-24T13:04:21.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.512+0000 7f93b9e00640 1 -- 172.21.15.29:0/951886515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f93b404e850 con 0x7f93b415cf50 2024-01-24T13:04:21.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.512+0000 7f93ab400640 1 -- 172.21.15.29:0/951886515 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163368 (secure 0 0 0) 0x7f93ac017020 con 0x7f93b415cf50 2024-01-24T13:04:21.517 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:21.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.516+0000 7f93b9e00640 1 -- 172.21.15.29:0/951886515 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f938c065a90 msgr2=0x7f938c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.516+0000 7f93b9e00640 1 --2- 172.21.15.29:0/951886515 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f938c065a90 0x7f938c067f50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93a4007fd0 tx=0x7f93a4009040 comp rx=0 tx=0).stop 2024-01-24T13:04:21.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.516+0000 7f93b9e00640 1 -- 172.21.15.29:0/951886515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93b415cf50 msgr2=0x7f93b4142c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.516+0000 7f93b9e00640 1 --2- 172.21.15.29:0/951886515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93b415cf50 0x7f93b4142c10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f93ac001570 tx=0x7f93ac00cd20 comp rx=0 tx=0).stop 2024-01-24T13:04:21.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.516+0000 7f93b9e00640 1 -- 172.21.15.29:0/951886515 shutdown_connections 2024-01-24T13:04:21.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.516+0000 7f93b9e00640 1 --2- 172.21.15.29:0/951886515 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f938c065a90 0x7f938c067f50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.516+0000 7f93b9e00640 1 --2- 172.21.15.29:0/951886515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93b415cf50 0x7f93b4142c10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.516+0000 7f93b9e00640 1 --2- 172.21.15.29:0/951886515 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93b4159300 0x7f93b40ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.516+0000 7f93b9e00640 1 --2- 172.21.15.29:0/951886515 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93b406bc10 0x7f93b40cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.516+0000 7f93b9e00640 1 -- 172.21.15.29:0/951886515 >> 172.21.15.29:0/951886515 conn(0x7f93b40b3950 msgr2=0x7f93b40cda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:21.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.516+0000 7f93b9e00640 1 -- 172.21.15.29:0/951886515 shutdown_connections 2024-01-24T13:04:21.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.516+0000 7f93b9e00640 1 -- 172.21.15.29:0/951886515 wait complete. 2024-01-24T13:04:21.539 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":26915},{"type":"v1","addr":"172.21.15.163:6833","nonce":26915}]},"active_addr":"172.21.15.163:6833/26915","active_change":"2024-01-24T13:03:35.519936+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":752075785}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":2819891249}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":1627502395}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":408735867}]}]} 2024-01-24T13:04:21.543 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-24T13:04:21.543 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-24T13:04:21.543 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:21.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.684+0000 7fd38b600640 1 Processor -- start 2024-01-24T13:04:21.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.684+0000 7fd38b600640 1 -- start start 2024-01-24T13:04:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.684+0000 7fd38b600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd3840cb100 0x7fd384165280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.684+0000 7fd38b600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3840cfe50 con 0x7fd3840c3ef0 2024-01-24T13:04:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.684+0000 7fd38b600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38415aa10 con 0x7fd38415a630 2024-01-24T13:04:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.684+0000 7fd38b600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3840cf380 con 0x7fd3840cb100 2024-01-24T13:04:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.684+0000 7fd389600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd3840cb100 0x7fd384165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.684+0000 7fd389600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd3840cb100 0x7fd384165280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37012/0 (socket says 172.21.15.29:37012) 2024-01-24T13:04:21.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.684+0000 7fd389600640 1 -- 172.21.15.29:0/3754263571 learned_addr learned my addr 172.21.15.29:0/3754263571 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:21.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.684+0000 7fd389600640 1 -- 172.21.15.29:0/3754263571 >> v1:172.21.15.163:6789/0 conn(0x7fd38415a630 legacy=0x7fd3840cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:21.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.684+0000 7fd389600640 1 -- 172.21.15.29:0/3754263571 >> v1:172.21.15.29:6789/0 conn(0x7fd3840c3ef0 legacy=0x7fd3840ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.684+0000 7fd389600640 1 -- 172.21.15.29:0/3754263571 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3840b2b70 con 0x7fd3840cb100 2024-01-24T13:04:21.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.688+0000 7fd389600640 1 --2- 172.21.15.29:0/3754263571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840cb100 0x7fd384165280 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009e50 tx=0x7fd37c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e8bd94a64c1b39 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.688+0000 7fd383400640 1 -- 172.21.15.29:0/3754263571 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0a5860 con 0x7fd3840cb100 2024-01-24T13:04:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.688+0000 7fd383400640 1 -- 172.21.15.29:0/3754263571 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c0a59c0 con 0x7fd3840cb100 2024-01-24T13:04:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.688+0000 7fd383400640 1 -- 172.21.15.29:0/3754263571 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0a5d50 con 0x7fd3840cb100 2024-01-24T13:04:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.688+0000 7fd38b600640 1 -- 172.21.15.29:0/3754263571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840cb100 msgr2=0x7fd384165280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.688+0000 7fd38b600640 1 --2- 172.21.15.29:0/3754263571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840cb100 0x7fd384165280 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009e50 tx=0x7fd37c01c9a0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.688+0000 7fd38b600640 1 -- 172.21.15.29:0/3754263571 shutdown_connections 2024-01-24T13:04:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.688+0000 7fd38b600640 1 --2- 172.21.15.29:0/3754263571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840cb100 0x7fd384165280 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.688+0000 7fd38b600640 1 -- 172.21.15.29:0/3754263571 >> 172.21.15.29:0/3754263571 conn(0x7fd384070570 msgr2=0x7fd384069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.688+0000 7fd38b600640 1 -- 172.21.15.29:0/3754263571 shutdown_connections 2024-01-24T13:04:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.688+0000 7fd38b600640 1 -- 172.21.15.29:0/3754263571 wait complete. 2024-01-24T13:04:21.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd38b600640 1 Processor -- start 2024-01-24T13:04:21.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd38b600640 1 -- start start 2024-01-24T13:04:21.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd38b600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd3840c3ef0 0x7fd384148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:21.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd38b600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840cb100 0x7fd38415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:21.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd38b600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd38415a630 0x7fd384150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:21.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd38b600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840b0e60 con 0x7fd3840cb100 2024-01-24T13:04:21.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd38b600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38415bfa0 con 0x7fd38415a630 2024-01-24T13:04:21.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd38b600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38415c280 con 0x7fd3840c3ef0 2024-01-24T13:04:21.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd383e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840cb100 0x7fd38415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:21.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd383e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840cb100 0x7fd38415ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37018/0 (socket says 172.21.15.29:37018) 2024-01-24T13:04:21.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd383e00640 1 -- 172.21.15.29:0/1844414569 learned_addr learned my addr 172.21.15.29:0/1844414569 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:21.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd389600640 1 --2- 172.21.15.29:0/1844414569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd38415a630 0x7fd384150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:21.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd388c00640 1 --2- 172.21.15.29:0/1844414569 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd3840c3ef0 0x7fd384148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:21.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd383e00640 1 -- 172.21.15.29:0/1844414569 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd3840c3ef0 msgr2=0x7fd384148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd383e00640 1 --2- 172.21.15.29:0/1844414569 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd3840c3ef0 0x7fd384148460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd383e00640 1 -- 172.21.15.29:0/1844414569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd38415a630 msgr2=0x7fd384150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd383e00640 1 --2- 172.21.15.29:0/1844414569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd38415a630 0x7fd384150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd383e00640 1 -- 172.21.15.29:0/1844414569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c009b30 con 0x7fd3840cb100 2024-01-24T13:04:21.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd383e00640 1 --2- 172.21.15.29:0/1844414569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840cb100 0x7fd38415ca80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c500 tx=0x7fd36c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:21.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd380c00640 1 -- 172.21.15.29:0/1844414569 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c005220 con 0x7fd3840cb100 2024-01-24T13:04:21.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd380c00640 1 -- 172.21.15.29:0/1844414569 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c005380 con 0x7fd3840cb100 2024-01-24T13:04:21.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd380c00640 1 -- 172.21.15.29:0/1844414569 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c007270 con 0x7fd3840cb100 2024-01-24T13:04:21.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd38b600640 1 -- 172.21.15.29:0/1844414569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38415c560 con 0x7fd3840cb100 2024-01-24T13:04:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.692+0000 7fd38b600640 1 -- 172.21.15.29:0/1844414569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38415cfc0 con 0x7fd3840cb100 2024-01-24T13:04:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.696+0000 7fd38b600640 1 -- 172.21.15.29:0/1844414569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38415be00 con 0x7fd3840cb100 2024-01-24T13:04:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.696+0000 7fd380c00640 1 -- 172.21.15.29:0/1844414569 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd36c0073d0 con 0x7fd3840cb100 2024-01-24T13:04:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.696+0000 7fd380c00640 1 --2- 172.21.15.29:0/1844414569 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd35c065a60 0x7fd35c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.696+0000 7fd380c00640 1 -- 172.21.15.29:0/1844414569 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd36c082e40 con 0x7fd3840cb100 2024-01-24T13:04:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.696+0000 7fd388c00640 1 --2- 172.21.15.29:0/1844414569 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd35c065a60 0x7fd35c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:21.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.696+0000 7fd388c00640 1 --2- 172.21.15.29:0/1844414569 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd35c065a60 0x7fd35c067f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd37400b810 tx=0x7fd374008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.700+0000 7fd380c00640 1 -- 172.21.15.29:0/1844414569 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd38415be00 con 0x7fd3840cb100 2024-01-24T13:04:21.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.860+0000 7fd38b600640 1 -- 172.21.15.29:0/1844414569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd38415be00 con 0x7fd3840cb100 2024-01-24T13:04:21.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.860+0000 7fd380c00640 1 -- 172.21.15.29:0/1844414569 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+17882 (secure 0 0 0) 0x7fd38415be00 con 0x7fd3840cb100 2024-01-24T13:04:21.863 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:21.863 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:01.140044+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:21.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.864+0000 7fd38b600640 1 -- 172.21.15.29:0/1844414569 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd35c065a60 msgr2=0x7fd35c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.864+0000 7fd38b600640 1 --2- 172.21.15.29:0/1844414569 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd35c065a60 0x7fd35c067f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd37400b810 tx=0x7fd374008040 comp rx=0 tx=0).stop 2024-01-24T13:04:21.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.864+0000 7fd38b600640 1 -- 172.21.15.29:0/1844414569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840cb100 msgr2=0x7fd38415ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:21.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.864+0000 7fd38b600640 1 --2- 172.21.15.29:0/1844414569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840cb100 0x7fd38415ca80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c500 tx=0x7fd36c00c9c0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.864+0000 7fd38b600640 1 -- 172.21.15.29:0/1844414569 shutdown_connections 2024-01-24T13:04:21.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.864+0000 7fd38b600640 1 --2- 172.21.15.29:0/1844414569 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd35c065a60 0x7fd35c067f20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.864+0000 7fd38b600640 1 --2- 172.21.15.29:0/1844414569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd38415a630 0x7fd384150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.864+0000 7fd38b600640 1 --2- 172.21.15.29:0/1844414569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3840cb100 0x7fd38415ca80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.864+0000 7fd38b600640 1 --2- 172.21.15.29:0/1844414569 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd3840c3ef0 0x7fd384148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:21.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.864+0000 7fd38b600640 1 -- 172.21.15.29:0/1844414569 >> 172.21.15.29:0/1844414569 conn(0x7fd384070570 msgr2=0x7fd3840c4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:21.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.864+0000 7fd38b600640 1 -- 172.21.15.29:0/1844414569 shutdown_connections 2024-01-24T13:04:21.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:21.864+0000 7fd38b600640 1 -- 172.21.15.29:0/1844414569 wait complete. 2024-01-24T13:04:21.886 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-24T13:04:21.886 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:22.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.024+0000 7f0ca9800640 1 Processor -- start 2024-01-24T13:04:22.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.024+0000 7f0ca9800640 1 -- start start 2024-01-24T13:04:22.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.024+0000 7f0ca9800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ca4143910 0x7f0ca4143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca9800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0ca406c320 0x7f0ca40cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca9800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca415aa30 con 0x7f0ca4070ac0 2024-01-24T13:04:22.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca9800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca40712a0 con 0x7f0ca4143910 2024-01-24T13:04:22.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca9800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca4071580 con 0x7f0ca406c320 2024-01-24T13:04:22.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca2a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ca4143910 0x7f0ca4143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca2a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ca4143910 0x7f0ca4143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37026/0 (socket says 172.21.15.29:37026) 2024-01-24T13:04:22.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca2000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0ca4070ac0 0x7f0ca406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41486/0 (socket says 172.21.15.29:41486) 2024-01-24T13:04:22.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca2a00640 1 -- 172.21.15.29:0/4020264794 learned_addr learned my addr 172.21.15.29:0/4020264794 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca3400640 1 --2- 172.21.15.29:0/4020264794 >> v2:172.21.15.163:3300/0 conn(0x7f0ca406c320 0x7f0ca40cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca2a00640 1 -- 172.21.15.29:0/4020264794 >> v2:172.21.15.163:3300/0 conn(0x7f0ca406c320 msgr2=0x7f0ca40cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca2a00640 1 --2- 172.21.15.29:0/4020264794 >> v2:172.21.15.163:3300/0 conn(0x7f0ca406c320 0x7f0ca40cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca2a00640 1 -- 172.21.15.29:0/4020264794 >> v1:172.21.15.29:6789/0 conn(0x7f0ca4070ac0 legacy=0x7f0ca406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca2a00640 1 -- 172.21.15.29:0/4020264794 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca40cd090 con 0x7f0ca4143910 2024-01-24T13:04:22.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca2a00640 1 --2- 172.21.15.29:0/4020264794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca4143910 0x7f0ca4143d30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40afcc0 tx=0x7f0c9401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0a9a8c5c285ba5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.028+0000 7f0ca1600640 1 -- 172.21.15.29:0/4020264794 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c940aa610 con 0x7f0ca4143910 2024-01-24T13:04:22.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca1600640 1 -- 172.21.15.29:0/4020264794 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c940a6040 con 0x7f0ca4143910 2024-01-24T13:04:22.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca1600640 1 -- 172.21.15.29:0/4020264794 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c940aa990 con 0x7f0ca4143910 2024-01-24T13:04:22.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 -- 172.21.15.29:0/4020264794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca4143910 msgr2=0x7f0ca4143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 --2- 172.21.15.29:0/4020264794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca4143910 0x7f0ca4143d30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40afcc0 tx=0x7f0c9401c4d0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 -- 172.21.15.29:0/4020264794 shutdown_connections 2024-01-24T13:04:22.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 --2- 172.21.15.29:0/4020264794 >> v2:172.21.15.163:3300/0 conn(0x7f0ca406c320 0x7f0ca40cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 --2- 172.21.15.29:0/4020264794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca4143910 0x7f0ca4143d30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 -- 172.21.15.29:0/4020264794 >> 172.21.15.29:0/4020264794 conn(0x7f0ca40b3950 msgr2=0x7f0ca4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 -- 172.21.15.29:0/4020264794 shutdown_connections 2024-01-24T13:04:22.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 -- 172.21.15.29:0/4020264794 wait complete. 2024-01-24T13:04:22.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 Processor -- start 2024-01-24T13:04:22.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 -- start start 2024-01-24T13:04:22.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca406c320 0x7f0ca4139a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ca4070ac0 0x7f0ca415c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ca4143910 0x7f0ca4153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca4139f60 con 0x7f0ca406c320 2024-01-24T13:04:22.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca415b910 con 0x7f0ca4070ac0 2024-01-24T13:04:22.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.032+0000 7f0ca9800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca415ad00 con 0x7f0ca4143910 2024-01-24T13:04:22.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0ca2a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca406c320 0x7f0ca4139a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0ca2a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca406c320 0x7f0ca4139a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37040/0 (socket says 172.21.15.29:37040) 2024-01-24T13:04:22.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0ca2a00640 1 -- 172.21.15.29:0/2007631588 learned_addr learned my addr 172.21.15.29:0/2007631588 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0ca3400640 1 --2- 172.21.15.29:0/2007631588 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ca4143910 0x7f0ca4153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0ca2000640 1 --2- 172.21.15.29:0/2007631588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ca4070ac0 0x7f0ca415c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0ca2a00640 1 -- 172.21.15.29:0/2007631588 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ca4143910 msgr2=0x7f0ca4153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0ca2a00640 1 --2- 172.21.15.29:0/2007631588 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ca4143910 0x7f0ca4153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0ca2a00640 1 -- 172.21.15.29:0/2007631588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ca4070ac0 msgr2=0x7f0ca415c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0ca2a00640 1 --2- 172.21.15.29:0/2007631588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ca4070ac0 0x7f0ca415c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0ca2a00640 1 -- 172.21.15.29:0/2007631588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c940094d0 con 0x7f0ca406c320 2024-01-24T13:04:22.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0ca2a00640 1 --2- 172.21.15.29:0/2007631588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca406c320 0x7f0ca4139a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0c940190e0 tx=0x7f0c9401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0c9aa00640 1 -- 172.21.15.29:0/2007631588 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c940bd5f0 con 0x7f0ca406c320 2024-01-24T13:04:22.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0c9aa00640 1 -- 172.21.15.29:0/2007631588 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c940bd750 con 0x7f0ca406c320 2024-01-24T13:04:22.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0ca9800640 1 -- 172.21.15.29:0/2007631588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca415afe0 con 0x7f0ca406c320 2024-01-24T13:04:22.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0c9aa00640 1 -- 172.21.15.29:0/2007631588 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c940bdb00 con 0x7f0ca406c320 2024-01-24T13:04:22.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0ca9800640 1 -- 172.21.15.29:0/2007631588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca415b5a0 con 0x7f0ca406c320 2024-01-24T13:04:22.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0ca9800640 1 -- 172.21.15.29:0/2007631588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca404e850 con 0x7f0ca406c320 2024-01-24T13:04:22.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.036+0000 7f0c9aa00640 1 -- 172.21.15.29:0/2007631588 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0c940b33f0 con 0x7f0ca406c320 2024-01-24T13:04:22.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.040+0000 7f0c9aa00640 1 --2- 172.21.15.29:0/2007631588 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0c7c065a60 0x7f0c7c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.040+0000 7f0c9aa00640 1 -- 172.21.15.29:0/2007631588 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0c9411e040 con 0x7f0ca406c320 2024-01-24T13:04:22.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.040+0000 7f0ca2000640 1 --2- 172.21.15.29:0/2007631588 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0c7c065a60 0x7f0c7c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.040+0000 7f0ca2000640 1 --2- 172.21.15.29:0/2007631588 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0c7c065a60 0x7f0c7c067f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ca415c500 tx=0x7f0c8c007e50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.040+0000 7f0c9aa00640 1 -- 172.21.15.29:0/2007631588 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f0c940eb850 con 0x7f0ca406c320 2024-01-24T13:04:22.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.200+0000 7f0ca9800640 1 -- 172.21.15.29:0/2007631588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ca4165160 con 0x7f0ca406c320 2024-01-24T13:04:22.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.200+0000 7f0c9aa00640 1 -- 172.21.15.29:0/2007631588 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f0c940aae60 con 0x7f0ca406c320 2024-01-24T13:04:22.202 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:22.202 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:01.140044+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:22.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.200+0000 7f0ca9800640 1 -- 172.21.15.29:0/2007631588 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0c7c065a60 msgr2=0x7f0c7c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.200+0000 7f0ca9800640 1 --2- 172.21.15.29:0/2007631588 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0c7c065a60 0x7f0c7c067f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ca415c500 tx=0x7f0c8c007e50 comp rx=0 tx=0).stop 2024-01-24T13:04:22.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.200+0000 7f0ca9800640 1 -- 172.21.15.29:0/2007631588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca406c320 msgr2=0x7f0ca4139a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.200+0000 7f0ca9800640 1 --2- 172.21.15.29:0/2007631588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca406c320 0x7f0ca4139a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0c940190e0 tx=0x7f0c9401ad10 comp rx=0 tx=0).stop 2024-01-24T13:04:22.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.200+0000 7f0ca9800640 1 -- 172.21.15.29:0/2007631588 shutdown_connections 2024-01-24T13:04:22.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.200+0000 7f0ca9800640 1 --2- 172.21.15.29:0/2007631588 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0c7c065a60 0x7f0c7c067f20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.200+0000 7f0ca9800640 1 --2- 172.21.15.29:0/2007631588 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ca4143910 0x7f0ca4153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.200+0000 7f0ca9800640 1 --2- 172.21.15.29:0/2007631588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ca4070ac0 0x7f0ca415c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.200+0000 7f0ca9800640 1 --2- 172.21.15.29:0/2007631588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca406c320 0x7f0ca4139a20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.200+0000 7f0ca9800640 1 -- 172.21.15.29:0/2007631588 >> 172.21.15.29:0/2007631588 conn(0x7f0ca40b3950 msgr2=0x7f0ca40af030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.204+0000 7f0ca9800640 1 -- 172.21.15.29:0/2007631588 shutdown_connections 2024-01-24T13:04:22.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.204+0000 7f0ca9800640 1 -- 172.21.15.29:0/2007631588 wait complete. 2024-01-24T13:04:22.226 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-24T13:04:22.226 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-24T13:04:22.227 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-24T13:04:22.227 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-24T13:04:22.227 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-24T13:04:22.228 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-24T13:04:22.228 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-24T13:04:22.228 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-24T13:04:22.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.468+0000 7f6162600640 1 Processor -- start 2024-01-24T13:04:22.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.468+0000 7f6162600640 1 -- start start 2024-01-24T13:04:22.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7f6162600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f615c0cb940 0x7f615c0ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7f6162600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f615c0ca160 0x7f615c0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7f6162600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c0cd6e0 con 0x7f615c15c410 2024-01-24T13:04:22.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7f6162600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615c0cab30 con 0x7f615c0cb940 2024-01-24T13:04:22.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7f6162600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c15c8c0 con 0x7f615c0ca160 2024-01-24T13:04:22.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7f6161000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f615c0ca160 0x7f615c0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7f6161000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f615c0ca160 0x7f615c0ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53170/0 (socket says 172.21.15.29:53170) 2024-01-24T13:04:22.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7f6161000640 1 -- 172.21.15.29:0/2541298787 learned_addr learned my addr 172.21.15.29:0/2541298787 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7f615a000640 1 -- 172.21.15.29:0/2541298787 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669313094 0 0) 0x7f615c0cd6e0 con 0x7f615c15c410 2024-01-24T13:04:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7f6161000640 1 -- 172.21.15.29:0/2541298787 >> v2:172.21.15.163:3300/0 conn(0x7f615c0cb940 msgr2=0x7f615c0ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7f615b400640 1 --2- 172.21.15.29:0/2541298787 >> v2:172.21.15.163:3300/0 conn(0x7f615c0cb940 0x7f615c0ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7fb41d600640 1 Processor -- start 2024-01-24T13:04:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7f6161000640 1 --2- 172.21.15.29:0/2541298787 >> v2:172.21.15.163:3300/0 conn(0x7f615c0cb940 0x7f615c0ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7f6161000640 1 -- 172.21.15.29:0/2541298787 >> v1:172.21.15.29:6789/0 conn(0x7f615c15c410 legacy=0x7f615c0b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7f6161000640 1 -- 172.21.15.29:0/2541298787 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c06f630 con 0x7f615c0ca160 2024-01-24T13:04:22.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.472+0000 7fb41d600640 1 -- start start 2024-01-24T13:04:22.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb41d600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb41815bdd0 0x7fb41815cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb41d600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb41806d6b0 0x7fb4180706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb41d600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4180cda30 con 0x7fb4180cd020 2024-01-24T13:04:22.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb41d600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41815d4c0 con 0x7fb41815bdd0 2024-01-24T13:04:22.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb41d600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180cc450 con 0x7fb41806d6b0 2024-01-24T13:04:22.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7f3a4d800640 1 Processor -- start 2024-01-24T13:04:22.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7f3a4d800640 1 -- start start 2024-01-24T13:04:22.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb417400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb41806d6b0 0x7fb4180706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb416000640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fb4180cd020 0x7fb41806cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:35888/0 (socket says 172.21.15.29:35888) 2024-01-24T13:04:22.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb416000640 1 -- 172.21.15.29:0/3105650732 learned_addr learned my addr 172.21.15.29:0/3105650732 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:22.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb416a00640 1 --2- 172.21.15.29:0/3105650732 >> v2:172.21.15.163:3300/0 conn(0x7fb41815bdd0 0x7fb41815cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb415600640 1 -- 172.21.15.29:0/3105650732 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889939828 0 0) 0x7fb4180cda30 con 0x7fb4180cd020 2024-01-24T13:04:22.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb415600640 1 -- 172.21.15.29:0/3105650732 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3f8003530 con 0x7fb4180cd020 2024-01-24T13:04:22.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb417400640 1 -- 172.21.15.29:0/3105650732 >> v2:172.21.15.163:3300/0 conn(0x7fb41815bdd0 msgr2=0x7fb41815cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb417400640 1 --2- 172.21.15.29:0/3105650732 >> v2:172.21.15.163:3300/0 conn(0x7fb41815bdd0 0x7fb41815cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb417400640 1 -- 172.21.15.29:0/3105650732 >> v1:172.21.15.163:6789/0 conn(0x7fb4180cd020 legacy=0x7fb41806cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7fb417400640 1 -- 172.21.15.29:0/3105650732 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180cdf60 con 0x7fb41806d6b0 2024-01-24T13:04:22.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7f3a4d800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a40048200 0x7f3a400eb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7f3a4d800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a40047bd0 0x7f3a40052ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7f3a4d800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a400ebda0 con 0x7f3a40033d10 2024-01-24T13:04:22.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7f3a4d800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a400ec020 con 0x7f3a40048200 2024-01-24T13:04:22.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.476+0000 7f3a4d800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4004f200 con 0x7f3a40047bd0 2024-01-24T13:04:22.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7f3a47400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a40047bd0 0x7f3a40052ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7f3a46000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a40048200 0x7f3a400eb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7f3a46a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3a40033d10 0x7f3a400eb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41506/0 (socket says 172.21.15.29:41506) 2024-01-24T13:04:22.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7f3a46a00640 1 -- 172.21.15.29:0/297155732 learned_addr learned my addr 172.21.15.29:0/297155732 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:22.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7f3a46000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a40048200 0x7f3a400eb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37056/0 (socket says 172.21.15.29:37056) 2024-01-24T13:04:22.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7f3a47400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a40047bd0 0x7f3a40052ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53186/0 (socket says 172.21.15.29:53186) 2024-01-24T13:04:22.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7f3a46000640 1 -- 172.21.15.29:0/297155732 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a40047bd0 msgr2=0x7f3a40052ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7f3a46000640 1 --2- 172.21.15.29:0/297155732 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a40047bd0 0x7f3a40052ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7f3a46000640 1 -- 172.21.15.29:0/297155732 >> v1:172.21.15.29:6789/0 conn(0x7f3a40033d10 legacy=0x7f3a400eb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7f3a46000640 1 -- 172.21.15.29:0/297155732 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4004f4e0 con 0x7f3a40048200 2024-01-24T13:04:22.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7fb416a00640 1 --2- 172.21.15.29:0/3105650732 >> v2:172.21.15.163:3300/0 conn(0x7fb41815bdd0 0x7fb41815cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:22.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7f6161000640 1 --2- 172.21.15.29:0/2541298787 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f615c0ca160 0x7f615c0ca5f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f614c009870 tx=0x7f614c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fcc22bf06cc2741 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7f615a000640 1 -- 172.21.15.29:0/2541298787 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c0aa670 con 0x7f615c0ca160 2024-01-24T13:04:22.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7f615a000640 1 -- 172.21.15.29:0/2541298787 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c0aa7d0 con 0x7f615c0ca160 2024-01-24T13:04:22.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.480+0000 7f615a000640 1 -- 172.21.15.29:0/2541298787 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c0aab60 con 0x7f615c0ca160 2024-01-24T13:04:22.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f6162600640 1 -- 172.21.15.29:0/2541298787 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f615c0ca160 msgr2=0x7f615c0ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f6162600640 1 --2- 172.21.15.29:0/2541298787 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f615c0ca160 0x7f615c0ca5f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f614c009870 tx=0x7f614c01c510 comp rx=0 tx=0).stop 2024-01-24T13:04:22.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f6162600640 1 -- 172.21.15.29:0/2541298787 shutdown_connections 2024-01-24T13:04:22.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f6162600640 1 --2- 172.21.15.29:0/2541298787 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f615c0ca160 0x7f615c0ca5f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f6162600640 1 --2- 172.21.15.29:0/2541298787 >> v2:172.21.15.163:3300/0 conn(0x7f615c0cb940 0x7f615c0ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f6162600640 1 -- 172.21.15.29:0/2541298787 >> 172.21.15.29:0/2541298787 conn(0x7f615c0cc590 msgr2=0x7f615c0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7fb417400640 1 --2- 172.21.15.29:0/3105650732 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb41806d6b0 0x7fb4180706a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb4000097c0 tx=0x7fb40001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdf96278277d4274 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f6162600640 1 -- 172.21.15.29:0/2541298787 shutdown_connections 2024-01-24T13:04:22.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f3a46000640 1 --2- 172.21.15.29:0/297155732 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a40048200 0x7f3a400eb860 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3a380097c0 tx=0x7f3a3801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d5c8a7157cd0b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7fb415600640 1 -- 172.21.15.29:0/3105650732 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4000a8970 con 0x7fb41806d6b0 2024-01-24T13:04:22.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f3a45600640 1 -- 172.21.15.29:0/297155732 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a380ab600 con 0x7f3a40048200 2024-01-24T13:04:22.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f6162600640 1 -- 172.21.15.29:0/2541298787 wait complete. 2024-01-24T13:04:22.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f3a45600640 1 -- 172.21.15.29:0/297155732 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a380a7050 con 0x7f3a40048200 2024-01-24T13:04:22.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f3a45600640 1 -- 172.21.15.29:0/297155732 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a380ab980 con 0x7f3a40048200 2024-01-24T13:04:22.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f5fe4c00640 1 Processor -- start 2024-01-24T13:04:22.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f5fe4c00640 1 -- start start 2024-01-24T13:04:22.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7fa417200640 1 Processor -- start 2024-01-24T13:04:22.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7fa417200640 1 -- start start 2024-01-24T13:04:22.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7fb415600640 1 -- 172.21.15.29:0/3105650732 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4000a8ad0 con 0x7fb41806d6b0 2024-01-24T13:04:22.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7fb415600640 1 -- 172.21.15.29:0/3105650732 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4000a8970 con 0x7fb41806d6b0 2024-01-24T13:04:22.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7fb41d600640 1 -- 172.21.15.29:0/3105650732 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb41806d6b0 msgr2=0x7fb4180706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7fb41d600640 1 --2- 172.21.15.29:0/3105650732 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb41806d6b0 0x7fb4180706a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb4000097c0 tx=0x7fb40001ec90 comp rx=0 tx=0).stop 2024-01-24T13:04:22.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f3a4d800640 1 -- 172.21.15.29:0/297155732 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a40048200 msgr2=0x7f3a400eb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f3a4d800640 1 --2- 172.21.15.29:0/297155732 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a40048200 0x7f3a400eb860 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3a380097c0 tx=0x7f3a3801c480 comp rx=0 tx=0).stop 2024-01-24T13:04:22.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f3a4d800640 1 -- 172.21.15.29:0/297155732 shutdown_connections 2024-01-24T13:04:22.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f3a4d800640 1 --2- 172.21.15.29:0/297155732 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a40047bd0 0x7f3a40052ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f3a4d800640 1 --2- 172.21.15.29:0/297155732 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a40048200 0x7f3a400eb860 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f3a4d800640 1 -- 172.21.15.29:0/297155732 >> 172.21.15.29:0/297155732 conn(0x7f3a40054b10 msgr2=0x7f3a40054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f3a4d800640 1 -- 172.21.15.29:0/297155732 shutdown_connections 2024-01-24T13:04:22.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.484+0000 7f08d7000640 1 Processor -- start 2024-01-24T13:04:22.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f6162600640 1 Processor -- start 2024-01-24T13:04:22.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f5fe4c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5fe0158570 0x7f5fe00b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f5fe4c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5fe00b22c0 0x7f5fe0070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f5fe4c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe015c2b0 con 0x7f5fe00ad870 2024-01-24T13:04:22.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f5fe4c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe015c590 con 0x7f5fe00b22c0 2024-01-24T13:04:22.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f5fe4c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe015c870 con 0x7f5fe0158570 2024-01-24T13:04:22.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f6162600640 1 -- start start 2024-01-24T13:04:22.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f5fdea00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f5fe00ad870 0x7f5fe00b1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:35892/0 (socket says 172.21.15.29:35892) 2024-01-24T13:04:22.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f5fdea00640 1 -- 172.21.15.29:0/2094562856 learned_addr learned my addr 172.21.15.29:0/2094562856 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:22.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f5fdfe00640 1 --2- 172.21.15.29:0/2094562856 >> v2:172.21.15.29:3300/0 conn(0x7f5fe00b22c0 0x7f5fe0070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7fa417200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa41015c1e0 0x7fa41015c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7fb41d600640 1 -- 172.21.15.29:0/3105650732 shutdown_connections 2024-01-24T13:04:22.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7fb41d600640 1 --2- 172.21.15.29:0/3105650732 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb41806d6b0 0x7fb4180706a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7fb41d600640 1 --2- 172.21.15.29:0/3105650732 >> v2:172.21.15.163:3300/0 conn(0x7fb41815bdd0 0x7fb41815cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7fb41d600640 1 -- 172.21.15.29:0/3105650732 >> 172.21.15.29:0/3105650732 conn(0x7fb4180cac10 msgr2=0x7fb4180caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f6162600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f615c0ca160 0x7f615c1fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f5fdf400640 1 --2- 172.21.15.29:0/2094562856 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5fe0158570 0x7f5fe00b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f08d7000640 1 -- start start 2024-01-24T13:04:22.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f6162600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f615c0cb940 0x7f615c15e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f615b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f615c0ca160 0x7f615c1fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f6162600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f615c15c410 0x7f615c1582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f615b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f615c0ca160 0x7f615c1fda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34112/0 (socket says 172.21.15.29:34112) 2024-01-24T13:04:22.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f6162600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c15f8c0 con 0x7f615c0cb940 2024-01-24T13:04:22.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f6162600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0c6e80 con 0x7f615c0ca160 2024-01-24T13:04:22.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f6162600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c15edf0 con 0x7f615c15c410 2024-01-24T13:04:22.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f3a4d800640 1 -- 172.21.15.29:0/297155732 wait complete. 2024-01-24T13:04:22.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f3a4d800640 1 Processor -- start 2024-01-24T13:04:22.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7fa415400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa4100b4010 0x7fa4100b44a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41522/0 (socket says 172.21.15.29:41522) 2024-01-24T13:04:22.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7fa415400640 1 -- 172.21.15.29:0/1480981816 learned_addr learned my addr 172.21.15.29:0/1480981816 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:22.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7fa417200640 1 --2- 172.21.15.29:0/1480981816 >> v2:172.21.15.163:3300/0 conn(0x7fa4100b4bb0 0x7fa4100d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f5fde000640 1 -- 172.21.15.29:0/2094562856 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863747560 0 0) 0x7f5fe015c2b0 con 0x7f5fe00ad870 2024-01-24T13:04:22.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f5fde000640 1 -- 172.21.15.29:0/2094562856 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc0003530 con 0x7f5fe00ad870 2024-01-24T13:04:22.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f08d7000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f08d00b08e0 0x7f08d00b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f08d7000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f08d0070810 0x7f08d0070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f08d7000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d0159d60 con 0x7f08d0158d70 2024-01-24T13:04:22.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f08d7000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d0159220 con 0x7f08d0070810 2024-01-24T13:04:22.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f08d7000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d01594c0 con 0x7f08d00b08e0 2024-01-24T13:04:22.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7fa417200640 1 -- 172.21.15.29:0/1480981816 --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa410160200 con 0x7fa4100b4010 2024-01-24T13:04:22.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7fa417200640 1 -- 172.21.15.29:0/1480981816 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41015cb00 con 0x7fa41015c1e0 2024-01-24T13:04:22.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7fa417200640 1 -- 172.21.15.29:0/1480981816 --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4100d1630 con 0x7fa4100b4bb0 2024-01-24T13:04:22.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7fa416800640 1 --2- 172.21.15.29:0/1480981816 >> v2:172.21.15.163:3300/0 conn(0x7fa4100b4bb0 0x7fa4100d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f615b400640 1 -- 172.21.15.29:0/978704654 learned_addr learned my addr 172.21.15.29:0/978704654 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f6161000640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f615c15c410 0x7f615c1582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.488+0000 7f615aa00640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f615c0cb940 0x7f615c15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f615b400640 1 -- 172.21.15.29:0/978704654 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f615c15c410 msgr2=0x7f615c1582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f615b400640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f615c15c410 0x7f615c1582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f615b400640 1 -- 172.21.15.29:0/978704654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f615c0cb940 msgr2=0x7f615c15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f615b400640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f615c0cb940 0x7f615c15e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f615b400640 1 -- 172.21.15.29:0/978704654 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c0094d0 con 0x7f615c0ca160 2024-01-24T13:04:22.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f08d5c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f08d00b08e0 0x7f08d00b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f08d5c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f08d00b08e0 0x7f08d00b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34130/0 (socket says 172.21.15.29:34130) 2024-01-24T13:04:22.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f08d5c00640 1 -- 172.21.15.29:0/2781476239 learned_addr learned my addr 172.21.15.29:0/2781476239 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a4d800640 1 -- start start 2024-01-24T13:04:22.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fde000640 1 -- 172.21.15.29:0/2094562856 <== mon.1 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4108595799 0 0) 0x7f5fc0003530 con 0x7f5fe00ad870 2024-01-24T13:04:22.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fde000640 1 -- 172.21.15.29:0/2094562856 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5fe0158570 msgr2=0x7f5fe00b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fde000640 1 --2- 172.21.15.29:0/2094562856 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5fe0158570 0x7f5fe00b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fde000640 1 -- 172.21.15.29:0/2094562856 >> v2:172.21.15.29:3300/0 conn(0x7f5fe00b22c0 msgr2=0x7f5fe0070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fde000640 1 --2- 172.21.15.29:0/2094562856 >> v2:172.21.15.29:3300/0 conn(0x7f5fe00b22c0 0x7f5fe0070730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fde000640 1 -- 172.21.15.29:0/2094562856 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe015cb50 con 0x7f5fe00ad870 2024-01-24T13:04:22.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fde000640 1 -- 172.21.15.29:0/2094562856 <== mon.1 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f5fd8001a00 con 0x7f5fe00ad870 2024-01-24T13:04:22.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fde000640 1 -- 172.21.15.29:0/2094562856 >> v1:172.21.15.163:6789/0 conn(0x7f5fe00ad870 legacy=0x7f5fe00b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fde000640 1 --2- 172.21.15.29:0/2094562856 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fc0003980 0x7f5fc0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fde000640 1 --2- 172.21.15.29:0/2094562856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fc00047d0 0x7f5fc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fde000640 1 --2- 172.21.15.29:0/2094562856 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5fc0005190 0x7f5fc000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fde000640 1 -- 172.21.15.29:0/2094562856 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe015c590 con 0x7f5fc00047d0 2024-01-24T13:04:22.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fde000640 1 -- 172.21.15.29:0/2094562856 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe015c870 con 0x7f5fc0003980 2024-01-24T13:04:22.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fde000640 1 -- 172.21.15.29:0/2094562856 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc000bf80 con 0x7f5fc0005190 2024-01-24T13:04:22.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7fa415e00640 1 --2- 172.21.15.29:0/1480981816 >> v2:172.21.15.29:3300/0 conn(0x7fa41015c1e0 0x7fa41015c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7fc6c5000640 1 Processor -- start 2024-01-24T13:04:22.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f615aa00640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f615c0cb940 0x7f615c15e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:22.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f615b400640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f615c0ca160 0x7f615c1fda60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f615400ce20 tx=0x7f615400a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f08d5c00640 1 -- 172.21.15.29:0/2781476239 >> v2:172.21.15.29:3300/0 conn(0x7f08d0070810 msgr2=0x7f08d0070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f08d5c00640 1 --2- 172.21.15.29:0/2781476239 >> v2:172.21.15.29:3300/0 conn(0x7f08d0070810 0x7f08d0070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f08d5c00640 1 -- 172.21.15.29:0/2781476239 >> v1:172.21.15.29:6789/0 conn(0x7f08d0158d70 legacy=0x7f08d0152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f08d5c00640 1 -- 172.21.15.29:0/2781476239 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d01597a0 con 0x7f08d00b08e0 2024-01-24T13:04:22.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7fc6c5000640 1 -- start start 2024-01-24T13:04:22.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fdea00640 1 --2- 172.21.15.29:0/2094562856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fc00047d0 0x7f5fc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fdfe00640 1 --2- 172.21.15.29:0/2094562856 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5fc0005190 0x7f5fc000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fdf400640 1 --2- 172.21.15.29:0/2094562856 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fc0003980 0x7f5fc0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7fa416800640 1 -- 172.21.15.29:0/1480981816 >> v2:172.21.15.29:3300/0 conn(0x7fa41015c1e0 msgr2=0x7fa41015c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7fa416800640 1 --2- 172.21.15.29:0/1480981816 >> v2:172.21.15.29:3300/0 conn(0x7fa41015c1e0 0x7fa41015c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7fa416800640 1 -- 172.21.15.29:0/1480981816 >> v1:172.21.15.29:6789/0 conn(0x7fa4100b4010 legacy=0x7fa4100b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7fa416800640 1 -- 172.21.15.29:0/1480981816 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4101604a0 con 0x7fa4100b4bb0 2024-01-24T13:04:22.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f6153400640 1 -- 172.21.15.29:0/978704654 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154003ba0 con 0x7f615c0ca160 2024-01-24T13:04:22.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f6153400640 1 -- 172.21.15.29:0/978704654 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6154003d00 con 0x7f615c0ca160 2024-01-24T13:04:22.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f6153400640 1 -- 172.21.15.29:0/978704654 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154004260 con 0x7f615c0ca160 2024-01-24T13:04:22.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a4d800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a40033d10 0x7f3a400061d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a4d800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a40047bd0 0x7f3a4004bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a4d800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a40048200 0x7f3a400db730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a4d800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40184480 con 0x7f3a40033d10 2024-01-24T13:04:22.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a4d800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4004c980 con 0x7f3a40048200 2024-01-24T13:04:22.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a4d800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40183b70 con 0x7f3a40047bd0 2024-01-24T13:04:22.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fdf400640 1 -- 172.21.15.29:0/2094562856 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5fc0005190 msgr2=0x7f5fc000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fdf400640 1 --2- 172.21.15.29:0/2094562856 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5fc0005190 0x7f5fc000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fdf400640 1 -- 172.21.15.29:0/2094562856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fc00047d0 msgr2=0x7f5fc0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fdf400640 1 --2- 172.21.15.29:0/2094562856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fc00047d0 0x7f5fc0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fdf400640 1 -- 172.21.15.29:0/2094562856 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc0003530 con 0x7f5fc0003980 2024-01-24T13:04:22.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f5fdfe00640 1 --2- 172.21.15.29:0/2094562856 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5fc0005190 0x7f5fc000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7fc6c5000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc6c015c5c0 0x7fc6c00b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7fc6c5000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6c00d1ad0 0x7fc6c00d1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7fc6c5000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c0160200 con 0x7fc6c015c1e0 2024-01-24T13:04:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7fc6c5000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c00d1630 con 0x7fc6c015c5c0 2024-01-24T13:04:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7fc6c5000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c015ca50 con 0x7fc6c00d1ad0 2024-01-24T13:04:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a47400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a40048200 0x7f3a400db730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a47400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a40048200 0x7f3a400db730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34152/0 (socket says 172.21.15.29:34152) 2024-01-24T13:04:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a47400640 1 -- 172.21.15.29:0/4003673224 learned_addr learned my addr 172.21.15.29:0/4003673224 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a47400640 1 -- 172.21.15.29:0/4003673224 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a40047bd0 msgr2=0x7f3a4004bbe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-24T13:04:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a47400640 1 --2- 172.21.15.29:0/4003673224 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a40047bd0 0x7f3a4004bbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a47400640 1 -- 172.21.15.29:0/4003673224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a40033d10 msgr2=0x7f3a400061d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a47400640 1 --2- 172.21.15.29:0/4003673224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a40033d10 0x7f3a400061d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a47400640 1 -- 172.21.15.29:0/4003673224 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a38009420 con 0x7f3a40048200 2024-01-24T13:04:22.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f3a47400640 1 --2- 172.21.15.29:0/4003673224 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a40048200 0x7f3a400db730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a4804f940 tx=0x7f3a48073640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7fb41d600640 1 -- 172.21.15.29:0/3105650732 shutdown_connections 2024-01-24T13:04:22.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.492+0000 7f6162600640 1 -- 172.21.15.29:0/978704654 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c15f020 con 0x7f615c0ca160 2024-01-24T13:04:22.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7fc6bf400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fc6c015c1e0 0x7fc6c00b4010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:35898/0 (socket says 172.21.15.29:35898) 2024-01-24T13:04:22.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7fc6bfe00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6c00d1ad0 0x7fc6c00d1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7fc6bf400640 1 -- 172.21.15.29:0/1267102982 learned_addr learned my addr 172.21.15.29:0/1267102982 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:22.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7fb41d600640 1 -- 172.21.15.29:0/3105650732 wait complete. 2024-01-24T13:04:22.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f6162600640 1 -- 172.21.15.29:0/978704654 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c15f5e0 con 0x7f615c0ca160 2024-01-24T13:04:22.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f3a3ea00640 1 -- 172.21.15.29:0/4003673224 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a48072a60 con 0x7f3a40048200 2024-01-24T13:04:22.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f3a3ea00640 1 -- 172.21.15.29:0/4003673224 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a48072bc0 con 0x7f3a40048200 2024-01-24T13:04:22.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f3a3ea00640 1 -- 172.21.15.29:0/4003673224 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a48067170 con 0x7f3a40048200 2024-01-24T13:04:22.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7fc6bea00640 1 --2- 172.21.15.29:0/1267102982 >> v2:172.21.15.29:3300/0 conn(0x7fc6c015c5c0 0x7fc6c00b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f6162600640 1 -- 172.21.15.29:0/978704654 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f615c0b1d10 con 0x7f615c0ca160 2024-01-24T13:04:22.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7fc6be000640 1 -- 172.21.15.29:0/1267102982 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164148015 0 0) 0x7fc6c0160200 con 0x7fc6c015c1e0 2024-01-24T13:04:22.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f3a4d800640 1 -- 172.21.15.29:0/4003673224 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4004c6a0 con 0x7f3a40048200 2024-01-24T13:04:22.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7fc6be000640 1 -- 172.21.15.29:0/1267102982 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a0003530 con 0x7fc6c015c1e0 2024-01-24T13:04:22.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7fc6bfe00640 1 -- 172.21.15.29:0/1267102982 >> v2:172.21.15.29:3300/0 conn(0x7fc6c015c5c0 msgr2=0x7fc6c00b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7fc6bfe00640 1 --2- 172.21.15.29:0/1267102982 >> v2:172.21.15.29:3300/0 conn(0x7fc6c015c5c0 0x7fc6c00b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f3a4d800640 1 -- 172.21.15.29:0/4003673224 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a401840a0 con 0x7f3a40048200 2024-01-24T13:04:22.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f08d5c00640 1 --2- 172.21.15.29:0/2781476239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08d00b08e0 0x7f08d00b1350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f08d00b0dd0 tx=0x7f08b801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b80c09c1dc7be20e server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7fb41d600640 1 Processor -- start 2024-01-24T13:04:22.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7fb41d600640 1 -- start start 2024-01-24T13:04:22.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f5fdf400640 1 --2- 172.21.15.29:0/2094562856 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fc0003980 0x7f5fc0003da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fe006a8a0 tx=0x7f5fd0024bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dc1eadab53d0904 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f5fde000640 1 -- 172.21.15.29:0/2094562856 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00adac0 con 0x7f5fc0003980 2024-01-24T13:04:22.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f5fde000640 1 -- 172.21.15.29:0/2094562856 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd00b1070 con 0x7f5fc0003980 2024-01-24T13:04:22.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f5fde000640 1 -- 172.21.15.29:0/2094562856 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00ade80 con 0x7f5fc0003980 2024-01-24T13:04:22.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f5fe4c00640 1 -- 172.21.15.29:0/2094562856 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fc0003980 msgr2=0x7f5fc0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f5fe4c00640 1 --2- 172.21.15.29:0/2094562856 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fc0003980 0x7f5fc0003da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fe006a8a0 tx=0x7f5fd0024bc0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f5fdfe00640 1 -- 172.21.15.29:0/2094562856 reap_dead start 2024-01-24T13:04:22.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f08cfe00640 1 -- 172.21.15.29:0/2781476239 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b80ab600 con 0x7f08d00b08e0 2024-01-24T13:04:22.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f08cfe00640 1 -- 172.21.15.29:0/2781476239 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b80a7050 con 0x7f08d00b08e0 2024-01-24T13:04:22.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f08cfe00640 1 -- 172.21.15.29:0/2781476239 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b80ab980 con 0x7f08d00b08e0 2024-01-24T13:04:22.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f08d7000640 1 -- 172.21.15.29:0/2781476239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08d00b08e0 msgr2=0x7f08d00b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f08d7000640 1 --2- 172.21.15.29:0/2781476239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08d00b08e0 0x7f08d00b1350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f08d00b0dd0 tx=0x7f08b801c430 comp rx=0 tx=0).stop 2024-01-24T13:04:22.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f9945a00640 1 Processor -- start 2024-01-24T13:04:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f9945a00640 1 -- start start 2024-01-24T13:04:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7fc6bfe00640 1 -- 172.21.15.29:0/1267102982 >> v1:172.21.15.163:6789/0 conn(0x7fc6c015c1e0 legacy=0x7fc6c00b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7fc6bfe00640 1 -- 172.21.15.29:0/1267102982 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c01604a0 con 0x7fc6c00d1ad0 2024-01-24T13:04:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.496+0000 7f3a37e00640 1 -- 172.21.15.29:0/4003673224 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a40053c30 con 0x7f3a40048200 2024-01-24T13:04:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb41d600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb41806d6b0 0x7fb418142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb41d600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4180cd020 0x7fb41815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb41d600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb41815bdd0 0x7fb41815c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb416a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb41806d6b0 0x7fb418142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb416a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb41806d6b0 0x7fb418142ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37118/0 (socket says 172.21.15.29:37118) 2024-01-24T13:04:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb416000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4180cd020 0x7fb41815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb416000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4180cd020 0x7fb41815c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53214/0 (socket says 172.21.15.29:53214) 2024-01-24T13:04:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb417400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb41815bdd0 0x7fb41815c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb417400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb41815bdd0 0x7fb41815c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34154/0 (socket says 172.21.15.29:34154) 2024-01-24T13:04:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb416a00640 1 -- 172.21.15.29:0/4103491047 learned_addr learned my addr 172.21.15.29:0/4103491047 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb41d600640 1 -- 172.21.15.29:0/4103491047 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4181443b0 con 0x7fb41806d6b0 2024-01-24T13:04:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb41d600640 1 -- 172.21.15.29:0/4103491047 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb418144060 con 0x7fb41815bdd0 2024-01-24T13:04:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb41d600640 1 -- 172.21.15.29:0/4103491047 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb418143780 con 0x7fb4180cd020 2024-01-24T13:04:22.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f6153400640 1 -- 172.21.15.29:0/978704654 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f61540043c0 con 0x7f615c0ca160 2024-01-24T13:04:22.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f3a3ea00640 1 -- 172.21.15.29:0/4003673224 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3a4809c3a0 con 0x7f3a40048200 2024-01-24T13:04:22.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f5fe4c00640 1 -- 172.21.15.29:0/2094562856 shutdown_connections 2024-01-24T13:04:22.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f5fe4c00640 1 -- 172.21.15.29:0/2094562856 >> 172.21.15.29:0/2094562856 conn(0x7f5fe006d700 msgr2=0x7f5fe0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fa416800640 1 --2- 172.21.15.29:0/1480981816 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4100b4bb0 0x7fa4100d1ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa4100ce050 tx=0x7fa40001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b7a692d3536247f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f08d7000640 1 -- 172.21.15.29:0/2781476239 shutdown_connections 2024-01-24T13:04:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f08d7000640 1 --2- 172.21.15.29:0/2781476239 >> v2:172.21.15.29:3300/0 conn(0x7f08d0070810 0x7f08d0070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f08d7000640 1 --2- 172.21.15.29:0/2781476239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08d00b08e0 0x7f08d00b1350 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f08d7000640 1 -- 172.21.15.29:0/2781476239 >> 172.21.15.29:0/2781476239 conn(0x7f08d00afdc0 msgr2=0x7f08d00b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f9945a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99400b0590 0x7f9940164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f9945a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f994006fd70 0x7f99400c9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f9945a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99400701c0 con 0x7f99400c1940 2024-01-24T13:04:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f9945a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9940071c00 con 0x7f99400b0590 2024-01-24T13:04:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f9945a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99400c1d20 con 0x7f994006fd70 2024-01-24T13:04:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f993ea00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f99400c1940 0x7f99400afe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41538/0 (socket says 172.21.15.29:41538) 2024-01-24T13:04:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f993ea00640 1 -- 172.21.15.29:0/2319273273 learned_addr learned my addr 172.21.15.29:0/2319273273 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f6153400640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6134065ab0 0x7f6134067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f5fe4c00640 1 -- 172.21.15.29:0/2094562856 shutdown_connections 2024-01-24T13:04:22.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f5fe4c00640 1 -- 172.21.15.29:0/2094562856 wait complete. 2024-01-24T13:04:22.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f993e000640 1 --2- 172.21.15.29:0/2319273273 >> v2:172.21.15.29:3300/0 conn(0x7f99400b0590 0x7f9940164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f08d7000640 1 -- 172.21.15.29:0/2781476239 shutdown_connections 2024-01-24T13:04:22.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f6153400640 1 -- 172.21.15.29:0/978704654 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6154012070 con 0x7f615c0ca160 2024-01-24T13:04:22.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f615aa00640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6134065ab0 0x7f6134067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f993f400640 1 --2- 172.21.15.29:0/2319273273 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f994006fd70 0x7f99400c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb417400640 1 -- 172.21.15.29:0/4103491047 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4180cd020 msgr2=0x7fb41815c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb417400640 1 --2- 172.21.15.29:0/4103491047 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4180cd020 0x7fb41815c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb417400640 1 -- 172.21.15.29:0/4103491047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb41806d6b0 msgr2=0x7fb418142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb417400640 1 --2- 172.21.15.29:0/4103491047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb41806d6b0 0x7fb418142ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f993e000640 1 -- 172.21.15.29:0/2319273273 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f994006fd70 msgr2=0x7f99400c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f993e000640 1 --2- 172.21.15.29:0/2319273273 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f994006fd70 0x7f99400c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fb417400640 1 -- 172.21.15.29:0/4103491047 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb410009a70 con 0x7fb41815bdd0 2024-01-24T13:04:22.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f6153400640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.29:6822/26966,v1:172.21.15.29:6824/26966] conn(0x7f613406f0f0 0x7f6134071530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f6153400640 1 -- 172.21.15.29:0/978704654 --> [v2:172.21.15.29:6822/26966,v1:172.21.15.29:6824/26966] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6134071c00 con 0x7f613406f0f0 2024-01-24T13:04:22.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f6153400640 1 -- 172.21.15.29:0/978704654 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6154003eb0 con 0x7f615c0ca160 2024-01-24T13:04:22.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fa414a00640 1 -- 172.21.15.29:0/1480981816 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000ac600 con 0x7fa4100b4bb0 2024-01-24T13:04:22.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fa414a00640 1 -- 172.21.15.29:0/1480981816 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4000a8050 con 0x7fa4100b4bb0 2024-01-24T13:04:22.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fa414a00640 1 -- 172.21.15.29:0/1480981816 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000ac980 con 0x7fa4100b4bb0 2024-01-24T13:04:22.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f993e000640 1 -- 172.21.15.29:0/2319273273 >> v1:172.21.15.29:6789/0 conn(0x7f99400c1940 legacy=0x7f99400afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f993e000640 1 -- 172.21.15.29:0/2319273273 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9940165090 con 0x7f99400b0590 2024-01-24T13:04:22.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7fc6bfe00640 1 --2- 172.21.15.29:0/1267102982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6c00d1ad0 0x7fc6c00d1f20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009d90 tx=0x7fc6b801c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59fbe9046b100bb3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fc6be000640 1 -- 172.21.15.29:0/1267102982 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b80a59e0 con 0x7fc6c00d1ad0 2024-01-24T13:04:22.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fb417400640 1 --2- 172.21.15.29:0/4103491047 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb41815bdd0 0x7fb41815c6f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb4000af000 tx=0x7fb40001ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fb40ea00640 1 -- 172.21.15.29:0/4103491047 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400004450 con 0x7fb41815bdd0 2024-01-24T13:04:22.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fb40ea00640 1 -- 172.21.15.29:0/4103491047 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb400003620 con 0x7fb41815bdd0 2024-01-24T13:04:22.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fb40ea00640 1 -- 172.21.15.29:0/4103491047 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4000039b0 con 0x7fb41815bdd0 2024-01-24T13:04:22.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fb41d600640 1 -- 172.21.15.29:0/4103491047 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb400009420 con 0x7fb41815bdd0 2024-01-24T13:04:22.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fb41d600640 1 -- 172.21.15.29:0/4103491047 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb418143d40 con 0x7fb41815bdd0 2024-01-24T13:04:22.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f615aa00640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6134065ab0 0x7f6134067f70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f615c165dd0 tx=0x7f6144009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.500+0000 7f3a3ea00640 1 --2- 172.21.15.29:0/4003673224 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a20065b30 0x7f3a20067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f3a3ea00640 1 -- 172.21.15.29:0/4003673224 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3a480fca50 con 0x7f3a40048200 2024-01-24T13:04:22.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f3a3ea00640 1 --2- 172.21.15.29:0/4003673224 >> [v2:172.21.15.29:6816/26968,v1:172.21.15.29:6817/26968] conn(0x7f3a2006f170 0x7f3a200715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f3a3ea00640 1 -- 172.21.15.29:0/4003673224 --> [v2:172.21.15.29:6816/26968,v1:172.21.15.29:6817/26968] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a20071c80 con 0x7f3a2006f170 2024-01-24T13:04:22.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f3a3ea00640 1 -- 172.21.15.29:0/4003673224 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a481012a0 con 0x7f3a40048200 2024-01-24T13:04:22.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f3a46a00640 1 --2- 172.21.15.29:0/4003673224 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a20065b30 0x7f3a20067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f3a46000640 1 --2- 172.21.15.29:0/4003673224 >> [v2:172.21.15.29:6816/26968,v1:172.21.15.29:6817/26968] conn(0x7f3a2006f170 0x7f3a200715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fa417200640 1 -- 172.21.15.29:0/1480981816 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4100b4bb0 msgr2=0x7fa4100d1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fa417200640 1 --2- 172.21.15.29:0/1480981816 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4100b4bb0 0x7fa4100d1ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa4100ce050 tx=0x7fa40001c3a0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f08d7000640 1 -- 172.21.15.29:0/2781476239 wait complete. 2024-01-24T13:04:22.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fc6be000640 1 -- 172.21.15.29:0/1267102982 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b80a5b40 con 0x7fc6c00d1ad0 2024-01-24T13:04:22.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fc6be000640 1 -- 172.21.15.29:0/1267102982 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b80ad440 con 0x7fc6c00d1ad0 2024-01-24T13:04:22.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fc6c5000640 1 -- 172.21.15.29:0/1267102982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6c00d1ad0 msgr2=0x7fc6c00d1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fc6c5000640 1 --2- 172.21.15.29:0/1267102982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6c00d1ad0 0x7fc6c00d1f20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009d90 tx=0x7fc6b801c960 comp rx=0 tx=0).stop 2024-01-24T13:04:22.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f6161000640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.29:6822/26966,v1:172.21.15.29:6824/26966] conn(0x7f613406f0f0 0x7f6134071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f5fe4c00640 1 Processor -- start 2024-01-24T13:04:22.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fa417200640 1 -- 172.21.15.29:0/1480981816 shutdown_connections 2024-01-24T13:04:22.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fa417200640 1 --2- 172.21.15.29:0/1480981816 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4100b4bb0 0x7fa4100d1ad0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fa417200640 1 --2- 172.21.15.29:0/1480981816 >> v2:172.21.15.29:3300/0 conn(0x7fa41015c1e0 0x7fa41015c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fa417200640 1 -- 172.21.15.29:0/1480981816 >> 172.21.15.29:0/1480981816 conn(0x7fa410071800 msgr2=0x7fa410071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f5fe4c00640 1 -- start start 2024-01-24T13:04:22.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f3a46000640 1 --2- 172.21.15.29:0/4003673224 >> [v2:172.21.15.29:6816/26968,v1:172.21.15.29:6817/26968] conn(0x7f3a2006f170 0x7f3a200715b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f6161000640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.29:6822/26966,v1:172.21.15.29:6824/26966] conn(0x7f613406f0f0 0x7f6134071530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f3a46a00640 1 --2- 172.21.15.29:0/4003673224 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a20065b30 0x7f3a20067ff0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3a30001600 tx=0x7f3a30007a50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fa417200640 1 -- 172.21.15.29:0/1480981816 shutdown_connections 2024-01-24T13:04:22.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f08d7000640 1 Processor -- start 2024-01-24T13:04:22.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fb41d600640 1 -- 172.21.15.29:0/4103491047 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb4180cbe00 con 0x7fb41815bdd0 2024-01-24T13:04:22.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fb40ea00640 1 -- 172.21.15.29:0/4103491047 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb4000b7040 con 0x7fb41815bdd0 2024-01-24T13:04:22.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f5fe4c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5fc0003980 0x7f5fe01539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f5fe4c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fe0070da0 0x7f5fe0071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f5fe4c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fe01386f0 0x7f5fe0138b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f5fe4c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe0071760 con 0x7f5fe01386f0 2024-01-24T13:04:22.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f5fe4c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe01390b0 con 0x7f5fe0070da0 2024-01-24T13:04:22.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f6153400640 1 -- 172.21.15.29:0/978704654 <== osd.1 v2:172.21.15.29:6822/26966 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6134071c00 con 0x7f613406f0f0 2024-01-24T13:04:22.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7f5fe4c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe0156810 con 0x7f5fc0003980 2024-01-24T13:04:22.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fdea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fe0070da0 0x7f5fe0071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fdea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fe0070da0 0x7f5fe0071220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34168/0 (socket says 172.21.15.29:34168) 2024-01-24T13:04:22.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fdea00640 1 -- 172.21.15.29:0/331610863 learned_addr learned my addr 172.21.15.29:0/331610863 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fdf400640 1 --2- 172.21.15.29:0/331610863 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5fc0003980 0x7f5fe01539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fdea00640 1 -- 172.21.15.29:0/331610863 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5fc0003980 msgr2=0x7f5fe01539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f08d7000640 1 -- start start 2024-01-24T13:04:22.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fdea00640 1 --2- 172.21.15.29:0/331610863 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5fc0003980 0x7f5fe01539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fdea00640 1 -- 172.21.15.29:0/331610863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fe01386f0 msgr2=0x7f5fe0138b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fdea00640 1 --2- 172.21.15.29:0/331610863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fe01386f0 0x7f5fe0138b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fdea00640 1 -- 172.21.15.29:0/331610863 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0153f30 con 0x7f5fe0070da0 2024-01-24T13:04:22.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.504+0000 7fa417200640 1 -- 172.21.15.29:0/1480981816 wait complete. 2024-01-24T13:04:22.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fdea00640 1 --2- 172.21.15.29:0/331610863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fe0070da0 0x7f5fe0071220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8011900 tx=0x7f5fd8011dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fb40ea00640 1 --2- 172.21.15.29:0/4103491047 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb3f0065b30 0x7fb3f0067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fd7400640 1 -- 172.21.15.29:0/331610863 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800fc20 con 0x7f5fe0070da0 2024-01-24T13:04:22.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fd7400640 1 -- 172.21.15.29:0/331610863 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd800fd80 con 0x7f5fe0070da0 2024-01-24T13:04:22.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fd7400640 1 -- 172.21.15.29:0/331610863 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8015650 con 0x7f5fe0070da0 2024-01-24T13:04:22.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fb40ea00640 1 -- 172.21.15.29:0/4103491047 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb400120a90 con 0x7fb41815bdd0 2024-01-24T13:04:22.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fc6c5000640 1 -- 172.21.15.29:0/1267102982 shutdown_connections 2024-01-24T13:04:22.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fc6c5000640 1 --2- 172.21.15.29:0/1267102982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6c00d1ad0 0x7fc6c00d1f20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fc6c5000640 1 --2- 172.21.15.29:0/1267102982 >> v2:172.21.15.29:3300/0 conn(0x7fc6c015c5c0 0x7fc6c00b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fc6c5000640 1 -- 172.21.15.29:0/1267102982 >> 172.21.15.29:0/1267102982 conn(0x7fc6c0071800 msgr2=0x7fc6c0071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fb416a00640 1 --2- 172.21.15.29:0/4103491047 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb3f0065b30 0x7fb3f0067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fb40ea00640 1 --2- 172.21.15.29:0/4103491047 >> [v2:172.21.15.29:6808/26963,v1:172.21.15.29:6809/26963] conn(0x7fb3f006f170 0x7fb3f00715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fb40ea00640 1 -- 172.21.15.29:0/4103491047 --> [v2:172.21.15.29:6808/26963,v1:172.21.15.29:6809/26963] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3f0071c80 con 0x7fb3f006f170 2024-01-24T13:04:22.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fb40ea00640 1 -- 172.21.15.29:0/4103491047 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb400125240 con 0x7fb41815bdd0 2024-01-24T13:04:22.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fc6c5000640 1 -- 172.21.15.29:0/1267102982 shutdown_connections 2024-01-24T13:04:22.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fc6c5000640 1 -- 172.21.15.29:0/1267102982 wait complete. 2024-01-24T13:04:22.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fa417200640 1 Processor -- start 2024-01-24T13:04:22.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f3a3ea00640 1 -- 172.21.15.29:0/4003673224 <== osd.2 v2:172.21.15.29:6816/26968 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3a20071c80 con 0x7f3a2006f170 2024-01-24T13:04:22.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fb416000640 1 --2- 172.21.15.29:0/4103491047 >> [v2:172.21.15.29:6808/26963,v1:172.21.15.29:6809/26963] conn(0x7fb3f006f170 0x7fb3f00715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f08d7000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08d0070810 0x7f08d014f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f08d7000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d00b08e0 0x7f08d014c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f08d7000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08d0158d70 0x7f08d014e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f08d7000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d014fe70 con 0x7f08d00b08e0 2024-01-24T13:04:22.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f08d7000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d014f570 con 0x7f08d0158d70 2024-01-24T13:04:22.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f08d7000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d0150080 con 0x7f08d0070810 2024-01-24T13:04:22.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f993e000640 1 --2- 172.21.15.29:0/2319273273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99400b0590 0x7f9940164ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9938009d90 tx=0x7f993801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a35fa7632ca875 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7fa417200640 1 -- start start 2024-01-24T13:04:22.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fe4c00640 1 -- 172.21.15.29:0/331610863 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe01384b0 con 0x7f5fe0070da0 2024-01-24T13:04:22.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f5fe4c00640 1 -- 172.21.15.29:0/331610863 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe0155ee0 con 0x7f5fe0070da0 2024-01-24T13:04:22.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f08d5c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08d0070810 0x7f08d014f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f08d5c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08d0070810 0x7f08d014f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53232/0 (socket says 172.21.15.29:53232) 2024-01-24T13:04:22.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.508+0000 7f08d5c00640 1 -- 172.21.15.29:0/983949075 learned_addr learned my addr 172.21.15.29:0/983949075 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fb416a00640 1 --2- 172.21.15.29:0/4103491047 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb3f0065b30 0x7fb3f0067ff0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb410007620 tx=0x7fb41000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fb416000640 1 --2- 172.21.15.29:0/4103491047 >> [v2:172.21.15.29:6808/26963,v1:172.21.15.29:6809/26963] conn(0x7fb3f006f170 0x7fb3f00715b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f08d6600640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08d0158d70 0x7f08d014e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f993d600640 1 -- 172.21.15.29:0/2319273273 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99380a5890 con 0x7f99400b0590 2024-01-24T13:04:22.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f08d5c00640 1 -- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08d0158d70 msgr2=0x7f08d014e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f08d5c00640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08d0158d70 0x7f08d014e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f08d5c00640 1 -- 172.21.15.29:0/983949075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d00b08e0 msgr2=0x7f08d014c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f5fe4c00640 1 -- 172.21.15.29:0/331610863 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5fe0158950 con 0x7f5fe0070da0 2024-01-24T13:04:22.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f08d5200640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d00b08e0 0x7f08d014c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f08d5c00640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d00b08e0 0x7f08d014c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f08d5c00640 1 -- 172.21.15.29:0/983949075 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80094d0 con 0x7f08d0070810 2024-01-24T13:04:22.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f993d600640 1 -- 172.21.15.29:0/2319273273 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99380a59f0 con 0x7f99400b0590 2024-01-24T13:04:22.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f993d600640 1 -- 172.21.15.29:0/2319273273 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99380a5890 con 0x7f99400b0590 2024-01-24T13:04:22.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fc6c5000640 1 Processor -- start 2024-01-24T13:04:22.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f08d5200640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d00b08e0 0x7f08d014c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:22.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fc6c5000640 1 -- start start 2024-01-24T13:04:22.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f08d5c00640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08d0070810 0x7f08d014f930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f08b80ae040 tx=0x7f08b801ac70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f9945a00640 1 -- 172.21.15.29:0/2319273273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99400b0590 msgr2=0x7f9940164ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f9945a00640 1 --2- 172.21.15.29:0/2319273273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99400b0590 0x7f9940164ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9938009d90 tx=0x7f993801c8c0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f5fd7400640 1 -- 172.21.15.29:0/331610863 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5fd80157b0 con 0x7f5fe0070da0 2024-01-24T13:04:22.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fb40ea00640 1 -- 172.21.15.29:0/4103491047 <== osd.0 v2:172.21.15.29:6808/26963 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb3f0071c80 con 0x7fb3f006f170 2024-01-24T13:04:22.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fa417200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa4100b4010 0x7fa4100c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fa417200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4100b4bb0 0x7fa410150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fa417200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41015c1e0 0x7fa410150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f9945a00640 1 -- 172.21.15.29:0/2319273273 shutdown_connections 2024-01-24T13:04:22.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f9945a00640 1 --2- 172.21.15.29:0/2319273273 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f994006fd70 0x7f99400c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f9945a00640 1 --2- 172.21.15.29:0/2319273273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99400b0590 0x7f9940164ab0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f9945a00640 1 -- 172.21.15.29:0/2319273273 >> 172.21.15.29:0/2319273273 conn(0x7f994006a2d0 msgr2=0x7f99400cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f08cd600640 1 -- 172.21.15.29:0/983949075 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b80b6830 con 0x7f08d0070810 2024-01-24T13:04:22.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f08cd600640 1 -- 172.21.15.29:0/983949075 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b80b69b0 con 0x7f08d0070810 2024-01-24T13:04:22.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f08cd600640 1 -- 172.21.15.29:0/983949075 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b80b6d60 con 0x7f08d0070810 2024-01-24T13:04:22.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f08d7000640 1 -- 172.21.15.29:0/983949075 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d0150360 con 0x7f08d0070810 2024-01-24T13:04:22.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fa415e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa4100b4010 0x7fa4100c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fa415e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa4100b4010 0x7fa4100c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53234/0 (socket says 172.21.15.29:53234) 2024-01-24T13:04:22.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fc6c5000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6c00d1ad0 0x7fc6c0154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fc6c5000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6c015c1e0 0x7fc6c01575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fa415e00640 1 -- 172.21.15.29:0/4245251866 learned_addr learned my addr 172.21.15.29:0/4245251866 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fc6c5000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6c015c5c0 0x7fc6c00c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fa417200640 1 -- 172.21.15.29:0/4245251866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4101567e0 con 0x7fa4100b4bb0 2024-01-24T13:04:22.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7fa417200640 1 -- 172.21.15.29:0/4245251866 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100c86e0 con 0x7fa41015c1e0 2024-01-24T13:04:22.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fa417200640 1 -- 172.21.15.29:0/4245251866 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa410151780 con 0x7fa4100b4010 2024-01-24T13:04:22.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fc6c5000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00c9c00 con 0x7fc6c015c5c0 2024-01-24T13:04:22.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fc6c5000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0158170 con 0x7fc6c00d1ad0 2024-01-24T13:04:22.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fc6c5000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00c9660 con 0x7fc6c015c1e0 2024-01-24T13:04:22.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7f5fd7400640 1 --2- 172.21.15.29:0/331610863 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5fb8065ab0 0x7f5fb8067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7f5fd7400640 1 -- 172.21.15.29:0/331610863 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5fd80866c0 con 0x7f5fe0070da0 2024-01-24T13:04:22.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fa416800640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41015c1e0 0x7fa410150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7f5fd7400640 1 --2- 172.21.15.29:0/331610863 >> [v2:172.21.15.29:6800/26967,v1:172.21.15.29:6801/26967] conn(0x7f5fb806f0f0 0x7f5fb8071530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7f5fd7400640 1 -- 172.21.15.29:0/331610863 --> [v2:172.21.15.29:6800/26967,v1:172.21.15.29:6801/26967] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5fb8071c00 con 0x7f5fb806f0f0 2024-01-24T13:04:22.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7f5fd7400640 1 -- 172.21.15.29:0/331610863 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fd8088dd0 con 0x7f5fe0070da0 2024-01-24T13:04:22.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7f5fdf400640 1 --2- 172.21.15.29:0/331610863 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5fb8065ab0 0x7f5fb8067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.512+0000 7f08d7000640 1 -- 172.21.15.29:0/983949075 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d0150920 con 0x7f08d0070810 2024-01-24T13:04:22.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7f08d7000640 1 -- 172.21.15.29:0/983949075 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08a0000fd0 con 0x7f08d0070810 2024-01-24T13:04:22.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fc6bf400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6c00d1ad0 0x7fc6c0154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fc6bf400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6c00d1ad0 0x7fc6c0154340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34190/0 (socket says 172.21.15.29:34190) 2024-01-24T13:04:22.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fc6bf400640 1 -- 172.21.15.29:0/2604451139 learned_addr learned my addr 172.21.15.29:0/2604451139 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fc6bea00640 1 --2- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6c015c1e0 0x7fc6c01575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7f9945a00640 1 -- 172.21.15.29:0/2319273273 shutdown_connections 2024-01-24T13:04:22.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fa415400640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4100b4bb0 0x7fa410150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7f9945a00640 1 -- 172.21.15.29:0/2319273273 wait complete. 2024-01-24T13:04:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fa416800640 1 -- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa4100b4010 msgr2=0x7fa4100c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fa416800640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa4100b4010 0x7fa4100c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fa416800640 1 -- 172.21.15.29:0/4245251866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4100b4bb0 msgr2=0x7fa410150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fa415e00640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa4100b4010 0x7fa4100c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fa416800640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4100b4bb0 0x7fa410150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fa416800640 1 -- 172.21.15.29:0/4245251866 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa400009420 con 0x7fa41015c1e0 2024-01-24T13:04:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fc6bfe00640 1 --2- 172.21.15.29:0/2604451139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6c015c5c0 0x7fc6c00c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fc6bea00640 1 -- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6c00d1ad0 msgr2=0x7fc6c0154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fc6bea00640 1 --2- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6c00d1ad0 0x7fc6c0154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fc6bea00640 1 -- 172.21.15.29:0/2604451139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6c015c5c0 msgr2=0x7fc6c00c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fc6bea00640 1 --2- 172.21.15.29:0/2604451139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6c015c5c0 0x7fc6c00c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fc6bea00640 1 -- 172.21.15.29:0/2604451139 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b8009a70 con 0x7fc6c015c1e0 2024-01-24T13:04:22.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fc6bea00640 1 --2- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6c015c1e0 0x7fc6c01575e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800d5f0 tx=0x7fc6a800dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7f5fdfe00640 1 --2- 172.21.15.29:0/331610863 >> [v2:172.21.15.29:6800/26967,v1:172.21.15.29:6801/26967] conn(0x7f5fb806f0f0 0x7f5fb8071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7f5fdf400640 1 --2- 172.21.15.29:0/331610863 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5fb8065ab0 0x7f5fb8067f70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00b8000 tx=0x7f5fd00046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7fa416800640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41015c1e0 0x7fa410150f50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa4000ac000 tx=0x7fa40001abe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.516+0000 7f5fdfe00640 1 --2- 172.21.15.29:0/331610863 >> [v2:172.21.15.29:6800/26967,v1:172.21.15.29:6801/26967] conn(0x7f5fb806f0f0 0x7f5fb8071530 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7fc6b7400640 1 -- 172.21.15.29:0/2604451139 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8021480 con 0x7fc6c015c1e0 2024-01-24T13:04:22.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7fa40e000640 1 -- 172.21.15.29:0/4245251866 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000b7650 con 0x7fa41015c1e0 2024-01-24T13:04:22.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7fa40e000640 1 -- 172.21.15.29:0/4245251866 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4000b77d0 con 0x7fa41015c1e0 2024-01-24T13:04:22.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7fa40e000640 1 -- 172.21.15.29:0/4245251866 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000b7b80 con 0x7fa41015c1e0 2024-01-24T13:04:22.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7fc6b7400640 1 -- 172.21.15.29:0/2604451139 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a801a070 con 0x7fc6c015c1e0 2024-01-24T13:04:22.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7fc6c5000640 1 -- 172.21.15.29:0/2604451139 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c0158410 con 0x7fc6c015c1e0 2024-01-24T13:04:22.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7fc6c5000640 1 -- 172.21.15.29:0/2604451139 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c0154a70 con 0x7fc6c015c1e0 2024-01-24T13:04:22.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f9945a00640 1 Processor -- start 2024-01-24T13:04:22.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f9945a00640 1 -- start start 2024-01-24T13:04:22.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7fc6b7400640 1 -- 172.21.15.29:0/2604451139 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8021820 con 0x7fc6c015c1e0 2024-01-24T13:04:22.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7fc6c5000640 1 -- 172.21.15.29:0/2604451139 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc690000fd0 con 0x7fc6c015c1e0 2024-01-24T13:04:22.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7fa417200640 1 -- 172.21.15.29:0/4245251866 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4100c6fb0 con 0x7fa41015c1e0 2024-01-24T13:04:22.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f08cd600640 1 -- 172.21.15.29:0/983949075 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f08b80b2040 con 0x7f08d0070810 2024-01-24T13:04:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f08cd600640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f08a8065b30 0x7f08a8067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f08cd600640 1 -- 172.21.15.29:0/983949075 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f08b811e060 con 0x7f08d0070810 2024-01-24T13:04:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f08cd600640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:6800/27229,v1:172.21.15.163:6801/27229] conn(0x7f08a806f170 0x7f08a80715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f08cd600640 1 -- 172.21.15.29:0/983949075 --> [v2:172.21.15.163:6800/27229,v1:172.21.15.163:6801/27229] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08a8071c80 con 0x7f08a806f170 2024-01-24T13:04:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f08cd600640 1 -- 172.21.15.29:0/983949075 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08b811e410 con 0x7f08d0070810 2024-01-24T13:04:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7fa417200640 1 -- 172.21.15.29:0/4245251866 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa410156470 con 0x7fa41015c1e0 2024-01-24T13:04:22.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f9945a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f994006fd70 0x7f994015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f9945a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99400b0590 0x7f99401615b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f9945a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99400c1940 0x7f99400b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f993ea00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f994006fd70 0x7f994015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f993ea00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f994006fd70 0x7f994015a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53258/0 (socket says 172.21.15.29:53258) 2024-01-24T13:04:22.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f9945a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99400b32c0 con 0x7f99400c1940 2024-01-24T13:04:22.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f9945a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994015ae90 con 0x7f99400b0590 2024-01-24T13:04:22.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f993ea00640 1 -- 172.21.15.29:0/412925921 learned_addr learned my addr 172.21.15.29:0/412925921 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f9945a00640 1 -- 172.21.15.29:0/412925921 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99401642a0 con 0x7f994006fd70 2024-01-24T13:04:22.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f993f400640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99400c1940 0x7f99400b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f5fd7400640 1 -- 172.21.15.29:0/331610863 <== osd.3 v2:172.21.15.29:6800/26967 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5fb8071c00 con 0x7f5fb806f0f0 2024-01-24T13:04:22.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7fa417200640 1 -- 172.21.15.29:0/4245251866 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa410160d40 con 0x7fa41015c1e0 2024-01-24T13:04:22.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.520+0000 7f08d5200640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f08a8065b30 0x7f08a8067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f08d5200640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f08a8065b30 0x7f08a8067ff0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f08d0160490 tx=0x7f08c80073c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f08d6600640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:6800/27229,v1:172.21.15.163:6801/27229] conn(0x7f08a806f170 0x7f08a80715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f08d6600640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:6800/27229,v1:172.21.15.163:6801/27229] conn(0x7f08a806f170 0x7f08a80715b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f993e000640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99400b0590 0x7f99401615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f993f400640 1 -- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f994006fd70 msgr2=0x7f994015a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f993f400640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f994006fd70 0x7f994015a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f993f400640 1 -- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99400b0590 msgr2=0x7f99401615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f993f400640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99400b0590 0x7f99401615b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f993f400640 1 -- 172.21.15.29:0/412925921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9938009a70 con 0x7f99400c1940 2024-01-24T13:04:22.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f993e000640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99400b0590 0x7f99401615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:22.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f993f400640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99400c1940 0x7f99400b2070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f993000c540 tx=0x7f993000ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f9936a00640 1 -- 172.21.15.29:0/412925921 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930004220 con 0x7f99400c1940 2024-01-24T13:04:22.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f9936a00640 1 -- 172.21.15.29:0/412925921 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9930004380 con 0x7f99400c1940 2024-01-24T13:04:22.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f9945a00640 1 -- 172.21.15.29:0/412925921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9940164580 con 0x7f99400c1940 2024-01-24T13:04:22.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f9945a00640 1 -- 172.21.15.29:0/412925921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99400b37f0 con 0x7f99400c1940 2024-01-24T13:04:22.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f9945a00640 1 -- 172.21.15.29:0/412925921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99400cc3a0 con 0x7f99400c1940 2024-01-24T13:04:22.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f08cd600640 1 -- 172.21.15.29:0/983949075 <== osd.5 v2:172.21.15.163:6800/27229 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f08a8071c80 con 0x7f08a806f170 2024-01-24T13:04:22.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7f9936a00640 1 -- 172.21.15.29:0/412925921 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930003840 con 0x7f99400c1940 2024-01-24T13:04:22.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7fa40e000640 1 -- 172.21.15.29:0/4245251866 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa4000b3070 con 0x7fa41015c1e0 2024-01-24T13:04:22.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.524+0000 7fc6b7400640 1 -- 172.21.15.29:0/2604451139 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc6a8021980 con 0x7fc6c015c1e0 2024-01-24T13:04:22.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fc6b7400640 1 --2- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc698065b30 0x7fc698067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fc6b7400640 1 -- 172.21.15.29:0/2604451139 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc6a801c070 con 0x7fc6c015c1e0 2024-01-24T13:04:22.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fc6b7400640 1 --2- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:6808/27231,v1:172.21.15.163:6809/27231] conn(0x7fc69806f170 0x7fc6980715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fc6b7400640 1 -- 172.21.15.29:0/2604451139 --> [v2:172.21.15.163:6808/27231,v1:172.21.15.163:6809/27231] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc698071c80 con 0x7fc69806f170 2024-01-24T13:04:22.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fc6b7400640 1 -- 172.21.15.29:0/2604451139 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6a808db70 con 0x7fc6c015c1e0 2024-01-24T13:04:22.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fa40e000640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3e8065b30 0x7fa3e8067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7f9936a00640 1 -- 172.21.15.29:0/412925921 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f99300039a0 con 0x7f99400c1940 2024-01-24T13:04:22.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fa40e000640 1 -- 172.21.15.29:0/4245251866 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa40011d5c0 con 0x7fa41015c1e0 2024-01-24T13:04:22.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fc6bf400640 1 --2- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc698065b30 0x7fc698067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fc6bfe00640 1 --2- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:6808/27231,v1:172.21.15.163:6809/27231] conn(0x7fc69806f170 0x7fc6980715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fa40e000640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:6816/27228,v1:172.21.15.163:6817/27228] conn(0x7fa3e806f170 0x7fa3e80715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fa40e000640 1 -- 172.21.15.29:0/4245251866 --> [v2:172.21.15.163:6816/27228,v1:172.21.15.163:6817/27228] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3e8071c80 con 0x7fa3e806f170 2024-01-24T13:04:22.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fa40e000640 1 -- 172.21.15.29:0/4245251866 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa40011fbe0 con 0x7fa41015c1e0 2024-01-24T13:04:22.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fc6bf400640 1 --2- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc698065b30 0x7fc698067ff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0005890 tx=0x7fc6b0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fa415e00640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3e8065b30 0x7fa3e8067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fa415400640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:6816/27228,v1:172.21.15.163:6817/27228] conn(0x7fa3e806f170 0x7fa3e80715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7f9936a00640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9918065b30 0x7f9918067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7f9936a00640 1 -- 172.21.15.29:0/412925921 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9930083650 con 0x7f99400c1940 2024-01-24T13:04:22.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fc6bfe00640 1 --2- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:6808/27231,v1:172.21.15.163:6809/27231] conn(0x7fc69806f170 0x7fc6980715b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7f993ea00640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9918065b30 0x7f9918067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7f9936a00640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:6824/27230,v1:172.21.15.163:6825/27230] conn(0x7f991806f170 0x7f99180715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7f9936a00640 1 -- 172.21.15.29:0/412925921 --> [v2:172.21.15.163:6824/27230,v1:172.21.15.163:6825/27230] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9918071c80 con 0x7f991806f170 2024-01-24T13:04:22.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7f9936a00640 1 -- 172.21.15.29:0/412925921 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9930083a00 con 0x7f99400c1940 2024-01-24T13:04:22.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fa415400640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:6816/27228,v1:172.21.15.163:6817/27228] conn(0x7fa3e806f170 0x7fa3e80715b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7f993ea00640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9918065b30 0x7f9918067ff0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9928005890 tx=0x7f9928009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.528+0000 7fa40e000640 1 -- 172.21.15.29:0/4245251866 <== osd.4 v2:172.21.15.163:6816/27228 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa3e8071c80 con 0x7fa3e806f170 2024-01-24T13:04:22.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.532+0000 7fa415e00640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3e8065b30 0x7fa3e8067ff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa408009fd0 tx=0x7fa4080099c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.532+0000 7f993e000640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:6824/27230,v1:172.21.15.163:6825/27230] conn(0x7f991806f170 0x7f99180715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.532+0000 7fc6b7400640 1 -- 172.21.15.29:0/2604451139 <== osd.7 v2:172.21.15.163:6808/27231 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc698071c80 con 0x7fc69806f170 2024-01-24T13:04:22.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.532+0000 7f993e000640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:6824/27230,v1:172.21.15.163:6825/27230] conn(0x7f991806f170 0x7f99180715b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.536+0000 7f9936a00640 1 -- 172.21.15.29:0/412925921 <== osd.6 v2:172.21.15.163:6824/27230 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9918071c80 con 0x7f991806f170 2024-01-24T13:04:22.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.536+0000 7f3a37e00640 1 -- 172.21.15.29:0/4003673224 --> [v2:172.21.15.29:6816/26968,v1:172.21.15.29:6817/26968] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a401845c0 con 0x7f3a2006f170 2024-01-24T13:04:22.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.540+0000 7f3a3ea00640 1 -- 172.21.15.29:0/4003673224 <== osd.2 v2:172.21.15.29:6816/26968 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3a401845c0 con 0x7f3a2006f170 2024-01-24T13:04:22.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.540+0000 7f3a37e00640 1 -- 172.21.15.29:0/4003673224 >> [v2:172.21.15.29:6816/26968,v1:172.21.15.29:6817/26968] conn(0x7f3a2006f170 msgr2=0x7f3a200715b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.540+0000 7f3a37e00640 1 --2- 172.21.15.29:0/4003673224 >> [v2:172.21.15.29:6816/26968,v1:172.21.15.29:6817/26968] conn(0x7f3a2006f170 0x7f3a200715b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.540+0000 7f3a37e00640 1 -- 172.21.15.29:0/4003673224 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a20065b30 msgr2=0x7f3a20067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.540+0000 7f3a37e00640 1 --2- 172.21.15.29:0/4003673224 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a20065b30 0x7f3a20067ff0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3a30001600 tx=0x7f3a30007a50 comp rx=0 tx=0).stop 2024-01-24T13:04:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.540+0000 7f3a37e00640 1 -- 172.21.15.29:0/4003673224 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a40048200 msgr2=0x7f3a400db730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.540+0000 7f3a37e00640 1 --2- 172.21.15.29:0/4003673224 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a40048200 0x7f3a400db730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a4804f940 tx=0x7f3a48073640 comp rx=0 tx=0).stop 2024-01-24T13:04:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.540+0000 7f3a47400640 1 -- 172.21.15.29:0/4003673224 reap_dead start 2024-01-24T13:04:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.540+0000 7f3a37e00640 1 -- 172.21.15.29:0/4003673224 shutdown_connections 2024-01-24T13:04:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.540+0000 7f3a37e00640 1 -- 172.21.15.29:0/4003673224 >> 172.21.15.29:0/4003673224 conn(0x7f3a40054b10 msgr2=0x7f3a40035b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.540+0000 7f3a37e00640 1 -- 172.21.15.29:0/4003673224 shutdown_connections 2024-01-24T13:04:22.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.540+0000 7f3a37e00640 1 -- 172.21.15.29:0/4003673224 wait complete. 2024-01-24T13:04:22.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.544+0000 7fb41d600640 1 -- 172.21.15.29:0/4103491047 --> [v2:172.21.15.29:6808/26963,v1:172.21.15.29:6809/26963] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb4180cdc80 con 0x7fb3f006f170 2024-01-24T13:04:22.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.544+0000 7f6162600640 1 -- 172.21.15.29:0/978704654 --> [v2:172.21.15.29:6822/26966,v1:172.21.15.29:6824/26966] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f615c06a850 con 0x7f613406f0f0 2024-01-24T13:04:22.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7f6153400640 1 -- 172.21.15.29:0/978704654 <== osd.1 v2:172.21.15.29:6822/26966 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6134071c00 con 0x7f613406f0f0 2024-01-24T13:04:22.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7fb40ea00640 1 -- 172.21.15.29:0/4103491047 <== osd.0 v2:172.21.15.29:6808/26963 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb408006b50 con 0x7fb3f006f170 2024-01-24T13:04:22.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7fb41d600640 1 -- 172.21.15.29:0/4103491047 >> [v2:172.21.15.29:6808/26963,v1:172.21.15.29:6809/26963] conn(0x7fb3f006f170 msgr2=0x7fb3f00715b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7fb41d600640 1 --2- 172.21.15.29:0/4103491047 >> [v2:172.21.15.29:6808/26963,v1:172.21.15.29:6809/26963] conn(0x7fb3f006f170 0x7fb3f00715b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7fb41d600640 1 -- 172.21.15.29:0/4103491047 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb3f0065b30 msgr2=0x7fb3f0067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7fb41d600640 1 --2- 172.21.15.29:0/4103491047 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb3f0065b30 0x7fb3f0067ff0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb410007620 tx=0x7fb41000b040 comp rx=0 tx=0).stop 2024-01-24T13:04:22.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7fb41d600640 1 -- 172.21.15.29:0/4103491047 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb41815bdd0 msgr2=0x7fb41815c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7fb41d600640 1 --2- 172.21.15.29:0/4103491047 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb41815bdd0 0x7fb41815c6f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb4000af000 tx=0x7fb40001ba30 comp rx=0 tx=0).stop 2024-01-24T13:04:22.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7fb417400640 1 -- 172.21.15.29:0/4103491047 reap_dead start 2024-01-24T13:04:22.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7f6162600640 1 -- 172.21.15.29:0/978704654 >> [v2:172.21.15.29:6822/26966,v1:172.21.15.29:6824/26966] conn(0x7f613406f0f0 msgr2=0x7f6134071530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7f6162600640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.29:6822/26966,v1:172.21.15.29:6824/26966] conn(0x7f613406f0f0 0x7f6134071530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7fb41d600640 1 -- 172.21.15.29:0/4103491047 shutdown_connections 2024-01-24T13:04:22.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7fb41d600640 1 -- 172.21.15.29:0/4103491047 >> 172.21.15.29:0/4103491047 conn(0x7fb4180cac10 msgr2=0x7fb4180c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7fb41d600640 1 -- 172.21.15.29:0/4103491047 shutdown_connections 2024-01-24T13:04:22.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.548+0000 7fb41d600640 1 -- 172.21.15.29:0/4103491047 wait complete. 2024-01-24T13:04:22.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.552+0000 7f6162600640 1 -- 172.21.15.29:0/978704654 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6134065ab0 msgr2=0x7f6134067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.552+0000 7f6162600640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6134065ab0 0x7f6134067f70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f615c165dd0 tx=0x7f6144009040 comp rx=0 tx=0).stop 2024-01-24T13:04:22.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.552+0000 7f6162600640 1 -- 172.21.15.29:0/978704654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f615c0ca160 msgr2=0x7f615c1fda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.552+0000 7f6162600640 1 --2- 172.21.15.29:0/978704654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f615c0ca160 0x7f615c1fda60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f615400ce20 tx=0x7f615400a660 comp rx=0 tx=0).stop 2024-01-24T13:04:22.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.552+0000 7f6161000640 1 -- 172.21.15.29:0/978704654 reap_dead start 2024-01-24T13:04:22.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.552+0000 7f6162600640 1 -- 172.21.15.29:0/978704654 shutdown_connections 2024-01-24T13:04:22.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.552+0000 7f6162600640 1 -- 172.21.15.29:0/978704654 >> 172.21.15.29:0/978704654 conn(0x7f615c0cc590 msgr2=0x7f615c0cdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.552+0000 7f6162600640 1 -- 172.21.15.29:0/978704654 shutdown_connections 2024-01-24T13:04:22.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.552+0000 7f6162600640 1 -- 172.21.15.29:0/978704654 wait complete. 2024-01-24T13:04:22.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.552+0000 7f08d7000640 1 -- 172.21.15.29:0/983949075 --> [v2:172.21.15.163:6800/27229,v1:172.21.15.163:6801/27229] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f08a0002cc0 con 0x7f08a806f170 2024-01-24T13:04:22.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.556+0000 7f5fe4c00640 1 -- 172.21.15.29:0/331610863 --> [v2:172.21.15.29:6800/26967,v1:172.21.15.29:6801/26967] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5fe015ce30 con 0x7f5fb806f0f0 2024-01-24T13:04:22.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.556+0000 7f5fd7400640 1 -- 172.21.15.29:0/331610863 <== osd.3 v2:172.21.15.29:6800/26967 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5fb8071c00 con 0x7f5fb806f0f0 2024-01-24T13:04:22.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.556+0000 7f08cd600640 1 -- 172.21.15.29:0/983949075 <== osd.5 v2:172.21.15.163:6800/27229 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f08a0002cc0 con 0x7f08a806f170 2024-01-24T13:04:22.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.556+0000 7f5fe4c00640 1 -- 172.21.15.29:0/331610863 >> [v2:172.21.15.29:6800/26967,v1:172.21.15.29:6801/26967] conn(0x7f5fb806f0f0 msgr2=0x7f5fb8071530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.556+0000 7f5fe4c00640 1 --2- 172.21.15.29:0/331610863 >> [v2:172.21.15.29:6800/26967,v1:172.21.15.29:6801/26967] conn(0x7f5fb806f0f0 0x7f5fb8071530 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.556+0000 7f08d7000640 1 -- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:6800/27229,v1:172.21.15.163:6801/27229] conn(0x7f08a806f170 msgr2=0x7f08a80715b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.556+0000 7f08d7000640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:6800/27229,v1:172.21.15.163:6801/27229] conn(0x7f08a806f170 0x7f08a80715b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7fc6c5000640 1 -- 172.21.15.29:0/2604451139 --> [v2:172.21.15.163:6808/27231,v1:172.21.15.163:6809/27231] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc690002cc0 con 0x7fc69806f170 2024-01-24T13:04:22.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7fc6b7400640 1 -- 172.21.15.29:0/2604451139 <== osd.7 v2:172.21.15.163:6808/27231 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc690002cc0 con 0x7fc69806f170 2024-01-24T13:04:22.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7f5fe4c00640 1 -- 172.21.15.29:0/331610863 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5fb8065ab0 msgr2=0x7f5fb8067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7fc6c5000640 1 -- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:6808/27231,v1:172.21.15.163:6809/27231] conn(0x7fc69806f170 msgr2=0x7fc6980715b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7fc6c5000640 1 --2- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:6808/27231,v1:172.21.15.163:6809/27231] conn(0x7fc69806f170 0x7fc6980715b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7f5fe4c00640 1 --2- 172.21.15.29:0/331610863 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5fb8065ab0 0x7f5fb8067f70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00b8000 tx=0x7f5fd00046d0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7f5fe4c00640 1 -- 172.21.15.29:0/331610863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fe0070da0 msgr2=0x7f5fe0071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7f5fe4c00640 1 --2- 172.21.15.29:0/331610863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fe0070da0 0x7f5fe0071220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8011900 tx=0x7f5fd8011dc0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7f5fdfe00640 1 -- 172.21.15.29:0/331610863 reap_dead start 2024-01-24T13:04:22.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7f08d7000640 1 -- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f08a8065b30 msgr2=0x7f08a8067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7f08d7000640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f08a8065b30 0x7f08a8067ff0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f08d0160490 tx=0x7f08c80073c0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7f08d7000640 1 -- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08d0070810 msgr2=0x7f08d014f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7f08d7000640 1 --2- 172.21.15.29:0/983949075 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f08d0070810 0x7f08d014f930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f08b80ae040 tx=0x7f08b801ac70 comp rx=0 tx=0).stop 2024-01-24T13:04:22.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7f08d6600640 1 -- 172.21.15.29:0/983949075 reap_dead start 2024-01-24T13:04:22.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7f5fe4c00640 1 -- 172.21.15.29:0/331610863 shutdown_connections 2024-01-24T13:04:22.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7f5fe4c00640 1 -- 172.21.15.29:0/331610863 >> 172.21.15.29:0/331610863 conn(0x7f5fe006d700 msgr2=0x7f5fe015adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7fa417200640 1 -- 172.21.15.29:0/4245251866 --> [v2:172.21.15.163:6816/27228,v1:172.21.15.163:6817/27228] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa4100736c0 con 0x7fa3e806f170 2024-01-24T13:04:22.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7fc6c5000640 1 -- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc698065b30 msgr2=0x7fc698067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7fc6c5000640 1 --2- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc698065b30 0x7fc698067ff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0005890 tx=0x7fc6b0009040 comp rx=0 tx=0).stop 2024-01-24T13:04:22.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7fc6c5000640 1 -- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6c015c1e0 msgr2=0x7fc6c01575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7fc6c5000640 1 --2- 172.21.15.29:0/2604451139 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6c015c1e0 0x7fc6c01575e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800d5f0 tx=0x7fc6a800dab0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7fc6bfe00640 1 -- 172.21.15.29:0/2604451139 reap_dead start 2024-01-24T13:04:22.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7f08d7000640 1 -- 172.21.15.29:0/983949075 shutdown_connections 2024-01-24T13:04:22.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7f08d7000640 1 -- 172.21.15.29:0/983949075 >> 172.21.15.29:0/983949075 conn(0x7f08d00afdc0 msgr2=0x7f08d00aef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7fc6c5000640 1 -- 172.21.15.29:0/2604451139 shutdown_connections 2024-01-24T13:04:22.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.560+0000 7fc6c5000640 1 -- 172.21.15.29:0/2604451139 >> 172.21.15.29:0/2604451139 conn(0x7fc6c0071800 msgr2=0x7fc6c01559e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7f5fe4c00640 1 -- 172.21.15.29:0/331610863 shutdown_connections 2024-01-24T13:04:22.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7f5fe4c00640 1 -- 172.21.15.29:0/331610863 wait complete. 2024-01-24T13:04:22.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7f08d7000640 1 -- 172.21.15.29:0/983949075 shutdown_connections 2024-01-24T13:04:22.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7f08d7000640 1 -- 172.21.15.29:0/983949075 wait complete. 2024-01-24T13:04:22.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7fc6c5000640 1 -- 172.21.15.29:0/2604451139 shutdown_connections 2024-01-24T13:04:22.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7fc6c5000640 1 -- 172.21.15.29:0/2604451139 wait complete. 2024-01-24T13:04:22.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7fa40e000640 1 -- 172.21.15.29:0/4245251866 <== osd.4 v2:172.21.15.163:6816/27228 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa4100736c0 con 0x7fa3e806f170 2024-01-24T13:04:22.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7f9945a00640 1 -- 172.21.15.29:0/412925921 --> [v2:172.21.15.163:6824/27230,v1:172.21.15.163:6825/27230] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9940165930 con 0x7f991806f170 2024-01-24T13:04:22.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7fa417200640 1 -- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:6816/27228,v1:172.21.15.163:6817/27228] conn(0x7fa3e806f170 msgr2=0x7fa3e80715b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7fa417200640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:6816/27228,v1:172.21.15.163:6817/27228] conn(0x7fa3e806f170 0x7fa3e80715b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7f9936a00640 1 -- 172.21.15.29:0/412925921 <== osd.6 v2:172.21.15.163:6824/27230 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9938009470 con 0x7f991806f170 2024-01-24T13:04:22.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7fa417200640 1 -- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3e8065b30 msgr2=0x7fa3e8067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7fa417200640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3e8065b30 0x7fa3e8067ff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa408009fd0 tx=0x7fa4080099c0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7fa417200640 1 -- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41015c1e0 msgr2=0x7fa410150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7fa417200640 1 --2- 172.21.15.29:0/4245251866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41015c1e0 0x7fa410150f50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa4000ac000 tx=0x7fa40001abe0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7fa416800640 1 -- 172.21.15.29:0/4245251866 reap_dead start 2024-01-24T13:04:22.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7f9945a00640 1 -- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:6824/27230,v1:172.21.15.163:6825/27230] conn(0x7f991806f170 msgr2=0x7f99180715b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7f9945a00640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:6824/27230,v1:172.21.15.163:6825/27230] conn(0x7f991806f170 0x7f99180715b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7fa417200640 1 -- 172.21.15.29:0/4245251866 shutdown_connections 2024-01-24T13:04:22.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7fa417200640 1 -- 172.21.15.29:0/4245251866 >> 172.21.15.29:0/4245251866 conn(0x7fa410071800 msgr2=0x7fa4100d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7f9945a00640 1 -- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9918065b30 msgr2=0x7f9918067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7f9945a00640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9918065b30 0x7f9918067ff0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9928005890 tx=0x7f9928009040 comp rx=0 tx=0).stop 2024-01-24T13:04:22.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7f9945a00640 1 -- 172.21.15.29:0/412925921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99400c1940 msgr2=0x7f99400b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7f9945a00640 1 --2- 172.21.15.29:0/412925921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99400c1940 0x7f99400b2070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f993000c540 tx=0x7f993000ca00 comp rx=0 tx=0).stop 2024-01-24T13:04:22.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7f993f400640 1 -- 172.21.15.29:0/412925921 reap_dead start 2024-01-24T13:04:22.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.564+0000 7fa417200640 1 -- 172.21.15.29:0/4245251866 shutdown_connections 2024-01-24T13:04:22.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.568+0000 7f9945a00640 1 -- 172.21.15.29:0/412925921 shutdown_connections 2024-01-24T13:04:22.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.568+0000 7f9945a00640 1 -- 172.21.15.29:0/412925921 >> 172.21.15.29:0/412925921 conn(0x7f994006a2d0 msgr2=0x7f9940160480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.568+0000 7fa417200640 1 -- 172.21.15.29:0/4245251866 wait complete. 2024-01-24T13:04:22.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.568+0000 7f9945a00640 1 -- 172.21.15.29:0/412925921 shutdown_connections 2024-01-24T13:04:22.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.568+0000 7f9945a00640 1 -- 172.21.15.29:0/412925921 wait complete. 2024-01-24T13:04:22.590 INFO:teuthology.orchestra.run.smithi029.stdout:64424509451 2024-01-24T13:04:22.591 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-24T13:04:22.596 INFO:teuthology.orchestra.run.smithi029.stdout:64424509451 2024-01-24T13:04:22.596 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-24T13:04:22.599 INFO:teuthology.orchestra.run.smithi029.stdout:64424509450 2024-01-24T13:04:22.599 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-24T13:04:22.601 INFO:teuthology.orchestra.run.smithi029.stdout:64424509453 2024-01-24T13:04:22.601 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-24T13:04:22.608 INFO:teuthology.orchestra.run.smithi029.stdout:64424509449 2024-01-24T13:04:22.609 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-24T13:04:22.610 INFO:teuthology.orchestra.run.smithi029.stdout:64424509450 2024-01-24T13:04:22.610 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-24T13:04:22.613 INFO:teuthology.orchestra.run.smithi029.stdout:64424509451 2024-01-24T13:04:22.613 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-24T13:04:22.617 INFO:teuthology.orchestra.run.smithi029.stdout:55834574860 2024-01-24T13:04:22.618 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-24T13:04:22.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f724d000640 1 Processor -- start 2024-01-24T13:04:22.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f724d000640 1 -- start start 2024-01-24T13:04:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f724d000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7240051a40 0x7f7240051e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f724d000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7240035fc0 0x7f724003c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f724d000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7240039e50 0x7f724003a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f724d000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7240055170 con 0x7f7240039e50 2024-01-24T13:04:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f724d000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7240052360 con 0x7f7240035fc0 2024-01-24T13:04:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f724d000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7240055410 con 0x7f7240051a40 2024-01-24T13:04:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f7246800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7240039e50 0x7f724003a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f7246800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7240039e50 0x7f724003a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37190/0 (socket says 172.21.15.29:37190) 2024-01-24T13:04:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f7246800640 1 -- 172.21.15.29:0/276593872 learned_addr learned my addr 172.21.15.29:0/276593872 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f7245400640 1 --2- 172.21.15.29:0/276593872 >> v2:172.21.15.163:3300/0 conn(0x7f7240035fc0 0x7f724003c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f7245e00640 1 --2- 172.21.15.29:0/276593872 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7240051a40 0x7f7240051e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f7245400640 1 -- 172.21.15.29:0/276593872 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7240051a40 msgr2=0x7f7240051e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f7245400640 1 --2- 172.21.15.29:0/276593872 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7240051a40 0x7f7240051e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f7245400640 1 -- 172.21.15.29:0/276593872 >> v2:172.21.15.29:3300/0 conn(0x7f7240039e50 msgr2=0x7f724003a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.836+0000 7f7245400640 1 --2- 172.21.15.29:0/276593872 >> v2:172.21.15.29:3300/0 conn(0x7f7240039e50 0x7f724003a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.840+0000 7f7245400640 1 -- 172.21.15.29:0/276593872 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72400556f0 con 0x7f7240035fc0 2024-01-24T13:04:22.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.844+0000 7f8e26e00640 1 Processor -- start 2024-01-24T13:04:22.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.844+0000 7f8e26e00640 1 -- start start 2024-01-24T13:04:22.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.844+0000 7f7245400640 1 --2- 172.21.15.29:0/276593872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7240035fc0 0x7f724003c640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f724000fb60 tx=0x7f723801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=898f91f33b31e1e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.844+0000 7fa6b7200640 1 Processor -- start 2024-01-24T13:04:22.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.844+0000 7fa6b7200640 1 -- start start 2024-01-24T13:04:22.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.844+0000 7f8e26e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8e2015c640 0x7f8e200701c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.844+0000 7f8e26e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2015d550 con 0x7f8e2015caf0 2024-01-24T13:04:22.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.844+0000 7f8e26e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2015cf90 con 0x7f8e200cef20 2024-01-24T13:04:22.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.844+0000 7f8e26e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e20158fd0 con 0x7f8e2015c640 2024-01-24T13:04:22.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.844+0000 7f8e24e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8e2015caf0 0x7f8e2006be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41540/0 (socket says 172.21.15.29:41540) 2024-01-24T13:04:22.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.844+0000 7f8e24e00640 1 -- 172.21.15.29:0/2945040568 learned_addr learned my addr 172.21.15.29:0/2945040568 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:22.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.844+0000 7f8e1f400640 1 --2- 172.21.15.29:0/2945040568 >> v2:172.21.15.163:3300/0 conn(0x7f8e2015c640 0x7f8e200701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.844+0000 7fa6b7200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa6b0070230 0x7fa6b00afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7fa6b7200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b00cc300 con 0x7fa6b006de60 2024-01-24T13:04:22.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7fa6b7200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b00c9960 con 0x7fa6b00b03c0 2024-01-24T13:04:22.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7fa6b7200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b0158ee0 con 0x7fa6b0070230 2024-01-24T13:04:22.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635580235 0 0) 0x7f8e2015d550 con 0x7f8e2015caf0 2024-01-24T13:04:22.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e00003530 con 0x7f8e2015caf0 2024-01-24T13:04:22.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f7244a00640 1 -- 172.21.15.29:0/276593872 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72380ac640 con 0x7f7240035fc0 2024-01-24T13:04:22.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f7244a00640 1 -- 172.21.15.29:0/276593872 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72380ac7a0 con 0x7f7240035fc0 2024-01-24T13:04:22.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f7244a00640 1 -- 172.21.15.29:0/276593872 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72380acb30 con 0x7f7240035fc0 2024-01-24T13:04:22.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7fa6afe00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa6b006de60 0x7fa6b01587d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41550/0 (socket says 172.21.15.29:41550) 2024-01-24T13:04:22.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7fa6afe00640 1 -- 172.21.15.29:0/3294426907 learned_addr learned my addr 172.21.15.29:0/3294426907 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:22.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7fa6af400640 1 --2- 172.21.15.29:0/3294426907 >> v2:172.21.15.29:3300/0 conn(0x7fa6b0070230 0x7fa6b00afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460121156 0 0) 0x7f8e2015cf90 con 0x7f8e200cef20 2024-01-24T13:04:22.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e2015d550 con 0x7f8e200cef20 2024-01-24T13:04:22.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f724d000640 1 -- 172.21.15.29:0/276593872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7240035fc0 msgr2=0x7f724003c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f724d000640 1 --2- 172.21.15.29:0/276593872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7240035fc0 0x7f724003c640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f724000fb60 tx=0x7f723801c470 comp rx=0 tx=0).stop 2024-01-24T13:04:22.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 <== mon.1 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3420533057 0 0) 0x7f8e2015d550 con 0x7f8e200cef20 2024-01-24T13:04:22.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 >> v2:172.21.15.163:3300/0 conn(0x7f8e2015c640 msgr2=0x7f8e200701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 --2- 172.21.15.29:0/2945040568 >> v2:172.21.15.163:3300/0 conn(0x7f8e2015c640 0x7f8e200701c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 >> v1:172.21.15.29:6789/0 conn(0x7f8e2015caf0 legacy=0x7f8e2006be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2015d270 con 0x7f8e200cef20 2024-01-24T13:04:22.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 <== mon.1 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f8e10001680 con 0x7f8e200cef20 2024-01-24T13:04:22.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 >> v1:172.21.15.163:6789/0 conn(0x7f8e200cef20 legacy=0x7f8e201588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 --2- 172.21.15.29:0/2945040568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e00003b10 0x7f8e00003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 --2- 172.21.15.29:0/2945040568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e000047d0 0x7f8e00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 --2- 172.21.15.29:0/2945040568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e00005190 0x7f8e0000ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20158fd0 con 0x7f8e000047d0 2024-01-24T13:04:22.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000104e0 con 0x7f8e00003b10 2024-01-24T13:04:22.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000106a0 con 0x7f8e00005190 2024-01-24T13:04:22.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7fa6aea00640 1 -- 172.21.15.29:0/3294426907 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736540315 0 0) 0x7fa6b00c9960 con 0x7fa6b00b03c0 2024-01-24T13:04:22.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7fa6aea00640 1 -- 172.21.15.29:0/3294426907 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa690003530 con 0x7fa6b00b03c0 2024-01-24T13:04:22.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f724d000640 1 -- 172.21.15.29:0/276593872 shutdown_connections 2024-01-24T13:04:22.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e1fe00640 1 --2- 172.21.15.29:0/2945040568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e00003b10 0x7f8e00003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f8e24e00640 1 --2- 172.21.15.29:0/2945040568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e00005190 0x7f8e0000ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f724d000640 1 --2- 172.21.15.29:0/276593872 >> v2:172.21.15.29:3300/0 conn(0x7f7240039e50 0x7f724003a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f724d000640 1 --2- 172.21.15.29:0/276593872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7240035fc0 0x7f724003c640 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f724d000640 1 --2- 172.21.15.29:0/276593872 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7240051a40 0x7f7240051e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7f724d000640 1 -- 172.21.15.29:0/276593872 >> 172.21.15.29:0/276593872 conn(0x7f72400537a0 msgr2=0x7f7240053bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7fa6af400640 1 -- 172.21.15.29:0/3294426907 >> v1:172.21.15.163:6789/0 conn(0x7fa6b00b03c0 legacy=0x7fa6b00c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7fa6af400640 1 -- 172.21.15.29:0/3294426907 >> v1:172.21.15.29:6789/0 conn(0x7fa6b006de60 legacy=0x7fa6b01587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.848+0000 7fa6af400640 1 -- 172.21.15.29:0/3294426907 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b00c9c40 con 0x7fa6b0070230 2024-01-24T13:04:22.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7f8e1f400640 1 --2- 172.21.15.29:0/2945040568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e000047d0 0x7f8e00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7f724d000640 1 -- 172.21.15.29:0/276593872 shutdown_connections 2024-01-24T13:04:22.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7f724d000640 1 -- 172.21.15.29:0/276593872 wait complete. 2024-01-24T13:04:22.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7f724d000640 1 Processor -- start 2024-01-24T13:04:22.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f724d000640 1 -- start start 2024-01-24T13:04:22.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7fc6d3400640 1 Processor -- start 2024-01-24T13:04:22.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7fc6d3400640 1 -- start start 2024-01-24T13:04:22.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7fc6d3400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc6cc0b0590 0x7fc6cc164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7fc6d3400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6cc06fd70 0x7fc6cc0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7fc6d3400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc0701c0 con 0x7fc6cc0c1940 2024-01-24T13:04:22.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7fc6d3400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc071c00 con 0x7fc6cc0b0590 2024-01-24T13:04:22.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7fc6d3400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0c1d20 con 0x7fc6cc06fd70 2024-01-24T13:04:22.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7fc6d1400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6cc06fd70 0x7fc6cc0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7fc6d1400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6cc06fd70 0x7fc6cc0c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53272/0 (socket says 172.21.15.29:53272) 2024-01-24T13:04:22.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7fc6d1400640 1 -- 172.21.15.29:0/808906655 learned_addr learned my addr 172.21.15.29:0/808906655 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7fc6d1400640 1 -- 172.21.15.29:0/808906655 >> v2:172.21.15.29:3300/0 conn(0x7fc6cc0b0590 msgr2=0x7fc6cc164ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7fc6d1400640 1 --2- 172.21.15.29:0/808906655 >> v2:172.21.15.29:3300/0 conn(0x7fc6cc0b0590 0x7fc6cc164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7fc6d1400640 1 -- 172.21.15.29:0/808906655 >> v1:172.21.15.29:6789/0 conn(0x7fc6cc0c1940 legacy=0x7fc6cc0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7fc6d1400640 1 -- 172.21.15.29:0/808906655 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc165090 con 0x7fc6cc06fd70 2024-01-24T13:04:22.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f9c8a200640 1 Processor -- start 2024-01-24T13:04:22.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7f8e24e00640 1 -- 172.21.15.29:0/2945040568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e00003b10 msgr2=0x7f8e00003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7f8e24e00640 1 --2- 172.21.15.29:0/2945040568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e00003b10 0x7f8e00003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7f8e24e00640 1 -- 172.21.15.29:0/2945040568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e000047d0 msgr2=0x7f8e00004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7f8e24e00640 1 --2- 172.21.15.29:0/2945040568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e000047d0 0x7f8e00004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.852+0000 7f8e24e00640 1 -- 172.21.15.29:0/2945040568 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2015d270 con 0x7f8e00005190 2024-01-24T13:04:22.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f8e24e00640 1 -- 172.21.15.29:0/2945040568 reap_dead start 2024-01-24T13:04:22.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f724d000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7240035fc0 0x7f72400db400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f724d000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7240039e50 0x7f724004a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7fa6af400640 1 --2- 172.21.15.29:0/3294426907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b0070230 0x7fa6b00afe80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa698009740 tx=0x7fa69801ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ed6c80cd2b5be server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f8e24e00640 1 --2- 172.21.15.29:0/2945040568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e00005190 0x7f8e0000ffa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800c320 tx=0x7f8e1801cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f56b327ecbfb08c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f7245e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7240035fc0 0x7f72400db400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f7245e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7240035fc0 0x7f72400db400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37214/0 (socket says 172.21.15.29:37214) 2024-01-24T13:04:22.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f724d000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7240051a40 0x7f724004aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f7245400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7240039e50 0x7f724004a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f7245400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7240039e50 0x7f724004a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34252/0 (socket says 172.21.15.29:34252) 2024-01-24T13:04:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f724d000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7240037130 con 0x7f7240035fc0 2024-01-24T13:04:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e180a5bf0 con 0x7f8e00005190 2024-01-24T13:04:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f724d000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72400373e0 con 0x7f7240039e50 2024-01-24T13:04:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f8e1ea00640 1 -- 172.21.15.29:0/2945040568 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e180a5d50 con 0x7f8e00005190 2024-01-24T13:04:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f9c8a200640 1 -- start start 2024-01-24T13:04:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c8a200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9c84152ca0 0x7f9c840b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c8a200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c8406d6c0 0x7f9c8406dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c8a200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c84159d60 con 0x7f9c84158d70 2024-01-24T13:04:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c8a200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8406e020 con 0x7f9c84152ca0 2024-01-24T13:04:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c8a200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c84159220 con 0x7f9c8406d6c0 2024-01-24T13:04:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f724d000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72400376c0 con 0x7f7240051a40 2024-01-24T13:04:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f7245e00640 1 -- 172.21.15.29:0/410721866 learned_addr learned my addr 172.21.15.29:0/410721866 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.856+0000 7f7246800640 1 --2- 172.21.15.29:0/410721866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7240051a40 0x7f724004aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f7245400640 1 -- 172.21.15.29:0/410721866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7240051a40 msgr2=0x7f724004aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f7245400640 1 --2- 172.21.15.29:0/410721866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7240051a40 0x7f724004aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f7245400640 1 -- 172.21.15.29:0/410721866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7240035fc0 msgr2=0x7f72400db400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f7245400640 1 --2- 172.21.15.29:0/410721866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7240035fc0 0x7f72400db400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f7245400640 1 -- 172.21.15.29:0/410721866 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7238009420 con 0x7f7240039e50 2024-01-24T13:04:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f7245400640 1 --2- 172.21.15.29:0/410721866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7240039e50 0x7f724004a970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f72380ab000 tx=0x7f7238019210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c89800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c8406d6c0 0x7f9c8406dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83e00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f9c84158d70 0x7f9c84070810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:35940/0 (socket says 172.21.15.29:35940) 2024-01-24T13:04:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f8e26e00640 1 -- 172.21.15.29:0/2945040568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e00005190 msgr2=0x7f8e0000ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f8e26e00640 1 --2- 172.21.15.29:0/2945040568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e00005190 0x7f8e0000ffa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800c320 tx=0x7f8e1801cd50 comp rx=0 tx=0).stop 2024-01-24T13:04:22.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83e00640 1 -- 172.21.15.29:0/2060501288 learned_addr learned my addr 172.21.15.29:0/2060501288 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:22.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7fa6aea00640 1 -- 172.21.15.29:0/3294426907 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8001a00 con 0x7fa6b0070230 2024-01-24T13:04:22.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f8e26e00640 1 -- 172.21.15.29:0/2945040568 shutdown_connections 2024-01-24T13:04:22.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f8e26e00640 1 --2- 172.21.15.29:0/2945040568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e00005190 0x7f8e0000ffa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f8e26e00640 1 -- 172.21.15.29:0/2945040568 >> 172.21.15.29:0/2945040568 conn(0x7f8e200ce400 msgr2=0x7f8e200ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 -- 172.21.15.29:0/2060501288 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753041396 0 0) 0x7f9c84159d60 con 0x7f9c84158d70 2024-01-24T13:04:22.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c88e00640 1 --2- 172.21.15.29:0/2060501288 >> v2:172.21.15.163:3300/0 conn(0x7f9c84152ca0 0x7f9c840b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 -- 172.21.15.29:0/2060501288 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c64003530 con 0x7f9c84158d70 2024-01-24T13:04:22.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7fa6aea00640 1 -- 172.21.15.29:0/3294426907 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6980a85b0 con 0x7fa6b0070230 2024-01-24T13:04:22.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7fa6aea00640 1 -- 172.21.15.29:0/3294426907 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6980a8940 con 0x7fa6b0070230 2024-01-24T13:04:22.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7fc6d1400640 1 --2- 172.21.15.29:0/808906655 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6cc06fd70 0x7fc6cc0c9460 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009e50 tx=0x7fc6c401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e409a60cdaca3b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f8e26e00640 1 -- 172.21.15.29:0/2945040568 shutdown_connections 2024-01-24T13:04:22.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f8e26e00640 1 -- 172.21.15.29:0/2945040568 wait complete. 2024-01-24T13:04:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 -- 172.21.15.29:0/2060501288 <== mon.1 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 327941426 0 0) 0x7f9c64003530 con 0x7f9c84158d70 2024-01-24T13:04:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f723e000640 1 -- 172.21.15.29:0/410721866 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72380b5600 con 0x7f7240039e50 2024-01-24T13:04:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f723e000640 1 -- 172.21.15.29:0/410721866 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72380b5760 con 0x7f7240039e50 2024-01-24T13:04:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f723e000640 1 -- 172.21.15.29:0/410721866 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72380b5ad0 con 0x7f7240039e50 2024-01-24T13:04:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f724d000640 1 -- 172.21.15.29:0/410721866 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72400379a0 con 0x7f7240039e50 2024-01-24T13:04:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f724d000640 1 -- 172.21.15.29:0/410721866 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7240037f60 con 0x7f7240039e50 2024-01-24T13:04:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 -- 172.21.15.29:0/2060501288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c8406d6c0 msgr2=0x7f9c8406dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 --2- 172.21.15.29:0/2060501288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c8406d6c0 0x7f9c8406dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 -- 172.21.15.29:0/2060501288 >> v2:172.21.15.163:3300/0 conn(0x7f9c84152ca0 msgr2=0x7f9c840b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 --2- 172.21.15.29:0/2060501288 >> v2:172.21.15.163:3300/0 conn(0x7f9c84152ca0 0x7f9c840b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 -- 172.21.15.29:0/2060501288 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c841594c0 con 0x7f9c84158d70 2024-01-24T13:04:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 -- 172.21.15.29:0/2060501288 <== mon.1 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f9c6c001680 con 0x7f9c84158d70 2024-01-24T13:04:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 -- 172.21.15.29:0/2060501288 >> v1:172.21.15.163:6789/0 conn(0x7f9c84158d70 legacy=0x7f9c84070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 --2- 172.21.15.29:0/2060501288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c64003980 0x7f9c64003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 --2- 172.21.15.29:0/2060501288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c640047d0 0x7f9c64004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 --2- 172.21.15.29:0/2060501288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c64005190 0x7f9c6400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 -- 172.21.15.29:0/2060501288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c84159220 con 0x7f9c640047d0 2024-01-24T13:04:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 -- 172.21.15.29:0/2060501288 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6400bed0 con 0x7f9c64005190 2024-01-24T13:04:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83400640 1 -- 172.21.15.29:0/2060501288 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6400c090 con 0x7f9c64003980 2024-01-24T13:04:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c88e00640 1 --2- 172.21.15.29:0/2060501288 >> v2:172.21.15.163:3300/0 conn(0x7f9c84152ca0 0x7f9c840b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c88e00640 1 --2- 172.21.15.29:0/2060501288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c64003980 0x7f9c64003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7f9c83e00640 1 --2- 172.21.15.29:0/2060501288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c640047d0 0x7f9c64004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7f9c88e00640 1 -- 172.21.15.29:0/2060501288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c64005190 msgr2=0x7f9c6400b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-24T13:04:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7f9c88e00640 1 --2- 172.21.15.29:0/2060501288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c64005190 0x7f9c6400b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7f9c88e00640 1 -- 172.21.15.29:0/2060501288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c640047d0 msgr2=0x7f9c64004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7f9c88e00640 1 --2- 172.21.15.29:0/2060501288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c640047d0 0x7f9c64004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7f9c88e00640 1 -- 172.21.15.29:0/2060501288 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c841594c0 con 0x7f9c64003980 2024-01-24T13:04:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7fc6cb400640 1 -- 172.21.15.29:0/808906655 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40a56d0 con 0x7fc6cc06fd70 2024-01-24T13:04:22.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7fc6cb400640 1 -- 172.21.15.29:0/808906655 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c40a5830 con 0x7fc6cc06fd70 2024-01-24T13:04:22.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7fc6cb400640 1 -- 172.21.15.29:0/808906655 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40a5bc0 con 0x7fc6cc06fd70 2024-01-24T13:04:22.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7fc6d3400640 1 -- 172.21.15.29:0/808906655 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6cc06fd70 msgr2=0x7fc6cc0c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7fc6d3400640 1 --2- 172.21.15.29:0/808906655 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6cc06fd70 0x7fc6cc0c9460 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009e50 tx=0x7fc6c401c940 comp rx=0 tx=0).stop 2024-01-24T13:04:22.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7fa6b7200640 1 -- 172.21.15.29:0/3294426907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b0070230 msgr2=0x7fa6b00afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.860+0000 7fa6b7200640 1 --2- 172.21.15.29:0/3294426907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b0070230 0x7fa6b00afe80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa698009740 tx=0x7fa69801ea70 comp rx=0 tx=0).stop 2024-01-24T13:04:22.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7fa6b7200640 1 -- 172.21.15.29:0/3294426907 shutdown_connections 2024-01-24T13:04:22.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7fa6b7200640 1 --2- 172.21.15.29:0/3294426907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b0070230 0x7fa6b00afe80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7fa6b7200640 1 -- 172.21.15.29:0/3294426907 >> 172.21.15.29:0/3294426907 conn(0x7fa6b006a2d0 msgr2=0x7fa6b00cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7fc6d3400640 1 -- 172.21.15.29:0/808906655 shutdown_connections 2024-01-24T13:04:22.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7fc6d3400640 1 --2- 172.21.15.29:0/808906655 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6cc06fd70 0x7fc6cc0c9460 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7fc6d3400640 1 --2- 172.21.15.29:0/808906655 >> v2:172.21.15.29:3300/0 conn(0x7fc6cc0b0590 0x7fc6cc164ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7fc6d3400640 1 -- 172.21.15.29:0/808906655 >> 172.21.15.29:0/808906655 conn(0x7fc6cc06a2d0 msgr2=0x7fc6cc0cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7f8e26e00640 1 Processor -- start 2024-01-24T13:04:22.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7fc6d3400640 1 -- 172.21.15.29:0/808906655 shutdown_connections 2024-01-24T13:04:22.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7fc6d3400640 1 -- 172.21.15.29:0/808906655 wait complete. 2024-01-24T13:04:22.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7f723e000640 1 -- 172.21.15.29:0/410721866 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f72380b3040 con 0x7f7240039e50 2024-01-24T13:04:22.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7f723e000640 1 --2- 172.21.15.29:0/410721866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7220065ae0 0x7f7220067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7f723e000640 1 -- 172.21.15.29:0/410721866 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f723811c980 con 0x7f7240039e50 2024-01-24T13:04:22.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7fa6b7200640 1 -- 172.21.15.29:0/3294426907 shutdown_connections 2024-01-24T13:04:22.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7fa6b7200640 1 -- 172.21.15.29:0/3294426907 wait complete. 2024-01-24T13:04:22.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7fc361000640 1 Processor -- start 2024-01-24T13:04:22.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7f7245e00640 1 --2- 172.21.15.29:0/410721866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7220065ae0 0x7f7220067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.864+0000 7fc361000640 1 -- start start 2024-01-24T13:04:22.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8c7e800640 1 Processor -- start 2024-01-24T13:04:22.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8c7e800640 1 -- start start 2024-01-24T13:04:22.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f724d000640 1 -- 172.21.15.29:0/410721866 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7240038150 con 0x7f7240039e50 2024-01-24T13:04:22.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7fc361000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc35c164ab0 0x7fc35c06fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7fc6d3400640 1 Processor -- start 2024-01-24T13:04:22.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8e26e00640 1 -- start start 2024-01-24T13:04:22.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f9c88e00640 1 --2- 172.21.15.29:0/2060501288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c64003980 0x7f9c64003da0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009840 tx=0x7f9c7401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ee156d35c930d9e server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7fa6b7200640 1 Processor -- start 2024-01-24T13:04:22.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f9c83400640 1 -- 172.21.15.29:0/2060501288 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c740a7a20 con 0x7f9c64003980 2024-01-24T13:04:22.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f9c83400640 1 -- 172.21.15.29:0/2060501288 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c740a7b80 con 0x7f9c64003980 2024-01-24T13:04:22.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f9c83400640 1 -- 172.21.15.29:0/2060501288 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c740af440 con 0x7f9c64003980 2024-01-24T13:04:22.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8c7e800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c780c1940 0x7f8c78164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8c7e800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c780b0590 0x7f8c780c9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8c7e800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c78071c00 con 0x7f8c7806fd70 2024-01-24T13:04:22.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8c7e800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c78070200 con 0x7f8c780c1940 2024-01-24T13:04:22.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8c7e800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780c1d20 con 0x7f8c780b0590 2024-01-24T13:04:22.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7fa6b7200640 1 -- start start 2024-01-24T13:04:22.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8e26e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e00005190 0x7f8e2014b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7fc361000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c071c00 con 0x7fc35c0b0590 2024-01-24T13:04:22.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7fc35a800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc35c164ab0 0x7fc35c06fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7fc35a800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc35c164ab0 0x7fc35c06fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34270/0 (socket says 172.21.15.29:34270) 2024-01-24T13:04:22.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7fc35a800640 1 -- 172.21.15.29:0/1879383155 learned_addr learned my addr 172.21.15.29:0/1879383155 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7fc359e00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fc35c0c1940 0x7fc35c0afe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:35946/0 (socket says 172.21.15.29:35946) 2024-01-24T13:04:22.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8e26e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e200b1000 0x7f8e200b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8e26e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e200b2fe0 0x7f8e200b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8e26e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200b19c0 con 0x7f8e00005190 2024-01-24T13:04:22.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8e26e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2014ca70 con 0x7f8e200b2fe0 2024-01-24T13:04:22.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8e26e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200b3d50 con 0x7f8e200b1000 2024-01-24T13:04:22.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8e1f400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e200b1000 0x7f8e200b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8c77400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c780c1940 0x7f8c78164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8e1f400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e200b1000 0x7f8e200b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53290/0 (socket says 172.21.15.29:53290) 2024-01-24T13:04:22.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8e1f400640 1 -- 172.21.15.29:0/1514041342 learned_addr learned my addr 172.21.15.29:0/1514041342 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8e24e00640 1 --2- 172.21.15.29:0/1514041342 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e200b2fe0 0x7f8e200b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7fc361000640 1 -- 172.21.15.29:0/1879383155 --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c0c1d20 con 0x7fc35c0c1940 2024-01-24T13:04:22.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7fc361000640 1 -- 172.21.15.29:0/1879383155 --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c165090 con 0x7fc35c164ab0 2024-01-24T13:04:22.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7fc6d3400640 1 -- start start 2024-01-24T13:04:22.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8c76a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8c7806fd70 0x7f8c780afe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41574/0 (socket says 172.21.15.29:41574) 2024-01-24T13:04:22.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8c76a00640 1 -- 172.21.15.29:0/2387285010 learned_addr learned my addr 172.21.15.29:0/2387285010 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:22.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f8c77e00640 1 --2- 172.21.15.29:0/2387285010 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c780b0590 0x7f8c780c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.868+0000 7f7245e00640 1 --2- 172.21.15.29:0/410721866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7220065ae0 0x7f7220067fa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f724003b2a0 tx=0x7f7230008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8e1fe00640 1 --2- 172.21.15.29:0/1514041342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e00005190 0x7f8e2014b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8e1f400640 1 -- 172.21.15.29:0/1514041342 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e200b2fe0 msgr2=0x7f8e200b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8e1f400640 1 --2- 172.21.15.29:0/1514041342 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e200b2fe0 0x7f8e200b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8e1f400640 1 -- 172.21.15.29:0/1514041342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e00005190 msgr2=0x7f8e2014b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8e1f400640 1 --2- 172.21.15.29:0/1514041342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e00005190 0x7f8e2014b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8e1f400640 1 -- 172.21.15.29:0/1514041342 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2014c140 con 0x7f8e200b1000 2024-01-24T13:04:22.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fc35a800640 1 -- 172.21.15.29:0/1879383155 >> v1:172.21.15.163:6789/0 conn(0x7fc35c0c1940 legacy=0x7fc35c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8c77e00640 1 -- 172.21.15.29:0/2387285010 >> v2:172.21.15.29:3300/0 conn(0x7f8c780c1940 msgr2=0x7f8c78164ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8c77e00640 1 --2- 172.21.15.29:0/2387285010 >> v2:172.21.15.29:3300/0 conn(0x7f8c780c1940 0x7f8c78164ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8c77e00640 1 -- 172.21.15.29:0/2387285010 >> v1:172.21.15.29:6789/0 conn(0x7f8c7806fd70 legacy=0x7f8c780afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8e1f400640 1 --2- 172.21.15.29:0/1514041342 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e200b1000 0x7f8e200b1480 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8e080118c0 tx=0x7f8e08011d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f9c8a200640 1 -- 172.21.15.29:0/2060501288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c64003980 msgr2=0x7f9c64003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f9c8a200640 1 --2- 172.21.15.29:0/2060501288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c64003980 0x7f9c64003da0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009840 tx=0x7f9c7401ecb0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f9c89800640 1 -- 172.21.15.29:0/2060501288 reap_dead start 2024-01-24T13:04:22.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8e17e00640 1 -- 172.21.15.29:0/1514041342 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08004240 con 0x7f8e200b1000 2024-01-24T13:04:22.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f9c8a200640 1 -- 172.21.15.29:0/2060501288 shutdown_connections 2024-01-24T13:04:22.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f9c8a200640 1 -- 172.21.15.29:0/2060501288 >> 172.21.15.29:0/2060501288 conn(0x7f9c840afdc0 msgr2=0x7f9c840b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8e17e00640 1 -- 172.21.15.29:0/1514041342 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e080043a0 con 0x7f8e200b1000 2024-01-24T13:04:22.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8e17e00640 1 -- 172.21.15.29:0/1514041342 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800fa60 con 0x7f8e200b1000 2024-01-24T13:04:22.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8e26e00640 1 -- 172.21.15.29:0/1514041342 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2014c420 con 0x7f8e200b1000 2024-01-24T13:04:22.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fc35a800640 1 -- 172.21.15.29:0/1879383155 >> v1:172.21.15.29:6789/0 conn(0x7fc35c0b0590 legacy=0x7fc35c0cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fc35a800640 1 -- 172.21.15.29:0/1879383155 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c165370 con 0x7fc35c164ab0 2024-01-24T13:04:22.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8e26e00640 1 -- 172.21.15.29:0/1514041342 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2014bea0 con 0x7f8e200b1000 2024-01-24T13:04:22.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6b7200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6b006de60 0x7fa6b0159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6b7200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b0070230 0x7fa6b0144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6b7200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6b00b03c0 0x7fa6b014b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f9c8a200640 1 -- 172.21.15.29:0/2060501288 shutdown_connections 2024-01-24T13:04:22.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6af400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b0070230 0x7fa6b0144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6afe00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6b006de60 0x7fa6b0159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6afe00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6b006de60 0x7fa6b0159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53318/0 (socket says 172.21.15.29:53318) 2024-01-24T13:04:22.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6afe00640 1 -- 172.21.15.29:0/793144456 learned_addr learned my addr 172.21.15.29:0/793144456 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6b5200640 1 --2- 172.21.15.29:0/793144456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6b00b03c0 0x7fa6b014b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6b7200640 1 -- 172.21.15.29:0/793144456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0144ec0 con 0x7fa6b0070230 2024-01-24T13:04:22.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8e26e00640 1 -- 172.21.15.29:0/1514041342 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df0005260 con 0x7f8e200b1000 2024-01-24T13:04:22.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6b7200640 1 -- 172.21.15.29:0/793144456 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b01468f0 con 0x7fa6b00b03c0 2024-01-24T13:04:22.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6b7200640 1 -- 172.21.15.29:0/793144456 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b015b880 con 0x7fa6b006de60 2024-01-24T13:04:22.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f8c77e00640 1 -- 172.21.15.29:0/2387285010 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c78165090 con 0x7f8c780b0590 2024-01-24T13:04:22.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6afe00640 1 -- 172.21.15.29:0/793144456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6b00b03c0 msgr2=0x7fa6b014b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6afe00640 1 --2- 172.21.15.29:0/793144456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6b00b03c0 0x7fa6b014b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6afe00640 1 -- 172.21.15.29:0/793144456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b0070230 msgr2=0x7fa6b0144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6afe00640 1 --2- 172.21.15.29:0/793144456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b0070230 0x7fa6b0144980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7fa6afe00640 1 -- 172.21.15.29:0/793144456 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa698009420 con 0x7fa6b006de60 2024-01-24T13:04:22.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fa6afe00640 1 --2- 172.21.15.29:0/793144456 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6b006de60 0x7fa6b0159f10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000c500 tx=0x7fa6a000c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7f8e17e00640 1 -- 172.21.15.29:0/1514041342 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8e0800fbc0 con 0x7f8e200b1000 2024-01-24T13:04:22.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.872+0000 7f9c8a200640 1 -- 172.21.15.29:0/2060501288 wait complete. 2024-01-24T13:04:22.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fa6a7e00640 1 -- 172.21.15.29:0/793144456 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0005cf0 con 0x7fa6b006de60 2024-01-24T13:04:22.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fa6a7e00640 1 -- 172.21.15.29:0/793144456 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a0005e50 con 0x7fa6b006de60 2024-01-24T13:04:22.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fa6a7e00640 1 -- 172.21.15.29:0/793144456 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00072f0 con 0x7fa6b006de60 2024-01-24T13:04:22.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fa6b7200640 1 -- 172.21.15.29:0/793144456 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b015bb60 con 0x7fa6b006de60 2024-01-24T13:04:22.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7f9c8a200640 1 Processor -- start 2024-01-24T13:04:22.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc35a800640 1 --2- 172.21.15.29:0/1879383155 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc35c164ab0 0x7fc35c06fd70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009870 tx=0x7fc34c01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=909cd14a0c71059 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fa6b7200640 1 -- 172.21.15.29:0/793144456 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b00c1f30 con 0x7fa6b006de60 2024-01-24T13:04:22.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7f9c8a200640 1 -- start start 2024-01-24T13:04:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7f723e000640 1 -- 172.21.15.29:0/410721866 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f72380ea160 con 0x7f7240039e50 2024-01-24T13:04:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc358a00640 1 -- 172.21.15.29:0/1879383155 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0ab600 con 0x7fc35c164ab0 2024-01-24T13:04:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc358a00640 1 -- 172.21.15.29:0/1879383155 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c0a7050 con 0x7fc35c164ab0 2024-01-24T13:04:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc358a00640 1 -- 172.21.15.29:0/1879383155 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0ab600 con 0x7fc35c164ab0 2024-01-24T13:04:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fa6b7200640 1 -- 172.21.15.29:0/793144456 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b004e000 con 0x7fa6b006de60 2024-01-24T13:04:22.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc6d3400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6cc06fd70 0x7fc6cc0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc6d3400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6cc0b0590 0x7fc6cc156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc6d3400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6cc0c1940 0x7fc6cc154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc6d3400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc164790 con 0x7fc6cc06fd70 2024-01-24T13:04:22.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc6d3400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0c81b0 con 0x7fc6cc0b0590 2024-01-24T13:04:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc6d3400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc1644b0 con 0x7fc6cc0c1940 2024-01-24T13:04:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc6cbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6cc0b0590 0x7fc6cc156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc6cbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6cc0b0590 0x7fc6cc156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34298/0 (socket says 172.21.15.29:34298) 2024-01-24T13:04:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc6cbe00640 1 -- 172.21.15.29:0/4126124120 learned_addr learned my addr 172.21.15.29:0/4126124120 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7f8e17e00640 1 --2- 172.21.15.29:0/1514041342 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8df8065a90 0x7f8df8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7f8c77e00640 1 --2- 172.21.15.29:0/2387285010 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c780b0590 0x7f8c780c9460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8c70009d90 tx=0x7f8c7001c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30b558246086dd50 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc361000640 1 -- 172.21.15.29:0/1879383155 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc35c164ab0 msgr2=0x7fc35c06fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc361000640 1 --2- 172.21.15.29:0/1879383155 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc35c164ab0 0x7fc35c06fd70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009870 tx=0x7fc34c01c4b0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc6cbe00640 1 -- 172.21.15.29:0/4126124120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6cc0c1940 msgr2=0x7fc6cc154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc6cbe00640 1 --2- 172.21.15.29:0/4126124120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6cc0c1940 0x7fc6cc154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc6cbe00640 1 -- 172.21.15.29:0/4126124120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6cc06fd70 msgr2=0x7fc6cc0c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7f8e17e00640 1 -- 172.21.15.29:0/1514041342 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8e080839b0 con 0x7f8e200b1000 2024-01-24T13:04:22.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7f8e1fe00640 1 --2- 172.21.15.29:0/1514041342 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8df8065a90 0x7f8df8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc6cbe00640 1 --2- 172.21.15.29:0/4126124120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6cc06fd70 0x7fc6cc0c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.876+0000 7fc6cbe00640 1 -- 172.21.15.29:0/4126124120 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4009b30 con 0x7fc6cc0b0590 2024-01-24T13:04:22.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7fc361000640 1 -- 172.21.15.29:0/1879383155 shutdown_connections 2024-01-24T13:04:22.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7fc361000640 1 --2- 172.21.15.29:0/1879383155 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc35c164ab0 0x7fc35c06fd70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7fc361000640 1 -- 172.21.15.29:0/1879383155 >> 172.21.15.29:0/1879383155 conn(0x7fc35c06a2d0 msgr2=0x7fc35c0cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f8e1fe00640 1 --2- 172.21.15.29:0/1514041342 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8df8065a90 0x7f8df8067f50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e10007cb0 tx=0x7f8e10000f60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7fc6cbe00640 1 --2- 172.21.15.29:0/4126124120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6cc0b0590 0x7fc6cc156d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00b4d0 tx=0x7fc6bc00b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7fc6c8c00640 1 -- 172.21.15.29:0/4126124120 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc011890 con 0x7fc6cc0b0590 2024-01-24T13:04:22.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7fc361000640 1 -- 172.21.15.29:0/1879383155 shutdown_connections 2024-01-24T13:04:22.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7fc6c8c00640 1 -- 172.21.15.29:0/4126124120 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc011a10 con 0x7fc6cc0b0590 2024-01-24T13:04:22.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7fc6c8c00640 1 -- 172.21.15.29:0/4126124120 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc011dc0 con 0x7fc6cc0b0590 2024-01-24T13:04:22.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7fc361000640 1 -- 172.21.15.29:0/1879383155 wait complete. 2024-01-24T13:04:22.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7fc6d3400640 1 -- 172.21.15.29:0/4126124120 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc0c7190 con 0x7fc6cc0b0590 2024-01-24T13:04:22.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7fc6d3400640 1 -- 172.21.15.29:0/4126124120 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc0c7750 con 0x7fc6cc0b0590 2024-01-24T13:04:22.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f9c8a200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c64003980 0x7f9c8414e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f9c8a200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c84155850 0x7f9c841540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f9c8a200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c84154610 0x7f9c84154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f9c8a200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c841553c0 con 0x7f9c84155850 2024-01-24T13:04:22.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f9c8a200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8415b780 con 0x7f9c64003980 2024-01-24T13:04:22.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f9c8a200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8415ba60 con 0x7f9c84154610 2024-01-24T13:04:22.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f9c88e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c64003980 0x7f9c8414e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f9c83e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c84155850 0x7f9c841540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f8e17e00640 1 -- 172.21.15.29:0/1514041342 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f8e08051090 con 0x7f8e200b1000 2024-01-24T13:04:22.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f9c83e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c84155850 0x7f9c841540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37264/0 (socket says 172.21.15.29:37264) 2024-01-24T13:04:22.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f9c83e00640 1 -- 172.21.15.29:0/99788692 learned_addr learned my addr 172.21.15.29:0/99788692 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f9c83e00640 1 -- 172.21.15.29:0/99788692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c84154610 msgr2=0x7f9c84154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f9c83e00640 1 --2- 172.21.15.29:0/99788692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c84154610 0x7f9c84154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f9c83e00640 1 -- 172.21.15.29:0/99788692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c64003980 msgr2=0x7f9c8414e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f9c83e00640 1 --2- 172.21.15.29:0/99788692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c64003980 0x7f9c8414e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7fc6d3400640 1 -- 172.21.15.29:0/4126124120 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc0c7970 con 0x7fc6cc0b0590 2024-01-24T13:04:22.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f8c76000640 1 -- 172.21.15.29:0/2387285010 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c700a5810 con 0x7f8c780b0590 2024-01-24T13:04:22.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f8c76000640 1 -- 172.21.15.29:0/2387285010 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c700a5970 con 0x7f8c780b0590 2024-01-24T13:04:22.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7f8c76000640 1 -- 172.21.15.29:0/2387285010 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c700a5d00 con 0x7f8c780b0590 2024-01-24T13:04:22.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f8c7e800640 1 -- 172.21.15.29:0/2387285010 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c780b0590 msgr2=0x7f8c780c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f8c7e800640 1 --2- 172.21.15.29:0/2387285010 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c780b0590 0x7f8c780c9460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8c70009d90 tx=0x7f8c7001c880 comp rx=0 tx=0).stop 2024-01-24T13:04:22.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.880+0000 7fc361000640 1 Processor -- start 2024-01-24T13:04:22.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f9c83e00640 1 -- 172.21.15.29:0/99788692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c840710a0 con 0x7f9c84155850 2024-01-24T13:04:22.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7fc361000640 1 -- start start 2024-01-24T13:04:22.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f8c7e800640 1 -- 172.21.15.29:0/2387285010 shutdown_connections 2024-01-24T13:04:22.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f8c7e800640 1 --2- 172.21.15.29:0/2387285010 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c780b0590 0x7f8c780c9460 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f8c7e800640 1 --2- 172.21.15.29:0/2387285010 >> v2:172.21.15.29:3300/0 conn(0x7f8c780c1940 0x7f8c78164ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f8c7e800640 1 -- 172.21.15.29:0/2387285010 >> 172.21.15.29:0/2387285010 conn(0x7f8c7806a2d0 msgr2=0x7f8c780cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f9c88e00640 1 --2- 172.21.15.29:0/99788692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c64003980 0x7f9c8414e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:22.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f9c83e00640 1 --2- 172.21.15.29:0/99788692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c84155850 0x7f9c841540d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c000c10 tx=0x7f9c6c007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7fa6a7e00640 1 -- 172.21.15.29:0/793144456 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa6a0007450 con 0x7fa6b006de60 2024-01-24T13:04:22.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f8c7e800640 1 -- 172.21.15.29:0/2387285010 shutdown_connections 2024-01-24T13:04:22.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f8c7e800640 1 -- 172.21.15.29:0/2387285010 wait complete. 2024-01-24T13:04:22.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7fc361000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc35c0b0590 0x7fc35c157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f9c80c00640 1 -- 172.21.15.29:0/99788692 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c00f930 con 0x7f9c84155850 2024-01-24T13:04:22.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f9c80c00640 1 -- 172.21.15.29:0/99788692 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c00fa90 con 0x7f9c84155850 2024-01-24T13:04:22.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f9c80c00640 1 -- 172.21.15.29:0/99788692 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c00fe40 con 0x7f9c84155850 2024-01-24T13:04:22.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7fc6c8c00640 1 -- 172.21.15.29:0/4126124120 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc6bc01a400 con 0x7fc6cc0b0590 2024-01-24T13:04:22.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7fc6c8c00640 1 --2- 172.21.15.29:0/4126124120 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc6a4065a60 0x7fc6a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7fc6c8c00640 1 -- 172.21.15.29:0/4126124120 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc6bc0838f0 con 0x7fc6cc0b0590 2024-01-24T13:04:22.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7fc361000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc35c0c1940 0x7fc35c163010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7fa6a7e00640 1 --2- 172.21.15.29:0/793144456 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa688065a90 0x7fa688067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7fc361000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35c164ab0 0x7fc35c163550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7fa6a7e00640 1 -- 172.21.15.29:0/793144456 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa6a0083170 con 0x7fa6b006de60 2024-01-24T13:04:22.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7fa6af400640 1 --2- 172.21.15.29:0/793144456 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa688065a90 0x7fa688067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f9c8a200640 1 -- 172.21.15.29:0/99788692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8415bd40 con 0x7f9c84155850 2024-01-24T13:04:22.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7f9c8a200640 1 -- 172.21.15.29:0/99788692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c84154fe0 con 0x7f9c84155850 2024-01-24T13:04:22.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc6d0a00640 1 --2- 172.21.15.29:0/4126124120 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc6a4065a60 0x7fc6a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.884+0000 7fc359400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc35c0c1940 0x7fc35c163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc359400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc35c0c1940 0x7fc35c163010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34310/0 (socket says 172.21.15.29:34310) 2024-01-24T13:04:22.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc359400640 1 -- 172.21.15.29:0/3925731417 learned_addr learned my addr 172.21.15.29:0/3925731417 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7f9c8a200640 1 -- 172.21.15.29:0/99788692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c84155570 con 0x7f9c84155850 2024-01-24T13:04:22.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc359e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc35c0b0590 0x7fc35c157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc361000640 1 -- 172.21.15.29:0/3925731417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0b1fb0 con 0x7fc35c164ab0 2024-01-24T13:04:22.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc361000640 1 -- 172.21.15.29:0/3925731417 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c163b80 con 0x7fc35c0c1940 2024-01-24T13:04:22.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc361000640 1 -- 172.21.15.29:0/3925731417 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c163e60 con 0x7fc35c0b0590 2024-01-24T13:04:22.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc35a800640 1 --2- 172.21.15.29:0/3925731417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35c164ab0 0x7fc35c163550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc6d0a00640 1 --2- 172.21.15.29:0/4126124120 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc6a4065a60 0x7fc6a4067f20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009650 tx=0x7fc6b4006bb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc35a800640 1 -- 172.21.15.29:0/3925731417 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc35c0b0590 msgr2=0x7fc35c157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc35a800640 1 --2- 172.21.15.29:0/3925731417 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc35c0b0590 0x7fc35c157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc35a800640 1 -- 172.21.15.29:0/3925731417 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc35c0c1940 msgr2=0x7fc35c163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc35a800640 1 --2- 172.21.15.29:0/3925731417 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc35c0c1940 0x7fc35c163010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc35a800640 1 -- 172.21.15.29:0/3925731417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c0094d0 con 0x7fc35c164ab0 2024-01-24T13:04:22.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc359e00640 1 --2- 172.21.15.29:0/3925731417 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc35c0b0590 0x7fc35c157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fa6af400640 1 --2- 172.21.15.29:0/793144456 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa688065a90 0x7fa688067f50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa6980b2000 tx=0x7fa6980aa070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fa6a7e00640 1 -- 172.21.15.29:0/793144456 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa6a0050960 con 0x7fa6b006de60 2024-01-24T13:04:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc6c8c00640 1 -- 172.21.15.29:0/4126124120 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc6bc050fd0 con 0x7fc6cc0b0590 2024-01-24T13:04:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7f8c7e800640 1 Processor -- start 2024-01-24T13:04:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7f8c7e800640 1 -- start start 2024-01-24T13:04:22.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.888+0000 7fc35a800640 1 --2- 172.21.15.29:0/3925731417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35c164ab0 0x7fc35c163550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0ab000 tx=0x7fc34c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f9c80c00640 1 -- 172.21.15.29:0/99788692 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9c6c01d360 con 0x7f9c84155850 2024-01-24T13:04:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c7e800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7806fd70 0x7f8c780c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c7e800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c780b0590 0x7f8c78156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c7e800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c780c1940 0x7f8c78158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c7e800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c78155470 con 0x7f8c780b0590 2024-01-24T13:04:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c7e800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c78156d00 con 0x7f8c780c1940 2024-01-24T13:04:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c7e800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780c2de0 con 0x7f8c7806fd70 2024-01-24T13:04:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c77400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7806fd70 0x7f8c780c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c77e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c780c1940 0x7f8c78158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c77e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c780c1940 0x7f8c78158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34322/0 (socket says 172.21.15.29:34322) 2024-01-24T13:04:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c77e00640 1 -- 172.21.15.29:0/1328843964 learned_addr learned my addr 172.21.15.29:0/1328843964 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c77e00640 1 -- 172.21.15.29:0/1328843964 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7806fd70 msgr2=0x7f8c780c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f9c80c00640 1 --2- 172.21.15.29:0/99788692 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9c5c065b30 0x7f9c5c067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f9c80c00640 1 -- 172.21.15.29:0/99788692 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c6c0834a0 con 0x7f9c84155850 2024-01-24T13:04:22.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c77e00640 1 --2- 172.21.15.29:0/1328843964 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7806fd70 0x7f8c780c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c77e00640 1 -- 172.21.15.29:0/1328843964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c780b0590 msgr2=0x7f8c78156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c77e00640 1 --2- 172.21.15.29:0/1328843964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c780b0590 0x7f8c78156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c77e00640 1 -- 172.21.15.29:0/1328843964 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c70009a70 con 0x7f8c780c1940 2024-01-24T13:04:22.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f9c88e00640 1 --2- 172.21.15.29:0/99788692 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9c5c065b30 0x7f9c5c067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.892+0000 7f8c77e00640 1 --2- 172.21.15.29:0/1328843964 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c780c1940 0x7f8c78158670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c7001af30 tx=0x7f8c70019620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.896+0000 7f8c6f400640 1 -- 172.21.15.29:0/1328843964 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c700ad850 con 0x7f8c780c1940 2024-01-24T13:04:22.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.896+0000 7f8c6f400640 1 -- 172.21.15.29:0/1328843964 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c700ad9b0 con 0x7f8c780c1940 2024-01-24T13:04:22.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.896+0000 7f8c6f400640 1 -- 172.21.15.29:0/1328843964 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c700add20 con 0x7f8c780c1940 2024-01-24T13:04:22.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.896+0000 7f8c7e800640 1 -- 172.21.15.29:0/1328843964 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c780c3930 con 0x7f8c780c1940 2024-01-24T13:04:22.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.896+0000 7f8c7e800640 1 -- 172.21.15.29:0/1328843964 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c78155960 con 0x7f8c780c1940 2024-01-24T13:04:22.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.896+0000 7f9c88e00640 1 --2- 172.21.15.29:0/99788692 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9c5c065b30 0x7f9c5c067ff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c740b1000 tx=0x7f9c740046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.896+0000 7f9c80c00640 1 -- 172.21.15.29:0/99788692 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9c6c050be0 con 0x7f9c84155850 2024-01-24T13:04:22.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.896+0000 7fc352000640 1 -- 172.21.15.29:0/3925731417 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c003d60 con 0x7fc35c164ab0 2024-01-24T13:04:22.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.896+0000 7fc352000640 1 -- 172.21.15.29:0/3925731417 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c000d10 con 0x7fc35c164ab0 2024-01-24T13:04:22.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.896+0000 7fc352000640 1 -- 172.21.15.29:0/3925731417 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0b4680 con 0x7fc35c164ab0 2024-01-24T13:04:22.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.896+0000 7fc361000640 1 -- 172.21.15.29:0/3925731417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c0b1960 con 0x7fc35c164ab0 2024-01-24T13:04:22.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.896+0000 7fc361000640 1 -- 172.21.15.29:0/3925731417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c158a10 con 0x7fc35c164ab0 2024-01-24T13:04:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.900+0000 7f8c7e800640 1 -- 172.21.15.29:0/1328843964 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7804e000 con 0x7f8c780c1940 2024-01-24T13:04:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.900+0000 7f8c6f400640 1 -- 172.21.15.29:0/1328843964 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8c700b4070 con 0x7f8c780c1940 2024-01-24T13:04:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.900+0000 7f8c6f400640 1 --2- 172.21.15.29:0/1328843964 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8c50065b30 0x7f8c50067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.900+0000 7f8c6f400640 1 -- 172.21.15.29:0/1328843964 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c7011e170 con 0x7f8c780c1940 2024-01-24T13:04:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.900+0000 7f8c77400640 1 --2- 172.21.15.29:0/1328843964 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8c50065b30 0x7f8c50067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.900+0000 7fc352000640 1 -- 172.21.15.29:0/3925731417 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc34c0b2070 con 0x7fc35c164ab0 2024-01-24T13:04:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.900+0000 7fc361000640 1 -- 172.21.15.29:0/3925731417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c0b2120 con 0x7fc35c164ab0 2024-01-24T13:04:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.900+0000 7fc352000640 1 --2- 172.21.15.29:0/3925731417 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc334065ab0 0x7fc334067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.904+0000 7fc352000640 1 -- 172.21.15.29:0/3925731417 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc34c11d350 con 0x7fc35c164ab0 2024-01-24T13:04:22.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.904+0000 7f8c77400640 1 --2- 172.21.15.29:0/1328843964 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8c50065b30 0x7f8c50067ff0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8c781590e0 tx=0x7f8c68008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.904+0000 7fc359e00640 1 --2- 172.21.15.29:0/3925731417 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc334065ab0 0x7fc334067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.904+0000 7fc359e00640 1 --2- 172.21.15.29:0/3925731417 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc334065ab0 0x7fc334067f70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc344000f70 tx=0x7fc344007d70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.908+0000 7f8c6f400640 1 -- 172.21.15.29:0/1328843964 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f8c700eb8b0 con 0x7f8c780c1940 2024-01-24T13:04:22.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.912+0000 7fc352000640 1 -- 172.21.15.29:0/3925731417 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc34c0eaa00 con 0x7fc35c164ab0 2024-01-24T13:04:22.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.928+0000 7f2f56800640 1 Processor -- start 2024-01-24T13:04:22.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.928+0000 7f2f56800640 1 -- start start 2024-01-24T13:04:22.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.932+0000 7f2f56800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2f500cd0e0 0x7f2f500ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.932+0000 7f2f56800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f50160280 con 0x7f2f500cd570 2024-01-24T13:04:22.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.932+0000 7f2f56800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f500ccc50 con 0x7f2f5015fea0 2024-01-24T13:04:22.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.932+0000 7f2f56800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f500cbd60 con 0x7f2f500cd0e0 2024-01-24T13:04:22.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.932+0000 7f2f4f400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f2f5015fea0 0x7f2f5006d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:35948/0 (socket says 172.21.15.29:35948) 2024-01-24T13:04:22.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.932+0000 7f2f4f400640 1 -- 172.21.15.29:0/1253766380 learned_addr learned my addr 172.21.15.29:0/1253766380 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.932+0000 7f2f4ea00640 1 --2- 172.21.15.29:0/1253766380 >> v2:172.21.15.29:3300/0 conn(0x7f2f500cd0e0 0x7f2f500ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.932+0000 7f2f4e000640 1 -- 172.21.15.29:0/1253766380 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282669706 0 0) 0x7f2f500ccc50 con 0x7f2f5015fea0 2024-01-24T13:04:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.932+0000 7f2f4e000640 1 -- 172.21.15.29:0/1253766380 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f30003530 con 0x7f2f5015fea0 2024-01-24T13:04:22.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.932+0000 7f2f4ea00640 1 -- 172.21.15.29:0/1253766380 >> v1:172.21.15.163:6789/0 conn(0x7f2f5015fea0 legacy=0x7f2f5006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.932+0000 7f2f4ea00640 1 -- 172.21.15.29:0/1253766380 >> v1:172.21.15.29:6789/0 conn(0x7f2f500cd570 legacy=0x7f2f500c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:22.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.932+0000 7f2f4ea00640 1 -- 172.21.15.29:0/1253766380 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f500cc040 con 0x7f2f500cd0e0 2024-01-24T13:04:22.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.936+0000 7f2f4ea00640 1 --2- 172.21.15.29:0/1253766380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f500cd0e0 0x7f2f500ab8e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2f400097c0 tx=0x7f2f4001c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d66b47d4e0d270f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.936+0000 7f2f4e000640 1 -- 172.21.15.29:0/1253766380 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f400ab600 con 0x7f2f500cd0e0 2024-01-24T13:04:22.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.940+0000 7f2f4e000640 1 -- 172.21.15.29:0/1253766380 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f400a7050 con 0x7f2f500cd0e0 2024-01-24T13:04:22.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.940+0000 7f2f4e000640 1 -- 172.21.15.29:0/1253766380 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f400ab600 con 0x7f2f500cd0e0 2024-01-24T13:04:22.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.940+0000 7f2f56800640 1 -- 172.21.15.29:0/1253766380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f500cd0e0 msgr2=0x7f2f500ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.940+0000 7f2f56800640 1 --2- 172.21.15.29:0/1253766380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f500cd0e0 0x7f2f500ab8e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2f400097c0 tx=0x7f2f4001c2f0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.940+0000 7f2f56800640 1 -- 172.21.15.29:0/1253766380 shutdown_connections 2024-01-24T13:04:22.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.940+0000 7f2f56800640 1 --2- 172.21.15.29:0/1253766380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f500cd0e0 0x7f2f500ab8e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.940+0000 7f2f56800640 1 -- 172.21.15.29:0/1253766380 >> 172.21.15.29:0/1253766380 conn(0x7f2f500cac10 msgr2=0x7f2f500caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:22.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.940+0000 7f2f56800640 1 -- 172.21.15.29:0/1253766380 shutdown_connections 2024-01-24T13:04:22.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.940+0000 7f2f56800640 1 -- 172.21.15.29:0/1253766380 wait complete. 2024-01-24T13:04:22.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.944+0000 7f2f56800640 1 Processor -- start 2024-01-24T13:04:22.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.944+0000 7f2f56800640 1 -- start start 2024-01-24T13:04:22.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.944+0000 7f2f56800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f500cd0e0 0x7f2f5015eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.944+0000 7f2f56800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f500cd570 0x7f2f500c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.944+0000 7f2f56800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f5015fea0 0x7f2f500c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.944+0000 7f2f56800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f501f99c0 con 0x7f2f500cd570 2024-01-24T13:04:22.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.944+0000 7f2f56800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f500c28f0 con 0x7f2f5015fea0 2024-01-24T13:04:22.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.944+0000 7f2f56800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f500c2bd0 con 0x7f2f500cd0e0 2024-01-24T13:04:22.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.948+0000 7f2f4ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f500cd570 0x7f2f500c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.948+0000 7f2f4ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f500cd570 0x7f2f500c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37308/0 (socket says 172.21.15.29:37308) 2024-01-24T13:04:22.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.948+0000 7f2f4ea00640 1 -- 172.21.15.29:0/441397916 learned_addr learned my addr 172.21.15.29:0/441397916 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:22.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.948+0000 7f2f4ea00640 1 -- 172.21.15.29:0/441397916 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f500cd0e0 msgr2=0x7f2f5015eb50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-24T13:04:22.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.948+0000 7f2f4ea00640 1 --2- 172.21.15.29:0/441397916 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f500cd0e0 0x7f2f5015eb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.948+0000 7f2f4ea00640 1 -- 172.21.15.29:0/441397916 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f5015fea0 msgr2=0x7f2f500c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:22.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.948+0000 7f2f4ea00640 1 --2- 172.21.15.29:0/441397916 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f5015fea0 0x7f2f500c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:22.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.948+0000 7f2f4ea00640 1 -- 172.21.15.29:0/441397916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f40009420 con 0x7f2f500cd570 2024-01-24T13:04:22.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.948+0000 7f2f4ea00640 1 --2- 172.21.15.29:0/441397916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f500cd570 0x7f2f500c7270 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f40019f20 tx=0x7f2f40019090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.948+0000 7f2f47400640 1 -- 172.21.15.29:0/441397916 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f400ab600 con 0x7f2f500cd570 2024-01-24T13:04:22.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.948+0000 7f2f47400640 1 -- 172.21.15.29:0/441397916 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f400aa6f0 con 0x7f2f500cd570 2024-01-24T13:04:22.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.948+0000 7f2f47400640 1 -- 172.21.15.29:0/441397916 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f400ab600 con 0x7f2f500cd570 2024-01-24T13:04:22.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.948+0000 7f2f56800640 1 -- 172.21.15.29:0/441397916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f500c2eb0 con 0x7f2f500cd570 2024-01-24T13:04:22.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.952+0000 7f2f56800640 1 -- 172.21.15.29:0/441397916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5015f090 con 0x7f2f500cd570 2024-01-24T13:04:22.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.952+0000 7f2f47400640 1 -- 172.21.15.29:0/441397916 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2f400b2040 con 0x7f2f500cd570 2024-01-24T13:04:22.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.956+0000 7f2f47400640 1 --2- 172.21.15.29:0/441397916 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2f28076ad0 0x7f2f28078f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:22.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.956+0000 7f2f47400640 1 -- 172.21.15.29:0/441397916 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2f400eedb0 con 0x7f2f500cd570 2024-01-24T13:04:22.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.956+0000 7f2f4f400640 1 --2- 172.21.15.29:0/441397916 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2f28076ad0 0x7f2f28078f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:22.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.956+0000 7f2f4f400640 1 --2- 172.21.15.29:0/441397916 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2f28076ad0 0x7f2f28078f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2f48001f90 tx=0x7f2f480015c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:22.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.960+0000 7f2f56800640 1 -- 172.21.15.29:0/441397916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5004e850 con 0x7f2f500cd570 2024-01-24T13:04:22.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:22.968+0000 7f2f47400640 1 -- 172.21.15.29:0/441397916 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2f400eb180 con 0x7f2f500cd570 2024-01-24T13:04:23.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.208+0000 7f724d000640 1 -- 172.21.15.29:0/410721866 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f72400057a0 con 0x7f7240039e50 2024-01-24T13:04:23.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.208+0000 7f723e000640 1 -- 172.21.15.29:0/410721866 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72380b1030 con 0x7f7240039e50 2024-01-24T13:04:23.212 INFO:teuthology.orchestra.run.smithi029.stdout:64424509450 2024-01-24T13:04:23.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.212+0000 7f724d000640 1 -- 172.21.15.29:0/410721866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7220065ae0 msgr2=0x7f7220067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.212+0000 7f724d000640 1 --2- 172.21.15.29:0/410721866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7220065ae0 0x7f7220067fa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f724003b2a0 tx=0x7f7230008040 comp rx=0 tx=0).stop 2024-01-24T13:04:23.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.212+0000 7f724d000640 1 -- 172.21.15.29:0/410721866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7240039e50 msgr2=0x7f724004a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.212+0000 7f724d000640 1 --2- 172.21.15.29:0/410721866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7240039e50 0x7f724004a970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f72380ab000 tx=0x7f7238019210 comp rx=0 tx=0).stop 2024-01-24T13:04:23.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.216+0000 7f724d000640 1 -- 172.21.15.29:0/410721866 shutdown_connections 2024-01-24T13:04:23.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.216+0000 7f8e26e00640 1 -- 172.21.15.29:0/1514041342 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8df0005510 con 0x7f8e200b1000 2024-01-24T13:04:23.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.216+0000 7f724d000640 1 --2- 172.21.15.29:0/410721866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7220065ae0 0x7f7220067fa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.216+0000 7f724d000640 1 --2- 172.21.15.29:0/410721866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7240051a40 0x7f724004aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.216+0000 7f724d000640 1 --2- 172.21.15.29:0/410721866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7240039e50 0x7f724004a970 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.216+0000 7f724d000640 1 --2- 172.21.15.29:0/410721866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7240035fc0 0x7f72400db400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.216+0000 7f724d000640 1 -- 172.21.15.29:0/410721866 >> 172.21.15.29:0/410721866 conn(0x7f72400537a0 msgr2=0x7f724003a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:23.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.216+0000 7f724d000640 1 -- 172.21.15.29:0/410721866 shutdown_connections 2024-01-24T13:04:23.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.216+0000 7f724d000640 1 -- 172.21.15.29:0/410721866 wait complete. 2024-01-24T13:04:23.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.216+0000 7f8e17e00640 1 -- 172.21.15.29:0/1514041342 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e08019090 con 0x7f8e200b1000 2024-01-24T13:04:23.221 INFO:teuthology.orchestra.run.smithi029.stdout:64424509449 2024-01-24T13:04:23.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.220+0000 7f8e26e00640 1 -- 172.21.15.29:0/1514041342 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8df8065a90 msgr2=0x7f8df8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.220+0000 7f8e26e00640 1 --2- 172.21.15.29:0/1514041342 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8df8065a90 0x7f8df8067f50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e10007cb0 tx=0x7f8e10000f60 comp rx=0 tx=0).stop 2024-01-24T13:04:23.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.220+0000 7f8e26e00640 1 -- 172.21.15.29:0/1514041342 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e200b1000 msgr2=0x7f8e200b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.220+0000 7f8e26e00640 1 --2- 172.21.15.29:0/1514041342 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e200b1000 0x7f8e200b1480 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8e080118c0 tx=0x7f8e08011d80 comp rx=0 tx=0).stop 2024-01-24T13:04:23.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.220+0000 7f8e26e00640 1 -- 172.21.15.29:0/1514041342 shutdown_connections 2024-01-24T13:04:23.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.220+0000 7f8e26e00640 1 --2- 172.21.15.29:0/1514041342 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8df8065a90 0x7f8df8067f50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.220+0000 7f8e26e00640 1 --2- 172.21.15.29:0/1514041342 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e200b2fe0 0x7f8e200b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.220+0000 7f8e26e00640 1 --2- 172.21.15.29:0/1514041342 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e200b1000 0x7f8e200b1480 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.220+0000 7f8e26e00640 1 --2- 172.21.15.29:0/1514041342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e00005190 0x7f8e2014b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.220+0000 7f8e26e00640 1 -- 172.21.15.29:0/1514041342 >> 172.21.15.29:0/1514041342 conn(0x7f8e200ce400 msgr2=0x7f8e20070820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:23.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.220+0000 7fa6b7200640 1 -- 172.21.15.29:0/793144456 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa6b015b9c0 con 0x7fa6b006de60 2024-01-24T13:04:23.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.220+0000 7f8e26e00640 1 -- 172.21.15.29:0/1514041342 shutdown_connections 2024-01-24T13:04:23.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.220+0000 7f8e26e00640 1 -- 172.21.15.29:0/1514041342 wait complete. 2024-01-24T13:04:23.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.224+0000 7fa6a7e00640 1 -- 172.21.15.29:0/793144456 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa6a0021020 con 0x7fa6b006de60 2024-01-24T13:04:23.225 INFO:teuthology.orchestra.run.smithi029.stdout:64424509450 2024-01-24T13:04:23.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.224+0000 7fc6d3400640 1 -- 172.21.15.29:0/4126124120 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc6cc04e000 con 0x7fc6cc0b0590 2024-01-24T13:04:23.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.224+0000 7fc6c8c00640 1 -- 172.21.15.29:0/4126124120 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6bc015090 con 0x7fc6cc0b0590 2024-01-24T13:04:23.228 INFO:teuthology.orchestra.run.smithi029.stdout:64424509449 2024-01-24T13:04:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.228+0000 7fa6b7200640 1 -- 172.21.15.29:0/793144456 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa688065a90 msgr2=0x7fa688067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.228+0000 7fa6b7200640 1 --2- 172.21.15.29:0/793144456 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa688065a90 0x7fa688067f50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa6980b2000 tx=0x7fa6980aa070 comp rx=0 tx=0).stop 2024-01-24T13:04:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.228+0000 7fa6b7200640 1 -- 172.21.15.29:0/793144456 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6b006de60 msgr2=0x7fa6b0159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.228+0000 7fa6b7200640 1 --2- 172.21.15.29:0/793144456 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6b006de60 0x7fa6b0159f10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000c500 tx=0x7fa6a000c9c0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.228+0000 7fa6b7200640 1 -- 172.21.15.29:0/793144456 shutdown_connections 2024-01-24T13:04:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.228+0000 7fa6b7200640 1 --2- 172.21.15.29:0/793144456 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa688065a90 0x7fa688067f50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.228+0000 7fa6b7200640 1 --2- 172.21.15.29:0/793144456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6b00b03c0 0x7fa6b014b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.228+0000 7fa6b7200640 1 --2- 172.21.15.29:0/793144456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b0070230 0x7fa6b0144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.228+0000 7fa6b7200640 1 --2- 172.21.15.29:0/793144456 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6b006de60 0x7fa6b0159f10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.228+0000 7fa6b7200640 1 -- 172.21.15.29:0/793144456 >> 172.21.15.29:0/793144456 conn(0x7fa6b006a2d0 msgr2=0x7fa6b00ad980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:23.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.228+0000 7fa6b7200640 1 -- 172.21.15.29:0/793144456 shutdown_connections 2024-01-24T13:04:23.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.228+0000 7fa6b7200640 1 -- 172.21.15.29:0/793144456 wait complete. 2024-01-24T13:04:23.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.232+0000 7fc6d3400640 1 -- 172.21.15.29:0/4126124120 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc6a4065a60 msgr2=0x7fc6a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.232+0000 7fc6d3400640 1 --2- 172.21.15.29:0/4126124120 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc6a4065a60 0x7fc6a4067f20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009650 tx=0x7fc6b4006bb0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.232+0000 7fc6d3400640 1 -- 172.21.15.29:0/4126124120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6cc0b0590 msgr2=0x7fc6cc156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.232+0000 7fc6d3400640 1 --2- 172.21.15.29:0/4126124120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6cc0b0590 0x7fc6cc156d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00b4d0 tx=0x7fc6bc00b990 comp rx=0 tx=0).stop 2024-01-24T13:04:23.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.232+0000 7fc6d3400640 1 -- 172.21.15.29:0/4126124120 shutdown_connections 2024-01-24T13:04:23.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.232+0000 7fc6d3400640 1 --2- 172.21.15.29:0/4126124120 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc6a4065a60 0x7fc6a4067f20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.232+0000 7fc6d3400640 1 --2- 172.21.15.29:0/4126124120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6cc0c1940 0x7fc6cc154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.232+0000 7fc6d3400640 1 --2- 172.21.15.29:0/4126124120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6cc0b0590 0x7fc6cc156d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.232+0000 7fc6d3400640 1 --2- 172.21.15.29:0/4126124120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6cc06fd70 0x7fc6cc0c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.232+0000 7fc6d3400640 1 -- 172.21.15.29:0/4126124120 >> 172.21.15.29:0/4126124120 conn(0x7fc6cc06a2d0 msgr2=0x7fc6cc0cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:23.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.232+0000 7fc6d3400640 1 -- 172.21.15.29:0/4126124120 shutdown_connections 2024-01-24T13:04:23.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.232+0000 7fc6d3400640 1 -- 172.21.15.29:0/4126124120 wait complete. 2024-01-24T13:04:23.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.236+0000 7f9c8a200640 1 -- 172.21.15.29:0/99788692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9c8415bed0 con 0x7f9c84155850 2024-01-24T13:04:23.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.236+0000 7f9c80c00640 1 -- 172.21.15.29:0/99788692 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c6c01a020 con 0x7f9c84155850 2024-01-24T13:04:23.240 INFO:teuthology.orchestra.run.smithi029.stdout:64424509451 2024-01-24T13:04:23.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.240+0000 7f9c8a200640 1 -- 172.21.15.29:0/99788692 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9c5c065b30 msgr2=0x7f9c5c067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.240+0000 7f9c8a200640 1 --2- 172.21.15.29:0/99788692 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9c5c065b30 0x7f9c5c067ff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c740b1000 tx=0x7f9c740046d0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.240+0000 7f9c8a200640 1 -- 172.21.15.29:0/99788692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c84155850 msgr2=0x7f9c841540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.240+0000 7f9c8a200640 1 --2- 172.21.15.29:0/99788692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c84155850 0x7f9c841540d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c000c10 tx=0x7f9c6c007770 comp rx=0 tx=0).stop 2024-01-24T13:04:23.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.244+0000 7f9c8a200640 1 -- 172.21.15.29:0/99788692 shutdown_connections 2024-01-24T13:04:23.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.244+0000 7f9c8a200640 1 --2- 172.21.15.29:0/99788692 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9c5c065b30 0x7f9c5c067ff0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.244+0000 7f9c8a200640 1 --2- 172.21.15.29:0/99788692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c84154610 0x7f9c84154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.244+0000 7f9c8a200640 1 --2- 172.21.15.29:0/99788692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c84155850 0x7f9c841540d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.244+0000 7f9c8a200640 1 --2- 172.21.15.29:0/99788692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c64003980 0x7f9c8414e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.244+0000 7f9c8a200640 1 -- 172.21.15.29:0/99788692 >> 172.21.15.29:0/99788692 conn(0x7f9c840afdc0 msgr2=0x7f9c84070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:23.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.244+0000 7f9c8a200640 1 -- 172.21.15.29:0/99788692 shutdown_connections 2024-01-24T13:04:23.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.244+0000 7f9c8a200640 1 -- 172.21.15.29:0/99788692 wait complete. 2024-01-24T13:04:23.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.244+0000 7f8c7e800640 1 -- 172.21.15.29:0/1328843964 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8c780cba70 con 0x7f8c780c1940 2024-01-24T13:04:23.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.248+0000 7fc361000640 1 -- 172.21.15.29:0/3925731417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc35c04e000 con 0x7fc35c164ab0 2024-01-24T13:04:23.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.248+0000 7f8c6f400640 1 -- 172.21.15.29:0/1328843964 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8c700eeed0 con 0x7f8c780c1940 2024-01-24T13:04:23.249 INFO:teuthology.orchestra.run.smithi029.stdout:64424509449 2024-01-24T13:04:23.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.248+0000 7fc352000640 1 -- 172.21.15.29:0/3925731417 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc34c0ee020 con 0x7fc35c164ab0 2024-01-24T13:04:23.252 INFO:teuthology.orchestra.run.smithi029.stdout:64424509448 2024-01-24T13:04:23.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7f8c7e800640 1 -- 172.21.15.29:0/1328843964 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8c50065b30 msgr2=0x7f8c50067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7f8c7e800640 1 --2- 172.21.15.29:0/1328843964 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8c50065b30 0x7f8c50067ff0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8c781590e0 tx=0x7f8c68008040 comp rx=0 tx=0).stop 2024-01-24T13:04:23.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7f8c7e800640 1 -- 172.21.15.29:0/1328843964 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c780c1940 msgr2=0x7f8c78158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7f8c7e800640 1 --2- 172.21.15.29:0/1328843964 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c780c1940 0x7f8c78158670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c7001af30 tx=0x7f8c70019620 comp rx=0 tx=0).stop 2024-01-24T13:04:23.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7fc361000640 1 -- 172.21.15.29:0/3925731417 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc334065ab0 msgr2=0x7fc334067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7fc361000640 1 --2- 172.21.15.29:0/3925731417 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc334065ab0 0x7fc334067f70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc344000f70 tx=0x7fc344007d70 comp rx=0 tx=0).stop 2024-01-24T13:04:23.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7fc361000640 1 -- 172.21.15.29:0/3925731417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35c164ab0 msgr2=0x7fc35c163550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7fc361000640 1 --2- 172.21.15.29:0/3925731417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35c164ab0 0x7fc35c163550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0ab000 tx=0x7fc34c019270 comp rx=0 tx=0).stop 2024-01-24T13:04:23.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7f8c7e800640 1 -- 172.21.15.29:0/1328843964 shutdown_connections 2024-01-24T13:04:23.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7f8c7e800640 1 --2- 172.21.15.29:0/1328843964 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8c50065b30 0x7f8c50067ff0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7f8c7e800640 1 --2- 172.21.15.29:0/1328843964 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c780c1940 0x7f8c78158670 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7f8c7e800640 1 --2- 172.21.15.29:0/1328843964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c780b0590 0x7f8c78156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7f8c7e800640 1 --2- 172.21.15.29:0/1328843964 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7806fd70 0x7f8c780c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7f8c7e800640 1 -- 172.21.15.29:0/1328843964 >> 172.21.15.29:0/1328843964 conn(0x7f8c7806a2d0 msgr2=0x7f8c78160350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:23.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7f8c7e800640 1 -- 172.21.15.29:0/1328843964 shutdown_connections 2024-01-24T13:04:23.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7f8c7e800640 1 -- 172.21.15.29:0/1328843964 wait complete. 2024-01-24T13:04:23.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7fc361000640 1 -- 172.21.15.29:0/3925731417 shutdown_connections 2024-01-24T13:04:23.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7fc361000640 1 --2- 172.21.15.29:0/3925731417 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc334065ab0 0x7fc334067f70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7fc361000640 1 --2- 172.21.15.29:0/3925731417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35c164ab0 0x7fc35c163550 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7fc361000640 1 --2- 172.21.15.29:0/3925731417 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc35c0c1940 0x7fc35c163010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7fc361000640 1 --2- 172.21.15.29:0/3925731417 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc35c0b0590 0x7fc35c157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7fc361000640 1 -- 172.21.15.29:0/3925731417 >> 172.21.15.29:0/3925731417 conn(0x7fc35c06a2d0 msgr2=0x7fc35c0aecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:23.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7fc361000640 1 -- 172.21.15.29:0/3925731417 shutdown_connections 2024-01-24T13:04:23.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.252+0000 7fc361000640 1 -- 172.21.15.29:0/3925731417 wait complete. 2024-01-24T13:04:23.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.2 2024-01-24T13:04:23.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.1 2024-01-24T13:04:23.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.0 2024-01-24T13:04:23.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2024-01-24T13:04:23.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509451 for osd.7 2024-01-24T13:04:23.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2024-01-24T13:04:23.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509449 for osd.6 2024-01-24T13:04:23.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.292+0000 7f2f56800640 1 -- 172.21.15.29:0/441397916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2f500c3360 con 0x7f2f500cd570 2024-01-24T13:04:23.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.292+0000 7f2f47400640 1 -- 172.21.15.29:0/441397916 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f400b0070 con 0x7f2f500cd570 2024-01-24T13:04:23.294 INFO:teuthology.orchestra.run.smithi029.stdout:55834574859 2024-01-24T13:04:23.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.292+0000 7f2f56800640 1 -- 172.21.15.29:0/441397916 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2f28076ad0 msgr2=0x7f2f28078f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.292+0000 7f2f56800640 1 --2- 172.21.15.29:0/441397916 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2f28076ad0 0x7f2f28078f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2f48001f90 tx=0x7f2f480015c0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.292+0000 7f2f56800640 1 -- 172.21.15.29:0/441397916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f500cd570 msgr2=0x7f2f500c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.292+0000 7f2f56800640 1 --2- 172.21.15.29:0/441397916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f500cd570 0x7f2f500c7270 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f40019f20 tx=0x7f2f40019090 comp rx=0 tx=0).stop 2024-01-24T13:04:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.292+0000 7f2f56800640 1 -- 172.21.15.29:0/441397916 shutdown_connections 2024-01-24T13:04:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.292+0000 7f2f56800640 1 --2- 172.21.15.29:0/441397916 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2f28076ad0 0x7f2f28078f90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.292+0000 7f2f56800640 1 --2- 172.21.15.29:0/441397916 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f5015fea0 0x7f2f500c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.292+0000 7f2f56800640 1 --2- 172.21.15.29:0/441397916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f500cd570 0x7f2f500c7270 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.292+0000 7f2f56800640 1 --2- 172.21.15.29:0/441397916 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f500cd0e0 0x7f2f5015eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.292+0000 7f2f56800640 1 -- 172.21.15.29:0/441397916 >> 172.21.15.29:0/441397916 conn(0x7f2f500cac10 msgr2=0x7f2f5006d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.296+0000 7f2f56800640 1 -- 172.21.15.29:0/441397916 shutdown_connections 2024-01-24T13:04:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:23.296+0000 7f2f56800640 1 -- 172.21.15.29:0/441397916 wait complete. 2024-01-24T13:04:23.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.5 2024-01-24T13:04:24.258 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-24T13:04:24.263 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-24T13:04:24.272 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-24T13:04:24.284 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-24T13:04:24.286 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-24T13:04:24.289 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-24T13:04:24.291 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-24T13:04:24.320 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-24T13:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.472+0000 7f12b3000640 1 Processor -- start 2024-01-24T13:04:24.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.472+0000 7f12b3000640 1 -- start start 2024-01-24T13:04:24.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.476+0000 7f12b3000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f12ac15bdd0 0x7f12ac15cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.476+0000 7f12b3000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12ac0cd020 0x7f12ac0cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.476+0000 7f12b3000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ac0cda30 con 0x7f12ac06cfa0 2024-01-24T13:04:24.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.476+0000 7f12ab400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12ac0cd020 0x7f12ac0cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.476+0000 7f12ab400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12ac0cd020 0x7f12ac0cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53388/0 (socket says 172.21.15.29:53388) 2024-01-24T13:04:24.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.476+0000 7f12ab400640 1 -- 172.21.15.29:0/1212686627 learned_addr learned my addr 172.21.15.29:0/1212686627 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:24.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.476+0000 7f12b3000640 1 -- 172.21.15.29:0/1212686627 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ac15d4c0 con 0x7f12ac15bdd0 2024-01-24T13:04:24.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.476+0000 7f12b3000640 1 -- 172.21.15.29:0/1212686627 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0cce20 con 0x7f12ac0cd020 2024-01-24T13:04:24.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.480+0000 7f12ab400640 1 -- 172.21.15.29:0/1212686627 >> v2:172.21.15.29:3300/0 conn(0x7f12ac15bdd0 msgr2=0x7f12ac15cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:24.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.480+0000 7f12ab400640 1 --2- 172.21.15.29:0/1212686627 >> v2:172.21.15.29:3300/0 conn(0x7f12ac15bdd0 0x7f12ac15cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.480+0000 7f12ab400640 1 -- 172.21.15.29:0/1212686627 >> v1:172.21.15.29:6789/0 conn(0x7f12ac06cfa0 legacy=0x7f12ac06fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:24.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.480+0000 7f12ab400640 1 -- 172.21.15.29:0/1212686627 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac0cc450 con 0x7f12ac0cd020 2024-01-24T13:04:24.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.484+0000 7f12ab400640 1 --2- 172.21.15.29:0/1212686627 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12ac0cd020 0x7f12ac0cc8e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f12a400c2e0 tx=0x7f12a40205f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=641da07599ae3167 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.484+0000 7f12aaa00640 1 -- 172.21.15.29:0/1212686627 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a40b1680 con 0x7f12ac0cd020 2024-01-24T13:04:24.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.484+0000 7f12aaa00640 1 -- 172.21.15.29:0/1212686627 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a40b17e0 con 0x7f12ac0cd020 2024-01-24T13:04:24.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.484+0000 7f12aaa00640 1 -- 172.21.15.29:0/1212686627 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a40b1b70 con 0x7f12ac0cd020 2024-01-24T13:04:24.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.484+0000 7f12b3000640 1 -- 172.21.15.29:0/1212686627 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12ac0cd020 msgr2=0x7f12ac0cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.484+0000 7f12b3000640 1 --2- 172.21.15.29:0/1212686627 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12ac0cd020 0x7f12ac0cc8e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f12a400c2e0 tx=0x7f12a40205f0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.484+0000 7f12b3000640 1 -- 172.21.15.29:0/1212686627 shutdown_connections 2024-01-24T13:04:24.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.484+0000 7f12b3000640 1 --2- 172.21.15.29:0/1212686627 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12ac0cd020 0x7f12ac0cc8e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.484+0000 7f12b3000640 1 --2- 172.21.15.29:0/1212686627 >> v2:172.21.15.29:3300/0 conn(0x7f12ac15bdd0 0x7f12ac15cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.484+0000 7f12b3000640 1 -- 172.21.15.29:0/1212686627 >> 172.21.15.29:0/1212686627 conn(0x7f12ac0cac10 msgr2=0x7f12ac0caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.484+0000 7f12b3000640 1 -- 172.21.15.29:0/1212686627 shutdown_connections 2024-01-24T13:04:24.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.488+0000 7f12b3000640 1 -- 172.21.15.29:0/1212686627 wait complete. 2024-01-24T13:04:24.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.488+0000 7f12b3000640 1 Processor -- start 2024-01-24T13:04:24.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.488+0000 7f12b3000640 1 -- start start 2024-01-24T13:04:24.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12b3000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12ac06cfa0 0x7f12ac145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12b3000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12ac0cd020 0x7f12ac1464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12b3000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12ac15bdd0 0x7f12ac0c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12ab400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12ac0cd020 0x7f12ac1464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12ab400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12ac0cd020 0x7f12ac1464a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37328/0 (socket says 172.21.15.29:37328) 2024-01-24T13:04:24.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12abe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12ac06cfa0 0x7f12ac145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12ab400640 1 -- 172.21.15.29:0/2682480065 learned_addr learned my addr 172.21.15.29:0/2682480065 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:24.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12b3000640 1 -- 172.21.15.29:0/2682480065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac14f350 con 0x7f12ac0cd020 2024-01-24T13:04:24.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12b3000640 1 -- 172.21.15.29:0/2682480065 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac14e740 con 0x7f12ac06cfa0 2024-01-24T13:04:24.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12b3000640 1 -- 172.21.15.29:0/2682480065 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac14ea20 con 0x7f12ac15bdd0 2024-01-24T13:04:24.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12b1000640 1 --2- 172.21.15.29:0/2682480065 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12ac15bdd0 0x7f12ac0c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12ab400640 1 -- 172.21.15.29:0/2682480065 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12ac15bdd0 msgr2=0x7f12ac0c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12ab400640 1 --2- 172.21.15.29:0/2682480065 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12ac15bdd0 0x7f12ac0c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12ab400640 1 -- 172.21.15.29:0/2682480065 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12ac06cfa0 msgr2=0x7f12ac145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12ab400640 1 --2- 172.21.15.29:0/2682480065 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12ac06cfa0 0x7f12ac145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12ab400640 1 -- 172.21.15.29:0/2682480065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a400c050 con 0x7f12ac0cd020 2024-01-24T13:04:24.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.492+0000 7f12abe00640 1 --2- 172.21.15.29:0/2682480065 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12ac06cfa0 0x7f12ac145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:24.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.500+0000 7f12ab400640 1 --2- 172.21.15.29:0/2682480065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12ac0cd020 0x7f12ac1464a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f12a40b4040 tx=0x7f12a401d390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.504+0000 7f12a3e00640 1 -- 172.21.15.29:0/2682480065 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a40b1950 con 0x7f12ac0cd020 2024-01-24T13:04:24.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.504+0000 7f12a3e00640 1 -- 172.21.15.29:0/2682480065 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a40b1ab0 con 0x7f12ac0cd020 2024-01-24T13:04:24.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.504+0000 7f12a3e00640 1 -- 172.21.15.29:0/2682480065 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a40b1e60 con 0x7f12ac0cd020 2024-01-24T13:04:24.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.504+0000 7f12b3000640 1 -- 172.21.15.29:0/2682480065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ac14ed00 con 0x7f12ac0cd020 2024-01-24T13:04:24.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.504+0000 7f12b3000640 1 -- 172.21.15.29:0/2682480065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ac146240 con 0x7f12ac0cd020 2024-01-24T13:04:24.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.504+0000 7f12b3000640 1 -- 172.21.15.29:0/2682480065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ac14eb60 con 0x7f12ac0cd020 2024-01-24T13:04:24.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.508+0000 7f12a3e00640 1 -- 172.21.15.29:0/2682480065 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f12a40b8040 con 0x7f12ac0cd020 2024-01-24T13:04:24.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.508+0000 7f12a3e00640 1 --2- 172.21.15.29:0/2682480065 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1284065ab0 0x7f1284067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.512+0000 7f12a3e00640 1 -- 172.21.15.29:0/2682480065 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f12a40f2fe0 con 0x7f12ac0cd020 2024-01-24T13:04:24.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.516+0000 7f12abe00640 1 --2- 172.21.15.29:0/2682480065 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1284065ab0 0x7f1284067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.516+0000 7f12abe00640 1 --2- 172.21.15.29:0/2682480065 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1284065ab0 0x7f1284067f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f129c009cc0 tx=0x7f129c006f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.520+0000 7f12a3e00640 1 -- 172.21.15.29:0/2682480065 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f12a40ef3a0 con 0x7f12ac0cd020 2024-01-24T13:04:24.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.544+0000 7f3485000640 1 Processor -- start 2024-01-24T13:04:24.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.544+0000 7f3485000640 1 -- start start 2024-01-24T13:04:24.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.544+0000 7f3485000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f348006be40 0x7f348006c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.544+0000 7f3485000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f34800ab4f0 0x7f34800afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.544+0000 7f3485000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3480161480 con 0x7f34801610a0 2024-01-24T13:04:24.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.544+0000 7f3485000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348006c8e0 con 0x7f348006be40 2024-01-24T13:04:24.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.544+0000 7f3485000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348006cbc0 con 0x7f34800ab4f0 2024-01-24T13:04:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.548+0000 7f347e800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f34800ab4f0 0x7f34800afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.548+0000 7f347e800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f34800ab4f0 0x7f34800afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34334/0 (socket says 172.21.15.29:34334) 2024-01-24T13:04:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.548+0000 7f347e800640 1 -- 172.21.15.29:0/2633476866 learned_addr learned my addr 172.21.15.29:0/2633476866 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.548+0000 7f347d400640 1 --2- 172.21.15.29:0/2633476866 >> v2:172.21.15.29:3300/0 conn(0x7f348006be40 0x7f348006c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.548+0000 7f347e800640 1 -- 172.21.15.29:0/2633476866 >> v2:172.21.15.29:3300/0 conn(0x7f348006be40 msgr2=0x7f348006c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.548+0000 7f347e800640 1 --2- 172.21.15.29:0/2633476866 >> v2:172.21.15.29:3300/0 conn(0x7f348006be40 0x7f348006c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.548+0000 7f347e800640 1 -- 172.21.15.29:0/2633476866 >> v1:172.21.15.29:6789/0 conn(0x7f34801610a0 legacy=0x7f348015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.548+0000 7f347e800640 1 -- 172.21.15.29:0/2633476866 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34801608a0 con 0x7f34800ab4f0 2024-01-24T13:04:24.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.552+0000 7f347e800640 1 --2- 172.21.15.29:0/2633476866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34800ab4f0 0x7f34800afe80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3480161670 tx=0x7f347801c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae709076067bf9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.552+0000 7f744ca00640 1 Processor -- start 2024-01-24T13:04:24.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.552+0000 7f744ca00640 1 -- start start 2024-01-24T13:04:24.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.552+0000 7f347ca00640 1 -- 172.21.15.29:0/2633476866 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34780a5770 con 0x7f34800ab4f0 2024-01-24T13:04:24.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.552+0000 7f347ca00640 1 -- 172.21.15.29:0/2633476866 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34780a58d0 con 0x7f34800ab4f0 2024-01-24T13:04:24.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.552+0000 7f347ca00640 1 -- 172.21.15.29:0/2633476866 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34780a5c60 con 0x7f34800ab4f0 2024-01-24T13:04:24.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f3485000640 1 -- 172.21.15.29:0/2633476866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34800ab4f0 msgr2=0x7f34800afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f3485000640 1 --2- 172.21.15.29:0/2633476866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34800ab4f0 0x7f34800afe80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3480161670 tx=0x7f347801c9a0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f744ca00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f744415cdb0 0x7f74440ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f3485000640 1 -- 172.21.15.29:0/2633476866 shutdown_connections 2024-01-24T13:04:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f3485000640 1 --2- 172.21.15.29:0/2633476866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34800ab4f0 0x7f34800afe80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f3485000640 1 --2- 172.21.15.29:0/2633476866 >> v2:172.21.15.29:3300/0 conn(0x7f348006be40 0x7f348006c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f3485000640 1 -- 172.21.15.29:0/2633476866 >> 172.21.15.29:0/2633476866 conn(0x7f348006a2d0 msgr2=0x7f34800cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f744ca00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f74440b1ca0 0x7f74440ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f744ca00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744406ac10 con 0x7f74440ce610 2024-01-24T13:04:24.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f744ca00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744406aef0 con 0x7f74440b1ca0 2024-01-24T13:04:24.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f744ca00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744406b1d0 con 0x7f744415cdb0 2024-01-24T13:04:24.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f7583400640 1 Processor -- start 2024-01-24T13:04:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f7449600640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f74440ce610 0x7f74440b1590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41618/0 (socket says 172.21.15.29:41618) 2024-01-24T13:04:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f0d2b200640 1 Processor -- start 2024-01-24T13:04:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f7583400640 1 -- start start 2024-01-24T13:04:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f7449600640 1 -- 172.21.15.29:0/3527682703 learned_addr learned my addr 172.21.15.29:0/3527682703 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f744b400640 1 --2- 172.21.15.29:0/3527682703 >> v2:172.21.15.29:3300/0 conn(0x7f74440b1ca0 0x7f74440ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f744a000640 1 --2- 172.21.15.29:0/3527682703 >> v2:172.21.15.163:3300/0 conn(0x7f744415cdb0 0x7f74440ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f744a000640 1 -- 172.21.15.29:0/3527682703 >> v2:172.21.15.29:3300/0 conn(0x7f74440b1ca0 msgr2=0x7f74440ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f744a000640 1 --2- 172.21.15.29:0/3527682703 >> v2:172.21.15.29:3300/0 conn(0x7f74440b1ca0 0x7f74440ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f744a000640 1 -- 172.21.15.29:0/3527682703 >> v1:172.21.15.29:6789/0 conn(0x7f74440ce610 legacy=0x7f74440b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f744a000640 1 -- 172.21.15.29:0/3527682703 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744406b4b0 con 0x7f744415cdb0 2024-01-24T13:04:24.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f0d2b200640 1 -- start start 2024-01-24T13:04:24.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f3485000640 1 -- 172.21.15.29:0/2633476866 shutdown_connections 2024-01-24T13:04:24.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.556+0000 7f3485000640 1 -- 172.21.15.29:0/2633476866 wait complete. 2024-01-24T13:04:24.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f7583400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f757c0b5230 0x7f757c0b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f7583400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f757c0cd0b0 0x7f757c0b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f7583400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c0b17c0 con 0x7f757c0cf5c0 2024-01-24T13:04:24.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f7583400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c0cef00 con 0x7f757c0cd0b0 2024-01-24T13:04:24.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f7583400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c0ce6f0 con 0x7f757c0b5230 2024-01-24T13:04:24.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f757be00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f757c0cd0b0 0x7f757c0b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f757be00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f757c0cd0b0 0x7f757c0b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37348/0 (socket says 172.21.15.29:37348) 2024-01-24T13:04:24.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f757be00640 1 -- 172.21.15.29:0/1514328003 learned_addr learned my addr 172.21.15.29:0/1514328003 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:24.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f0d2b200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d2406d6b0 0x7f0d2415cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f3485000640 1 Processor -- start 2024-01-24T13:04:24.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f0d2b200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d240cd020 0x7f0d240cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f0d23e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0d2415bdd0 0x7f0d2406cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41634/0 (socket says 172.21.15.29:41634) 2024-01-24T13:04:24.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f0d23e00640 1 -- 172.21.15.29:0/1669927532 learned_addr learned my addr 172.21.15.29:0/1669927532 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:24.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f0d2b200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d240cda30 con 0x7f0d2415bdd0 2024-01-24T13:04:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f0d2b200640 1 -- 172.21.15.29:0/1669927532 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2415d4c0 con 0x7f0d2406d6b0 2024-01-24T13:04:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f0d29200640 1 --2- 172.21.15.29:0/1669927532 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d240cd020 0x7f0d240cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f0d2b200640 1 -- 172.21.15.29:0/1669927532 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240cce20 con 0x7f0d240cd020 2024-01-24T13:04:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f757be00640 1 -- 172.21.15.29:0/1514328003 >> v2:172.21.15.163:3300/0 conn(0x7f757c0b5230 msgr2=0x7f757c0b1c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-24T13:04:24.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.560+0000 7f3485000640 1 -- start start 2024-01-24T13:04:24.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f3485000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f348006be40 0x7f34801596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f3485000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34800ab4f0 0x7f348015d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f3485000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34801610a0 0x7f34800c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f3485000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34800c7ec0 con 0x7f34800ab4f0 2024-01-24T13:04:24.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f3485000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34800c81a0 con 0x7f34801610a0 2024-01-24T13:04:24.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f3485000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348015c6e0 con 0x7f348006be40 2024-01-24T13:04:24.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f7580a00640 1 --2- 172.21.15.29:0/1514328003 >> v2:172.21.15.163:3300/0 conn(0x7f757c0b5230 0x7f757c0b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f0d22a00640 1 -- 172.21.15.29:0/1669927532 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185184256 0 0) 0x7f0d240cda30 con 0x7f0d2415bdd0 2024-01-24T13:04:24.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f0d23400640 1 --2- 172.21.15.29:0/1669927532 >> v2:172.21.15.29:3300/0 conn(0x7f0d2406d6b0 0x7f0d2415cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f0d22a00640 1 -- 172.21.15.29:0/1669927532 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d04003530 con 0x7f0d2415bdd0 2024-01-24T13:04:24.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f347de00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f348006be40 0x7f34801596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f347e800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34801610a0 0x7f34800c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f347de00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f348006be40 0x7f34801596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53414/0 (socket says 172.21.15.29:53414) 2024-01-24T13:04:24.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f347de00640 1 -- 172.21.15.29:0/3302527256 learned_addr learned my addr 172.21.15.29:0/3302527256 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:24.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f0d29200640 1 -- 172.21.15.29:0/1669927532 >> v2:172.21.15.29:3300/0 conn(0x7f0d2406d6b0 msgr2=0x7f0d2415cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:24.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f0d29200640 1 --2- 172.21.15.29:0/1669927532 >> v2:172.21.15.29:3300/0 conn(0x7f0d2406d6b0 0x7f0d2415cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f0d29200640 1 -- 172.21.15.29:0/1669927532 >> v1:172.21.15.29:6789/0 conn(0x7f0d2415bdd0 legacy=0x7f0d2406cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f0d29200640 1 -- 172.21.15.29:0/1669927532 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d240cc450 con 0x7f0d240cd020 2024-01-24T13:04:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f347d400640 1 --2- 172.21.15.29:0/3302527256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34800ab4f0 0x7f348015d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f347de00640 1 -- 172.21.15.29:0/3302527256 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34801610a0 msgr2=0x7f34800c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f347de00640 1 --2- 172.21.15.29:0/3302527256 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34801610a0 0x7f34800c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f347de00640 1 -- 172.21.15.29:0/3302527256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34800ab4f0 msgr2=0x7f348015d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f347de00640 1 --2- 172.21.15.29:0/3302527256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34800ab4f0 0x7f348015d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f347de00640 1 -- 172.21.15.29:0/3302527256 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3478009b30 con 0x7f348006be40 2024-01-24T13:04:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f347de00640 1 --2- 172.21.15.29:0/3302527256 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f348006be40 0x7f34801596a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f346800c3c0 tx=0x7f346800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f347d400640 1 --2- 172.21.15.29:0/3302527256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34800ab4f0 0x7f348015d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f3476000640 1 -- 172.21.15.29:0/3302527256 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34680052d0 con 0x7f348006be40 2024-01-24T13:04:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f3476000640 1 -- 172.21.15.29:0/3302527256 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3468005430 con 0x7f348006be40 2024-01-24T13:04:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f3476000640 1 -- 172.21.15.29:0/3302527256 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3468003820 con 0x7f348006be40 2024-01-24T13:04:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f3485000640 1 -- 172.21.15.29:0/3302527256 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348015c9c0 con 0x7f348006be40 2024-01-24T13:04:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f3485000640 1 -- 172.21.15.29:0/3302527256 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348015dd70 con 0x7f348006be40 2024-01-24T13:04:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f757be00640 1 --2- 172.21.15.29:0/1514328003 >> v2:172.21.15.163:3300/0 conn(0x7f757c0b5230 0x7f757c0b1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f757be00640 1 -- 172.21.15.29:0/1514328003 >> v1:172.21.15.29:6789/0 conn(0x7f757c0cf5c0 legacy=0x7f757c15e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f757be00640 1 -- 172.21.15.29:0/1514328003 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c0ce940 con 0x7f757c0cd0b0 2024-01-24T13:04:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.564+0000 7f7580a00640 1 --2- 172.21.15.29:0/1514328003 >> v2:172.21.15.163:3300/0 conn(0x7f757c0b5230 0x7f757c0b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f744a000640 1 --2- 172.21.15.29:0/3527682703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f744415cdb0 0x7f74440ce0d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7444071130 tx=0x7f742c01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd0cc5a4eed803ed server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f7448c00640 1 -- 172.21.15.29:0/3527682703 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74440cd560 con 0x7f744415cdb0 2024-01-24T13:04:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f7448c00640 1 -- 172.21.15.29:0/3527682703 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c0ac620 con 0x7f744415cdb0 2024-01-24T13:04:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f7448c00640 1 -- 172.21.15.29:0/3527682703 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c0ac9b0 con 0x7f744415cdb0 2024-01-24T13:04:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f744ca00640 1 -- 172.21.15.29:0/3527682703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f744415cdb0 msgr2=0x7f74440ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f744ca00640 1 --2- 172.21.15.29:0/3527682703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f744415cdb0 0x7f74440ce0d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7444071130 tx=0x7f742c01c3a0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f3485000640 1 -- 172.21.15.29:0/3302527256 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3450005260 con 0x7f348006be40 2024-01-24T13:04:24.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f744ca00640 1 -- 172.21.15.29:0/3527682703 shutdown_connections 2024-01-24T13:04:24.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f744ca00640 1 --2- 172.21.15.29:0/3527682703 >> v2:172.21.15.29:3300/0 conn(0x7f74440b1ca0 0x7f74440ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f744ca00640 1 --2- 172.21.15.29:0/3527682703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f744415cdb0 0x7f74440ce0d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f744ca00640 1 -- 172.21.15.29:0/3527682703 >> 172.21.15.29:0/3527682703 conn(0x7f74440cc590 msgr2=0x7f74440cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f744ca00640 1 -- 172.21.15.29:0/3527682703 shutdown_connections 2024-01-24T13:04:24.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f744ca00640 1 -- 172.21.15.29:0/3527682703 wait complete. 2024-01-24T13:04:24.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f757be00640 1 --2- 172.21.15.29:0/1514328003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f757c0cd0b0 0x7f757c0b2960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f756c009870 tx=0x7f756c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453cc1f21ad03392 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f0d29200640 1 --2- 172.21.15.29:0/1669927532 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d240cd020 0x7f0d240cc8e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009d90 tx=0x7f0d1c01eb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be065a762e2399dd server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f757b400640 1 -- 172.21.15.29:0/1514328003 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c004230 con 0x7f757c0cd0b0 2024-01-24T13:04:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f757b400640 1 -- 172.21.15.29:0/1514328003 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c0a7050 con 0x7f757c0cd0b0 2024-01-24T13:04:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f757b400640 1 -- 172.21.15.29:0/1514328003 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c003620 con 0x7f757c0cd0b0 2024-01-24T13:04:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7932a00640 1 Processor -- start 2024-01-24T13:04:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f9ffc400640 1 Processor -- start 2024-01-24T13:04:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f9ffc400640 1 -- start start 2024-01-24T13:04:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7583400640 1 -- 172.21.15.29:0/1514328003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f757c0cd0b0 msgr2=0x7f757c0b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7583400640 1 --2- 172.21.15.29:0/1514328003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f757c0cd0b0 0x7f757c0b2960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f756c009870 tx=0x7f756c01c440 comp rx=0 tx=0).stop 2024-01-24T13:04:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.568+0000 7f3476000640 1 -- 172.21.15.29:0/3302527256 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3468003980 con 0x7f348006be40 2024-01-24T13:04:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f3476000640 1 --2- 172.21.15.29:0/3302527256 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3458065a60 0x7f3458067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f3476000640 1 -- 172.21.15.29:0/3302527256 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3468082a00 con 0x7f348006be40 2024-01-24T13:04:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7932a00640 1 -- start start 2024-01-24T13:04:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7583400640 1 -- 172.21.15.29:0/1514328003 shutdown_connections 2024-01-24T13:04:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7583400640 1 --2- 172.21.15.29:0/1514328003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f757c0cd0b0 0x7f757c0b2960 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7583400640 1 --2- 172.21.15.29:0/1514328003 >> v2:172.21.15.163:3300/0 conn(0x7f757c0b5230 0x7f757c0b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7583400640 1 -- 172.21.15.29:0/1514328003 >> 172.21.15.29:0/1514328003 conn(0x7f757c0cc590 msgr2=0x7f757c0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f347d400640 1 --2- 172.21.15.29:0/3302527256 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3458065a60 0x7f3458067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f744ca00640 1 Processor -- start 2024-01-24T13:04:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7583400640 1 -- 172.21.15.29:0/1514328003 shutdown_connections 2024-01-24T13:04:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7583400640 1 -- 172.21.15.29:0/1514328003 wait complete. 2024-01-24T13:04:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7932a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f792c0cb700 0x7f792c15cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7932a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f792c0cd020 0x7f792c0cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f744ca00640 1 -- start start 2024-01-24T13:04:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7932a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792c0cda30 con 0x7f792c15bd40 2024-01-24T13:04:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7932a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792c15d4c0 con 0x7f792c0cd020 2024-01-24T13:04:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7932a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0cce20 con 0x7f792c0cb700 2024-01-24T13:04:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7930a00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f792c15bd40 0x7f792c06cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:35964/0 (socket says 172.21.15.29:35964) 2024-01-24T13:04:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f7930a00640 1 -- 172.21.15.29:0/778450520 learned_addr learned my addr 172.21.15.29:0/778450520 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f792be00640 1 --2- 172.21.15.29:0/778450520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f792c0cb700 0x7f792c15cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f9ffc400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ff40cd020 0x7f9ff415cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f9ffc400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff40cda30 con 0x7f9ff406d6b0 2024-01-24T13:04:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f9ffc400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff40cc450 con 0x7f9ff415bdd0 2024-01-24T13:04:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f9ffc400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff415d4c0 con 0x7f9ff40cd020 2024-01-24T13:04:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f792b400640 1 --2- 172.21.15.29:0/778450520 >> v2:172.21.15.163:3300/0 conn(0x7f792c0cd020 0x7f792c0cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f9ff9000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9ff406d6b0 0x7f9ff406fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41650/0 (socket says 172.21.15.29:41650) 2024-01-24T13:04:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f9ff9000640 1 -- 172.21.15.29:0/4155657947 learned_addr learned my addr 172.21.15.29:0/4155657947 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f792be00640 1 -- 172.21.15.29:0/778450520 >> v2:172.21.15.163:3300/0 conn(0x7f792c0cd020 msgr2=0x7f792c0cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.572+0000 7f792be00640 1 --2- 172.21.15.29:0/778450520 >> v2:172.21.15.163:3300/0 conn(0x7f792c0cd020 0x7f792c0cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f792be00640 1 -- 172.21.15.29:0/778450520 >> v1:172.21.15.163:6789/0 conn(0x7f792c15bd40 legacy=0x7f792c06cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f792be00640 1 -- 172.21.15.29:0/778450520 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c0cc450 con 0x7f792c0cb700 2024-01-24T13:04:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f9ffa400640 1 --2- 172.21.15.29:0/4155657947 >> v2:172.21.15.29:3300/0 conn(0x7f9ff40cd020 0x7f9ff415cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f9ff3e00640 1 -- 172.21.15.29:0/4155657947 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314675723 0 0) 0x7f9ff40cc450 con 0x7f9ff415bdd0 2024-01-24T13:04:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f7583400640 1 Processor -- start 2024-01-24T13:04:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f0d22a00640 1 -- 172.21.15.29:0/1669927532 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c0a7c10 con 0x7f0d240cd020 2024-01-24T13:04:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f9ffa400640 1 -- 172.21.15.29:0/4155657947 >> v1:172.21.15.163:6789/0 conn(0x7f9ff415bdd0 legacy=0x7f9ff406cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f9ffa400640 1 -- 172.21.15.29:0/4155657947 >> v1:172.21.15.29:6789/0 conn(0x7f9ff406d6b0 legacy=0x7f9ff406fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f9ffa400640 1 -- 172.21.15.29:0/4155657947 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff40cdf60 con 0x7f9ff40cd020 2024-01-24T13:04:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f0d22a00640 1 -- 172.21.15.29:0/1669927532 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c0a7d70 con 0x7f0d240cd020 2024-01-24T13:04:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f0d22a00640 1 -- 172.21.15.29:0/1669927532 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c0af660 con 0x7f0d240cd020 2024-01-24T13:04:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f347d400640 1 --2- 172.21.15.29:0/3302527256 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3458065a60 0x7f3458067f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f34801605b0 tx=0x7f3470008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f744ca00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74440b1ca0 0x7f74440ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f744ca00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74440ce610 0x7f744415af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f7583400640 1 -- start start 2024-01-24T13:04:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f3476000640 1 -- 172.21.15.29:0/3302527256 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3468050050 con 0x7f348006be40 2024-01-24T13:04:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f0d2b200640 1 -- 172.21.15.29:0/1669927532 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d240cd020 msgr2=0x7f0d240cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f0d2b200640 1 --2- 172.21.15.29:0/1669927532 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d240cd020 0x7f0d240cc8e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009d90 tx=0x7f0d1c01eb60 comp rx=0 tx=0).stop 2024-01-24T13:04:24.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f744ca00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f744415b450 0x7f74440c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f7449600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74440ce610 0x7f744415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f744b400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f744415b450 0x7f74440c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f7449600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74440ce610 0x7f744415af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34388/0 (socket says 172.21.15.29:34388) 2024-01-24T13:04:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f7449600640 1 -- 172.21.15.29:0/2293686215 learned_addr learned my addr 172.21.15.29:0/2293686215 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f744ca00640 1 -- 172.21.15.29:0/2293686215 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7444154200 con 0x7f74440b1ca0 2024-01-24T13:04:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f744ca00640 1 -- 172.21.15.29:0/2293686215 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74440ae790 con 0x7f74440ce610 2024-01-24T13:04:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f744ca00640 1 -- 172.21.15.29:0/2293686215 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7444154450 con 0x7f744415b450 2024-01-24T13:04:24.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f0d2b200640 1 -- 172.21.15.29:0/1669927532 shutdown_connections 2024-01-24T13:04:24.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f0d2b200640 1 --2- 172.21.15.29:0/1669927532 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d240cd020 0x7f0d240cc8e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f0d2b200640 1 --2- 172.21.15.29:0/1669927532 >> v2:172.21.15.29:3300/0 conn(0x7f0d2406d6b0 0x7f0d2415cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.576+0000 7f0d2b200640 1 -- 172.21.15.29:0/1669927532 >> 172.21.15.29:0/1669927532 conn(0x7f0d240cac10 msgr2=0x7f0d240caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f744a000640 1 --2- 172.21.15.29:0/2293686215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74440b1ca0 0x7f74440ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f744a000640 1 -- 172.21.15.29:0/2293686215 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f744415b450 msgr2=0x7f74440c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f744a000640 1 --2- 172.21.15.29:0/2293686215 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f744415b450 0x7f74440c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f744a000640 1 -- 172.21.15.29:0/2293686215 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74440ce610 msgr2=0x7f744415af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f744a000640 1 --2- 172.21.15.29:0/2293686215 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74440ce610 0x7f744415af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f744a000640 1 -- 172.21.15.29:0/2293686215 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c009420 con 0x7f74440b1ca0 2024-01-24T13:04:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f744a000640 1 --2- 172.21.15.29:0/2293686215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74440b1ca0 0x7f74440ae250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f742c0ac000 tx=0x7f742c019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7442000640 1 -- 172.21.15.29:0/2293686215 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c0b5400 con 0x7f74440b1ca0 2024-01-24T13:04:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7442000640 1 -- 172.21.15.29:0/2293686215 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c0b5560 con 0x7f74440b1ca0 2024-01-24T13:04:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f744ca00640 1 -- 172.21.15.29:0/2293686215 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7444154730 con 0x7f74440b1ca0 2024-01-24T13:04:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f744ca00640 1 -- 172.21.15.29:0/2293686215 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7444154cf0 con 0x7f74440b1ca0 2024-01-24T13:04:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7442000640 1 -- 172.21.15.29:0/2293686215 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c0b5910 con 0x7f74440b1ca0 2024-01-24T13:04:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f0d2b200640 1 -- 172.21.15.29:0/1669927532 shutdown_connections 2024-01-24T13:04:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f0d2b200640 1 -- 172.21.15.29:0/1669927532 wait complete. 2024-01-24T13:04:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f0d2b200640 1 Processor -- start 2024-01-24T13:04:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f792be00640 1 --2- 172.21.15.29:0/778450520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f792c0cb700 0x7f792c15cf80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f791c0097c0 tx=0x7f791c01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=def2055ccab7990f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f792aa00640 1 -- 172.21.15.29:0/778450520 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c0ab600 con 0x7f792c0cb700 2024-01-24T13:04:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f792aa00640 1 -- 172.21.15.29:0/778450520 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c0a7050 con 0x7f792c0cb700 2024-01-24T13:04:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f792aa00640 1 -- 172.21.15.29:0/778450520 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c0ab600 con 0x7f792c0cb700 2024-01-24T13:04:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7932a00640 1 -- 172.21.15.29:0/778450520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f792c0cb700 msgr2=0x7f792c15cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7932a00640 1 --2- 172.21.15.29:0/778450520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f792c0cb700 0x7f792c15cf80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f791c0097c0 tx=0x7f791c01c3a0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7583400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f757c0b5230 0x7f757c14cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7583400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f757c0cd0b0 0x7f757c15c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7580a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f757c0b5230 0x7f757c14cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7580a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f757c0b5230 0x7f757c14cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53430/0 (socket says 172.21.15.29:53430) 2024-01-24T13:04:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7580a00640 1 -- 172.21.15.29:0/505637443 learned_addr learned my addr 172.21.15.29:0/505637443 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7583400640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f757c0cf5c0 0x7f757c0ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f757be00640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f757c0cd0b0 0x7f757c15c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7583400640 1 -- 172.21.15.29:0/505637443 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c15d910 con 0x7f757c0cd0b0 2024-01-24T13:04:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7583400640 1 -- 172.21.15.29:0/505637443 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c15cd00 con 0x7f757c0cf5c0 2024-01-24T13:04:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7581e00640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f757c0cf5c0 0x7f757c0ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7583400640 1 -- 172.21.15.29:0/505637443 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c15cfe0 con 0x7f757c0b5230 2024-01-24T13:04:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7932a00640 1 -- 172.21.15.29:0/778450520 shutdown_connections 2024-01-24T13:04:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7932a00640 1 --2- 172.21.15.29:0/778450520 >> v2:172.21.15.163:3300/0 conn(0x7f792c0cd020 0x7f792c0cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7932a00640 1 --2- 172.21.15.29:0/778450520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f792c0cb700 0x7f792c15cf80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f0d2b200640 1 -- start start 2024-01-24T13:04:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7932a00640 1 -- 172.21.15.29:0/778450520 >> 172.21.15.29:0/778450520 conn(0x7f792c0cac10 msgr2=0x7f792c0caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7580a00640 1 -- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f757c0cf5c0 msgr2=0x7f757c0ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7580a00640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f757c0cf5c0 0x7f757c0ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7580a00640 1 -- 172.21.15.29:0/505637443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f757c0cd0b0 msgr2=0x7f757c15c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f744ca00640 1 -- 172.21.15.29:0/2293686215 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74440cf4a0 con 0x7f74440b1ca0 2024-01-24T13:04:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7580a00640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f757c0cd0b0 0x7f757c15c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.580+0000 7f7580a00640 1 -- 172.21.15.29:0/505637443 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c0094d0 con 0x7f757c0b5230 2024-01-24T13:04:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f9ffa400640 1 --2- 172.21.15.29:0/4155657947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ff40cd020 0x7f9ff415cf80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009d90 tx=0x7f9fec01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fe6333284d769b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f7580a00640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f757c0b5230 0x7f757c14cbb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f757400cf60 tx=0x7f757400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f7578c00640 1 -- 172.21.15.29:0/505637443 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400d840 con 0x7f757c0b5230 2024-01-24T13:04:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f7583400640 1 -- 172.21.15.29:0/505637443 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c15d2c0 con 0x7f757c0b5230 2024-01-24T13:04:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f7583400640 1 -- 172.21.15.29:0/505637443 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c155780 con 0x7f757c0b5230 2024-01-24T13:04:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f7578c00640 1 -- 172.21.15.29:0/505637443 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757400d9a0 con 0x7f757c0b5230 2024-01-24T13:04:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f7578c00640 1 -- 172.21.15.29:0/505637443 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400dd10 con 0x7f757c0b5230 2024-01-24T13:04:24.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f0d2b200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d2406d6b0 0x7f0d24162f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f0d2b200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d240cd020 0x7f0d2414e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f7442000640 1 -- 172.21.15.29:0/2293686215 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f742c0b3040 con 0x7f74440b1ca0 2024-01-24T13:04:24.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f7932a00640 1 -- 172.21.15.29:0/778450520 shutdown_connections 2024-01-24T13:04:24.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f0d23e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d2406d6b0 0x7f0d24162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f0d23e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d2406d6b0 0x7f0d24162f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53438/0 (socket says 172.21.15.29:53438) 2024-01-24T13:04:24.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f0d2b200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d2415bdd0 0x7f0d24151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f0d2b200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24071840 con 0x7f0d240cd020 2024-01-24T13:04:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f0d2b200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d241634b0 con 0x7f0d2415bdd0 2024-01-24T13:04:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f0d2b200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2414d830 con 0x7f0d2406d6b0 2024-01-24T13:04:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f0d23400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d240cd020 0x7f0d2414e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f0d23400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d240cd020 0x7f0d2414e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37410/0 (socket says 172.21.15.29:37410) 2024-01-24T13:04:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f0d23400640 1 -- 172.21.15.29:0/952238252 learned_addr learned my addr 172.21.15.29:0/952238252 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f0d29200640 1 --2- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d2415bdd0 0x7f0d24151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f0d29200640 1 -- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d2406d6b0 msgr2=0x7f0d24162f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f0d29200640 1 --2- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d2406d6b0 0x7f0d24162f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f0d29200640 1 -- 172.21.15.29:0/952238252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d240cd020 msgr2=0x7f0d2414e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f0d29200640 1 --2- 172.21.15.29:0/952238252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d240cd020 0x7f0d2414e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f0d29200640 1 -- 172.21.15.29:0/952238252 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c009a70 con 0x7f0d2415bdd0 2024-01-24T13:04:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f0d23e00640 1 --2- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d2406d6b0 0x7f0d24162f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-01-24T13:04:24.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.584+0000 7f7932a00640 1 -- 172.21.15.29:0/778450520 wait complete. 2024-01-24T13:04:24.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f7442000640 1 --2- 172.21.15.29:0/2293686215 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f741c065a90 0x7f741c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f0d29200640 1 --2- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d2415bdd0 0x7f0d24151290 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0ae000 tx=0x7f0d1c01b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f7442000640 1 -- 172.21.15.29:0/2293686215 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f742c11da20 con 0x7f74440b1ca0 2024-01-24T13:04:24.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f7449600640 1 --2- 172.21.15.29:0/2293686215 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f741c065a90 0x7f741c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f0d1be00640 1 -- 172.21.15.29:0/952238252 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c0bd070 con 0x7f0d2415bdd0 2024-01-24T13:04:24.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f0d1be00640 1 -- 172.21.15.29:0/952238252 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c009450 con 0x7f0d2415bdd0 2024-01-24T13:04:24.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f7932a00640 1 Processor -- start 2024-01-24T13:04:24.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f7932a00640 1 -- start start 2024-01-24T13:04:24.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f0d1be00640 1 -- 172.21.15.29:0/952238252 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c0a7c10 con 0x7f0d2415bdd0 2024-01-24T13:04:24.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f0d2b200640 1 -- 172.21.15.29:0/952238252 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2414db10 con 0x7f0d2415bdd0 2024-01-24T13:04:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f0d2b200640 1 -- 172.21.15.29:0/952238252 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2414e0d0 con 0x7f0d2415bdd0 2024-01-24T13:04:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7932a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f792c0cb700 0x7f792c1fe790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7932a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f792c0cd020 0x7f792c1e78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.588+0000 7f7578c00640 1 -- 172.21.15.29:0/505637443 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7574015440 con 0x7f757c0b5230 2024-01-24T13:04:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7583400640 1 -- 172.21.15.29:0/505637443 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754c005260 con 0x7f757c0b5230 2024-01-24T13:04:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7578c00640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7554065b60 0x7f7554068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7578c00640 1 -- 172.21.15.29:0/505637443 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7574083f30 con 0x7f757c0b5230 2024-01-24T13:04:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7932a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f792c15bd40 0x7f792c1e7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7932a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c157a90 con 0x7f792c0cb700 2024-01-24T13:04:24.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7932a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c15a9c0 con 0x7f792c0cd020 2024-01-24T13:04:24.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7932a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c15af80 con 0x7f792c15bd40 2024-01-24T13:04:24.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f792b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f792c0cd020 0x7f792c1e78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f792b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f792c0cd020 0x7f792c1e78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34424/0 (socket says 172.21.15.29:34424) 2024-01-24T13:04:24.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f792b400640 1 -- 172.21.15.29:0/2479531803 learned_addr learned my addr 172.21.15.29:0/2479531803 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:24.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7930a00640 1 --2- 172.21.15.29:0/2479531803 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f792c15bd40 0x7f792c1e7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f792be00640 1 --2- 172.21.15.29:0/2479531803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f792c0cb700 0x7f792c1fe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f757be00640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7554065b60 0x7f7554068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f792b400640 1 -- 172.21.15.29:0/2479531803 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f792c15bd40 msgr2=0x7f792c1e7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f792b400640 1 --2- 172.21.15.29:0/2479531803 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f792c15bd40 0x7f792c1e7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f792b400640 1 -- 172.21.15.29:0/2479531803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f792c0cb700 msgr2=0x7f792c1fe790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f792b400640 1 --2- 172.21.15.29:0/2479531803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f792c0cb700 0x7f792c1fe790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f9ff3e00640 1 -- 172.21.15.29:0/4155657947 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0af600 con 0x7f9ff40cd020 2024-01-24T13:04:24.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f792b400640 1 -- 172.21.15.29:0/2479531803 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c009420 con 0x7f792c0cd020 2024-01-24T13:04:24.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f9ff3e00640 1 -- 172.21.15.29:0/4155657947 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec0ab050 con 0x7f9ff40cd020 2024-01-24T13:04:24.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f0d19600640 1 -- 172.21.15.29:0/952238252 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec005260 con 0x7f0d2415bdd0 2024-01-24T13:04:24.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f9ff3e00640 1 -- 172.21.15.29:0/4155657947 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0af980 con 0x7f9ff40cd020 2024-01-24T13:04:24.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7442000640 1 -- 172.21.15.29:0/2293686215 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f742c0eb210 con 0x7f74440b1ca0 2024-01-24T13:04:24.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7449600640 1 --2- 172.21.15.29:0/2293686215 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f741c065a90 0x7f741c067f50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f744415c510 tx=0x7f743c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f757be00640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7554065b60 0x7f7554068020 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f756c0ad000 tx=0x7f756c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f792b400640 1 --2- 172.21.15.29:0/2479531803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f792c0cd020 0x7f792c1e78b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f791400e960 tx=0x7f791400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7923e00640 1 -- 172.21.15.29:0/2479531803 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914009690 con 0x7f792c0cd020 2024-01-24T13:04:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7923e00640 1 -- 172.21.15.29:0/2479531803 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791400ca00 con 0x7f792c0cd020 2024-01-24T13:04:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7923e00640 1 -- 172.21.15.29:0/2479531803 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791400cd70 con 0x7f792c0cd020 2024-01-24T13:04:24.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7932a00640 1 -- 172.21.15.29:0/2479531803 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c15b410 con 0x7f792c0cd020 2024-01-24T13:04:24.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f9ffc400640 1 -- 172.21.15.29:0/4155657947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ff40cd020 msgr2=0x7f9ff415cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f9ffc400640 1 --2- 172.21.15.29:0/4155657947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ff40cd020 0x7f9ff415cf80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009d90 tx=0x7f9fec01f150 comp rx=0 tx=0).stop 2024-01-24T13:04:24.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f7932a00640 1 -- 172.21.15.29:0/2479531803 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792c1577b0 con 0x7f792c0cd020 2024-01-24T13:04:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f9ffc400640 1 -- 172.21.15.29:0/4155657947 shutdown_connections 2024-01-24T13:04:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f9ffc400640 1 --2- 172.21.15.29:0/4155657947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ff40cd020 0x7f9ff415cf80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.592+0000 7f9ffc400640 1 -- 172.21.15.29:0/4155657947 >> 172.21.15.29:0/4155657947 conn(0x7f9ff40cac10 msgr2=0x7f9ff40caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.596+0000 7f9ffc400640 1 -- 172.21.15.29:0/4155657947 shutdown_connections 2024-01-24T13:04:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.596+0000 7f9ffc400640 1 -- 172.21.15.29:0/4155657947 wait complete. 2024-01-24T13:04:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.596+0000 7f0d1be00640 1 -- 172.21.15.29:0/952238252 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0d1c0b6070 con 0x7f0d2415bdd0 2024-01-24T13:04:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.596+0000 7f7932a00640 1 -- 172.21.15.29:0/2479531803 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc005260 con 0x7f792c0cd020 2024-01-24T13:04:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.596+0000 7f0d1be00640 1 --2- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0cfc065b30 0x7f0cfc067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.596+0000 7f0d1be00640 1 -- 172.21.15.29:0/952238252 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d1c11d8d0 con 0x7f0d2415bdd0 2024-01-24T13:04:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.596+0000 7f9ffc400640 1 Processor -- start 2024-01-24T13:04:24.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.596+0000 7f7923e00640 1 -- 172.21.15.29:0/2479531803 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7914013470 con 0x7f792c0cd020 2024-01-24T13:04:24.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.596+0000 7f9ffc400640 1 -- start start 2024-01-24T13:04:24.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.596+0000 7f7578c00640 1 -- 172.21.15.29:0/505637443 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f757401a080 con 0x7f757c0b5230 2024-01-24T13:04:24.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f0d23e00640 1 --2- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0cfc065b30 0x7f0cfc067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f0d23e00640 1 --2- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0cfc065b30 0x7f0cfc067ff0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0011f0 tx=0x7f0d0c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f9ffc400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ff406d6b0 0x7f9ff4148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f7923e00640 1 --2- 172.21.15.29:0/2479531803 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7904065b30 0x7f7904067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f7923e00640 1 -- 172.21.15.29:0/2479531803 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79140835d0 con 0x7f792c0cd020 2024-01-24T13:04:24.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f9ffc400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ff40cd020 0x7f9ff4165140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f9ff9a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ff406d6b0 0x7f9ff4148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f9ff9a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ff406d6b0 0x7f9ff4148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37414/0 (socket says 172.21.15.29:37414) 2024-01-24T13:04:24.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f9ff9a00640 1 -- 172.21.15.29:0/3047777725 learned_addr learned my addr 172.21.15.29:0/3047777725 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f792be00640 1 --2- 172.21.15.29:0/2479531803 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7904065b30 0x7f7904067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f9ffc400640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ff415bdd0 0x7f9ff4165680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f0d1be00640 1 -- 172.21.15.29:0/952238252 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f0d1c0eb050 con 0x7f0d2415bdd0 2024-01-24T13:04:24.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f9ff9000640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ff40cd020 0x7f9ff4165140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f9ffc400640 1 -- 172.21.15.29:0/3047777725 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff40c2fa0 con 0x7f9ff406d6b0 2024-01-24T13:04:24.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f9ffc400640 1 -- 172.21.15.29:0/3047777725 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff4148eb0 con 0x7f9ff415bdd0 2024-01-24T13:04:24.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f792be00640 1 --2- 172.21.15.29:0/2479531803 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7904065b30 0x7f7904067ff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f791c0ad000 tx=0x7f791c0a4f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.600+0000 7f9ffa400640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ff415bdd0 0x7f9ff4165680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f9ffc400640 1 -- 172.21.15.29:0/3047777725 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff4153890 con 0x7f9ff40cd020 2024-01-24T13:04:24.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f9ff9a00640 1 -- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ff40cd020 msgr2=0x7f9ff4165140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f9ff9a00640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ff40cd020 0x7f9ff4165140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f9ff9a00640 1 -- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ff415bdd0 msgr2=0x7f9ff4165680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f9ff9a00640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ff415bdd0 0x7f9ff4165680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f9ff9a00640 1 -- 172.21.15.29:0/3047777725 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec009a70 con 0x7f9ff406d6b0 2024-01-24T13:04:24.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f9ff9000640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ff40cd020 0x7f9ff4165140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:24.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f9ffa400640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ff415bdd0 0x7f9ff4165680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:24.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f9ff9a00640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ff406d6b0 0x7f9ff4148970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4001ec0 tx=0x7f9fe400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f9ff1600640 1 -- 172.21.15.29:0/3047777725 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40054e0 con 0x7f9ff406d6b0 2024-01-24T13:04:24.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f7923e00640 1 -- 172.21.15.29:0/2479531803 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7914050d30 con 0x7f792c0cd020 2024-01-24T13:04:24.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f9ff1600640 1 -- 172.21.15.29:0/3047777725 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe4003600 con 0x7f9ff406d6b0 2024-01-24T13:04:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f9ffc400640 1 -- 172.21.15.29:0/3047777725 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff40c2950 con 0x7f9ff406d6b0 2024-01-24T13:04:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f9ffc400640 1 -- 172.21.15.29:0/3047777725 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff4153b70 con 0x7f9ff406d6b0 2024-01-24T13:04:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.604+0000 7f9ff1600640 1 -- 172.21.15.29:0/3047777725 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40039b0 con 0x7f9ff406d6b0 2024-01-24T13:04:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.608+0000 7f9ffc400640 1 -- 172.21.15.29:0/3047777725 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc4005260 con 0x7f9ff406d6b0 2024-01-24T13:04:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.612+0000 7f9ff1600640 1 -- 172.21.15.29:0/3047777725 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9fe4003b10 con 0x7f9ff406d6b0 2024-01-24T13:04:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.612+0000 7f9ff1600640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9fcc065a60 0x7f9fcc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.612+0000 7f9ff1600640 1 -- 172.21.15.29:0/3047777725 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9fe4082e00 con 0x7f9ff406d6b0 2024-01-24T13:04:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.612+0000 7f9ff9000640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9fcc065a60 0x7f9fcc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.620+0000 7f9ff9000640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9fcc065a60 0x7f9fcc067f20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4166220 tx=0x7f9fdc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.620+0000 7f9ff1600640 1 -- 172.21.15.29:0/3047777725 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9fe4050540 con 0x7f9ff406d6b0 2024-01-24T13:04:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.636+0000 7f1d99000640 1 Processor -- start 2024-01-24T13:04:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.636+0000 7f1d99000640 1 -- start start 2024-01-24T13:04:24.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d99000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d94071720 0x7f1d94070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d99000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1d94089860 0x7f1d9406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d99000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d94071cc0 con 0x7f1d9406d5b0 2024-01-24T13:04:24.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d99000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d94071fa0 con 0x7f1d94089860 2024-01-24T13:04:24.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d99000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940b10c0 con 0x7f1d94071720 2024-01-24T13:04:24.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d93400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d94071720 0x7f1d94070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d93400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d94071720 0x7f1d94070ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53454/0 (socket says 172.21.15.29:53454) 2024-01-24T13:04:24.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d93400640 1 -- 172.21.15.29:0/2680512003 learned_addr learned my addr 172.21.15.29:0/2680512003 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:24.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d92a00640 1 --2- 172.21.15.29:0/2680512003 >> v2:172.21.15.163:3300/0 conn(0x7f1d94089860 0x7f1d9406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d92000640 1 -- 172.21.15.29:0/2680512003 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544504766 0 0) 0x7f1d94071cc0 con 0x7f1d9406d5b0 2024-01-24T13:04:24.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d92a00640 1 -- 172.21.15.29:0/2680512003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d94071720 msgr2=0x7f1d94070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:24.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d92a00640 1 --2- 172.21.15.29:0/2680512003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d94071720 0x7f1d94070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d92a00640 1 -- 172.21.15.29:0/2680512003 >> v1:172.21.15.163:6789/0 conn(0x7f1d9406d5b0 legacy=0x7f1d940cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d92a00640 1 -- 172.21.15.29:0/2680512003 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d940b12d0 con 0x7f1d94089860 2024-01-24T13:04:24.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.640+0000 7f1d93400640 1 --2- 172.21.15.29:0/2680512003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d94071720 0x7f1d94070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:24.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.648+0000 7f1d92a00640 1 --2- 172.21.15.29:0/2680512003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d94089860 0x7f1d9406d070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009d90 tx=0x7f1d8c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bea3af75de1cead9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.648+0000 7f1d92000640 1 -- 172.21.15.29:0/2680512003 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0a5920 con 0x7f1d94089860 2024-01-24T13:04:24.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.648+0000 7f1d92000640 1 -- 172.21.15.29:0/2680512003 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c0a5a80 con 0x7f1d94089860 2024-01-24T13:04:24.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.648+0000 7f1d92000640 1 -- 172.21.15.29:0/2680512003 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0a5e10 con 0x7f1d94089860 2024-01-24T13:04:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.648+0000 7f1d99000640 1 -- 172.21.15.29:0/2680512003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d94089860 msgr2=0x7f1d9406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.648+0000 7f1d99000640 1 --2- 172.21.15.29:0/2680512003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d94089860 0x7f1d9406d070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009d90 tx=0x7f1d8c01c970 comp rx=0 tx=0).stop 2024-01-24T13:04:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.648+0000 7f1d99000640 1 -- 172.21.15.29:0/2680512003 shutdown_connections 2024-01-24T13:04:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.648+0000 7f1d99000640 1 --2- 172.21.15.29:0/2680512003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d94089860 0x7f1d9406d070 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.648+0000 7f1d99000640 1 --2- 172.21.15.29:0/2680512003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d94071720 0x7f1d94070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.648+0000 7f1d99000640 1 -- 172.21.15.29:0/2680512003 >> 172.21.15.29:0/2680512003 conn(0x7f1d940afdc0 msgr2=0x7f1d940b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.652+0000 7f1d99000640 1 -- 172.21.15.29:0/2680512003 shutdown_connections 2024-01-24T13:04:24.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.652+0000 7f1d99000640 1 -- 172.21.15.29:0/2680512003 wait complete. 2024-01-24T13:04:24.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.652+0000 7f1d99000640 1 Processor -- start 2024-01-24T13:04:24.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.652+0000 7f1d99000640 1 -- start start 2024-01-24T13:04:24.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.656+0000 7f1d99000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d9406d5b0 0x7f1d940c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.656+0000 7f1d99000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d94071720 0x7f1d9415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.656+0000 7f1d99000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d94089860 0x7f1d94088ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.656+0000 7f1d93400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d9406d5b0 0x7f1d940c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.656+0000 7f1d93e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d94089860 0x7f1d94088ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.656+0000 7f1d92a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d94071720 0x7f1d9415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.656+0000 7f1d92a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d94071720 0x7f1d9415bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:53466/0 (socket says 172.21.15.29:53466) 2024-01-24T13:04:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.656+0000 7f1d93e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d94089860 0x7f1d94088ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37430/0 (socket says 172.21.15.29:37430) 2024-01-24T13:04:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.656+0000 7f1d99000640 1 -- 172.21.15.29:0/206146323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9415e3b0 con 0x7f1d94089860 2024-01-24T13:04:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.656+0000 7f1d92a00640 1 -- 172.21.15.29:0/206146323 learned_addr learned my addr 172.21.15.29:0/206146323 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.656+0000 7f1d99000640 1 -- 172.21.15.29:0/206146323 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9415ef30 con 0x7f1d9406d5b0 2024-01-24T13:04:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.656+0000 7f1d99000640 1 -- 172.21.15.29:0/206146323 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9415c200 con 0x7f1d94071720 2024-01-24T13:04:24.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.656+0000 7f1d93400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d9406d5b0 0x7f1d940c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34456/0 (socket says 172.21.15.29:34456) 2024-01-24T13:04:24.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.660+0000 7f1d93e00640 1 -- 172.21.15.29:0/206146323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d94071720 msgr2=0x7f1d9415bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.660+0000 7f1d93e00640 1 --2- 172.21.15.29:0/206146323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d94071720 0x7f1d9415bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.660+0000 7f1d93e00640 1 -- 172.21.15.29:0/206146323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d9406d5b0 msgr2=0x7f1d940c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.660+0000 7f1d93e00640 1 --2- 172.21.15.29:0/206146323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d9406d5b0 0x7f1d940c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.660+0000 7f1d93e00640 1 -- 172.21.15.29:0/206146323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d840094d0 con 0x7f1d94089860 2024-01-24T13:04:24.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.660+0000 7f1d93e00640 1 --2- 172.21.15.29:0/206146323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d94089860 0x7f1d94088ad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00c3e0 tx=0x7f1d7c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.660+0000 7f1d92a00640 1 --2- 172.21.15.29:0/206146323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d94071720 0x7f1d9415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.660+0000 7f1d8b400640 1 -- 172.21.15.29:0/206146323 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0054e0 con 0x7f1d94089860 2024-01-24T13:04:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.660+0000 7f1d8b400640 1 -- 172.21.15.29:0/206146323 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c003600 con 0x7f1d94089860 2024-01-24T13:04:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.660+0000 7f1d8b400640 1 -- 172.21.15.29:0/206146323 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c003a10 con 0x7f1d94089860 2024-01-24T13:04:24.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.660+0000 7f1d99000640 1 -- 172.21.15.29:0/206146323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c009a70 con 0x7f1d94089860 2024-01-24T13:04:24.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.664+0000 7f1d99000640 1 -- 172.21.15.29:0/206146323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d94089e40 con 0x7f1d94089860 2024-01-24T13:04:24.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.664+0000 7f1d99000640 1 -- 172.21.15.29:0/206146323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9404e850 con 0x7f1d94089860 2024-01-24T13:04:24.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.668+0000 7f1d8b400640 1 -- 172.21.15.29:0/206146323 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1d7c003b70 con 0x7f1d94089860 2024-01-24T13:04:24.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.668+0000 7f1d8b400640 1 --2- 172.21.15.29:0/206146323 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1d6c065a90 0x7f1d6c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:24.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.668+0000 7f1d8b400640 1 -- 172.21.15.29:0/206146323 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d7c003e20 con 0x7f1d94089860 2024-01-24T13:04:24.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.668+0000 7f1d93400640 1 --2- 172.21.15.29:0/206146323 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1d6c065a90 0x7f1d6c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:24.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.672+0000 7f1d93400640 1 --2- 172.21.15.29:0/206146323 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1d6c065a90 0x7f1d6c067f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009c70 tx=0x7f1d84008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:24.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.680+0000 7f1d8b400640 1 -- 172.21.15.29:0/206146323 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1d7c0507e0 con 0x7f1d94089860 2024-01-24T13:04:24.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.856+0000 7f12b3000640 1 -- 172.21.15.29:0/2682480065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f12ac14eb60 con 0x7f12ac0cd020 2024-01-24T13:04:24.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.856+0000 7f12a3e00640 1 -- 172.21.15.29:0/2682480065 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12ac14eb60 con 0x7f12ac0cd020 2024-01-24T13:04:24.860 INFO:teuthology.orchestra.run.smithi029.stdout:64424509452 2024-01-24T13:04:24.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.860+0000 7f12b3000640 1 -- 172.21.15.29:0/2682480065 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1284065ab0 msgr2=0x7f1284067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.860+0000 7f12b3000640 1 --2- 172.21.15.29:0/2682480065 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1284065ab0 0x7f1284067f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f129c009cc0 tx=0x7f129c006f90 comp rx=0 tx=0).stop 2024-01-24T13:04:24.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.860+0000 7f12b3000640 1 -- 172.21.15.29:0/2682480065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12ac0cd020 msgr2=0x7f12ac1464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.860+0000 7f12b3000640 1 --2- 172.21.15.29:0/2682480065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12ac0cd020 0x7f12ac1464a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f12a40b4040 tx=0x7f12a401d390 comp rx=0 tx=0).stop 2024-01-24T13:04:24.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.860+0000 7f12b3000640 1 -- 172.21.15.29:0/2682480065 shutdown_connections 2024-01-24T13:04:24.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.860+0000 7f12b3000640 1 --2- 172.21.15.29:0/2682480065 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1284065ab0 0x7f1284067f70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.864+0000 7f12b3000640 1 --2- 172.21.15.29:0/2682480065 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12ac15bdd0 0x7f12ac0c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.864+0000 7f12b3000640 1 --2- 172.21.15.29:0/2682480065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12ac0cd020 0x7f12ac1464a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.864+0000 7f12b3000640 1 --2- 172.21.15.29:0/2682480065 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12ac06cfa0 0x7f12ac145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.864+0000 7f12b3000640 1 -- 172.21.15.29:0/2682480065 >> 172.21.15.29:0/2682480065 conn(0x7f12ac0cac10 msgr2=0x7f12ac14ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.868+0000 7f12b3000640 1 -- 172.21.15.29:0/2682480065 shutdown_connections 2024-01-24T13:04:24.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.868+0000 7f12b3000640 1 -- 172.21.15.29:0/2682480065 wait complete. 2024-01-24T13:04:24.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.2 2024-01-24T13:04:24.902 DEBUG:teuthology.parallel:result is None 2024-01-24T13:04:24.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.920+0000 7f3485000640 1 -- 172.21.15.29:0/3302527256 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3450005510 con 0x7f348006be40 2024-01-24T13:04:24.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.920+0000 7f3476000640 1 -- 172.21.15.29:0/3302527256 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3468017090 con 0x7f348006be40 2024-01-24T13:04:24.924 INFO:teuthology.orchestra.run.smithi029.stdout:64424509451 2024-01-24T13:04:24.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.924+0000 7f3485000640 1 -- 172.21.15.29:0/3302527256 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3458065a60 msgr2=0x7f3458067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.924+0000 7f3485000640 1 --2- 172.21.15.29:0/3302527256 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3458065a60 0x7f3458067f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f34801605b0 tx=0x7f3470008040 comp rx=0 tx=0).stop 2024-01-24T13:04:24.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.924+0000 7f3485000640 1 -- 172.21.15.29:0/3302527256 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f348006be40 msgr2=0x7f34801596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.924+0000 7f3485000640 1 --2- 172.21.15.29:0/3302527256 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f348006be40 0x7f34801596a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f346800c3c0 tx=0x7f346800c880 comp rx=0 tx=0).stop 2024-01-24T13:04:24.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.928+0000 7f3485000640 1 -- 172.21.15.29:0/3302527256 shutdown_connections 2024-01-24T13:04:24.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.928+0000 7f3485000640 1 --2- 172.21.15.29:0/3302527256 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3458065a60 0x7f3458067f20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.928+0000 7f3485000640 1 --2- 172.21.15.29:0/3302527256 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34801610a0 0x7f34800c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.928+0000 7f3485000640 1 --2- 172.21.15.29:0/3302527256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34800ab4f0 0x7f348015d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.928+0000 7f3485000640 1 --2- 172.21.15.29:0/3302527256 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f348006be40 0x7f34801596a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.928+0000 7f3485000640 1 -- 172.21.15.29:0/3302527256 >> 172.21.15.29:0/3302527256 conn(0x7f348006a2d0 msgr2=0x7f34800ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.928+0000 7f3485000640 1 -- 172.21.15.29:0/3302527256 shutdown_connections 2024-01-24T13:04:24.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.928+0000 7f3485000640 1 -- 172.21.15.29:0/3302527256 wait complete. 2024-01-24T13:04:24.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.928+0000 7f744ca00640 1 -- 172.21.15.29:0/2293686215 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f744415b860 con 0x7f74440b1ca0 2024-01-24T13:04:24.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.932+0000 7f7442000640 1 -- 172.21.15.29:0/2293686215 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f742c0ba020 con 0x7f74440b1ca0 2024-01-24T13:04:24.933 INFO:teuthology.orchestra.run.smithi029.stdout:64424509451 2024-01-24T13:04:24.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f744ca00640 1 -- 172.21.15.29:0/2293686215 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f741c065a90 msgr2=0x7f741c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f744ca00640 1 --2- 172.21.15.29:0/2293686215 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f741c065a90 0x7f741c067f50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f744415c510 tx=0x7f743c009040 comp rx=0 tx=0).stop 2024-01-24T13:04:24.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f744ca00640 1 -- 172.21.15.29:0/2293686215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74440b1ca0 msgr2=0x7f74440ae250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f744ca00640 1 --2- 172.21.15.29:0/2293686215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74440b1ca0 0x7f74440ae250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f742c0ac000 tx=0x7f742c019140 comp rx=0 tx=0).stop 2024-01-24T13:04:24.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f7932a00640 1 -- 172.21.15.29:0/2479531803 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f78fc005510 con 0x7f792c0cd020 2024-01-24T13:04:24.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f744ca00640 1 -- 172.21.15.29:0/2293686215 shutdown_connections 2024-01-24T13:04:24.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f744ca00640 1 --2- 172.21.15.29:0/2293686215 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f741c065a90 0x7f741c067f50 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f744415c510 tx=0x7f743c009040 comp rx=0 tx=0).stop 2024-01-24T13:04:24.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f744ca00640 1 --2- 172.21.15.29:0/2293686215 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f744415b450 0x7f74440c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f744ca00640 1 --2- 172.21.15.29:0/2293686215 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74440ce610 0x7f744415af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f744ca00640 1 --2- 172.21.15.29:0/2293686215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74440b1ca0 0x7f74440ae250 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f744ca00640 1 -- 172.21.15.29:0/2293686215 >> 172.21.15.29:0/2293686215 conn(0x7f74440cc590 msgr2=0x7f7444158c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f744ca00640 1 -- 172.21.15.29:0/2293686215 shutdown_connections 2024-01-24T13:04:24.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f7923e00640 1 -- 172.21.15.29:0/2479531803 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7914054350 con 0x7f792c0cd020 2024-01-24T13:04:24.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f744ca00640 1 -- 172.21.15.29:0/2293686215 wait complete. 2024-01-24T13:04:24.940 INFO:teuthology.orchestra.run.smithi029.stdout:64424509453 2024-01-24T13:04:24.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f7583400640 1 -- 172.21.15.29:0/505637443 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f754c005510 con 0x7f757c0b5230 2024-01-24T13:04:24.941 INFO:teuthology.orchestra.run.smithi029.stdout:64424509451 2024-01-24T13:04:24.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.936+0000 7f7578c00640 1 -- 172.21.15.29:0/505637443 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7574051600 con 0x7f757c0b5230 2024-01-24T13:04:24.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7932a00640 1 -- 172.21.15.29:0/2479531803 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7904065b30 msgr2=0x7f7904067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7932a00640 1 --2- 172.21.15.29:0/2479531803 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7904065b30 0x7f7904067ff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f791c0ad000 tx=0x7f791c0a4f90 comp rx=0 tx=0).stop 2024-01-24T13:04:24.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7932a00640 1 -- 172.21.15.29:0/2479531803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f792c0cd020 msgr2=0x7f792c1e78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7932a00640 1 --2- 172.21.15.29:0/2479531803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f792c0cd020 0x7f792c1e78b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f791400e960 tx=0x7f791400ee20 comp rx=0 tx=0).stop 2024-01-24T13:04:24.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7932a00640 1 -- 172.21.15.29:0/2479531803 shutdown_connections 2024-01-24T13:04:24.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7932a00640 1 --2- 172.21.15.29:0/2479531803 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7904065b30 0x7f7904067ff0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7932a00640 1 --2- 172.21.15.29:0/2479531803 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f792c15bd40 0x7f792c1e7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7932a00640 1 --2- 172.21.15.29:0/2479531803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f792c0cd020 0x7f792c1e78b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7932a00640 1 --2- 172.21.15.29:0/2479531803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f792c0cb700 0x7f792c1fe790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7932a00640 1 -- 172.21.15.29:0/2479531803 >> 172.21.15.29:0/2479531803 conn(0x7f792c0cac10 msgr2=0x7f792c154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f0d19600640 1 -- 172.21.15.29:0/952238252 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0cec005510 con 0x7f0d2415bdd0 2024-01-24T13:04:24.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7932a00640 1 -- 172.21.15.29:0/2479531803 shutdown_connections 2024-01-24T13:04:24.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7932a00640 1 -- 172.21.15.29:0/2479531803 wait complete. 2024-01-24T13:04:24.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7583400640 1 -- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7554065b60 msgr2=0x7f7554068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7583400640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7554065b60 0x7f7554068020 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f756c0ad000 tx=0x7f756c009040 comp rx=0 tx=0).stop 2024-01-24T13:04:24.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7583400640 1 -- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f757c0b5230 msgr2=0x7f757c14cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7583400640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f757c0b5230 0x7f757c14cbb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f757400cf60 tx=0x7f757400cf90 comp rx=0 tx=0).stop 2024-01-24T13:04:24.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7583400640 1 -- 172.21.15.29:0/505637443 shutdown_connections 2024-01-24T13:04:24.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7583400640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7554065b60 0x7f7554068020 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7583400640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f757c0cf5c0 0x7f757c0ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7583400640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f757c0cd0b0 0x7f757c15c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7583400640 1 --2- 172.21.15.29:0/505637443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f757c0b5230 0x7f757c14cbb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7583400640 1 -- 172.21.15.29:0/505637443 >> 172.21.15.29:0/505637443 conn(0x7f757c0cc590 msgr2=0x7f757c072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f0d1be00640 1 -- 172.21.15.29:0/952238252 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d1c0ee670 con 0x7f0d2415bdd0 2024-01-24T13:04:24.945 INFO:teuthology.orchestra.run.smithi029.stdout:64424509452 2024-01-24T13:04:24.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7583400640 1 -- 172.21.15.29:0/505637443 shutdown_connections 2024-01-24T13:04:24.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.940+0000 7f7583400640 1 -- 172.21.15.29:0/505637443 wait complete. 2024-01-24T13:04:24.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.944+0000 7f0d19600640 1 -- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0cfc065b30 msgr2=0x7f0cfc067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.944+0000 7f0d19600640 1 --2- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0cfc065b30 0x7f0cfc067ff0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0011f0 tx=0x7f0d0c009040 comp rx=0 tx=0).stop 2024-01-24T13:04:24.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.944+0000 7f0d19600640 1 -- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d2415bdd0 msgr2=0x7f0d24151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.944+0000 7f0d19600640 1 --2- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d2415bdd0 0x7f0d24151290 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0ae000 tx=0x7f0d1c01b900 comp rx=0 tx=0).stop 2024-01-24T13:04:24.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.944+0000 7f0d19600640 1 -- 172.21.15.29:0/952238252 shutdown_connections 2024-01-24T13:04:24.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.944+0000 7f0d19600640 1 --2- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0cfc065b30 0x7f0cfc067ff0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.944+0000 7f0d19600640 1 --2- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d2415bdd0 0x7f0d24151290 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.944+0000 7f0d19600640 1 --2- 172.21.15.29:0/952238252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d240cd020 0x7f0d2414e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.944+0000 7f0d19600640 1 --2- 172.21.15.29:0/952238252 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d2406d6b0 0x7f0d24162f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.944+0000 7f0d19600640 1 -- 172.21.15.29:0/952238252 >> 172.21.15.29:0/952238252 conn(0x7f0d240cac10 msgr2=0x7f0d24154af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.952+0000 7f0d19600640 1 -- 172.21.15.29:0/952238252 shutdown_connections 2024-01-24T13:04:24.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.952+0000 7f0d19600640 1 -- 172.21.15.29:0/952238252 wait complete. 2024-01-24T13:04:24.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.964+0000 7f9ffc400640 1 -- 172.21.15.29:0/3047777725 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9fc40057e0 con 0x7f9ff406d6b0 2024-01-24T13:04:24.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.964+0000 7f1d99000640 1 -- 172.21.15.29:0/206146323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1d94172250 con 0x7f1d94089860 2024-01-24T13:04:24.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.964+0000 7f9ff1600640 1 -- 172.21.15.29:0/3047777725 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9fe4017090 con 0x7f9ff406d6b0 2024-01-24T13:04:24.968 INFO:teuthology.orchestra.run.smithi029.stdout:64424509450 2024-01-24T13:04:24.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.964+0000 7f1d8b400640 1 -- 172.21.15.29:0/206146323 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1d7c0507e0 con 0x7f1d94089860 2024-01-24T13:04:24.969 INFO:teuthology.orchestra.run.smithi029.stdout:55834574860 2024-01-24T13:04:24.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f1d99000640 1 -- 172.21.15.29:0/206146323 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1d6c065a90 msgr2=0x7f1d6c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f1d99000640 1 --2- 172.21.15.29:0/206146323 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1d6c065a90 0x7f1d6c067f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009c70 tx=0x7f1d84008040 comp rx=0 tx=0).stop 2024-01-24T13:04:24.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f1d99000640 1 -- 172.21.15.29:0/206146323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d94089860 msgr2=0x7f1d94088ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f1d99000640 1 --2- 172.21.15.29:0/206146323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d94089860 0x7f1d94088ad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00c3e0 tx=0x7f1d7c00c8a0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f9ffc400640 1 -- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9fcc065a60 msgr2=0x7f9fcc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f9ffc400640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9fcc065a60 0x7f9fcc067f20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4166220 tx=0x7f9fdc009040 comp rx=0 tx=0).stop 2024-01-24T13:04:24.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f9ffc400640 1 -- 172.21.15.29:0/3047777725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ff406d6b0 msgr2=0x7f9ff4148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:24.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f9ffc400640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ff406d6b0 0x7f9ff4148970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4001ec0 tx=0x7f9fe400c8e0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f1d99000640 1 -- 172.21.15.29:0/206146323 shutdown_connections 2024-01-24T13:04:24.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f1d99000640 1 --2- 172.21.15.29:0/206146323 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1d6c065a90 0x7f1d6c067f50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f1d99000640 1 --2- 172.21.15.29:0/206146323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d94089860 0x7f1d94088ad0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f1d99000640 1 --2- 172.21.15.29:0/206146323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d94071720 0x7f1d9415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f1d99000640 1 --2- 172.21.15.29:0/206146323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d9406d5b0 0x7f1d940c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f1d99000640 1 -- 172.21.15.29:0/206146323 >> 172.21.15.29:0/206146323 conn(0x7f1d940afdc0 msgr2=0x7f1d941643f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f9ffc400640 1 -- 172.21.15.29:0/3047777725 shutdown_connections 2024-01-24T13:04:24.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f1d99000640 1 -- 172.21.15.29:0/206146323 shutdown_connections 2024-01-24T13:04:24.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f9ffc400640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9fcc065a60 0x7f9fcc067f20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f9ffc400640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ff415bdd0 0x7f9ff4165680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f9ffc400640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ff40cd020 0x7f9ff4165140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f9ffc400640 1 --2- 172.21.15.29:0/3047777725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ff406d6b0 0x7f9ff4148970 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:24.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f9ffc400640 1 -- 172.21.15.29:0/3047777725 >> 172.21.15.29:0/3047777725 conn(0x7f9ff40cac10 msgr2=0x7f9ff415c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:24.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.968+0000 7f1d99000640 1 -- 172.21.15.29:0/206146323 wait complete. 2024-01-24T13:04:24.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.972+0000 7f9ffc400640 1 -- 172.21.15.29:0/3047777725 shutdown_connections 2024-01-24T13:04:24.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:24.972+0000 7f9ffc400640 1 -- 172.21.15.29:0/3047777725 wait complete. 2024-01-24T13:04:24.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.4 2024-01-24T13:04:24.975 DEBUG:teuthology.parallel:result is None 2024-01-24T13:04:24.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.1 2024-01-24T13:04:24.982 DEBUG:teuthology.parallel:result is None 2024-01-24T13:04:24.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.6 2024-01-24T13:04:24.983 DEBUG:teuthology.parallel:result is None 2024-01-24T13:04:24.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.7 2024-01-24T13:04:24.984 DEBUG:teuthology.parallel:result is None 2024-01-24T13:04:24.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.0 2024-01-24T13:04:24.988 DEBUG:teuthology.parallel:result is None 2024-01-24T13:04:24.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.5 2024-01-24T13:04:24.997 DEBUG:teuthology.parallel:result is None 2024-01-24T13:04:24.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.3 2024-01-24T13:04:24.999 DEBUG:teuthology.parallel:result is None 2024-01-24T13:04:24.999 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-24T13:04:24.999 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:04:25.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.180+0000 7f49d1800640 1 Processor -- start 2024-01-24T13:04:25.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.180+0000 7f49d1800640 1 -- start start 2024-01-24T13:04:25.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49d1800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f49cc15c450 0x7f49cc0cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49d1800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc06ca30 con 0x7f49cc0b1f50 2024-01-24T13:04:25.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49d1800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc070230 con 0x7f49cc0b1030 2024-01-24T13:04:25.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49d1800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc0712d0 con 0x7f49cc15c450 2024-01-24T13:04:25.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49ca000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f49cc0b1f50 0x7f49cc06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41652/0 (socket says 172.21.15.29:41652) 2024-01-24T13:04:25.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49ca000640 1 -- 172.21.15.29:0/4082066982 learned_addr learned my addr 172.21.15.29:0/4082066982 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:25.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49caa00640 1 --2- 172.21.15.29:0/4082066982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f49cc15c450 0x7f49cc0cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 -- 172.21.15.29:0/4082066982 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526491017 0 0) 0x7f49cc06ca30 con 0x7f49cc0b1f50 2024-01-24T13:04:25.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 -- 172.21.15.29:0/4082066982 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49ac003530 con 0x7f49cc0b1f50 2024-01-24T13:04:25.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 -- 172.21.15.29:0/4082066982 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2868359229 0 0) 0x7f49ac003530 con 0x7f49cc0b1f50 2024-01-24T13:04:25.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 -- 172.21.15.29:0/4082066982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f49cc15c450 msgr2=0x7f49cc0cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:25.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 --2- 172.21.15.29:0/4082066982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f49cc15c450 0x7f49cc0cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 -- 172.21.15.29:0/4082066982 >> v1:172.21.15.163:6789/0 conn(0x7f49cc0b1030 legacy=0x7f49cc06c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 -- 172.21.15.29:0/4082066982 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc070510 con 0x7f49cc0b1f50 2024-01-24T13:04:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 -- 172.21.15.29:0/4082066982 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f49b4001680 con 0x7f49cc0b1f50 2024-01-24T13:04:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 -- 172.21.15.29:0/4082066982 >> v1:172.21.15.29:6789/0 conn(0x7f49cc0b1f50 legacy=0x7f49cc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 --2- 172.21.15.29:0/4082066982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49ac0039b0 0x7f49ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 --2- 172.21.15.29:0/4082066982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49ac004360 0x7f49ac004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 --2- 172.21.15.29:0/4082066982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f49cc15c450 0x7f49ac005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 -- 172.21.15.29:0/4082066982 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac00b990 con 0x7f49ac0039b0 2024-01-24T13:04:25.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 -- 172.21.15.29:0/4082066982 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac00bad0 con 0x7f49ac004360 2024-01-24T13:04:25.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49c9600640 1 -- 172.21.15.29:0/4082066982 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac00bc90 con 0x7f49cc15c450 2024-01-24T13:04:25.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49caa00640 1 --2- 172.21.15.29:0/4082066982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49ac0039b0 0x7f49ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49cb400640 1 --2- 172.21.15.29:0/4082066982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f49cc15c450 0x7f49ac005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49ca000640 1 --2- 172.21.15.29:0/4082066982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49ac004360 0x7f49ac004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49caa00640 1 -- 172.21.15.29:0/4082066982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f49cc15c450 msgr2=0x7f49ac005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:25.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49caa00640 1 --2- 172.21.15.29:0/4082066982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f49cc15c450 0x7f49ac005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49caa00640 1 -- 172.21.15.29:0/4082066982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49ac004360 msgr2=0x7f49ac004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:25.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49caa00640 1 --2- 172.21.15.29:0/4082066982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49ac004360 0x7f49ac004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49caa00640 1 -- 172.21.15.29:0/4082066982 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac003530 con 0x7f49ac0039b0 2024-01-24T13:04:25.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.184+0000 7f49cb400640 1 --2- 172.21.15.29:0/4082066982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f49cc15c450 0x7f49ac005090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.188+0000 7f49caa00640 1 --2- 172.21.15.29:0/4082066982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49ac0039b0 0x7f49ac003d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49bc009ae0 tx=0x7f49bc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee10eb3d7951fd4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.188+0000 7f49c9600640 1 -- 172.21.15.29:0/4082066982 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc0a5640 con 0x7f49ac0039b0 2024-01-24T13:04:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.188+0000 7f49c9600640 1 -- 172.21.15.29:0/4082066982 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc0a57a0 con 0x7f49ac0039b0 2024-01-24T13:04:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.188+0000 7f49c9600640 1 -- 172.21.15.29:0/4082066982 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc0a5b50 con 0x7f49ac0039b0 2024-01-24T13:04:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.188+0000 7f49d1800640 1 -- 172.21.15.29:0/4082066982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49ac0039b0 msgr2=0x7f49ac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.188+0000 7f49d1800640 1 --2- 172.21.15.29:0/4082066982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49ac0039b0 0x7f49ac003d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49bc009ae0 tx=0x7f49bc01ca50 comp rx=0 tx=0).stop 2024-01-24T13:04:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.188+0000 7f49cb400640 1 -- 172.21.15.29:0/4082066982 reap_dead start 2024-01-24T13:04:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.188+0000 7f49d1800640 1 -- 172.21.15.29:0/4082066982 shutdown_connections 2024-01-24T13:04:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.188+0000 7f49d1800640 1 -- 172.21.15.29:0/4082066982 >> 172.21.15.29:0/4082066982 conn(0x7f49cc0b3950 msgr2=0x7f49cc069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.188+0000 7f49d1800640 1 -- 172.21.15.29:0/4082066982 shutdown_connections 2024-01-24T13:04:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.188+0000 7f49d1800640 1 -- 172.21.15.29:0/4082066982 wait complete. 2024-01-24T13:04:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49d1800640 1 Processor -- start 2024-01-24T13:04:25.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49d1800640 1 -- start start 2024-01-24T13:04:25.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49d1800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49ac0039b0 0x7f49cc148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49d1800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f49cc0acda0 0x7f49cc0ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49d1800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49cc0ca6d0 0x7f49cc0cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49d1800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc0ad760 con 0x7f49cc0ca6d0 2024-01-24T13:04:25.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49d1800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc0cb9c0 con 0x7f49ac0039b0 2024-01-24T13:04:25.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49d1800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc1531d0 con 0x7f49cc0acda0 2024-01-24T13:04:25.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49cb400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49cc0ca6d0 0x7f49cc0cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49cb400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49cc0ca6d0 0x7f49cc0cab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37440/0 (socket says 172.21.15.29:37440) 2024-01-24T13:04:25.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49cb400640 1 -- 172.21.15.29:0/190166196 learned_addr learned my addr 172.21.15.29:0/190166196 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:25.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49ca000640 1 --2- 172.21.15.29:0/190166196 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f49cc0acda0 0x7f49cc0ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49caa00640 1 --2- 172.21.15.29:0/190166196 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49ac0039b0 0x7f49cc148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49cb400640 1 -- 172.21.15.29:0/190166196 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f49cc0acda0 msgr2=0x7f49cc0ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49cb400640 1 --2- 172.21.15.29:0/190166196 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f49cc0acda0 0x7f49cc0ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49cb400640 1 -- 172.21.15.29:0/190166196 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49ac0039b0 msgr2=0x7f49cc148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49cb400640 1 --2- 172.21.15.29:0/190166196 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49ac0039b0 0x7f49cc148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49cb400640 1 -- 172.21.15.29:0/190166196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc0cb400 con 0x7f49cc0ca6d0 2024-01-24T13:04:25.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49cb400640 1 --2- 172.21.15.29:0/190166196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49cc0ca6d0 0x7f49cc0cab50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49cc06e0f0 tx=0x7f49c4010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:25.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49c2a00640 1 -- 172.21.15.29:0/190166196 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4003d90 con 0x7f49cc0ca6d0 2024-01-24T13:04:25.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49c2a00640 1 -- 172.21.15.29:0/190166196 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c400d070 con 0x7f49cc0ca6d0 2024-01-24T13:04:25.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49d1800640 1 -- 172.21.15.29:0/190166196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49cc0cb6e0 con 0x7f49cc0ca6d0 2024-01-24T13:04:25.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49c2a00640 1 -- 172.21.15.29:0/190166196 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c400ea50 con 0x7f49cc0ca6d0 2024-01-24T13:04:25.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.192+0000 7f49d1800640 1 -- 172.21.15.29:0/190166196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc0cb090 con 0x7f49cc0ca6d0 2024-01-24T13:04:25.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.196+0000 7f49d1800640 1 -- 172.21.15.29:0/190166196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49cc153030 con 0x7f49cc0ca6d0 2024-01-24T13:04:25.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.196+0000 7f49c2a00640 1 -- 172.21.15.29:0/190166196 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f49c400ebb0 con 0x7f49cc0ca6d0 2024-01-24T13:04:25.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.196+0000 7f49c2a00640 1 --2- 172.21.15.29:0/190166196 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f49a4065a60 0x7f49a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.196+0000 7f49c2a00640 1 -- 172.21.15.29:0/190166196 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f49c4086430 con 0x7f49cc0ca6d0 2024-01-24T13:04:25.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.196+0000 7f49caa00640 1 --2- 172.21.15.29:0/190166196 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f49a4065a60 0x7f49a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.196+0000 7f49caa00640 1 --2- 172.21.15.29:0/190166196 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f49a4065a60 0x7f49a4067f20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f49bc009ae0 tx=0x7f49bc0046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:25.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.200+0000 7f49c2a00640 1 -- 172.21.15.29:0/190166196 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f49cc153030 con 0x7f49cc0ca6d0 2024-01-24T13:04:25.240 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:04:25.245 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:04:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.356+0000 7f49d1800640 1 -- 172.21.15.29:0/190166196 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49cc070ad0 con 0x7f49a4065a60 2024-01-24T13:04:25.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.368+0000 7f49c2a00640 1 -- 172.21.15.29:0/190166196 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345261 (secure 0 0 0) 0x7f49bc00f080 con 0x7f49a4065a60 2024-01-24T13:04:25.374 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:25.376 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:04:25.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.372+0000 7f49d1800640 1 -- 172.21.15.29:0/190166196 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f49a4065a60 msgr2=0x7f49a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.372+0000 7f49d1800640 1 --2- 172.21.15.29:0/190166196 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f49a4065a60 0x7f49a4067f20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f49bc009ae0 tx=0x7f49bc0046d0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.372+0000 7f49d1800640 1 -- 172.21.15.29:0/190166196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49cc0ca6d0 msgr2=0x7f49cc0cab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.372+0000 7f49d1800640 1 --2- 172.21.15.29:0/190166196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49cc0ca6d0 0x7f49cc0cab50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49cc06e0f0 tx=0x7f49c4010f40 comp rx=0 tx=0).stop 2024-01-24T13:04:25.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.372+0000 7f49d1800640 1 -- 172.21.15.29:0/190166196 shutdown_connections 2024-01-24T13:04:25.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.372+0000 7f49d1800640 1 --2- 172.21.15.29:0/190166196 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f49a4065a60 0x7f49a4067f20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.372+0000 7f49d1800640 1 --2- 172.21.15.29:0/190166196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49cc0ca6d0 0x7f49cc0cab50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.372+0000 7f49d1800640 1 --2- 172.21.15.29:0/190166196 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f49cc0acda0 0x7f49cc0ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.372+0000 7f49d1800640 1 --2- 172.21.15.29:0/190166196 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49ac0039b0 0x7f49cc148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.372+0000 7f49d1800640 1 -- 172.21.15.29:0/190166196 >> 172.21.15.29:0/190166196 conn(0x7f49cc0b3950 msgr2=0x7f49cc0adca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:25.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.372+0000 7f49d1800640 1 -- 172.21.15.29:0/190166196 shutdown_connections 2024-01-24T13:04:25.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.372+0000 7f49d1800640 1 -- 172.21.15.29:0/190166196 wait complete. 2024-01-24T13:04:25.395 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-01-24T13:04:23.542561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219700,"kb_used_data":3528,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755020,"statfs":{"total":773094113280,"available":772869140480,"internally_reserved":0,"allocated":3612672,"data_stored":2126578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003005"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020698+0000","last_change":"2024-01-24T13:03:55.606327+0000","last_active":"2024-01-24T13:04:00.020698+0000","last_peered":"2024-01-24T13:04:00.020698+0000","last_clean":"2024-01-24T13:04:00.020698+0000","last_became_active":"2024-01-24T13:03:55.606030+0000","last_became_peered":"2024-01-24T13:03:55.606030+0000","last_unstale":"2024-01-24T13:04:00.020698+0000","last_undegraded":"2024-01-24T13:04:00.020698+0000","last_fullsized":"2024-01-24T13:04:00.020698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:03:57.780901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017226+0000","last_change":"2024-01-24T13:03:56.018840+0000","last_active":"2024-01-24T13:04:01.017226+0000","last_peered":"2024-01-24T13:04:01.017226+0000","last_clean":"2024-01-24T13:04:01.017226+0000","last_became_active":"2024-01-24T13:03:56.018597+0000","last_became_peered":"2024-01-24T13:03:56.018597+0000","last_unstale":"2024-01-24T13:04:01.017226+0000","last_undegraded":"2024-01-24T13:04:01.017226+0000","last_fullsized":"2024-01-24T13:04:01.017226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:26:26.138489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806814+0000","last_change":"2024-01-24T13:04:00.044582+0000","last_active":"2024-01-24T13:04:01.806814+0000","last_peered":"2024-01-24T13:04:01.806814+0000","last_clean":"2024-01-24T13:04:01.806814+0000","last_became_active":"2024-01-24T13:04:00.044171+0000","last_became_peered":"2024-01-24T13:04:00.044171+0000","last_unstale":"2024-01-24T13:04:01.806814+0000","last_undegraded":"2024-01-24T13:04:01.806814+0000","last_fullsized":"2024-01-24T13:04:01.806814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:14:04.213076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017241+0000","last_change":"2024-01-24T13:03:55.596925+0000","last_active":"2024-01-24T13:04:01.017241+0000","last_peered":"2024-01-24T13:04:01.017241+0000","last_clean":"2024-01-24T13:04:01.017241+0000","last_became_active":"2024-01-24T13:03:55.596539+0000","last_became_peered":"2024-01-24T13:03:55.596539+0000","last_unstale":"2024-01-24T13:04:01.017241+0000","last_undegraded":"2024-01-24T13:04:01.017241+0000","last_fullsized":"2024-01-24T13:04:01.017241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:18.551398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017244+0000","last_change":"2024-01-24T13:03:56.010228+0000","last_active":"2024-01-24T13:04:01.017244+0000","last_peered":"2024-01-24T13:04:01.017244+0000","last_clean":"2024-01-24T13:04:01.017244+0000","last_became_active":"2024-01-24T13:03:56.009920+0000","last_became_peered":"2024-01-24T13:03:56.009920+0000","last_unstale":"2024-01-24T13:04:01.017244+0000","last_undegraded":"2024-01-24T13:04:01.017244+0000","last_fullsized":"2024-01-24T13:04:01.017244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:33:22.274202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805044+0000","last_change":"2024-01-24T13:04:00.036039+0000","last_active":"2024-01-24T13:04:01.805044+0000","last_peered":"2024-01-24T13:04:01.805044+0000","last_clean":"2024-01-24T13:04:01.805044+0000","last_became_active":"2024-01-24T13:04:00.035441+0000","last_became_peered":"2024-01-24T13:04:00.035441+0000","last_unstale":"2024-01-24T13:04:01.805044+0000","last_undegraded":"2024-01-24T13:04:01.805044+0000","last_fullsized":"2024-01-24T13:04:01.805044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:18:37.828066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.031062+0000","last_change":"2024-01-24T13:03:55.601607+0000","last_active":"2024-01-24T13:04:00.031062+0000","last_peered":"2024-01-24T13:04:00.031062+0000","last_clean":"2024-01-24T13:04:00.031062+0000","last_became_active":"2024-01-24T13:03:55.601320+0000","last_became_peered":"2024-01-24T13:03:55.601320+0000","last_unstale":"2024-01-24T13:04:00.031062+0000","last_undegraded":"2024-01-24T13:04:00.031062+0000","last_fullsized":"2024-01-24T13:04:00.031062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:12.091224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021279+0000","last_change":"2024-01-24T13:03:56.022848+0000","last_active":"2024-01-24T13:04:00.021279+0000","last_peered":"2024-01-24T13:04:00.021279+0000","last_clean":"2024-01-24T13:04:00.021279+0000","last_became_active":"2024-01-24T13:03:56.022529+0000","last_became_peered":"2024-01-24T13:03:56.022529+0000","last_unstale":"2024-01-24T13:04:00.021279+0000","last_undegraded":"2024-01-24T13:04:00.021279+0000","last_fullsized":"2024-01-24T13:04:00.021279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:02.421483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806130+0000","last_change":"2024-01-24T13:04:00.052590+0000","last_active":"2024-01-24T13:04:01.806130+0000","last_peered":"2024-01-24T13:04:01.806130+0000","last_clean":"2024-01-24T13:04:01.806130+0000","last_became_active":"2024-01-24T13:04:00.052118+0000","last_became_peered":"2024-01-24T13:04:00.052118+0000","last_unstale":"2024-01-24T13:04:01.806130+0000","last_undegraded":"2024-01-24T13:04:01.806130+0000","last_fullsized":"2024-01-24T13:04:01.806130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:50:50.867503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.026082+0000","last_change":"2024-01-24T13:03:55.605745+0000","last_active":"2024-01-24T13:04:00.026082+0000","last_peered":"2024-01-24T13:04:00.026082+0000","last_clean":"2024-01-24T13:04:00.026082+0000","last_became_active":"2024-01-24T13:03:55.605321+0000","last_became_peered":"2024-01-24T13:03:55.605321+0000","last_unstale":"2024-01-24T13:04:00.026082+0000","last_undegraded":"2024-01-24T13:04:00.026082+0000","last_fullsized":"2024-01-24T13:04:00.026082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:01.413713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013678+0000","last_change":"2024-01-24T13:03:56.024669+0000","last_active":"2024-01-24T13:04:00.013678+0000","last_peered":"2024-01-24T13:04:00.013678+0000","last_clean":"2024-01-24T13:04:00.013678+0000","last_became_active":"2024-01-24T13:03:56.024411+0000","last_became_peered":"2024-01-24T13:03:56.024411+0000","last_unstale":"2024-01-24T13:04:00.013678+0000","last_undegraded":"2024-01-24T13:04:00.013678+0000","last_fullsized":"2024-01-24T13:04:00.013678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:26:46.456477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805258+0000","last_change":"2024-01-24T13:04:00.051526+0000","last_active":"2024-01-24T13:04:01.805258+0000","last_peered":"2024-01-24T13:04:01.805258+0000","last_clean":"2024-01-24T13:04:01.805258+0000","last_became_active":"2024-01-24T13:04:00.046616+0000","last_became_peered":"2024-01-24T13:04:00.046616+0000","last_unstale":"2024-01-24T13:04:01.805258+0000","last_undegraded":"2024-01-24T13:04:01.805258+0000","last_fullsized":"2024-01-24T13:04:01.805258+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:04.738538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011521+0000","last_change":"2024-01-24T13:03:56.015309+0000","last_active":"2024-01-24T13:04:00.011521+0000","last_peered":"2024-01-24T13:04:00.011521+0000","last_clean":"2024-01-24T13:04:00.011521+0000","last_became_active":"2024-01-24T13:03:56.015046+0000","last_became_peered":"2024-01-24T13:03:56.015046+0000","last_unstale":"2024-01-24T13:04:00.011521+0000","last_undegraded":"2024-01-24T13:04:00.011521+0000","last_fullsized":"2024-01-24T13:04:00.011521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:25:17.038527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011674+0000","last_change":"2024-01-24T13:03:55.597378+0000","last_active":"2024-01-24T13:04:00.011674+0000","last_peered":"2024-01-24T13:04:00.011674+0000","last_clean":"2024-01-24T13:04:00.011674+0000","last_became_active":"2024-01-24T13:03:55.597128+0000","last_became_peered":"2024-01-24T13:03:55.597128+0000","last_unstale":"2024-01-24T13:04:00.011674+0000","last_undegraded":"2024-01-24T13:04:00.011674+0000","last_fullsized":"2024-01-24T13:04:00.011674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:41:52.439330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806109+0000","last_change":"2024-01-24T13:04:00.049793+0000","last_active":"2024-01-24T13:04:01.806109+0000","last_peered":"2024-01-24T13:04:01.806109+0000","last_clean":"2024-01-24T13:04:01.806109+0000","last_became_active":"2024-01-24T13:04:00.049395+0000","last_became_peered":"2024-01-24T13:04:00.049395+0000","last_unstale":"2024-01-24T13:04:01.806109+0000","last_undegraded":"2024-01-24T13:04:01.806109+0000","last_fullsized":"2024-01-24T13:04:01.806109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:31:27.768822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016628+0000","last_change":"2024-01-24T13:03:56.015127+0000","last_active":"2024-01-24T13:04:01.016628+0000","last_peered":"2024-01-24T13:04:01.016628+0000","last_clean":"2024-01-24T13:04:01.016628+0000","last_became_active":"2024-01-24T13:03:56.014713+0000","last_became_peered":"2024-01-24T13:03:56.014713+0000","last_unstale":"2024-01-24T13:04:01.016628+0000","last_undegraded":"2024-01-24T13:04:01.016628+0000","last_fullsized":"2024-01-24T13:04:01.016628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:13.098994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017134+0000","last_change":"2024-01-24T13:03:55.601999+0000","last_active":"2024-01-24T13:04:00.017134+0000","last_peered":"2024-01-24T13:04:00.017134+0000","last_clean":"2024-01-24T13:04:00.017134+0000","last_became_active":"2024-01-24T13:03:55.601673+0000","last_became_peered":"2024-01-24T13:03:55.601673+0000","last_unstale":"2024-01-24T13:04:00.017134+0000","last_undegraded":"2024-01-24T13:04:00.017134+0000","last_fullsized":"2024-01-24T13:04:00.017134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:45:36.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.146739+0000","last_change":"2024-01-24T13:04:00.044536+0000","last_active":"2024-01-24T13:04:01.146739+0000","last_peered":"2024-01-24T13:04:01.146739+0000","last_clean":"2024-01-24T13:04:01.146739+0000","last_became_active":"2024-01-24T13:04:00.044138+0000","last_became_peered":"2024-01-24T13:04:00.044138+0000","last_unstale":"2024-01-24T13:04:01.146739+0000","last_undegraded":"2024-01-24T13:04:01.146739+0000","last_fullsized":"2024-01-24T13:04:01.146739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017399+0000","last_change":"2024-01-24T13:03:56.012647+0000","last_active":"2024-01-24T13:04:00.017399+0000","last_peered":"2024-01-24T13:04:00.017399+0000","last_clean":"2024-01-24T13:04:00.017399+0000","last_became_active":"2024-01-24T13:03:56.012253+0000","last_became_peered":"2024-01-24T13:03:56.012253+0000","last_unstale":"2024-01-24T13:04:00.017399+0000","last_undegraded":"2024-01-24T13:04:00.017399+0000","last_fullsized":"2024-01-24T13:04:00.017399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:24:10.805392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019610+0000","last_change":"2024-01-24T13:03:55.607929+0000","last_active":"2024-01-24T13:04:00.019610+0000","last_peered":"2024-01-24T13:04:00.019610+0000","last_clean":"2024-01-24T13:04:00.019610+0000","last_became_active":"2024-01-24T13:03:55.607579+0000","last_became_peered":"2024-01-24T13:03:55.607579+0000","last_unstale":"2024-01-24T13:04:00.019610+0000","last_undegraded":"2024-01-24T13:04:00.019610+0000","last_fullsized":"2024-01-24T13:04:00.019610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:47:45.731340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806758+0000","last_change":"2024-01-24T13:04:00.042942+0000","last_active":"2024-01-24T13:04:01.806758+0000","last_peered":"2024-01-24T13:04:01.806758+0000","last_clean":"2024-01-24T13:04:01.806758+0000","last_became_active":"2024-01-24T13:04:00.042539+0000","last_became_peered":"2024-01-24T13:04:00.042539+0000","last_unstale":"2024-01-24T13:04:01.806758+0000","last_undegraded":"2024-01-24T13:04:01.806758+0000","last_fullsized":"2024-01-24T13:04:01.806758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:44:50.908587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011397+0000","last_change":"2024-01-24T13:03:56.012053+0000","last_active":"2024-01-24T13:04:00.011397+0000","last_peered":"2024-01-24T13:04:00.011397+0000","last_clean":"2024-01-24T13:04:00.011397+0000","last_became_active":"2024-01-24T13:03:56.011812+0000","last_became_peered":"2024-01-24T13:03:56.011812+0000","last_unstale":"2024-01-24T13:04:00.011397+0000","last_undegraded":"2024-01-24T13:04:00.011397+0000","last_fullsized":"2024-01-24T13:04:00.011397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:32.185320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021271+0000","last_change":"2024-01-24T13:03:55.595674+0000","last_active":"2024-01-24T13:04:00.021271+0000","last_peered":"2024-01-24T13:04:00.021271+0000","last_clean":"2024-01-24T13:04:00.021271+0000","last_became_active":"2024-01-24T13:03:55.594833+0000","last_became_peered":"2024-01-24T13:03:55.594833+0000","last_unstale":"2024-01-24T13:04:00.021271+0000","last_undegraded":"2024-01-24T13:04:00.021271+0000","last_fullsized":"2024-01-24T13:04:00.021271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:54:35.340555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806952+0000","last_change":"2024-01-24T13:04:00.042902+0000","last_active":"2024-01-24T13:04:01.806952+0000","last_peered":"2024-01-24T13:04:01.806952+0000","last_clean":"2024-01-24T13:04:01.806952+0000","last_became_active":"2024-01-24T13:04:00.042120+0000","last_became_peered":"2024-01-24T13:04:00.042120+0000","last_unstale":"2024-01-24T13:04:01.806952+0000","last_undegraded":"2024-01-24T13:04:01.806952+0000","last_fullsized":"2024-01-24T13:04:01.806952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:48:26.063259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020230+0000","last_change":"2024-01-24T13:03:56.012262+0000","last_active":"2024-01-24T13:04:00.020230+0000","last_peered":"2024-01-24T13:04:00.020230+0000","last_clean":"2024-01-24T13:04:00.020230+0000","last_became_active":"2024-01-24T13:03:56.011966+0000","last_became_peered":"2024-01-24T13:03:56.011966+0000","last_unstale":"2024-01-24T13:04:00.020230+0000","last_undegraded":"2024-01-24T13:04:00.020230+0000","last_fullsized":"2024-01-24T13:04:00.020230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:17:34.235081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.012933+0000","last_change":"2024-01-24T13:03:55.607257+0000","last_active":"2024-01-24T13:04:00.012933+0000","last_peered":"2024-01-24T13:04:00.012933+0000","last_clean":"2024-01-24T13:04:00.012933+0000","last_became_active":"2024-01-24T13:03:55.606021+0000","last_became_peered":"2024-01-24T13:03:55.606021+0000","last_unstale":"2024-01-24T13:04:00.012933+0000","last_undegraded":"2024-01-24T13:04:00.012933+0000","last_fullsized":"2024-01-24T13:04:00.012933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:45:36.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805293+0000","last_change":"2024-01-24T13:04:00.038690+0000","last_active":"2024-01-24T13:04:01.805293+0000","last_peered":"2024-01-24T13:04:01.805293+0000","last_clean":"2024-01-24T13:04:01.805293+0000","last_became_active":"2024-01-24T13:04:00.033603+0000","last_became_peered":"2024-01-24T13:04:00.033603+0000","last_unstale":"2024-01-24T13:04:01.805293+0000","last_undegraded":"2024-01-24T13:04:01.805293+0000","last_fullsized":"2024-01-24T13:04:01.805293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020685+0000","last_change":"2024-01-24T13:03:56.019251+0000","last_active":"2024-01-24T13:04:00.020685+0000","last_peered":"2024-01-24T13:04:00.020685+0000","last_clean":"2024-01-24T13:04:00.020685+0000","last_became_active":"2024-01-24T13:03:56.016877+0000","last_became_peered":"2024-01-24T13:03:56.016877+0000","last_unstale":"2024-01-24T13:04:00.020685+0000","last_undegraded":"2024-01-24T13:04:00.020685+0000","last_fullsized":"2024-01-24T13:04:00.020685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:02.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020421+0000","last_change":"2024-01-24T13:03:55.607924+0000","last_active":"2024-01-24T13:04:00.020421+0000","last_peered":"2024-01-24T13:04:00.020421+0000","last_clean":"2024-01-24T13:04:00.020421+0000","last_became_active":"2024-01-24T13:03:55.607591+0000","last_became_peered":"2024-01-24T13:03:55.607591+0000","last_unstale":"2024-01-24T13:04:00.020421+0000","last_undegraded":"2024-01-24T13:04:00.020421+0000","last_fullsized":"2024-01-24T13:04:00.020421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:13.842299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149029+0000","last_change":"2024-01-24T13:04:00.035477+0000","last_active":"2024-01-24T13:04:01.149029+0000","last_peered":"2024-01-24T13:04:01.149029+0000","last_clean":"2024-01-24T13:04:01.149029+0000","last_became_active":"2024-01-24T13:04:00.034981+0000","last_became_peered":"2024-01-24T13:04:00.034981+0000","last_unstale":"2024-01-24T13:04:01.149029+0000","last_undegraded":"2024-01-24T13:04:01.149029+0000","last_fullsized":"2024-01-24T13:04:01.149029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:04.738538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018375+0000","last_change":"2024-01-24T13:03:56.017993+0000","last_active":"2024-01-24T13:04:00.018375+0000","last_peered":"2024-01-24T13:04:00.018375+0000","last_clean":"2024-01-24T13:04:00.018375+0000","last_became_active":"2024-01-24T13:03:56.017682+0000","last_became_peered":"2024-01-24T13:03:56.017682+0000","last_unstale":"2024-01-24T13:04:00.018375+0000","last_undegraded":"2024-01-24T13:04:00.018375+0000","last_fullsized":"2024-01-24T13:04:00.018375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:46:24.457447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013622+0000","last_change":"2024-01-24T13:03:55.601678+0000","last_active":"2024-01-24T13:04:00.013622+0000","last_peered":"2024-01-24T13:04:00.013622+0000","last_clean":"2024-01-24T13:04:00.013622+0000","last_became_active":"2024-01-24T13:03:55.599824+0000","last_became_peered":"2024-01-24T13:03:55.599824+0000","last_unstale":"2024-01-24T13:04:00.013622+0000","last_undegraded":"2024-01-24T13:04:00.013622+0000","last_fullsized":"2024-01-24T13:04:00.013622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:01.413713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806924+0000","last_change":"2024-01-24T13:04:00.044489+0000","last_active":"2024-01-24T13:04:01.806924+0000","last_peered":"2024-01-24T13:04:01.806924+0000","last_clean":"2024-01-24T13:04:01.806924+0000","last_became_active":"2024-01-24T13:04:00.044090+0000","last_became_peered":"2024-01-24T13:04:00.044090+0000","last_unstale":"2024-01-24T13:04:01.806924+0000","last_undegraded":"2024-01-24T13:04:01.806924+0000","last_fullsized":"2024-01-24T13:04:01.806924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013877+0000","last_change":"2024-01-24T13:03:56.012608+0000","last_active":"2024-01-24T13:04:01.013877+0000","last_peered":"2024-01-24T13:04:01.013877+0000","last_clean":"2024-01-24T13:04:01.013877+0000","last_became_active":"2024-01-24T13:03:56.012369+0000","last_became_peered":"2024-01-24T13:03:56.012369+0000","last_unstale":"2024-01-24T13:04:01.013877+0000","last_undegraded":"2024-01-24T13:04:01.013877+0000","last_fullsized":"2024-01-24T13:04:01.013877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:02.421483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016565+0000","last_change":"2024-01-24T13:03:55.595049+0000","last_active":"2024-01-24T13:04:01.016565+0000","last_peered":"2024-01-24T13:04:01.016565+0000","last_clean":"2024-01-24T13:04:01.016565+0000","last_became_active":"2024-01-24T13:03:55.594748+0000","last_became_peered":"2024-01-24T13:03:55.594748+0000","last_unstale":"2024-01-24T13:04:01.016565+0000","last_undegraded":"2024-01-24T13:04:01.016565+0000","last_fullsized":"2024-01-24T13:04:01.016565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:54:02.325596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.807443+0000","last_change":"2024-01-24T13:04:00.052891+0000","last_active":"2024-01-24T13:04:01.807443+0000","last_peered":"2024-01-24T13:04:01.807443+0000","last_clean":"2024-01-24T13:04:01.807443+0000","last_became_active":"2024-01-24T13:04:00.051617+0000","last_became_peered":"2024-01-24T13:04:00.051617+0000","last_unstale":"2024-01-24T13:04:01.807443+0000","last_undegraded":"2024-01-24T13:04:01.807443+0000","last_fullsized":"2024-01-24T13:04:01.807443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:35.624217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.022993+0000","last_change":"2024-01-24T13:03:56.009995+0000","last_active":"2024-01-24T13:04:00.022993+0000","last_peered":"2024-01-24T13:04:00.022993+0000","last_clean":"2024-01-24T13:04:00.022993+0000","last_became_active":"2024-01-24T13:03:56.009662+0000","last_became_peered":"2024-01-24T13:03:56.009662+0000","last_unstale":"2024-01-24T13:04:00.022993+0000","last_undegraded":"2024-01-24T13:04:00.022993+0000","last_fullsized":"2024-01-24T13:04:00.022993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:28.956711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011686+0000","last_change":"2024-01-24T13:03:55.595933+0000","last_active":"2024-01-24T13:04:00.011686+0000","last_peered":"2024-01-24T13:04:00.011686+0000","last_clean":"2024-01-24T13:04:00.011686+0000","last_became_active":"2024-01-24T13:03:55.594957+0000","last_became_peered":"2024-01-24T13:03:55.594957+0000","last_unstale":"2024-01-24T13:04:00.011686+0000","last_undegraded":"2024-01-24T13:04:00.011686+0000","last_fullsized":"2024-01-24T13:04:00.011686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:12.091224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.808365+0000","last_change":"2024-01-24T13:04:00.045610+0000","last_active":"2024-01-24T13:04:01.808365+0000","last_peered":"2024-01-24T13:04:01.808365+0000","last_clean":"2024-01-24T13:04:01.808365+0000","last_became_active":"2024-01-24T13:04:00.044937+0000","last_became_peered":"2024-01-24T13:04:00.044937+0000","last_unstale":"2024-01-24T13:04:01.808365+0000","last_undegraded":"2024-01-24T13:04:01.808365+0000","last_fullsized":"2024-01-24T13:04:01.808365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T01:02:53.163148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015631+0000","last_change":"2024-01-24T13:03:56.016991+0000","last_active":"2024-01-24T13:04:01.015631+0000","last_peered":"2024-01-24T13:04:01.015631+0000","last_clean":"2024-01-24T13:04:01.015631+0000","last_became_active":"2024-01-24T13:03:56.016720+0000","last_became_peered":"2024-01-24T13:03:56.016720+0000","last_unstale":"2024-01-24T13:04:01.015631+0000","last_undegraded":"2024-01-24T13:04:01.015631+0000","last_fullsized":"2024-01-24T13:04:01.015631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:33:24.896330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016383+0000","last_change":"2024-01-24T13:03:55.598471+0000","last_active":"2024-01-24T13:04:01.016383+0000","last_peered":"2024-01-24T13:04:01.016383+0000","last_clean":"2024-01-24T13:04:01.016383+0000","last_became_active":"2024-01-24T13:03:55.598159+0000","last_became_peered":"2024-01-24T13:03:55.598159+0000","last_unstale":"2024-01-24T13:04:01.016383+0000","last_undegraded":"2024-01-24T13:04:01.016383+0000","last_fullsized":"2024-01-24T13:04:01.016383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:40:38.850663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806777+0000","last_change":"2024-01-24T13:04:00.040424+0000","last_active":"2024-01-24T13:04:01.806777+0000","last_peered":"2024-01-24T13:04:01.806777+0000","last_clean":"2024-01-24T13:04:01.806777+0000","last_became_active":"2024-01-24T13:04:00.038744+0000","last_became_peered":"2024-01-24T13:04:00.038744+0000","last_unstale":"2024-01-24T13:04:01.806777+0000","last_undegraded":"2024-01-24T13:04:01.806777+0000","last_fullsized":"2024-01-24T13:04:01.806777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:48:26.063259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018273+0000","last_change":"2024-01-24T13:03:56.014411+0000","last_active":"2024-01-24T13:04:00.018273+0000","last_peered":"2024-01-24T13:04:00.018273+0000","last_clean":"2024-01-24T13:04:00.018273+0000","last_became_active":"2024-01-24T13:03:56.014076+0000","last_became_peered":"2024-01-24T13:03:56.014076+0000","last_unstale":"2024-01-24T13:04:00.018273+0000","last_undegraded":"2024-01-24T13:04:00.018273+0000","last_fullsized":"2024-01-24T13:04:00.018273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:13.098994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011676+0000","last_change":"2024-01-24T13:03:55.603197+0000","last_active":"2024-01-24T13:04:00.011676+0000","last_peered":"2024-01-24T13:04:00.011676+0000","last_clean":"2024-01-24T13:04:00.011676+0000","last_became_active":"2024-01-24T13:03:55.600175+0000","last_became_peered":"2024-01-24T13:03:55.600175+0000","last_unstale":"2024-01-24T13:04:00.011676+0000","last_undegraded":"2024-01-24T13:04:00.011676+0000","last_fullsized":"2024-01-24T13:04:00.011676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:30:38.906451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016791+0000","last_change":"2024-01-24T13:04:00.049384+0000","last_active":"2024-01-24T13:04:01.016791+0000","last_peered":"2024-01-24T13:04:01.016791+0000","last_clean":"2024-01-24T13:04:01.016791+0000","last_became_active":"2024-01-24T13:04:00.048632+0000","last_became_peered":"2024-01-24T13:04:00.048632+0000","last_unstale":"2024-01-24T13:04:01.016791+0000","last_undegraded":"2024-01-24T13:04:01.016791+0000","last_fullsized":"2024-01-24T13:04:01.016791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:06:53.027528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019637+0000","last_change":"2024-01-24T13:03:56.018433+0000","last_active":"2024-01-24T13:04:00.019637+0000","last_peered":"2024-01-24T13:04:00.019637+0000","last_clean":"2024-01-24T13:04:00.019637+0000","last_became_active":"2024-01-24T13:03:56.018164+0000","last_became_peered":"2024-01-24T13:03:56.018164+0000","last_unstale":"2024-01-24T13:04:00.019637+0000","last_undegraded":"2024-01-24T13:04:00.019637+0000","last_fullsized":"2024-01-24T13:04:00.019637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:26:27.582337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011717+0000","last_change":"2024-01-24T13:03:55.597798+0000","last_active":"2024-01-24T13:04:00.011717+0000","last_peered":"2024-01-24T13:04:00.011717+0000","last_clean":"2024-01-24T13:04:00.011717+0000","last_became_active":"2024-01-24T13:03:55.597513+0000","last_became_peered":"2024-01-24T13:03:55.597513+0000","last_unstale":"2024-01-24T13:04:00.011717+0000","last_undegraded":"2024-01-24T13:04:00.011717+0000","last_fullsized":"2024-01-24T13:04:00.011717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:18:51.734678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.023086+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:04:00.023086+0000","last_peered":"2024-01-24T13:04:00.023086+0000","last_clean":"2024-01-24T13:04:00.023086+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:04:00.023086+0000","last_undegraded":"2024-01-24T13:04:00.023086+0000","last_fullsized":"2024-01-24T13:04:00.023086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806680+0000","last_change":"2024-01-24T13:04:00.038740+0000","last_active":"2024-01-24T13:04:01.806680+0000","last_peered":"2024-01-24T13:04:01.806680+0000","last_clean":"2024-01-24T13:04:01.806680+0000","last_became_active":"2024-01-24T13:04:00.038231+0000","last_became_peered":"2024-01-24T13:04:00.038231+0000","last_unstale":"2024-01-24T13:04:01.806680+0000","last_undegraded":"2024-01-24T13:04:01.806680+0000","last_fullsized":"2024-01-24T13:04:01.806680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:08:54.372154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.012909+0000","last_change":"2024-01-24T13:03:56.016055+0000","last_active":"2024-01-24T13:04:00.012909+0000","last_peered":"2024-01-24T13:04:00.012909+0000","last_clean":"2024-01-24T13:04:00.012909+0000","last_became_active":"2024-01-24T13:03:56.015784+0000","last_became_peered":"2024-01-24T13:03:56.015784+0000","last_unstale":"2024-01-24T13:04:00.012909+0000","last_undegraded":"2024-01-24T13:04:00.012909+0000","last_fullsized":"2024-01-24T13:04:00.012909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:37:02.929160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018991+0000","last_change":"2024-01-24T13:03:55.608578+0000","last_active":"2024-01-24T13:04:00.018991+0000","last_peered":"2024-01-24T13:04:00.018991+0000","last_clean":"2024-01-24T13:04:00.018991+0000","last_became_active":"2024-01-24T13:03:55.608223+0000","last_became_peered":"2024-01-24T13:03:55.608223+0000","last_unstale":"2024-01-24T13:04:00.018991+0000","last_undegraded":"2024-01-24T13:04:00.018991+0000","last_fullsized":"2024-01-24T13:04:00.018991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:40:38.850663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805871+0000","last_change":"2024-01-24T13:04:00.036185+0000","last_active":"2024-01-24T13:04:01.805871+0000","last_peered":"2024-01-24T13:04:01.805871+0000","last_clean":"2024-01-24T13:04:01.805871+0000","last_became_active":"2024-01-24T13:04:00.035683+0000","last_became_peered":"2024-01-24T13:04:00.035683+0000","last_unstale":"2024-01-24T13:04:01.805871+0000","last_undegraded":"2024-01-24T13:04:01.805871+0000","last_fullsized":"2024-01-24T13:04:01.805871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:35.010431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.025989+0000","last_change":"2024-01-24T13:03:56.010590+0000","last_active":"2024-01-24T13:04:00.025989+0000","last_peered":"2024-01-24T13:04:00.025989+0000","last_clean":"2024-01-24T13:04:00.025989+0000","last_became_active":"2024-01-24T13:03:56.010337+0000","last_became_peered":"2024-01-24T13:03:56.010337+0000","last_unstale":"2024-01-24T13:04:00.025989+0000","last_undegraded":"2024-01-24T13:04:00.025989+0000","last_fullsized":"2024-01-24T13:04:00.025989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:33:30.023414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016888+0000","last_change":"2024-01-24T13:03:55.598738+0000","last_active":"2024-01-24T13:04:01.016888+0000","last_peered":"2024-01-24T13:04:01.016888+0000","last_clean":"2024-01-24T13:04:01.016888+0000","last_became_active":"2024-01-24T13:03:55.598468+0000","last_became_peered":"2024-01-24T13:03:55.598468+0000","last_unstale":"2024-01-24T13:04:01.016888+0000","last_undegraded":"2024-01-24T13:04:01.016888+0000","last_fullsized":"2024-01-24T13:04:01.016888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:33:00.188281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016100+0000","last_change":"2024-01-24T13:04:00.047084+0000","last_active":"2024-01-24T13:04:01.016100+0000","last_peered":"2024-01-24T13:04:01.016100+0000","last_clean":"2024-01-24T13:04:01.016100+0000","last_became_active":"2024-01-24T13:04:00.046694+0000","last_became_peered":"2024-01-24T13:04:00.046694+0000","last_unstale":"2024-01-24T13:04:01.016100+0000","last_undegraded":"2024-01-24T13:04:01.016100+0000","last_fullsized":"2024-01-24T13:04:01.016100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:11:37.105076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.028935+0000","last_change":"2024-01-24T13:03:56.011152+0000","last_active":"2024-01-24T13:04:00.028935+0000","last_peered":"2024-01-24T13:04:00.028935+0000","last_clean":"2024-01-24T13:04:00.028935+0000","last_became_active":"2024-01-24T13:03:56.010924+0000","last_became_peered":"2024-01-24T13:03:56.010924+0000","last_unstale":"2024-01-24T13:04:00.028935+0000","last_undegraded":"2024-01-24T13:04:00.028935+0000","last_fullsized":"2024-01-24T13:04:00.028935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:14:00.774178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020323+0000","last_change":"2024-01-24T13:03:55.602406+0000","last_active":"2024-01-24T13:04:00.020323+0000","last_peered":"2024-01-24T13:04:00.020323+0000","last_clean":"2024-01-24T13:04:00.020323+0000","last_became_active":"2024-01-24T13:03:55.601915+0000","last_became_peered":"2024-01-24T13:03:55.601915+0000","last_unstale":"2024-01-24T13:04:00.020323+0000","last_undegraded":"2024-01-24T13:04:00.020323+0000","last_fullsized":"2024-01-24T13:04:00.020323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:02:25.134363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805322+0000","last_change":"2024-01-24T13:04:00.028655+0000","last_active":"2024-01-24T13:04:01.805322+0000","last_peered":"2024-01-24T13:04:01.805322+0000","last_clean":"2024-01-24T13:04:01.805322+0000","last_became_active":"2024-01-24T13:04:00.028105+0000","last_became_peered":"2024-01-24T13:04:00.028105+0000","last_unstale":"2024-01-24T13:04:01.805322+0000","last_undegraded":"2024-01-24T13:04:01.805322+0000","last_fullsized":"2024-01-24T13:04:01.805322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:54:22.271694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013786+0000","last_change":"2024-01-24T13:03:56.002044+0000","last_active":"2024-01-24T13:04:01.013786+0000","last_peered":"2024-01-24T13:04:01.013786+0000","last_clean":"2024-01-24T13:04:01.013786+0000","last_became_active":"2024-01-24T13:03:56.001772+0000","last_became_peered":"2024-01-24T13:03:56.001772+0000","last_unstale":"2024-01-24T13:04:01.013786+0000","last_undegraded":"2024-01-24T13:04:01.013786+0000","last_fullsized":"2024-01-24T13:04:01.013786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:54:36.348326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.029043+0000","last_change":"2024-01-24T13:03:55.601600+0000","last_active":"2024-01-24T13:04:00.029043+0000","last_peered":"2024-01-24T13:04:00.029043+0000","last_clean":"2024-01-24T13:04:00.029043+0000","last_became_active":"2024-01-24T13:03:55.601309+0000","last_became_peered":"2024-01-24T13:03:55.601309+0000","last_unstale":"2024-01-24T13:04:00.029043+0000","last_undegraded":"2024-01-24T13:04:00.029043+0000","last_fullsized":"2024-01-24T13:04:00.029043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:39.217211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.652527+0000","last_change":"2024-01-24T13:04:00.048932+0000","last_active":"2024-01-24T13:04:01.652527+0000","last_peered":"2024-01-24T13:04:01.652527+0000","last_clean":"2024-01-24T13:04:01.652527+0000","last_became_active":"2024-01-24T13:04:00.048532+0000","last_became_peered":"2024-01-24T13:04:00.048532+0000","last_unstale":"2024-01-24T13:04:01.652527+0000","last_undegraded":"2024-01-24T13:04:01.652527+0000","last_fullsized":"2024-01-24T13:04:01.652527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:46:41.343291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011316+0000","last_change":"2024-01-24T13:03:56.014290+0000","last_active":"2024-01-24T13:04:00.011316+0000","last_peered":"2024-01-24T13:04:00.011316+0000","last_clean":"2024-01-24T13:04:00.011316+0000","last_became_active":"2024-01-24T13:03:56.014029+0000","last_became_peered":"2024-01-24T13:03:56.014029+0000","last_unstale":"2024-01-24T13:04:00.011316+0000","last_undegraded":"2024-01-24T13:04:00.011316+0000","last_fullsized":"2024-01-24T13:04:00.011316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:09:08.217574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017500+0000","last_change":"2024-01-24T13:03:55.600217+0000","last_active":"2024-01-24T13:04:00.017500+0000","last_peered":"2024-01-24T13:04:00.017500+0000","last_clean":"2024-01-24T13:04:00.017500+0000","last_became_active":"2024-01-24T13:03:55.599923+0000","last_became_peered":"2024-01-24T13:03:55.599923+0000","last_unstale":"2024-01-24T13:04:00.017500+0000","last_undegraded":"2024-01-24T13:04:00.017500+0000","last_fullsized":"2024-01-24T13:04:00.017500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:23:39.711167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017117+0000","last_change":"2024-01-24T13:04:00.049088+0000","last_active":"2024-01-24T13:04:01.017117+0000","last_peered":"2024-01-24T13:04:01.017117+0000","last_clean":"2024-01-24T13:04:01.017117+0000","last_became_active":"2024-01-24T13:04:00.048038+0000","last_became_peered":"2024-01-24T13:04:00.048038+0000","last_unstale":"2024-01-24T13:04:01.017117+0000","last_undegraded":"2024-01-24T13:04:01.017117+0000","last_fullsized":"2024-01-24T13:04:01.017117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:25:56.475987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021646+0000","last_change":"2024-01-24T13:03:56.025258+0000","last_active":"2024-01-24T13:04:00.021646+0000","last_peered":"2024-01-24T13:04:00.021646+0000","last_clean":"2024-01-24T13:04:00.021646+0000","last_became_active":"2024-01-24T13:03:56.025008+0000","last_became_peered":"2024-01-24T13:03:56.025008+0000","last_unstale":"2024-01-24T13:04:00.021646+0000","last_undegraded":"2024-01-24T13:04:00.021646+0000","last_fullsized":"2024-01-24T13:04:00.021646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:13.098994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021114+0000","last_change":"2024-01-24T13:03:55.606138+0000","last_active":"2024-01-24T13:04:00.021114+0000","last_peered":"2024-01-24T13:04:00.021114+0000","last_clean":"2024-01-24T13:04:00.021114+0000","last_became_active":"2024-01-24T13:03:55.605730+0000","last_became_peered":"2024-01-24T13:03:55.605730+0000","last_unstale":"2024-01-24T13:04:00.021114+0000","last_undegraded":"2024-01-24T13:04:00.021114+0000","last_fullsized":"2024-01-24T13:04:00.021114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:13.842299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017136+0000","last_change":"2024-01-24T13:04:00.047326+0000","last_active":"2024-01-24T13:04:01.017136+0000","last_peered":"2024-01-24T13:04:01.017136+0000","last_clean":"2024-01-24T13:04:01.017136+0000","last_became_active":"2024-01-24T13:04:00.046914+0000","last_became_peered":"2024-01-24T13:04:00.046914+0000","last_unstale":"2024-01-24T13:04:01.017136+0000","last_undegraded":"2024-01-24T13:04:01.017136+0000","last_fullsized":"2024-01-24T13:04:01.017136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:55:11.375322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011611+0000","last_change":"2024-01-24T13:03:56.023957+0000","last_active":"2024-01-24T13:04:00.011611+0000","last_peered":"2024-01-24T13:04:00.011611+0000","last_clean":"2024-01-24T13:04:00.011611+0000","last_became_active":"2024-01-24T13:03:56.022133+0000","last_became_peered":"2024-01-24T13:03:56.022133+0000","last_unstale":"2024-01-24T13:04:00.011611+0000","last_undegraded":"2024-01-24T13:04:00.011611+0000","last_fullsized":"2024-01-24T13:04:00.011611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:14:00.774178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011695+0000","last_change":"2024-01-24T13:03:55.596366+0000","last_active":"2024-01-24T13:04:00.011695+0000","last_peered":"2024-01-24T13:04:00.011695+0000","last_clean":"2024-01-24T13:04:00.011695+0000","last_became_active":"2024-01-24T13:03:55.593651+0000","last_became_peered":"2024-01-24T13:03:55.593651+0000","last_unstale":"2024-01-24T13:04:00.011695+0000","last_undegraded":"2024-01-24T13:04:00.011695+0000","last_fullsized":"2024-01-24T13:04:00.011695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:39.217211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.807643+0000","last_change":"2024-01-24T13:04:00.045823+0000","last_active":"2024-01-24T13:04:01.807643+0000","last_peered":"2024-01-24T13:04:01.807643+0000","last_clean":"2024-01-24T13:04:01.807643+0000","last_became_active":"2024-01-24T13:04:00.045308+0000","last_became_peered":"2024-01-24T13:04:00.045308+0000","last_unstale":"2024-01-24T13:04:01.807643+0000","last_undegraded":"2024-01-24T13:04:01.807643+0000","last_fullsized":"2024-01-24T13:04:01.807643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:48:59.613697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017004+0000","last_change":"2024-01-24T13:03:56.006377+0000","last_active":"2024-01-24T13:04:00.017004+0000","last_peered":"2024-01-24T13:04:00.017004+0000","last_clean":"2024-01-24T13:04:00.017004+0000","last_became_active":"2024-01-24T13:03:56.006045+0000","last_became_peered":"2024-01-24T13:03:56.006045+0000","last_unstale":"2024-01-24T13:04:00.017004+0000","last_undegraded":"2024-01-24T13:04:00.017004+0000","last_fullsized":"2024-01-24T13:04:00.017004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:30:39.914222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016729+0000","last_change":"2024-01-24T13:03:55.606775+0000","last_active":"2024-01-24T13:04:01.016729+0000","last_peered":"2024-01-24T13:04:01.016729+0000","last_clean":"2024-01-24T13:04:01.016729+0000","last_became_active":"2024-01-24T13:03:55.606406+0000","last_became_peered":"2024-01-24T13:03:55.606406+0000","last_unstale":"2024-01-24T13:04:01.016729+0000","last_undegraded":"2024-01-24T13:04:01.016729+0000","last_fullsized":"2024-01-24T13:04:01.016729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:03:38.642654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806328+0000","last_change":"2024-01-24T13:04:00.049217+0000","last_active":"2024-01-24T13:04:01.806328+0000","last_peered":"2024-01-24T13:04:01.806328+0000","last_clean":"2024-01-24T13:04:01.806328+0000","last_became_active":"2024-01-24T13:04:00.048805+0000","last_became_peered":"2024-01-24T13:04:00.048805+0000","last_unstale":"2024-01-24T13:04:01.806328+0000","last_undegraded":"2024-01-24T13:04:01.806328+0000","last_fullsized":"2024-01-24T13:04:01.806328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:51:50.366250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.031010+0000","last_change":"2024-01-24T13:03:56.016870+0000","last_active":"2024-01-24T13:04:00.031010+0000","last_peered":"2024-01-24T13:04:00.031010+0000","last_clean":"2024-01-24T13:04:00.031010+0000","last_became_active":"2024-01-24T13:03:56.016600+0000","last_became_peered":"2024-01-24T13:03:56.016600+0000","last_unstale":"2024-01-24T13:04:00.031010+0000","last_undegraded":"2024-01-24T13:04:00.031010+0000","last_fullsized":"2024-01-24T13:04:00.031010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:50:02.158087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'10","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:11.278469+0000","last_change":"2024-01-24T13:03:55.600760+0000","last_active":"2024-01-24T13:04:11.278469+0000","last_peered":"2024-01-24T13:04:11.278469+0000","last_clean":"2024-01-24T13:04:11.278469+0000","last_became_active":"2024-01-24T13:03:55.600478+0000","last_became_peered":"2024-01-24T13:03:55.600478+0000","last_unstale":"2024-01-24T13:04:11.278469+0000","last_undegraded":"2024-01-24T13:04:11.278469+0000","last_fullsized":"2024-01-24T13:04:11.278469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:35:44.393474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149129+0000","last_change":"2024-01-24T13:04:00.047921+0000","last_active":"2024-01-24T13:04:01.149129+0000","last_peered":"2024-01-24T13:04:01.149129+0000","last_clean":"2024-01-24T13:04:01.149129+0000","last_became_active":"2024-01-24T13:04:00.047461+0000","last_became_peered":"2024-01-24T13:04:00.047461+0000","last_unstale":"2024-01-24T13:04:01.149129+0000","last_undegraded":"2024-01-24T13:04:01.149129+0000","last_fullsized":"2024-01-24T13:04:01.149129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:35.010431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011713+0000","last_change":"2024-01-24T13:03:56.019212+0000","last_active":"2024-01-24T13:04:00.011713+0000","last_peered":"2024-01-24T13:04:00.011713+0000","last_clean":"2024-01-24T13:04:00.011713+0000","last_became_active":"2024-01-24T13:03:56.018880+0000","last_became_peered":"2024-01-24T13:03:56.018880+0000","last_unstale":"2024-01-24T13:04:00.011713+0000","last_undegraded":"2024-01-24T13:04:00.011713+0000","last_fullsized":"2024-01-24T13:04:00.011713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T01:02:49.724251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017145+0000","last_change":"2024-01-24T13:03:55.599109+0000","last_active":"2024-01-24T13:04:01.017145+0000","last_peered":"2024-01-24T13:04:01.017145+0000","last_clean":"2024-01-24T13:04:01.017145+0000","last_became_active":"2024-01-24T13:03:55.598819+0000","last_became_peered":"2024-01-24T13:03:55.598819+0000","last_unstale":"2024-01-24T13:04:01.017145+0000","last_undegraded":"2024-01-24T13:04:01.017145+0000","last_fullsized":"2024-01-24T13:04:01.017145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:45:36.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806220+0000","last_change":"2024-01-24T13:04:00.039074+0000","last_active":"2024-01-24T13:04:01.806220+0000","last_peered":"2024-01-24T13:04:01.806220+0000","last_clean":"2024-01-24T13:04:01.806220+0000","last_became_active":"2024-01-24T13:04:00.038717+0000","last_became_peered":"2024-01-24T13:04:00.038717+0000","last_unstale":"2024-01-24T13:04:01.806220+0000","last_undegraded":"2024-01-24T13:04:01.806220+0000","last_fullsized":"2024-01-24T13:04:01.806220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:16:03.907815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017269+0000","last_change":"2024-01-24T13:03:56.012177+0000","last_active":"2024-01-24T13:04:01.017269+0000","last_peered":"2024-01-24T13:04:01.017269+0000","last_clean":"2024-01-24T13:04:01.017269+0000","last_became_active":"2024-01-24T13:03:56.011917+0000","last_became_peered":"2024-01-24T13:03:56.011917+0000","last_unstale":"2024-01-24T13:04:01.017269+0000","last_undegraded":"2024-01-24T13:04:01.017269+0000","last_fullsized":"2024-01-24T13:04:01.017269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:37.212289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.028063+0000","last_change":"2024-01-24T13:03:55.602617+0000","last_active":"2024-01-24T13:04:00.028063+0000","last_peered":"2024-01-24T13:04:00.028063+0000","last_clean":"2024-01-24T13:04:00.028063+0000","last_became_active":"2024-01-24T13:03:55.602297+0000","last_became_peered":"2024-01-24T13:03:55.602297+0000","last_unstale":"2024-01-24T13:04:00.028063+0000","last_undegraded":"2024-01-24T13:04:00.028063+0000","last_fullsized":"2024-01-24T13:04:00.028063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:08.959080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806443+0000","last_change":"2024-01-24T13:04:00.043082+0000","last_active":"2024-01-24T13:04:01.806443+0000","last_peered":"2024-01-24T13:04:01.806443+0000","last_clean":"2024-01-24T13:04:01.806443+0000","last_became_active":"2024-01-24T13:04:00.042663+0000","last_became_peered":"2024-01-24T13:04:00.042663+0000","last_unstale":"2024-01-24T13:04:01.806443+0000","last_undegraded":"2024-01-24T13:04:01.806443+0000","last_fullsized":"2024-01-24T13:04:01.806443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:13:01.067406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013739+0000","last_change":"2024-01-24T13:03:56.007996+0000","last_active":"2024-01-24T13:04:01.013739+0000","last_peered":"2024-01-24T13:04:01.013739+0000","last_clean":"2024-01-24T13:04:01.013739+0000","last_became_active":"2024-01-24T13:03:56.006784+0000","last_became_peered":"2024-01-24T13:03:56.006784+0000","last_unstale":"2024-01-24T13:04:01.013739+0000","last_undegraded":"2024-01-24T13:04:01.013739+0000","last_fullsized":"2024-01-24T13:04:01.013739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:18:52.742448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.022444+0000","last_change":"2024-01-24T13:03:55.598172+0000","last_active":"2024-01-24T13:04:00.022444+0000","last_peered":"2024-01-24T13:04:00.022444+0000","last_clean":"2024-01-24T13:04:00.022444+0000","last_became_active":"2024-01-24T13:03:55.597945+0000","last_became_peered":"2024-01-24T13:03:55.597945+0000","last_unstale":"2024-01-24T13:04:00.022444+0000","last_undegraded":"2024-01-24T13:04:00.022444+0000","last_fullsized":"2024-01-24T13:04:00.022444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:40:38.850663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149379+0000","last_change":"2024-01-24T13:04:00.033699+0000","last_active":"2024-01-24T13:04:01.149379+0000","last_peered":"2024-01-24T13:04:01.149379+0000","last_clean":"2024-01-24T13:04:01.149379+0000","last_became_active":"2024-01-24T13:04:00.032771+0000","last_became_peered":"2024-01-24T13:04:00.032771+0000","last_unstale":"2024-01-24T13:04:01.149379+0000","last_undegraded":"2024-01-24T13:04:01.149379+0000","last_fullsized":"2024-01-24T13:04:01.149379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:16:03.907815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.150744+0000","last_change":"2024-01-24T13:04:00.053152+0000","last_active":"2024-01-24T13:04:01.150744+0000","last_peered":"2024-01-24T13:04:01.150744+0000","last_clean":"2024-01-24T13:04:01.150744+0000","last_became_active":"2024-01-24T13:04:00.052760+0000","last_became_peered":"2024-01-24T13:04:00.052760+0000","last_unstale":"2024-01-24T13:04:01.150744+0000","last_undegraded":"2024-01-24T13:04:01.150744+0000","last_fullsized":"2024-01-24T13:04:01.150744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019513+0000","last_change":"2024-01-24T13:03:56.010008+0000","last_active":"2024-01-24T13:04:00.019513+0000","last_peered":"2024-01-24T13:04:00.019513+0000","last_clean":"2024-01-24T13:04:00.019513+0000","last_became_active":"2024-01-24T13:03:56.009750+0000","last_became_peered":"2024-01-24T13:03:56.009750+0000","last_unstale":"2024-01-24T13:04:00.019513+0000","last_undegraded":"2024-01-24T13:04:00.019513+0000","last_fullsized":"2024-01-24T13:04:00.019513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:46:37.904394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011569+0000","last_change":"2024-01-24T13:03:55.592274+0000","last_active":"2024-01-24T13:04:00.011569+0000","last_peered":"2024-01-24T13:04:00.011569+0000","last_clean":"2024-01-24T13:04:00.011569+0000","last_became_active":"2024-01-24T13:03:55.591994+0000","last_became_peered":"2024-01-24T13:03:55.591994+0000","last_unstale":"2024-01-24T13:04:00.011569+0000","last_undegraded":"2024-01-24T13:04:00.011569+0000","last_fullsized":"2024-01-24T13:04:00.011569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:08.959080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806986+0000","last_change":"2024-01-24T13:04:00.053348+0000","last_active":"2024-01-24T13:04:01.806986+0000","last_peered":"2024-01-24T13:04:01.806986+0000","last_clean":"2024-01-24T13:04:01.806986+0000","last_became_active":"2024-01-24T13:04:00.052859+0000","last_became_peered":"2024-01-24T13:04:00.052859+0000","last_unstale":"2024-01-24T13:04:01.806986+0000","last_undegraded":"2024-01-24T13:04:01.806986+0000","last_fullsized":"2024-01-24T13:04:01.806986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:31:55.847658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015772+0000","last_change":"2024-01-24T13:03:56.013494+0000","last_active":"2024-01-24T13:04:01.015772+0000","last_peered":"2024-01-24T13:04:01.015772+0000","last_clean":"2024-01-24T13:04:01.015772+0000","last_became_active":"2024-01-24T13:03:56.013241+0000","last_became_peered":"2024-01-24T13:03:56.013241+0000","last_unstale":"2024-01-24T13:04:01.015772+0000","last_undegraded":"2024-01-24T13:04:01.015772+0000","last_fullsized":"2024-01-24T13:04:01.015772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:09:52.534215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018229+0000","last_change":"2024-01-24T13:03:55.608610+0000","last_active":"2024-01-24T13:04:00.018229+0000","last_peered":"2024-01-24T13:04:00.018229+0000","last_clean":"2024-01-24T13:04:00.018229+0000","last_became_active":"2024-01-24T13:03:55.608272+0000","last_became_peered":"2024-01-24T13:03:55.608272+0000","last_unstale":"2024-01-24T13:04:00.018229+0000","last_undegraded":"2024-01-24T13:04:00.018229+0000","last_fullsized":"2024-01-24T13:04:00.018229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:03:38.642654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011518+0000","last_change":"2024-01-24T13:03:55.603336+0000","last_active":"2024-01-24T13:04:00.011518+0000","last_peered":"2024-01-24T13:04:00.011518+0000","last_clean":"2024-01-24T13:04:00.011518+0000","last_became_active":"2024-01-24T13:03:55.603034+0000","last_became_peered":"2024-01-24T13:03:55.603034+0000","last_unstale":"2024-01-24T13:04:00.011518+0000","last_undegraded":"2024-01-24T13:04:00.011518+0000","last_fullsized":"2024-01-24T13:04:00.011518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:54:35.340555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019760+0000","last_change":"2024-01-24T13:03:56.023712+0000","last_active":"2024-01-24T13:04:00.019760+0000","last_peered":"2024-01-24T13:04:00.019760+0000","last_clean":"2024-01-24T13:04:00.019760+0000","last_became_active":"2024-01-24T13:03:56.023037+0000","last_became_peered":"2024-01-24T13:03:56.023037+0000","last_unstale":"2024-01-24T13:04:00.019760+0000","last_undegraded":"2024-01-24T13:04:00.019760+0000","last_fullsized":"2024-01-24T13:04:00.019760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:10:17.205776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149525+0000","last_change":"2024-01-24T13:04:00.049354+0000","last_active":"2024-01-24T13:04:01.149525+0000","last_peered":"2024-01-24T13:04:01.149525+0000","last_clean":"2024-01-24T13:04:01.149525+0000","last_became_active":"2024-01-24T13:04:00.048648+0000","last_became_peered":"2024-01-24T13:04:00.048648+0000","last_unstale":"2024-01-24T13:04:01.149525+0000","last_undegraded":"2024-01-24T13:04:01.149525+0000","last_fullsized":"2024-01-24T13:04:01.149525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:37:19.983867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016202+0000","last_change":"2024-01-24T13:03:55.595499+0000","last_active":"2024-01-24T13:04:01.016202+0000","last_peered":"2024-01-24T13:04:01.016202+0000","last_clean":"2024-01-24T13:04:01.016202+0000","last_became_active":"2024-01-24T13:03:55.595229+0000","last_became_peered":"2024-01-24T13:03:55.595229+0000","last_unstale":"2024-01-24T13:04:01.016202+0000","last_undegraded":"2024-01-24T13:04:01.016202+0000","last_fullsized":"2024-01-24T13:04:01.016202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:33:37.210242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020904+0000","last_change":"2024-01-24T13:03:56.025558+0000","last_active":"2024-01-24T13:04:00.020904+0000","last_peered":"2024-01-24T13:04:00.020904+0000","last_clean":"2024-01-24T13:04:00.020904+0000","last_became_active":"2024-01-24T13:03:56.023819+0000","last_became_peered":"2024-01-24T13:03:56.023819+0000","last_unstale":"2024-01-24T13:04:00.020904+0000","last_undegraded":"2024-01-24T13:04:00.020904+0000","last_fullsized":"2024-01-24T13:04:00.020904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.807832+0000","last_change":"2024-01-24T13:04:00.050356+0000","last_active":"2024-01-24T13:04:01.807832+0000","last_peered":"2024-01-24T13:04:01.807832+0000","last_clean":"2024-01-24T13:04:01.807832+0000","last_became_active":"2024-01-24T13:04:00.049681+0000","last_became_peered":"2024-01-24T13:04:00.049681+0000","last_unstale":"2024-01-24T13:04:01.807832+0000","last_undegraded":"2024-01-24T13:04:01.807832+0000","last_fullsized":"2024-01-24T13:04:01.807832+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:37:06.368057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013232+0000","last_change":"2024-01-24T13:03:56.004498+0000","last_active":"2024-01-24T13:04:01.013232+0000","last_peered":"2024-01-24T13:04:01.013232+0000","last_clean":"2024-01-24T13:04:01.013232+0000","last_became_active":"2024-01-24T13:03:56.004175+0000","last_became_peered":"2024-01-24T13:03:56.004175+0000","last_unstale":"2024-01-24T13:04:01.013232+0000","last_undegraded":"2024-01-24T13:04:01.013232+0000","last_fullsized":"2024-01-24T13:04:01.013232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016280+0000","last_change":"2024-01-24T13:03:56.022795+0000","last_active":"2024-01-24T13:04:01.016280+0000","last_peered":"2024-01-24T13:04:01.016280+0000","last_clean":"2024-01-24T13:04:01.016280+0000","last_became_active":"2024-01-24T13:03:56.022534+0000","last_became_peered":"2024-01-24T13:03:56.022534+0000","last_unstale":"2024-01-24T13:04:01.016280+0000","last_undegraded":"2024-01-24T13:04:01.016280+0000","last_fullsized":"2024-01-24T13:04:01.016280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:14.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011421+0000","last_change":"2024-01-24T13:03:56.017677+0000","last_active":"2024-01-24T13:04:00.011421+0000","last_peered":"2024-01-24T13:04:00.011421+0000","last_clean":"2024-01-24T13:04:00.011421+0000","last_became_active":"2024-01-24T13:03:56.017371+0000","last_became_peered":"2024-01-24T13:03:56.017371+0000","last_unstale":"2024-01-24T13:04:00.011421+0000","last_undegraded":"2024-01-24T13:04:00.011421+0000","last_fullsized":"2024-01-24T13:04:00.011421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:33:30.023414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016121+0000","last_change":"2024-01-24T13:03:56.018818+0000","last_active":"2024-01-24T13:04:01.016121+0000","last_peered":"2024-01-24T13:04:01.016121+0000","last_clean":"2024-01-24T13:04:01.016121+0000","last_became_active":"2024-01-24T13:03:56.018526+0000","last_became_peered":"2024-01-24T13:03:56.018526+0000","last_unstale":"2024-01-24T13:04:01.016121+0000","last_undegraded":"2024-01-24T13:04:01.016121+0000","last_fullsized":"2024-01-24T13:04:01.016121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:03:08.353848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018278+0000","last_change":"2024-01-24T13:03:56.021986+0000","last_active":"2024-01-24T13:04:00.018278+0000","last_peered":"2024-01-24T13:04:00.018278+0000","last_clean":"2024-01-24T13:04:00.018278+0000","last_became_active":"2024-01-24T13:03:56.021722+0000","last_became_peered":"2024-01-24T13:03:56.021722+0000","last_unstale":"2024-01-24T13:04:00.018278+0000","last_undegraded":"2024-01-24T13:04:00.018278+0000","last_fullsized":"2024-01-24T13:04:00.018278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:41:53.447100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018684+0000","last_change":"2024-01-24T13:03:56.017766+0000","last_active":"2024-01-24T13:04:00.018684+0000","last_peered":"2024-01-24T13:04:00.018684+0000","last_clean":"2024-01-24T13:04:00.018684+0000","last_became_active":"2024-01-24T13:03:56.017460+0000","last_became_peered":"2024-01-24T13:03:56.017460+0000","last_unstale":"2024-01-24T13:04:00.018684+0000","last_undegraded":"2024-01-24T13:04:00.018684+0000","last_fullsized":"2024-01-24T13:04:00.018684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013764+0000","last_change":"2024-01-24T13:03:56.006732+0000","last_active":"2024-01-24T13:04:01.013764+0000","last_peered":"2024-01-24T13:04:01.013764+0000","last_clean":"2024-01-24T13:04:01.013764+0000","last_became_active":"2024-01-24T13:03:56.006500+0000","last_became_peered":"2024-01-24T13:03:56.006500+0000","last_unstale":"2024-01-24T13:04:01.013764+0000","last_undegraded":"2024-01-24T13:04:01.013764+0000","last_fullsized":"2024-01-24T13:04:01.013764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:41:53.447100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017053+0000","last_change":"2024-01-24T13:03:56.022835+0000","last_active":"2024-01-24T13:04:01.017053+0000","last_peered":"2024-01-24T13:04:01.017053+0000","last_clean":"2024-01-24T13:04:01.017053+0000","last_became_active":"2024-01-24T13:03:56.022521+0000","last_became_peered":"2024-01-24T13:03:56.022521+0000","last_unstale":"2024-01-24T13:04:01.017053+0000","last_undegraded":"2024-01-24T13:04:01.017053+0000","last_fullsized":"2024-01-24T13:04:01.017053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:50:36.168607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011457+0000","last_change":"2024-01-24T13:03:56.018264+0000","last_active":"2024-01-24T13:04:00.011457+0000","last_peered":"2024-01-24T13:04:00.011457+0000","last_clean":"2024-01-24T13:04:00.011457+0000","last_became_active":"2024-01-24T13:03:56.018005+0000","last_became_peered":"2024-01-24T13:03:56.018005+0000","last_unstale":"2024-01-24T13:04:00.011457+0000","last_undegraded":"2024-01-24T13:04:00.011457+0000","last_fullsized":"2024-01-24T13:04:00.011457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:28.956711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015611+0000","last_change":"2024-01-24T13:03:55.999869+0000","last_active":"2024-01-24T13:04:01.015611+0000","last_peered":"2024-01-24T13:04:01.015611+0000","last_clean":"2024-01-24T13:04:01.015611+0000","last_became_active":"2024-01-24T13:03:55.999485+0000","last_became_peered":"2024-01-24T13:03:55.999485+0000","last_unstale":"2024-01-24T13:04:01.015611+0000","last_undegraded":"2024-01-24T13:04:01.015611+0000","last_fullsized":"2024-01-24T13:04:01.015611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:30:44.114343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020828+0000","last_change":"2024-01-24T13:03:56.020510+0000","last_active":"2024-01-24T13:04:00.020828+0000","last_peered":"2024-01-24T13:04:00.020828+0000","last_clean":"2024-01-24T13:04:00.020828+0000","last_became_active":"2024-01-24T13:03:56.020184+0000","last_became_peered":"2024-01-24T13:03:56.020184+0000","last_unstale":"2024-01-24T13:04:00.020828+0000","last_undegraded":"2024-01-24T13:04:00.020828+0000","last_fullsized":"2024-01-24T13:04:00.020828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:40.224981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019636+0000","last_change":"2024-01-24T13:03:56.016392+0000","last_active":"2024-01-24T13:04:00.019636+0000","last_peered":"2024-01-24T13:04:00.019636+0000","last_clean":"2024-01-24T13:04:00.019636+0000","last_became_active":"2024-01-24T13:03:56.016151+0000","last_became_peered":"2024-01-24T13:03:56.016151+0000","last_unstale":"2024-01-24T13:04:00.019636+0000","last_undegraded":"2024-01-24T13:04:00.019636+0000","last_fullsized":"2024-01-24T13:04:00.019636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:40:18.485138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.025905+0000","last_change":"2024-01-24T13:03:56.012700+0000","last_active":"2024-01-24T13:04:00.025905+0000","last_peered":"2024-01-24T13:04:00.025905+0000","last_clean":"2024-01-24T13:04:00.025905+0000","last_became_active":"2024-01-24T13:03:56.012103+0000","last_became_peered":"2024-01-24T13:03:56.012103+0000","last_unstale":"2024-01-24T13:04:00.025905+0000","last_undegraded":"2024-01-24T13:04:00.025905+0000","last_fullsized":"2024-01-24T13:04:00.025905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:13:44.864520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013515+0000","last_change":"2024-01-24T13:03:56.012794+0000","last_active":"2024-01-24T13:04:00.013515+0000","last_peered":"2024-01-24T13:04:00.013515+0000","last_clean":"2024-01-24T13:04:00.013515+0000","last_became_active":"2024-01-24T13:03:56.012545+0000","last_became_peered":"2024-01-24T13:03:56.012545+0000","last_unstale":"2024-01-24T13:04:00.013515+0000","last_undegraded":"2024-01-24T13:04:00.013515+0000","last_fullsized":"2024-01-24T13:04:00.013515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:44:49.313400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017636+0000","last_change":"2024-01-24T13:03:56.024693+0000","last_active":"2024-01-24T13:04:01.017636+0000","last_peered":"2024-01-24T13:04:01.017636+0000","last_clean":"2024-01-24T13:04:01.017636+0000","last_became_active":"2024-01-24T13:03:56.024414+0000","last_became_peered":"2024-01-24T13:03:56.024414+0000","last_unstale":"2024-01-24T13:04:01.017636+0000","last_undegraded":"2024-01-24T13:04:01.017636+0000","last_fullsized":"2024-01-24T13:04:01.017636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013466+0000","last_change":"2024-01-24T13:03:56.022620+0000","last_active":"2024-01-24T13:04:00.013466+0000","last_peered":"2024-01-24T13:04:00.013466+0000","last_clean":"2024-01-24T13:04:00.013466+0000","last_became_active":"2024-01-24T13:03:56.022340+0000","last_became_peered":"2024-01-24T13:03:56.022340+0000","last_unstale":"2024-01-24T13:04:00.013466+0000","last_undegraded":"2024-01-24T13:04:00.013466+0000","last_fullsized":"2024-01-24T13:04:00.013466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:13:44.864520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011319+0000","last_change":"2024-01-24T13:03:56.021834+0000","last_active":"2024-01-24T13:04:00.011319+0000","last_peered":"2024-01-24T13:04:00.011319+0000","last_clean":"2024-01-24T13:04:00.011319+0000","last_became_active":"2024-01-24T13:03:56.021527+0000","last_became_peered":"2024-01-24T13:03:56.021527+0000","last_unstale":"2024-01-24T13:04:00.011319+0000","last_undegraded":"2024-01-24T13:04:00.011319+0000","last_fullsized":"2024-01-24T13:04:00.011319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:48:22.624362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015966+0000","last_change":"2024-01-24T13:03:56.009268+0000","last_active":"2024-01-24T13:04:01.015966+0000","last_peered":"2024-01-24T13:04:01.015966+0000","last_clean":"2024-01-24T13:04:01.015966+0000","last_became_active":"2024-01-24T13:03:56.009008+0000","last_became_peered":"2024-01-24T13:03:56.009008+0000","last_unstale":"2024-01-24T13:04:01.015966+0000","last_undegraded":"2024-01-24T13:04:01.015966+0000","last_fullsized":"2024-01-24T13:04:01.015966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:41:51.025201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.016927+0000","last_change":"2024-01-24T13:03:56.013449+0000","last_active":"2024-01-24T13:04:00.016927+0000","last_peered":"2024-01-24T13:04:00.016927+0000","last_clean":"2024-01-24T13:04:00.016927+0000","last_became_active":"2024-01-24T13:03:56.011189+0000","last_became_peered":"2024-01-24T13:03:56.011189+0000","last_unstale":"2024-01-24T13:04:00.016927+0000","last_undegraded":"2024-01-24T13:04:00.016927+0000","last_fullsized":"2024-01-24T13:04:00.016927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:02.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.016811+0000","last_change":"2024-01-24T13:03:56.024913+0000","last_active":"2024-01-24T13:04:00.016811+0000","last_peered":"2024-01-24T13:04:00.016811+0000","last_clean":"2024-01-24T13:04:00.016811+0000","last_became_active":"2024-01-24T13:03:56.024610+0000","last_became_peered":"2024-01-24T13:03:56.024610+0000","last_unstale":"2024-01-24T13:04:00.016811+0000","last_undegraded":"2024-01-24T13:04:00.016811+0000","last_fullsized":"2024-01-24T13:04:00.016811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:18:52.742448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.025821+0000","last_change":"2024-01-24T13:03:56.012889+0000","last_active":"2024-01-24T13:04:00.025821+0000","last_peered":"2024-01-24T13:04:00.025821+0000","last_clean":"2024-01-24T13:04:00.025821+0000","last_became_active":"2024-01-24T13:03:56.012457+0000","last_became_peered":"2024-01-24T13:03:56.012457+0000","last_unstale":"2024-01-24T13:04:00.025821+0000","last_undegraded":"2024-01-24T13:04:00.025821+0000","last_fullsized":"2024-01-24T13:04:00.025821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:25:17.038527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.030919+0000","last_change":"2024-01-24T13:03:56.007919+0000","last_active":"2024-01-24T13:04:00.030919+0000","last_peered":"2024-01-24T13:04:00.030919+0000","last_clean":"2024-01-24T13:04:00.030919+0000","last_became_active":"2024-01-24T13:03:56.007649+0000","last_became_peered":"2024-01-24T13:03:56.007649+0000","last_unstale":"2024-01-24T13:04:00.030919+0000","last_undegraded":"2024-01-24T13:04:00.030919+0000","last_fullsized":"2024-01-24T13:04:00.030919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:02:53.625968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.027982+0000","last_change":"2024-01-24T13:03:56.006823+0000","last_active":"2024-01-24T13:04:00.027982+0000","last_peered":"2024-01-24T13:04:00.027982+0000","last_clean":"2024-01-24T13:04:00.027982+0000","last_became_active":"2024-01-24T13:03:56.006551+0000","last_became_peered":"2024-01-24T13:03:56.006551+0000","last_unstale":"2024-01-24T13:04:00.027982+0000","last_undegraded":"2024-01-24T13:04:00.027982+0000","last_fullsized":"2024-01-24T13:04:00.027982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:44:47.469690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.022358+0000","last_change":"2024-01-24T13:03:56.011850+0000","last_active":"2024-01-24T13:04:00.022358+0000","last_peered":"2024-01-24T13:04:00.022358+0000","last_clean":"2024-01-24T13:04:00.022358+0000","last_became_active":"2024-01-24T13:03:56.011377+0000","last_became_peered":"2024-01-24T13:03:56.011377+0000","last_unstale":"2024-01-24T13:04:00.022358+0000","last_undegraded":"2024-01-24T13:04:00.022358+0000","last_fullsized":"2024-01-24T13:04:00.022358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:47:46.739111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015553+0000","last_change":"2024-01-24T13:03:56.009254+0000","last_active":"2024-01-24T13:04:01.015553+0000","last_peered":"2024-01-24T13:04:01.015553+0000","last_clean":"2024-01-24T13:04:01.015553+0000","last_became_active":"2024-01-24T13:03:56.008910+0000","last_became_peered":"2024-01-24T13:03:56.008910+0000","last_unstale":"2024-01-24T13:04:01.015553+0000","last_undegraded":"2024-01-24T13:04:01.015553+0000","last_fullsized":"2024-01-24T13:04:01.015553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:57:08.977681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021030+0000","last_change":"2024-01-24T13:03:56.008312+0000","last_active":"2024-01-24T13:04:00.021030+0000","last_peered":"2024-01-24T13:04:00.021030+0000","last_clean":"2024-01-24T13:04:00.021030+0000","last_became_active":"2024-01-24T13:03:56.008049+0000","last_became_peered":"2024-01-24T13:03:56.008049+0000","last_unstale":"2024-01-24T13:04:00.021030+0000","last_undegraded":"2024-01-24T13:04:00.021030+0000","last_fullsized":"2024-01-24T13:04:00.021030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:26:46.456477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013251+0000","last_change":"2024-01-24T13:03:56.007224+0000","last_active":"2024-01-24T13:04:01.013251+0000","last_peered":"2024-01-24T13:04:01.013251+0000","last_clean":"2024-01-24T13:04:01.013251+0000","last_became_active":"2024-01-24T13:03:56.006804+0000","last_became_peered":"2024-01-24T13:03:56.006804+0000","last_unstale":"2024-01-24T13:04:01.013251+0000","last_undegraded":"2024-01-24T13:04:01.013251+0000","last_fullsized":"2024-01-24T13:04:01.013251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:30:39.914222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.023149+0000","last_change":"2024-01-24T13:03:56.021601+0000","last_active":"2024-01-24T13:04:00.023149+0000","last_peered":"2024-01-24T13:04:00.023149+0000","last_clean":"2024-01-24T13:04:00.023149+0000","last_became_active":"2024-01-24T13:03:56.021378+0000","last_became_peered":"2024-01-24T13:03:56.021378+0000","last_unstale":"2024-01-24T13:04:00.023149+0000","last_undegraded":"2024-01-24T13:04:00.023149+0000","last_fullsized":"2024-01-24T13:04:00.023149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:26:27.582337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013386+0000","last_change":"2024-01-24T13:03:56.006893+0000","last_active":"2024-01-24T13:04:01.013386+0000","last_peered":"2024-01-24T13:04:01.013386+0000","last_clean":"2024-01-24T13:04:01.013386+0000","last_became_active":"2024-01-24T13:03:56.006553+0000","last_became_peered":"2024-01-24T13:03:56.006553+0000","last_unstale":"2024-01-24T13:04:01.013386+0000","last_undegraded":"2024-01-24T13:04:01.013386+0000","last_fullsized":"2024-01-24T13:04:01.013386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:40.224981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016663+0000","last_change":"2024-01-24T13:03:56.010902+0000","last_active":"2024-01-24T13:04:01.016663+0000","last_peered":"2024-01-24T13:04:01.016663+0000","last_clean":"2024-01-24T13:04:01.016663+0000","last_became_active":"2024-01-24T13:03:56.008359+0000","last_became_peered":"2024-01-24T13:03:56.008359+0000","last_unstale":"2024-01-24T13:04:01.016663+0000","last_undegraded":"2024-01-24T13:04:01.016663+0000","last_fullsized":"2024-01-24T13:04:01.016663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:01:35.209896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017095+0000","last_change":"2024-01-24T13:03:56.018292+0000","last_active":"2024-01-24T13:04:01.017095+0000","last_peered":"2024-01-24T13:04:01.017095+0000","last_clean":"2024-01-24T13:04:01.017095+0000","last_became_active":"2024-01-24T13:03:56.015689+0000","last_became_peered":"2024-01-24T13:03:56.015689+0000","last_unstale":"2024-01-24T13:04:01.017095+0000","last_undegraded":"2024-01-24T13:04:01.017095+0000","last_fullsized":"2024-01-24T13:04:01.017095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:15:57.223738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.028853+0000","last_change":"2024-01-24T13:03:56.010593+0000","last_active":"2024-01-24T13:04:00.028853+0000","last_peered":"2024-01-24T13:04:00.028853+0000","last_clean":"2024-01-24T13:04:00.028853+0000","last_became_active":"2024-01-24T13:03:56.010357+0000","last_became_peered":"2024-01-24T13:03:56.010357+0000","last_unstale":"2024-01-24T13:04:00.028853+0000","last_undegraded":"2024-01-24T13:04:00.028853+0000","last_fullsized":"2024-01-24T13:04:00.028853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:12:57.628509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":117206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":117082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":121549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":117664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":892928,"data_stored":707520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":303104,"data_stored":117138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":897024,"data_stored":707542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:04:25.401 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:04:25.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5689400640 1 Processor -- start 2024-01-24T13:04:25.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5689400640 1 -- start start 2024-01-24T13:04:25.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5689400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5684159300 0x7f56840b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5689400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f568406bc10 0x7f568406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5689400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568406c5b0 con 0x7f568415cf50 2024-01-24T13:04:25.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5689400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5684071140 con 0x7f568406bc10 2024-01-24T13:04:25.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5689400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568415de10 con 0x7f5684159300 2024-01-24T13:04:25.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5681e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f568406bc10 0x7f568406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5682800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5684159300 0x7f56840b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5683200640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f568415cf50 0x7f56840cbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:35982/0 (socket says 172.21.15.29:35982) 2024-01-24T13:04:25.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5683200640 1 -- 172.21.15.29:0/1870172927 learned_addr learned my addr 172.21.15.29:0/1870172927 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:25.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5681400640 1 -- 172.21.15.29:0/1870172927 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622036798 0 0) 0x7f568406c5b0 con 0x7f568415cf50 2024-01-24T13:04:25.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5681400640 1 -- 172.21.15.29:0/1870172927 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5664005740 con 0x7f568415cf50 2024-01-24T13:04:25.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5681e00640 1 -- 172.21.15.29:0/1870172927 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5684159300 msgr2=0x7f56840b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:25.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5681e00640 1 --2- 172.21.15.29:0/1870172927 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5684159300 0x7f56840b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5681e00640 1 -- 172.21.15.29:0/1870172927 >> v1:172.21.15.163:6789/0 conn(0x7f568415cf50 legacy=0x7f56840cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5681e00640 1 -- 172.21.15.29:0/1870172927 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568415db30 con 0x7f568406bc10 2024-01-24T13:04:25.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.576+0000 7f5682800640 1 --2- 172.21.15.29:0/1870172927 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5684159300 0x7f56840b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:25.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.580+0000 7f5681e00640 1 --2- 172.21.15.29:0/1870172927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f568406bc10 0x7f568406c070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f566c0097c0 tx=0x7f566c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64f8b35df3aea2fd server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:25.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.580+0000 7f5681400640 1 -- 172.21.15.29:0/1870172927 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c0ab600 con 0x7f568406bc10 2024-01-24T13:04:25.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.580+0000 7f5681400640 1 -- 172.21.15.29:0/1870172927 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c0a7050 con 0x7f568406bc10 2024-01-24T13:04:25.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.580+0000 7f5681400640 1 -- 172.21.15.29:0/1870172927 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c0ab980 con 0x7f568406bc10 2024-01-24T13:04:25.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.580+0000 7f5689400640 1 -- 172.21.15.29:0/1870172927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f568406bc10 msgr2=0x7f568406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.580+0000 7f5689400640 1 --2- 172.21.15.29:0/1870172927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f568406bc10 0x7f568406c070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f566c0097c0 tx=0x7f566c01c3c0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.580+0000 7f5689400640 1 -- 172.21.15.29:0/1870172927 shutdown_connections 2024-01-24T13:04:25.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.580+0000 7f5689400640 1 --2- 172.21.15.29:0/1870172927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f568406bc10 0x7f568406c070 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.580+0000 7f5689400640 1 --2- 172.21.15.29:0/1870172927 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5684159300 0x7f56840b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.580+0000 7f5689400640 1 -- 172.21.15.29:0/1870172927 >> 172.21.15.29:0/1870172927 conn(0x7f56840b3950 msgr2=0x7f5684069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:25.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.580+0000 7f5689400640 1 -- 172.21.15.29:0/1870172927 shutdown_connections 2024-01-24T13:04:25.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.580+0000 7f5689400640 1 -- 172.21.15.29:0/1870172927 wait complete. 2024-01-24T13:04:25.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5689400640 1 Processor -- start 2024-01-24T13:04:25.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5689400640 1 -- start start 2024-01-24T13:04:25.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5689400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f568406bc10 0x7f568414b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5689400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5684159300 0x7f5684153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5689400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f568415cf50 0x7f5684153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5689400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568414ccf0 con 0x7f5684159300 2024-01-24T13:04:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5689400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568414d0f0 con 0x7f568415cf50 2024-01-24T13:04:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5689400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568414c070 con 0x7f568406bc10 2024-01-24T13:04:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5681e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5684159300 0x7f5684153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5681e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5684159300 0x7f5684153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37452/0 (socket says 172.21.15.29:37452) 2024-01-24T13:04:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5681e00640 1 -- 172.21.15.29:0/667133055 learned_addr learned my addr 172.21.15.29:0/667133055 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5682800640 1 --2- 172.21.15.29:0/667133055 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f568406bc10 0x7f568414b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5683200640 1 --2- 172.21.15.29:0/667133055 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f568415cf50 0x7f5684153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5681e00640 1 -- 172.21.15.29:0/667133055 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f568406bc10 msgr2=0x7f568414b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5681e00640 1 --2- 172.21.15.29:0/667133055 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f568406bc10 0x7f568414b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5681e00640 1 -- 172.21.15.29:0/667133055 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f568415cf50 msgr2=0x7f5684153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5681e00640 1 --2- 172.21.15.29:0/667133055 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f568415cf50 0x7f5684153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5681e00640 1 -- 172.21.15.29:0/667133055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5674009420 con 0x7f5684159300 2024-01-24T13:04:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5681e00640 1 --2- 172.21.15.29:0/667133055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5684159300 0x7f5684153820 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f566c019ff0 tx=0x7f566c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f567aa00640 1 -- 172.21.15.29:0/667133055 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c0b4410 con 0x7f5684159300 2024-01-24T13:04:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f567aa00640 1 -- 172.21.15.29:0/667133055 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c0b4590 con 0x7f5684159300 2024-01-24T13:04:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5689400640 1 -- 172.21.15.29:0/667133055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c009420 con 0x7f5684159300 2024-01-24T13:04:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f567aa00640 1 -- 172.21.15.29:0/667133055 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c0b4940 con 0x7f5684159300 2024-01-24T13:04:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.584+0000 7f5689400640 1 -- 172.21.15.29:0/667133055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568414c630 con 0x7f5684159300 2024-01-24T13:04:25.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.588+0000 7f5689400640 1 -- 172.21.15.29:0/667133055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568414cf60 con 0x7f5684159300 2024-01-24T13:04:25.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.588+0000 7f567aa00640 1 -- 172.21.15.29:0/667133055 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f566c0b2040 con 0x7f5684159300 2024-01-24T13:04:25.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.588+0000 7f567aa00640 1 --2- 172.21.15.29:0/667133055 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f565c065a60 0x7f565c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.588+0000 7f567aa00640 1 -- 172.21.15.29:0/667133055 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f566c11d480 con 0x7f5684159300 2024-01-24T13:04:25.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.588+0000 7f5682800640 1 --2- 172.21.15.29:0/667133055 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f565c065a60 0x7f565c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.588+0000 7f5682800640 1 --2- 172.21.15.29:0/667133055 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f565c065a60 0x7f565c067f20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5674009c80 tx=0x7f5674008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:25.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.592+0000 7f567aa00640 1 -- 172.21.15.29:0/667133055 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f566c0eab60 con 0x7f5684159300 2024-01-24T13:04:25.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.744+0000 7f5689400640 1 -- 172.21.15.29:0/667133055 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56840cc7f0 con 0x7f565c065a60 2024-01-24T13:04:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.756+0000 7f567aa00640 1 -- 172.21.15.29:0/667133055 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345259 (secure 0 0 0) 0x7f56740098d0 con 0x7f565c065a60 2024-01-24T13:04:25.761 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:25.763 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:04:25.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.760+0000 7f5689400640 1 -- 172.21.15.29:0/667133055 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f565c065a60 msgr2=0x7f565c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.760+0000 7f5689400640 1 --2- 172.21.15.29:0/667133055 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f565c065a60 0x7f565c067f20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5674009c80 tx=0x7f5674008040 comp rx=0 tx=0).stop 2024-01-24T13:04:25.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.760+0000 7f5689400640 1 -- 172.21.15.29:0/667133055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5684159300 msgr2=0x7f5684153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.760+0000 7f5689400640 1 --2- 172.21.15.29:0/667133055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5684159300 0x7f5684153820 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f566c019ff0 tx=0x7f566c019160 comp rx=0 tx=0).stop 2024-01-24T13:04:25.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.760+0000 7f5689400640 1 -- 172.21.15.29:0/667133055 shutdown_connections 2024-01-24T13:04:25.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.760+0000 7f5689400640 1 --2- 172.21.15.29:0/667133055 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f565c065a60 0x7f565c067f20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.760+0000 7f5689400640 1 --2- 172.21.15.29:0/667133055 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f568415cf50 0x7f5684153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.760+0000 7f5689400640 1 --2- 172.21.15.29:0/667133055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5684159300 0x7f5684153820 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.760+0000 7f5689400640 1 --2- 172.21.15.29:0/667133055 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f568406bc10 0x7f568414b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.760+0000 7f5689400640 1 -- 172.21.15.29:0/667133055 >> 172.21.15.29:0/667133055 conn(0x7f56840b3950 msgr2=0x7f56840b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:25.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.760+0000 7f5689400640 1 -- 172.21.15.29:0/667133055 shutdown_connections 2024-01-24T13:04:25.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.760+0000 7f5689400640 1 -- 172.21.15.29:0/667133055 wait complete. 2024-01-24T13:04:25.782 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-01-24T13:04:25.543268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219700,"kb_used_data":3528,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755020,"statfs":{"total":773094113280,"available":772869140480,"internally_reserved":0,"allocated":3612672,"data_stored":2126578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003277"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020698+0000","last_change":"2024-01-24T13:03:55.606327+0000","last_active":"2024-01-24T13:04:00.020698+0000","last_peered":"2024-01-24T13:04:00.020698+0000","last_clean":"2024-01-24T13:04:00.020698+0000","last_became_active":"2024-01-24T13:03:55.606030+0000","last_became_peered":"2024-01-24T13:03:55.606030+0000","last_unstale":"2024-01-24T13:04:00.020698+0000","last_undegraded":"2024-01-24T13:04:00.020698+0000","last_fullsized":"2024-01-24T13:04:00.020698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:03:57.780901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017226+0000","last_change":"2024-01-24T13:03:56.018840+0000","last_active":"2024-01-24T13:04:01.017226+0000","last_peered":"2024-01-24T13:04:01.017226+0000","last_clean":"2024-01-24T13:04:01.017226+0000","last_became_active":"2024-01-24T13:03:56.018597+0000","last_became_peered":"2024-01-24T13:03:56.018597+0000","last_unstale":"2024-01-24T13:04:01.017226+0000","last_undegraded":"2024-01-24T13:04:01.017226+0000","last_fullsized":"2024-01-24T13:04:01.017226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:26:26.138489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806814+0000","last_change":"2024-01-24T13:04:00.044582+0000","last_active":"2024-01-24T13:04:01.806814+0000","last_peered":"2024-01-24T13:04:01.806814+0000","last_clean":"2024-01-24T13:04:01.806814+0000","last_became_active":"2024-01-24T13:04:00.044171+0000","last_became_peered":"2024-01-24T13:04:00.044171+0000","last_unstale":"2024-01-24T13:04:01.806814+0000","last_undegraded":"2024-01-24T13:04:01.806814+0000","last_fullsized":"2024-01-24T13:04:01.806814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:14:04.213076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017241+0000","last_change":"2024-01-24T13:03:55.596925+0000","last_active":"2024-01-24T13:04:01.017241+0000","last_peered":"2024-01-24T13:04:01.017241+0000","last_clean":"2024-01-24T13:04:01.017241+0000","last_became_active":"2024-01-24T13:03:55.596539+0000","last_became_peered":"2024-01-24T13:03:55.596539+0000","last_unstale":"2024-01-24T13:04:01.017241+0000","last_undegraded":"2024-01-24T13:04:01.017241+0000","last_fullsized":"2024-01-24T13:04:01.017241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:18.551398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017244+0000","last_change":"2024-01-24T13:03:56.010228+0000","last_active":"2024-01-24T13:04:01.017244+0000","last_peered":"2024-01-24T13:04:01.017244+0000","last_clean":"2024-01-24T13:04:01.017244+0000","last_became_active":"2024-01-24T13:03:56.009920+0000","last_became_peered":"2024-01-24T13:03:56.009920+0000","last_unstale":"2024-01-24T13:04:01.017244+0000","last_undegraded":"2024-01-24T13:04:01.017244+0000","last_fullsized":"2024-01-24T13:04:01.017244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:33:22.274202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805044+0000","last_change":"2024-01-24T13:04:00.036039+0000","last_active":"2024-01-24T13:04:01.805044+0000","last_peered":"2024-01-24T13:04:01.805044+0000","last_clean":"2024-01-24T13:04:01.805044+0000","last_became_active":"2024-01-24T13:04:00.035441+0000","last_became_peered":"2024-01-24T13:04:00.035441+0000","last_unstale":"2024-01-24T13:04:01.805044+0000","last_undegraded":"2024-01-24T13:04:01.805044+0000","last_fullsized":"2024-01-24T13:04:01.805044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:18:37.828066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.031062+0000","last_change":"2024-01-24T13:03:55.601607+0000","last_active":"2024-01-24T13:04:00.031062+0000","last_peered":"2024-01-24T13:04:00.031062+0000","last_clean":"2024-01-24T13:04:00.031062+0000","last_became_active":"2024-01-24T13:03:55.601320+0000","last_became_peered":"2024-01-24T13:03:55.601320+0000","last_unstale":"2024-01-24T13:04:00.031062+0000","last_undegraded":"2024-01-24T13:04:00.031062+0000","last_fullsized":"2024-01-24T13:04:00.031062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:12.091224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021279+0000","last_change":"2024-01-24T13:03:56.022848+0000","last_active":"2024-01-24T13:04:00.021279+0000","last_peered":"2024-01-24T13:04:00.021279+0000","last_clean":"2024-01-24T13:04:00.021279+0000","last_became_active":"2024-01-24T13:03:56.022529+0000","last_became_peered":"2024-01-24T13:03:56.022529+0000","last_unstale":"2024-01-24T13:04:00.021279+0000","last_undegraded":"2024-01-24T13:04:00.021279+0000","last_fullsized":"2024-01-24T13:04:00.021279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:02.421483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806130+0000","last_change":"2024-01-24T13:04:00.052590+0000","last_active":"2024-01-24T13:04:01.806130+0000","last_peered":"2024-01-24T13:04:01.806130+0000","last_clean":"2024-01-24T13:04:01.806130+0000","last_became_active":"2024-01-24T13:04:00.052118+0000","last_became_peered":"2024-01-24T13:04:00.052118+0000","last_unstale":"2024-01-24T13:04:01.806130+0000","last_undegraded":"2024-01-24T13:04:01.806130+0000","last_fullsized":"2024-01-24T13:04:01.806130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:50:50.867503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.026082+0000","last_change":"2024-01-24T13:03:55.605745+0000","last_active":"2024-01-24T13:04:00.026082+0000","last_peered":"2024-01-24T13:04:00.026082+0000","last_clean":"2024-01-24T13:04:00.026082+0000","last_became_active":"2024-01-24T13:03:55.605321+0000","last_became_peered":"2024-01-24T13:03:55.605321+0000","last_unstale":"2024-01-24T13:04:00.026082+0000","last_undegraded":"2024-01-24T13:04:00.026082+0000","last_fullsized":"2024-01-24T13:04:00.026082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:01.413713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013678+0000","last_change":"2024-01-24T13:03:56.024669+0000","last_active":"2024-01-24T13:04:00.013678+0000","last_peered":"2024-01-24T13:04:00.013678+0000","last_clean":"2024-01-24T13:04:00.013678+0000","last_became_active":"2024-01-24T13:03:56.024411+0000","last_became_peered":"2024-01-24T13:03:56.024411+0000","last_unstale":"2024-01-24T13:04:00.013678+0000","last_undegraded":"2024-01-24T13:04:00.013678+0000","last_fullsized":"2024-01-24T13:04:00.013678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:26:46.456477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805258+0000","last_change":"2024-01-24T13:04:00.051526+0000","last_active":"2024-01-24T13:04:01.805258+0000","last_peered":"2024-01-24T13:04:01.805258+0000","last_clean":"2024-01-24T13:04:01.805258+0000","last_became_active":"2024-01-24T13:04:00.046616+0000","last_became_peered":"2024-01-24T13:04:00.046616+0000","last_unstale":"2024-01-24T13:04:01.805258+0000","last_undegraded":"2024-01-24T13:04:01.805258+0000","last_fullsized":"2024-01-24T13:04:01.805258+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:04.738538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011521+0000","last_change":"2024-01-24T13:03:56.015309+0000","last_active":"2024-01-24T13:04:00.011521+0000","last_peered":"2024-01-24T13:04:00.011521+0000","last_clean":"2024-01-24T13:04:00.011521+0000","last_became_active":"2024-01-24T13:03:56.015046+0000","last_became_peered":"2024-01-24T13:03:56.015046+0000","last_unstale":"2024-01-24T13:04:00.011521+0000","last_undegraded":"2024-01-24T13:04:00.011521+0000","last_fullsized":"2024-01-24T13:04:00.011521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:25:17.038527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011674+0000","last_change":"2024-01-24T13:03:55.597378+0000","last_active":"2024-01-24T13:04:00.011674+0000","last_peered":"2024-01-24T13:04:00.011674+0000","last_clean":"2024-01-24T13:04:00.011674+0000","last_became_active":"2024-01-24T13:03:55.597128+0000","last_became_peered":"2024-01-24T13:03:55.597128+0000","last_unstale":"2024-01-24T13:04:00.011674+0000","last_undegraded":"2024-01-24T13:04:00.011674+0000","last_fullsized":"2024-01-24T13:04:00.011674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:41:52.439330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806109+0000","last_change":"2024-01-24T13:04:00.049793+0000","last_active":"2024-01-24T13:04:01.806109+0000","last_peered":"2024-01-24T13:04:01.806109+0000","last_clean":"2024-01-24T13:04:01.806109+0000","last_became_active":"2024-01-24T13:04:00.049395+0000","last_became_peered":"2024-01-24T13:04:00.049395+0000","last_unstale":"2024-01-24T13:04:01.806109+0000","last_undegraded":"2024-01-24T13:04:01.806109+0000","last_fullsized":"2024-01-24T13:04:01.806109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:31:27.768822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016628+0000","last_change":"2024-01-24T13:03:56.015127+0000","last_active":"2024-01-24T13:04:01.016628+0000","last_peered":"2024-01-24T13:04:01.016628+0000","last_clean":"2024-01-24T13:04:01.016628+0000","last_became_active":"2024-01-24T13:03:56.014713+0000","last_became_peered":"2024-01-24T13:03:56.014713+0000","last_unstale":"2024-01-24T13:04:01.016628+0000","last_undegraded":"2024-01-24T13:04:01.016628+0000","last_fullsized":"2024-01-24T13:04:01.016628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:13.098994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017134+0000","last_change":"2024-01-24T13:03:55.601999+0000","last_active":"2024-01-24T13:04:00.017134+0000","last_peered":"2024-01-24T13:04:00.017134+0000","last_clean":"2024-01-24T13:04:00.017134+0000","last_became_active":"2024-01-24T13:03:55.601673+0000","last_became_peered":"2024-01-24T13:03:55.601673+0000","last_unstale":"2024-01-24T13:04:00.017134+0000","last_undegraded":"2024-01-24T13:04:00.017134+0000","last_fullsized":"2024-01-24T13:04:00.017134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:45:36.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.146739+0000","last_change":"2024-01-24T13:04:00.044536+0000","last_active":"2024-01-24T13:04:01.146739+0000","last_peered":"2024-01-24T13:04:01.146739+0000","last_clean":"2024-01-24T13:04:01.146739+0000","last_became_active":"2024-01-24T13:04:00.044138+0000","last_became_peered":"2024-01-24T13:04:00.044138+0000","last_unstale":"2024-01-24T13:04:01.146739+0000","last_undegraded":"2024-01-24T13:04:01.146739+0000","last_fullsized":"2024-01-24T13:04:01.146739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017399+0000","last_change":"2024-01-24T13:03:56.012647+0000","last_active":"2024-01-24T13:04:00.017399+0000","last_peered":"2024-01-24T13:04:00.017399+0000","last_clean":"2024-01-24T13:04:00.017399+0000","last_became_active":"2024-01-24T13:03:56.012253+0000","last_became_peered":"2024-01-24T13:03:56.012253+0000","last_unstale":"2024-01-24T13:04:00.017399+0000","last_undegraded":"2024-01-24T13:04:00.017399+0000","last_fullsized":"2024-01-24T13:04:00.017399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:24:10.805392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019610+0000","last_change":"2024-01-24T13:03:55.607929+0000","last_active":"2024-01-24T13:04:00.019610+0000","last_peered":"2024-01-24T13:04:00.019610+0000","last_clean":"2024-01-24T13:04:00.019610+0000","last_became_active":"2024-01-24T13:03:55.607579+0000","last_became_peered":"2024-01-24T13:03:55.607579+0000","last_unstale":"2024-01-24T13:04:00.019610+0000","last_undegraded":"2024-01-24T13:04:00.019610+0000","last_fullsized":"2024-01-24T13:04:00.019610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:47:45.731340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806758+0000","last_change":"2024-01-24T13:04:00.042942+0000","last_active":"2024-01-24T13:04:01.806758+0000","last_peered":"2024-01-24T13:04:01.806758+0000","last_clean":"2024-01-24T13:04:01.806758+0000","last_became_active":"2024-01-24T13:04:00.042539+0000","last_became_peered":"2024-01-24T13:04:00.042539+0000","last_unstale":"2024-01-24T13:04:01.806758+0000","last_undegraded":"2024-01-24T13:04:01.806758+0000","last_fullsized":"2024-01-24T13:04:01.806758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:44:50.908587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011397+0000","last_change":"2024-01-24T13:03:56.012053+0000","last_active":"2024-01-24T13:04:00.011397+0000","last_peered":"2024-01-24T13:04:00.011397+0000","last_clean":"2024-01-24T13:04:00.011397+0000","last_became_active":"2024-01-24T13:03:56.011812+0000","last_became_peered":"2024-01-24T13:03:56.011812+0000","last_unstale":"2024-01-24T13:04:00.011397+0000","last_undegraded":"2024-01-24T13:04:00.011397+0000","last_fullsized":"2024-01-24T13:04:00.011397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:32.185320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021271+0000","last_change":"2024-01-24T13:03:55.595674+0000","last_active":"2024-01-24T13:04:00.021271+0000","last_peered":"2024-01-24T13:04:00.021271+0000","last_clean":"2024-01-24T13:04:00.021271+0000","last_became_active":"2024-01-24T13:03:55.594833+0000","last_became_peered":"2024-01-24T13:03:55.594833+0000","last_unstale":"2024-01-24T13:04:00.021271+0000","last_undegraded":"2024-01-24T13:04:00.021271+0000","last_fullsized":"2024-01-24T13:04:00.021271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:54:35.340555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806952+0000","last_change":"2024-01-24T13:04:00.042902+0000","last_active":"2024-01-24T13:04:01.806952+0000","last_peered":"2024-01-24T13:04:01.806952+0000","last_clean":"2024-01-24T13:04:01.806952+0000","last_became_active":"2024-01-24T13:04:00.042120+0000","last_became_peered":"2024-01-24T13:04:00.042120+0000","last_unstale":"2024-01-24T13:04:01.806952+0000","last_undegraded":"2024-01-24T13:04:01.806952+0000","last_fullsized":"2024-01-24T13:04:01.806952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:48:26.063259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020230+0000","last_change":"2024-01-24T13:03:56.012262+0000","last_active":"2024-01-24T13:04:00.020230+0000","last_peered":"2024-01-24T13:04:00.020230+0000","last_clean":"2024-01-24T13:04:00.020230+0000","last_became_active":"2024-01-24T13:03:56.011966+0000","last_became_peered":"2024-01-24T13:03:56.011966+0000","last_unstale":"2024-01-24T13:04:00.020230+0000","last_undegraded":"2024-01-24T13:04:00.020230+0000","last_fullsized":"2024-01-24T13:04:00.020230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:17:34.235081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.012933+0000","last_change":"2024-01-24T13:03:55.607257+0000","last_active":"2024-01-24T13:04:00.012933+0000","last_peered":"2024-01-24T13:04:00.012933+0000","last_clean":"2024-01-24T13:04:00.012933+0000","last_became_active":"2024-01-24T13:03:55.606021+0000","last_became_peered":"2024-01-24T13:03:55.606021+0000","last_unstale":"2024-01-24T13:04:00.012933+0000","last_undegraded":"2024-01-24T13:04:00.012933+0000","last_fullsized":"2024-01-24T13:04:00.012933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:45:36.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805293+0000","last_change":"2024-01-24T13:04:00.038690+0000","last_active":"2024-01-24T13:04:01.805293+0000","last_peered":"2024-01-24T13:04:01.805293+0000","last_clean":"2024-01-24T13:04:01.805293+0000","last_became_active":"2024-01-24T13:04:00.033603+0000","last_became_peered":"2024-01-24T13:04:00.033603+0000","last_unstale":"2024-01-24T13:04:01.805293+0000","last_undegraded":"2024-01-24T13:04:01.805293+0000","last_fullsized":"2024-01-24T13:04:01.805293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020685+0000","last_change":"2024-01-24T13:03:56.019251+0000","last_active":"2024-01-24T13:04:00.020685+0000","last_peered":"2024-01-24T13:04:00.020685+0000","last_clean":"2024-01-24T13:04:00.020685+0000","last_became_active":"2024-01-24T13:03:56.016877+0000","last_became_peered":"2024-01-24T13:03:56.016877+0000","last_unstale":"2024-01-24T13:04:00.020685+0000","last_undegraded":"2024-01-24T13:04:00.020685+0000","last_fullsized":"2024-01-24T13:04:00.020685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:02.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020421+0000","last_change":"2024-01-24T13:03:55.607924+0000","last_active":"2024-01-24T13:04:00.020421+0000","last_peered":"2024-01-24T13:04:00.020421+0000","last_clean":"2024-01-24T13:04:00.020421+0000","last_became_active":"2024-01-24T13:03:55.607591+0000","last_became_peered":"2024-01-24T13:03:55.607591+0000","last_unstale":"2024-01-24T13:04:00.020421+0000","last_undegraded":"2024-01-24T13:04:00.020421+0000","last_fullsized":"2024-01-24T13:04:00.020421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:13.842299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149029+0000","last_change":"2024-01-24T13:04:00.035477+0000","last_active":"2024-01-24T13:04:01.149029+0000","last_peered":"2024-01-24T13:04:01.149029+0000","last_clean":"2024-01-24T13:04:01.149029+0000","last_became_active":"2024-01-24T13:04:00.034981+0000","last_became_peered":"2024-01-24T13:04:00.034981+0000","last_unstale":"2024-01-24T13:04:01.149029+0000","last_undegraded":"2024-01-24T13:04:01.149029+0000","last_fullsized":"2024-01-24T13:04:01.149029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:04.738538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018375+0000","last_change":"2024-01-24T13:03:56.017993+0000","last_active":"2024-01-24T13:04:00.018375+0000","last_peered":"2024-01-24T13:04:00.018375+0000","last_clean":"2024-01-24T13:04:00.018375+0000","last_became_active":"2024-01-24T13:03:56.017682+0000","last_became_peered":"2024-01-24T13:03:56.017682+0000","last_unstale":"2024-01-24T13:04:00.018375+0000","last_undegraded":"2024-01-24T13:04:00.018375+0000","last_fullsized":"2024-01-24T13:04:00.018375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:46:24.457447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013622+0000","last_change":"2024-01-24T13:03:55.601678+0000","last_active":"2024-01-24T13:04:00.013622+0000","last_peered":"2024-01-24T13:04:00.013622+0000","last_clean":"2024-01-24T13:04:00.013622+0000","last_became_active":"2024-01-24T13:03:55.599824+0000","last_became_peered":"2024-01-24T13:03:55.599824+0000","last_unstale":"2024-01-24T13:04:00.013622+0000","last_undegraded":"2024-01-24T13:04:00.013622+0000","last_fullsized":"2024-01-24T13:04:00.013622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:01.413713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806924+0000","last_change":"2024-01-24T13:04:00.044489+0000","last_active":"2024-01-24T13:04:01.806924+0000","last_peered":"2024-01-24T13:04:01.806924+0000","last_clean":"2024-01-24T13:04:01.806924+0000","last_became_active":"2024-01-24T13:04:00.044090+0000","last_became_peered":"2024-01-24T13:04:00.044090+0000","last_unstale":"2024-01-24T13:04:01.806924+0000","last_undegraded":"2024-01-24T13:04:01.806924+0000","last_fullsized":"2024-01-24T13:04:01.806924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013877+0000","last_change":"2024-01-24T13:03:56.012608+0000","last_active":"2024-01-24T13:04:01.013877+0000","last_peered":"2024-01-24T13:04:01.013877+0000","last_clean":"2024-01-24T13:04:01.013877+0000","last_became_active":"2024-01-24T13:03:56.012369+0000","last_became_peered":"2024-01-24T13:03:56.012369+0000","last_unstale":"2024-01-24T13:04:01.013877+0000","last_undegraded":"2024-01-24T13:04:01.013877+0000","last_fullsized":"2024-01-24T13:04:01.013877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:08:02.421483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016565+0000","last_change":"2024-01-24T13:03:55.595049+0000","last_active":"2024-01-24T13:04:01.016565+0000","last_peered":"2024-01-24T13:04:01.016565+0000","last_clean":"2024-01-24T13:04:01.016565+0000","last_became_active":"2024-01-24T13:03:55.594748+0000","last_became_peered":"2024-01-24T13:03:55.594748+0000","last_unstale":"2024-01-24T13:04:01.016565+0000","last_undegraded":"2024-01-24T13:04:01.016565+0000","last_fullsized":"2024-01-24T13:04:01.016565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:54:02.325596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.807443+0000","last_change":"2024-01-24T13:04:00.052891+0000","last_active":"2024-01-24T13:04:01.807443+0000","last_peered":"2024-01-24T13:04:01.807443+0000","last_clean":"2024-01-24T13:04:01.807443+0000","last_became_active":"2024-01-24T13:04:00.051617+0000","last_became_peered":"2024-01-24T13:04:00.051617+0000","last_unstale":"2024-01-24T13:04:01.807443+0000","last_undegraded":"2024-01-24T13:04:01.807443+0000","last_fullsized":"2024-01-24T13:04:01.807443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:35.624217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.022993+0000","last_change":"2024-01-24T13:03:56.009995+0000","last_active":"2024-01-24T13:04:00.022993+0000","last_peered":"2024-01-24T13:04:00.022993+0000","last_clean":"2024-01-24T13:04:00.022993+0000","last_became_active":"2024-01-24T13:03:56.009662+0000","last_became_peered":"2024-01-24T13:03:56.009662+0000","last_unstale":"2024-01-24T13:04:00.022993+0000","last_undegraded":"2024-01-24T13:04:00.022993+0000","last_fullsized":"2024-01-24T13:04:00.022993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:28.956711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011686+0000","last_change":"2024-01-24T13:03:55.595933+0000","last_active":"2024-01-24T13:04:00.011686+0000","last_peered":"2024-01-24T13:04:00.011686+0000","last_clean":"2024-01-24T13:04:00.011686+0000","last_became_active":"2024-01-24T13:03:55.594957+0000","last_became_peered":"2024-01-24T13:03:55.594957+0000","last_unstale":"2024-01-24T13:04:00.011686+0000","last_undegraded":"2024-01-24T13:04:00.011686+0000","last_fullsized":"2024-01-24T13:04:00.011686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:12.091224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.808365+0000","last_change":"2024-01-24T13:04:00.045610+0000","last_active":"2024-01-24T13:04:01.808365+0000","last_peered":"2024-01-24T13:04:01.808365+0000","last_clean":"2024-01-24T13:04:01.808365+0000","last_became_active":"2024-01-24T13:04:00.044937+0000","last_became_peered":"2024-01-24T13:04:00.044937+0000","last_unstale":"2024-01-24T13:04:01.808365+0000","last_undegraded":"2024-01-24T13:04:01.808365+0000","last_fullsized":"2024-01-24T13:04:01.808365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T01:02:53.163148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015631+0000","last_change":"2024-01-24T13:03:56.016991+0000","last_active":"2024-01-24T13:04:01.015631+0000","last_peered":"2024-01-24T13:04:01.015631+0000","last_clean":"2024-01-24T13:04:01.015631+0000","last_became_active":"2024-01-24T13:03:56.016720+0000","last_became_peered":"2024-01-24T13:03:56.016720+0000","last_unstale":"2024-01-24T13:04:01.015631+0000","last_undegraded":"2024-01-24T13:04:01.015631+0000","last_fullsized":"2024-01-24T13:04:01.015631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:33:24.896330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016383+0000","last_change":"2024-01-24T13:03:55.598471+0000","last_active":"2024-01-24T13:04:01.016383+0000","last_peered":"2024-01-24T13:04:01.016383+0000","last_clean":"2024-01-24T13:04:01.016383+0000","last_became_active":"2024-01-24T13:03:55.598159+0000","last_became_peered":"2024-01-24T13:03:55.598159+0000","last_unstale":"2024-01-24T13:04:01.016383+0000","last_undegraded":"2024-01-24T13:04:01.016383+0000","last_fullsized":"2024-01-24T13:04:01.016383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:40:38.850663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806777+0000","last_change":"2024-01-24T13:04:00.040424+0000","last_active":"2024-01-24T13:04:01.806777+0000","last_peered":"2024-01-24T13:04:01.806777+0000","last_clean":"2024-01-24T13:04:01.806777+0000","last_became_active":"2024-01-24T13:04:00.038744+0000","last_became_peered":"2024-01-24T13:04:00.038744+0000","last_unstale":"2024-01-24T13:04:01.806777+0000","last_undegraded":"2024-01-24T13:04:01.806777+0000","last_fullsized":"2024-01-24T13:04:01.806777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:48:26.063259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018273+0000","last_change":"2024-01-24T13:03:56.014411+0000","last_active":"2024-01-24T13:04:00.018273+0000","last_peered":"2024-01-24T13:04:00.018273+0000","last_clean":"2024-01-24T13:04:00.018273+0000","last_became_active":"2024-01-24T13:03:56.014076+0000","last_became_peered":"2024-01-24T13:03:56.014076+0000","last_unstale":"2024-01-24T13:04:00.018273+0000","last_undegraded":"2024-01-24T13:04:00.018273+0000","last_fullsized":"2024-01-24T13:04:00.018273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:13.098994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011676+0000","last_change":"2024-01-24T13:03:55.603197+0000","last_active":"2024-01-24T13:04:00.011676+0000","last_peered":"2024-01-24T13:04:00.011676+0000","last_clean":"2024-01-24T13:04:00.011676+0000","last_became_active":"2024-01-24T13:03:55.600175+0000","last_became_peered":"2024-01-24T13:03:55.600175+0000","last_unstale":"2024-01-24T13:04:00.011676+0000","last_undegraded":"2024-01-24T13:04:00.011676+0000","last_fullsized":"2024-01-24T13:04:00.011676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:30:38.906451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016791+0000","last_change":"2024-01-24T13:04:00.049384+0000","last_active":"2024-01-24T13:04:01.016791+0000","last_peered":"2024-01-24T13:04:01.016791+0000","last_clean":"2024-01-24T13:04:01.016791+0000","last_became_active":"2024-01-24T13:04:00.048632+0000","last_became_peered":"2024-01-24T13:04:00.048632+0000","last_unstale":"2024-01-24T13:04:01.016791+0000","last_undegraded":"2024-01-24T13:04:01.016791+0000","last_fullsized":"2024-01-24T13:04:01.016791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:06:53.027528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019637+0000","last_change":"2024-01-24T13:03:56.018433+0000","last_active":"2024-01-24T13:04:00.019637+0000","last_peered":"2024-01-24T13:04:00.019637+0000","last_clean":"2024-01-24T13:04:00.019637+0000","last_became_active":"2024-01-24T13:03:56.018164+0000","last_became_peered":"2024-01-24T13:03:56.018164+0000","last_unstale":"2024-01-24T13:04:00.019637+0000","last_undegraded":"2024-01-24T13:04:00.019637+0000","last_fullsized":"2024-01-24T13:04:00.019637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:26:27.582337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011717+0000","last_change":"2024-01-24T13:03:55.597798+0000","last_active":"2024-01-24T13:04:00.011717+0000","last_peered":"2024-01-24T13:04:00.011717+0000","last_clean":"2024-01-24T13:04:00.011717+0000","last_became_active":"2024-01-24T13:03:55.597513+0000","last_became_peered":"2024-01-24T13:03:55.597513+0000","last_unstale":"2024-01-24T13:04:00.011717+0000","last_undegraded":"2024-01-24T13:04:00.011717+0000","last_fullsized":"2024-01-24T13:04:00.011717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:18:51.734678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.023086+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:04:00.023086+0000","last_peered":"2024-01-24T13:04:00.023086+0000","last_clean":"2024-01-24T13:04:00.023086+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:04:00.023086+0000","last_undegraded":"2024-01-24T13:04:00.023086+0000","last_fullsized":"2024-01-24T13:04:00.023086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806680+0000","last_change":"2024-01-24T13:04:00.038740+0000","last_active":"2024-01-24T13:04:01.806680+0000","last_peered":"2024-01-24T13:04:01.806680+0000","last_clean":"2024-01-24T13:04:01.806680+0000","last_became_active":"2024-01-24T13:04:00.038231+0000","last_became_peered":"2024-01-24T13:04:00.038231+0000","last_unstale":"2024-01-24T13:04:01.806680+0000","last_undegraded":"2024-01-24T13:04:01.806680+0000","last_fullsized":"2024-01-24T13:04:01.806680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:08:54.372154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.012909+0000","last_change":"2024-01-24T13:03:56.016055+0000","last_active":"2024-01-24T13:04:00.012909+0000","last_peered":"2024-01-24T13:04:00.012909+0000","last_clean":"2024-01-24T13:04:00.012909+0000","last_became_active":"2024-01-24T13:03:56.015784+0000","last_became_peered":"2024-01-24T13:03:56.015784+0000","last_unstale":"2024-01-24T13:04:00.012909+0000","last_undegraded":"2024-01-24T13:04:00.012909+0000","last_fullsized":"2024-01-24T13:04:00.012909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:37:02.929160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018991+0000","last_change":"2024-01-24T13:03:55.608578+0000","last_active":"2024-01-24T13:04:00.018991+0000","last_peered":"2024-01-24T13:04:00.018991+0000","last_clean":"2024-01-24T13:04:00.018991+0000","last_became_active":"2024-01-24T13:03:55.608223+0000","last_became_peered":"2024-01-24T13:03:55.608223+0000","last_unstale":"2024-01-24T13:04:00.018991+0000","last_undegraded":"2024-01-24T13:04:00.018991+0000","last_fullsized":"2024-01-24T13:04:00.018991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:40:38.850663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805871+0000","last_change":"2024-01-24T13:04:00.036185+0000","last_active":"2024-01-24T13:04:01.805871+0000","last_peered":"2024-01-24T13:04:01.805871+0000","last_clean":"2024-01-24T13:04:01.805871+0000","last_became_active":"2024-01-24T13:04:00.035683+0000","last_became_peered":"2024-01-24T13:04:00.035683+0000","last_unstale":"2024-01-24T13:04:01.805871+0000","last_undegraded":"2024-01-24T13:04:01.805871+0000","last_fullsized":"2024-01-24T13:04:01.805871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:35.010431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.025989+0000","last_change":"2024-01-24T13:03:56.010590+0000","last_active":"2024-01-24T13:04:00.025989+0000","last_peered":"2024-01-24T13:04:00.025989+0000","last_clean":"2024-01-24T13:04:00.025989+0000","last_became_active":"2024-01-24T13:03:56.010337+0000","last_became_peered":"2024-01-24T13:03:56.010337+0000","last_unstale":"2024-01-24T13:04:00.025989+0000","last_undegraded":"2024-01-24T13:04:00.025989+0000","last_fullsized":"2024-01-24T13:04:00.025989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:33:30.023414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016888+0000","last_change":"2024-01-24T13:03:55.598738+0000","last_active":"2024-01-24T13:04:01.016888+0000","last_peered":"2024-01-24T13:04:01.016888+0000","last_clean":"2024-01-24T13:04:01.016888+0000","last_became_active":"2024-01-24T13:03:55.598468+0000","last_became_peered":"2024-01-24T13:03:55.598468+0000","last_unstale":"2024-01-24T13:04:01.016888+0000","last_undegraded":"2024-01-24T13:04:01.016888+0000","last_fullsized":"2024-01-24T13:04:01.016888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:33:00.188281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016100+0000","last_change":"2024-01-24T13:04:00.047084+0000","last_active":"2024-01-24T13:04:01.016100+0000","last_peered":"2024-01-24T13:04:01.016100+0000","last_clean":"2024-01-24T13:04:01.016100+0000","last_became_active":"2024-01-24T13:04:00.046694+0000","last_became_peered":"2024-01-24T13:04:00.046694+0000","last_unstale":"2024-01-24T13:04:01.016100+0000","last_undegraded":"2024-01-24T13:04:01.016100+0000","last_fullsized":"2024-01-24T13:04:01.016100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:11:37.105076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.028935+0000","last_change":"2024-01-24T13:03:56.011152+0000","last_active":"2024-01-24T13:04:00.028935+0000","last_peered":"2024-01-24T13:04:00.028935+0000","last_clean":"2024-01-24T13:04:00.028935+0000","last_became_active":"2024-01-24T13:03:56.010924+0000","last_became_peered":"2024-01-24T13:03:56.010924+0000","last_unstale":"2024-01-24T13:04:00.028935+0000","last_undegraded":"2024-01-24T13:04:00.028935+0000","last_fullsized":"2024-01-24T13:04:00.028935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:14:00.774178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020323+0000","last_change":"2024-01-24T13:03:55.602406+0000","last_active":"2024-01-24T13:04:00.020323+0000","last_peered":"2024-01-24T13:04:00.020323+0000","last_clean":"2024-01-24T13:04:00.020323+0000","last_became_active":"2024-01-24T13:03:55.601915+0000","last_became_peered":"2024-01-24T13:03:55.601915+0000","last_unstale":"2024-01-24T13:04:00.020323+0000","last_undegraded":"2024-01-24T13:04:00.020323+0000","last_fullsized":"2024-01-24T13:04:00.020323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:02:25.134363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.805322+0000","last_change":"2024-01-24T13:04:00.028655+0000","last_active":"2024-01-24T13:04:01.805322+0000","last_peered":"2024-01-24T13:04:01.805322+0000","last_clean":"2024-01-24T13:04:01.805322+0000","last_became_active":"2024-01-24T13:04:00.028105+0000","last_became_peered":"2024-01-24T13:04:00.028105+0000","last_unstale":"2024-01-24T13:04:01.805322+0000","last_undegraded":"2024-01-24T13:04:01.805322+0000","last_fullsized":"2024-01-24T13:04:01.805322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:54:22.271694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013786+0000","last_change":"2024-01-24T13:03:56.002044+0000","last_active":"2024-01-24T13:04:01.013786+0000","last_peered":"2024-01-24T13:04:01.013786+0000","last_clean":"2024-01-24T13:04:01.013786+0000","last_became_active":"2024-01-24T13:03:56.001772+0000","last_became_peered":"2024-01-24T13:03:56.001772+0000","last_unstale":"2024-01-24T13:04:01.013786+0000","last_undegraded":"2024-01-24T13:04:01.013786+0000","last_fullsized":"2024-01-24T13:04:01.013786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:54:36.348326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.029043+0000","last_change":"2024-01-24T13:03:55.601600+0000","last_active":"2024-01-24T13:04:00.029043+0000","last_peered":"2024-01-24T13:04:00.029043+0000","last_clean":"2024-01-24T13:04:00.029043+0000","last_became_active":"2024-01-24T13:03:55.601309+0000","last_became_peered":"2024-01-24T13:03:55.601309+0000","last_unstale":"2024-01-24T13:04:00.029043+0000","last_undegraded":"2024-01-24T13:04:00.029043+0000","last_fullsized":"2024-01-24T13:04:00.029043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:39.217211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.652527+0000","last_change":"2024-01-24T13:04:00.048932+0000","last_active":"2024-01-24T13:04:01.652527+0000","last_peered":"2024-01-24T13:04:01.652527+0000","last_clean":"2024-01-24T13:04:01.652527+0000","last_became_active":"2024-01-24T13:04:00.048532+0000","last_became_peered":"2024-01-24T13:04:00.048532+0000","last_unstale":"2024-01-24T13:04:01.652527+0000","last_undegraded":"2024-01-24T13:04:01.652527+0000","last_fullsized":"2024-01-24T13:04:01.652527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:46:41.343291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011316+0000","last_change":"2024-01-24T13:03:56.014290+0000","last_active":"2024-01-24T13:04:00.011316+0000","last_peered":"2024-01-24T13:04:00.011316+0000","last_clean":"2024-01-24T13:04:00.011316+0000","last_became_active":"2024-01-24T13:03:56.014029+0000","last_became_peered":"2024-01-24T13:03:56.014029+0000","last_unstale":"2024-01-24T13:04:00.011316+0000","last_undegraded":"2024-01-24T13:04:00.011316+0000","last_fullsized":"2024-01-24T13:04:00.011316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:09:08.217574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017500+0000","last_change":"2024-01-24T13:03:55.600217+0000","last_active":"2024-01-24T13:04:00.017500+0000","last_peered":"2024-01-24T13:04:00.017500+0000","last_clean":"2024-01-24T13:04:00.017500+0000","last_became_active":"2024-01-24T13:03:55.599923+0000","last_became_peered":"2024-01-24T13:03:55.599923+0000","last_unstale":"2024-01-24T13:04:00.017500+0000","last_undegraded":"2024-01-24T13:04:00.017500+0000","last_fullsized":"2024-01-24T13:04:00.017500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:23:39.711167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017117+0000","last_change":"2024-01-24T13:04:00.049088+0000","last_active":"2024-01-24T13:04:01.017117+0000","last_peered":"2024-01-24T13:04:01.017117+0000","last_clean":"2024-01-24T13:04:01.017117+0000","last_became_active":"2024-01-24T13:04:00.048038+0000","last_became_peered":"2024-01-24T13:04:00.048038+0000","last_unstale":"2024-01-24T13:04:01.017117+0000","last_undegraded":"2024-01-24T13:04:01.017117+0000","last_fullsized":"2024-01-24T13:04:01.017117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:25:56.475987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021646+0000","last_change":"2024-01-24T13:03:56.025258+0000","last_active":"2024-01-24T13:04:00.021646+0000","last_peered":"2024-01-24T13:04:00.021646+0000","last_clean":"2024-01-24T13:04:00.021646+0000","last_became_active":"2024-01-24T13:03:56.025008+0000","last_became_peered":"2024-01-24T13:03:56.025008+0000","last_unstale":"2024-01-24T13:04:00.021646+0000","last_undegraded":"2024-01-24T13:04:00.021646+0000","last_fullsized":"2024-01-24T13:04:00.021646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:13.098994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021114+0000","last_change":"2024-01-24T13:03:55.606138+0000","last_active":"2024-01-24T13:04:00.021114+0000","last_peered":"2024-01-24T13:04:00.021114+0000","last_clean":"2024-01-24T13:04:00.021114+0000","last_became_active":"2024-01-24T13:03:55.605730+0000","last_became_peered":"2024-01-24T13:03:55.605730+0000","last_unstale":"2024-01-24T13:04:00.021114+0000","last_undegraded":"2024-01-24T13:04:00.021114+0000","last_fullsized":"2024-01-24T13:04:00.021114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:13.842299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017136+0000","last_change":"2024-01-24T13:04:00.047326+0000","last_active":"2024-01-24T13:04:01.017136+0000","last_peered":"2024-01-24T13:04:01.017136+0000","last_clean":"2024-01-24T13:04:01.017136+0000","last_became_active":"2024-01-24T13:04:00.046914+0000","last_became_peered":"2024-01-24T13:04:00.046914+0000","last_unstale":"2024-01-24T13:04:01.017136+0000","last_undegraded":"2024-01-24T13:04:01.017136+0000","last_fullsized":"2024-01-24T13:04:01.017136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:55:11.375322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011611+0000","last_change":"2024-01-24T13:03:56.023957+0000","last_active":"2024-01-24T13:04:00.011611+0000","last_peered":"2024-01-24T13:04:00.011611+0000","last_clean":"2024-01-24T13:04:00.011611+0000","last_became_active":"2024-01-24T13:03:56.022133+0000","last_became_peered":"2024-01-24T13:03:56.022133+0000","last_unstale":"2024-01-24T13:04:00.011611+0000","last_undegraded":"2024-01-24T13:04:00.011611+0000","last_fullsized":"2024-01-24T13:04:00.011611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:14:00.774178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011695+0000","last_change":"2024-01-24T13:03:55.596366+0000","last_active":"2024-01-24T13:04:00.011695+0000","last_peered":"2024-01-24T13:04:00.011695+0000","last_clean":"2024-01-24T13:04:00.011695+0000","last_became_active":"2024-01-24T13:03:55.593651+0000","last_became_peered":"2024-01-24T13:03:55.593651+0000","last_unstale":"2024-01-24T13:04:00.011695+0000","last_undegraded":"2024-01-24T13:04:00.011695+0000","last_fullsized":"2024-01-24T13:04:00.011695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:39.217211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.807643+0000","last_change":"2024-01-24T13:04:00.045823+0000","last_active":"2024-01-24T13:04:01.807643+0000","last_peered":"2024-01-24T13:04:01.807643+0000","last_clean":"2024-01-24T13:04:01.807643+0000","last_became_active":"2024-01-24T13:04:00.045308+0000","last_became_peered":"2024-01-24T13:04:00.045308+0000","last_unstale":"2024-01-24T13:04:01.807643+0000","last_undegraded":"2024-01-24T13:04:01.807643+0000","last_fullsized":"2024-01-24T13:04:01.807643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:48:59.613697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.017004+0000","last_change":"2024-01-24T13:03:56.006377+0000","last_active":"2024-01-24T13:04:00.017004+0000","last_peered":"2024-01-24T13:04:00.017004+0000","last_clean":"2024-01-24T13:04:00.017004+0000","last_became_active":"2024-01-24T13:03:56.006045+0000","last_became_peered":"2024-01-24T13:03:56.006045+0000","last_unstale":"2024-01-24T13:04:00.017004+0000","last_undegraded":"2024-01-24T13:04:00.017004+0000","last_fullsized":"2024-01-24T13:04:00.017004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:30:39.914222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016729+0000","last_change":"2024-01-24T13:03:55.606775+0000","last_active":"2024-01-24T13:04:01.016729+0000","last_peered":"2024-01-24T13:04:01.016729+0000","last_clean":"2024-01-24T13:04:01.016729+0000","last_became_active":"2024-01-24T13:03:55.606406+0000","last_became_peered":"2024-01-24T13:03:55.606406+0000","last_unstale":"2024-01-24T13:04:01.016729+0000","last_undegraded":"2024-01-24T13:04:01.016729+0000","last_fullsized":"2024-01-24T13:04:01.016729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:03:38.642654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806328+0000","last_change":"2024-01-24T13:04:00.049217+0000","last_active":"2024-01-24T13:04:01.806328+0000","last_peered":"2024-01-24T13:04:01.806328+0000","last_clean":"2024-01-24T13:04:01.806328+0000","last_became_active":"2024-01-24T13:04:00.048805+0000","last_became_peered":"2024-01-24T13:04:00.048805+0000","last_unstale":"2024-01-24T13:04:01.806328+0000","last_undegraded":"2024-01-24T13:04:01.806328+0000","last_fullsized":"2024-01-24T13:04:01.806328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:51:50.366250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.031010+0000","last_change":"2024-01-24T13:03:56.016870+0000","last_active":"2024-01-24T13:04:00.031010+0000","last_peered":"2024-01-24T13:04:00.031010+0000","last_clean":"2024-01-24T13:04:00.031010+0000","last_became_active":"2024-01-24T13:03:56.016600+0000","last_became_peered":"2024-01-24T13:03:56.016600+0000","last_unstale":"2024-01-24T13:04:00.031010+0000","last_undegraded":"2024-01-24T13:04:00.031010+0000","last_fullsized":"2024-01-24T13:04:00.031010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:50:02.158087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'10","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:11.278469+0000","last_change":"2024-01-24T13:03:55.600760+0000","last_active":"2024-01-24T13:04:11.278469+0000","last_peered":"2024-01-24T13:04:11.278469+0000","last_clean":"2024-01-24T13:04:11.278469+0000","last_became_active":"2024-01-24T13:03:55.600478+0000","last_became_peered":"2024-01-24T13:03:55.600478+0000","last_unstale":"2024-01-24T13:04:11.278469+0000","last_undegraded":"2024-01-24T13:04:11.278469+0000","last_fullsized":"2024-01-24T13:04:11.278469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:35:44.393474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149129+0000","last_change":"2024-01-24T13:04:00.047921+0000","last_active":"2024-01-24T13:04:01.149129+0000","last_peered":"2024-01-24T13:04:01.149129+0000","last_clean":"2024-01-24T13:04:01.149129+0000","last_became_active":"2024-01-24T13:04:00.047461+0000","last_became_peered":"2024-01-24T13:04:00.047461+0000","last_unstale":"2024-01-24T13:04:01.149129+0000","last_undegraded":"2024-01-24T13:04:01.149129+0000","last_fullsized":"2024-01-24T13:04:01.149129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:35.010431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011713+0000","last_change":"2024-01-24T13:03:56.019212+0000","last_active":"2024-01-24T13:04:00.011713+0000","last_peered":"2024-01-24T13:04:00.011713+0000","last_clean":"2024-01-24T13:04:00.011713+0000","last_became_active":"2024-01-24T13:03:56.018880+0000","last_became_peered":"2024-01-24T13:03:56.018880+0000","last_unstale":"2024-01-24T13:04:00.011713+0000","last_undegraded":"2024-01-24T13:04:00.011713+0000","last_fullsized":"2024-01-24T13:04:00.011713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T01:02:49.724251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017145+0000","last_change":"2024-01-24T13:03:55.599109+0000","last_active":"2024-01-24T13:04:01.017145+0000","last_peered":"2024-01-24T13:04:01.017145+0000","last_clean":"2024-01-24T13:04:01.017145+0000","last_became_active":"2024-01-24T13:03:55.598819+0000","last_became_peered":"2024-01-24T13:03:55.598819+0000","last_unstale":"2024-01-24T13:04:01.017145+0000","last_undegraded":"2024-01-24T13:04:01.017145+0000","last_fullsized":"2024-01-24T13:04:01.017145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:45:36.039334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806220+0000","last_change":"2024-01-24T13:04:00.039074+0000","last_active":"2024-01-24T13:04:01.806220+0000","last_peered":"2024-01-24T13:04:01.806220+0000","last_clean":"2024-01-24T13:04:01.806220+0000","last_became_active":"2024-01-24T13:04:00.038717+0000","last_became_peered":"2024-01-24T13:04:00.038717+0000","last_unstale":"2024-01-24T13:04:01.806220+0000","last_undegraded":"2024-01-24T13:04:01.806220+0000","last_fullsized":"2024-01-24T13:04:01.806220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:16:03.907815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017269+0000","last_change":"2024-01-24T13:03:56.012177+0000","last_active":"2024-01-24T13:04:01.017269+0000","last_peered":"2024-01-24T13:04:01.017269+0000","last_clean":"2024-01-24T13:04:01.017269+0000","last_became_active":"2024-01-24T13:03:56.011917+0000","last_became_peered":"2024-01-24T13:03:56.011917+0000","last_unstale":"2024-01-24T13:04:01.017269+0000","last_undegraded":"2024-01-24T13:04:01.017269+0000","last_fullsized":"2024-01-24T13:04:01.017269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:37.212289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.028063+0000","last_change":"2024-01-24T13:03:55.602617+0000","last_active":"2024-01-24T13:04:00.028063+0000","last_peered":"2024-01-24T13:04:00.028063+0000","last_clean":"2024-01-24T13:04:00.028063+0000","last_became_active":"2024-01-24T13:03:55.602297+0000","last_became_peered":"2024-01-24T13:03:55.602297+0000","last_unstale":"2024-01-24T13:04:00.028063+0000","last_undegraded":"2024-01-24T13:04:00.028063+0000","last_fullsized":"2024-01-24T13:04:00.028063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:08.959080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806443+0000","last_change":"2024-01-24T13:04:00.043082+0000","last_active":"2024-01-24T13:04:01.806443+0000","last_peered":"2024-01-24T13:04:01.806443+0000","last_clean":"2024-01-24T13:04:01.806443+0000","last_became_active":"2024-01-24T13:04:00.042663+0000","last_became_peered":"2024-01-24T13:04:00.042663+0000","last_unstale":"2024-01-24T13:04:01.806443+0000","last_undegraded":"2024-01-24T13:04:01.806443+0000","last_fullsized":"2024-01-24T13:04:01.806443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:13:01.067406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013739+0000","last_change":"2024-01-24T13:03:56.007996+0000","last_active":"2024-01-24T13:04:01.013739+0000","last_peered":"2024-01-24T13:04:01.013739+0000","last_clean":"2024-01-24T13:04:01.013739+0000","last_became_active":"2024-01-24T13:03:56.006784+0000","last_became_peered":"2024-01-24T13:03:56.006784+0000","last_unstale":"2024-01-24T13:04:01.013739+0000","last_undegraded":"2024-01-24T13:04:01.013739+0000","last_fullsized":"2024-01-24T13:04:01.013739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:18:52.742448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.022444+0000","last_change":"2024-01-24T13:03:55.598172+0000","last_active":"2024-01-24T13:04:00.022444+0000","last_peered":"2024-01-24T13:04:00.022444+0000","last_clean":"2024-01-24T13:04:00.022444+0000","last_became_active":"2024-01-24T13:03:55.597945+0000","last_became_peered":"2024-01-24T13:03:55.597945+0000","last_unstale":"2024-01-24T13:04:00.022444+0000","last_undegraded":"2024-01-24T13:04:00.022444+0000","last_fullsized":"2024-01-24T13:04:00.022444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:40:38.850663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149379+0000","last_change":"2024-01-24T13:04:00.033699+0000","last_active":"2024-01-24T13:04:01.149379+0000","last_peered":"2024-01-24T13:04:01.149379+0000","last_clean":"2024-01-24T13:04:01.149379+0000","last_became_active":"2024-01-24T13:04:00.032771+0000","last_became_peered":"2024-01-24T13:04:00.032771+0000","last_unstale":"2024-01-24T13:04:01.149379+0000","last_undegraded":"2024-01-24T13:04:01.149379+0000","last_fullsized":"2024-01-24T13:04:01.149379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:16:03.907815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.150744+0000","last_change":"2024-01-24T13:04:00.053152+0000","last_active":"2024-01-24T13:04:01.150744+0000","last_peered":"2024-01-24T13:04:01.150744+0000","last_clean":"2024-01-24T13:04:01.150744+0000","last_became_active":"2024-01-24T13:04:00.052760+0000","last_became_peered":"2024-01-24T13:04:00.052760+0000","last_unstale":"2024-01-24T13:04:01.150744+0000","last_undegraded":"2024-01-24T13:04:01.150744+0000","last_fullsized":"2024-01-24T13:04:01.150744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:39:06.851501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019513+0000","last_change":"2024-01-24T13:03:56.010008+0000","last_active":"2024-01-24T13:04:00.019513+0000","last_peered":"2024-01-24T13:04:00.019513+0000","last_clean":"2024-01-24T13:04:00.019513+0000","last_became_active":"2024-01-24T13:03:56.009750+0000","last_became_peered":"2024-01-24T13:03:56.009750+0000","last_unstale":"2024-01-24T13:04:00.019513+0000","last_undegraded":"2024-01-24T13:04:00.019513+0000","last_fullsized":"2024-01-24T13:04:00.019513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:46:37.904394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011569+0000","last_change":"2024-01-24T13:03:55.592274+0000","last_active":"2024-01-24T13:04:00.011569+0000","last_peered":"2024-01-24T13:04:00.011569+0000","last_clean":"2024-01-24T13:04:00.011569+0000","last_became_active":"2024-01-24T13:03:55.591994+0000","last_became_peered":"2024-01-24T13:03:55.591994+0000","last_unstale":"2024-01-24T13:04:00.011569+0000","last_undegraded":"2024-01-24T13:04:00.011569+0000","last_fullsized":"2024-01-24T13:04:00.011569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:08.959080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.806986+0000","last_change":"2024-01-24T13:04:00.053348+0000","last_active":"2024-01-24T13:04:01.806986+0000","last_peered":"2024-01-24T13:04:01.806986+0000","last_clean":"2024-01-24T13:04:01.806986+0000","last_became_active":"2024-01-24T13:04:00.052859+0000","last_became_peered":"2024-01-24T13:04:00.052859+0000","last_unstale":"2024-01-24T13:04:01.806986+0000","last_undegraded":"2024-01-24T13:04:01.806986+0000","last_fullsized":"2024-01-24T13:04:01.806986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:31:55.847658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015772+0000","last_change":"2024-01-24T13:03:56.013494+0000","last_active":"2024-01-24T13:04:01.015772+0000","last_peered":"2024-01-24T13:04:01.015772+0000","last_clean":"2024-01-24T13:04:01.015772+0000","last_became_active":"2024-01-24T13:03:56.013241+0000","last_became_peered":"2024-01-24T13:03:56.013241+0000","last_unstale":"2024-01-24T13:04:01.015772+0000","last_undegraded":"2024-01-24T13:04:01.015772+0000","last_fullsized":"2024-01-24T13:04:01.015772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:09:52.534215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018229+0000","last_change":"2024-01-24T13:03:55.608610+0000","last_active":"2024-01-24T13:04:00.018229+0000","last_peered":"2024-01-24T13:04:00.018229+0000","last_clean":"2024-01-24T13:04:00.018229+0000","last_became_active":"2024-01-24T13:03:55.608272+0000","last_became_peered":"2024-01-24T13:03:55.608272+0000","last_unstale":"2024-01-24T13:04:00.018229+0000","last_undegraded":"2024-01-24T13:04:00.018229+0000","last_fullsized":"2024-01-24T13:04:00.018229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:03:38.642654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011518+0000","last_change":"2024-01-24T13:03:55.603336+0000","last_active":"2024-01-24T13:04:00.011518+0000","last_peered":"2024-01-24T13:04:00.011518+0000","last_clean":"2024-01-24T13:04:00.011518+0000","last_became_active":"2024-01-24T13:03:55.603034+0000","last_became_peered":"2024-01-24T13:03:55.603034+0000","last_unstale":"2024-01-24T13:04:00.011518+0000","last_undegraded":"2024-01-24T13:04:00.011518+0000","last_fullsized":"2024-01-24T13:04:00.011518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:54:35.340555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019760+0000","last_change":"2024-01-24T13:03:56.023712+0000","last_active":"2024-01-24T13:04:00.019760+0000","last_peered":"2024-01-24T13:04:00.019760+0000","last_clean":"2024-01-24T13:04:00.019760+0000","last_became_active":"2024-01-24T13:03:56.023037+0000","last_became_peered":"2024-01-24T13:03:56.023037+0000","last_unstale":"2024-01-24T13:04:00.019760+0000","last_undegraded":"2024-01-24T13:04:00.019760+0000","last_fullsized":"2024-01-24T13:04:00.019760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:10:17.205776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.149525+0000","last_change":"2024-01-24T13:04:00.049354+0000","last_active":"2024-01-24T13:04:01.149525+0000","last_peered":"2024-01-24T13:04:01.149525+0000","last_clean":"2024-01-24T13:04:01.149525+0000","last_became_active":"2024-01-24T13:04:00.048648+0000","last_became_peered":"2024-01-24T13:04:00.048648+0000","last_unstale":"2024-01-24T13:04:01.149525+0000","last_undegraded":"2024-01-24T13:04:01.149525+0000","last_fullsized":"2024-01-24T13:04:01.149525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:37:19.983867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016202+0000","last_change":"2024-01-24T13:03:55.595499+0000","last_active":"2024-01-24T13:04:01.016202+0000","last_peered":"2024-01-24T13:04:01.016202+0000","last_clean":"2024-01-24T13:04:01.016202+0000","last_became_active":"2024-01-24T13:03:55.595229+0000","last_became_peered":"2024-01-24T13:03:55.595229+0000","last_unstale":"2024-01-24T13:04:01.016202+0000","last_undegraded":"2024-01-24T13:04:01.016202+0000","last_fullsized":"2024-01-24T13:04:01.016202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:54.552293+0000","last_clean_scrub_stamp":"2024-01-24T13:03:54.552293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:33:37.210242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020904+0000","last_change":"2024-01-24T13:03:56.025558+0000","last_active":"2024-01-24T13:04:00.020904+0000","last_peered":"2024-01-24T13:04:00.020904+0000","last_clean":"2024-01-24T13:04:00.020904+0000","last_became_active":"2024-01-24T13:03:56.023819+0000","last_became_peered":"2024-01-24T13:03:56.023819+0000","last_unstale":"2024-01-24T13:04:00.020904+0000","last_undegraded":"2024-01-24T13:04:00.020904+0000","last_fullsized":"2024-01-24T13:04:00.020904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.807832+0000","last_change":"2024-01-24T13:04:00.050356+0000","last_active":"2024-01-24T13:04:01.807832+0000","last_peered":"2024-01-24T13:04:01.807832+0000","last_clean":"2024-01-24T13:04:01.807832+0000","last_became_active":"2024-01-24T13:04:00.049681+0000","last_became_peered":"2024-01-24T13:04:00.049681+0000","last_unstale":"2024-01-24T13:04:01.807832+0000","last_undegraded":"2024-01-24T13:04:01.807832+0000","last_fullsized":"2024-01-24T13:04:01.807832+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:58.998961+0000","last_clean_scrub_stamp":"2024-01-24T13:03:58.998961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:37:06.368057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013232+0000","last_change":"2024-01-24T13:03:56.004498+0000","last_active":"2024-01-24T13:04:01.013232+0000","last_peered":"2024-01-24T13:04:01.013232+0000","last_clean":"2024-01-24T13:04:01.013232+0000","last_became_active":"2024-01-24T13:03:56.004175+0000","last_became_peered":"2024-01-24T13:03:56.004175+0000","last_unstale":"2024-01-24T13:04:01.013232+0000","last_undegraded":"2024-01-24T13:04:01.013232+0000","last_fullsized":"2024-01-24T13:04:01.013232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016280+0000","last_change":"2024-01-24T13:03:56.022795+0000","last_active":"2024-01-24T13:04:01.016280+0000","last_peered":"2024-01-24T13:04:01.016280+0000","last_clean":"2024-01-24T13:04:01.016280+0000","last_became_active":"2024-01-24T13:03:56.022534+0000","last_became_peered":"2024-01-24T13:03:56.022534+0000","last_unstale":"2024-01-24T13:04:01.016280+0000","last_undegraded":"2024-01-24T13:04:01.016280+0000","last_fullsized":"2024-01-24T13:04:01.016280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:15:14.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011421+0000","last_change":"2024-01-24T13:03:56.017677+0000","last_active":"2024-01-24T13:04:00.011421+0000","last_peered":"2024-01-24T13:04:00.011421+0000","last_clean":"2024-01-24T13:04:00.011421+0000","last_became_active":"2024-01-24T13:03:56.017371+0000","last_became_peered":"2024-01-24T13:03:56.017371+0000","last_unstale":"2024-01-24T13:04:00.011421+0000","last_undegraded":"2024-01-24T13:04:00.011421+0000","last_fullsized":"2024-01-24T13:04:00.011421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:33:30.023414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016121+0000","last_change":"2024-01-24T13:03:56.018818+0000","last_active":"2024-01-24T13:04:01.016121+0000","last_peered":"2024-01-24T13:04:01.016121+0000","last_clean":"2024-01-24T13:04:01.016121+0000","last_became_active":"2024-01-24T13:03:56.018526+0000","last_became_peered":"2024-01-24T13:03:56.018526+0000","last_unstale":"2024-01-24T13:04:01.016121+0000","last_undegraded":"2024-01-24T13:04:01.016121+0000","last_fullsized":"2024-01-24T13:04:01.016121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:03:08.353848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018278+0000","last_change":"2024-01-24T13:03:56.021986+0000","last_active":"2024-01-24T13:04:00.018278+0000","last_peered":"2024-01-24T13:04:00.018278+0000","last_clean":"2024-01-24T13:04:00.018278+0000","last_became_active":"2024-01-24T13:03:56.021722+0000","last_became_peered":"2024-01-24T13:03:56.021722+0000","last_unstale":"2024-01-24T13:04:00.018278+0000","last_undegraded":"2024-01-24T13:04:00.018278+0000","last_fullsized":"2024-01-24T13:04:00.018278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:41:53.447100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.018684+0000","last_change":"2024-01-24T13:03:56.017766+0000","last_active":"2024-01-24T13:04:00.018684+0000","last_peered":"2024-01-24T13:04:00.018684+0000","last_clean":"2024-01-24T13:04:00.018684+0000","last_became_active":"2024-01-24T13:03:56.017460+0000","last_became_peered":"2024-01-24T13:03:56.017460+0000","last_unstale":"2024-01-24T13:04:00.018684+0000","last_undegraded":"2024-01-24T13:04:00.018684+0000","last_fullsized":"2024-01-24T13:04:00.018684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013764+0000","last_change":"2024-01-24T13:03:56.006732+0000","last_active":"2024-01-24T13:04:01.013764+0000","last_peered":"2024-01-24T13:04:01.013764+0000","last_clean":"2024-01-24T13:04:01.013764+0000","last_became_active":"2024-01-24T13:03:56.006500+0000","last_became_peered":"2024-01-24T13:03:56.006500+0000","last_unstale":"2024-01-24T13:04:01.013764+0000","last_undegraded":"2024-01-24T13:04:01.013764+0000","last_fullsized":"2024-01-24T13:04:01.013764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:41:53.447100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017053+0000","last_change":"2024-01-24T13:03:56.022835+0000","last_active":"2024-01-24T13:04:01.017053+0000","last_peered":"2024-01-24T13:04:01.017053+0000","last_clean":"2024-01-24T13:04:01.017053+0000","last_became_active":"2024-01-24T13:03:56.022521+0000","last_became_peered":"2024-01-24T13:03:56.022521+0000","last_unstale":"2024-01-24T13:04:01.017053+0000","last_undegraded":"2024-01-24T13:04:01.017053+0000","last_fullsized":"2024-01-24T13:04:01.017053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:50:36.168607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011457+0000","last_change":"2024-01-24T13:03:56.018264+0000","last_active":"2024-01-24T13:04:00.011457+0000","last_peered":"2024-01-24T13:04:00.011457+0000","last_clean":"2024-01-24T13:04:00.011457+0000","last_became_active":"2024-01-24T13:03:56.018005+0000","last_became_peered":"2024-01-24T13:03:56.018005+0000","last_unstale":"2024-01-24T13:04:00.011457+0000","last_undegraded":"2024-01-24T13:04:00.011457+0000","last_fullsized":"2024-01-24T13:04:00.011457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:26:28.956711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015611+0000","last_change":"2024-01-24T13:03:55.999869+0000","last_active":"2024-01-24T13:04:01.015611+0000","last_peered":"2024-01-24T13:04:01.015611+0000","last_clean":"2024-01-24T13:04:01.015611+0000","last_became_active":"2024-01-24T13:03:55.999485+0000","last_became_peered":"2024-01-24T13:03:55.999485+0000","last_unstale":"2024-01-24T13:04:01.015611+0000","last_undegraded":"2024-01-24T13:04:01.015611+0000","last_fullsized":"2024-01-24T13:04:01.015611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:30:44.114343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.020828+0000","last_change":"2024-01-24T13:03:56.020510+0000","last_active":"2024-01-24T13:04:00.020828+0000","last_peered":"2024-01-24T13:04:00.020828+0000","last_clean":"2024-01-24T13:04:00.020828+0000","last_became_active":"2024-01-24T13:03:56.020184+0000","last_became_peered":"2024-01-24T13:03:56.020184+0000","last_unstale":"2024-01-24T13:04:00.020828+0000","last_undegraded":"2024-01-24T13:04:00.020828+0000","last_fullsized":"2024-01-24T13:04:00.020828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:40.224981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.019636+0000","last_change":"2024-01-24T13:03:56.016392+0000","last_active":"2024-01-24T13:04:00.019636+0000","last_peered":"2024-01-24T13:04:00.019636+0000","last_clean":"2024-01-24T13:04:00.019636+0000","last_became_active":"2024-01-24T13:03:56.016151+0000","last_became_peered":"2024-01-24T13:03:56.016151+0000","last_unstale":"2024-01-24T13:04:00.019636+0000","last_undegraded":"2024-01-24T13:04:00.019636+0000","last_fullsized":"2024-01-24T13:04:00.019636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:40:18.485138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.025905+0000","last_change":"2024-01-24T13:03:56.012700+0000","last_active":"2024-01-24T13:04:00.025905+0000","last_peered":"2024-01-24T13:04:00.025905+0000","last_clean":"2024-01-24T13:04:00.025905+0000","last_became_active":"2024-01-24T13:03:56.012103+0000","last_became_peered":"2024-01-24T13:03:56.012103+0000","last_unstale":"2024-01-24T13:04:00.025905+0000","last_undegraded":"2024-01-24T13:04:00.025905+0000","last_fullsized":"2024-01-24T13:04:00.025905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:13:44.864520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013515+0000","last_change":"2024-01-24T13:03:56.012794+0000","last_active":"2024-01-24T13:04:00.013515+0000","last_peered":"2024-01-24T13:04:00.013515+0000","last_clean":"2024-01-24T13:04:00.013515+0000","last_became_active":"2024-01-24T13:03:56.012545+0000","last_became_peered":"2024-01-24T13:03:56.012545+0000","last_unstale":"2024-01-24T13:04:00.013515+0000","last_undegraded":"2024-01-24T13:04:00.013515+0000","last_fullsized":"2024-01-24T13:04:00.013515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:44:49.313400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017636+0000","last_change":"2024-01-24T13:03:56.024693+0000","last_active":"2024-01-24T13:04:01.017636+0000","last_peered":"2024-01-24T13:04:01.017636+0000","last_clean":"2024-01-24T13:04:01.017636+0000","last_became_active":"2024-01-24T13:03:56.024414+0000","last_became_peered":"2024-01-24T13:03:56.024414+0000","last_unstale":"2024-01-24T13:04:01.017636+0000","last_undegraded":"2024-01-24T13:04:01.017636+0000","last_fullsized":"2024-01-24T13:04:01.017636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:43:09.966851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.013466+0000","last_change":"2024-01-24T13:03:56.022620+0000","last_active":"2024-01-24T13:04:00.013466+0000","last_peered":"2024-01-24T13:04:00.013466+0000","last_clean":"2024-01-24T13:04:00.013466+0000","last_became_active":"2024-01-24T13:03:56.022340+0000","last_became_peered":"2024-01-24T13:03:56.022340+0000","last_unstale":"2024-01-24T13:04:00.013466+0000","last_undegraded":"2024-01-24T13:04:00.013466+0000","last_fullsized":"2024-01-24T13:04:00.013466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:13:44.864520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.011319+0000","last_change":"2024-01-24T13:03:56.021834+0000","last_active":"2024-01-24T13:04:00.011319+0000","last_peered":"2024-01-24T13:04:00.011319+0000","last_clean":"2024-01-24T13:04:00.011319+0000","last_became_active":"2024-01-24T13:03:56.021527+0000","last_became_peered":"2024-01-24T13:03:56.021527+0000","last_unstale":"2024-01-24T13:04:00.011319+0000","last_undegraded":"2024-01-24T13:04:00.011319+0000","last_fullsized":"2024-01-24T13:04:00.011319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:48:22.624362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015966+0000","last_change":"2024-01-24T13:03:56.009268+0000","last_active":"2024-01-24T13:04:01.015966+0000","last_peered":"2024-01-24T13:04:01.015966+0000","last_clean":"2024-01-24T13:04:01.015966+0000","last_became_active":"2024-01-24T13:03:56.009008+0000","last_became_peered":"2024-01-24T13:03:56.009008+0000","last_unstale":"2024-01-24T13:04:01.015966+0000","last_undegraded":"2024-01-24T13:04:01.015966+0000","last_fullsized":"2024-01-24T13:04:01.015966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:41:51.025201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.016927+0000","last_change":"2024-01-24T13:03:56.013449+0000","last_active":"2024-01-24T13:04:00.016927+0000","last_peered":"2024-01-24T13:04:00.016927+0000","last_clean":"2024-01-24T13:04:00.016927+0000","last_became_active":"2024-01-24T13:03:56.011189+0000","last_became_peered":"2024-01-24T13:03:56.011189+0000","last_unstale":"2024-01-24T13:04:00.016927+0000","last_undegraded":"2024-01-24T13:04:00.016927+0000","last_fullsized":"2024-01-24T13:04:00.016927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:02.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.016811+0000","last_change":"2024-01-24T13:03:56.024913+0000","last_active":"2024-01-24T13:04:00.016811+0000","last_peered":"2024-01-24T13:04:00.016811+0000","last_clean":"2024-01-24T13:04:00.016811+0000","last_became_active":"2024-01-24T13:03:56.024610+0000","last_became_peered":"2024-01-24T13:03:56.024610+0000","last_unstale":"2024-01-24T13:04:00.016811+0000","last_undegraded":"2024-01-24T13:04:00.016811+0000","last_fullsized":"2024-01-24T13:04:00.016811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:18:52.742448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.025821+0000","last_change":"2024-01-24T13:03:56.012889+0000","last_active":"2024-01-24T13:04:00.025821+0000","last_peered":"2024-01-24T13:04:00.025821+0000","last_clean":"2024-01-24T13:04:00.025821+0000","last_became_active":"2024-01-24T13:03:56.012457+0000","last_became_peered":"2024-01-24T13:03:56.012457+0000","last_unstale":"2024-01-24T13:04:00.025821+0000","last_undegraded":"2024-01-24T13:04:00.025821+0000","last_fullsized":"2024-01-24T13:04:00.025821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:25:17.038527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.030919+0000","last_change":"2024-01-24T13:03:56.007919+0000","last_active":"2024-01-24T13:04:00.030919+0000","last_peered":"2024-01-24T13:04:00.030919+0000","last_clean":"2024-01-24T13:04:00.030919+0000","last_became_active":"2024-01-24T13:03:56.007649+0000","last_became_peered":"2024-01-24T13:03:56.007649+0000","last_unstale":"2024-01-24T13:04:00.030919+0000","last_undegraded":"2024-01-24T13:04:00.030919+0000","last_fullsized":"2024-01-24T13:04:00.030919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:02:53.625968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.027982+0000","last_change":"2024-01-24T13:03:56.006823+0000","last_active":"2024-01-24T13:04:00.027982+0000","last_peered":"2024-01-24T13:04:00.027982+0000","last_clean":"2024-01-24T13:04:00.027982+0000","last_became_active":"2024-01-24T13:03:56.006551+0000","last_became_peered":"2024-01-24T13:03:56.006551+0000","last_unstale":"2024-01-24T13:04:00.027982+0000","last_undegraded":"2024-01-24T13:04:00.027982+0000","last_fullsized":"2024-01-24T13:04:00.027982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:44:47.469690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.022358+0000","last_change":"2024-01-24T13:03:56.011850+0000","last_active":"2024-01-24T13:04:00.022358+0000","last_peered":"2024-01-24T13:04:00.022358+0000","last_clean":"2024-01-24T13:04:00.022358+0000","last_became_active":"2024-01-24T13:03:56.011377+0000","last_became_peered":"2024-01-24T13:03:56.011377+0000","last_unstale":"2024-01-24T13:04:00.022358+0000","last_undegraded":"2024-01-24T13:04:00.022358+0000","last_fullsized":"2024-01-24T13:04:00.022358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:47:46.739111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.015553+0000","last_change":"2024-01-24T13:03:56.009254+0000","last_active":"2024-01-24T13:04:01.015553+0000","last_peered":"2024-01-24T13:04:01.015553+0000","last_clean":"2024-01-24T13:04:01.015553+0000","last_became_active":"2024-01-24T13:03:56.008910+0000","last_became_peered":"2024-01-24T13:03:56.008910+0000","last_unstale":"2024-01-24T13:04:01.015553+0000","last_undegraded":"2024-01-24T13:04:01.015553+0000","last_fullsized":"2024-01-24T13:04:01.015553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:57:08.977681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.021030+0000","last_change":"2024-01-24T13:03:56.008312+0000","last_active":"2024-01-24T13:04:00.021030+0000","last_peered":"2024-01-24T13:04:00.021030+0000","last_clean":"2024-01-24T13:04:00.021030+0000","last_became_active":"2024-01-24T13:03:56.008049+0000","last_became_peered":"2024-01-24T13:03:56.008049+0000","last_unstale":"2024-01-24T13:04:00.021030+0000","last_undegraded":"2024-01-24T13:04:00.021030+0000","last_fullsized":"2024-01-24T13:04:00.021030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:26:46.456477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013251+0000","last_change":"2024-01-24T13:03:56.007224+0000","last_active":"2024-01-24T13:04:01.013251+0000","last_peered":"2024-01-24T13:04:01.013251+0000","last_clean":"2024-01-24T13:04:01.013251+0000","last_became_active":"2024-01-24T13:03:56.006804+0000","last_became_peered":"2024-01-24T13:03:56.006804+0000","last_unstale":"2024-01-24T13:04:01.013251+0000","last_undegraded":"2024-01-24T13:04:01.013251+0000","last_fullsized":"2024-01-24T13:04:01.013251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:30:39.914222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.023149+0000","last_change":"2024-01-24T13:03:56.021601+0000","last_active":"2024-01-24T13:04:00.023149+0000","last_peered":"2024-01-24T13:04:00.023149+0000","last_clean":"2024-01-24T13:04:00.023149+0000","last_became_active":"2024-01-24T13:03:56.021378+0000","last_became_peered":"2024-01-24T13:03:56.021378+0000","last_unstale":"2024-01-24T13:04:00.023149+0000","last_undegraded":"2024-01-24T13:04:00.023149+0000","last_fullsized":"2024-01-24T13:04:00.023149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:26:27.582337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.013386+0000","last_change":"2024-01-24T13:03:56.006893+0000","last_active":"2024-01-24T13:04:01.013386+0000","last_peered":"2024-01-24T13:04:01.013386+0000","last_clean":"2024-01-24T13:04:01.013386+0000","last_became_active":"2024-01-24T13:03:56.006553+0000","last_became_peered":"2024-01-24T13:03:56.006553+0000","last_unstale":"2024-01-24T13:04:01.013386+0000","last_undegraded":"2024-01-24T13:04:01.013386+0000","last_fullsized":"2024-01-24T13:04:01.013386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:19:40.224981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.016663+0000","last_change":"2024-01-24T13:03:56.010902+0000","last_active":"2024-01-24T13:04:01.016663+0000","last_peered":"2024-01-24T13:04:01.016663+0000","last_clean":"2024-01-24T13:04:01.016663+0000","last_became_active":"2024-01-24T13:03:56.008359+0000","last_became_peered":"2024-01-24T13:03:56.008359+0000","last_unstale":"2024-01-24T13:04:01.016663+0000","last_undegraded":"2024-01-24T13:04:01.016663+0000","last_fullsized":"2024-01-24T13:04:01.016663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:01:35.209896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-24T13:04:01.017095+0000","last_change":"2024-01-24T13:03:56.018292+0000","last_active":"2024-01-24T13:04:01.017095+0000","last_peered":"2024-01-24T13:04:01.017095+0000","last_clean":"2024-01-24T13:04:01.017095+0000","last_became_active":"2024-01-24T13:03:56.015689+0000","last_became_peered":"2024-01-24T13:03:56.015689+0000","last_unstale":"2024-01-24T13:04:01.017095+0000","last_undegraded":"2024-01-24T13:04:01.017095+0000","last_fullsized":"2024-01-24T13:04:01.017095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:15:57.223738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-24T13:04:00.028853+0000","last_change":"2024-01-24T13:03:56.010593+0000","last_active":"2024-01-24T13:04:00.028853+0000","last_peered":"2024-01-24T13:04:00.028853+0000","last_clean":"2024-01-24T13:04:00.028853+0000","last_became_active":"2024-01-24T13:03:56.010357+0000","last_became_peered":"2024-01-24T13:03:56.010357+0000","last_unstale":"2024-01-24T13:04:00.028853+0000","last_undegraded":"2024-01-24T13:04:00.028853+0000","last_fullsized":"2024-01-24T13:04:00.028853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:55.560063+0000","last_clean_scrub_stamp":"2024-01-24T13:03:55.560063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:12:57.628509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":117206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":117082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":121549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":117664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":120877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":892928,"data_stored":707520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":303104,"data_stored":117138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":897024,"data_stored":707542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:04:25.787 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-24T13:04:25.787 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-24T13:04:25.787 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-24T13:04:25.787 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-24T13:04:25.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.960+0000 7ff607a00640 1 Processor -- start 2024-01-24T13:04:25.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.960+0000 7ff607a00640 1 -- start start 2024-01-24T13:04:25.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff607a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff60015fb50 0x7ff60015dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff607a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff60015d730 0x7ff6000cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff607a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6000ce4b0 0x7ff600152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff607a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6000ce900 con 0x7ff6000ce4b0 2024-01-24T13:04:25.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff607a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60006c0e0 con 0x7ff60015d730 2024-01-24T13:04:25.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff607a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60006cb20 con 0x7ff60015fb50 2024-01-24T13:04:25.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff605a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6000ce4b0 0x7ff600152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff605a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6000ce4b0 0x7ff600152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37460/0 (socket says 172.21.15.29:37460) 2024-01-24T13:04:25.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff605a00640 1 -- 172.21.15.29:0/707912549 learned_addr learned my addr 172.21.15.29:0/707912549 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:25.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff605a00640 1 -- 172.21.15.29:0/707912549 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff60015fb50 msgr2=0x7ff60015dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:25.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff605a00640 1 --2- 172.21.15.29:0/707912549 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff60015fb50 0x7ff60015dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff605a00640 1 -- 172.21.15.29:0/707912549 >> v2:172.21.15.163:3300/0 conn(0x7ff60015d730 msgr2=0x7ff6000cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:25.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff5ffe00640 1 --2- 172.21.15.29:0/707912549 >> v2:172.21.15.163:3300/0 conn(0x7ff60015d730 0x7ff6000cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff605a00640 1 --2- 172.21.15.29:0/707912549 >> v2:172.21.15.163:3300/0 conn(0x7ff60015d730 0x7ff6000cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff605a00640 1 -- 172.21.15.29:0/707912549 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60006b4d0 con 0x7ff6000ce4b0 2024-01-24T13:04:25.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.964+0000 7ff5ffe00640 1 --2- 172.21.15.29:0/707912549 >> v2:172.21.15.163:3300/0 conn(0x7ff60015d730 0x7ff6000cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:25.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff605a00640 1 --2- 172.21.15.29:0/707912549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6000ce4b0 0x7ff600152f80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff60006ab20 tx=0x7ff5f801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e6f058cfbfba30 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:25.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff5ff400640 1 -- 172.21.15.29:0/707912549 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f80a5820 con 0x7ff6000ce4b0 2024-01-24T13:04:25.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff5ff400640 1 -- 172.21.15.29:0/707912549 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f80a5980 con 0x7ff6000ce4b0 2024-01-24T13:04:25.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff5ff400640 1 -- 172.21.15.29:0/707912549 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f80a5d10 con 0x7ff6000ce4b0 2024-01-24T13:04:25.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff607a00640 1 -- 172.21.15.29:0/707912549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6000ce4b0 msgr2=0x7ff600152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff607a00640 1 --2- 172.21.15.29:0/707912549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6000ce4b0 0x7ff600152f80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff60006ab20 tx=0x7ff5f801c9a0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff607a00640 1 -- 172.21.15.29:0/707912549 shutdown_connections 2024-01-24T13:04:25.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff607a00640 1 --2- 172.21.15.29:0/707912549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6000ce4b0 0x7ff600152f80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff607a00640 1 --2- 172.21.15.29:0/707912549 >> v2:172.21.15.163:3300/0 conn(0x7ff60015d730 0x7ff6000cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff607a00640 1 --2- 172.21.15.29:0/707912549 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff60015fb50 0x7ff60015dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff607a00640 1 -- 172.21.15.29:0/707912549 >> 172.21.15.29:0/707912549 conn(0x7ff600070570 msgr2=0x7ff600069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:25.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff607a00640 1 -- 172.21.15.29:0/707912549 shutdown_connections 2024-01-24T13:04:25.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff607a00640 1 -- 172.21.15.29:0/707912549 wait complete. 2024-01-24T13:04:25.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff607a00640 1 Processor -- start 2024-01-24T13:04:25.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.968+0000 7ff607a00640 1 -- start start 2024-01-24T13:04:25.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff607a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6000ce4b0 0x7ff600156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff607a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff60015d730 0x7ff60015dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff607a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60015fb50 0x7ff6000b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff607a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff600156b90 con 0x7ff60015fb50 2024-01-24T13:04:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff607a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000b49b0 con 0x7ff6000ce4b0 2024-01-24T13:04:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff607a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000b4c90 con 0x7ff60015d730 2024-01-24T13:04:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff605a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60015fb50 0x7ff6000b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff605a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60015fb50 0x7ff6000b5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37472/0 (socket says 172.21.15.29:37472) 2024-01-24T13:04:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff605a00640 1 -- 172.21.15.29:0/1873903569 learned_addr learned my addr 172.21.15.29:0/1873903569 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff5ffe00640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff60015d730 0x7ff60015dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff605000640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6000ce4b0 0x7ff600156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff605a00640 1 -- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff60015d730 msgr2=0x7ff60015dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff605a00640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff60015d730 0x7ff60015dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff605a00640 1 -- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6000ce4b0 msgr2=0x7ff600156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:25.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff605a00640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6000ce4b0 0x7ff600156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:25.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff605a00640 1 -- 172.21.15.29:0/1873903569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8009b30 con 0x7ff60015fb50 2024-01-24T13:04:25.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff605000640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6000ce4b0 0x7ff600156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:25.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff5ffe00640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff60015d730 0x7ff60015dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:25.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff605a00640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60015fb50 0x7ff6000b5a50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff5f801b050 tx=0x7ff5f8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:25.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff5fcc00640 1 -- 172.21.15.29:0/1873903569 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f80b8670 con 0x7ff60015fb50 2024-01-24T13:04:25.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff5fcc00640 1 -- 172.21.15.29:0/1873903569 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f80b8830 con 0x7ff60015fb50 2024-01-24T13:04:25.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff5fcc00640 1 -- 172.21.15.29:0/1873903569 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f80b8be0 con 0x7ff60015fb50 2024-01-24T13:04:25.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff607a00640 1 -- 172.21.15.29:0/1873903569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6000b4f70 con 0x7ff60015fb50 2024-01-24T13:04:25.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff607a00640 1 -- 172.21.15.29:0/1873903569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6000b5530 con 0x7ff60015fb50 2024-01-24T13:04:25.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.972+0000 7ff607a00640 1 -- 172.21.15.29:0/1873903569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6000cdd50 con 0x7ff60015fb50 2024-01-24T13:04:25.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.976+0000 7ff5fcc00640 1 -- 172.21.15.29:0/1873903569 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff5f80b8d40 con 0x7ff60015fb50 2024-01-24T13:04:25.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.976+0000 7ff5fcc00640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff5d8065a60 0x7ff5d8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:25.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.976+0000 7ff5fcc00640 1 -- 172.21.15.29:0/1873903569 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff5f811ec10 con 0x7ff60015fb50 2024-01-24T13:04:25.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.976+0000 7ff605000640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff5d8065a60 0x7ff5d8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:25.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.976+0000 7ff605000640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff5d8065a60 0x7ff5d8067f20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0006fd0 tx=0x7ff5f0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:25.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:25.980+0000 7ff5fcc00640 1 -- 172.21.15.29:0/1873903569 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff6000cdd50 con 0x7ff60015fb50 2024-01-24T13:04:26.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.172+0000 7ff607a00640 1 -- 172.21.15.29:0/1873903569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff6000cdd50 con 0x7ff60015fb50 2024-01-24T13:04:26.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.172+0000 7ff5fcc00640 1 -- 172.21.15.29:0/1873903569 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff6000cdd50 con 0x7ff60015fb50 2024-01-24T13:04:26.174 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:26.174 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-24T13:04:26.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.172+0000 7ff607a00640 1 -- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff5d8065a60 msgr2=0x7ff5d8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:26.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.172+0000 7ff607a00640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff5d8065a60 0x7ff5d8067f20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0006fd0 tx=0x7ff5f0008040 comp rx=0 tx=0).stop 2024-01-24T13:04:26.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.172+0000 7ff607a00640 1 -- 172.21.15.29:0/1873903569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60015fb50 msgr2=0x7ff6000b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:26.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.172+0000 7ff607a00640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60015fb50 0x7ff6000b5a50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff5f801b050 tx=0x7ff5f8019740 comp rx=0 tx=0).stop 2024-01-24T13:04:26.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.172+0000 7ff607a00640 1 -- 172.21.15.29:0/1873903569 shutdown_connections 2024-01-24T13:04:26.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.172+0000 7ff607a00640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff5d8065a60 0x7ff5d8067f20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.172+0000 7ff607a00640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60015fb50 0x7ff6000b5a50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.172+0000 7ff607a00640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff60015d730 0x7ff60015dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.172+0000 7ff607a00640 1 --2- 172.21.15.29:0/1873903569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6000ce4b0 0x7ff600156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.172+0000 7ff607a00640 1 -- 172.21.15.29:0/1873903569 >> 172.21.15.29:0/1873903569 conn(0x7ff600070570 msgr2=0x7ff6000d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:26.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.172+0000 7ff607a00640 1 -- 172.21.15.29:0/1873903569 shutdown_connections 2024-01-24T13:04:26.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.172+0000 7ff607a00640 1 -- 172.21.15.29:0/1873903569 wait complete. 2024-01-24T13:04:26.197 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-24T13:04:26.197 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:26.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.336+0000 7f927f400640 1 Processor -- start 2024-01-24T13:04:26.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.336+0000 7f927f400640 1 -- start start 2024-01-24T13:04:26.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f927f400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92780ce5e0 0x7f92780abd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:26.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f927f400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f92780b1f50 0x7f92780ac290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:26.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f927f400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9278070230 con 0x7f927815c450 2024-01-24T13:04:26.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f927f400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92780712d0 con 0x7f92780ce5e0 2024-01-24T13:04:26.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f927f400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9278070510 con 0x7f92780b1f50 2024-01-24T13:04:26.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f9277e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92780ce5e0 0x7f92780abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:26.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f9277e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92780ce5e0 0x7f92780abd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37480/0 (socket says 172.21.15.29:37480) 2024-01-24T13:04:26.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f9277e00640 1 -- 172.21.15.29:0/1001700593 learned_addr learned my addr 172.21.15.29:0/1001700593 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:26.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f927d400640 1 --2- 172.21.15.29:0/1001700593 >> v2:172.21.15.163:3300/0 conn(0x7f92780b1f50 0x7f92780ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:26.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f9277e00640 1 -- 172.21.15.29:0/1001700593 >> v2:172.21.15.163:3300/0 conn(0x7f92780b1f50 msgr2=0x7f92780ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:26.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f9277e00640 1 --2- 172.21.15.29:0/1001700593 >> v2:172.21.15.163:3300/0 conn(0x7f92780b1f50 0x7f92780ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f9277e00640 1 -- 172.21.15.29:0/1001700593 >> v1:172.21.15.163:6789/0 conn(0x7f927815c450 legacy=0x7f92780cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:26.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f9277e00640 1 -- 172.21.15.29:0/1001700593 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92780707f0 con 0x7f92780ce5e0 2024-01-24T13:04:26.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f927d400640 1 --2- 172.21.15.29:0/1001700593 >> v2:172.21.15.163:3300/0 conn(0x7f92780b1f50 0x7f92780ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:26.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.340+0000 7f9277e00640 1 --2- 172.21.15.29:0/1001700593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92780ce5e0 0x7f92780abd50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f92780b2cf0 tx=0x7f926001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60e9eb0fb723048 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:26.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f9277400640 1 -- 172.21.15.29:0/1001700593 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600ab670 con 0x7f92780ce5e0 2024-01-24T13:04:26.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f9277400640 1 -- 172.21.15.29:0/1001700593 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92600ab7d0 con 0x7f92780ce5e0 2024-01-24T13:04:26.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f9277400640 1 -- 172.21.15.29:0/1001700593 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600abb60 con 0x7f92780ce5e0 2024-01-24T13:04:26.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f927f400640 1 -- 172.21.15.29:0/1001700593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92780ce5e0 msgr2=0x7f92780abd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:26.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f927f400640 1 --2- 172.21.15.29:0/1001700593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92780ce5e0 0x7f92780abd50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f92780b2cf0 tx=0x7f926001c470 comp rx=0 tx=0).stop 2024-01-24T13:04:26.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f927f400640 1 -- 172.21.15.29:0/1001700593 shutdown_connections 2024-01-24T13:04:26.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f927f400640 1 --2- 172.21.15.29:0/1001700593 >> v2:172.21.15.163:3300/0 conn(0x7f92780b1f50 0x7f92780ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f927f400640 1 --2- 172.21.15.29:0/1001700593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92780ce5e0 0x7f92780abd50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f927f400640 1 -- 172.21.15.29:0/1001700593 >> 172.21.15.29:0/1001700593 conn(0x7f92780b3950 msgr2=0x7f9278069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:26.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f927f400640 1 -- 172.21.15.29:0/1001700593 shutdown_connections 2024-01-24T13:04:26.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f927f400640 1 -- 172.21.15.29:0/1001700593 wait complete. 2024-01-24T13:04:26.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f927f400640 1 Processor -- start 2024-01-24T13:04:26.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f927f400640 1 -- start start 2024-01-24T13:04:26.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f927f400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f92780b1f50 0x7f9278153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:26.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.344+0000 7f927f400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92780ce5e0 0x7f9278146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:26.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f927f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f927815c450 0x7f927813f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:26.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f927f400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9278140500 con 0x7f92780ce5e0 2024-01-24T13:04:26.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f927f400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9278140750 con 0x7f927815c450 2024-01-24T13:04:26.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f927f400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9278140a30 con 0x7f92780b1f50 2024-01-24T13:04:26.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f9277e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92780ce5e0 0x7f9278146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:26.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f9277e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92780ce5e0 0x7f9278146ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37492/0 (socket says 172.21.15.29:37492) 2024-01-24T13:04:26.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f9277e00640 1 -- 172.21.15.29:0/1633521288 learned_addr learned my addr 172.21.15.29:0/1633521288 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:26.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f927ca00640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f92780b1f50 0x7f9278153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:26.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f927d400640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f927815c450 0x7f927813f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:26.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f9277e00640 1 -- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f92780b1f50 msgr2=0x7f9278153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:26.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f9277e00640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f92780b1f50 0x7f9278153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f9277e00640 1 -- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f927815c450 msgr2=0x7f927813f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:26.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f9277e00640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f927815c450 0x7f927813f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f9277e00640 1 -- 172.21.15.29:0/1633521288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92600094d0 con 0x7f92780ce5e0 2024-01-24T13:04:26.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f927d400640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f927815c450 0x7f927813f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:26.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f927ca00640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f92780b1f50 0x7f9278153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:26.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f9277e00640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92780ce5e0 0x7f9278146ca0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9260019080 tx=0x7f926001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:26.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f9274c00640 1 -- 172.21.15.29:0/1633521288 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600b4800 con 0x7f92780ce5e0 2024-01-24T13:04:26.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f9274c00640 1 -- 172.21.15.29:0/1633521288 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92600b4980 con 0x7f92780ce5e0 2024-01-24T13:04:26.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f9274c00640 1 -- 172.21.15.29:0/1633521288 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600b4d30 con 0x7f92780ce5e0 2024-01-24T13:04:26.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f927f400640 1 -- 172.21.15.29:0/1633521288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9278140d10 con 0x7f92780ce5e0 2024-01-24T13:04:26.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f927f400640 1 -- 172.21.15.29:0/1633521288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92781412d0 con 0x7f92780ce5e0 2024-01-24T13:04:26.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f927f400640 1 -- 172.21.15.29:0/1633521288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927804e850 con 0x7f92780ce5e0 2024-01-24T13:04:26.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.348+0000 7f9274c00640 1 -- 172.21.15.29:0/1633521288 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f92600b3380 con 0x7f92780ce5e0 2024-01-24T13:04:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.352+0000 7f9274c00640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9250065a60 0x7f9250067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.352+0000 7f9274c00640 1 -- 172.21.15.29:0/1633521288 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f926011d800 con 0x7f92780ce5e0 2024-01-24T13:04:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.352+0000 7f927ca00640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9250065a60 0x7f9250067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.352+0000 7f927ca00640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9250065a60 0x7f9250067f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9268000f70 tx=0x7f9268009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:26.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.352+0000 7f9274c00640 1 -- 172.21.15.29:0/1633521288 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f92600eaf70 con 0x7f92780ce5e0 2024-01-24T13:04:26.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.516+0000 7f927f400640 1 -- 172.21.15.29:0/1633521288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9278141490 con 0x7f92780ce5e0 2024-01-24T13:04:26.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.516+0000 7f9274c00640 1 -- 172.21.15.29:0/1633521288 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f92600ee590 con 0x7f92780ce5e0 2024-01-24T13:04:26.518 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:26.518 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:01.140044+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.516+0000 7f927f400640 1 -- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9250065a60 msgr2=0x7f9250067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.516+0000 7f927f400640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9250065a60 0x7f9250067f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9268000f70 tx=0x7f9268009040 comp rx=0 tx=0).stop 2024-01-24T13:04:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.516+0000 7f927f400640 1 -- 172.21.15.29:0/1633521288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92780ce5e0 msgr2=0x7f9278146ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.516+0000 7f927f400640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92780ce5e0 0x7f9278146ca0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9260019080 tx=0x7f926001acb0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.520+0000 7f927f400640 1 -- 172.21.15.29:0/1633521288 shutdown_connections 2024-01-24T13:04:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.520+0000 7f927f400640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9250065a60 0x7f9250067f20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.520+0000 7f927f400640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f927815c450 0x7f927813f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.520+0000 7f927f400640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92780ce5e0 0x7f9278146ca0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.520+0000 7f927f400640 1 --2- 172.21.15.29:0/1633521288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f92780b1f50 0x7f9278153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.520+0000 7f927f400640 1 -- 172.21.15.29:0/1633521288 >> 172.21.15.29:0/1633521288 conn(0x7f92780b3950 msgr2=0x7f92780b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.520+0000 7f927f400640 1 -- 172.21.15.29:0/1633521288 shutdown_connections 2024-01-24T13:04:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.520+0000 7f927f400640 1 -- 172.21.15.29:0/1633521288 wait complete. 2024-01-24T13:04:26.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:04:26.542 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:04:26.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.684+0000 7fb80c600640 1 Processor -- start 2024-01-24T13:04:26.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.684+0000 7fb80c600640 1 -- start start 2024-01-24T13:04:26.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.684+0000 7fb80c600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb80415c690 0x7fb8040cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:26.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.684+0000 7fb80c600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8040b3360 0x7fb8040ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:26.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.684+0000 7fb80c600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb8040abae0 0x7fb80406bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:26.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.684+0000 7fb80c600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb804160fc0 con 0x7fb80415c690 2024-01-24T13:04:26.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.684+0000 7fb80c600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8040b2ef0 con 0x7fb8040abae0 2024-01-24T13:04:26.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.684+0000 7fb80c600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8041603f0 con 0x7fb8040b3360 2024-01-24T13:04:26.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.684+0000 7fb809c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb80415c690 0x7fb8040cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:26.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.684+0000 7fb809c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb80415c690 0x7fb8040cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37502/0 (socket says 172.21.15.29:37502) 2024-01-24T13:04:26.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.684+0000 7fb809c00640 1 -- 172.21.15.29:0/686517468 learned_addr learned my addr 172.21.15.29:0/686517468 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:26.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.688+0000 7fb80a600640 1 --2- 172.21.15.29:0/686517468 >> v2:172.21.15.163:3300/0 conn(0x7fb8040abae0 0x7fb80406bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:26.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.688+0000 7fb809200640 1 --2- 172.21.15.29:0/686517468 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8040b3360 0x7fb8040ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:26.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.688+0000 7fb809c00640 1 -- 172.21.15.29:0/686517468 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8040b3360 msgr2=0x7fb8040ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:26.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.688+0000 7fb809c00640 1 --2- 172.21.15.29:0/686517468 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8040b3360 0x7fb8040ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.688+0000 7fb809c00640 1 -- 172.21.15.29:0/686517468 >> v2:172.21.15.163:3300/0 conn(0x7fb8040abae0 msgr2=0x7fb80406bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:26.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.688+0000 7fb809c00640 1 --2- 172.21.15.29:0/686517468 >> v2:172.21.15.163:3300/0 conn(0x7fb8040abae0 0x7fb80406bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.688+0000 7fb809c00640 1 -- 172.21.15.29:0/686517468 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb804160690 con 0x7fb80415c690 2024-01-24T13:04:26.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.688+0000 7fb809c00640 1 --2- 172.21.15.29:0/686517468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80415c690 0x7fb8040cdea0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb80406cda0 tx=0x7fb7f401c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764614b18cda915f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.688+0000 7fb803e00640 1 -- 172.21.15.29:0/686517468 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40ab400 con 0x7fb80415c690 2024-01-24T13:04:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.688+0000 7fb803e00640 1 -- 172.21.15.29:0/686517468 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f40a7050 con 0x7fb80415c690 2024-01-24T13:04:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.688+0000 7fb803e00640 1 -- 172.21.15.29:0/686517468 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40ab780 con 0x7fb80415c690 2024-01-24T13:04:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 -- 172.21.15.29:0/686517468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80415c690 msgr2=0x7fb8040cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 --2- 172.21.15.29:0/686517468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80415c690 0x7fb8040cdea0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb80406cda0 tx=0x7fb7f401c1b0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 -- 172.21.15.29:0/686517468 shutdown_connections 2024-01-24T13:04:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 --2- 172.21.15.29:0/686517468 >> v2:172.21.15.163:3300/0 conn(0x7fb8040abae0 0x7fb80406bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 --2- 172.21.15.29:0/686517468 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8040b3360 0x7fb8040ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 --2- 172.21.15.29:0/686517468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80415c690 0x7fb8040cdea0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 -- 172.21.15.29:0/686517468 >> 172.21.15.29:0/686517468 conn(0x7fb80406d700 msgr2=0x7fb804069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:26.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 -- 172.21.15.29:0/686517468 shutdown_connections 2024-01-24T13:04:26.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 -- 172.21.15.29:0/686517468 wait complete. 2024-01-24T13:04:26.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 Processor -- start 2024-01-24T13:04:26.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 -- start start 2024-01-24T13:04:26.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8040abae0 0x7fb804148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8040b3360 0x7fb804151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb80415c690 0x7fb804145980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80414b470 con 0x7fb8040b3360 2024-01-24T13:04:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80414a7f0 con 0x7fb80415c690 2024-01-24T13:04:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.692+0000 7fb80c600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80414aad0 con 0x7fb8040abae0 2024-01-24T13:04:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb809200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8040b3360 0x7fb804151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb809200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8040b3360 0x7fb804151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37518/0 (socket says 172.21.15.29:37518) 2024-01-24T13:04:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb809200640 1 -- 172.21.15.29:0/3914072005 learned_addr learned my addr 172.21.15.29:0/3914072005 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb80a600640 1 --2- 172.21.15.29:0/3914072005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb80415c690 0x7fb804145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb809c00640 1 --2- 172.21.15.29:0/3914072005 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8040abae0 0x7fb804148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb809200640 1 -- 172.21.15.29:0/3914072005 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8040abae0 msgr2=0x7fb804148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb809200640 1 --2- 172.21.15.29:0/3914072005 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8040abae0 0x7fb804148aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb809200640 1 -- 172.21.15.29:0/3914072005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb80415c690 msgr2=0x7fb804145980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb809200640 1 --2- 172.21.15.29:0/3914072005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb80415c690 0x7fb804145980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb809200640 1 -- 172.21.15.29:0/3914072005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f40094d0 con 0x7fb8040b3360 2024-01-24T13:04:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb809200640 1 --2- 172.21.15.29:0/3914072005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8040b3360 0x7fb804151c50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00e930 tx=0x7fb7ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb801600640 1 -- 172.21.15.29:0/3914072005 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec009690 con 0x7fb8040b3360 2024-01-24T13:04:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb801600640 1 -- 172.21.15.29:0/3914072005 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec00ca00 con 0x7fb8040b3360 2024-01-24T13:04:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb801600640 1 -- 172.21.15.29:0/3914072005 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00cd70 con 0x7fb8040b3360 2024-01-24T13:04:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb80c600640 1 -- 172.21.15.29:0/3914072005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80414adb0 con 0x7fb8040b3360 2024-01-24T13:04:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb80c600640 1 -- 172.21.15.29:0/3914072005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb804152190 con 0x7fb8040b3360 2024-01-24T13:04:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb7faa00640 1 -- 172.21.15.29:0/3914072005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80414b6e0 con 0x7fb8040b3360 2024-01-24T13:04:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.696+0000 7fb801600640 1 -- 172.21.15.29:0/3914072005 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb7ec013470 con 0x7fb8040b3360 2024-01-24T13:04:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.700+0000 7fb801600640 1 --2- 172.21.15.29:0/3914072005 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7dc065a60 0x7fb7dc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.700+0000 7fb801600640 1 -- 172.21.15.29:0/3914072005 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb7ec083620 con 0x7fb8040b3360 2024-01-24T13:04:26.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.700+0000 7fb809c00640 1 --2- 172.21.15.29:0/3914072005 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7dc065a60 0x7fb7dc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:26.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.700+0000 7fb809c00640 1 --2- 172.21.15.29:0/3914072005 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7dc065a60 0x7fb7dc067f20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40ad000 tx=0x7fb7f4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:26.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.704+0000 7fb801600640 1 -- 172.21.15.29:0/3914072005 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb7ec050e50 con 0x7fb8040b3360 2024-01-24T13:04:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.864+0000 7fb7faa00640 1 -- 172.21.15.29:0/3914072005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb804152410 con 0x7fb8040b3360 2024-01-24T13:04:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.864+0000 7fb801600640 1 -- 172.21.15.29:0/3914072005 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7ec054470 con 0x7fb8040b3360 2024-01-24T13:04:26.867 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:04:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.868+0000 7fb7faa00640 1 -- 172.21.15.29:0/3914072005 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7dc065a60 msgr2=0x7fb7dc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.868+0000 7fb7faa00640 1 --2- 172.21.15.29:0/3914072005 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7dc065a60 0x7fb7dc067f20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40ad000 tx=0x7fb7f4008040 comp rx=0 tx=0).stop 2024-01-24T13:04:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.868+0000 7fb7faa00640 1 -- 172.21.15.29:0/3914072005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8040b3360 msgr2=0x7fb804151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.868+0000 7fb7faa00640 1 --2- 172.21.15.29:0/3914072005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8040b3360 0x7fb804151c50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00e930 tx=0x7fb7ec00edf0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.868+0000 7fb7faa00640 1 -- 172.21.15.29:0/3914072005 shutdown_connections 2024-01-24T13:04:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.868+0000 7fb7faa00640 1 --2- 172.21.15.29:0/3914072005 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7dc065a60 0x7fb7dc067f20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.868+0000 7fb7faa00640 1 --2- 172.21.15.29:0/3914072005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb80415c690 0x7fb804145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.868+0000 7fb7faa00640 1 --2- 172.21.15.29:0/3914072005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8040b3360 0x7fb804151c50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.868+0000 7fb7faa00640 1 --2- 172.21.15.29:0/3914072005 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8040abae0 0x7fb804148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.868+0000 7fb7faa00640 1 -- 172.21.15.29:0/3914072005 >> 172.21.15.29:0/3914072005 conn(0x7fb80406d700 msgr2=0x7fb8040ae410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.868+0000 7fb7faa00640 1 -- 172.21.15.29:0/3914072005 shutdown_connections 2024-01-24T13:04:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:26.868+0000 7fb7faa00640 1 -- 172.21.15.29:0/3914072005 wait complete. 2024-01-24T13:04:26.890 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:04:27.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f9395a00640 1 Processor -- start 2024-01-24T13:04:27.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f9395a00640 1 -- start start 2024-01-24T13:04:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f9395a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f93900ce050 0x7f93900ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f9395a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939006b0a0 0x7f939006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f9395a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9390161130 con 0x7f93900cd300 2024-01-24T13:04:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f9395a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93900cea20 con 0x7f93900ce050 2024-01-24T13:04:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f9395a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93901605b0 con 0x7f939006b0a0 2024-01-24T13:04:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f938e000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f93900ce050 0x7f93900ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f938f400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939006b0a0 0x7f939006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f938ea00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f93900cd300 0x7f939015d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:36008/0 (socket says 172.21.15.29:36008) 2024-01-24T13:04:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f938e000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f93900ce050 0x7f93900ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34552/0 (socket says 172.21.15.29:34552) 2024-01-24T13:04:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f938ea00640 1 -- 172.21.15.29:0/33335184 learned_addr learned my addr 172.21.15.29:0/33335184 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f938e000640 1 -- 172.21.15.29:0/33335184 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939006b0a0 msgr2=0x7f939006b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f938e000640 1 --2- 172.21.15.29:0/33335184 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939006b0a0 0x7f939006b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f938e000640 1 -- 172.21.15.29:0/33335184 >> v1:172.21.15.163:6789/0 conn(0x7f93900cd300 legacy=0x7f939015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.031+0000 7f938e000640 1 -- 172.21.15.29:0/33335184 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9390160890 con 0x7f93900ce050 2024-01-24T13:04:27.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.035+0000 7f938e000640 1 --2- 172.21.15.29:0/33335184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93900ce050 0x7f93900ce4e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f93780097c0 tx=0x7f937801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cdffea57810b8cc server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:27.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.035+0000 7f938d600640 1 -- 172.21.15.29:0/33335184 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93780ab680 con 0x7f93900ce050 2024-01-24T13:04:27.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.035+0000 7f938d600640 1 -- 172.21.15.29:0/33335184 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93780ab7e0 con 0x7f93900ce050 2024-01-24T13:04:27.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.035+0000 7f938d600640 1 -- 172.21.15.29:0/33335184 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93780abb70 con 0x7f93900ce050 2024-01-24T13:04:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.035+0000 7f9395a00640 1 -- 172.21.15.29:0/33335184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93900ce050 msgr2=0x7f93900ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.035+0000 7f9395a00640 1 --2- 172.21.15.29:0/33335184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93900ce050 0x7f93900ce4e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f93780097c0 tx=0x7f937801c480 comp rx=0 tx=0).stop 2024-01-24T13:04:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.035+0000 7f9395a00640 1 -- 172.21.15.29:0/33335184 shutdown_connections 2024-01-24T13:04:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.035+0000 7f9395a00640 1 --2- 172.21.15.29:0/33335184 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939006b0a0 0x7f939006b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.035+0000 7f9395a00640 1 --2- 172.21.15.29:0/33335184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93900ce050 0x7f93900ce4e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.035+0000 7f9395a00640 1 -- 172.21.15.29:0/33335184 >> 172.21.15.29:0/33335184 conn(0x7f9390069cd0 msgr2=0x7f939006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f9395a00640 1 -- 172.21.15.29:0/33335184 shutdown_connections 2024-01-24T13:04:27.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f9395a00640 1 -- 172.21.15.29:0/33335184 wait complete. 2024-01-24T13:04:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f9395a00640 1 Processor -- start 2024-01-24T13:04:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f9395a00640 1 -- start start 2024-01-24T13:04:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f9395a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939006b0a0 0x7f93900c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f9395a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93900cd300 0x7f939014d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f9395a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93900ce050 0x7f939014df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f9395a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93900b4a70 con 0x7f93900cd300 2024-01-24T13:04:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f9395a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939014e490 con 0x7f93900ce050 2024-01-24T13:04:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f9395a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939014e730 con 0x7f939006b0a0 2024-01-24T13:04:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f938e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93900cd300 0x7f939014d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f938e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93900cd300 0x7f939014d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37526/0 (socket says 172.21.15.29:37526) 2024-01-24T13:04:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f938e000640 1 -- 172.21.15.29:0/3150945037 learned_addr learned my addr 172.21.15.29:0/3150945037 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f938f400640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93900ce050 0x7f939014df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f938ea00640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939006b0a0 0x7f93900c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f938e000640 1 -- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939006b0a0 msgr2=0x7f93900c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f938e000640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939006b0a0 0x7f93900c4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f938e000640 1 -- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93900ce050 msgr2=0x7f939014df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f938e000640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93900ce050 0x7f939014df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f938e000640 1 -- 172.21.15.29:0/3150945037 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9378009420 con 0x7f93900cd300 2024-01-24T13:04:27.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f938f400640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93900ce050 0x7f939014df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:27.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f938ea00640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939006b0a0 0x7f93900c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:27.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.039+0000 7f938e000640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93900cd300 0x7f939014d930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f93780ad040 tx=0x7f937801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.043+0000 7f9386a00640 1 -- 172.21.15.29:0/3150945037 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93780bf610 con 0x7f93900cd300 2024-01-24T13:04:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.043+0000 7f9386a00640 1 -- 172.21.15.29:0/3150945037 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93780bf790 con 0x7f93900cd300 2024-01-24T13:04:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.043+0000 7f9395a00640 1 -- 172.21.15.29:0/3150945037 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939014ea10 con 0x7f93900cd300 2024-01-24T13:04:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.043+0000 7f9386a00640 1 -- 172.21.15.29:0/3150945037 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93780bfb40 con 0x7f93900cd300 2024-01-24T13:04:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.043+0000 7f9395a00640 1 -- 172.21.15.29:0/3150945037 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939014efd0 con 0x7f93900cd300 2024-01-24T13:04:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.043+0000 7f9395a00640 1 -- 172.21.15.29:0/3150945037 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939004e850 con 0x7f93900cd300 2024-01-24T13:04:27.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.043+0000 7f9386a00640 1 -- 172.21.15.29:0/3150945037 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f93780bfca0 con 0x7f93900cd300 2024-01-24T13:04:27.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.043+0000 7f9386a00640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9368065a60 0x7f9368067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.043+0000 7f9386a00640 1 -- 172.21.15.29:0/3150945037 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f937811df30 con 0x7f93900cd300 2024-01-24T13:04:27.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.043+0000 7f938ea00640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9368065a60 0x7f9368067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.047+0000 7f938ea00640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9368065a60 0x7f9368067f20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9380005890 tx=0x7f9380009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:27.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.047+0000 7f9386a00640 1 -- 172.21.15.29:0/3150945037 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f93780eb560 con 0x7f93900cd300 2024-01-24T13:04:27.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.207+0000 7f9395a00640 1 -- 172.21.15.29:0/3150945037 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93900ce770 con 0x7f93900cd300 2024-01-24T13:04:27.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.207+0000 7f9386a00640 1 -- 172.21.15.29:0/3150945037 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f93780eeb80 con 0x7f93900cd300 2024-01-24T13:04:27.209 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.207+0000 7f9395a00640 1 -- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9368065a60 msgr2=0x7f9368067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.207+0000 7f9395a00640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9368065a60 0x7f9368067f20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9380005890 tx=0x7f9380009040 comp rx=0 tx=0).stop 2024-01-24T13:04:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.207+0000 7f9395a00640 1 -- 172.21.15.29:0/3150945037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93900cd300 msgr2=0x7f939014d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.207+0000 7f9395a00640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93900cd300 0x7f939014d930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f93780ad040 tx=0x7f937801acc0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.207+0000 7f9395a00640 1 -- 172.21.15.29:0/3150945037 shutdown_connections 2024-01-24T13:04:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.207+0000 7f9395a00640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9368065a60 0x7f9368067f20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.207+0000 7f9395a00640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93900ce050 0x7f939014df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.207+0000 7f9395a00640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93900cd300 0x7f939014d930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.207+0000 7f9395a00640 1 --2- 172.21.15.29:0/3150945037 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939006b0a0 0x7f93900c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.207+0000 7f9395a00640 1 -- 172.21.15.29:0/3150945037 >> 172.21.15.29:0/3150945037 conn(0x7f9390069cd0 msgr2=0x7f939015e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.207+0000 7f9395a00640 1 -- 172.21.15.29:0/3150945037 shutdown_connections 2024-01-24T13:04:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.207+0000 7f9395a00640 1 -- 172.21.15.29:0/3150945037 wait complete. 2024-01-24T13:04:27.231 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:04:27.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.371+0000 7f1e51a00640 1 Processor -- start 2024-01-24T13:04:27.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.371+0000 7f1e51a00640 1 -- start start 2024-01-24T13:04:27.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.371+0000 7f1e51a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1e4c158ca0 0x7f1e4c0b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.371+0000 7f1e51a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1e4c070560 0x7f1e4c06c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.371+0000 7f1e51a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4c070970 con 0x7f1e4c06bbc0 2024-01-24T13:04:27.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.371+0000 7f1e51a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4c159080 con 0x7f1e4c158ca0 2024-01-24T13:04:27.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.371+0000 7f1e51a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4c070ba0 con 0x7f1e4c070560 2024-01-24T13:04:27.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.375+0000 7f1e4aa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1e4c158ca0 0x7f1e4c0b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.375+0000 7f1e4a000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1e4c06bbc0 0x7f1e4c06fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41658/0 (socket says 172.21.15.29:41658) 2024-01-24T13:04:27.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.375+0000 7f1e4a000640 1 -- 172.21.15.29:0/1575507936 learned_addr learned my addr 172.21.15.29:0/1575507936 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:27.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.375+0000 7f1e4aa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1e4c158ca0 0x7f1e4c0b2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37530/0 (socket says 172.21.15.29:37530) 2024-01-24T13:04:27.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.375+0000 7f1e4b400640 1 --2- 172.21.15.29:0/1575507936 >> v2:172.21.15.163:3300/0 conn(0x7f1e4c070560 0x7f1e4c06c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.375+0000 7f1e4aa00640 1 -- 172.21.15.29:0/1575507936 >> v2:172.21.15.163:3300/0 conn(0x7f1e4c070560 msgr2=0x7f1e4c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:27.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.375+0000 7f1e4aa00640 1 --2- 172.21.15.29:0/1575507936 >> v2:172.21.15.163:3300/0 conn(0x7f1e4c070560 0x7f1e4c06c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.375+0000 7f1e4aa00640 1 -- 172.21.15.29:0/1575507936 >> v1:172.21.15.29:6789/0 conn(0x7f1e4c06bbc0 legacy=0x7f1e4c06fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.375+0000 7f1e4aa00640 1 -- 172.21.15.29:0/1575507936 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c06c560 con 0x7f1e4c158ca0 2024-01-24T13:04:27.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.375+0000 7f1e4aa00640 1 --2- 172.21.15.29:0/1575507936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e4c158ca0 0x7f1e4c0b2680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c0ca760 tx=0x7f1e3c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d7be007898db47 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:27.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.375+0000 7f1e49600640 1 -- 172.21.15.29:0/1575507936 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0ac410 con 0x7f1e4c158ca0 2024-01-24T13:04:27.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.375+0000 7f1e49600640 1 -- 172.21.15.29:0/1575507936 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c0ac570 con 0x7f1e4c158ca0 2024-01-24T13:04:27.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.375+0000 7f1e49600640 1 -- 172.21.15.29:0/1575507936 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0ac900 con 0x7f1e4c158ca0 2024-01-24T13:04:27.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 -- 172.21.15.29:0/1575507936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e4c158ca0 msgr2=0x7f1e4c0b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 --2- 172.21.15.29:0/1575507936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e4c158ca0 0x7f1e4c0b2680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c0ca760 tx=0x7f1e3c01c430 comp rx=0 tx=0).stop 2024-01-24T13:04:27.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 -- 172.21.15.29:0/1575507936 shutdown_connections 2024-01-24T13:04:27.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 --2- 172.21.15.29:0/1575507936 >> v2:172.21.15.163:3300/0 conn(0x7f1e4c070560 0x7f1e4c06c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 --2- 172.21.15.29:0/1575507936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e4c158ca0 0x7f1e4c0b2680 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 -- 172.21.15.29:0/1575507936 >> 172.21.15.29:0/1575507936 conn(0x7f1e4c06d700 msgr2=0x7f1e4c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:27.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 -- 172.21.15.29:0/1575507936 shutdown_connections 2024-01-24T13:04:27.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 -- 172.21.15.29:0/1575507936 wait complete. 2024-01-24T13:04:27.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 Processor -- start 2024-01-24T13:04:27.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 -- start start 2024-01-24T13:04:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e4c06bbc0 0x7f1e4c14a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1e4c070560 0x7f1e4c13abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1e4c158ca0 0x7f1e4c14f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c15c3d0 con 0x7f1e4c06bbc0 2024-01-24T13:04:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c15c0f0 con 0x7f1e4c158ca0 2024-01-24T13:04:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e51a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c14ea10 con 0x7f1e4c070560 2024-01-24T13:04:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e4aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e4c06bbc0 0x7f1e4c14a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e4aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e4c06bbc0 0x7f1e4c14a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37542/0 (socket says 172.21.15.29:37542) 2024-01-24T13:04:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e4aa00640 1 -- 172.21.15.29:0/147059377 learned_addr learned my addr 172.21.15.29:0/147059377 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e4b400640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1e4c158ca0 0x7f1e4c14f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.379+0000 7f1e4a000640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1e4c070560 0x7f1e4c13abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e4aa00640 1 -- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1e4c070560 msgr2=0x7f1e4c13abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e4aa00640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1e4c070560 0x7f1e4c13abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e4aa00640 1 -- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1e4c158ca0 msgr2=0x7f1e4c14f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e4aa00640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1e4c158ca0 0x7f1e4c14f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e4aa00640 1 -- 172.21.15.29:0/147059377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c009420 con 0x7f1e4c06bbc0 2024-01-24T13:04:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e4a000640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1e4c070560 0x7f1e4c13abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e4aa00640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e4c06bbc0 0x7f1e4c14a930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0af040 tx=0x7f1e3c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e42a00640 1 -- 172.21.15.29:0/147059377 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0ace70 con 0x7f1e4c06bbc0 2024-01-24T13:04:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e42a00640 1 -- 172.21.15.29:0/147059377 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c006e20 con 0x7f1e4c06bbc0 2024-01-24T13:04:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e42a00640 1 -- 172.21.15.29:0/147059377 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0b5880 con 0x7f1e4c06bbc0 2024-01-24T13:04:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e51a00640 1 -- 172.21.15.29:0/147059377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4c14ecf0 con 0x7f1e4c06bbc0 2024-01-24T13:04:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e51a00640 1 -- 172.21.15.29:0/147059377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4c13b100 con 0x7f1e4c06bbc0 2024-01-24T13:04:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e51a00640 1 -- 172.21.15.29:0/147059377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4c14f210 con 0x7f1e4c06bbc0 2024-01-24T13:04:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e42a00640 1 -- 172.21.15.29:0/147059377 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1e3c0b3040 con 0x7f1e4c06bbc0 2024-01-24T13:04:27.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e42a00640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1e24065a60 0x7f1e24067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.383+0000 7f1e42a00640 1 -- 172.21.15.29:0/147059377 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1e3c11d7a0 con 0x7f1e4c06bbc0 2024-01-24T13:04:27.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.387+0000 7f1e4a000640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1e24065a60 0x7f1e24067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.387+0000 7f1e4a000640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1e24065a60 0x7f1e24067f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c14cce0 tx=0x7f1e34009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.387+0000 7f1e42a00640 1 -- 172.21.15.29:0/147059377 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1e3c0eaf10 con 0x7f1e4c06bbc0 2024-01-24T13:04:27.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.547+0000 7f1e51a00640 1 -- 172.21.15.29:0/147059377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e4c04e850 con 0x7f1e4c06bbc0 2024-01-24T13:04:27.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.547+0000 7f1e42a00640 1 -- 172.21.15.29:0/147059377 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e3c0ee530 con 0x7f1e4c06bbc0 2024-01-24T13:04:27.550 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:04:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.547+0000 7f1e51a00640 1 -- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1e24065a60 msgr2=0x7f1e24067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.547+0000 7f1e51a00640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1e24065a60 0x7f1e24067f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c14cce0 tx=0x7f1e34009040 comp rx=0 tx=0).stop 2024-01-24T13:04:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.547+0000 7f1e51a00640 1 -- 172.21.15.29:0/147059377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e4c06bbc0 msgr2=0x7f1e4c14a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.547+0000 7f1e51a00640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e4c06bbc0 0x7f1e4c14a930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0af040 tx=0x7f1e3c0191d0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.547+0000 7f1e51a00640 1 -- 172.21.15.29:0/147059377 shutdown_connections 2024-01-24T13:04:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.547+0000 7f1e51a00640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1e24065a60 0x7f1e24067f20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.547+0000 7f1e51a00640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1e4c158ca0 0x7f1e4c14f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.547+0000 7f1e51a00640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1e4c070560 0x7f1e4c13abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.547+0000 7f1e51a00640 1 --2- 172.21.15.29:0/147059377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e4c06bbc0 0x7f1e4c14a930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.547+0000 7f1e51a00640 1 -- 172.21.15.29:0/147059377 >> 172.21.15.29:0/147059377 conn(0x7f1e4c06d700 msgr2=0x7f1e4c14cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:27.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.547+0000 7f1e51a00640 1 -- 172.21.15.29:0/147059377 shutdown_connections 2024-01-24T13:04:27.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.547+0000 7f1e51a00640 1 -- 172.21.15.29:0/147059377 wait complete. 2024-01-24T13:04:27.572 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:04:27.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2f2800640 1 Processor -- start 2024-01-24T13:04:27.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2f2800640 1 -- start start 2024-01-24T13:04:27.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2f2800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd2ec0cd300 0x7fd2ec15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2f2800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2ec0ce050 0x7fd2ec0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2f2800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ec0ce9f0 con 0x7fd2ec0d0410 2024-01-24T13:04:27.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2f2800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ec161130 con 0x7fd2ec0cd300 2024-01-24T13:04:27.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2f2800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec15dbe0 con 0x7fd2ec0ce050 2024-01-24T13:04:27.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2eb400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd2ec0cd300 0x7fd2ec15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2eaa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2ec0ce050 0x7fd2ec0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2eb400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd2ec0cd300 0x7fd2ec15d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34576/0 (socket says 172.21.15.29:34576) 2024-01-24T13:04:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2ebe00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fd2ec0d0410 0x7fd2ec0d0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:36018/0 (socket says 172.21.15.29:36018) 2024-01-24T13:04:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2eb400640 1 -- 172.21.15.29:0/3100498167 learned_addr learned my addr 172.21.15.29:0/3100498167 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2eb400640 1 -- 172.21.15.29:0/3100498167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2ec0ce050 msgr2=0x7fd2ec0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2eb400640 1 --2- 172.21.15.29:0/3100498167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2ec0ce050 0x7fd2ec0ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2eb400640 1 -- 172.21.15.29:0/3100498167 >> v1:172.21.15.163:6789/0 conn(0x7fd2ec0d0410 legacy=0x7fd2ec0d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2eb400640 1 -- 172.21.15.29:0/3100498167 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec1605b0 con 0x7fd2ec0cd300 2024-01-24T13:04:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.715+0000 7fd2eaa00640 1 --2- 172.21.15.29:0/3100498167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2ec0ce050 0x7fd2ec0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.719+0000 7fd2eb400640 1 --2- 172.21.15.29:0/3100498167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2ec0cd300 0x7fd2ec15d6a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009870 tx=0x7fd2dc01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d2ce715693c32e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.719+0000 7fd2ea000640 1 -- 172.21.15.29:0/3100498167 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc0a9400 con 0x7fd2ec0cd300 2024-01-24T13:04:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.719+0000 7fd2ea000640 1 -- 172.21.15.29:0/3100498167 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2dc0a9560 con 0x7fd2ec0cd300 2024-01-24T13:04:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.719+0000 7fd2ea000640 1 -- 172.21.15.29:0/3100498167 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc0a98f0 con 0x7fd2ec0cd300 2024-01-24T13:04:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.719+0000 7fd2f2800640 1 -- 172.21.15.29:0/3100498167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2ec0cd300 msgr2=0x7fd2ec15d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.719+0000 7fd2f2800640 1 --2- 172.21.15.29:0/3100498167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2ec0cd300 0x7fd2ec15d6a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009870 tx=0x7fd2dc01c540 comp rx=0 tx=0).stop 2024-01-24T13:04:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2f2800640 1 -- 172.21.15.29:0/3100498167 shutdown_connections 2024-01-24T13:04:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2f2800640 1 --2- 172.21.15.29:0/3100498167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2ec0ce050 0x7fd2ec0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2f2800640 1 --2- 172.21.15.29:0/3100498167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2ec0cd300 0x7fd2ec15d6a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2f2800640 1 -- 172.21.15.29:0/3100498167 >> 172.21.15.29:0/3100498167 conn(0x7fd2ec069cd0 msgr2=0x7fd2ec06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2f2800640 1 -- 172.21.15.29:0/3100498167 shutdown_connections 2024-01-24T13:04:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2f2800640 1 -- 172.21.15.29:0/3100498167 wait complete. 2024-01-24T13:04:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2f2800640 1 Processor -- start 2024-01-24T13:04:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2f2800640 1 -- start start 2024-01-24T13:04:27.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2f2800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ec0cd300 0x7fd2ec150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2f2800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2ec0ce050 0x7fd2ec0b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2f2800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2ec0d0410 0x7fd2ec0b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2f2800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec150f50 con 0x7fd2ec0cd300 2024-01-24T13:04:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2f2800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0c49c0 con 0x7fd2ec0d0410 2024-01-24T13:04:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2f2800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0c4c10 con 0x7fd2ec0ce050 2024-01-24T13:04:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2eb400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ec0cd300 0x7fd2ec150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2eb400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ec0cd300 0x7fd2ec150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37552/0 (socket says 172.21.15.29:37552) 2024-01-24T13:04:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2eb400640 1 -- 172.21.15.29:0/4000054289 learned_addr learned my addr 172.21.15.29:0/4000054289 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2eaa00640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2ec0ce050 0x7fd2ec0b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2ebe00640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2ec0d0410 0x7fd2ec0b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2eb400640 1 -- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2ec0ce050 msgr2=0x7fd2ec0b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2eb400640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2ec0ce050 0x7fd2ec0b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2eb400640 1 -- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2ec0d0410 msgr2=0x7fd2ec0b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2eb400640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2ec0d0410 0x7fd2ec0b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2eb400640 1 -- 172.21.15.29:0/4000054289 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d4009420 con 0x7fd2ec0cd300 2024-01-24T13:04:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2ebe00640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2ec0d0410 0x7fd2ec0b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.723+0000 7fd2eb400640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ec0cd300 0x7fd2ec150a10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc01abf0 tx=0x7fd2dc0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.727+0000 7fd2e3400640 1 -- 172.21.15.29:0/4000054289 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc0a9400 con 0x7fd2ec0cd300 2024-01-24T13:04:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.727+0000 7fd2e3400640 1 -- 172.21.15.29:0/4000054289 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2dc0b5070 con 0x7fd2ec0cd300 2024-01-24T13:04:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.727+0000 7fd2e3400640 1 -- 172.21.15.29:0/4000054289 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc0b1a20 con 0x7fd2ec0cd300 2024-01-24T13:04:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.727+0000 7fd2f2800640 1 -- 172.21.15.29:0/4000054289 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2dc0094d0 con 0x7fd2ec0cd300 2024-01-24T13:04:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.727+0000 7fd2f2800640 1 -- 172.21.15.29:0/4000054289 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ec0c51d0 con 0x7fd2ec0cd300 2024-01-24T13:04:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.727+0000 7fd2f2800640 1 -- 172.21.15.29:0/4000054289 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ec160e30 con 0x7fd2ec0cd300 2024-01-24T13:04:27.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.727+0000 7fd2e3400640 1 -- 172.21.15.29:0/4000054289 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd2dc0b1b80 con 0x7fd2ec0cd300 2024-01-24T13:04:27.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.727+0000 7fd2e3400640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd2c4065a60 0x7fd2c4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:27.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.727+0000 7fd2e3400640 1 -- 172.21.15.29:0/4000054289 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd2dc0b7070 con 0x7fd2ec0cd300 2024-01-24T13:04:27.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.727+0000 7fd2eaa00640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd2c4065a60 0x7fd2c4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:27.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.731+0000 7fd2eaa00640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd2c4065a60 0x7fd2c4067f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec06bbc0 tx=0x7fd2d4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.731+0000 7fd2e3400640 1 -- 172.21.15.29:0/4000054289 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd2ec160e30 con 0x7fd2ec0cd300 2024-01-24T13:04:27.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.891+0000 7fd2f2800640 1 -- 172.21.15.29:0/4000054289 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd2ec160e30 con 0x7fd2ec0cd300 2024-01-24T13:04:27.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.891+0000 7fd2e3400640 1 -- 172.21.15.29:0/4000054289 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd2ec160e30 con 0x7fd2ec0cd300 2024-01-24T13:04:27.895 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:27.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.895+0000 7fd2f2800640 1 -- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd2c4065a60 msgr2=0x7fd2c4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.895+0000 7fd2f2800640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd2c4065a60 0x7fd2c4067f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec06bbc0 tx=0x7fd2d4009190 comp rx=0 tx=0).stop 2024-01-24T13:04:27.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.895+0000 7fd2f2800640 1 -- 172.21.15.29:0/4000054289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ec0cd300 msgr2=0x7fd2ec150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:27.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.895+0000 7fd2f2800640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ec0cd300 0x7fd2ec150a10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc01abf0 tx=0x7fd2dc0192e0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.895+0000 7fd2f2800640 1 -- 172.21.15.29:0/4000054289 shutdown_connections 2024-01-24T13:04:27.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.895+0000 7fd2f2800640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd2c4065a60 0x7fd2c4067f20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.895+0000 7fd2f2800640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2ec0d0410 0x7fd2ec0b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.895+0000 7fd2f2800640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2ec0ce050 0x7fd2ec0b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.895+0000 7fd2f2800640 1 --2- 172.21.15.29:0/4000054289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ec0cd300 0x7fd2ec150a10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:27.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.895+0000 7fd2f2800640 1 -- 172.21.15.29:0/4000054289 >> 172.21.15.29:0/4000054289 conn(0x7fd2ec069cd0 msgr2=0x7fd2ec06c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:27.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.895+0000 7fd2f2800640 1 -- 172.21.15.29:0/4000054289 shutdown_connections 2024-01-24T13:04:27.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:27.895+0000 7fd2f2800640 1 -- 172.21.15.29:0/4000054289 wait complete. 2024-01-24T13:04:27.918 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:04:28.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.059+0000 7fc1fc800640 1 Processor -- start 2024-01-24T13:04:28.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.059+0000 7fc1fc800640 1 -- start start 2024-01-24T13:04:28.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.059+0000 7fc1fc800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc1f40b2700 0x7fc1f406b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.059+0000 7fc1fc800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f406cc10 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.059+0000 7fc1fc800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f406b7a0 con 0x7fc1f415c730 2024-01-24T13:04:28.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.059+0000 7fc1fc800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f406ba80 con 0x7fc1f40b2700 2024-01-24T13:04:28.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.059+0000 7fc1fa800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc1f40ccdb0 0x7fc1f40d0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41662/0 (socket says 172.21.15.29:41662) 2024-01-24T13:04:28.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.059+0000 7fc1fa800640 1 -- 172.21.15.29:0/843628306 learned_addr learned my addr 172.21.15.29:0/843628306 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:28.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.059+0000 7fc1f9400640 1 --2- 172.21.15.29:0/843628306 >> v2:172.21.15.163:3300/0 conn(0x7fc1f40b2700 0x7fc1f406b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.059+0000 7fc1f8a00640 1 -- 172.21.15.29:0/843628306 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336578066 0 0) 0x7fc1f406cc10 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.059+0000 7fc1f8a00640 1 -- 172.21.15.29:0/843628306 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d4003530 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.059+0000 7fc1f9400640 1 -- 172.21.15.29:0/843628306 >> v1:172.21.15.163:6789/0 conn(0x7fc1f415c730 legacy=0x7fc1f40ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.059+0000 7fc1f9400640 1 -- 172.21.15.29:0/843628306 >> v1:172.21.15.29:6789/0 conn(0x7fc1f40ccdb0 legacy=0x7fc1f40d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.059+0000 7fc1f9400640 1 -- 172.21.15.29:0/843628306 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f406bd60 con 0x7fc1f40b2700 2024-01-24T13:04:28.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.063+0000 7fc1f9400640 1 --2- 172.21.15.29:0/843628306 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1f40b2700 0x7fc1f406b110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0097c0 tx=0x7fc1dc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32eb4a8e9f2b3038 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:28.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.063+0000 7fc1f8a00640 1 -- 172.21.15.29:0/843628306 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0ab600 con 0x7fc1f40b2700 2024-01-24T13:04:28.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.063+0000 7fc1f8a00640 1 -- 172.21.15.29:0/843628306 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc0a7050 con 0x7fc1f40b2700 2024-01-24T13:04:28.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.063+0000 7fc1f8a00640 1 -- 172.21.15.29:0/843628306 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0ab980 con 0x7fc1f40b2700 2024-01-24T13:04:28.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.063+0000 7fc1fc800640 1 -- 172.21.15.29:0/843628306 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1f40b2700 msgr2=0x7fc1f406b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.063+0000 7fc1fc800640 1 --2- 172.21.15.29:0/843628306 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1f40b2700 0x7fc1f406b110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0097c0 tx=0x7fc1dc01c480 comp rx=0 tx=0).stop 2024-01-24T13:04:28.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fc800640 1 -- 172.21.15.29:0/843628306 shutdown_connections 2024-01-24T13:04:28.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fc800640 1 --2- 172.21.15.29:0/843628306 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1f40b2700 0x7fc1f406b110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fc800640 1 -- 172.21.15.29:0/843628306 >> 172.21.15.29:0/843628306 conn(0x7fc1f4070570 msgr2=0x7fc1f4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:28.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fc800640 1 -- 172.21.15.29:0/843628306 shutdown_connections 2024-01-24T13:04:28.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fc800640 1 -- 172.21.15.29:0/843628306 wait complete. 2024-01-24T13:04:28.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fc800640 1 Processor -- start 2024-01-24T13:04:28.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fc800640 1 -- start start 2024-01-24T13:04:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fc800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1f40b2700 0x7fc1f41593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fc800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1f40ccdb0 0x7fc1f40c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fc800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1f415c730 0x7fc1f40c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fc800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40c45f0 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fc800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40c6170 con 0x7fc1f40b2700 2024-01-24T13:04:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fc800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40c6450 con 0x7fc1f415c730 2024-01-24T13:04:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1f9400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1f40ccdb0 0x7fc1f40c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1f9400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1f40ccdb0 0x7fc1f40c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37562/0 (socket says 172.21.15.29:37562) 2024-01-24T13:04:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1f9400640 1 -- 172.21.15.29:0/3032089847 learned_addr learned my addr 172.21.15.29:0/3032089847 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1f9e00640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1f40b2700 0x7fc1f41593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fa800640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1f415c730 0x7fc1f40c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1f9400640 1 -- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1f415c730 msgr2=0x7fc1f40c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1f9400640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1f415c730 0x7fc1f40c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1f9400640 1 -- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1f40b2700 msgr2=0x7fc1f41593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1f9400640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1f40b2700 0x7fc1f41593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1f9400640 1 -- 172.21.15.29:0/3032089847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc009420 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1fa800640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1f415c730 0x7fc1f40c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.067+0000 7fc1f9400640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1f40ccdb0 0x7fc1f40c5600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0ae040 tx=0x7fc1dc019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.071+0000 7fc1f2000640 1 -- 172.21.15.29:0/3032089847 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0b4430 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.071+0000 7fc1f2000640 1 -- 172.21.15.29:0/3032089847 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc0b4590 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.071+0000 7fc1f2000640 1 -- 172.21.15.29:0/3032089847 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0b4940 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.071+0000 7fc1fc800640 1 -- 172.21.15.29:0/3032089847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f40cd750 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.071+0000 7fc1fc800640 1 -- 172.21.15.29:0/3032089847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f40c4280 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.071+0000 7fc1fc800640 1 -- 172.21.15.29:0/3032089847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f40cf430 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.071+0000 7fc1f2000640 1 -- 172.21.15.29:0/3032089847 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc1dc0b2040 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.071+0000 7fc1f2000640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc1cc065a60 0x7fc1cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.071+0000 7fc1f2000640 1 -- 172.21.15.29:0/3032089847 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1dc11d370 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.071+0000 7fc1f9e00640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc1cc065a60 0x7fc1cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.075+0000 7fc1f9e00640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc1cc065a60 0x7fc1cc067f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4007fd0 tx=0x7fc1e4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:28.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.075+0000 7fc1f2000640 1 -- 172.21.15.29:0/3032089847 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc1dc0ea9a0 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.263+0000 7fc1fc800640 1 -- 172.21.15.29:0/3032089847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1f40c3e00 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.263+0000 7fc1f2000640 1 -- 172.21.15.29:0/3032089847 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7fc1f40c3e00 con 0x7fc1f40ccdb0 2024-01-24T13:04:28.267 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:28.268 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1485056573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1485056573},{"type":"v1","addr":"172.21.15.29:6834","nonce":1485056573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/447431893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":447431893},{"type":"v1","addr":"172.21.15.163:6836","nonce":447431893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2390785325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2390785325},{"type":"v1","addr":"172.21.15.29:6835","nonce":2390785325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:03:55.981917+0000","modified":"2024-01-24T13:04:19.618027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/1191601563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1191601563},{"type":"v1","addr":"172.21.15.163:6837","nonce":1191601563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T13:04:28.268 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-24T13:04:28.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.267+0000 7fc1fc800640 1 -- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc1cc065a60 msgr2=0x7fc1cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.267+0000 7fc1fc800640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc1cc065a60 0x7fc1cc067f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4007fd0 tx=0x7fc1e4009040 comp rx=0 tx=0).stop 2024-01-24T13:04:28.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.267+0000 7fc1fc800640 1 -- 172.21.15.29:0/3032089847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1f40ccdb0 msgr2=0x7fc1f40c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.267+0000 7fc1fc800640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1f40ccdb0 0x7fc1f40c5600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0ae040 tx=0x7fc1dc019220 comp rx=0 tx=0).stop 2024-01-24T13:04:28.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.267+0000 7fc1fc800640 1 -- 172.21.15.29:0/3032089847 shutdown_connections 2024-01-24T13:04:28.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.267+0000 7fc1fc800640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc1cc065a60 0x7fc1cc067f20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.267+0000 7fc1fc800640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1f415c730 0x7fc1f40c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.267+0000 7fc1fc800640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1f40ccdb0 0x7fc1f40c5600 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.267+0000 7fc1fc800640 1 --2- 172.21.15.29:0/3032089847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1f40b2700 0x7fc1f41593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.267+0000 7fc1fc800640 1 -- 172.21.15.29:0/3032089847 >> 172.21.15.29:0/3032089847 conn(0x7fc1f4070570 msgr2=0x7fc1f40b5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:28.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.267+0000 7fc1fc800640 1 -- 172.21.15.29:0/3032089847 shutdown_connections 2024-01-24T13:04:28.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.267+0000 7fc1fc800640 1 -- 172.21.15.29:0/3032089847 wait complete. 2024-01-24T13:04:28.289 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:28.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.427+0000 7f4da6000640 1 Processor -- start 2024-01-24T13:04:28.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.427+0000 7f4da6000640 1 -- start start 2024-01-24T13:04:28.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.427+0000 7f4da6000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4da0143d30 0x7f4da006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.427+0000 7f4da6000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4da006c150 0x7f4da00cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.427+0000 7f4da6000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da015aa30 con 0x7f4da0143910 2024-01-24T13:04:28.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.427+0000 7f4da6000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da006c5e0 con 0x7f4da0143d30 2024-01-24T13:04:28.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.427+0000 7f4da6000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00712a0 con 0x7f4da006c150 2024-01-24T13:04:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.427+0000 7f4d9fe00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4da006c150 0x7f4da00cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.427+0000 7f4d9ea00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4da0143d30 0x7f4da006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.427+0000 7f4d9f400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f4da0143910 0x7f4da0070ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:36038/0 (socket says 172.21.15.29:36038) 2024-01-24T13:04:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.427+0000 7f4d9f400640 1 -- 172.21.15.29:0/3231279674 learned_addr learned my addr 172.21.15.29:0/3231279674 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.431+0000 7f4d9ea00640 1 -- 172.21.15.29:0/3231279674 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4da006c150 msgr2=0x7f4da00cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.431+0000 7f4d9ea00640 1 --2- 172.21.15.29:0/3231279674 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4da006c150 0x7f4da00cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.431+0000 7f4d9e000640 1 -- 172.21.15.29:0/3231279674 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020427124 0 0) 0x7f4d90001120 con 0x7f4da0143910 2024-01-24T13:04:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.431+0000 7f4d9ea00640 1 -- 172.21.15.29:0/3231279674 >> v1:172.21.15.163:6789/0 conn(0x7f4da0143910 legacy=0x7f4da0070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.431+0000 7f4d9ea00640 1 -- 172.21.15.29:0/3231279674 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da0071580 con 0x7f4da0143d30 2024-01-24T13:04:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.431+0000 7f4d9fe00640 1 --2- 172.21.15.29:0/3231279674 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4da006c150 0x7f4da00cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:28.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.431+0000 7f4d9ea00640 1 --2- 172.21.15.29:0/3231279674 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4da0143d30 0x7f4da006bc10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4d880097c0 tx=0x7f4d8801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da823366c9f40166 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:28.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.431+0000 7f4d9e000640 1 -- 172.21.15.29:0/3231279674 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d880ab600 con 0x7f4da0143d30 2024-01-24T13:04:28.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4d9e000640 1 -- 172.21.15.29:0/3231279674 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d880a7050 con 0x7f4da0143d30 2024-01-24T13:04:28.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4d9e000640 1 -- 172.21.15.29:0/3231279674 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d880ab980 con 0x7f4da0143d30 2024-01-24T13:04:28.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 -- 172.21.15.29:0/3231279674 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4da0143d30 msgr2=0x7f4da006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 --2- 172.21.15.29:0/3231279674 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4da0143d30 0x7f4da006bc10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4d880097c0 tx=0x7f4d8801c480 comp rx=0 tx=0).stop 2024-01-24T13:04:28.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 -- 172.21.15.29:0/3231279674 shutdown_connections 2024-01-24T13:04:28.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 --2- 172.21.15.29:0/3231279674 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4da006c150 0x7f4da00cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 --2- 172.21.15.29:0/3231279674 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4da0143d30 0x7f4da006bc10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 -- 172.21.15.29:0/3231279674 >> 172.21.15.29:0/3231279674 conn(0x7f4da00b3950 msgr2=0x7f4da0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:28.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 -- 172.21.15.29:0/3231279674 shutdown_connections 2024-01-24T13:04:28.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 -- 172.21.15.29:0/3231279674 wait complete. 2024-01-24T13:04:28.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 Processor -- start 2024-01-24T13:04:28.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 -- start start 2024-01-24T13:04:28.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4da006c150 0x7f4da0137d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4da0143910 0x7f4da015d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4da0143d30 0x7f4da01385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da013dda0 con 0x7f4da0143910 2024-01-24T13:04:28.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da0157e00 con 0x7f4da0143d30 2024-01-24T13:04:28.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4da6000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da0140400 con 0x7f4da006c150 2024-01-24T13:04:28.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4d9ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4da0143910 0x7f4da015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4d9ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4da0143910 0x7f4da015d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37564/0 (socket says 172.21.15.29:37564) 2024-01-24T13:04:28.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.435+0000 7f4d9ea00640 1 -- 172.21.15.29:0/1902229587 learned_addr learned my addr 172.21.15.29:0/1902229587 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:28.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4d9f400640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4da006c150 0x7f4da0137d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4d9fe00640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4da0143d30 0x7f4da01385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4d9ea00640 1 -- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4da006c150 msgr2=0x7f4da0137d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4d9ea00640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4da006c150 0x7f4da0137d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4d9ea00640 1 -- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4da0143d30 msgr2=0x7f4da01385d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4d9ea00640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4da0143d30 0x7f4da01385d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4d9ea00640 1 -- 172.21.15.29:0/1902229587 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d98009a70 con 0x7f4da0143910 2024-01-24T13:04:28.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4d9fe00640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4da0143d30 0x7f4da01385d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:28.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4d9ea00640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4da0143910 0x7f4da015d460 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d8801a0b0 tx=0x7f4d88019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:28.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4d97400640 1 -- 172.21.15.29:0/1902229587 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d880b4410 con 0x7f4da0143910 2024-01-24T13:04:28.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4d97400640 1 -- 172.21.15.29:0/1902229587 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d880b4570 con 0x7f4da0143910 2024-01-24T13:04:28.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4da6000640 1 -- 172.21.15.29:0/1902229587 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d88009420 con 0x7f4da0143910 2024-01-24T13:04:28.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4d97400640 1 -- 172.21.15.29:0/1902229587 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d880b4920 con 0x7f4da0143910 2024-01-24T13:04:28.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4da6000640 1 -- 172.21.15.29:0/1902229587 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da01580a0 con 0x7f4da0143910 2024-01-24T13:04:28.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4da6000640 1 -- 172.21.15.29:0/1902229587 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da0158290 con 0x7f4da0143910 2024-01-24T13:04:28.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.439+0000 7f4d97400640 1 -- 172.21.15.29:0/1902229587 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4d880b2040 con 0x7f4da0143910 2024-01-24T13:04:28.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.443+0000 7f4d97400640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4d78065a90 0x7f4d78067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.443+0000 7f4d97400640 1 -- 172.21.15.29:0/1902229587 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4d8811d420 con 0x7f4da0143910 2024-01-24T13:04:28.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.443+0000 7f4d9f400640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4d78065a90 0x7f4d78067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.443+0000 7f4d9f400640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4d78065a90 0x7f4d78067f50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4d90000f70 tx=0x7f4d90009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:28.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.443+0000 7f4d97400640 1 -- 172.21.15.29:0/1902229587 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4d880ea9d0 con 0x7f4da0143910 2024-01-24T13:04:28.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.603+0000 7f4da6000640 1 -- 172.21.15.29:0/1902229587 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4da004e850 con 0x7f4da0143910 2024-01-24T13:04:28.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.607+0000 7f4d97400640 1 -- 172.21.15.29:0/1902229587 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f4d880edff0 con 0x7f4da0143910 2024-01-24T13:04:28.610 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:28.610 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:01.140044+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.607+0000 7f4da6000640 1 -- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4d78065a90 msgr2=0x7f4d78067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.607+0000 7f4da6000640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4d78065a90 0x7f4d78067f50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4d90000f70 tx=0x7f4d90009040 comp rx=0 tx=0).stop 2024-01-24T13:04:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.607+0000 7f4da6000640 1 -- 172.21.15.29:0/1902229587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4da0143910 msgr2=0x7f4da015d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.607+0000 7f4da6000640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4da0143910 0x7f4da015d460 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d8801a0b0 tx=0x7f4d88019220 comp rx=0 tx=0).stop 2024-01-24T13:04:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.607+0000 7f4da6000640 1 -- 172.21.15.29:0/1902229587 shutdown_connections 2024-01-24T13:04:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.607+0000 7f4da6000640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4d78065a90 0x7f4d78067f50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.607+0000 7f4da6000640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4da0143d30 0x7f4da01385d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.607+0000 7f4da6000640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4da0143910 0x7f4da015d460 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.607+0000 7f4da6000640 1 --2- 172.21.15.29:0/1902229587 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4da006c150 0x7f4da0137d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.607+0000 7f4da6000640 1 -- 172.21.15.29:0/1902229587 >> 172.21.15.29:0/1902229587 conn(0x7f4da00b3950 msgr2=0x7f4da00cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:28.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.607+0000 7f4da6000640 1 -- 172.21.15.29:0/1902229587 shutdown_connections 2024-01-24T13:04:28.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.607+0000 7f4da6000640 1 -- 172.21.15.29:0/1902229587 wait complete. 2024-01-24T13:04:28.632 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:04:28.633 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:04:28.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.775+0000 7fdd1bc00640 1 Processor -- start 2024-01-24T13:04:28.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.775+0000 7fdd1bc00640 1 -- start start 2024-01-24T13:04:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.775+0000 7fdd1bc00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdd14158ca0 0x7fdd140b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.775+0000 7fdd1bc00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd14070970 con 0x7fdd14070560 2024-01-24T13:04:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.775+0000 7fdd1bc00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd14070ba0 con 0x7fdd1406bbc0 2024-01-24T13:04:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.775+0000 7fdd1bc00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd14159080 con 0x7fdd14158ca0 2024-01-24T13:04:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.775+0000 7fdd19200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdd14158ca0 0x7fdd140b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.775+0000 7fdd19200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdd14158ca0 0x7fdd140b2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37578/0 (socket says 172.21.15.29:37578) 2024-01-24T13:04:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.775+0000 7fdd19200640 1 -- 172.21.15.29:0/670744694 learned_addr learned my addr 172.21.15.29:0/670744694 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.775+0000 7fdd19200640 1 -- 172.21.15.29:0/670744694 >> v1:172.21.15.163:6789/0 conn(0x7fdd1406bbc0 legacy=0x7fdd1406fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.775+0000 7fdd19200640 1 -- 172.21.15.29:0/670744694 >> v1:172.21.15.29:6789/0 conn(0x7fdd14070560 legacy=0x7fdd140cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.775+0000 7fdd19200640 1 -- 172.21.15.29:0/670744694 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd140b18c0 con 0x7fdd14158ca0 2024-01-24T13:04:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.779+0000 7fdd19200640 1 --2- 172.21.15.29:0/670744694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd14158ca0 0x7fdd140b2680 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdd04006fd0 tx=0x7fdd0401e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216056e472506f70 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.779+0000 7fdd13400640 1 -- 172.21.15.29:0/670744694 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04004230 con 0x7fdd14158ca0 2024-01-24T13:04:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.779+0000 7fdd13400640 1 -- 172.21.15.29:0/670744694 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd040ab070 con 0x7fdd14158ca0 2024-01-24T13:04:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.779+0000 7fdd13400640 1 -- 172.21.15.29:0/670744694 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040a7830 con 0x7fdd14158ca0 2024-01-24T13:04:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.779+0000 7fdd1bc00640 1 -- 172.21.15.29:0/670744694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd14158ca0 msgr2=0x7fdd140b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.779+0000 7fdd1bc00640 1 --2- 172.21.15.29:0/670744694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd14158ca0 0x7fdd140b2680 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdd04006fd0 tx=0x7fdd0401e960 comp rx=0 tx=0).stop 2024-01-24T13:04:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.779+0000 7fdd1bc00640 1 -- 172.21.15.29:0/670744694 shutdown_connections 2024-01-24T13:04:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.779+0000 7fdd1bc00640 1 --2- 172.21.15.29:0/670744694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd14158ca0 0x7fdd140b2680 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.779+0000 7fdd1bc00640 1 -- 172.21.15.29:0/670744694 >> 172.21.15.29:0/670744694 conn(0x7fdd1406d700 msgr2=0x7fdd14069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.779+0000 7fdd1bc00640 1 -- 172.21.15.29:0/670744694 shutdown_connections 2024-01-24T13:04:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.779+0000 7fdd1bc00640 1 -- 172.21.15.29:0/670744694 wait complete. 2024-01-24T13:04:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd1bc00640 1 Processor -- start 2024-01-24T13:04:28.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd1bc00640 1 -- start start 2024-01-24T13:04:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd1bc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdd1406bbc0 0x7fdd1414d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd1bc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd14070560 0x7fdd140c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd1bc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdd14158ca0 0x7fdd141501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd1bc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1414dcd0 con 0x7fdd14070560 2024-01-24T13:04:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd1bc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1414dfb0 con 0x7fdd1406bbc0 2024-01-24T13:04:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd1bc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1414e290 con 0x7fdd14158ca0 2024-01-24T13:04:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd13e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd14070560 0x7fdd140c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd19200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdd1406bbc0 0x7fdd1414d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd19200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdd1406bbc0 0x7fdd1414d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:34636/0 (socket says 172.21.15.29:34636) 2024-01-24T13:04:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd13e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd14070560 0x7fdd140c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37586/0 (socket says 172.21.15.29:37586) 2024-01-24T13:04:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd19200640 1 -- 172.21.15.29:0/2382135600 learned_addr learned my addr 172.21.15.29:0/2382135600 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd19c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdd14158ca0 0x7fdd141501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd19200640 1 -- 172.21.15.29:0/2382135600 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdd14158ca0 msgr2=0x7fdd141501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd19200640 1 --2- 172.21.15.29:0/2382135600 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdd14158ca0 0x7fdd141501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd19200640 1 -- 172.21.15.29:0/2382135600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd14070560 msgr2=0x7fdd140c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd19200640 1 --2- 172.21.15.29:0/2382135600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd14070560 0x7fdd140c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd19200640 1 -- 172.21.15.29:0/2382135600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0400b780 con 0x7fdd1406bbc0 2024-01-24T13:04:28.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd13e00640 1 --2- 172.21.15.29:0/2382135600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd14070560 0x7fdd140c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:28.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd19200640 1 --2- 172.21.15.29:0/2382135600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdd1406bbc0 0x7fdd1414d050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd04006fd0 tx=0x7fdd0401b700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:28.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd10c00640 1 -- 172.21.15.29:0/2382135600 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04003620 con 0x7fdd1406bbc0 2024-01-24T13:04:28.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd10c00640 1 -- 172.21.15.29:0/2382135600 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd040037a0 con 0x7fdd1406bbc0 2024-01-24T13:04:28.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd10c00640 1 -- 172.21.15.29:0/2382135600 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04003b50 con 0x7fdd1406bbc0 2024-01-24T13:04:28.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd1bc00640 1 -- 172.21.15.29:0/2382135600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1414e570 con 0x7fdd1406bbc0 2024-01-24T13:04:28.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd1bc00640 1 -- 172.21.15.29:0/2382135600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1414d590 con 0x7fdd1406bbc0 2024-01-24T13:04:28.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.783+0000 7fdd1bc00640 1 -- 172.21.15.29:0/2382135600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1404e850 con 0x7fdd1406bbc0 2024-01-24T13:04:28.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.787+0000 7fdd10c00640 1 -- 172.21.15.29:0/2382135600 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdd04003cb0 con 0x7fdd1406bbc0 2024-01-24T13:04:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.787+0000 7fdd10c00640 1 --2- 172.21.15.29:0/2382135600 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdcec065a60 0x7fdcec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.787+0000 7fdd10c00640 1 -- 172.21.15.29:0/2382135600 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdd0411d320 con 0x7fdd1406bbc0 2024-01-24T13:04:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.787+0000 7fdd13e00640 1 --2- 172.21.15.29:0/2382135600 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdcec065a60 0x7fdcec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.787+0000 7fdd13e00640 1 --2- 172.21.15.29:0/2382135600 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdcec065a60 0x7fdcec067f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdd140b1870 tx=0x7fdcfc007e40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.791+0000 7fdd10c00640 1 -- 172.21.15.29:0/2382135600 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fdd040eab10 con 0x7fdd1406bbc0 2024-01-24T13:04:28.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.947+0000 7fdd1bc00640 1 -- 172.21.15.29:0/2382135600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd140cb8f0 con 0x7fdd1406bbc0 2024-01-24T13:04:28.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.951+0000 7fdd10c00640 1 -- 172.21.15.29:0/2382135600 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd040ad020 con 0x7fdd1406bbc0 2024-01-24T13:04:28.953 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:04:28.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.951+0000 7fdd1bc00640 1 -- 172.21.15.29:0/2382135600 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdcec065a60 msgr2=0x7fdcec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.951+0000 7fdd1bc00640 1 --2- 172.21.15.29:0/2382135600 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdcec065a60 0x7fdcec067f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdd140b1870 tx=0x7fdcfc007e40 comp rx=0 tx=0).stop 2024-01-24T13:04:28.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.951+0000 7fdd1bc00640 1 -- 172.21.15.29:0/2382135600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdd1406bbc0 msgr2=0x7fdd1414d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:28.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.951+0000 7fdd1bc00640 1 --2- 172.21.15.29:0/2382135600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdd1406bbc0 0x7fdd1414d050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd04006fd0 tx=0x7fdd0401b700 comp rx=0 tx=0).stop 2024-01-24T13:04:28.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.951+0000 7fdd1bc00640 1 -- 172.21.15.29:0/2382135600 shutdown_connections 2024-01-24T13:04:28.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.951+0000 7fdd1bc00640 1 --2- 172.21.15.29:0/2382135600 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdcec065a60 0x7fdcec067f20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.951+0000 7fdd1bc00640 1 --2- 172.21.15.29:0/2382135600 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdd14158ca0 0x7fdd141501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.951+0000 7fdd1bc00640 1 --2- 172.21.15.29:0/2382135600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd14070560 0x7fdd140c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.951+0000 7fdd1bc00640 1 --2- 172.21.15.29:0/2382135600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdd1406bbc0 0x7fdd1414d050 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:28.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.951+0000 7fdd1bc00640 1 -- 172.21.15.29:0/2382135600 >> 172.21.15.29:0/2382135600 conn(0x7fdd1406d700 msgr2=0x7fdd14157fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:28.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.951+0000 7fdd1bc00640 1 -- 172.21.15.29:0/2382135600 shutdown_connections 2024-01-24T13:04:28.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:28.951+0000 7fdd1bc00640 1 -- 172.21.15.29:0/2382135600 wait complete. 2024-01-24T13:04:28.976 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:04:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.115+0000 7f659c000640 1 Processor -- start 2024-01-24T13:04:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.115+0000 7f659c000640 1 -- start start 2024-01-24T13:04:29.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.119+0000 7f659c000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f659406be20 0x7f659415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.119+0000 7f659c000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f659406c200 0x7f659415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.119+0000 7f659c000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659415b4f0 con 0x7f659413cda0 2024-01-24T13:04:29.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.119+0000 7f659c000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659415b7d0 con 0x7f659406c200 2024-01-24T13:04:29.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.119+0000 7f659c000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65940cd0c0 con 0x7f659406be20 2024-01-24T13:04:29.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.119+0000 7f6598c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f659406c200 0x7f659415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.119+0000 7f6598c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f659406c200 0x7f659415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37598/0 (socket says 172.21.15.29:37598) 2024-01-24T13:04:29.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.119+0000 7f6598c00640 1 -- 172.21.15.29:0/3261384662 learned_addr learned my addr 172.21.15.29:0/3261384662 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:29.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.119+0000 7f6599600640 1 --2- 172.21.15.29:0/3261384662 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f659406be20 0x7f659415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.119+0000 7f6598c00640 1 -- 172.21.15.29:0/3261384662 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f659406be20 msgr2=0x7f659415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:29.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.119+0000 7f6598c00640 1 --2- 172.21.15.29:0/3261384662 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f659406be20 0x7f659415a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.119+0000 7f6598c00640 1 -- 172.21.15.29:0/3261384662 >> v1:172.21.15.163:6789/0 conn(0x7f659413cda0 legacy=0x7f659413d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.119+0000 7f6598c00640 1 -- 172.21.15.29:0/3261384662 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65940cd3a0 con 0x7f659406c200 2024-01-24T13:04:29.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.123+0000 7f6598c00640 1 --2- 172.21.15.29:0/3261384662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f659406c200 0x7f659415af00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f657c009870 tx=0x7f657c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3da881930d3de15 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:29.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.123+0000 7f6593e00640 1 -- 172.21.15.29:0/3261384662 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c0a9620 con 0x7f659406c200 2024-01-24T13:04:29.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.123+0000 7f6593e00640 1 -- 172.21.15.29:0/3261384662 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c0a9780 con 0x7f659406c200 2024-01-24T13:04:29.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.123+0000 7f6593e00640 1 -- 172.21.15.29:0/3261384662 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c0a9b10 con 0x7f659406c200 2024-01-24T13:04:29.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.123+0000 7f659c000640 1 -- 172.21.15.29:0/3261384662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f659406c200 msgr2=0x7f659415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.123+0000 7f659c000640 1 --2- 172.21.15.29:0/3261384662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f659406c200 0x7f659415af00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f657c009870 tx=0x7f657c01c500 comp rx=0 tx=0).stop 2024-01-24T13:04:29.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.123+0000 7f659c000640 1 -- 172.21.15.29:0/3261384662 shutdown_connections 2024-01-24T13:04:29.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.123+0000 7f659c000640 1 --2- 172.21.15.29:0/3261384662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f659406c200 0x7f659415af00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.123+0000 7f659c000640 1 --2- 172.21.15.29:0/3261384662 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f659406be20 0x7f659415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.123+0000 7f659c000640 1 -- 172.21.15.29:0/3261384662 >> 172.21.15.29:0/3261384662 conn(0x7f659406d700 msgr2=0x7f6594069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:29.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.123+0000 7f659c000640 1 -- 172.21.15.29:0/3261384662 shutdown_connections 2024-01-24T13:04:29.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.123+0000 7f659c000640 1 -- 172.21.15.29:0/3261384662 wait complete. 2024-01-24T13:04:29.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.123+0000 7f659c000640 1 Processor -- start 2024-01-24T13:04:29.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.123+0000 7f659c000640 1 -- start start 2024-01-24T13:04:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659c000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f659406be20 0x7f6594136c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659c000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659406c200 0x7f65941382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659c000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f659413cda0 0x7f6594138820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659c000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65940b1f60 con 0x7f659413cda0 2024-01-24T13:04:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659c000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65940b2830 con 0x7f659406c200 2024-01-24T13:04:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659c000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659414e100 con 0x7f659406be20 2024-01-24T13:04:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659a000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f659413cda0 0x7f6594138820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f6598c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659406c200 0x7f65941382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659a000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f659413cda0 0x7f6594138820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37600/0 (socket says 172.21.15.29:37600) 2024-01-24T13:04:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659a000640 1 -- 172.21.15.29:0/2192131985 learned_addr learned my addr 172.21.15.29:0/2192131985 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f6599600640 1 --2- 172.21.15.29:0/2192131985 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f659406be20 0x7f6594136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659a000640 1 -- 172.21.15.29:0/2192131985 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f659406be20 msgr2=0x7f6594136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659a000640 1 --2- 172.21.15.29:0/2192131985 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f659406be20 0x7f6594136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659a000640 1 -- 172.21.15.29:0/2192131985 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659406c200 msgr2=0x7f65941382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659a000640 1 --2- 172.21.15.29:0/2192131985 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659406c200 0x7f65941382e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659a000640 1 -- 172.21.15.29:0/2192131985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c0094d0 con 0x7f659413cda0 2024-01-24T13:04:29.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659a000640 1 --2- 172.21.15.29:0/2192131985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f659413cda0 0x7f6594138820 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f658c00c760 tx=0x7f658c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f6591600640 1 -- 172.21.15.29:0/2192131985 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c003b80 con 0x7f659413cda0 2024-01-24T13:04:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f6591600640 1 -- 172.21.15.29:0/2192131985 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c003ce0 con 0x7f659413cda0 2024-01-24T13:04:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f6591600640 1 -- 172.21.15.29:0/2192131985 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c00aa30 con 0x7f659413cda0 2024-01-24T13:04:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659c000640 1 -- 172.21.15.29:0/2192131985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65941371c0 con 0x7f659413cda0 2024-01-24T13:04:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659c000640 1 -- 172.21.15.29:0/2192131985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659414e350 con 0x7f659413cda0 2024-01-24T13:04:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.127+0000 7f659c000640 1 -- 172.21.15.29:0/2192131985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659404e850 con 0x7f659413cda0 2024-01-24T13:04:29.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.131+0000 7f6591600640 1 -- 172.21.15.29:0/2192131985 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f658c00ab90 con 0x7f659413cda0 2024-01-24T13:04:29.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.131+0000 7f6591600640 1 --2- 172.21.15.29:0/2192131985 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f656c065a60 0x7f656c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.131+0000 7f6591600640 1 -- 172.21.15.29:0/2192131985 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f658c0830a0 con 0x7f659413cda0 2024-01-24T13:04:29.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.131+0000 7f6599600640 1 --2- 172.21.15.29:0/2192131985 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f656c065a60 0x7f656c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.131+0000 7f6599600640 1 --2- 172.21.15.29:0/2192131985 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f656c065a60 0x7f656c067f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f659413bbe0 tx=0x7f6584008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:29.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.135+0000 7f6591600640 1 -- 172.21.15.29:0/2192131985 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f658c050810 con 0x7f659413cda0 2024-01-24T13:04:29.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.291+0000 7f659c000640 1 -- 172.21.15.29:0/2192131985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f659415b230 con 0x7f659413cda0 2024-01-24T13:04:29.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.291+0000 7f6591600640 1 -- 172.21.15.29:0/2192131985 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f658c053e30 con 0x7f659413cda0 2024-01-24T13:04:29.294 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:29.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.291+0000 7f659c000640 1 -- 172.21.15.29:0/2192131985 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f656c065a60 msgr2=0x7f656c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.291+0000 7f659c000640 1 --2- 172.21.15.29:0/2192131985 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f656c065a60 0x7f656c067f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f659413bbe0 tx=0x7f6584008040 comp rx=0 tx=0).stop 2024-01-24T13:04:29.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.291+0000 7f659c000640 1 -- 172.21.15.29:0/2192131985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f659413cda0 msgr2=0x7f6594138820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.291+0000 7f659c000640 1 --2- 172.21.15.29:0/2192131985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f659413cda0 0x7f6594138820 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f658c00c760 tx=0x7f658c00cc20 comp rx=0 tx=0).stop 2024-01-24T13:04:29.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.291+0000 7f659c000640 1 -- 172.21.15.29:0/2192131985 shutdown_connections 2024-01-24T13:04:29.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.291+0000 7f659c000640 1 --2- 172.21.15.29:0/2192131985 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f656c065a60 0x7f656c067f20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.291+0000 7f659c000640 1 --2- 172.21.15.29:0/2192131985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f659413cda0 0x7f6594138820 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.291+0000 7f659c000640 1 --2- 172.21.15.29:0/2192131985 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659406c200 0x7f65941382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.291+0000 7f659c000640 1 --2- 172.21.15.29:0/2192131985 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f659406be20 0x7f6594136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.291+0000 7f659c000640 1 -- 172.21.15.29:0/2192131985 >> 172.21.15.29:0/2192131985 conn(0x7f659406d700 msgr2=0x7f659413a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:29.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.291+0000 7f659c000640 1 -- 172.21.15.29:0/2192131985 shutdown_connections 2024-01-24T13:04:29.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.291+0000 7f659c000640 1 -- 172.21.15.29:0/2192131985 wait complete. 2024-01-24T13:04:29.315 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:04:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.455+0000 7fc96ee00640 1 Processor -- start 2024-01-24T13:04:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.455+0000 7fc96ee00640 1 -- start start 2024-01-24T13:04:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc96ee00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc9680c3fd0 0x7fc9680caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc96ee00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc9680cb010 0x7fc9680d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc96ee00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9680cb440 con 0x7fc96815a6f0 2024-01-24T13:04:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc96ee00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96815aad0 con 0x7fc9680c3fd0 2024-01-24T13:04:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc96ee00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9680cd1e0 con 0x7fc9680cb010 2024-01-24T13:04:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc967400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc9680c3fd0 0x7fc9680caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc967400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc9680c3fd0 0x7fc9680caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37604/0 (socket says 172.21.15.29:37604) 2024-01-24T13:04:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc967400640 1 -- 172.21.15.29:0/2347586983 learned_addr learned my addr 172.21.15.29:0/2347586983 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc96ce00640 1 --2- 172.21.15.29:0/2347586983 >> v2:172.21.15.163:3300/0 conn(0x7fc9680cb010 0x7fc9680d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc967400640 1 -- 172.21.15.29:0/2347586983 >> v2:172.21.15.163:3300/0 conn(0x7fc9680cb010 msgr2=0x7fc9680d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:29.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc967400640 1 --2- 172.21.15.29:0/2347586983 >> v2:172.21.15.163:3300/0 conn(0x7fc9680cb010 0x7fc9680d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc967400640 1 -- 172.21.15.29:0/2347586983 >> v1:172.21.15.163:6789/0 conn(0x7fc96815a6f0 legacy=0x7fc9680ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc967400640 1 -- 172.21.15.29:0/2347586983 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9680cd4c0 con 0x7fc9680c3fd0 2024-01-24T13:04:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc967400640 1 --2- 172.21.15.29:0/2347586983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9680c3fd0 0x7fc9680caad0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc9680b2670 tx=0x7fc95001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53cf0bf32d2af04 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.459+0000 7fc966a00640 1 -- 172.21.15.29:0/2347586983 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9500aa430 con 0x7fc9680c3fd0 2024-01-24T13:04:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc966a00640 1 -- 172.21.15.29:0/2347586983 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9500aa590 con 0x7fc9680c3fd0 2024-01-24T13:04:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc966a00640 1 -- 172.21.15.29:0/2347586983 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9500aa920 con 0x7fc9680c3fd0 2024-01-24T13:04:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 -- 172.21.15.29:0/2347586983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9680c3fd0 msgr2=0x7fc9680caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 --2- 172.21.15.29:0/2347586983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9680c3fd0 0x7fc9680caad0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc9680b2670 tx=0x7fc95001c4d0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 -- 172.21.15.29:0/2347586983 shutdown_connections 2024-01-24T13:04:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 --2- 172.21.15.29:0/2347586983 >> v2:172.21.15.163:3300/0 conn(0x7fc9680cb010 0x7fc9680d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 --2- 172.21.15.29:0/2347586983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9680c3fd0 0x7fc9680caad0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 -- 172.21.15.29:0/2347586983 >> 172.21.15.29:0/2347586983 conn(0x7fc968069cd0 msgr2=0x7fc96806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 -- 172.21.15.29:0/2347586983 shutdown_connections 2024-01-24T13:04:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 -- 172.21.15.29:0/2347586983 wait complete. 2024-01-24T13:04:29.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 Processor -- start 2024-01-24T13:04:29.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 -- start start 2024-01-24T13:04:29.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680c3fd0 0x7fc9680c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9680cb010 0x7fc968155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc96815a6f0 0x7fc9680c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc968156010 con 0x7fc96815a6f0 2024-01-24T13:04:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680c8cd0 con 0x7fc9680c3fd0 2024-01-24T13:04:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ee00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680c80c0 con 0x7fc9680cb010 2024-01-24T13:04:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.463+0000 7fc96ce00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc96815a6f0 0x7fc9680c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc96ce00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc96815a6f0 0x7fc9680c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37616/0 (socket says 172.21.15.29:37616) 2024-01-24T13:04:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc96ce00640 1 -- 172.21.15.29:0/2966413099 learned_addr learned my addr 172.21.15.29:0/2966413099 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc967400640 1 --2- 172.21.15.29:0/2966413099 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9680cb010 0x7fc968155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc967e00640 1 --2- 172.21.15.29:0/2966413099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680c3fd0 0x7fc9680c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc96ce00640 1 -- 172.21.15.29:0/2966413099 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9680cb010 msgr2=0x7fc968155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc96ce00640 1 --2- 172.21.15.29:0/2966413099 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9680cb010 0x7fc968155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc96ce00640 1 -- 172.21.15.29:0/2966413099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680c3fd0 msgr2=0x7fc9680c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc96ce00640 1 --2- 172.21.15.29:0/2966413099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680c3fd0 0x7fc9680c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc96ce00640 1 -- 172.21.15.29:0/2966413099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9500094d0 con 0x7fc96815a6f0 2024-01-24T13:04:29.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc96ce00640 1 --2- 172.21.15.29:0/2966413099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc96815a6f0 0x7fc9680c7550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc960009dd0 tx=0x7fc96000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:29.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc95fe00640 1 -- 172.21.15.29:0/2966413099 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960014480 con 0x7fc96815a6f0 2024-01-24T13:04:29.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc95fe00640 1 -- 172.21.15.29:0/2966413099 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96000f040 con 0x7fc96815a6f0 2024-01-24T13:04:29.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc95fe00640 1 -- 172.21.15.29:0/2966413099 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960014840 con 0x7fc96815a6f0 2024-01-24T13:04:29.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc96ee00640 1 -- 172.21.15.29:0/2966413099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9680c83a0 con 0x7fc96815a6f0 2024-01-24T13:04:29.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc96ee00640 1 -- 172.21.15.29:0/2966413099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9680c8960 con 0x7fc96815a6f0 2024-01-24T13:04:29.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc96ee00640 1 -- 172.21.15.29:0/2966413099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9680c8e60 con 0x7fc96815a6f0 2024-01-24T13:04:29.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc95fe00640 1 -- 172.21.15.29:0/2966413099 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc9600149a0 con 0x7fc96815a6f0 2024-01-24T13:04:29.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.467+0000 7fc95fe00640 1 --2- 172.21.15.29:0/2966413099 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc940065a60 0x7fc940067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.471+0000 7fc95fe00640 1 -- 172.21.15.29:0/2966413099 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc960083f00 con 0x7fc96815a6f0 2024-01-24T13:04:29.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.471+0000 7fc967e00640 1 --2- 172.21.15.29:0/2966413099 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc940065a60 0x7fc940067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.471+0000 7fc967e00640 1 --2- 172.21.15.29:0/2966413099 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc940065a60 0x7fc940067f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc958007fd0 tx=0x7fc958009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:29.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.471+0000 7fc95fe00640 1 -- 172.21.15.29:0/2966413099 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc9600515e0 con 0x7fc96815a6f0 2024-01-24T13:04:29.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.627+0000 7fc96ee00640 1 -- 172.21.15.29:0/2966413099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9680cffd0 con 0x7fc96815a6f0 2024-01-24T13:04:29.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.627+0000 7fc95fe00640 1 -- 172.21.15.29:0/2966413099 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc960018020 con 0x7fc96815a6f0 2024-01-24T13:04:29.633 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:04:29.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.631+0000 7fc96ee00640 1 -- 172.21.15.29:0/2966413099 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc940065a60 msgr2=0x7fc940067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.631+0000 7fc96ee00640 1 --2- 172.21.15.29:0/2966413099 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc940065a60 0x7fc940067f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc958007fd0 tx=0x7fc958009040 comp rx=0 tx=0).stop 2024-01-24T13:04:29.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.631+0000 7fc96ee00640 1 -- 172.21.15.29:0/2966413099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc96815a6f0 msgr2=0x7fc9680c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.631+0000 7fc96ee00640 1 --2- 172.21.15.29:0/2966413099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc96815a6f0 0x7fc9680c7550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc960009dd0 tx=0x7fc96000c490 comp rx=0 tx=0).stop 2024-01-24T13:04:29.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.631+0000 7fc96ee00640 1 -- 172.21.15.29:0/2966413099 shutdown_connections 2024-01-24T13:04:29.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.631+0000 7fc96ee00640 1 --2- 172.21.15.29:0/2966413099 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc940065a60 0x7fc940067f20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.631+0000 7fc96ee00640 1 --2- 172.21.15.29:0/2966413099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc96815a6f0 0x7fc9680c7550 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.631+0000 7fc96ee00640 1 --2- 172.21.15.29:0/2966413099 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9680cb010 0x7fc968155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.631+0000 7fc96ee00640 1 --2- 172.21.15.29:0/2966413099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680c3fd0 0x7fc9680c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.631+0000 7fc96ee00640 1 -- 172.21.15.29:0/2966413099 >> 172.21.15.29:0/2966413099 conn(0x7fc968069cd0 msgr2=0x7fc96806a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:29.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.631+0000 7fc96ee00640 1 -- 172.21.15.29:0/2966413099 shutdown_connections 2024-01-24T13:04:29.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.631+0000 7fc96ee00640 1 -- 172.21.15.29:0/2966413099 wait complete. 2024-01-24T13:04:29.655 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:04:29.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.795+0000 7febc5200640 1 Processor -- start 2024-01-24T13:04:29.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.795+0000 7febc5200640 1 -- start start 2024-01-24T13:04:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.795+0000 7febc5200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7febc006c860 0x7febc006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.795+0000 7febc5200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7febc0142980 0x7febc00cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.795+0000 7febc5200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc006b320 con 0x7febc00cd350 2024-01-24T13:04:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.795+0000 7febc5200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc00cd7e0 con 0x7febc0142980 2024-01-24T13:04:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.795+0000 7febc5200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc01611b0 con 0x7febc006c860 2024-01-24T13:04:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.795+0000 7febbd400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7febc0142980 0x7febc00cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.799+0000 7febbd400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7febc0142980 0x7febc00cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37618/0 (socket says 172.21.15.29:37618) 2024-01-24T13:04:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.799+0000 7febbd400640 1 -- 172.21.15.29:0/676808520 learned_addr learned my addr 172.21.15.29:0/676808520 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.799+0000 7febbe800640 1 --1- 172.21.15.29:0/676808520 >> v1:172.21.15.29:6789/0 conn(0x7febc00cd350 0x7febc015d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41684/0 (socket says 172.21.15.29:41684) 2024-01-24T13:04:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.799+0000 7febbde00640 1 --2- 172.21.15.29:0/676808520 >> v2:172.21.15.163:3300/0 conn(0x7febc006c860 0x7febc006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.799+0000 7febbd400640 1 -- 172.21.15.29:0/676808520 >> v2:172.21.15.163:3300/0 conn(0x7febc006c860 msgr2=0x7febc006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.799+0000 7febbd400640 1 --2- 172.21.15.29:0/676808520 >> v2:172.21.15.163:3300/0 conn(0x7febc006c860 0x7febc006ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.799+0000 7febbd400640 1 -- 172.21.15.29:0/676808520 >> v1:172.21.15.29:6789/0 conn(0x7febc00cd350 legacy=0x7febc015d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.799+0000 7febbd400640 1 -- 172.21.15.29:0/676808520 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc0160630 con 0x7febc0142980 2024-01-24T13:04:29.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.799+0000 7febbd400640 1 --2- 172.21.15.29:0/676808520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc0142980 0x7febc00cce10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7febc00d14c0 tx=0x7feba801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6374814560be50 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:29.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.799+0000 7febbca00640 1 -- 172.21.15.29:0/676808520 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba80aa430 con 0x7febc0142980 2024-01-24T13:04:29.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.799+0000 7febbca00640 1 -- 172.21.15.29:0/676808520 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba80aa590 con 0x7febc0142980 2024-01-24T13:04:29.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.799+0000 7febbca00640 1 -- 172.21.15.29:0/676808520 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba80aa920 con 0x7febc0142980 2024-01-24T13:04:29.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 -- 172.21.15.29:0/676808520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc0142980 msgr2=0x7febc00cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 --2- 172.21.15.29:0/676808520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc0142980 0x7febc00cce10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7febc00d14c0 tx=0x7feba801c4d0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 -- 172.21.15.29:0/676808520 shutdown_connections 2024-01-24T13:04:29.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 --2- 172.21.15.29:0/676808520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc0142980 0x7febc00cce10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 --2- 172.21.15.29:0/676808520 >> v2:172.21.15.163:3300/0 conn(0x7febc006c860 0x7febc006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 -- 172.21.15.29:0/676808520 >> 172.21.15.29:0/676808520 conn(0x7febc0069cd0 msgr2=0x7febc006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:29.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 -- 172.21.15.29:0/676808520 shutdown_connections 2024-01-24T13:04:29.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 -- 172.21.15.29:0/676808520 wait complete. 2024-01-24T13:04:29.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 Processor -- start 2024-01-24T13:04:29.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 -- start start 2024-01-24T13:04:29.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febc006c860 0x7febc014ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00cd350 0x7febc00c3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc0142980 0x7febc0151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc014f120 con 0x7febc0142980 2024-01-24T13:04:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc00c3860 con 0x7febc00cd350 2024-01-24T13:04:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febc5200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc0152810 con 0x7febc006c860 2024-01-24T13:04:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febbe800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc0142980 0x7febc0151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febbe800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc0142980 0x7febc0151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37628/0 (socket says 172.21.15.29:37628) 2024-01-24T13:04:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.803+0000 7febbe800640 1 -- 172.21.15.29:0/3285019340 learned_addr learned my addr 172.21.15.29:0/3285019340 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febbd400640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00cd350 0x7febc00c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febbde00640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febc006c860 0x7febc014ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febbe800640 1 -- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febc006c860 msgr2=0x7febc014ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febbe800640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febc006c860 0x7febc014ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febbe800640 1 -- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00cd350 msgr2=0x7febc00c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febbe800640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00cd350 0x7febc00c3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febbe800640 1 -- 172.21.15.29:0/3285019340 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba80094d0 con 0x7febc0142980 2024-01-24T13:04:29.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febbde00640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febc006c860 0x7febc014ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:29.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febbe800640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc0142980 0x7febc0151460 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7febb800c7a0 tx=0x7febb800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:29.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febb6000640 1 -- 172.21.15.29:0/3285019340 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800a640 con 0x7febc0142980 2024-01-24T13:04:29.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febb6000640 1 -- 172.21.15.29:0/3285019340 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb800a7a0 con 0x7febc0142980 2024-01-24T13:04:29.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febb6000640 1 -- 172.21.15.29:0/3285019340 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800ab10 con 0x7febc0142980 2024-01-24T13:04:29.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febc5200640 1 -- 172.21.15.29:0/3285019340 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc01519a0 con 0x7febc0142980 2024-01-24T13:04:29.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febc5200640 1 -- 172.21.15.29:0/3285019340 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc0151ee0 con 0x7febc0142980 2024-01-24T13:04:29.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febc5200640 1 -- 172.21.15.29:0/3285019340 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc0152980 con 0x7febc0142980 2024-01-24T13:04:29.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febb6000640 1 -- 172.21.15.29:0/3285019340 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7febb800ac70 con 0x7febc0142980 2024-01-24T13:04:29.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.807+0000 7febb6000640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feb98065a60 0x7feb98067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:29.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.811+0000 7febb6000640 1 -- 172.21.15.29:0/3285019340 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7febb8082ca0 con 0x7febc0142980 2024-01-24T13:04:29.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.811+0000 7febbde00640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feb98065a60 0x7feb98067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:29.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.811+0000 7febbde00640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feb98065a60 0x7feb98067f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7febb000b9f0 tx=0x7febb0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:29.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.815+0000 7febb6000640 1 -- 172.21.15.29:0/3285019340 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7febb8050380 con 0x7febc0142980 2024-01-24T13:04:29.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.971+0000 7febc5200640 1 -- 172.21.15.29:0/3285019340 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7febc004e850 con 0x7febc0142980 2024-01-24T13:04:29.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.971+0000 7febb6000640 1 -- 172.21.15.29:0/3285019340 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7febb80170a0 con 0x7febc0142980 2024-01-24T13:04:29.975 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.971+0000 7febc5200640 1 -- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feb98065a60 msgr2=0x7feb98067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.971+0000 7febc5200640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feb98065a60 0x7feb98067f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7febb000b9f0 tx=0x7febb0008040 comp rx=0 tx=0).stop 2024-01-24T13:04:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.975+0000 7febc5200640 1 -- 172.21.15.29:0/3285019340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc0142980 msgr2=0x7febc0151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.975+0000 7febc5200640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc0142980 0x7febc0151460 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7febb800c7a0 tx=0x7febb800cc60 comp rx=0 tx=0).stop 2024-01-24T13:04:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.975+0000 7febc5200640 1 -- 172.21.15.29:0/3285019340 shutdown_connections 2024-01-24T13:04:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.975+0000 7febc5200640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feb98065a60 0x7feb98067f20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.975+0000 7febc5200640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc0142980 0x7febc0151460 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.975+0000 7febc5200640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00cd350 0x7febc00c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.975+0000 7febc5200640 1 --2- 172.21.15.29:0/3285019340 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febc006c860 0x7febc014ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:29.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.975+0000 7febc5200640 1 -- 172.21.15.29:0/3285019340 >> 172.21.15.29:0/3285019340 conn(0x7febc0069cd0 msgr2=0x7febc015e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:29.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.975+0000 7febc5200640 1 -- 172.21.15.29:0/3285019340 shutdown_connections 2024-01-24T13:04:29.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:29.975+0000 7febc5200640 1 -- 172.21.15.29:0/3285019340 wait complete. 2024-01-24T13:04:29.997 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:04:30.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.135+0000 7f6dba000640 1 Processor -- start 2024-01-24T13:04:30.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.135+0000 7f6dba000640 1 -- start start 2024-01-24T13:04:30.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.135+0000 7f6dba000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6db40cb100 0x7f6db4165280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.135+0000 7f6dba000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db40cfe50 con 0x7f6db40c3ef0 2024-01-24T13:04:30.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.135+0000 7f6dba000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db415aa10 con 0x7f6db415a630 2024-01-24T13:04:30.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.135+0000 7f6dba000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db40cf380 con 0x7f6db40cb100 2024-01-24T13:04:30.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.135+0000 7f6db2a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6db40c3ef0 0x7f6db40ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41690/0 (socket says 172.21.15.29:41690) 2024-01-24T13:04:30.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.135+0000 7f6db2a00640 1 -- 172.21.15.29:0/864203644 learned_addr learned my addr 172.21.15.29:0/864203644 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:30.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.135+0000 7f6db3e00640 1 --2- 172.21.15.29:0/864203644 >> v2:172.21.15.163:3300/0 conn(0x7f6db40cb100 0x7f6db4165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.135+0000 7f6db2000640 1 -- 172.21.15.29:0/864203644 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270600027 0 0) 0x7f6db40cfe50 con 0x7f6db40c3ef0 2024-01-24T13:04:30.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.135+0000 7f6db2000640 1 -- 172.21.15.29:0/864203644 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d94003530 con 0x7f6db40c3ef0 2024-01-24T13:04:30.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.135+0000 7f6db3e00640 1 -- 172.21.15.29:0/864203644 >> v1:172.21.15.163:6789/0 conn(0x7f6db415a630 legacy=0x7f6db40cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.135+0000 7f6db3e00640 1 -- 172.21.15.29:0/864203644 >> v1:172.21.15.29:6789/0 conn(0x7f6db40c3ef0 legacy=0x7f6db40ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.135+0000 7f6db3e00640 1 -- 172.21.15.29:0/864203644 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db40b2b70 con 0x7f6db40cb100 2024-01-24T13:04:30.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.139+0000 7f6db3e00640 1 --2- 172.21.15.29:0/864203644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6db40cb100 0x7f6db4165280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009d90 tx=0x7f6dac01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccb09e800c2cb373 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:30.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.139+0000 7f6db2000640 1 -- 172.21.15.29:0/864203644 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0a59e0 con 0x7f6db40cb100 2024-01-24T13:04:30.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.139+0000 7f6db2000640 1 -- 172.21.15.29:0/864203644 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac0a5b40 con 0x7f6db40cb100 2024-01-24T13:04:30.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.139+0000 7f6db2000640 1 -- 172.21.15.29:0/864203644 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0ad440 con 0x7f6db40cb100 2024-01-24T13:04:30.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.139+0000 7f6dba000640 1 -- 172.21.15.29:0/864203644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6db40cb100 msgr2=0x7f6db4165280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.139+0000 7f6dba000640 1 --2- 172.21.15.29:0/864203644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6db40cb100 0x7f6db4165280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009d90 tx=0x7f6dac01c920 comp rx=0 tx=0).stop 2024-01-24T13:04:30.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.139+0000 7f6dba000640 1 -- 172.21.15.29:0/864203644 shutdown_connections 2024-01-24T13:04:30.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.139+0000 7f6dba000640 1 --2- 172.21.15.29:0/864203644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6db40cb100 0x7f6db4165280 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.139+0000 7f6dba000640 1 -- 172.21.15.29:0/864203644 >> 172.21.15.29:0/864203644 conn(0x7f6db4070570 msgr2=0x7f6db4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:30.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.139+0000 7f6dba000640 1 -- 172.21.15.29:0/864203644 shutdown_connections 2024-01-24T13:04:30.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.139+0000 7f6dba000640 1 -- 172.21.15.29:0/864203644 wait complete. 2024-01-24T13:04:30.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6dba000640 1 Processor -- start 2024-01-24T13:04:30.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6dba000640 1 -- start start 2024-01-24T13:04:30.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6dba000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6db40c3ef0 0x7f6db414b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6dba000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6db40cb100 0x7f6db40c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6dba000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6db415a630 0x7f6db40b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6dba000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db414b580 con 0x7f6db415a630 2024-01-24T13:04:30.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6dba000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db414f9e0 con 0x7f6db40cb100 2024-01-24T13:04:30.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6dba000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4151490 con 0x7f6db40c3ef0 2024-01-24T13:04:30.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6db3e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6db415a630 0x7f6db40b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6db3e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6db415a630 0x7f6db40b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37642/0 (socket says 172.21.15.29:37642) 2024-01-24T13:04:30.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6db3e00640 1 -- 172.21.15.29:0/1240181558 learned_addr learned my addr 172.21.15.29:0/1240181558 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:30.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6db2a00640 1 --2- 172.21.15.29:0/1240181558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6db40cb100 0x7f6db40c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6db3400640 1 --2- 172.21.15.29:0/1240181558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6db40c3ef0 0x7f6db414b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6db3e00640 1 -- 172.21.15.29:0/1240181558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6db40c3ef0 msgr2=0x7f6db414b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6db3e00640 1 --2- 172.21.15.29:0/1240181558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6db40c3ef0 0x7f6db414b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6db3e00640 1 -- 172.21.15.29:0/1240181558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6db40cb100 msgr2=0x7f6db40c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6db3e00640 1 --2- 172.21.15.29:0/1240181558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6db40cb100 0x7f6db40c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6db3e00640 1 -- 172.21.15.29:0/1240181558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac009a70 con 0x7f6db415a630 2024-01-24T13:04:30.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6db3e00640 1 --2- 172.21.15.29:0/1240181558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6db415a630 0x7f6db40b01d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6dac01a550 tx=0x7f6dac0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:30.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6dab400640 1 -- 172.21.15.29:0/1240181558 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0add90 con 0x7f6db415a630 2024-01-24T13:04:30.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6dab400640 1 -- 172.21.15.29:0/1240181558 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac009450 con 0x7f6db415a630 2024-01-24T13:04:30.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6dab400640 1 -- 172.21.15.29:0/1240181558 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0b9670 con 0x7f6db415a630 2024-01-24T13:04:30.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.143+0000 7f6dba000640 1 -- 172.21.15.29:0/1240181558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db41516a0 con 0x7f6db415a630 2024-01-24T13:04:30.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.147+0000 7f6dba000640 1 -- 172.21.15.29:0/1240181558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db406c830 con 0x7f6db415a630 2024-01-24T13:04:30.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.147+0000 7f6dba000640 1 -- 172.21.15.29:0/1240181558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db4151bc0 con 0x7f6db415a630 2024-01-24T13:04:30.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.147+0000 7f6dab400640 1 -- 172.21.15.29:0/1240181558 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6dac0b97d0 con 0x7f6db415a630 2024-01-24T13:04:30.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.147+0000 7f6dab400640 1 --2- 172.21.15.29:0/1240181558 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6d8c065a60 0x7f6d8c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.147+0000 7f6dab400640 1 -- 172.21.15.29:0/1240181558 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6dac11eb30 con 0x7f6db415a630 2024-01-24T13:04:30.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.147+0000 7f6db3400640 1 --2- 172.21.15.29:0/1240181558 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6d8c065a60 0x7f6d8c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.151+0000 7f6db3400640 1 --2- 172.21.15.29:0/1240181558 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6d8c065a60 0x7f6d8c067f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6da4007fd0 tx=0x7f6da4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:30.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.151+0000 7f6dab400640 1 -- 172.21.15.29:0/1240181558 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f6dac0ec210 con 0x7f6db415a630 2024-01-24T13:04:30.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.347+0000 7f6dba000640 1 -- 172.21.15.29:0/1240181558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6db404e850 con 0x7f6db415a630 2024-01-24T13:04:30.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.347+0000 7f6dab400640 1 -- 172.21.15.29:0/1240181558 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f6dac0b2090 con 0x7f6db415a630 2024-01-24T13:04:30.350 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:30.350 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1485056573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1485056573},{"type":"v1","addr":"172.21.15.29:6834","nonce":1485056573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/447431893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":447431893},{"type":"v1","addr":"172.21.15.163:6836","nonce":447431893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2390785325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2390785325},{"type":"v1","addr":"172.21.15.29:6835","nonce":2390785325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:03:55.981917+0000","modified":"2024-01-24T13:04:19.618027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/1191601563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1191601563},{"type":"v1","addr":"172.21.15.163:6837","nonce":1191601563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T13:04:30.350 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-24T13:04:30.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.347+0000 7f6dba000640 1 -- 172.21.15.29:0/1240181558 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6d8c065a60 msgr2=0x7f6d8c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.347+0000 7f6dba000640 1 --2- 172.21.15.29:0/1240181558 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6d8c065a60 0x7f6d8c067f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6da4007fd0 tx=0x7f6da4009040 comp rx=0 tx=0).stop 2024-01-24T13:04:30.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.347+0000 7f6dba000640 1 -- 172.21.15.29:0/1240181558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6db415a630 msgr2=0x7f6db40b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.347+0000 7f6dba000640 1 --2- 172.21.15.29:0/1240181558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6db415a630 0x7f6db40b01d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6dac01a550 tx=0x7f6dac0196c0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.347+0000 7f6dba000640 1 -- 172.21.15.29:0/1240181558 shutdown_connections 2024-01-24T13:04:30.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.347+0000 7f6dba000640 1 --2- 172.21.15.29:0/1240181558 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6d8c065a60 0x7f6d8c067f20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.347+0000 7f6dba000640 1 --2- 172.21.15.29:0/1240181558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6db415a630 0x7f6db40b01d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.347+0000 7f6dba000640 1 --2- 172.21.15.29:0/1240181558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6db40cb100 0x7f6db40c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.347+0000 7f6dba000640 1 --2- 172.21.15.29:0/1240181558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6db40c3ef0 0x7f6db414b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.347+0000 7f6dba000640 1 -- 172.21.15.29:0/1240181558 >> 172.21.15.29:0/1240181558 conn(0x7f6db4070570 msgr2=0x7f6db4155b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:30.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.347+0000 7f6dba000640 1 -- 172.21.15.29:0/1240181558 shutdown_connections 2024-01-24T13:04:30.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.347+0000 7f6dba000640 1 -- 172.21.15.29:0/1240181558 wait complete. 2024-01-24T13:04:30.372 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:30.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec97200640 1 Processor -- start 2024-01-24T13:04:30.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec97200640 1 -- start start 2024-01-24T13:04:30.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec97200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fec90159300 0x7fec900b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec97200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fec9006bc10 0x7fec9006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec97200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9015de10 con 0x7fec9015cf50 2024-01-24T13:04:30.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec97200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec90071140 con 0x7fec9006bc10 2024-01-24T13:04:30.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec97200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9006c5e0 con 0x7fec90159300 2024-01-24T13:04:30.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec8f400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fec9006bc10 0x7fec9006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec8f400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fec9006bc10 0x7fec9006c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37644/0 (socket says 172.21.15.29:37644) 2024-01-24T13:04:30.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec8f400640 1 -- 172.21.15.29:0/2425154183 learned_addr learned my addr 172.21.15.29:0/2425154183 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:30.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec95200640 1 --1- 172.21.15.29:0/2425154183 >> v1:172.21.15.29:6789/0 conn(0x7fec9015cf50 0x7fec900cbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41702/0 (socket says 172.21.15.29:41702) 2024-01-24T13:04:30.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec8f400640 1 -- 172.21.15.29:0/2425154183 >> v2:172.21.15.163:3300/0 conn(0x7fec90159300 msgr2=0x7fec900b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:30.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec8fe00640 1 --2- 172.21.15.29:0/2425154183 >> v2:172.21.15.163:3300/0 conn(0x7fec90159300 0x7fec900b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec8f400640 1 --2- 172.21.15.29:0/2425154183 >> v2:172.21.15.163:3300/0 conn(0x7fec90159300 0x7fec900b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec8f400640 1 -- 172.21.15.29:0/2425154183 >> v1:172.21.15.29:6789/0 conn(0x7fec9015cf50 legacy=0x7fec900cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec8f400640 1 -- 172.21.15.29:0/2425154183 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9015db30 con 0x7fec9006bc10 2024-01-24T13:04:30.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.511+0000 7fec8fe00640 1 --2- 172.21.15.29:0/2425154183 >> v2:172.21.15.163:3300/0 conn(0x7fec90159300 0x7fec900b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:30.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.515+0000 7fec8f400640 1 --2- 172.21.15.29:0/2425154183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec9006bc10 0x7fec9006c0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fec9006ded0 tx=0x7fec7801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40aa6a0a65870dd1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:30.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.515+0000 7fec8ea00640 1 -- 172.21.15.29:0/2425154183 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec780ab640 con 0x7fec9006bc10 2024-01-24T13:04:30.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.515+0000 7fec8ea00640 1 -- 172.21.15.29:0/2425154183 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec780a7070 con 0x7fec9006bc10 2024-01-24T13:04:30.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.515+0000 7fec8ea00640 1 -- 172.21.15.29:0/2425154183 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec780ab9c0 con 0x7fec9006bc10 2024-01-24T13:04:30.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.515+0000 7fec97200640 1 -- 172.21.15.29:0/2425154183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec9006bc10 msgr2=0x7fec9006c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.515+0000 7fec97200640 1 --2- 172.21.15.29:0/2425154183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec9006bc10 0x7fec9006c0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fec9006ded0 tx=0x7fec7801c440 comp rx=0 tx=0).stop 2024-01-24T13:04:30.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.515+0000 7fec97200640 1 -- 172.21.15.29:0/2425154183 shutdown_connections 2024-01-24T13:04:30.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.515+0000 7fec97200640 1 --2- 172.21.15.29:0/2425154183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec9006bc10 0x7fec9006c0a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.515+0000 7fec97200640 1 --2- 172.21.15.29:0/2425154183 >> v2:172.21.15.163:3300/0 conn(0x7fec90159300 0x7fec900b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.515+0000 7fec97200640 1 -- 172.21.15.29:0/2425154183 >> 172.21.15.29:0/2425154183 conn(0x7fec900b3950 msgr2=0x7fec90069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:30.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.515+0000 7fec97200640 1 -- 172.21.15.29:0/2425154183 shutdown_connections 2024-01-24T13:04:30.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.515+0000 7fec97200640 1 -- 172.21.15.29:0/2425154183 wait complete. 2024-01-24T13:04:30.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec97200640 1 Processor -- start 2024-01-24T13:04:30.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec97200640 1 -- start start 2024-01-24T13:04:30.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec97200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec9006bc10 0x7fec9015c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec97200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fec90159300 0x7fec901596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec97200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec9015cf50 0x7fec9015b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec97200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec90146210 con 0x7fec9015cf50 2024-01-24T13:04:30.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec97200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec90142750 con 0x7fec9006bc10 2024-01-24T13:04:30.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec97200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9014db90 con 0x7fec90159300 2024-01-24T13:04:30.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec95200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec9015cf50 0x7fec9015b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec95200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec9015cf50 0x7fec9015b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37654/0 (socket says 172.21.15.29:37654) 2024-01-24T13:04:30.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec95200640 1 -- 172.21.15.29:0/1968673338 learned_addr learned my addr 172.21.15.29:0/1968673338 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:30.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec8f400640 1 --2- 172.21.15.29:0/1968673338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fec90159300 0x7fec901596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec8fe00640 1 --2- 172.21.15.29:0/1968673338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec9006bc10 0x7fec9015c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec95200640 1 -- 172.21.15.29:0/1968673338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fec90159300 msgr2=0x7fec901596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec95200640 1 --2- 172.21.15.29:0/1968673338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fec90159300 0x7fec901596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec95200640 1 -- 172.21.15.29:0/1968673338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec9006bc10 msgr2=0x7fec9015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec95200640 1 --2- 172.21.15.29:0/1968673338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec9006bc10 0x7fec9015c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec95200640 1 -- 172.21.15.29:0/1968673338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec780094d0 con 0x7fec9015cf50 2024-01-24T13:04:30.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec95200640 1 --2- 172.21.15.29:0/1968673338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec9015cf50 0x7fec9015b550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c700 tx=0x7fec8800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:30.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec87e00640 1 -- 172.21.15.29:0/1968673338 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8800ce10 con 0x7fec9015cf50 2024-01-24T13:04:30.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec87e00640 1 -- 172.21.15.29:0/1968673338 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8800a640 con 0x7fec9015cf50 2024-01-24T13:04:30.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec87e00640 1 -- 172.21.15.29:0/1968673338 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8800a9b0 con 0x7fec9015cf50 2024-01-24T13:04:30.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec97200640 1 -- 172.21.15.29:0/1968673338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec900ce9c0 con 0x7fec9015cf50 2024-01-24T13:04:30.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.519+0000 7fec97200640 1 -- 172.21.15.29:0/1968673338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9014e0c0 con 0x7fec9015cf50 2024-01-24T13:04:30.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.523+0000 7fec97200640 1 -- 172.21.15.29:0/1968673338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9004e850 con 0x7fec9015cf50 2024-01-24T13:04:30.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.523+0000 7fec87e00640 1 -- 172.21.15.29:0/1968673338 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fec8800ab10 con 0x7fec9015cf50 2024-01-24T13:04:30.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.523+0000 7fec87e00640 1 --2- 172.21.15.29:0/1968673338 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fec68065a60 0x7fec68067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.523+0000 7fec87e00640 1 -- 172.21.15.29:0/1968673338 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fec88082b70 con 0x7fec9015cf50 2024-01-24T13:04:30.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.523+0000 7fec8fe00640 1 --2- 172.21.15.29:0/1968673338 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fec68065a60 0x7fec68067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.523+0000 7fec8fe00640 1 --2- 172.21.15.29:0/1968673338 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fec68065a60 0x7fec68067f20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec8000ab60 tx=0x7fec80008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:30.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.527+0000 7fec87e00640 1 -- 172.21.15.29:0/1968673338 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fec880502e0 con 0x7fec9015cf50 2024-01-24T13:04:30.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.687+0000 7fec97200640 1 -- 172.21.15.29:0/1968673338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec9006a150 con 0x7fec9015cf50 2024-01-24T13:04:30.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.687+0000 7fec87e00640 1 -- 172.21.15.29:0/1968673338 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+17882 (secure 0 0 0) 0x7fec88017020 con 0x7fec9015cf50 2024-01-24T13:04:30.691 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:30.691 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:01.140044+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.691+0000 7fec97200640 1 -- 172.21.15.29:0/1968673338 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fec68065a60 msgr2=0x7fec68067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.691+0000 7fec97200640 1 --2- 172.21.15.29:0/1968673338 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fec68065a60 0x7fec68067f20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec8000ab60 tx=0x7fec80008040 comp rx=0 tx=0).stop 2024-01-24T13:04:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.691+0000 7fec97200640 1 -- 172.21.15.29:0/1968673338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec9015cf50 msgr2=0x7fec9015b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.691+0000 7fec97200640 1 --2- 172.21.15.29:0/1968673338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec9015cf50 0x7fec9015b550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c700 tx=0x7fec8800cbc0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.691+0000 7fec97200640 1 -- 172.21.15.29:0/1968673338 shutdown_connections 2024-01-24T13:04:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.691+0000 7fec97200640 1 --2- 172.21.15.29:0/1968673338 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fec68065a60 0x7fec68067f20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.691+0000 7fec97200640 1 --2- 172.21.15.29:0/1968673338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec9015cf50 0x7fec9015b550 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.691+0000 7fec97200640 1 --2- 172.21.15.29:0/1968673338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fec90159300 0x7fec901596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.691+0000 7fec97200640 1 --2- 172.21.15.29:0/1968673338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec9006bc10 0x7fec9015c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.691+0000 7fec97200640 1 -- 172.21.15.29:0/1968673338 >> 172.21.15.29:0/1968673338 conn(0x7fec900b3950 msgr2=0x7fec900b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:30.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.691+0000 7fec97200640 1 -- 172.21.15.29:0/1968673338 shutdown_connections 2024-01-24T13:04:30.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.691+0000 7fec97200640 1 -- 172.21.15.29:0/1968673338 wait complete. 2024-01-24T13:04:30.713 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:04:30.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.851+0000 7fad56400640 1 Processor -- start 2024-01-24T13:04:30.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.851+0000 7fad56400640 1 -- start start 2024-01-24T13:04:30.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad56400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fad5015a630 0x7fad500cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad56400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad500c3ef0 0x7fad500ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad56400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad500ca9f0 0x7fad500cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad56400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad500cf380 con 0x7fad500c3ef0 2024-01-24T13:04:30.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad56400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad500cfe50 con 0x7fad5015a630 2024-01-24T13:04:30.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad56400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad500cb3c0 con 0x7fad500ca9f0 2024-01-24T13:04:30.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad4ea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad500c3ef0 0x7fad500ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad4ea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad500c3ef0 0x7fad500ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37670/0 (socket says 172.21.15.29:37670) 2024-01-24T13:04:30.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad4ea00640 1 -- 172.21.15.29:0/3362862073 learned_addr learned my addr 172.21.15.29:0/3362862073 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:30.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad4fe00640 1 --2- 172.21.15.29:0/3362862073 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad500ca9f0 0x7fad500cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad4f400640 1 --2- 172.21.15.29:0/3362862073 >> v2:172.21.15.163:3300/0 conn(0x7fad5015a630 0x7fad500cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad4ea00640 1 -- 172.21.15.29:0/3362862073 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad500ca9f0 msgr2=0x7fad500cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:30.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad4ea00640 1 --2- 172.21.15.29:0/3362862073 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad500ca9f0 0x7fad500cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad4ea00640 1 -- 172.21.15.29:0/3362862073 >> v2:172.21.15.163:3300/0 conn(0x7fad5015a630 msgr2=0x7fad500cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:30.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad4ea00640 1 --2- 172.21.15.29:0/3362862073 >> v2:172.21.15.163:3300/0 conn(0x7fad5015a630 0x7fad500cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad4ea00640 1 -- 172.21.15.29:0/3362862073 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5015aa10 con 0x7fad500c3ef0 2024-01-24T13:04:30.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad4f400640 1 --2- 172.21.15.29:0/3362862073 >> v2:172.21.15.163:3300/0 conn(0x7fad5015a630 0x7fad500cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:30.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.855+0000 7fad4ea00640 1 --2- 172.21.15.29:0/3362862073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad500c3ef0 0x7fad500ce4b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fad5006a8d0 tx=0x7fad3801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cc1b1f54e20120 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:30.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad4e000640 1 -- 172.21.15.29:0/3362862073 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad380a6040 con 0x7fad500c3ef0 2024-01-24T13:04:30.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad4e000640 1 -- 172.21.15.29:0/3362862073 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad380aa600 con 0x7fad500c3ef0 2024-01-24T13:04:30.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad4e000640 1 -- 172.21.15.29:0/3362862073 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad380aa990 con 0x7fad500c3ef0 2024-01-24T13:04:30.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 -- 172.21.15.29:0/3362862073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad500c3ef0 msgr2=0x7fad500ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 --2- 172.21.15.29:0/3362862073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad500c3ef0 0x7fad500ce4b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fad5006a8d0 tx=0x7fad3801c4e0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 -- 172.21.15.29:0/3362862073 shutdown_connections 2024-01-24T13:04:30.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 --2- 172.21.15.29:0/3362862073 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad500ca9f0 0x7fad500cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 --2- 172.21.15.29:0/3362862073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad500c3ef0 0x7fad500ce4b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 --2- 172.21.15.29:0/3362862073 >> v2:172.21.15.163:3300/0 conn(0x7fad5015a630 0x7fad500cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 -- 172.21.15.29:0/3362862073 >> 172.21.15.29:0/3362862073 conn(0x7fad50070570 msgr2=0x7fad50069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:30.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 -- 172.21.15.29:0/3362862073 shutdown_connections 2024-01-24T13:04:30.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 -- 172.21.15.29:0/3362862073 wait complete. 2024-01-24T13:04:30.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 Processor -- start 2024-01-24T13:04:30.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 -- start start 2024-01-24T13:04:30.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad500c3ef0 0x7fad500c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad500ca9f0 0x7fad5014b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad5015a630 0x7fad500b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad500b2090 con 0x7fad500ca9f0 2024-01-24T13:04:30.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad50153590 con 0x7fad500c3ef0 2024-01-24T13:04:30.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.859+0000 7fad56400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5014b8d0 con 0x7fad5015a630 2024-01-24T13:04:30.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad4ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad500ca9f0 0x7fad5014b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad4ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad500ca9f0 0x7fad5014b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37674/0 (socket says 172.21.15.29:37674) 2024-01-24T13:04:30.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad4ea00640 1 -- 172.21.15.29:0/4093307296 learned_addr learned my addr 172.21.15.29:0/4093307296 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:30.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad4fe00640 1 --2- 172.21.15.29:0/4093307296 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad5015a630 0x7fad500b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad4f400640 1 --2- 172.21.15.29:0/4093307296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad500c3ef0 0x7fad500c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad4ea00640 1 -- 172.21.15.29:0/4093307296 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad5015a630 msgr2=0x7fad500b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad4ea00640 1 --2- 172.21.15.29:0/4093307296 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad5015a630 0x7fad500b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad4ea00640 1 -- 172.21.15.29:0/4093307296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad500c3ef0 msgr2=0x7fad500c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:30.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad4ea00640 1 --2- 172.21.15.29:0/4093307296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad500c3ef0 0x7fad500c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:30.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad4ea00640 1 -- 172.21.15.29:0/4093307296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad380094d0 con 0x7fad500ca9f0 2024-01-24T13:04:30.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad4ea00640 1 --2- 172.21.15.29:0/4093307296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad500ca9f0 0x7fad5014b390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fad3801cd80 tx=0x7fad3801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:30.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad47400640 1 -- 172.21.15.29:0/4093307296 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad380aa4a0 con 0x7fad500ca9f0 2024-01-24T13:04:30.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad47400640 1 -- 172.21.15.29:0/4093307296 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad380b3800 con 0x7fad500ca9f0 2024-01-24T13:04:30.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad47400640 1 -- 172.21.15.29:0/4093307296 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad380b3b70 con 0x7fad500ca9f0 2024-01-24T13:04:30.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad56400640 1 -- 172.21.15.29:0/4093307296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad50152c60 con 0x7fad500ca9f0 2024-01-24T13:04:30.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad56400640 1 -- 172.21.15.29:0/4093307296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad50153220 con 0x7fad500ca9f0 2024-01-24T13:04:30.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad56400640 1 -- 172.21.15.29:0/4093307296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad50153700 con 0x7fad500ca9f0 2024-01-24T13:04:30.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.863+0000 7fad47400640 1 -- 172.21.15.29:0/4093307296 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fad380b3cd0 con 0x7fad500ca9f0 2024-01-24T13:04:30.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.867+0000 7fad47400640 1 --2- 172.21.15.29:0/4093307296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fad28065a90 0x7fad28067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:30.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.867+0000 7fad47400640 1 -- 172.21.15.29:0/4093307296 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fad3811d950 con 0x7fad500ca9f0 2024-01-24T13:04:30.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.867+0000 7fad4f400640 1 --2- 172.21.15.29:0/4093307296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fad28065a90 0x7fad28067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:30.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.867+0000 7fad4f400640 1 --2- 172.21.15.29:0/4093307296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fad28065a90 0x7fad28067f50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad40006fd0 tx=0x7fad40008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:30.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:30.871+0000 7fad47400640 1 -- 172.21.15.29:0/4093307296 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fad380eb030 con 0x7fad500ca9f0 2024-01-24T13:04:31.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.059+0000 7fad56400640 1 -- 172.21.15.29:0/4093307296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad500cf070 con 0x7fad500ca9f0 2024-01-24T13:04:31.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.059+0000 7fad47400640 1 -- 172.21.15.29:0/4093307296 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7fad380ee650 con 0x7fad500ca9f0 2024-01-24T13:04:31.061 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:31.061 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1485056573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1485056573},{"type":"v1","addr":"172.21.15.29:6834","nonce":1485056573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/447431893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":447431893},{"type":"v1","addr":"172.21.15.163:6836","nonce":447431893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2390785325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2390785325},{"type":"v1","addr":"172.21.15.29:6835","nonce":2390785325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:03:55.981917+0000","modified":"2024-01-24T13:04:19.618027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/1191601563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1191601563},{"type":"v1","addr":"172.21.15.163:6837","nonce":1191601563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T13:04:31.062 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-24T13:04:31.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.059+0000 7fad56400640 1 -- 172.21.15.29:0/4093307296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fad28065a90 msgr2=0x7fad28067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:31.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.059+0000 7fad56400640 1 --2- 172.21.15.29:0/4093307296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fad28065a90 0x7fad28067f50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad40006fd0 tx=0x7fad40008040 comp rx=0 tx=0).stop 2024-01-24T13:04:31.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.059+0000 7fad56400640 1 -- 172.21.15.29:0/4093307296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad500ca9f0 msgr2=0x7fad5014b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:31.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.059+0000 7fad56400640 1 --2- 172.21.15.29:0/4093307296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad500ca9f0 0x7fad5014b390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fad3801cd80 tx=0x7fad3801ad20 comp rx=0 tx=0).stop 2024-01-24T13:04:31.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.059+0000 7fad56400640 1 -- 172.21.15.29:0/4093307296 shutdown_connections 2024-01-24T13:04:31.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.059+0000 7fad56400640 1 --2- 172.21.15.29:0/4093307296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fad28065a90 0x7fad28067f50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.059+0000 7fad56400640 1 --2- 172.21.15.29:0/4093307296 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fad5015a630 0x7fad500b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.059+0000 7fad56400640 1 --2- 172.21.15.29:0/4093307296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad500ca9f0 0x7fad5014b390 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.059+0000 7fad56400640 1 --2- 172.21.15.29:0/4093307296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad500c3ef0 0x7fad500c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.059+0000 7fad56400640 1 -- 172.21.15.29:0/4093307296 >> 172.21.15.29:0/4093307296 conn(0x7fad50070570 msgr2=0x7fad500cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:31.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.059+0000 7fad56400640 1 -- 172.21.15.29:0/4093307296 shutdown_connections 2024-01-24T13:04:31.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.059+0000 7fad56400640 1 -- 172.21.15.29:0/4093307296 wait complete. 2024-01-24T13:04:31.486 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-24T13:03:55.981917+0000', 'modified': '2024-01-24T13:04:19.618027+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.163:6837/1191601563', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6835', 'nonce': 1191601563}, {'type': 'v1', 'addr': '172.21.15.163:6837', 'nonce': 1191601563}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-24T13:04:31.486 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-24T13:04:31.486 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-24T13:04:31.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.627+0000 7ff74d400640 1 Processor -- start 2024-01-24T13:04:31.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.627+0000 7ff74d400640 1 -- start start 2024-01-24T13:04:31.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.627+0000 7ff74d400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7480cd160 0x7ff7480cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.627+0000 7ff74d400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff74815e0f0 0x7ff74815b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.627+0000 7ff74d400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff74815b8b0 0x7ff7480cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.627+0000 7ff74d400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74815e920 con 0x7ff74815b8b0 2024-01-24T13:04:31.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.627+0000 7ff74d400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74815ec00 con 0x7ff74815e0f0 2024-01-24T13:04:31.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.627+0000 7ff74d400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74815eee0 con 0x7ff7480cd160 2024-01-24T13:04:31.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.631+0000 7ff747200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff74815b8b0 0x7ff7480cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.631+0000 7ff747200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff74815b8b0 0x7ff7480cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41648/0 (socket says 172.21.15.29:41648) 2024-01-24T13:04:31.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.631+0000 7ff747200640 1 -- 172.21.15.29:0/2555886226 learned_addr learned my addr 172.21.15.29:0/2555886226 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:31.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.631+0000 7ff745e00640 1 --2- 172.21.15.29:0/2555886226 >> v2:172.21.15.163:3300/0 conn(0x7ff74815e0f0 0x7ff74815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.631+0000 7ff746800640 1 --2- 172.21.15.29:0/2555886226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7480cd160 0x7ff7480cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.631+0000 7ff747200640 1 -- 172.21.15.29:0/2555886226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7480cd160 msgr2=0x7ff7480cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:31.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.631+0000 7ff747200640 1 --2- 172.21.15.29:0/2555886226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7480cd160 0x7ff7480cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.631+0000 7ff747200640 1 -- 172.21.15.29:0/2555886226 >> v2:172.21.15.163:3300/0 conn(0x7ff74815e0f0 msgr2=0x7ff74815b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:31.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.631+0000 7ff747200640 1 --2- 172.21.15.29:0/2555886226 >> v2:172.21.15.163:3300/0 conn(0x7ff74815e0f0 0x7ff74815b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.631+0000 7ff747200640 1 -- 172.21.15.29:0/2555886226 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74815ae50 con 0x7ff74815b8b0 2024-01-24T13:04:31.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.631+0000 7ff747200640 1 --2- 172.21.15.29:0/2555886226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff74815b8b0 0x7ff7480cab00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff7480d1530 tx=0x7ff74001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1eeda4668c093b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:31.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.631+0000 7ff745400640 1 -- 172.21.15.29:0/2555886226 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7400a5680 con 0x7ff74815b8b0 2024-01-24T13:04:31.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.631+0000 7ff745400640 1 -- 172.21.15.29:0/2555886226 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7400a57e0 con 0x7ff74815b8b0 2024-01-24T13:04:31.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.631+0000 7ff745400640 1 -- 172.21.15.29:0/2555886226 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7400a5b70 con 0x7ff74815b8b0 2024-01-24T13:04:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 -- 172.21.15.29:0/2555886226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff74815b8b0 msgr2=0x7ff7480cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 --2- 172.21.15.29:0/2555886226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff74815b8b0 0x7ff7480cab00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff7480d1530 tx=0x7ff74001c9d0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 -- 172.21.15.29:0/2555886226 shutdown_connections 2024-01-24T13:04:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 --2- 172.21.15.29:0/2555886226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff74815b8b0 0x7ff7480cab00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 --2- 172.21.15.29:0/2555886226 >> v2:172.21.15.163:3300/0 conn(0x7ff74815e0f0 0x7ff74815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 --2- 172.21.15.29:0/2555886226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7480cd160 0x7ff7480cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 -- 172.21.15.29:0/2555886226 >> 172.21.15.29:0/2555886226 conn(0x7ff748069cd0 msgr2=0x7ff74806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 -- 172.21.15.29:0/2555886226 shutdown_connections 2024-01-24T13:04:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 -- 172.21.15.29:0/2555886226 wait complete. 2024-01-24T13:04:31.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 Processor -- start 2024-01-24T13:04:31.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 -- start start 2024-01-24T13:04:31.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7480cd160 0x7ff74806c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff74815e0f0 0x7ff7480c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff748154250 0x7ff7481595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74806c1a0 con 0x7ff7480cd160 2024-01-24T13:04:31.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74806b2b0 con 0x7ff74815e0f0 2024-01-24T13:04:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff74d400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74806b590 con 0x7ff748154250 2024-01-24T13:04:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff746800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7480cd160 0x7ff74806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff746800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7480cd160 0x7ff74806c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41658/0 (socket says 172.21.15.29:41658) 2024-01-24T13:04:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.635+0000 7ff746800640 1 -- 172.21.15.29:0/4201546777 learned_addr learned my addr 172.21.15.29:0/4201546777 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff747200640 1 --2- 172.21.15.29:0/4201546777 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff748154250 0x7ff7481595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff745e00640 1 --2- 172.21.15.29:0/4201546777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff74815e0f0 0x7ff7480c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff746800640 1 -- 172.21.15.29:0/4201546777 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff748154250 msgr2=0x7ff7481595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff746800640 1 --2- 172.21.15.29:0/4201546777 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff748154250 0x7ff7481595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff746800640 1 -- 172.21.15.29:0/4201546777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff74815e0f0 msgr2=0x7ff7480c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff746800640 1 --2- 172.21.15.29:0/4201546777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff74815e0f0 0x7ff7480c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff746800640 1 -- 172.21.15.29:0/4201546777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff740009b30 con 0x7ff7480cd160 2024-01-24T13:04:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff746800640 1 --2- 172.21.15.29:0/4201546777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7480cd160 0x7ff74806c630 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff73800d800 tx=0x7ff73800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff73ea00640 1 -- 172.21.15.29:0/4201546777 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7380096a0 con 0x7ff7480cd160 2024-01-24T13:04:31.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff73ea00640 1 -- 172.21.15.29:0/4201546777 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff738009800 con 0x7ff7480cd160 2024-01-24T13:04:31.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff73ea00640 1 -- 172.21.15.29:0/4201546777 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738009b70 con 0x7ff7480cd160 2024-01-24T13:04:31.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff74d400640 1 -- 172.21.15.29:0/4201546777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74806b870 con 0x7ff7480cd160 2024-01-24T13:04:31.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff74d400640 1 -- 172.21.15.29:0/4201546777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74806be30 con 0x7ff7480cd160 2024-01-24T13:04:31.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff73ea00640 1 -- 172.21.15.29:0/4201546777 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff738009cd0 con 0x7ff7480cd160 2024-01-24T13:04:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff73ea00640 1 --2- 172.21.15.29:0/4201546777 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff720065a60 0x7ff720067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.639+0000 7ff73ea00640 1 -- 172.21.15.29:0/4201546777 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff738083b40 con 0x7ff7480cd160 2024-01-24T13:04:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff745e00640 1 --2- 172.21.15.29:0/4201546777 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff720065a60 0x7ff720067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 Processor -- start 2024-01-24T13:04:31.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 -- start start 2024-01-24T13:04:31.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff745e00640 1 --2- 172.21.15.29:0/4201546777 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff720065a60 0x7ff720067f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff748165450 tx=0x7ff730008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:31.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a053d8980 0x563a053d8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d92a0 0x563a0538c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a0538d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a051e4350 con 0x563a0538cd30 2024-01-24T13:04:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a051e1920 con 0x563a053d8980 2024-01-24T13:04:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a051dd210 con 0x563a053d92a0 2024-01-24T13:04:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff747200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a0538d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff747200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a0538d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41660/0 (socket says 172.21.15.29:41660) 2024-01-24T13:04:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff747200640 1 -- 172.21.15.29:0/1939302390 learned_addr learned my addr 172.21.15.29:0/1939302390 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff745e00640 1 --2- 172.21.15.29:0/1939302390 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d92a0 0x563a0538c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff746800640 1 --2- 172.21.15.29:0/1939302390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a053d8980 0x563a053d8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff747200640 1 -- 172.21.15.29:0/1939302390 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d92a0 msgr2=0x563a0538c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff747200640 1 --2- 172.21.15.29:0/1939302390 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d92a0 0x563a0538c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff747200640 1 -- 172.21.15.29:0/1939302390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a053d8980 msgr2=0x563a053d8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff747200640 1 --2- 172.21.15.29:0/1939302390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a053d8980 0x563a053d8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff747200640 1 -- 172.21.15.29:0/1939302390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a0517dff0 con 0x563a0538cd30 2024-01-24T13:04:31.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff747200640 1 --2- 172.21.15.29:0/1939302390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a0538d110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff74001b080 tx=0x7ff740004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdcd1def73c85f7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:31.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff737400640 1 -- 172.21.15.29:0/1939302390 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7400a5950 con 0x563a0538cd30 2024-01-24T13:04:31.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff737400640 1 -- 172.21.15.29:0/1939302390 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7400a5ab0 con 0x563a0538cd30 2024-01-24T13:04:31.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff737400640 1 -- 172.21.15.29:0/1939302390 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7400a5e40 con 0x563a0538cd30 2024-01-24T13:04:31.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 -- 172.21.15.29:0/1939302390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 msgr2=0x563a0538d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:31.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 --2- 172.21.15.29:0/1939302390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a0538d110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff74001b080 tx=0x7ff740004ac0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 -- 172.21.15.29:0/1939302390 shutdown_connections 2024-01-24T13:04:31.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 --2- 172.21.15.29:0/1939302390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a0538d110 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 --2- 172.21.15.29:0/1939302390 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d92a0 0x563a0538c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 --2- 172.21.15.29:0/1939302390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a053d8980 0x563a053d8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.643+0000 7ff75076d000 1 -- 172.21.15.29:0/1939302390 >> 172.21.15.29:0/1939302390 conn(0x563a05292430 msgr2=0x563a053bbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:31.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 1 -- 172.21.15.29:0/1939302390 shutdown_connections 2024-01-24T13:04:31.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 1 -- 172.21.15.29:0/1939302390 wait complete. 2024-01-24T13:04:31.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 1 -- start start 2024-01-24T13:04:31.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 1 Processor -- start 2024-01-24T13:04:31.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a053def20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a053d8980 0x563a053df460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d92a0 0x563a053939c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0517c420 con 0x563a0538cd30 2024-01-24T13:04:31.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0519a890 con 0x563a053d8980 2024-01-24T13:04:31.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a04e9a940 con 0x563a053d92a0 2024-01-24T13:04:31.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 10 client.0 _ll_register_callbacks cb 0x563a051d1f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-24T13:04:31.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff746800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a053def20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff746800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a053def20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41662/0 (socket says 172.21.15.29:41662) 2024-01-24T13:04:31.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff746800640 1 -- 172.21.15.29:0/4166785562 learned_addr learned my addr 172.21.15.29:0/4166785562 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:31.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff745e00640 1 --2- 172.21.15.29:0/4166785562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a053d8980 0x563a053df460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff747200640 1 --2- 172.21.15.29:0/4166785562 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d92a0 0x563a053939c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff746800640 1 -- 172.21.15.29:0/4166785562 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d92a0 msgr2=0x563a053939c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:31.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff746800640 1 --2- 172.21.15.29:0/4166785562 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d92a0 0x563a053939c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff746800640 1 -- 172.21.15.29:0/4166785562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a053d8980 msgr2=0x563a053df460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:31.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff746800640 1 --2- 172.21.15.29:0/4166785562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a053d8980 0x563a053df460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff746800640 1 -- 172.21.15.29:0/4166785562 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74815ae50 con 0x563a0538cd30 2024-01-24T13:04:31.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff746800640 1 --2- 172.21.15.29:0/4166785562 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a053def20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff73800bfd0 tx=0x7ff738058d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d357704cd93fbd server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:31.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff72fe00640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-01-24T13:04:31.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff72fe00640 1 -- 172.21.15.29:0/4166785562 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73805cb80 con 0x563a0538cd30 2024-01-24T13:04:31.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff72fe00640 1 -- 172.21.15.29:0/4166785562 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff738055e40 con 0x563a0538cd30 2024-01-24T13:04:31.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 1 -- 172.21.15.29:0/4166785562 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a051a2cc0 con 0x563a0538cd30 2024-01-24T13:04:31.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff72fe00640 1 -- 172.21.15.29:0/4166785562 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff738053340 con 0x563a0538cd30 2024-01-24T13:04:31.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 10 client.4812 fetch_fsmap learned FSMap version 9 2024-01-24T13:04:31.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 1 -- 172.21.15.29:0/4166785562 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x563a04ed9890 con 0x563a0538cd30 2024-01-24T13:04:31.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff72fe00640 1 -- 172.21.15.29:0/4166785562 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563a051a2cc0 con 0x563a0538cd30 2024-01-24T13:04:31.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff72fe00640 1 -- 172.21.15.29:0/4166785562 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7ff73806c170 con 0x563a0538cd30 2024-01-24T13:04:31.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.647+0000 7ff75076d000 10 client.4812 fetch_fsmap finished waiting for FSMap version 9 2024-01-24T13:04:31.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 10 client.4812 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-24T13:04:31.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 20 client.4812 populate_metadata read hostname 'smithi029' 2024-01-24T13:04:31.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 1 --2- 172.21.15.29:0/4166785562 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x563a05394730 0x563a05394b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 4 client.4812 mds_command: new command op to 4284 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-24T13:04:31.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 1 -- 172.21.15.29:0/4166785562 --> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a051dbb60 con 0x563a05394730 2024-01-24T13:04:31.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff745e00640 1 --2- 172.21.15.29:0/4166785562 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x563a05394730 0x563a05394b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff745e00640 1 --2- 172.21.15.29:0/4166785562 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x563a05394730 0x563a05394b10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c902ad817992ca9c server_cookie=5299e2629f55334c in_seq=0 out_seq=0 2024-01-24T13:04:31.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff72fe00640 10 client.4812 ms_handle_connect on v2:172.21.15.163:6835/1191601563 2024-01-24T13:04:31.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff72fe00640 1 -- 172.21.15.29:0/4166785562 <== mds.0 v2:172.21.15.163:6835/1191601563 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x563a051dbb60 con 0x563a05394730 2024-01-24T13:04:31.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff72fe00640 10 client.4812 handle_command_reply: tid=0 2024-01-24T13:04:31.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 1 client.4812 shutdown 2024-01-24T13:04:31.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 1 -- 172.21.15.29:0/4166785562 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 msgr2=0x563a053def20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:31.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 1 --2- 172.21.15.29:0/4166785562 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a053def20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff73800bfd0 tx=0x7ff738058d20 comp rx=0 tx=0).stop 2024-01-24T13:04:31.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 1 -- 172.21.15.29:0/4166785562 shutdown_connections 2024-01-24T13:04:31.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 1 --2- 172.21.15.29:0/4166785562 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x563a05394730 0x563a05394b10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 1 --2- 172.21.15.29:0/4166785562 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d92a0 0x563a053939c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff72fe00640 0 client.4812 ms_handle_reset on v2:172.21.15.163:6835/1191601563 2024-01-24T13:04:31.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 1 --2- 172.21.15.29:0/4166785562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a053d8980 0x563a053df460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 1 --2- 172.21.15.29:0/4166785562 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a053def20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 1 -- 172.21.15.29:0/4166785562 >> 172.21.15.29:0/4166785562 conn(0x563a05292430 msgr2=0x563a0538bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:31.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 1 -- 172.21.15.29:0/4166785562 shutdown_connections 2024-01-24T13:04:31.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 1 -- 172.21.15.29:0/4166785562 wait complete. 2024-01-24T13:04:31.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.651+0000 7ff75076d000 20 client.4812 trim_cache size 0 max 16384 2024-01-24T13:04:31.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff75076d000 1 Processor -- start 2024-01-24T13:04:31.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff75076d000 1 -- start start 2024-01-24T13:04:31.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff75076d000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a05391780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff75076d000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a05394730 0x563a0538af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff75076d000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d8980 0x563a0538b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff75076d000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a053d7db0 con 0x563a0538cd30 2024-01-24T13:04:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff75076d000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a051daa20 con 0x563a05394730 2024-01-24T13:04:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff75076d000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a05190aa0 con 0x563a053d8980 2024-01-24T13:04:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff746800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a05391780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff746800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a05391780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41666/0 (socket says 172.21.15.29:41666) 2024-01-24T13:04:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff746800640 1 -- 172.21.15.29:0/3920889889 learned_addr learned my addr 172.21.15.29:0/3920889889 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff747200640 1 --2- 172.21.15.29:0/3920889889 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d8980 0x563a0538b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff745e00640 1 --2- 172.21.15.29:0/3920889889 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a05394730 0x563a0538af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff746800640 1 -- 172.21.15.29:0/3920889889 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d8980 msgr2=0x563a0538b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff746800640 1 --2- 172.21.15.29:0/3920889889 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d8980 0x563a0538b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff746800640 1 -- 172.21.15.29:0/3920889889 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a05394730 msgr2=0x563a0538af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:31.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff746800640 1 --2- 172.21.15.29:0/3920889889 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a05394730 0x563a0538af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff746800640 1 -- 172.21.15.29:0/3920889889 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a051a22d0 con 0x563a0538cd30 2024-01-24T13:04:31.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff747200640 1 --2- 172.21.15.29:0/3920889889 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d8980 0x563a0538b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:31.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff745e00640 1 --2- 172.21.15.29:0/3920889889 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a05394730 0x563a0538af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:31.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.667+0000 7ff746800640 1 --2- 172.21.15.29:0/3920889889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a05391780 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff738054b90 tx=0x7ff73801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2150db53819bc61c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:31.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff737e00640 1 -- 172.21.15.29:0/3920889889 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738054840 con 0x563a0538cd30 2024-01-24T13:04:31.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff737e00640 1 -- 172.21.15.29:0/3920889889 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff738083040 con 0x563a0538cd30 2024-01-24T13:04:31.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff737e00640 1 -- 172.21.15.29:0/3920889889 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73805cb80 con 0x563a0538cd30 2024-01-24T13:04:31.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 -- 172.21.15.29:0/3920889889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 msgr2=0x563a05391780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:31.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 --2- 172.21.15.29:0/3920889889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a05391780 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff738054b90 tx=0x7ff73801f000 comp rx=0 tx=0).stop 2024-01-24T13:04:31.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 -- 172.21.15.29:0/3920889889 shutdown_connections 2024-01-24T13:04:31.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 --2- 172.21.15.29:0/3920889889 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d8980 0x563a0538b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 --2- 172.21.15.29:0/3920889889 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a05394730 0x563a0538af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 --2- 172.21.15.29:0/3920889889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a05391780 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 -- 172.21.15.29:0/3920889889 >> 172.21.15.29:0/3920889889 conn(0x563a05292430 msgr2=0x563a05394b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 -- 172.21.15.29:0/3920889889 shutdown_connections 2024-01-24T13:04:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 -- 172.21.15.29:0/3920889889 wait complete. 2024-01-24T13:04:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 -- start start 2024-01-24T13:04:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 Processor -- start 2024-01-24T13:04:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a05435750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a05394730 0x563a05437ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d8980 0x563a0543a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a051967a0 con 0x563a0538cd30 2024-01-24T13:04:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0517a430 con 0x563a05394730 2024-01-24T13:04:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a053d7080 con 0x563a053d8980 2024-01-24T13:04:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff75076d000 10 client.0 _ll_register_callbacks cb 0x563a0535b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-24T13:04:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff746800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a05435750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff746800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a05435750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41682/0 (socket says 172.21.15.29:41682) 2024-01-24T13:04:31.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff746800640 1 -- 172.21.15.29:0/1293380230 learned_addr learned my addr 172.21.15.29:0/1293380230 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:31.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff745e00640 1 --2- 172.21.15.29:0/1293380230 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a05394730 0x563a05437ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff747200640 1 --2- 172.21.15.29:0/1293380230 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d8980 0x563a0543a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff746800640 1 -- 172.21.15.29:0/1293380230 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d8980 msgr2=0x563a0543a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:31.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff746800640 1 --2- 172.21.15.29:0/1293380230 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d8980 0x563a0543a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff746800640 1 -- 172.21.15.29:0/1293380230 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a05394730 msgr2=0x563a05437ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:31.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff746800640 1 --2- 172.21.15.29:0/1293380230 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a05394730 0x563a05437ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff746800640 1 -- 172.21.15.29:0/1293380230 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a04ed9890 con 0x563a0538cd30 2024-01-24T13:04:31.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff746800640 1 --2- 172.21.15.29:0/1293380230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a05435750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff738054e70 tx=0x7ff73800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7ca829f2188426 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:31.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.671+0000 7ff72fe00640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-01-24T13:04:31.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff72fe00640 1 -- 172.21.15.29:0/1293380230 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738053340 con 0x563a0538cd30 2024-01-24T13:04:31.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff72fe00640 1 -- 172.21.15.29:0/1293380230 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff738055e40 con 0x563a0538cd30 2024-01-24T13:04:31.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 -- 172.21.15.29:0/1293380230 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a05196a00 con 0x563a0538cd30 2024-01-24T13:04:31.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff72fe00640 1 -- 172.21.15.29:0/1293380230 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff73805ce10 con 0x563a0538cd30 2024-01-24T13:04:31.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 10 client.4818 fetch_fsmap learned FSMap version 9 2024-01-24T13:04:31.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 -- 172.21.15.29:0/1293380230 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x563a05188420 con 0x563a0538cd30 2024-01-24T13:04:31.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff72fe00640 1 -- 172.21.15.29:0/1293380230 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff738066020 con 0x563a0538cd30 2024-01-24T13:04:31.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff72fe00640 1 -- 172.21.15.29:0/1293380230 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7ff738053e40 con 0x563a0538cd30 2024-01-24T13:04:31.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 10 client.4818 fetch_fsmap finished waiting for FSMap version 9 2024-01-24T13:04:31.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 10 client.4818 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-24T13:04:31.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 20 client.4818 populate_metadata read hostname 'smithi029' 2024-01-24T13:04:31.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 --2- 172.21.15.29:0/1293380230 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x563a053d92a0 0x563a0543c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:31.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 4 client.4818 mds_command: new command op to 4284 tid=0[{"prefix": "status"}] 2024-01-24T13:04:31.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 -- 172.21.15.29:0/1293380230 --> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563a051d6290 con 0x563a053d92a0 2024-01-24T13:04:31.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff745e00640 1 --2- 172.21.15.29:0/1293380230 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x563a053d92a0 0x563a0543c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:31.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff745e00640 1 --2- 172.21.15.29:0/1293380230 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x563a053d92a0 0x563a0543c740 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=450673ba4116ef2a server_cookie=eccdde81cc625af8 in_seq=0 out_seq=0 2024-01-24T13:04:31.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff72fe00640 10 client.4818 ms_handle_connect on v2:172.21.15.163:6835/1191601563 2024-01-24T13:04:31.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff72fe00640 1 -- 172.21.15.29:0/1293380230 <== mds.0 v2:172.21.15.163:6835/1191601563 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x563a051d6290 con 0x563a053d92a0 2024-01-24T13:04:31.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff72fe00640 10 client.4818 handle_command_reply: tid=0 2024-01-24T13:04:31.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 client.4818 shutdown 2024-01-24T13:04:31.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 -- 172.21.15.29:0/1293380230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 msgr2=0x563a05435750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:31.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 --2- 172.21.15.29:0/1293380230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a05435750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff738054e70 tx=0x7ff73800b460 comp rx=0 tx=0).stop 2024-01-24T13:04:31.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 -- 172.21.15.29:0/1293380230 shutdown_connections 2024-01-24T13:04:31.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 --2- 172.21.15.29:0/1293380230 >> [v2:172.21.15.163:6835/1191601563,v1:172.21.15.163:6837/1191601563] conn(0x563a053d92a0 0x563a0543c740 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 --2- 172.21.15.29:0/1293380230 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x563a053d8980 0x563a0543a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 --2- 172.21.15.29:0/1293380230 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563a05394730 0x563a05437ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 --2- 172.21.15.29:0/1293380230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563a0538cd30 0x563a05435750 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff72fe00640 0 client.4818 ms_handle_reset on v2:172.21.15.163:6835/1191601563 2024-01-24T13:04:31.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 -- 172.21.15.29:0/1293380230 >> 172.21.15.29:0/1293380230 conn(0x563a05292430 msgr2=0x563a053953a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:31.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 -- 172.21.15.29:0/1293380230 shutdown_connections 2024-01-24T13:04:31.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 1 -- 172.21.15.29:0/1293380230 wait complete. 2024-01-24T13:04:31.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff75076d000 20 client.4818 trim_cache size 0 max 16384 2024-01-24T13:04:31.684 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:04:31.685 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "065451ff-9152-4ec9-a888-63a66559ccfb", 2024-01-24T13:04:31.685 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-01-24T13:04:31.685 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4284, 2024-01-24T13:04:31.685 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-01-24T13:04:31.685 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-01-24T13:04:31.685 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-01-24T13:04:31.685 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 35.694338322, 2024-01-24T13:04:31.686 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 9, 2024-01-24T13:04:31.686 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 28, 2024-01-24T13:04:31.686 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 28, 2024-01-24T13:04:31.686 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 42.794282207999998 2024-01-24T13:04:31.686 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:04:31.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff74d400640 1 -- 172.21.15.29:0/4201546777 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff720065a60 msgr2=0x7ff720067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:31.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff74d400640 1 --2- 172.21.15.29:0/4201546777 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff720065a60 0x7ff720067f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff748165450 tx=0x7ff730008040 comp rx=0 tx=0).stop 2024-01-24T13:04:31.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff74d400640 1 -- 172.21.15.29:0/4201546777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7480cd160 msgr2=0x7ff74806c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:31.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.675+0000 7ff74d400640 1 --2- 172.21.15.29:0/4201546777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7480cd160 0x7ff74806c630 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff73800d800 tx=0x7ff73800dcc0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.679+0000 7ff74d400640 1 -- 172.21.15.29:0/4201546777 shutdown_connections 2024-01-24T13:04:31.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.679+0000 7ff74d400640 1 --2- 172.21.15.29:0/4201546777 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff720065a60 0x7ff720067f20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.679+0000 7ff74d400640 1 --2- 172.21.15.29:0/4201546777 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff748154250 0x7ff7481595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.679+0000 7ff74d400640 1 --2- 172.21.15.29:0/4201546777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff74815e0f0 0x7ff7480c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.679+0000 7ff74d400640 1 --2- 172.21.15.29:0/4201546777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7480cd160 0x7ff74806c630 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:31.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.679+0000 7ff74d400640 1 -- 172.21.15.29:0/4201546777 >> 172.21.15.29:0/4201546777 conn(0x7ff748069cd0 msgr2=0x7ff7480b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:31.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.679+0000 7ff74d400640 1 -- 172.21.15.29:0/4201546777 shutdown_connections 2024-01-24T13:04:31.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:31.679+0000 7ff74d400640 1 -- 172.21.15.29:0/4201546777 wait complete. 2024-01-24T13:04:31.701 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-01-24T13:04:31.715 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-01-24T13:04:31.715 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-01-24T13:04:31.715 INFO:tasks.ceph_fuse:client.0 config is {} 2024-01-24T13:04:31.715 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-24T13:04:31.715 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-24T13:04:31.715 INFO:tasks.ceph_fuse:client.2 config is {} 2024-01-24T13:04:31.715 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-24T13:04:31.715 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-01-24T13:04:31.716 INFO:tasks.ceph_fuse:client.1 config is {} 2024-01-24T13:04:31.716 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-24T13:04:31.716 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-24T13:04:31.716 INFO:tasks.ceph_fuse:client.3 config is {} 2024-01-24T13:04:31.716 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-24T13:04:31.716 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-01-24T13:04:31.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:31.716 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2024-01-24T13:04:31.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:31.727 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2024-01-24T13:04:31.793 INFO:teuthology.orchestra.run.smithi163.stderr:Cannot find device "ceph-brx" 2024-01-24T13:04:31.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:04:31.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:31.796 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-24T13:04:31.805 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-01-24T13:04:31.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:31.806 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-24T13:04:31.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:31.869 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-01-24T13:04:32.062 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-01-24T13:04:32.063 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-24T13:04:32.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.199+0000 7fbd39000640 1 Processor -- start 2024-01-24T13:04:32.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.199+0000 7fbd39000640 1 -- start start 2024-01-24T13:04:32.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.203+0000 7fbd39000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbd340b1f50 0x7fbd340ac460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:32.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.203+0000 7fbd39000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd34070230 con 0x7fbd3415c450 2024-01-24T13:04:32.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.203+0000 7fbd39000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd34070510 con 0x7fbd340ce5e0 2024-01-24T13:04:32.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.203+0000 7fbd39000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd340712d0 con 0x7fbd340b1f50 2024-01-24T13:04:32.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.203+0000 7fbd32800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbd340b1f50 0x7fbd340ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:32.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.203+0000 7fbd32800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbd340b1f50 0x7fbd340ac460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41684/0 (socket says 172.21.15.29:41684) 2024-01-24T13:04:32.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.203+0000 7fbd32800640 1 -- 172.21.15.29:0/2723419833 learned_addr learned my addr 172.21.15.29:0/2723419833 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:32.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.203+0000 7fbd32800640 1 -- 172.21.15.29:0/2723419833 >> v1:172.21.15.163:6789/0 conn(0x7fbd340ce5e0 legacy=0x7fbd340abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:32.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.203+0000 7fbd32800640 1 -- 172.21.15.29:0/2723419833 >> v1:172.21.15.29:6789/0 conn(0x7fbd3415c450 legacy=0x7fbd340cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:32.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.203+0000 7fbd32800640 1 -- 172.21.15.29:0/2723419833 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd340707f0 con 0x7fbd340b1f50 2024-01-24T13:04:32.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd32800640 1 --2- 172.21.15.29:0/2723419833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd340b1f50 0x7fbd340ac460 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009e50 tx=0x7fbd2c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b117483c1d3572 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:32.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd30a00640 1 -- 172.21.15.29:0/2723419833 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0a5840 con 0x7fbd340b1f50 2024-01-24T13:04:32.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd30a00640 1 -- 172.21.15.29:0/2723419833 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c0a59a0 con 0x7fbd340b1f50 2024-01-24T13:04:32.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd30a00640 1 -- 172.21.15.29:0/2723419833 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0a5d30 con 0x7fbd340b1f50 2024-01-24T13:04:32.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 -- 172.21.15.29:0/2723419833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd340b1f50 msgr2=0x7fbd340ac460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:32.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 --2- 172.21.15.29:0/2723419833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd340b1f50 0x7fbd340ac460 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009e50 tx=0x7fbd2c01c980 comp rx=0 tx=0).stop 2024-01-24T13:04:32.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 -- 172.21.15.29:0/2723419833 shutdown_connections 2024-01-24T13:04:32.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 --2- 172.21.15.29:0/2723419833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd340b1f50 0x7fbd340ac460 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:32.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 -- 172.21.15.29:0/2723419833 >> 172.21.15.29:0/2723419833 conn(0x7fbd340b3950 msgr2=0x7fbd34069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:32.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 -- 172.21.15.29:0/2723419833 shutdown_connections 2024-01-24T13:04:32.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 -- 172.21.15.29:0/2723419833 wait complete. 2024-01-24T13:04:32.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 Processor -- start 2024-01-24T13:04:32.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 -- start start 2024-01-24T13:04:32.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd340b1f50 0x7fbd34149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:32.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd340ce5e0 0x7fbd34156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:32.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd3415c450 0x7fbd34148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:32.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3414cee0 con 0x7fbd340b1f50 2024-01-24T13:04:32.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3414d1c0 con 0x7fbd340ce5e0 2024-01-24T13:04:32.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.207+0000 7fbd39000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3414d4a0 con 0x7fbd3415c450 2024-01-24T13:04:32.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd31e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd340b1f50 0x7fbd34149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:32.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd31e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd340b1f50 0x7fbd34149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41686/0 (socket says 172.21.15.29:41686) 2024-01-24T13:04:32.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd31e00640 1 -- 172.21.15.29:0/3930443473 learned_addr learned my addr 172.21.15.29:0/3930443473 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:32.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd32800640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd3415c450 0x7fbd34148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:32.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd31e00640 1 -- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd3415c450 msgr2=0x7fbd34148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:32.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd31e00640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd3415c450 0x7fbd34148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:32.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd31400640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd340ce5e0 0x7fbd34156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:32.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd31e00640 1 -- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd340ce5e0 msgr2=0x7fbd34156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:32.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd31e00640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd340ce5e0 0x7fbd34156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:32.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd31e00640 1 -- 172.21.15.29:0/3930443473 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c009b30 con 0x7fbd340b1f50 2024-01-24T13:04:32.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd32800640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd3415c450 0x7fbd34148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:32.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd31400640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd340ce5e0 0x7fbd34156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:32.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd31e00640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd340b1f50 0x7fbd34149730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400c3c0 tx=0x7fbd2400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:32.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd2a000640 1 -- 172.21.15.29:0/3930443473 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd240052d0 con 0x7fbd340b1f50 2024-01-24T13:04:32.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd2a000640 1 -- 172.21.15.29:0/3930443473 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd24005430 con 0x7fbd340b1f50 2024-01-24T13:04:32.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd39000640 1 -- 172.21.15.29:0/3930443473 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3414d780 con 0x7fbd340b1f50 2024-01-24T13:04:32.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd2a000640 1 -- 172.21.15.29:0/3930443473 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24003840 con 0x7fbd340b1f50 2024-01-24T13:04:32.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd39000640 1 -- 172.21.15.29:0/3930443473 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd34148fc0 con 0x7fbd340b1f50 2024-01-24T13:04:32.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd39000640 1 -- 172.21.15.29:0/3930443473 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd340ac920 con 0x7fbd340b1f50 2024-01-24T13:04:32.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.211+0000 7fbd2a000640 1 -- 172.21.15.29:0/3930443473 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbd240039a0 con 0x7fbd340b1f50 2024-01-24T13:04:32.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.215+0000 7fbd2a000640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd0c065a60 0x7fbd0c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:32.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.215+0000 7fbd2a000640 1 -- 172.21.15.29:0/3930443473 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd240829c0 con 0x7fbd340b1f50 2024-01-24T13:04:32.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.215+0000 7fbd31400640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd0c065a60 0x7fbd0c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:32.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.215+0000 7fbd31400640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd0c065a60 0x7fbd0c067f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbd34071c70 tx=0x7fbd1c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:32.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.219+0000 7fbd2a000640 1 -- 172.21.15.29:0/3930443473 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fbd24050090 con 0x7fbd340b1f50 2024-01-24T13:04:32.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.411+0000 7fbd39000640 1 -- 172.21.15.29:0/3930443473 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbd3404e850 con 0x7fbd340b1f50 2024-01-24T13:04:32.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.411+0000 7fbd2a000640 1 -- 172.21.15.29:0/3930443473 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbd24017070 con 0x7fbd340b1f50 2024-01-24T13:04:32.413 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-24T13:04:32.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.411+0000 7fbd39000640 1 -- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd0c065a60 msgr2=0x7fbd0c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:32.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.411+0000 7fbd39000640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd0c065a60 0x7fbd0c067f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbd34071c70 tx=0x7fbd1c009040 comp rx=0 tx=0).stop 2024-01-24T13:04:32.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.411+0000 7fbd39000640 1 -- 172.21.15.29:0/3930443473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd340b1f50 msgr2=0x7fbd34149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:32.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.411+0000 7fbd39000640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd340b1f50 0x7fbd34149730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400c3c0 tx=0x7fbd2400c880 comp rx=0 tx=0).stop 2024-01-24T13:04:32.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.411+0000 7fbd39000640 1 -- 172.21.15.29:0/3930443473 shutdown_connections 2024-01-24T13:04:32.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.411+0000 7fbd39000640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd0c065a60 0x7fbd0c067f20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:32.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.411+0000 7fbd39000640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd3415c450 0x7fbd34148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:32.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.411+0000 7fbd39000640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd340ce5e0 0x7fbd34156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:32.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.411+0000 7fbd39000640 1 --2- 172.21.15.29:0/3930443473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd340b1f50 0x7fbd34149730 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:32.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.411+0000 7fbd39000640 1 -- 172.21.15.29:0/3930443473 >> 172.21.15.29:0/3930443473 conn(0x7fbd340b3950 msgr2=0x7fbd3415aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:32.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.411+0000 7fbd39000640 1 -- 172.21.15.29:0/3930443473 shutdown_connections 2024-01-24T13:04:32.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:32.411+0000 7fbd39000640 1 -- 172.21.15.29:0/3930443473 wait complete. 2024-01-24T13:04:32.435 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-24T13:04:32.435 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-24T13:04:32.435 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-01-24T13:04:32.435 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-24T13:04:32.435 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-24T13:04:32.435 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-24T13:04:32.435 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-24T13:04:32.436 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-24T13:04:32.436 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:04:32.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:32.436 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-01-24T13:04:32.446 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:04:32.446 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:04:32.446 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:04:32.446 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:32.446 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-24T13:04:32.446 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:32.446 INFO:teuthology.orchestra.run.smithi029.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-24T13:04:32.446 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:32.446 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-01-24T13:04:32.446 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42426sec preferred_lft 42426sec 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:b4:3c:c7:07 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-24T13:04:32.447 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:32.448 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-24T13:04:32.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:32.448 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:04:32.448 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:04:32.448 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2024-01-24T13:04:32.448 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2024-01-24T13:04:32.448 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2024-01-24T13:04:32.448 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-24T13:04:32.448 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:04:32.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:32.560 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-24T13:04:32.579 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-01-24T13:04:32.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:32.581 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-01-24T13:04:32.638 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-01-24T13:04:32.638 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-24T13:04:32.638 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-24T13:04:32.638 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-24T13:04:32.638 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-24T13:04:32.638 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-24T13:04:32.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:32.639 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:04:32.639 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:04:32.639 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-24T13:04:32.639 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-24T13:04:32.639 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-24T13:04:32.639 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:04:32.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:32.734 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-24T13:04:32.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:32.744 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-01-24T13:04:32.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:32.792 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:04:32.793 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:04:32.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-24T13:04:32.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-24T13:04:32.793 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:04:32.875 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-24T13:04:32.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:32.875 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:04:32.875 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:04:32.875 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-24T13:04:32.875 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-24T13:04:32.875 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-24T13:04:32.875 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-24T13:04:32.875 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-24T13:04:32.876 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:04:33.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:33.014 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:04:33.014 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:04:33.014 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-01-24T13:04:33.014 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2024-01-24T13:04:33.014 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:04:33.053 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-24T13:04:33.053 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:04:33.053 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-24T13:04:33.104 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:04:33.105 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:04:33.105 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-24T13:04:33.155 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:04:33.217 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:04:33.217 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:04:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:04:33.280 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:04:33.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:33.280 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:04:33.332 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-24T13:04:33.333 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-24T13:04:33.378 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:04:33.400 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:04:33.400 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:04:33.462 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:04:33.464 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:04:33.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:33.465 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:04:33.476 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2024-01-24T13:04:33.471+0000 7feaef401580 -1 init, newargv = 0x560a54e44ed0 newargc=15 2024-01-24T13:04:33.476 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[33722]: starting ceph client 2024-01-24T13:04:33.484 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[33722]: starting fuse 2024-01-24T13:04:34.586 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:04:34.610 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:04:34.610 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:04:34.672 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:04:34.673 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:04:34.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:34.674 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:04:34.729 INFO:teuthology.orchestra.run.smithi029.stdout:43 2024-01-24T13:04:34.729 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-24T13:04:34.729 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-24T13:04:34.729 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-01-24T13:04:34.729 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-01-24T13:04:34.729 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-01-24T13:04:34.729 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-01-24T13:04:34.729 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:04:34.730 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-01-24T13:04:34.730 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-24T13:04:34.730 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-01-24T13:04:34.730 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-24T13:04:34.730 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:04:34.730 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-01-24T13:04:34.730 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-01-24T13:04:34.730 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-01-24T13:04:34.730 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-01-24T13:04:34.730 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:04:34.730 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-01-24T13:04:34.730 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-24T13:04:34.730 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-24T13:04:34.731 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-24T13:04:34.731 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-01-24T13:04:34.731 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-01-24T13:04:34.731 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-01-24T13:04:34.731 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-24T13:04:34.731 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:04:34.731 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2024-01-24T13:04:34.731 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-01-24T13:04:34.861 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.33722.asok 2024-01-24T13:04:35.044 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33722.asok 2024-01-24T13:04:35.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:35.045 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33722.asok status 2024-01-24T13:04:35.229 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:04:35.230 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-01-24T13:04:35.230 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "4e3182a65800aed6d4aa2f6b86da3cfd72188134", 2024-01-24T13:04:35.230 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable)", 2024-01-24T13:04:35.230 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2024-01-24T13:04:35.230 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-01-24T13:04:35.230 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-24T13:04:35.230 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "33722", 2024-01-24T13:04:35.230 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-01-24T13:04:35.230 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:04:35.230 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-01-24T13:04:35.230 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-01-24T13:04:35.231 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4836, 2024-01-24T13:04:35.231 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-01-24T13:04:35.231 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-01-24T13:04:35.231 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-01-24T13:04:35.231 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 4836 2024-01-24T13:04:35.231 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:04:35.231 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:04:35.231 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:04:35.231 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:04:35.231 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3709053839 2024-01-24T13:04:35.231 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:04:35.231 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:04:35.231 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:04:35.231 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:04:35.232 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:04:35.232 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3709053839 2024-01-24T13:04:35.232 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:04:35.232 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.4836 192.168.0.1:0/3709053839", 2024-01-24T13:04:35.232 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/3709053839", 2024-01-24T13:04:35.232 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-01-24T13:04:35.232 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 9, 2024-01-24T13:04:35.232 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 28, 2024-01-24T13:04:35.232 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-01-24T13:04:35.232 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-01-24T13:04:35.232 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-01-24T13:04:35.232 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:04:35.246 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-24T13:04:35.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.383+0000 7fbb2aa00640 1 Processor -- start 2024-01-24T13:04:35.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.383+0000 7fbb2aa00640 1 -- start start 2024-01-24T13:04:35.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb2aa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb240c3ef0 0x7fbb240ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:35.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb2aa00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbb240caf30 0x7fbb240d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:35.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb2aa00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb240cfe50 con 0x7fbb2415a630 2024-01-24T13:04:35.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb2aa00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb240cf380 con 0x7fbb240caf30 2024-01-24T13:04:35.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb2aa00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240cb3c0 con 0x7fbb240c3ef0 2024-01-24T13:04:35.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb23e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbb2415a630 0x7fbb240cdf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43398/0 (socket says 172.21.15.29:43398) 2024-01-24T13:04:35.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb23e00640 1 -- 172.21.15.29:0/2822876187 learned_addr learned my addr 172.21.15.29:0/2822876187 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:35.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb28a00640 1 --2- 172.21.15.29:0/2822876187 >> v2:172.21.15.163:3300/0 conn(0x7fbb240caf30 0x7fbb240d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:35.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb23400640 1 --2- 172.21.15.29:0/2822876187 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb240c3ef0 0x7fbb240ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:35.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 -- 172.21.15.29:0/2822876187 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078873060 0 0) 0x7fbb240cfe50 con 0x7fbb2415a630 2024-01-24T13:04:35.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 -- 172.21.15.29:0/2822876187 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb04003530 con 0x7fbb2415a630 2024-01-24T13:04:35.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 -- 172.21.15.29:0/2822876187 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2797387232 0 0) 0x7fbb04003530 con 0x7fbb2415a630 2024-01-24T13:04:35.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 -- 172.21.15.29:0/2822876187 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb240c3ef0 msgr2=0x7fbb240ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:35.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 --2- 172.21.15.29:0/2822876187 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb240c3ef0 0x7fbb240ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:35.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 -- 172.21.15.29:0/2822876187 >> v2:172.21.15.163:3300/0 conn(0x7fbb240caf30 msgr2=0x7fbb240d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:35.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 --2- 172.21.15.29:0/2822876187 >> v2:172.21.15.163:3300/0 conn(0x7fbb240caf30 0x7fbb240d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:35.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 -- 172.21.15.29:0/2822876187 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2415aa10 con 0x7fbb2415a630 2024-01-24T13:04:35.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 -- 172.21.15.29:0/2822876187 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7fbb14001680 con 0x7fbb2415a630 2024-01-24T13:04:35.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb23400640 1 --2- 172.21.15.29:0/2822876187 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb240c3ef0 0x7fbb240ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:35.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 -- 172.21.15.29:0/2822876187 >> v1:172.21.15.29:6789/0 conn(0x7fbb2415a630 legacy=0x7fbb240cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 --2- 172.21.15.29:0/2822876187 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb04003980 0x7fbb04003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 --2- 172.21.15.29:0/2822876187 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb04004370 0x7fbb04004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 --2- 172.21.15.29:0/2822876187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb04004ec0 0x7fbb0400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 -- 172.21.15.29:0/2822876187 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240cf380 con 0x7fbb04004ec0 2024-01-24T13:04:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 -- 172.21.15.29:0/2822876187 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240cb3c0 con 0x7fbb04004370 2024-01-24T13:04:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb22a00640 1 -- 172.21.15.29:0/2822876187 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0400bed0 con 0x7fbb04003980 2024-01-24T13:04:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb28a00640 1 --2- 172.21.15.29:0/2822876187 >> v2:172.21.15.163:3300/0 conn(0x7fbb240caf30 0x7fbb240d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb23400640 1 --2- 172.21.15.29:0/2822876187 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb04004370 0x7fbb04004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb28a00640 1 --2- 172.21.15.29:0/2822876187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb04004ec0 0x7fbb0400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb23e00640 1 --2- 172.21.15.29:0/2822876187 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb04003980 0x7fbb04003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb23400640 1 -- 172.21.15.29:0/2822876187 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb04003980 msgr2=0x7fbb04003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb23400640 1 --2- 172.21.15.29:0/2822876187 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb04003980 0x7fbb04003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb23400640 1 -- 172.21.15.29:0/2822876187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb04004ec0 msgr2=0x7fbb0400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:35.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb23400640 1 --2- 172.21.15.29:0/2822876187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb04004ec0 0x7fbb0400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:35.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.387+0000 7fbb23400640 1 -- 172.21.15.29:0/2822876187 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb04003530 con 0x7fbb04004370 2024-01-24T13:04:35.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.391+0000 7fbb23400640 1 --2- 172.21.15.29:0/2822876187 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb04004370 0x7fbb04004850 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb240c3e80 tx=0x7fbb0c01cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e4bbf3364bdf64c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:35.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.391+0000 7fbb22a00640 1 -- 172.21.15.29:0/2822876187 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c004030 con 0x7fbb04004370 2024-01-24T13:04:35.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.391+0000 7fbb22a00640 1 -- 172.21.15.29:0/2822876187 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c004190 con 0x7fbb04004370 2024-01-24T13:04:35.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.391+0000 7fbb22a00640 1 -- 172.21.15.29:0/2822876187 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c004500 con 0x7fbb04004370 2024-01-24T13:04:35.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.391+0000 7fbb2aa00640 1 -- 172.21.15.29:0/2822876187 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb04004370 msgr2=0x7fbb04004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:35.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.391+0000 7fbb2aa00640 1 --2- 172.21.15.29:0/2822876187 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb04004370 0x7fbb04004850 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb240c3e80 tx=0x7fbb0c01cad0 comp rx=0 tx=0).stop 2024-01-24T13:04:35.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.391+0000 7fbb28a00640 1 -- 172.21.15.29:0/2822876187 reap_dead start 2024-01-24T13:04:35.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.391+0000 7fbb2aa00640 1 -- 172.21.15.29:0/2822876187 shutdown_connections 2024-01-24T13:04:35.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.391+0000 7fbb2aa00640 1 -- 172.21.15.29:0/2822876187 >> 172.21.15.29:0/2822876187 conn(0x7fbb24070570 msgr2=0x7fbb24069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:35.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.391+0000 7fbb2aa00640 1 -- 172.21.15.29:0/2822876187 shutdown_connections 2024-01-24T13:04:35.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.391+0000 7fbb2aa00640 1 -- 172.21.15.29:0/2822876187 wait complete. 2024-01-24T13:04:35.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb2aa00640 1 Processor -- start 2024-01-24T13:04:35.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb2aa00640 1 -- start start 2024-01-24T13:04:35.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb2aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb04004370 0x7fbb240aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:35.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb2aa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb2415cfe0 0x7fbb240c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:35.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb2aa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb240c7cd0 0x7fbb240c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:35.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb2aa00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2406ce80 con 0x7fbb04004370 2024-01-24T13:04:35.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb2aa00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2415c5f0 con 0x7fbb2415cfe0 2024-01-24T13:04:35.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb2aa00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240af3e0 con 0x7fbb240c7cd0 2024-01-24T13:04:35.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb23e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb04004370 0x7fbb240aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:35.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb23e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb04004370 0x7fbb240aeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41696/0 (socket says 172.21.15.29:41696) 2024-01-24T13:04:35.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb23e00640 1 -- 172.21.15.29:0/1812794868 learned_addr learned my addr 172.21.15.29:0/1812794868 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:35.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb23400640 1 --2- 172.21.15.29:0/1812794868 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb2415cfe0 0x7fbb240c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:35.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb28a00640 1 --2- 172.21.15.29:0/1812794868 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb240c7cd0 0x7fbb240c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:35.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb23e00640 1 -- 172.21.15.29:0/1812794868 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb240c7cd0 msgr2=0x7fbb240c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:35.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb23e00640 1 --2- 172.21.15.29:0/1812794868 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb240c7cd0 0x7fbb240c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:35.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb23e00640 1 -- 172.21.15.29:0/1812794868 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb2415cfe0 msgr2=0x7fbb240c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:35.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb23e00640 1 --2- 172.21.15.29:0/1812794868 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb2415cfe0 0x7fbb240c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:35.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb23e00640 1 -- 172.21.15.29:0/1812794868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2406c8c0 con 0x7fbb04004370 2024-01-24T13:04:35.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb23e00640 1 --2- 172.21.15.29:0/1812794868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb04004370 0x7fbb240aeea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbb14007310 tx=0x7fbb140077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:35.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb1be00640 1 -- 172.21.15.29:0/1812794868 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1400f960 con 0x7fbb04004370 2024-01-24T13:04:35.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb1be00640 1 -- 172.21.15.29:0/1812794868 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1400fae0 con 0x7fbb04004370 2024-01-24T13:04:35.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb1be00640 1 -- 172.21.15.29:0/1812794868 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1400fe90 con 0x7fbb04004370 2024-01-24T13:04:35.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb2aa00640 1 -- 172.21.15.29:0/1812794868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2406cba0 con 0x7fbb04004370 2024-01-24T13:04:35.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.395+0000 7fbb2aa00640 1 -- 172.21.15.29:0/1812794868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2415cac0 con 0x7fbb04004370 2024-01-24T13:04:35.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.399+0000 7fbb2aa00640 1 -- 172.21.15.29:0/1812794868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb24073770 con 0x7fbb04004370 2024-01-24T13:04:35.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.399+0000 7fbb1be00640 1 -- 172.21.15.29:0/1812794868 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbb1401d460 con 0x7fbb04004370 2024-01-24T13:04:35.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.399+0000 7fbb1be00640 1 --2- 172.21.15.29:0/1812794868 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbafc065a90 0x7fbafc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:35.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.399+0000 7fbb1be00640 1 -- 172.21.15.29:0/1812794868 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbb140835d0 con 0x7fbb04004370 2024-01-24T13:04:35.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.399+0000 7fbb23400640 1 --2- 172.21.15.29:0/1812794868 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbafc065a90 0x7fbafc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:35.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.403+0000 7fbb23400640 1 --2- 172.21.15.29:0/1812794868 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbafc065a90 0x7fbafc067f50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0ae000 tx=0x7fbb0c0046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:35.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.403+0000 7fbb1be00640 1 -- 172.21.15.29:0/1812794868 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fbb24073770 con 0x7fbb04004370 2024-01-24T13:04:35.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.595+0000 7fbb2aa00640 1 -- 172.21.15.29:0/1812794868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbb24073770 con 0x7fbb04004370 2024-01-24T13:04:35.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.595+0000 7fbb1be00640 1 -- 172.21.15.29:0/1812794868 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbb24073770 con 0x7fbb04004370 2024-01-24T13:04:35.600 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-24T13:04:35.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.599+0000 7fbb2aa00640 1 -- 172.21.15.29:0/1812794868 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbafc065a90 msgr2=0x7fbafc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:35.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.599+0000 7fbb2aa00640 1 --2- 172.21.15.29:0/1812794868 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbafc065a90 0x7fbafc067f50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0ae000 tx=0x7fbb0c0046d0 comp rx=0 tx=0).stop 2024-01-24T13:04:35.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.599+0000 7fbb2aa00640 1 -- 172.21.15.29:0/1812794868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb04004370 msgr2=0x7fbb240aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:35.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.599+0000 7fbb2aa00640 1 --2- 172.21.15.29:0/1812794868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb04004370 0x7fbb240aeea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbb14007310 tx=0x7fbb140077d0 comp rx=0 tx=0).stop 2024-01-24T13:04:35.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.599+0000 7fbb2aa00640 1 -- 172.21.15.29:0/1812794868 shutdown_connections 2024-01-24T13:04:35.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.599+0000 7fbb2aa00640 1 --2- 172.21.15.29:0/1812794868 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbafc065a90 0x7fbafc067f50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:35.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.599+0000 7fbb2aa00640 1 --2- 172.21.15.29:0/1812794868 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb240c7cd0 0x7fbb240c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:35.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.599+0000 7fbb2aa00640 1 --2- 172.21.15.29:0/1812794868 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb2415cfe0 0x7fbb240c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:35.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.599+0000 7fbb2aa00640 1 --2- 172.21.15.29:0/1812794868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb04004370 0x7fbb240aeea0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:35.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.599+0000 7fbb2aa00640 1 -- 172.21.15.29:0/1812794868 >> 172.21.15.29:0/1812794868 conn(0x7fbb24070570 msgr2=0x7fbb240afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:35.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.599+0000 7fbb2aa00640 1 -- 172.21.15.29:0/1812794868 shutdown_connections 2024-01-24T13:04:35.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:35.599+0000 7fbb2aa00640 1 -- 172.21.15.29:0/1812794868 wait complete. 2024-01-24T13:04:35.622 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-24T13:04:35.622 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-24T13:04:35.622 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-01-24T13:04:35.623 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-01-24T13:04:35.623 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-01-24T13:04:35.623 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-24T13:04:35.623 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-24T13:04:35.623 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-24T13:04:35.623 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-01-24T13:04:35.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:35.623 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-01-24T13:04:35.633 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:04:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:04:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:04:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-24T13:04:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:35.634 INFO:teuthology.orchestra.run.smithi029.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-24T13:04:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-01-24T13:04:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-24T13:04:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42423sec preferred_lft 42423sec 2024-01-24T13:04:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-01-24T13:04:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:35.634 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-01-24T13:04:35.635 INFO:teuthology.orchestra.run.smithi029.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-01-24T13:04:35.635 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-01-24T13:04:35.635 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-24T13:04:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:b4:3c:c7:07 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-24T13:04:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:35.635 INFO:teuthology.orchestra.run.smithi029.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-24T13:04:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-24T13:04:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-24T13:04:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:35.636 INFO:teuthology.orchestra.run.smithi029.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T13:04:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-24T13:04:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-24T13:04:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:35.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:35.637 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-24T13:04:35.698 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-01-24T13:04:35.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:35.700 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-01-24T13:04:35.753 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-01-24T13:04:35.753 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-24T13:04:35.753 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-24T13:04:35.753 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-24T13:04:35.753 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-24T13:04:35.753 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-24T13:04:35.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:35.754 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:04:35.754 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:04:35.754 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-24T13:04:35.754 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-24T13:04:35.754 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-24T13:04:35.754 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:04:35.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:35.845 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-24T13:04:35.853 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-24T13:04:35.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:35.855 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-01-24T13:04:35.904 INFO:teuthology.orchestra.run.smithi029.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-01-24T13:04:35.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:35.905 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:04:35.905 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:04:35.905 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-24T13:04:35.905 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-01-24T13:04:35.905 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:04:35.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:35.987 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-24T13:04:36.049 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:04:36.049 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:04:36.049 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:04:36.049 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:36.049 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-24T13:04:36.049 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:36.049 INFO:teuthology.orchestra.run.smithi029.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-24T13:04:36.049 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether ca:b0:b3:04:9b:c2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-24T13:04:36.049 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-24T13:04:36.049 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:36.049 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c8b0:b3ff:fe04:9bc2/64 scope link 2024-01-24T13:04:36.049 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:36.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:36.051 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-24T13:04:36.116 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:04:36.116 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:04:36.116 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:04:36.117 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:36.117 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-24T13:04:36.117 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:36.117 INFO:teuthology.orchestra.run.smithi029.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-24T13:04:36.117 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether ca:b0:b3:04:9b:c2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-24T13:04:36.117 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-24T13:04:36.117 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:36.117 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c8b0:b3ff:fe04:9bc2/64 scope link 2024-01-24T13:04:36.117 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:36.118 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-01-24T13:04:36.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:36.119 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:04:36.119 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:04:36.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-01-24T13:04:36.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-24T13:04:36.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-01-24T13:04:36.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-01-24T13:04:36.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-01-24T13:04:36.119 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:04:36.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:36.257 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:04:36.257 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:04:36.257 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.1 up 2024-01-24T13:04:36.257 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.1 master ceph-brx 2024-01-24T13:04:36.257 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:04:36.295 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-01-24T13:04:36.295 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:04:36.295 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-01-24T13:04:36.348 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-01-24T13:04:36.349 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:04:36.349 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-01-24T13:04:36.399 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:04:36.460 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:04:36.460 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:04:36.522 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:04:36.523 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:04:36.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:36.524 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:04:36.576 INFO:teuthology.orchestra.run.smithi029.stdout:43 2024-01-24T13:04:36.577 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-01-24T13:04:36.577 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-01-24T13:04:36.623 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:04:36.644 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:04:36.644 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:04:36.702 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:04:36.704 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:04:36.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:36.705 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:04:36.719 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi029.stderr:2024-01-24T13:04:36.715+0000 7f18ad2ba580 -1 init, newargv = 0x563ac1d764c0 newargc=15 2024-01-24T13:04:36.719 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi029.stderr:ceph-fuse[33861]: starting ceph client 2024-01-24T13:04:36.727 INFO:teuthology.orchestra.run.smithi029.stdout:43 2024-01-24T13:04:36.727 INFO:teuthology.orchestra.run.smithi029.stdout:44 2024-01-24T13:04:36.728 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi029.stderr:ceph-fuse[33861]: starting fuse 2024-01-24T13:04:36.728 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-01-24T13:04:36.728 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-24T13:04:36.729 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-01-24T13:04:36.729 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-01-24T13:04:36.729 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-01-24T13:04:36.729 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-01-24T13:04:36.729 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:04:36.729 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-01-24T13:04:36.729 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-01-24T13:04:36.729 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-01-24T13:04:36.729 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-01-24T13:04:36.729 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:04:36.729 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-01-24T13:04:36.729 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-01-24T13:04:36.729 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-01-24T13:04:36.729 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-01-24T13:04:36.730 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:04:36.730 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-01-24T13:04:36.730 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-24T13:04:36.730 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-24T13:04:36.730 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-24T13:04:36.730 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-01-24T13:04:36.730 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-01-24T13:04:36.730 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-01-24T13:04:36.730 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-24T13:04:36.730 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:04:36.730 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.2")) 2024-01-24T13:04:36.730 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-01-24T13:04:36.853 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.2.33861.asok 2024-01-24T13:04:37.038 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.33861.asok 2024-01-24T13:04:37.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:37.038 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.33861.asok status 2024-01-24T13:04:37.211 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:04:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-01-24T13:04:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "4e3182a65800aed6d4aa2f6b86da3cfd72188134", 2024-01-24T13:04:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable)", 2024-01-24T13:04:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "2", 2024-01-24T13:04:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-01-24T13:04:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-01-24T13:04:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "33861", 2024-01-24T13:04:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-01-24T13:04:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:04:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-01-24T13:04:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-01-24T13:04:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4848, 2024-01-24T13:04:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 4848 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.2:0", 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2864552493 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.2:0", 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2864552493 2024-01-24T13:04:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:04:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.4848 192.168.0.2:0/2864552493", 2024-01-24T13:04:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.2:0/2864552493", 2024-01-24T13:04:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-01-24T13:04:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 9, 2024-01-24T13:04:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 29, 2024-01-24T13:04:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-01-24T13:04:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-01-24T13:04:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-01-24T13:04:37.214 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:04:37.226 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-24T13:04:37.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.367+0000 7f787da00640 1 Processor -- start 2024-01-24T13:04:37.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.367+0000 7f787da00640 1 -- start start 2024-01-24T13:04:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.367+0000 7f787da00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7878143d30 0x7f787806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.367+0000 7f787da00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f787806c150 0x7f78780cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.367+0000 7f787da00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787806c5b0 con 0x7f7878143910 2024-01-24T13:04:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.367+0000 7f787da00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787815aa30 con 0x7f787806c150 2024-01-24T13:04:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.367+0000 7f787da00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78780712a0 con 0x7f7878143d30 2024-01-24T13:04:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.367+0000 7f7877400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f787806c150 0x7f78780cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.371+0000 7f7877400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f787806c150 0x7f78780cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41710/0 (socket says 172.21.15.29:41710) 2024-01-24T13:04:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.371+0000 7f7877400640 1 -- 172.21.15.29:0/3483284659 learned_addr learned my addr 172.21.15.29:0/3483284659 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.371+0000 7f7876000640 1 --2- 172.21.15.29:0/3483284659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7878143d30 0x7f787806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.371+0000 7f7877400640 1 -- 172.21.15.29:0/3483284659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7878143d30 msgr2=0x7f787806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.371+0000 7f7877400640 1 --2- 172.21.15.29:0/3483284659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7878143d30 0x7f787806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.371+0000 7f7877400640 1 -- 172.21.15.29:0/3483284659 >> v1:172.21.15.163:6789/0 conn(0x7f7878143910 legacy=0x7f7878070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.371+0000 7f7877400640 1 -- 172.21.15.29:0/3483284659 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7878071580 con 0x7f787806c150 2024-01-24T13:04:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.371+0000 7f7876000640 1 --2- 172.21.15.29:0/3483284659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7878143d30 0x7f787806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:37.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.371+0000 7f7877400640 1 --2- 172.21.15.29:0/3483284659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f787806c150 0x7f78780cd890 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7870009e50 tx=0x7f787001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58af606b613cc7f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:37.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.371+0000 7f7875600640 1 -- 172.21.15.29:0/3483284659 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78700a5740 con 0x7f787806c150 2024-01-24T13:04:37.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.371+0000 7f7875600640 1 -- 172.21.15.29:0/3483284659 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78700a58a0 con 0x7f787806c150 2024-01-24T13:04:37.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.371+0000 7f7875600640 1 -- 172.21.15.29:0/3483284659 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78700a5c30 con 0x7f787806c150 2024-01-24T13:04:37.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 -- 172.21.15.29:0/3483284659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f787806c150 msgr2=0x7f78780cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:37.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 --2- 172.21.15.29:0/3483284659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f787806c150 0x7f78780cd890 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7870009e50 tx=0x7f787001c9d0 comp rx=0 tx=0).stop 2024-01-24T13:04:37.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 -- 172.21.15.29:0/3483284659 shutdown_connections 2024-01-24T13:04:37.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 --2- 172.21.15.29:0/3483284659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f787806c150 0x7f78780cd890 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:37.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 --2- 172.21.15.29:0/3483284659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7878143d30 0x7f787806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:37.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 -- 172.21.15.29:0/3483284659 >> 172.21.15.29:0/3483284659 conn(0x7f78780b3950 msgr2=0x7f7878069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:37.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 -- 172.21.15.29:0/3483284659 shutdown_connections 2024-01-24T13:04:37.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 -- 172.21.15.29:0/3483284659 wait complete. 2024-01-24T13:04:37.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 Processor -- start 2024-01-24T13:04:37.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 -- start start 2024-01-24T13:04:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f787806c150 0x7f78781581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7878143910 0x7f7878155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7878143d30 0x7f7878155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78780b1ed0 con 0x7f7878143910 2024-01-24T13:04:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78780b12c0 con 0x7f787806c150 2024-01-24T13:04:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f787da00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78780b15a0 con 0x7f7878143d30 2024-01-24T13:04:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f7876000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7878143910 0x7f7878155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f7876000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7878143910 0x7f7878155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41726/0 (socket says 172.21.15.29:41726) 2024-01-24T13:04:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f7876000640 1 -- 172.21.15.29:0/1656728214 learned_addr learned my addr 172.21.15.29:0/1656728214 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f7877400640 1 --2- 172.21.15.29:0/1656728214 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7878143d30 0x7f7878155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f7876a00640 1 --2- 172.21.15.29:0/1656728214 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f787806c150 0x7f78781581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f7876000640 1 -- 172.21.15.29:0/1656728214 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7878143d30 msgr2=0x7f7878155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f7876000640 1 --2- 172.21.15.29:0/1656728214 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7878143d30 0x7f7878155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f7876000640 1 -- 172.21.15.29:0/1656728214 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f787806c150 msgr2=0x7f78781581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f7876000640 1 --2- 172.21.15.29:0/1656728214 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f787806c150 0x7f78781581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.375+0000 7f7876000640 1 -- 172.21.15.29:0/1656728214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7870009b30 con 0x7f7878143910 2024-01-24T13:04:37.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.379+0000 7f7876000640 1 --2- 172.21.15.29:0/1656728214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7878143910 0x7f7878155040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f786000c7f0 tx=0x7f786000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:37.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.379+0000 7f786ea00640 1 -- 172.21.15.29:0/1656728214 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860007820 con 0x7f7878143910 2024-01-24T13:04:37.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.379+0000 7f786ea00640 1 -- 172.21.15.29:0/1656728214 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7860007980 con 0x7f7878143910 2024-01-24T13:04:37.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.379+0000 7f786ea00640 1 -- 172.21.15.29:0/1656728214 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860007d30 con 0x7f7878143910 2024-01-24T13:04:37.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.379+0000 7f787da00640 1 -- 172.21.15.29:0/1656728214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78780b1880 con 0x7f7878143910 2024-01-24T13:04:37.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.379+0000 7f787da00640 1 -- 172.21.15.29:0/1656728214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78781586f0 con 0x7f7878143910 2024-01-24T13:04:37.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.379+0000 7f787da00640 1 -- 172.21.15.29:0/1656728214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78780b2080 con 0x7f7878143910 2024-01-24T13:04:37.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.379+0000 7f786ea00640 1 -- 172.21.15.29:0/1656728214 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f78600113f0 con 0x7f7878143910 2024-01-24T13:04:37.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.379+0000 7f786ea00640 1 --2- 172.21.15.29:0/1656728214 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7850065a90 0x7f7850067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:37.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.379+0000 7f786ea00640 1 -- 172.21.15.29:0/1656728214 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f7860083830 con 0x7f7878143910 2024-01-24T13:04:37.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.379+0000 7f7876a00640 1 --2- 172.21.15.29:0/1656728214 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7850065a90 0x7f7850067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:37.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.383+0000 7f7876a00640 1 --2- 172.21.15.29:0/1656728214 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7850065a90 0x7f7850067f50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7868004e30 tx=0x7f7868009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:37.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.383+0000 7f786ea00640 1 -- 172.21.15.29:0/1656728214 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f78780b2080 con 0x7f7878143910 2024-01-24T13:04:37.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.575+0000 7f787da00640 1 -- 172.21.15.29:0/1656728214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f787804e850 con 0x7f7878143910 2024-01-24T13:04:37.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.575+0000 7f786ea00640 1 -- 172.21.15.29:0/1656728214 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7860050e20 con 0x7f7878143910 2024-01-24T13:04:37.579 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-24T13:04:37.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.579+0000 7f787da00640 1 -- 172.21.15.29:0/1656728214 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7850065a90 msgr2=0x7f7850067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:37.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.579+0000 7f787da00640 1 --2- 172.21.15.29:0/1656728214 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7850065a90 0x7f7850067f50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7868004e30 tx=0x7f7868009040 comp rx=0 tx=0).stop 2024-01-24T13:04:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.579+0000 7f787da00640 1 -- 172.21.15.29:0/1656728214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7878143910 msgr2=0x7f7878155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.579+0000 7f787da00640 1 --2- 172.21.15.29:0/1656728214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7878143910 0x7f7878155040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f786000c7f0 tx=0x7f786000ccb0 comp rx=0 tx=0).stop 2024-01-24T13:04:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.579+0000 7f787da00640 1 -- 172.21.15.29:0/1656728214 shutdown_connections 2024-01-24T13:04:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.579+0000 7f787da00640 1 --2- 172.21.15.29:0/1656728214 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7850065a90 0x7f7850067f50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.579+0000 7f787da00640 1 --2- 172.21.15.29:0/1656728214 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7878143d30 0x7f7878155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.579+0000 7f787da00640 1 --2- 172.21.15.29:0/1656728214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7878143910 0x7f7878155040 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.579+0000 7f787da00640 1 --2- 172.21.15.29:0/1656728214 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f787806c150 0x7f78781581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.579+0000 7f787da00640 1 -- 172.21.15.29:0/1656728214 >> 172.21.15.29:0/1656728214 conn(0x7f78780b3950 msgr2=0x7f7878153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.579+0000 7f787da00640 1 -- 172.21.15.29:0/1656728214 shutdown_connections 2024-01-24T13:04:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:37.579+0000 7f787da00640 1 -- 172.21.15.29:0/1656728214 wait complete. 2024-01-24T13:04:37.600 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-24T13:04:37.601 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-24T13:04:37.601 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi163.front.sepia.ceph.com 2024-01-24T13:04:37.601 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-24T13:04:37.601 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-24T13:04:37.601 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-24T13:04:37.601 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-24T13:04:37.601 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-24T13:04:37.601 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-24T13:04:37.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:37.601 DEBUG:teuthology.orchestra.run.smithi163:> ip addr 2024-01-24T13:04:37.612 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:04:37.612 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:04:37.612 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:04:37.612 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:37.612 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2024-01-24T13:04:37.612 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:37.612 INFO:teuthology.orchestra.run.smithi163.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:37.613 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:06 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:37.613 INFO:teuthology.orchestra.run.smithi163.stdout: altname enp7s0f0 2024-01-24T13:04:37.613 INFO:teuthology.orchestra.run.smithi163.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:37.613 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:07 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:37.613 INFO:teuthology.orchestra.run.smithi163.stdout: altname enp7s0f1 2024-01-24T13:04:37.613 INFO:teuthology.orchestra.run.smithi163.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:37.613 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5a brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:37.613 INFO:teuthology.orchestra.run.smithi163.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-24T13:04:37.613 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5b brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:37.613 INFO:teuthology.orchestra.run.smithi163.stdout: inet 172.21.15.163/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-24T13:04:37.613 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft 42420sec preferred_lft 42420sec 2024-01-24T13:04:37.613 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::ec4:7aff:fe88:7d5b/64 scope link 2024-01-24T13:04:37.613 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:37.613 INFO:teuthology.orchestra.run.smithi163.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-24T13:04:37.614 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 02:42:4a:ef:39:98 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:37.614 INFO:teuthology.orchestra.run.smithi163.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-24T13:04:37.614 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:37.614 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-24T13:04:37.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:37.614 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2024-01-24T13:04:37.614 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-01-24T13:04:37.614 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add name ceph-brx type bridge 2024-01-24T13:04:37.614 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip addr flush dev ceph-brx 2024-01-24T13:04:37.614 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set ceph-brx up 2024-01-24T13:04:37.614 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-24T13:04:37.615 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-01-24T13:04:37.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:37.729 DEBUG:teuthology.orchestra.run.smithi163:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-24T13:04:37.747 INFO:teuthology.orchestra.run.smithi163.stdout:1 2024-01-24T13:04:37.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:37.749 DEBUG:teuthology.orchestra.run.smithi163:> route 2024-01-24T13:04:37.821 INFO:teuthology.orchestra.run.smithi163.stdout:Kernel IP routing table 2024-01-24T13:04:37.821 INFO:teuthology.orchestra.run.smithi163.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-24T13:04:37.821 INFO:teuthology.orchestra.run.smithi163.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-24T13:04:37.821 INFO:teuthology.orchestra.run.smithi163.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-24T13:04:37.821 INFO:teuthology.orchestra.run.smithi163.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-24T13:04:37.821 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-24T13:04:37.821 INFO:teuthology.orchestra.run.smithi163.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-24T13:04:37.821 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-24T13:04:37.822 INFO:teuthology.orchestra.run.smithi163.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-24T13:04:37.822 INFO:teuthology.orchestra.run.smithi163.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-24T13:04:37.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:37.822 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2024-01-24T13:04:37.822 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-01-24T13:04:37.822 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-24T13:04:37.822 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-24T13:04:37.822 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-24T13:04:37.822 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-01-24T13:04:37.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:37.911 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2024-01-24T13:04:37.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:37.920 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list-id 2024-01-24T13:04:37.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:37.974 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2024-01-24T13:04:37.974 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-01-24T13:04:37.974 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-24T13:04:37.974 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-01-24T13:04:37.974 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-01-24T13:04:38.055 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-01-24T13:04:38.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:38.055 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2024-01-24T13:04:38.056 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-01-24T13:04:38.056 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-01-24T13:04:38.056 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-24T13:04:38.056 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-01-24T13:04:38.056 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-01-24T13:04:38.056 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-01-24T13:04:38.056 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-01-24T13:04:38.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:38.211 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2024-01-24T13:04:38.211 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-01-24T13:04:38.211 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set brx.0 up 2024-01-24T13:04:38.211 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set dev brx.0 master ceph-brx 2024-01-24T13:04:38.211 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-01-24T13:04:38.250 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-01-24T13:04:38.250 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:04:38.250 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-24T13:04:38.305 INFO:teuthology.orchestra.run.smithi163.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-24T13:04:38.306 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:04:38.306 DEBUG:teuthology.orchestra.run.smithi163:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-24T13:04:38.361 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2024-01-24T13:04:38.425 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:04:38.425 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:04:38.491 INFO:teuthology.orchestra.run.smithi163.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:04:38.492 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:04:38.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:38.493 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2024-01-24T13:04:38.541 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-24T13:04:38.541 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-01-24T13:04:38.589 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2024-01-24T13:04:38.610 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:04:38.610 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:04:38.676 INFO:teuthology.orchestra.run.smithi163.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:04:38.677 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:04:38.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:38.678 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2024-01-24T13:04:38.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi163.stderr:2024-01-24T13:04:38.694+0000 7f39cbc49580 -1 init, newargv = 0x561cf59aa4a0 newargc=15 2024-01-24T13:04:38.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi163.stderr:ceph-fuse[32383]: starting ceph client 2024-01-24T13:04:38.702 INFO:teuthology.orchestra.run.smithi163.stdout:43 2024-01-24T13:04:38.703 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi163.stderr:ceph-fuse[32383]: starting fuse 2024-01-24T13:04:38.704 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-24T13:04:38.704 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-24T13:04:38.704 DEBUG:teuthology.orchestra.run.smithi163:> import glob 2024-01-24T13:04:38.704 DEBUG:teuthology.orchestra.run.smithi163:> import re 2024-01-24T13:04:38.704 DEBUG:teuthology.orchestra.run.smithi163:> import os 2024-01-24T13:04:38.704 DEBUG:teuthology.orchestra.run.smithi163:> import subprocess 2024-01-24T13:04:38.704 DEBUG:teuthology.orchestra.run.smithi163:> 2024-01-24T13:04:38.704 DEBUG:teuthology.orchestra.run.smithi163:> def _find_admin_socket(client_name): 2024-01-24T13:04:38.705 DEBUG:teuthology.orchestra.run.smithi163:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> files = glob.glob(asok_path) 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> # Given a non-glob path, it better be there 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> if "*" not in asok_path: 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> assert(len(files) == 1) 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> return files[0] 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> for f in files: 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> contents = proc_f.read() 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> if mountpoint in contents: 2024-01-24T13:04:38.706 DEBUG:teuthology.orchestra.run.smithi163:> return f 2024-01-24T13:04:38.707 DEBUG:teuthology.orchestra.run.smithi163:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-24T13:04:38.707 DEBUG:teuthology.orchestra.run.smithi163:> 2024-01-24T13:04:38.707 DEBUG:teuthology.orchestra.run.smithi163:> print(_find_admin_socket("client.1")) 2024-01-24T13:04:38.707 DEBUG:teuthology.orchestra.run.smithi163:> ' 2024-01-24T13:04:38.822 INFO:teuthology.orchestra.run.smithi163.stdout:/var/run/ceph/ceph-client.1.32383.asok 2024-01-24T13:04:39.008 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.32383.asok 2024-01-24T13:04:39.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:39.010 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.32383.asok status 2024-01-24T13:04:39.175 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-01-24T13:04:39.176 INFO:teuthology.orchestra.run.smithi163.stdout: "metadata": { 2024-01-24T13:04:39.176 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_sha1": "4e3182a65800aed6d4aa2f6b86da3cfd72188134", 2024-01-24T13:04:39.176 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_version": "ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable)", 2024-01-24T13:04:39.176 INFO:teuthology.orchestra.run.smithi163.stdout: "entity_id": "1", 2024-01-24T13:04:39.176 INFO:teuthology.orchestra.run.smithi163.stdout: "hostname": "smithi163", 2024-01-24T13:04:39.176 INFO:teuthology.orchestra.run.smithi163.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-01-24T13:04:39.176 INFO:teuthology.orchestra.run.smithi163.stdout: "pid": "32383", 2024-01-24T13:04:39.176 INFO:teuthology.orchestra.run.smithi163.stdout: "root": "/" 2024-01-24T13:04:39.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-01-24T13:04:39.176 INFO:teuthology.orchestra.run.smithi163.stdout: "dentry_count": 0, 2024-01-24T13:04:39.176 INFO:teuthology.orchestra.run.smithi163.stdout: "dentry_pinned_count": 0, 2024-01-24T13:04:39.177 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 4640, 2024-01-24T13:04:39.177 INFO:teuthology.orchestra.run.smithi163.stdout: "inst": { 2024-01-24T13:04:39.177 INFO:teuthology.orchestra.run.smithi163.stdout: "name": { 2024-01-24T13:04:39.177 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "client", 2024-01-24T13:04:39.177 INFO:teuthology.orchestra.run.smithi163.stdout: "num": 4640 2024-01-24T13:04:39.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-01-24T13:04:39.177 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": { 2024-01-24T13:04:39.177 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v1", 2024-01-24T13:04:39.177 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:04:39.177 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 1752657346 2024-01-24T13:04:39.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-01-24T13:04:39.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-01-24T13:04:39.177 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": { 2024-01-24T13:04:39.177 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v1", 2024-01-24T13:04:39.178 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:04:39.178 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 1752657346 2024-01-24T13:04:39.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-01-24T13:04:39.178 INFO:teuthology.orchestra.run.smithi163.stdout: "inst_str": "client.4640 192.168.0.1:0/1752657346", 2024-01-24T13:04:39.178 INFO:teuthology.orchestra.run.smithi163.stdout: "addr_str": "192.168.0.1:0/1752657346", 2024-01-24T13:04:39.178 INFO:teuthology.orchestra.run.smithi163.stdout: "inode_count": 1, 2024-01-24T13:04:39.178 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_epoch": 9, 2024-01-24T13:04:39.178 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_epoch": 30, 2024-01-24T13:04:39.178 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_epoch_barrier": 0, 2024-01-24T13:04:39.178 INFO:teuthology.orchestra.run.smithi163.stdout: "blocklisted": false, 2024-01-24T13:04:39.178 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs" 2024-01-24T13:04:39.178 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-01-24T13:04:39.190 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-24T13:04:39.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.339+0000 7f26e0400640 1 Processor -- start 2024-01-24T13:04:39.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.339+0000 7f26e0400640 1 -- start start 2024-01-24T13:04:39.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26e0400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f26d8146160 0x7f26d8070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:39.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26e0400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f26d80705b0 0x7f26d80cc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:39.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26e0400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26d80cc7c0 0x7f26d806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:39.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26e0400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d80ccc50 con 0x7f26d8146160 2024-01-24T13:04:39.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26e0400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d8160670 con 0x7f26d80705b0 2024-01-24T13:04:39.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26e0400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d8070be0 con 0x7f26d80cc7c0 2024-01-24T13:04:39.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26dda00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f26d8146160 0x7f26d8070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:39.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26dda00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f26d8146160 0x7f26d8070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41742/0 (socket says 172.21.15.29:41742) 2024-01-24T13:04:39.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26dda00640 1 -- 172.21.15.29:0/2976537506 learned_addr learned my addr 172.21.15.29:0/2976537506 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:39.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26dda00640 1 -- 172.21.15.29:0/2976537506 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26d80cc7c0 msgr2=0x7f26d806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:39.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26dda00640 1 --2- 172.21.15.29:0/2976537506 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26d80cc7c0 0x7f26d806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:39.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26dda00640 1 -- 172.21.15.29:0/2976537506 >> v2:172.21.15.163:3300/0 conn(0x7f26d80705b0 msgr2=0x7f26d80cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:39.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26dd000640 1 --2- 172.21.15.29:0/2976537506 >> v2:172.21.15.163:3300/0 conn(0x7f26d80705b0 0x7f26d80cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:39.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26dda00640 1 --2- 172.21.15.29:0/2976537506 >> v2:172.21.15.163:3300/0 conn(0x7f26d80705b0 0x7f26d80cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:39.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26dda00640 1 -- 172.21.15.29:0/2976537506 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d8070ec0 con 0x7f26d8146160 2024-01-24T13:04:39.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.343+0000 7f26dd000640 1 --2- 172.21.15.29:0/2976537506 >> v2:172.21.15.163:3300/0 conn(0x7f26d80705b0 0x7f26d80cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:39.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26dda00640 1 --2- 172.21.15.29:0/2976537506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26d8146160 0x7f26d8070070 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f26d80cde80 tx=0x7f26c801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1869dc50ba577d1c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:39.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26d7e00640 1 -- 172.21.15.29:0/2976537506 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c80ab600 con 0x7f26d8146160 2024-01-24T13:04:39.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26d7e00640 1 -- 172.21.15.29:0/2976537506 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c80a7050 con 0x7f26d8146160 2024-01-24T13:04:39.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26d7e00640 1 -- 172.21.15.29:0/2976537506 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c80ab980 con 0x7f26d8146160 2024-01-24T13:04:39.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26e0400640 1 -- 172.21.15.29:0/2976537506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26d8146160 msgr2=0x7f26d8070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:39.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26e0400640 1 --2- 172.21.15.29:0/2976537506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26d8146160 0x7f26d8070070 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f26d80cde80 tx=0x7f26c801c240 comp rx=0 tx=0).stop 2024-01-24T13:04:39.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26e0400640 1 -- 172.21.15.29:0/2976537506 shutdown_connections 2024-01-24T13:04:39.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26e0400640 1 --2- 172.21.15.29:0/2976537506 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26d80cc7c0 0x7f26d806d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:39.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26e0400640 1 --2- 172.21.15.29:0/2976537506 >> v2:172.21.15.163:3300/0 conn(0x7f26d80705b0 0x7f26d80cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:39.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26e0400640 1 --2- 172.21.15.29:0/2976537506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26d8146160 0x7f26d8070070 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:39.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26e0400640 1 -- 172.21.15.29:0/2976537506 >> 172.21.15.29:0/2976537506 conn(0x7f26d806c090 msgr2=0x7f26d806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:39.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26e0400640 1 -- 172.21.15.29:0/2976537506 shutdown_connections 2024-01-24T13:04:39.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26e0400640 1 -- 172.21.15.29:0/2976537506 wait complete. 2024-01-24T13:04:39.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26e0400640 1 Processor -- start 2024-01-24T13:04:39.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.347+0000 7f26e0400640 1 -- start start 2024-01-24T13:04:39.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26e0400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26d80705b0 0x7f26d813f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:39.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26e0400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26d80cc7c0 0x7f26d80c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:39.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26e0400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26d8146160 0x7f26d81607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:39.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26e0400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d8144d80 con 0x7f26d80cc7c0 2024-01-24T13:04:39.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26e0400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d813f8d0 con 0x7f26d8146160 2024-01-24T13:04:39.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26e0400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d8144120 con 0x7f26d80705b0 2024-01-24T13:04:39.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26dd000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26d80cc7c0 0x7f26d80c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:39.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26dd000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26d80cc7c0 0x7f26d80c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41754/0 (socket says 172.21.15.29:41754) 2024-01-24T13:04:39.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26dd000640 1 -- 172.21.15.29:0/2008052061 learned_addr learned my addr 172.21.15.29:0/2008052061 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:39.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26dda00640 1 --2- 172.21.15.29:0/2008052061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26d80705b0 0x7f26d813f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:39.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26de400640 1 --2- 172.21.15.29:0/2008052061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26d8146160 0x7f26d81607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:39.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26dd000640 1 -- 172.21.15.29:0/2008052061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26d80705b0 msgr2=0x7f26d813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:39.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26dd000640 1 --2- 172.21.15.29:0/2008052061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26d80705b0 0x7f26d813f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:39.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26dd000640 1 -- 172.21.15.29:0/2008052061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26d8146160 msgr2=0x7f26d81607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:39.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26dd000640 1 --2- 172.21.15.29:0/2008052061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26d8146160 0x7f26d81607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:39.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26dd000640 1 -- 172.21.15.29:0/2008052061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c80094d0 con 0x7f26d80cc7c0 2024-01-24T13:04:39.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26dd000640 1 --2- 172.21.15.29:0/2008052061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26d80cc7c0 0x7f26d80c9710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f26c000c7c0 tx=0x7f26c000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:39.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26d5600640 1 -- 172.21.15.29:0/2008052061 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0007a30 con 0x7f26d80cc7c0 2024-01-24T13:04:39.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26d5600640 1 -- 172.21.15.29:0/2008052061 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c0007b90 con 0x7f26d80cc7c0 2024-01-24T13:04:39.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26d5600640 1 -- 172.21.15.29:0/2008052061 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c000ce70 con 0x7f26d80cc7c0 2024-01-24T13:04:39.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26e0400640 1 -- 172.21.15.29:0/2008052061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d81443e0 con 0x7f26d80cc7c0 2024-01-24T13:04:39.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26e0400640 1 -- 172.21.15.29:0/2008052061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d81449a0 con 0x7f26d80cc7c0 2024-01-24T13:04:39.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.351+0000 7f26e0400640 1 -- 172.21.15.29:0/2008052061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d813f180 con 0x7f26d80cc7c0 2024-01-24T13:04:39.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.355+0000 7f26d5600640 1 -- 172.21.15.29:0/2008052061 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f26c00113f0 con 0x7f26d80cc7c0 2024-01-24T13:04:39.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.355+0000 7f26d5600640 1 --2- 172.21.15.29:0/2008052061 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f26b0065a60 0x7f26b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:39.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.355+0000 7f26d5600640 1 -- 172.21.15.29:0/2008052061 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f26c00838b0 con 0x7f26d80cc7c0 2024-01-24T13:04:39.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.355+0000 7f26dda00640 1 --2- 172.21.15.29:0/2008052061 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f26b0065a60 0x7f26b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:39.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.355+0000 7f26dda00640 1 --2- 172.21.15.29:0/2008052061 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f26b0065a60 0x7f26b0067f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f26c80ad000 tx=0x7f26c8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:39.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.359+0000 7f26d5600640 1 -- 172.21.15.29:0/2008052061 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f26c0050fe0 con 0x7f26d80cc7c0 2024-01-24T13:04:39.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.551+0000 7f26e0400640 1 -- 172.21.15.29:0/2008052061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f26d804e850 con 0x7f26d80cc7c0 2024-01-24T13:04:39.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.551+0000 7f26d5600640 1 -- 172.21.15.29:0/2008052061 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f26c001e070 con 0x7f26d80cc7c0 2024-01-24T13:04:39.555 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-24T13:04:39.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.551+0000 7f26e0400640 1 -- 172.21.15.29:0/2008052061 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f26b0065a60 msgr2=0x7f26b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:39.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.551+0000 7f26e0400640 1 --2- 172.21.15.29:0/2008052061 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f26b0065a60 0x7f26b0067f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f26c80ad000 tx=0x7f26c8008040 comp rx=0 tx=0).stop 2024-01-24T13:04:39.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.551+0000 7f26e0400640 1 -- 172.21.15.29:0/2008052061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26d80cc7c0 msgr2=0x7f26d80c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:39.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.551+0000 7f26e0400640 1 --2- 172.21.15.29:0/2008052061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26d80cc7c0 0x7f26d80c9710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f26c000c7c0 tx=0x7f26c000cc80 comp rx=0 tx=0).stop 2024-01-24T13:04:39.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.555+0000 7f26e0400640 1 -- 172.21.15.29:0/2008052061 shutdown_connections 2024-01-24T13:04:39.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.555+0000 7f26e0400640 1 --2- 172.21.15.29:0/2008052061 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f26b0065a60 0x7f26b0067f20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:39.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.555+0000 7f26e0400640 1 --2- 172.21.15.29:0/2008052061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26d8146160 0x7f26d81607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:39.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.555+0000 7f26e0400640 1 --2- 172.21.15.29:0/2008052061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26d80cc7c0 0x7f26d80c9710 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:39.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.555+0000 7f26e0400640 1 --2- 172.21.15.29:0/2008052061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26d80705b0 0x7f26d813f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:39.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.555+0000 7f26e0400640 1 -- 172.21.15.29:0/2008052061 >> 172.21.15.29:0/2008052061 conn(0x7f26d806c090 msgr2=0x7f26d815e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:39.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.555+0000 7f26e0400640 1 -- 172.21.15.29:0/2008052061 shutdown_connections 2024-01-24T13:04:39.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:39.555+0000 7f26e0400640 1 -- 172.21.15.29:0/2008052061 wait complete. 2024-01-24T13:04:39.576 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-24T13:04:39.576 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-24T13:04:39.576 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi163.front.sepia.ceph.com 2024-01-24T13:04:39.576 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-01-24T13:04:39.576 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-01-24T13:04:39.576 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-24T13:04:39.576 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-24T13:04:39.576 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-24T13:04:39.576 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-01-24T13:04:39.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:39.577 DEBUG:teuthology.orchestra.run.smithi163:> ip addr 2024-01-24T13:04:39.586 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:04:39.586 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:04:39.586 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:04:39.586 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:39.586 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2024-01-24T13:04:39.586 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:39.586 INFO:teuthology.orchestra.run.smithi163.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:39.586 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:06 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:39.586 INFO:teuthology.orchestra.run.smithi163.stdout: altname enp7s0f0 2024-01-24T13:04:39.586 INFO:teuthology.orchestra.run.smithi163.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:39.586 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:07 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:39.587 INFO:teuthology.orchestra.run.smithi163.stdout: altname enp7s0f1 2024-01-24T13:04:39.587 INFO:teuthology.orchestra.run.smithi163.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:04:39.587 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5a brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:39.587 INFO:teuthology.orchestra.run.smithi163.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-24T13:04:39.587 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5b brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:39.587 INFO:teuthology.orchestra.run.smithi163.stdout: inet 172.21.15.163/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-24T13:04:39.587 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft 42418sec preferred_lft 42418sec 2024-01-24T13:04:39.587 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::ec4:7aff:fe88:7d5b/64 scope link 2024-01-24T13:04:39.587 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:39.587 INFO:teuthology.orchestra.run.smithi163.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-24T13:04:39.587 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 02:42:4a:ef:39:98 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:39.587 INFO:teuthology.orchestra.run.smithi163.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-24T13:04:39.588 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:39.588 INFO:teuthology.orchestra.run.smithi163.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-24T13:04:39.588 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-24T13:04:39.588 INFO:teuthology.orchestra.run.smithi163.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-24T13:04:39.588 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:39.588 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-01-24T13:04:39.588 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:39.588 INFO:teuthology.orchestra.run.smithi163.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T13:04:39.588 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-24T13:04:39.588 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-24T13:04:39.588 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:39.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:39.589 DEBUG:teuthology.orchestra.run.smithi163:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-24T13:04:39.651 INFO:teuthology.orchestra.run.smithi163.stdout:1 2024-01-24T13:04:39.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:39.653 DEBUG:teuthology.orchestra.run.smithi163:> route 2024-01-24T13:04:39.708 INFO:teuthology.orchestra.run.smithi163.stdout:Kernel IP routing table 2024-01-24T13:04:39.708 INFO:teuthology.orchestra.run.smithi163.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-24T13:04:39.708 INFO:teuthology.orchestra.run.smithi163.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-24T13:04:39.708 INFO:teuthology.orchestra.run.smithi163.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-24T13:04:39.708 INFO:teuthology.orchestra.run.smithi163.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-24T13:04:39.708 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-24T13:04:39.708 INFO:teuthology.orchestra.run.smithi163.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-24T13:04:39.708 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-24T13:04:39.708 INFO:teuthology.orchestra.run.smithi163.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-24T13:04:39.709 INFO:teuthology.orchestra.run.smithi163.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-24T13:04:39.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:39.709 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2024-01-24T13:04:39.709 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-01-24T13:04:39.709 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-24T13:04:39.709 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-24T13:04:39.709 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-24T13:04:39.709 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-01-24T13:04:39.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:39.801 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2024-01-24T13:04:39.810 INFO:teuthology.orchestra.run.smithi163.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-24T13:04:39.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:39.811 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list-id 2024-01-24T13:04:39.861 INFO:teuthology.orchestra.run.smithi163.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-01-24T13:04:39.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:39.862 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2024-01-24T13:04:39.862 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-01-24T13:04:39.862 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-24T13:04:39.862 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-01-24T13:04:39.862 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-01-24T13:04:39.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:39.942 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-24T13:04:40.005 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:04:40.005 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:04:40.005 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:04:40.005 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:40.005 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2024-01-24T13:04:40.005 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:40.005 INFO:teuthology.orchestra.run.smithi163.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-24T13:04:40.005 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 96:6e:7c:88:73:0e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-24T13:04:40.005 INFO:teuthology.orchestra.run.smithi163.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-24T13:04:40.006 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:40.006 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::946e:7cff:fe88:730e/64 scope link tentative 2024-01-24T13:04:40.006 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:40.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:40.007 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-24T13:04:40.069 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:04:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:04:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:04:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2024-01-24T13:04:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:40.070 INFO:teuthology.orchestra.run.smithi163.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-24T13:04:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 96:6e:7c:88:73:0e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-24T13:04:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-24T13:04:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::946e:7cff:fe88:730e/64 scope link tentative 2024-01-24T13:04:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:04:40.071 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-01-24T13:04:40.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:40.072 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2024-01-24T13:04:40.072 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-01-24T13:04:40.072 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-01-24T13:04:40.072 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-24T13:04:40.072 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-01-24T13:04:40.072 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-01-24T13:04:40.072 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-01-24T13:04:40.072 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-01-24T13:04:40.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:40.205 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2024-01-24T13:04:40.205 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-01-24T13:04:40.205 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set brx.1 up 2024-01-24T13:04:40.205 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set dev brx.1 master ceph-brx 2024-01-24T13:04:40.205 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-01-24T13:04:40.244 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-01-24T13:04:40.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:04:40.244 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-01-24T13:04:40.293 INFO:teuthology.orchestra.run.smithi163.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-01-24T13:04:40.294 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:04:40.294 DEBUG:teuthology.orchestra.run.smithi163:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-01-24T13:04:40.345 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2024-01-24T13:04:40.405 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:04:40.406 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:04:40.471 INFO:teuthology.orchestra.run.smithi163.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:04:40.473 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:04:40.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:40.474 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2024-01-24T13:04:40.530 INFO:teuthology.orchestra.run.smithi163.stdout:43 2024-01-24T13:04:40.530 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-01-24T13:04:40.530 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-01-24T13:04:40.576 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2024-01-24T13:04:40.597 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:04:40.597 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:04:40.656 INFO:teuthology.orchestra.run.smithi163.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:04:40.658 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:04:40.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:40.658 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2024-01-24T13:04:40.671 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi163.stderr:2024-01-24T13:04:40.670+0000 7f1b6144c580 -1 init, newargv = 0x555606f4d100 newargc=15 2024-01-24T13:04:40.672 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi163.stderr:ceph-fuse[32490]: starting ceph client 2024-01-24T13:04:40.679 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi163.stderr:ceph-fuse[32490]: starting fuse 2024-01-24T13:04:40.680 INFO:teuthology.orchestra.run.smithi163.stdout:43 2024-01-24T13:04:40.680 INFO:teuthology.orchestra.run.smithi163.stdout:44 2024-01-24T13:04:40.680 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-01-24T13:04:40.681 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-24T13:04:40.681 DEBUG:teuthology.orchestra.run.smithi163:> import glob 2024-01-24T13:04:40.681 DEBUG:teuthology.orchestra.run.smithi163:> import re 2024-01-24T13:04:40.681 DEBUG:teuthology.orchestra.run.smithi163:> import os 2024-01-24T13:04:40.681 DEBUG:teuthology.orchestra.run.smithi163:> import subprocess 2024-01-24T13:04:40.681 DEBUG:teuthology.orchestra.run.smithi163:> 2024-01-24T13:04:40.681 DEBUG:teuthology.orchestra.run.smithi163:> def _find_admin_socket(client_name): 2024-01-24T13:04:40.681 DEBUG:teuthology.orchestra.run.smithi163:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-01-24T13:04:40.681 DEBUG:teuthology.orchestra.run.smithi163:> files = glob.glob(asok_path) 2024-01-24T13:04:40.681 DEBUG:teuthology.orchestra.run.smithi163:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-01-24T13:04:40.681 DEBUG:teuthology.orchestra.run.smithi163:> 2024-01-24T13:04:40.681 DEBUG:teuthology.orchestra.run.smithi163:> # Given a non-glob path, it better be there 2024-01-24T13:04:40.681 DEBUG:teuthology.orchestra.run.smithi163:> if "*" not in asok_path: 2024-01-24T13:04:40.681 DEBUG:teuthology.orchestra.run.smithi163:> assert(len(files) == 1) 2024-01-24T13:04:40.682 DEBUG:teuthology.orchestra.run.smithi163:> return files[0] 2024-01-24T13:04:40.682 DEBUG:teuthology.orchestra.run.smithi163:> 2024-01-24T13:04:40.682 DEBUG:teuthology.orchestra.run.smithi163:> for f in files: 2024-01-24T13:04:40.682 DEBUG:teuthology.orchestra.run.smithi163:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-24T13:04:40.682 DEBUG:teuthology.orchestra.run.smithi163:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-24T13:04:40.682 DEBUG:teuthology.orchestra.run.smithi163:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-24T13:04:40.682 DEBUG:teuthology.orchestra.run.smithi163:> contents = proc_f.read() 2024-01-24T13:04:40.682 DEBUG:teuthology.orchestra.run.smithi163:> if mountpoint in contents: 2024-01-24T13:04:40.682 DEBUG:teuthology.orchestra.run.smithi163:> return f 2024-01-24T13:04:40.682 DEBUG:teuthology.orchestra.run.smithi163:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-24T13:04:40.682 DEBUG:teuthology.orchestra.run.smithi163:> 2024-01-24T13:04:40.682 DEBUG:teuthology.orchestra.run.smithi163:> print(_find_admin_socket("client.3")) 2024-01-24T13:04:40.682 DEBUG:teuthology.orchestra.run.smithi163:> ' 2024-01-24T13:04:40.798 INFO:teuthology.orchestra.run.smithi163.stdout:/var/run/ceph/ceph-client.3.32490.asok 2024-01-24T13:04:40.983 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.32490.asok 2024-01-24T13:04:40.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:40.983 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.32490.asok status 2024-01-24T13:04:41.151 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-01-24T13:04:41.151 INFO:teuthology.orchestra.run.smithi163.stdout: "metadata": { 2024-01-24T13:04:41.151 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_sha1": "4e3182a65800aed6d4aa2f6b86da3cfd72188134", 2024-01-24T13:04:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_version": "ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable)", 2024-01-24T13:04:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: "entity_id": "3", 2024-01-24T13:04:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: "hostname": "smithi163", 2024-01-24T13:04:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-01-24T13:04:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: "pid": "32490", 2024-01-24T13:04:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: "root": "/" 2024-01-24T13:04:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-01-24T13:04:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: "dentry_count": 0, 2024-01-24T13:04:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: "dentry_pinned_count": 0, 2024-01-24T13:04:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 4649, 2024-01-24T13:04:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: "inst": { 2024-01-24T13:04:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: "name": { 2024-01-24T13:04:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "client", 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "num": 4649 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": { 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v1", 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "192.168.0.2:0", 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 2577349490 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": { 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v1", 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "192.168.0.2:0", 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 2577349490 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "inst_str": "client.4649 192.168.0.2:0/2577349490", 2024-01-24T13:04:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "addr_str": "192.168.0.2:0/2577349490", 2024-01-24T13:04:41.154 INFO:teuthology.orchestra.run.smithi163.stdout: "inode_count": 1, 2024-01-24T13:04:41.154 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_epoch": 9, 2024-01-24T13:04:41.154 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_epoch": 30, 2024-01-24T13:04:41.154 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_epoch_barrier": 0, 2024-01-24T13:04:41.154 INFO:teuthology.orchestra.run.smithi163.stdout: "blocklisted": false, 2024-01-24T13:04:41.154 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs" 2024-01-24T13:04:41.154 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-01-24T13:04:41.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:41.166 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-01-24T13:04:41.166 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-24T13:04:41.176 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-01-24T13:04:41.177 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-24T13:04:41.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:41.177 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-24T13:04:41.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:41.243 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-01-24T13:04:41.243 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.2 2024-01-24T13:04:41.294 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-01-24T13:04:41.297 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-01-24T13:04:41.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:41.297 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-01-24T13:04:41.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:41.358 DEBUG:teuthology.orchestra.run.smithi163:> stat --file-system '--printf=%T 2024-01-24T13:04:41.358 DEBUG:teuthology.orchestra.run.smithi163:> ' -- /home/ubuntu/cephtest/mnt.1 2024-01-24T13:04:41.368 INFO:teuthology.orchestra.run.smithi163.stdout:fuseblk 2024-01-24T13:04:41.368 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-01-24T13:04:41.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:41.368 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-24T13:04:41.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:41.429 DEBUG:teuthology.orchestra.run.smithi163:> stat --file-system '--printf=%T 2024-01-24T13:04:41.429 DEBUG:teuthology.orchestra.run.smithi163:> ' -- /home/ubuntu/cephtest/mnt.3 2024-01-24T13:04:41.484 INFO:teuthology.orchestra.run.smithi163.stdout:fuseblk 2024-01-24T13:04:41.484 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-01-24T13:04:41.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:41.484 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-01-24T13:04:41.545 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-24T13:04:41.582 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:41.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.731+0000 7f22d3000640 1 Processor -- start 2024-01-24T13:04:41.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.731+0000 7f22d3000640 1 -- start start 2024-01-24T13:04:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.735+0000 7f22d3000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f22cc1612c0 0x7f22cc06c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.735+0000 7f22d3000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f22cc0cd600 0x7f22cc06cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.735+0000 7f22d3000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc0caed0 con 0x7f22cc0ae150 2024-01-24T13:04:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.735+0000 7f22d3000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc0caca0 con 0x7f22cc1612c0 2024-01-24T13:04:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.735+0000 7f22d3000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc0cb170 con 0x7f22cc0cd600 2024-01-24T13:04:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.735+0000 7f22cbe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f22cc1612c0 0x7f22cc06c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.735+0000 7f22cbe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f22cc1612c0 0x7f22cc06c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52428/0 (socket says 172.21.15.29:52428) 2024-01-24T13:04:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.735+0000 7f22cbe00640 1 -- 172.21.15.29:0/1707856279 learned_addr learned my addr 172.21.15.29:0/1707856279 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.735+0000 7f22d1000640 1 --2- 172.21.15.29:0/1707856279 >> v2:172.21.15.163:3300/0 conn(0x7f22cc0cd600 0x7f22cc06cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.735+0000 7f22cbe00640 1 -- 172.21.15.29:0/1707856279 >> v2:172.21.15.163:3300/0 conn(0x7f22cc0cd600 msgr2=0x7f22cc06cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.735+0000 7f22cbe00640 1 --2- 172.21.15.29:0/1707856279 >> v2:172.21.15.163:3300/0 conn(0x7f22cc0cd600 0x7f22cc06cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.735+0000 7f22cbe00640 1 -- 172.21.15.29:0/1707856279 >> v1:172.21.15.163:6789/0 conn(0x7f22cc0ae150 legacy=0x7f22cc0c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.735+0000 7f22cbe00640 1 -- 172.21.15.29:0/1707856279 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc06dab0 con 0x7f22cc1612c0 2024-01-24T13:04:41.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.739+0000 7f22cbe00640 1 --2- 172.21.15.29:0/1707856279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22cc1612c0 0x7f22cc06c8b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0c91d0 tx=0x7f22bc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7070f8a65021ca6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:41.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.739+0000 7f22caa00640 1 -- 172.21.15.29:0/1707856279 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc0ab640 con 0x7f22cc1612c0 2024-01-24T13:04:41.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.739+0000 7f22caa00640 1 -- 172.21.15.29:0/1707856279 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc0a7070 con 0x7f22cc1612c0 2024-01-24T13:04:41.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.739+0000 7f22caa00640 1 -- 172.21.15.29:0/1707856279 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc0ab9c0 con 0x7f22cc1612c0 2024-01-24T13:04:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.739+0000 7f22d3000640 1 -- 172.21.15.29:0/1707856279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22cc1612c0 msgr2=0x7f22cc06c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.739+0000 7f22d3000640 1 --2- 172.21.15.29:0/1707856279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22cc1612c0 0x7f22cc06c8b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0c91d0 tx=0x7f22bc01c440 comp rx=0 tx=0).stop 2024-01-24T13:04:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.739+0000 7f22d3000640 1 -- 172.21.15.29:0/1707856279 shutdown_connections 2024-01-24T13:04:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.739+0000 7f22d3000640 1 --2- 172.21.15.29:0/1707856279 >> v2:172.21.15.163:3300/0 conn(0x7f22cc0cd600 0x7f22cc06cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.739+0000 7f22d3000640 1 --2- 172.21.15.29:0/1707856279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22cc1612c0 0x7f22cc06c8b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.739+0000 7f22d3000640 1 -- 172.21.15.29:0/1707856279 >> 172.21.15.29:0/1707856279 conn(0x7f22cc0cb700 msgr2=0x7f22cc0cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.739+0000 7f22d3000640 1 -- 172.21.15.29:0/1707856279 shutdown_connections 2024-01-24T13:04:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.739+0000 7f22d3000640 1 -- 172.21.15.29:0/1707856279 wait complete. 2024-01-24T13:04:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.739+0000 7f22d3000640 1 Processor -- start 2024-01-24T13:04:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.739+0000 7f22d3000640 1 -- start start 2024-01-24T13:04:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22d3000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22cc0ae150 0x7f22cc158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22d3000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22cc0cd600 0x7f22cc157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22d3000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22cc1612c0 0x7f22cc15d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22d3000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc160bb0 con 0x7f22cc0ae150 2024-01-24T13:04:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22d3000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc1608d0 con 0x7f22cc0cd600 2024-01-24T13:04:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22d3000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc15e330 con 0x7f22cc1612c0 2024-01-24T13:04:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22cbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22cc0ae150 0x7f22cc158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22cbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22cc0ae150 0x7f22cc158fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52440/0 (socket says 172.21.15.29:52440) 2024-01-24T13:04:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22cbe00640 1 -- 172.21.15.29:0/3103961946 learned_addr learned my addr 172.21.15.29:0/3103961946 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22cb400640 1 --2- 172.21.15.29:0/3103961946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22cc0cd600 0x7f22cc157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22d1000640 1 --2- 172.21.15.29:0/3103961946 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22cc1612c0 0x7f22cc15d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22cbe00640 1 -- 172.21.15.29:0/3103961946 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22cc1612c0 msgr2=0x7f22cc15d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22cbe00640 1 --2- 172.21.15.29:0/3103961946 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22cc1612c0 0x7f22cc15d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22cbe00640 1 -- 172.21.15.29:0/3103961946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22cc0cd600 msgr2=0x7f22cc157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22cbe00640 1 --2- 172.21.15.29:0/3103961946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22cc0cd600 0x7f22cc157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22cbe00640 1 -- 172.21.15.29:0/3103961946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0094d0 con 0x7f22cc0ae150 2024-01-24T13:04:41.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22cbe00640 1 --2- 172.21.15.29:0/3103961946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22cc0ae150 0x7f22cc158fa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f22bc019050 tx=0x7f22bc01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:41.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22c3e00640 1 -- 172.21.15.29:0/3103961946 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc0abe80 con 0x7f22cc0ae150 2024-01-24T13:04:41.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22c3e00640 1 -- 172.21.15.29:0/3103961946 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc0be3f0 con 0x7f22cc0ae150 2024-01-24T13:04:41.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22c3e00640 1 -- 172.21.15.29:0/3103961946 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc0be780 con 0x7f22cc0ae150 2024-01-24T13:04:41.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22d3000640 1 -- 172.21.15.29:0/3103961946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc15e610 con 0x7f22cc0ae150 2024-01-24T13:04:41.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22d3000640 1 -- 172.21.15.29:0/3103961946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc15ee10 con 0x7f22cc0ae150 2024-01-24T13:04:41.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22d3000640 1 -- 172.21.15.29:0/3103961946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc15e190 con 0x7f22cc0ae150 2024-01-24T13:04:41.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.743+0000 7f22c3e00640 1 -- 172.21.15.29:0/3103961946 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f22bc0b43f0 con 0x7f22cc0ae150 2024-01-24T13:04:41.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.747+0000 7f22c3e00640 1 --2- 172.21.15.29:0/3103961946 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f22a4065a60 0x7f22a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:41.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.747+0000 7f22c3e00640 1 -- 172.21.15.29:0/3103961946 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f22bc11d920 con 0x7f22cc0ae150 2024-01-24T13:04:41.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.747+0000 7f22cb400640 1 --2- 172.21.15.29:0/3103961946 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f22a4065a60 0x7f22a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:41.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.747+0000 7f22cb400640 1 --2- 172.21.15.29:0/3103961946 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f22a4065a60 0x7f22a4067f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f22cc160300 tx=0x7f22b4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:41.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.751+0000 7f22c3e00640 1 -- 172.21.15.29:0/3103961946 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f22cc15e190 con 0x7f22cc0ae150 2024-01-24T13:04:41.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.907+0000 7f22d3000640 1 -- 172.21.15.29:0/3103961946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22cc15e190 con 0x7f22cc0ae150 2024-01-24T13:04:41.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.907+0000 7f22c3e00640 1 -- 172.21.15.29:0/3103961946 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7f22cc15e190 con 0x7f22cc0ae150 2024-01-24T13:04:41.913 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:41.913 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:41.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.911+0000 7f22d3000640 1 -- 172.21.15.29:0/3103961946 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f22a4065a60 msgr2=0x7f22a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:41.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.911+0000 7f22d3000640 1 --2- 172.21.15.29:0/3103961946 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f22a4065a60 0x7f22a4067f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f22cc160300 tx=0x7f22b4009040 comp rx=0 tx=0).stop 2024-01-24T13:04:41.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.911+0000 7f22d3000640 1 -- 172.21.15.29:0/3103961946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22cc0ae150 msgr2=0x7f22cc158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:41.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.911+0000 7f22d3000640 1 --2- 172.21.15.29:0/3103961946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22cc0ae150 0x7f22cc158fa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f22bc019050 tx=0x7f22bc01ac80 comp rx=0 tx=0).stop 2024-01-24T13:04:41.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.911+0000 7f22d3000640 1 -- 172.21.15.29:0/3103961946 shutdown_connections 2024-01-24T13:04:41.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.911+0000 7f22d3000640 1 --2- 172.21.15.29:0/3103961946 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f22a4065a60 0x7f22a4067f20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:41.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.911+0000 7f22d3000640 1 --2- 172.21.15.29:0/3103961946 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22cc1612c0 0x7f22cc15d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:41.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.911+0000 7f22d3000640 1 --2- 172.21.15.29:0/3103961946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22cc0cd600 0x7f22cc157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:41.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.911+0000 7f22d3000640 1 --2- 172.21.15.29:0/3103961946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22cc0ae150 0x7f22cc158fa0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:41.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.911+0000 7f22d3000640 1 -- 172.21.15.29:0/3103961946 >> 172.21.15.29:0/3103961946 conn(0x7f22cc0cb700 msgr2=0x7f22cc06c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:41.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.911+0000 7f22d3000640 1 -- 172.21.15.29:0/3103961946 shutdown_connections 2024-01-24T13:04:41.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:41.911+0000 7f22d3000640 1 -- 172.21.15.29:0/3103961946 wait complete. 2024-01-24T13:04:41.934 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:04:41.934 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:04:42.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.075+0000 7f8109e00640 1 Processor -- start 2024-01-24T13:04:42.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.075+0000 7f8109e00640 1 -- start start 2024-01-24T13:04:42.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.075+0000 7f8109e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81040c3fd0 0x7f81040caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.075+0000 7f8109e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81040cb440 con 0x7f810415a6f0 2024-01-24T13:04:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.075+0000 7f8109e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81040cd1e0 con 0x7f81040cb010 2024-01-24T13:04:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.075+0000 7f8109e00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810415aad0 con 0x7f81040c3fd0 2024-01-24T13:04:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.075+0000 7f8102000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81040c3fd0 0x7f81040caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.075+0000 7f8102000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81040c3fd0 0x7f81040caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52446/0 (socket says 172.21.15.29:52446) 2024-01-24T13:04:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.075+0000 7f8102000640 1 -- 172.21.15.29:0/848194071 learned_addr learned my addr 172.21.15.29:0/848194071 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.075+0000 7f8102000640 1 -- 172.21.15.29:0/848194071 >> v1:172.21.15.163:6789/0 conn(0x7f81040cb010 legacy=0x7f81040d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.075+0000 7f8102000640 1 -- 172.21.15.29:0/848194071 >> v1:172.21.15.29:6789/0 conn(0x7f810415a6f0 legacy=0x7f81040ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.075+0000 7f8102000640 1 -- 172.21.15.29:0/848194071 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81040cd4c0 con 0x7f81040c3fd0 2024-01-24T13:04:42.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.075+0000 7f8101600640 1 -- 172.21.15.29:0/848194071 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358948523 0 0) 0x7f81040cb440 con 0x7f810415a6f0 2024-01-24T13:04:42.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.079+0000 7f8102000640 1 --2- 172.21.15.29:0/848194071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81040c3fd0 0x7f81040caad0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009870 tx=0x7f80ec01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed217252a92f08b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:42.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.079+0000 7f8101600640 1 -- 172.21.15.29:0/848194071 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0aa670 con 0x7f81040c3fd0 2024-01-24T13:04:42.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.079+0000 7f8101600640 1 -- 172.21.15.29:0/848194071 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec0aa7d0 con 0x7f81040c3fd0 2024-01-24T13:04:42.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.079+0000 7f8101600640 1 -- 172.21.15.29:0/848194071 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0aab60 con 0x7f81040c3fd0 2024-01-24T13:04:42.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.079+0000 7f8109e00640 1 -- 172.21.15.29:0/848194071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81040c3fd0 msgr2=0x7f81040caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.079+0000 7f8109e00640 1 --2- 172.21.15.29:0/848194071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81040c3fd0 0x7f81040caad0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009870 tx=0x7f80ec01c510 comp rx=0 tx=0).stop 2024-01-24T13:04:42.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.079+0000 7f8109e00640 1 -- 172.21.15.29:0/848194071 shutdown_connections 2024-01-24T13:04:42.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.079+0000 7f8109e00640 1 --2- 172.21.15.29:0/848194071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81040c3fd0 0x7f81040caad0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.079+0000 7f8109e00640 1 -- 172.21.15.29:0/848194071 >> 172.21.15.29:0/848194071 conn(0x7f8104069cd0 msgr2=0x7f810406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:42.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.079+0000 7f8109e00640 1 -- 172.21.15.29:0/848194071 shutdown_connections 2024-01-24T13:04:42.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.079+0000 7f8109e00640 1 -- 172.21.15.29:0/848194071 wait complete. 2024-01-24T13:04:42.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8109e00640 1 Processor -- start 2024-01-24T13:04:42.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8109e00640 1 -- start start 2024-01-24T13:04:42.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8109e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81040c3fd0 0x7f81041518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8109e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81040cb010 0x7f810406c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8109e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f810415a6f0 0x7f81040c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8109e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810406c670 con 0x7f81040cb010 2024-01-24T13:04:42.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8109e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810406ce50 con 0x7f81040c3fd0 2024-01-24T13:04:42.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8109e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8104151410 con 0x7f810415a6f0 2024-01-24T13:04:42.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8102000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81040cb010 0x7f810406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8102000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81040cb010 0x7f810406c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52458/0 (socket says 172.21.15.29:52458) 2024-01-24T13:04:42.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8102000640 1 -- 172.21.15.29:0/1716801277 learned_addr learned my addr 172.21.15.29:0/1716801277 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:42.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8102a00640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81040c3fd0 0x7f81041518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8103400640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f810415a6f0 0x7f81040c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8102000640 1 -- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f810415a6f0 msgr2=0x7f81040c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8102000640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f810415a6f0 0x7f81040c5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8102000640 1 -- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81040c3fd0 msgr2=0x7f81041518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8102000640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81040c3fd0 0x7f81041518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8102000640 1 -- 172.21.15.29:0/1716801277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0094d0 con 0x7f81040cb010 2024-01-24T13:04:42.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8103400640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f810415a6f0 0x7f81040c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:42.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8102a00640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81040c3fd0 0x7f81041518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:42.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8102000640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81040cb010 0x7f810406c910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f80ec019120 tx=0x7f80ec01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:42.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f80fb400640 1 -- 172.21.15.29:0/1716801277 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0b38c0 con 0x7f81040cb010 2024-01-24T13:04:42.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f80fb400640 1 -- 172.21.15.29:0/1716801277 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec0b3a20 con 0x7f81040cb010 2024-01-24T13:04:42.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8109e00640 1 -- 172.21.15.29:0/1716801277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810406c0b0 con 0x7f81040cb010 2024-01-24T13:04:42.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f80fb400640 1 -- 172.21.15.29:0/1716801277 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0b3dd0 con 0x7f81040cb010 2024-01-24T13:04:42.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.083+0000 7f8109e00640 1 -- 172.21.15.29:0/1716801277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81041510a0 con 0x7f81040cb010 2024-01-24T13:04:42.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.087+0000 7f8109e00640 1 -- 172.21.15.29:0/1716801277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8104150f00 con 0x7f81040cb010 2024-01-24T13:04:42.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.087+0000 7f80fb400640 1 -- 172.21.15.29:0/1716801277 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f80ec0c6390 con 0x7f81040cb010 2024-01-24T13:04:42.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.087+0000 7f80fb400640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f80dc065a60 0x7f80dc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.087+0000 7f80fb400640 1 -- 172.21.15.29:0/1716801277 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f80ec11e150 con 0x7f81040cb010 2024-01-24T13:04:42.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.087+0000 7f8102a00640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f80dc065a60 0x7f80dc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.091+0000 7f8102a00640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f80dc065a60 0x7f80dc067f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f80f4000f70 tx=0x7f80f4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:42.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.091+0000 7f80fb400640 1 -- 172.21.15.29:0/1716801277 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f80ec0eb850 con 0x7f81040cb010 2024-01-24T13:04:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.247+0000 7f8109e00640 1 -- 172.21.15.29:0/1716801277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8104150f00 con 0x7f81040cb010 2024-01-24T13:04:42.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.247+0000 7f80fb400640 1 -- 172.21.15.29:0/1716801277 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8104150f00 con 0x7f81040cb010 2024-01-24T13:04:42.250 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:04:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.247+0000 7f8109e00640 1 -- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f80dc065a60 msgr2=0x7f80dc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.247+0000 7f8109e00640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f80dc065a60 0x7f80dc067f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f80f4000f70 tx=0x7f80f4009040 comp rx=0 tx=0).stop 2024-01-24T13:04:42.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.247+0000 7f8109e00640 1 -- 172.21.15.29:0/1716801277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81040cb010 msgr2=0x7f810406c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.247+0000 7f8109e00640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81040cb010 0x7f810406c910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f80ec019120 tx=0x7f80ec01ad50 comp rx=0 tx=0).stop 2024-01-24T13:04:42.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.247+0000 7f8109e00640 1 -- 172.21.15.29:0/1716801277 shutdown_connections 2024-01-24T13:04:42.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.247+0000 7f8109e00640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f80dc065a60 0x7f80dc067f20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.247+0000 7f8109e00640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f810415a6f0 0x7f81040c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.247+0000 7f8109e00640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81040cb010 0x7f810406c910 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.247+0000 7f8109e00640 1 --2- 172.21.15.29:0/1716801277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81040c3fd0 0x7f81041518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.247+0000 7f8109e00640 1 -- 172.21.15.29:0/1716801277 >> 172.21.15.29:0/1716801277 conn(0x7f8104069cd0 msgr2=0x7f81040b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:42.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.251+0000 7f8109e00640 1 -- 172.21.15.29:0/1716801277 shutdown_connections 2024-01-24T13:04:42.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.251+0000 7f8109e00640 1 -- 172.21.15.29:0/1716801277 wait complete. 2024-01-24T13:04:42.272 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:04:42.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.411+0000 7ff16d800640 1 Processor -- start 2024-01-24T13:04:42.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.411+0000 7ff16d800640 1 -- start start 2024-01-24T13:04:42.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff16d800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff16806c200 0x7ff16813cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff16d800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff16813d2e0 0x7ff1680cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff16d800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16813d720 con 0x7ff16806be20 2024-01-24T13:04:42.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff16d800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16815b4f0 con 0x7ff16813d2e0 2024-01-24T13:04:42.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff16d800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16815b7d0 con 0x7ff16806c200 2024-01-24T13:04:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff166a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff16806be20 0x7ff16815a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33646/0 (socket says 172.21.15.29:33646) 2024-01-24T13:04:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff166a00640 1 -- 172.21.15.29:0/158034609 learned_addr learned my addr 172.21.15.29:0/158034609 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff166000640 1 --2- 172.21.15.29:0/158034609 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff16806c200 0x7ff16813cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff167400640 1 --2- 172.21.15.29:0/158034609 >> v2:172.21.15.163:3300/0 conn(0x7ff16813d2e0 0x7ff1680cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 -- 172.21.15.29:0/158034609 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367248465 0 0) 0x7ff16813d720 con 0x7ff16806be20 2024-01-24T13:04:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 -- 172.21.15.29:0/158034609 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff148003530 con 0x7ff16806be20 2024-01-24T13:04:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 -- 172.21.15.29:0/158034609 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1866747534 0 0) 0x7ff148003530 con 0x7ff16806be20 2024-01-24T13:04:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 -- 172.21.15.29:0/158034609 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff16806c200 msgr2=0x7ff16813cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 --2- 172.21.15.29:0/158034609 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff16806c200 0x7ff16813cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 -- 172.21.15.29:0/158034609 >> v2:172.21.15.163:3300/0 conn(0x7ff16813d2e0 msgr2=0x7ff1680cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 --2- 172.21.15.29:0/158034609 >> v2:172.21.15.163:3300/0 conn(0x7ff16813d2e0 0x7ff1680cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 -- 172.21.15.29:0/158034609 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1680cd0c0 con 0x7ff16806be20 2024-01-24T13:04:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 -- 172.21.15.29:0/158034609 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7ff158001680 con 0x7ff16806be20 2024-01-24T13:04:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 -- 172.21.15.29:0/158034609 >> v1:172.21.15.29:6789/0 conn(0x7ff16806be20 legacy=0x7ff16815a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 --2- 172.21.15.29:0/158034609 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff16806c200 0x7ff148003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 --2- 172.21.15.29:0/158034609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff148003f00 0x7ff1480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 --2- 172.21.15.29:0/158034609 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff148004d10 0x7ff148005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 -- 172.21.15.29:0/158034609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16815b4f0 con 0x7ff148003f00 2024-01-24T13:04:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 -- 172.21.15.29:0/158034609 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16815b7d0 con 0x7ff148004d10 2024-01-24T13:04:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff165600640 1 -- 172.21.15.29:0/158034609 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14800b990 con 0x7ff16806c200 2024-01-24T13:04:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff166000640 1 --2- 172.21.15.29:0/158034609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff148003f00 0x7ff1480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff166a00640 1 --2- 172.21.15.29:0/158034609 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff16806c200 0x7ff148003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff167400640 1 --2- 172.21.15.29:0/158034609 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff148004d10 0x7ff148005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff166000640 1 -- 172.21.15.29:0/158034609 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff16806c200 msgr2=0x7ff148003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff166000640 1 --2- 172.21.15.29:0/158034609 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff16806c200 0x7ff148003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff166000640 1 -- 172.21.15.29:0/158034609 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff148004d10 msgr2=0x7ff148005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff166000640 1 --2- 172.21.15.29:0/158034609 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff148004d10 0x7ff148005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.415+0000 7ff166000640 1 -- 172.21.15.29:0/158034609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff148003530 con 0x7ff148003f00 2024-01-24T13:04:42.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.419+0000 7ff166000640 1 --2- 172.21.15.29:0/158034609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff148003f00 0x7ff1480047d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff150009ae0 tx=0x7ff15001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21913bfe05aef727 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:42.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.419+0000 7ff165600640 1 -- 172.21.15.29:0/158034609 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500a5640 con 0x7ff148003f00 2024-01-24T13:04:42.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.419+0000 7ff165600640 1 -- 172.21.15.29:0/158034609 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1500a57a0 con 0x7ff148003f00 2024-01-24T13:04:42.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.419+0000 7ff165600640 1 -- 172.21.15.29:0/158034609 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500a5b50 con 0x7ff148003f00 2024-01-24T13:04:42.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.419+0000 7ff16d800640 1 -- 172.21.15.29:0/158034609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff148003f00 msgr2=0x7ff1480047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.419+0000 7ff16d800640 1 --2- 172.21.15.29:0/158034609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff148003f00 0x7ff1480047d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff150009ae0 tx=0x7ff15001c9f0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.419+0000 7ff167400640 1 -- 172.21.15.29:0/158034609 reap_dead start 2024-01-24T13:04:42.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.419+0000 7ff16d800640 1 -- 172.21.15.29:0/158034609 shutdown_connections 2024-01-24T13:04:42.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.419+0000 7ff16d800640 1 -- 172.21.15.29:0/158034609 >> 172.21.15.29:0/158034609 conn(0x7ff16806d700 msgr2=0x7ff168069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:42.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.419+0000 7ff16d800640 1 -- 172.21.15.29:0/158034609 shutdown_connections 2024-01-24T13:04:42.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.419+0000 7ff16d800640 1 -- 172.21.15.29:0/158034609 wait complete. 2024-01-24T13:04:42.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff16d800640 1 Processor -- start 2024-01-24T13:04:42.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff16d800640 1 -- start start 2024-01-24T13:04:42.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff16d800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff148003f00 0x7ff168151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff16d800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1680710f0 0x7ff16813bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff16d800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff16814f4d0 0x7ff1681f1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff16d800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff168139700 con 0x7ff1680710f0 2024-01-24T13:04:42.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff16d800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff168071580 con 0x7ff16814f4d0 2024-01-24T13:04:42.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff16d800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff168071860 con 0x7ff148003f00 2024-01-24T13:04:42.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff166000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1680710f0 0x7ff16813bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff166000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1680710f0 0x7ff16813bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52478/0 (socket says 172.21.15.29:52478) 2024-01-24T13:04:42.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff166000640 1 -- 172.21.15.29:0/204779488 learned_addr learned my addr 172.21.15.29:0/204779488 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:42.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff166a00640 1 --2- 172.21.15.29:0/204779488 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff148003f00 0x7ff168151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff167400640 1 --2- 172.21.15.29:0/204779488 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff16814f4d0 0x7ff1681f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff166000640 1 -- 172.21.15.29:0/204779488 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff148003f00 msgr2=0x7ff168151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff166000640 1 --2- 172.21.15.29:0/204779488 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff148003f00 0x7ff168151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff166000640 1 -- 172.21.15.29:0/204779488 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff16814f4d0 msgr2=0x7ff1681f1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff166000640 1 --2- 172.21.15.29:0/204779488 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff16814f4d0 0x7ff1681f1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff166000640 1 -- 172.21.15.29:0/204779488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff168071b40 con 0x7ff1680710f0 2024-01-24T13:04:42.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff166000640 1 --2- 172.21.15.29:0/204779488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1680710f0 0x7ff16813bdc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff150009ae0 tx=0x7ff148005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:42.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff15ea00640 1 -- 172.21.15.29:0/204779488 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500be070 con 0x7ff1680710f0 2024-01-24T13:04:42.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff15ea00640 1 -- 172.21.15.29:0/204779488 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff150004020 con 0x7ff1680710f0 2024-01-24T13:04:42.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff15ea00640 1 -- 172.21.15.29:0/204779488 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500a5640 con 0x7ff1680710f0 2024-01-24T13:04:42.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff16d800640 1 -- 172.21.15.29:0/204779488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1680ab8d0 con 0x7ff1680710f0 2024-01-24T13:04:42.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.423+0000 7ff16d800640 1 -- 172.21.15.29:0/204779488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff168152020 con 0x7ff1680710f0 2024-01-24T13:04:42.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.427+0000 7ff16d800640 1 -- 172.21.15.29:0/204779488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16806c8c0 con 0x7ff1680710f0 2024-01-24T13:04:42.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.427+0000 7ff15ea00640 1 -- 172.21.15.29:0/204779488 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff1500b4040 con 0x7ff1680710f0 2024-01-24T13:04:42.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.427+0000 7ff15ea00640 1 --2- 172.21.15.29:0/204779488 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff140065a60 0x7ff140067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.427+0000 7ff15ea00640 1 -- 172.21.15.29:0/204779488 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff15011ce20 con 0x7ff1680710f0 2024-01-24T13:04:42.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.427+0000 7ff166a00640 1 --2- 172.21.15.29:0/204779488 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff140065a60 0x7ff140067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.427+0000 7ff166a00640 1 --2- 172.21.15.29:0/204779488 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff140065a60 0x7ff140067f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff158001060 tx=0x7ff158007900 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:42.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.431+0000 7ff15ea00640 1 -- 172.21.15.29:0/204779488 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff1500ea4c0 con 0x7ff1680710f0 2024-01-24T13:04:42.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.587+0000 7ff16d800640 1 -- 172.21.15.29:0/204779488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff16804e850 con 0x7ff1680710f0 2024-01-24T13:04:42.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.587+0000 7ff15ea00640 1 -- 172.21.15.29:0/204779488 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff1500edae0 con 0x7ff1680710f0 2024-01-24T13:04:42.591 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:42.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.591+0000 7ff16d800640 1 -- 172.21.15.29:0/204779488 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff140065a60 msgr2=0x7ff140067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.591+0000 7ff16d800640 1 --2- 172.21.15.29:0/204779488 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff140065a60 0x7ff140067f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff158001060 tx=0x7ff158007900 comp rx=0 tx=0).stop 2024-01-24T13:04:42.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.591+0000 7ff16d800640 1 -- 172.21.15.29:0/204779488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1680710f0 msgr2=0x7ff16813bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.591+0000 7ff16d800640 1 --2- 172.21.15.29:0/204779488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1680710f0 0x7ff16813bdc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff150009ae0 tx=0x7ff148005800 comp rx=0 tx=0).stop 2024-01-24T13:04:42.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.591+0000 7ff16d800640 1 -- 172.21.15.29:0/204779488 shutdown_connections 2024-01-24T13:04:42.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.591+0000 7ff16d800640 1 --2- 172.21.15.29:0/204779488 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff140065a60 0x7ff140067f20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.591+0000 7ff16d800640 1 --2- 172.21.15.29:0/204779488 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff16814f4d0 0x7ff1681f1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.591+0000 7ff16d800640 1 --2- 172.21.15.29:0/204779488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1680710f0 0x7ff16813bdc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.591+0000 7ff16d800640 1 --2- 172.21.15.29:0/204779488 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff148003f00 0x7ff168151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.591+0000 7ff16d800640 1 -- 172.21.15.29:0/204779488 >> 172.21.15.29:0/204779488 conn(0x7ff16806d700 msgr2=0x7ff1680aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:42.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.591+0000 7ff16d800640 1 -- 172.21.15.29:0/204779488 shutdown_connections 2024-01-24T13:04:42.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.591+0000 7ff16d800640 1 -- 172.21.15.29:0/204779488 wait complete. 2024-01-24T13:04:42.613 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:04:42.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.755+0000 7f8e24800640 1 Processor -- start 2024-01-24T13:04:42.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.755+0000 7f8e24800640 1 -- start start 2024-01-24T13:04:42.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.755+0000 7f8e24800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8e1c13d4b0 0x7f8e1c165130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.755+0000 7f8e24800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1c15b4f0 con 0x7f8e1c06be20 2024-01-24T13:04:42.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.755+0000 7f8e24800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1c15b7d0 con 0x7f8e1c06c200 2024-01-24T13:04:42.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.755+0000 7f8e24800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1c0cd0c0 con 0x7f8e1c13d4b0 2024-01-24T13:04:42.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.755+0000 7f8e21e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8e1c06be20 0x7f8e1c15a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33658/0 (socket says 172.21.15.29:33658) 2024-01-24T13:04:42.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.755+0000 7f8e22800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8e1c13d4b0 0x7f8e1c165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.755+0000 7f8e21e00640 1 -- 172.21.15.29:0/298733403 learned_addr learned my addr 172.21.15.29:0/298733403 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:42.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.755+0000 7f8e22800640 1 -- 172.21.15.29:0/298733403 >> v1:172.21.15.163:6789/0 conn(0x7f8e1c06c200 legacy=0x7f8e1c13cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:42.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.755+0000 7f8e22800640 1 -- 172.21.15.29:0/298733403 >> v1:172.21.15.29:6789/0 conn(0x7f8e1c06be20 legacy=0x7f8e1c15a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.755+0000 7f8e22800640 1 -- 172.21.15.29:0/298733403 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c0cd3a0 con 0x7f8e1c13d4b0 2024-01-24T13:04:42.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.755+0000 7f8e20a00640 1 -- 172.21.15.29:0/298733403 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978968090 0 0) 0x7f8e1c15b4f0 con 0x7f8e1c06be20 2024-01-24T13:04:42.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.759+0000 7f8e22800640 1 --2- 172.21.15.29:0/298733403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e1c13d4b0 0x7f8e1c165130 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009d90 tx=0x7f8e1401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6728d96eb9141780 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:42.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.759+0000 7f8e20a00640 1 -- 172.21.15.29:0/298733403 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140a5a30 con 0x7f8e1c13d4b0 2024-01-24T13:04:42.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.759+0000 7f8e20a00640 1 -- 172.21.15.29:0/298733403 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e140a5b90 con 0x7f8e1c13d4b0 2024-01-24T13:04:42.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.759+0000 7f8e20a00640 1 -- 172.21.15.29:0/298733403 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140ad440 con 0x7f8e1c13d4b0 2024-01-24T13:04:42.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.759+0000 7f8e24800640 1 -- 172.21.15.29:0/298733403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e1c13d4b0 msgr2=0x7f8e1c165130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.759+0000 7f8e24800640 1 --2- 172.21.15.29:0/298733403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e1c13d4b0 0x7f8e1c165130 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009d90 tx=0x7f8e1401c910 comp rx=0 tx=0).stop 2024-01-24T13:04:42.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.759+0000 7f8e24800640 1 -- 172.21.15.29:0/298733403 shutdown_connections 2024-01-24T13:04:42.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.759+0000 7f8e24800640 1 --2- 172.21.15.29:0/298733403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e1c13d4b0 0x7f8e1c165130 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.759+0000 7f8e24800640 1 -- 172.21.15.29:0/298733403 >> 172.21.15.29:0/298733403 conn(0x7f8e1c06d700 msgr2=0x7f8e1c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:42.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.759+0000 7f8e24800640 1 -- 172.21.15.29:0/298733403 shutdown_connections 2024-01-24T13:04:42.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.759+0000 7f8e24800640 1 -- 172.21.15.29:0/298733403 wait complete. 2024-01-24T13:04:42.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e24800640 1 Processor -- start 2024-01-24T13:04:42.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e24800640 1 -- start start 2024-01-24T13:04:42.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e24800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e1c06be20 0x7f8e1c13a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e24800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e1c06c200 0x7f8e1c137210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e24800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e1c13d4b0 0x7f8e1c14ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e24800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c137750 con 0x7f8e1c06be20 2024-01-24T13:04:42.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e24800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c071b50 con 0x7f8e1c06c200 2024-01-24T13:04:42.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e24800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c13c2d0 con 0x7f8e1c13d4b0 2024-01-24T13:04:42.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e21e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e1c06be20 0x7f8e1c13a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e21e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e1c06be20 0x7f8e1c13a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52492/0 (socket says 172.21.15.29:52492) 2024-01-24T13:04:42.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e21e00640 1 -- 172.21.15.29:0/910073094 learned_addr learned my addr 172.21.15.29:0/910073094 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:42.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e21400640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e1c06c200 0x7f8e1c137210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e22800640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e1c13d4b0 0x7f8e1c14ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e21e00640 1 -- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e1c13d4b0 msgr2=0x7f8e1c14ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e21e00640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e1c13d4b0 0x7f8e1c14ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e21e00640 1 -- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e1c06c200 msgr2=0x7f8e1c137210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e21e00640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e1c06c200 0x7f8e1c137210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e21e00640 1 -- 172.21.15.29:0/910073094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14009a70 con 0x7f8e1c06be20 2024-01-24T13:04:42.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e22800640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e1c13d4b0 0x7f8e1c14ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:42.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e21e00640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e1c06be20 0x7f8e1c13a600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c4a0 tx=0x7f8e0c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:42.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e1a000640 1 -- 172.21.15.29:0/910073094 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0074e0 con 0x7f8e1c06be20 2024-01-24T13:04:42.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e1a000640 1 -- 172.21.15.29:0/910073094 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c007640 con 0x7f8e1c06be20 2024-01-24T13:04:42.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e24800640 1 -- 172.21.15.29:0/910073094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1c06fcc0 con 0x7f8e1c06be20 2024-01-24T13:04:42.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e1a000640 1 -- 172.21.15.29:0/910073094 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c004a30 con 0x7f8e1c06be20 2024-01-24T13:04:42.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e24800640 1 -- 172.21.15.29:0/910073094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1c137bd0 con 0x7f8e1c06be20 2024-01-24T13:04:42.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.763+0000 7f8e24800640 1 -- 172.21.15.29:0/910073094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1c06ff00 con 0x7f8e1c06be20 2024-01-24T13:04:42.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.767+0000 7f8e1a000640 1 -- 172.21.15.29:0/910073094 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8e0c004b90 con 0x7f8e1c06be20 2024-01-24T13:04:42.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.767+0000 7f8e1a000640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8df4065a60 0x7f8df4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:42.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.767+0000 7f8e1a000640 1 -- 172.21.15.29:0/910073094 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f8e0c082aa0 con 0x7f8e1c06be20 2024-01-24T13:04:42.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.767+0000 7f8e21400640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8df4065a60 0x7f8df4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:42.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.767+0000 7f8e21400640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8df4065a60 0x7f8df4067f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c138290 tx=0x7f8e04009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:42.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.771+0000 7f8e1a000640 1 -- 172.21.15.29:0/910073094 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f8e0c050090 con 0x7f8e1c06be20 2024-01-24T13:04:42.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.927+0000 7f8e24800640 1 -- 172.21.15.29:0/910073094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e1c04e850 con 0x7f8e1c06be20 2024-01-24T13:04:42.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.927+0000 7f8e1a000640 1 -- 172.21.15.29:0/910073094 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e0c018020 con 0x7f8e1c06be20 2024-01-24T13:04:42.931 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:04:42.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.927+0000 7f8e24800640 1 -- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8df4065a60 msgr2=0x7f8df4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.927+0000 7f8e24800640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8df4065a60 0x7f8df4067f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c138290 tx=0x7f8e04009040 comp rx=0 tx=0).stop 2024-01-24T13:04:42.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.927+0000 7f8e24800640 1 -- 172.21.15.29:0/910073094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e1c06be20 msgr2=0x7f8e1c13a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:42.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.927+0000 7f8e24800640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e1c06be20 0x7f8e1c13a600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c4a0 tx=0x7f8e0c00c960 comp rx=0 tx=0).stop 2024-01-24T13:04:42.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.931+0000 7f8e24800640 1 -- 172.21.15.29:0/910073094 shutdown_connections 2024-01-24T13:04:42.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.931+0000 7f8e24800640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8df4065a60 0x7f8df4067f20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.931+0000 7f8e24800640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8e1c13d4b0 0x7f8e1c14ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.931+0000 7f8e24800640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e1c06c200 0x7f8e1c137210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.931+0000 7f8e24800640 1 --2- 172.21.15.29:0/910073094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e1c06be20 0x7f8e1c13a600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:42.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.931+0000 7f8e24800640 1 -- 172.21.15.29:0/910073094 >> 172.21.15.29:0/910073094 conn(0x7f8e1c06d700 msgr2=0x7f8e1c0b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:42.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.931+0000 7f8e24800640 1 -- 172.21.15.29:0/910073094 shutdown_connections 2024-01-24T13:04:42.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:42.931+0000 7f8e24800640 1 -- 172.21.15.29:0/910073094 wait complete. 2024-01-24T13:04:42.953 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:04:43.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.091+0000 7fb829200640 1 Processor -- start 2024-01-24T13:04:43.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.095+0000 7fb829200640 1 -- start start 2024-01-24T13:04:43.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.095+0000 7fb829200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8240cb1e0 0x7fb8240d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.095+0000 7fb829200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8240cd1e0 con 0x7fb8240c3fd0 2024-01-24T13:04:43.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.095+0000 7fb829200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8240cd4c0 con 0x7fb82415a6f0 2024-01-24T13:04:43.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.095+0000 7fb829200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82415aad0 con 0x7fb8240cb1e0 2024-01-24T13:04:43.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.095+0000 7fb821400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb8240c3fd0 0x7fb8240caad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33674/0 (socket says 172.21.15.29:33674) 2024-01-24T13:04:43.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.095+0000 7fb822800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8240cb1e0 0x7fb8240d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.095+0000 7fb821400640 1 -- 172.21.15.29:0/3692201399 learned_addr learned my addr 172.21.15.29:0/3692201399 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:43.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.095+0000 7fb820a00640 1 -- 172.21.15.29:0/3692201399 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511808199 0 0) 0x7fb8240cd1e0 con 0x7fb8240c3fd0 2024-01-24T13:04:43.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.095+0000 7fb820a00640 1 -- 172.21.15.29:0/3692201399 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb804003530 con 0x7fb8240c3fd0 2024-01-24T13:04:43.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.095+0000 7fb822800640 1 -- 172.21.15.29:0/3692201399 >> v1:172.21.15.163:6789/0 conn(0x7fb82415a6f0 legacy=0x7fb8240ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.095+0000 7fb822800640 1 -- 172.21.15.29:0/3692201399 >> v1:172.21.15.29:6789/0 conn(0x7fb8240c3fd0 legacy=0x7fb8240caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.095+0000 7fb822800640 1 -- 172.21.15.29:0/3692201399 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8240cd7a0 con 0x7fb8240cb1e0 2024-01-24T13:04:43.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.099+0000 7fb822800640 1 --2- 172.21.15.29:0/3692201399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240cb1e0 0x7fb8240d0520 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009d90 tx=0x7fb81c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354ee58f484783f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:43.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.099+0000 7fb820a00640 1 -- 172.21.15.29:0/3692201399 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0a58f0 con 0x7fb8240cb1e0 2024-01-24T13:04:43.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.099+0000 7fb820a00640 1 -- 172.21.15.29:0/3692201399 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c0a5a50 con 0x7fb8240cb1e0 2024-01-24T13:04:43.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.099+0000 7fb820a00640 1 -- 172.21.15.29:0/3692201399 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0a5dc0 con 0x7fb8240cb1e0 2024-01-24T13:04:43.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.099+0000 7fb829200640 1 -- 172.21.15.29:0/3692201399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240cb1e0 msgr2=0x7fb8240d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.099+0000 7fb829200640 1 --2- 172.21.15.29:0/3692201399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240cb1e0 0x7fb8240d0520 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009d90 tx=0x7fb81c01c920 comp rx=0 tx=0).stop 2024-01-24T13:04:43.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.099+0000 7fb829200640 1 -- 172.21.15.29:0/3692201399 shutdown_connections 2024-01-24T13:04:43.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.099+0000 7fb829200640 1 --2- 172.21.15.29:0/3692201399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240cb1e0 0x7fb8240d0520 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.099+0000 7fb829200640 1 -- 172.21.15.29:0/3692201399 >> 172.21.15.29:0/3692201399 conn(0x7fb824069cd0 msgr2=0x7fb82406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:43.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.099+0000 7fb829200640 1 -- 172.21.15.29:0/3692201399 shutdown_connections 2024-01-24T13:04:43.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.099+0000 7fb829200640 1 -- 172.21.15.29:0/3692201399 wait complete. 2024-01-24T13:04:43.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.099+0000 7fb829200640 1 Processor -- start 2024-01-24T13:04:43.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.099+0000 7fb829200640 1 -- start start 2024-01-24T13:04:43.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb829200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8240c3fd0 0x7fb8241522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb829200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240cb1e0 0x7fb824159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb829200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb82415a6f0 0x7fb8240c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb829200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb824159fc0 con 0x7fb8240cb1e0 2024-01-24T13:04:43.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb829200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240b0eb0 con 0x7fb8240c3fd0 2024-01-24T13:04:43.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb829200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240b1190 con 0x7fb82415a6f0 2024-01-24T13:04:43.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb821400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240cb1e0 0x7fb824159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb821400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240cb1e0 0x7fb824159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52512/0 (socket says 172.21.15.29:52512) 2024-01-24T13:04:43.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb821400640 1 -- 172.21.15.29:0/882852384 learned_addr learned my addr 172.21.15.29:0/882852384 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:43.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb821e00640 1 --2- 172.21.15.29:0/882852384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8240c3fd0 0x7fb8241522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb822800640 1 --2- 172.21.15.29:0/882852384 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb82415a6f0 0x7fb8240c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb821400640 1 -- 172.21.15.29:0/882852384 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb82415a6f0 msgr2=0x7fb8240c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb821400640 1 --2- 172.21.15.29:0/882852384 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb82415a6f0 0x7fb8240c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb821400640 1 -- 172.21.15.29:0/882852384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8240c3fd0 msgr2=0x7fb8241522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb821400640 1 --2- 172.21.15.29:0/882852384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8240c3fd0 0x7fb8241522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb821400640 1 -- 172.21.15.29:0/882852384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c009a70 con 0x7fb8240cb1e0 2024-01-24T13:04:43.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb821400640 1 --2- 172.21.15.29:0/882852384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240cb1e0 0x7fb824159a80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00c4d0 tx=0x7fb80c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:43.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb81a000640 1 -- 172.21.15.29:0/882852384 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c005cf0 con 0x7fb8240cb1e0 2024-01-24T13:04:43.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb81a000640 1 -- 172.21.15.29:0/882852384 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c005e50 con 0x7fb8240cb1e0 2024-01-24T13:04:43.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb829200640 1 -- 172.21.15.29:0/882852384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8240b1470 con 0x7fb8240cb1e0 2024-01-24T13:04:43.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb81a000640 1 -- 172.21.15.29:0/882852384 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c007270 con 0x7fb8240cb1e0 2024-01-24T13:04:43.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb829200640 1 -- 172.21.15.29:0/882852384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb824157a50 con 0x7fb8240cb1e0 2024-01-24T13:04:43.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.103+0000 7fb829200640 1 -- 172.21.15.29:0/882852384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8240afd30 con 0x7fb8240cb1e0 2024-01-24T13:04:43.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.107+0000 7fb81a000640 1 -- 172.21.15.29:0/882852384 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb80c0073d0 con 0x7fb8240cb1e0 2024-01-24T13:04:43.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.107+0000 7fb81a000640 1 --2- 172.21.15.29:0/882852384 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7fc065a90 0x7fb7fc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.107+0000 7fb81a000640 1 -- 172.21.15.29:0/882852384 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fb80c082980 con 0x7fb8240cb1e0 2024-01-24T13:04:43.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.107+0000 7fb821e00640 1 --2- 172.21.15.29:0/882852384 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7fc065a90 0x7fb7fc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.107+0000 7fb821e00640 1 --2- 172.21.15.29:0/882852384 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7fc065a90 0x7fb7fc067f50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb8240b1b00 tx=0x7fb814009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:43.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.111+0000 7fb81a000640 1 -- 172.21.15.29:0/882852384 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb80c0500b0 con 0x7fb8240cb1e0 2024-01-24T13:04:43.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.263+0000 7fb829200640 1 -- 172.21.15.29:0/882852384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb824157c70 con 0x7fb8240cb1e0 2024-01-24T13:04:43.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.267+0000 7fb81a000640 1 -- 172.21.15.29:0/882852384 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb80c0170a0 con 0x7fb8240cb1e0 2024-01-24T13:04:43.269 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:43.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.267+0000 7fb829200640 1 -- 172.21.15.29:0/882852384 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7fc065a90 msgr2=0x7fb7fc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.267+0000 7fb829200640 1 --2- 172.21.15.29:0/882852384 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7fc065a90 0x7fb7fc067f50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb8240b1b00 tx=0x7fb814009040 comp rx=0 tx=0).stop 2024-01-24T13:04:43.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.267+0000 7fb829200640 1 -- 172.21.15.29:0/882852384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240cb1e0 msgr2=0x7fb824159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.267+0000 7fb829200640 1 --2- 172.21.15.29:0/882852384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240cb1e0 0x7fb824159a80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00c4d0 tx=0x7fb80c00c990 comp rx=0 tx=0).stop 2024-01-24T13:04:43.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.267+0000 7fb829200640 1 -- 172.21.15.29:0/882852384 shutdown_connections 2024-01-24T13:04:43.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.267+0000 7fb829200640 1 --2- 172.21.15.29:0/882852384 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7fc065a90 0x7fb7fc067f50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.267+0000 7fb829200640 1 --2- 172.21.15.29:0/882852384 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb82415a6f0 0x7fb8240c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.267+0000 7fb829200640 1 --2- 172.21.15.29:0/882852384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240cb1e0 0x7fb824159a80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.267+0000 7fb829200640 1 --2- 172.21.15.29:0/882852384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8240c3fd0 0x7fb8241522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.267+0000 7fb829200640 1 -- 172.21.15.29:0/882852384 >> 172.21.15.29:0/882852384 conn(0x7fb824069cd0 msgr2=0x7fb8240ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:43.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.267+0000 7fb829200640 1 -- 172.21.15.29:0/882852384 shutdown_connections 2024-01-24T13:04:43.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.267+0000 7fb829200640 1 -- 172.21.15.29:0/882852384 wait complete. 2024-01-24T13:04:43.291 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:43.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.427+0000 7f35b5400640 1 Processor -- start 2024-01-24T13:04:43.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.427+0000 7f35b5400640 1 -- start start 2024-01-24T13:04:43.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35b5400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f35b015dea0 0x7f35b00cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35b5400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35b00ce4b0 0x7f35b0152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35b5400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b00ce8e0 con 0x7f35b015fb50 2024-01-24T13:04:43.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35b5400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b006c0e0 con 0x7f35b015dea0 2024-01-24T13:04:43.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35b5400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b006cb20 con 0x7f35b00ce4b0 2024-01-24T13:04:43.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35ade00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f35b015dea0 0x7f35b00cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35ae800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f35b015fb50 0x7f35b015d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33680/0 (socket says 172.21.15.29:33680) 2024-01-24T13:04:43.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35ae800640 1 -- 172.21.15.29:0/4059180396 learned_addr learned my addr 172.21.15.29:0/4059180396 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:43.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35af200640 1 --2- 172.21.15.29:0/4059180396 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35b00ce4b0 0x7f35b0152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35ade00640 1 -- 172.21.15.29:0/4059180396 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35b00ce4b0 msgr2=0x7f35b0152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:43.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35ade00640 1 --2- 172.21.15.29:0/4059180396 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35b00ce4b0 0x7f35b0152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35ade00640 1 -- 172.21.15.29:0/4059180396 >> v1:172.21.15.29:6789/0 conn(0x7f35b015fb50 legacy=0x7f35b015d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35ad400640 1 -- 172.21.15.29:0/4059180396 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590395067 0 0) 0x7f35b00ce8e0 con 0x7f35b015fb50 2024-01-24T13:04:43.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35ade00640 1 -- 172.21.15.29:0/4059180396 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b006b4d0 con 0x7f35b015dea0 2024-01-24T13:04:43.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.431+0000 7f35af200640 1 --2- 172.21.15.29:0/4059180396 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35b00ce4b0 0x7f35b0152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:43.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.435+0000 7f35ade00640 1 --2- 172.21.15.29:0/4059180396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b015dea0 0x7f35b00cdf70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f35980097c0 tx=0x7f359801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a2a290e8353ec2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:43.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.435+0000 7f35ad400640 1 -- 172.21.15.29:0/4059180396 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980ab650 con 0x7f35b015dea0 2024-01-24T13:04:43.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.435+0000 7f35ad400640 1 -- 172.21.15.29:0/4059180396 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35980ab7b0 con 0x7f35b015dea0 2024-01-24T13:04:43.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.435+0000 7f35ad400640 1 -- 172.21.15.29:0/4059180396 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980abb40 con 0x7f35b015dea0 2024-01-24T13:04:43.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.435+0000 7f35b5400640 1 -- 172.21.15.29:0/4059180396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b015dea0 msgr2=0x7f35b00cdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.435+0000 7f35b5400640 1 --2- 172.21.15.29:0/4059180396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b015dea0 0x7f35b00cdf70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f35980097c0 tx=0x7f359801c450 comp rx=0 tx=0).stop 2024-01-24T13:04:43.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.435+0000 7f35b5400640 1 -- 172.21.15.29:0/4059180396 shutdown_connections 2024-01-24T13:04:43.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.435+0000 7f35b5400640 1 --2- 172.21.15.29:0/4059180396 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35b00ce4b0 0x7f35b0152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.435+0000 7f35b5400640 1 --2- 172.21.15.29:0/4059180396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b015dea0 0x7f35b00cdf70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.435+0000 7f35b5400640 1 -- 172.21.15.29:0/4059180396 >> 172.21.15.29:0/4059180396 conn(0x7f35b0070570 msgr2=0x7f35b0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:43.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.435+0000 7f35b5400640 1 -- 172.21.15.29:0/4059180396 shutdown_connections 2024-01-24T13:04:43.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.435+0000 7f35b5400640 1 -- 172.21.15.29:0/4059180396 wait complete. 2024-01-24T13:04:43.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.435+0000 7f35b5400640 1 Processor -- start 2024-01-24T13:04:43.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.435+0000 7f35b5400640 1 -- start start 2024-01-24T13:04:43.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35b5400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35b00ce4b0 0x7f35b00b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35b5400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b015dea0 0x7f35b00b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35b5400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f35b015fb50 0x7f35b00b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35b5400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b00c9e60 con 0x7f35b015dea0 2024-01-24T13:04:43.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35b5400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b00c92e0 con 0x7f35b015fb50 2024-01-24T13:04:43.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35b5400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b00c95c0 con 0x7f35b00ce4b0 2024-01-24T13:04:43.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35ade00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b015dea0 0x7f35b00b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35ade00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b015dea0 0x7f35b00b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52538/0 (socket says 172.21.15.29:52538) 2024-01-24T13:04:43.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35ade00640 1 -- 172.21.15.29:0/2029203002 learned_addr learned my addr 172.21.15.29:0/2029203002 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:43.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35af200640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f35b015fb50 0x7f35b00b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35ae800640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35b00ce4b0 0x7f35b00b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35ade00640 1 -- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35b00ce4b0 msgr2=0x7f35b00b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35ade00640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35b00ce4b0 0x7f35b00b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35ade00640 1 -- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f35b015fb50 msgr2=0x7f35b00b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35ade00640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f35b015fb50 0x7f35b00b2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35ade00640 1 -- 172.21.15.29:0/2029203002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598009420 con 0x7f35b015dea0 2024-01-24T13:04:43.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35ae800640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35b00ce4b0 0x7f35b00b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:43.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35ade00640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b015dea0 0x7f35b00b4980 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f359801ab00 tx=0x7f359801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:43.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35a6a00640 1 -- 172.21.15.29:0/2029203002 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598004220 con 0x7f35b015dea0 2024-01-24T13:04:43.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35a6a00640 1 -- 172.21.15.29:0/2029203002 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35980b9070 con 0x7f35b015dea0 2024-01-24T13:04:43.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35b5400640 1 -- 172.21.15.29:0/2029203002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b00c98a0 con 0x7f35b015dea0 2024-01-24T13:04:43.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35a6a00640 1 -- 172.21.15.29:0/2029203002 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598003620 con 0x7f35b015dea0 2024-01-24T13:04:43.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35b5400640 1 -- 172.21.15.29:0/2029203002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b00b34d0 con 0x7f35b015dea0 2024-01-24T13:04:43.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.439+0000 7f35b5400640 1 -- 172.21.15.29:0/2029203002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b004e850 con 0x7f35b015dea0 2024-01-24T13:04:43.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.443+0000 7f35a6a00640 1 -- 172.21.15.29:0/2029203002 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3598003780 con 0x7f35b015dea0 2024-01-24T13:04:43.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.443+0000 7f35a6a00640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3588065a60 0x7f3588067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.443+0000 7f35a6a00640 1 -- 172.21.15.29:0/2029203002 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f35980bb070 con 0x7f35b015dea0 2024-01-24T13:04:43.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.443+0000 7f35ae800640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3588065a60 0x7f3588067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.443+0000 7f35ae800640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3588065a60 0x7f3588067f20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f35a0007fd0 tx=0x7f35a0007c20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:43.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.447+0000 7f35a6a00640 1 -- 172.21.15.29:0/2029203002 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f35980eb710 con 0x7f35b015dea0 2024-01-24T13:04:43.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.607+0000 7f35b5400640 1 -- 172.21.15.29:0/2029203002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35b00ce270 con 0x7f35b015dea0 2024-01-24T13:04:43.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.607+0000 7f35a6a00640 1 -- 172.21.15.29:0/2029203002 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7f35980c4020 con 0x7f35b015dea0 2024-01-24T13:04:43.612 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:43.612 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:43.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.611+0000 7f35b5400640 1 -- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3588065a60 msgr2=0x7f3588067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.611+0000 7f35b5400640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3588065a60 0x7f3588067f20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f35a0007fd0 tx=0x7f35a0007c20 comp rx=0 tx=0).stop 2024-01-24T13:04:43.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.611+0000 7f35b5400640 1 -- 172.21.15.29:0/2029203002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b015dea0 msgr2=0x7f35b00b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.611+0000 7f35b5400640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b015dea0 0x7f35b00b4980 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f359801ab00 tx=0x7f359801ac90 comp rx=0 tx=0).stop 2024-01-24T13:04:43.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.611+0000 7f35b5400640 1 -- 172.21.15.29:0/2029203002 shutdown_connections 2024-01-24T13:04:43.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.611+0000 7f35b5400640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3588065a60 0x7f3588067f20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.611+0000 7f35b5400640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f35b015fb50 0x7f35b00b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.611+0000 7f35b5400640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b015dea0 0x7f35b00b4980 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.611+0000 7f35b5400640 1 --2- 172.21.15.29:0/2029203002 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35b00ce4b0 0x7f35b00b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.611+0000 7f35b5400640 1 -- 172.21.15.29:0/2029203002 >> 172.21.15.29:0/2029203002 conn(0x7f35b0070570 msgr2=0x7f35b00b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:43.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.611+0000 7f35b5400640 1 -- 172.21.15.29:0/2029203002 shutdown_connections 2024-01-24T13:04:43.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.611+0000 7f35b5400640 1 -- 172.21.15.29:0/2029203002 wait complete. 2024-01-24T13:04:43.636 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:04:43.636 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:04:43.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d12000640 1 Processor -- start 2024-01-24T13:04:43.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d12000640 1 -- start start 2024-01-24T13:04:43.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d12000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7d0c158ca0 0x7f7d0c0b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d12000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7d0c06bbc0 0x7f7d0c06c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d12000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c06c560 con 0x7f7d0c06fe50 2024-01-24T13:04:43.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d12000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c159080 con 0x7f7d0c158ca0 2024-01-24T13:04:43.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d12000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c070ba0 con 0x7f7d0c06bbc0 2024-01-24T13:04:43.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d0b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7d0c158ca0 0x7f7d0c0b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d0be00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7d0c06fe50 0x7f7d0c070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33694/0 (socket says 172.21.15.29:33694) 2024-01-24T13:04:43.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d0be00640 1 -- 172.21.15.29:0/3111979531 learned_addr learned my addr 172.21.15.29:0/3111979531 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:43.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d0aa00640 1 --2- 172.21.15.29:0/3111979531 >> v2:172.21.15.163:3300/0 conn(0x7f7d0c06bbc0 0x7f7d0c06c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d0b400640 1 -- 172.21.15.29:0/3111979531 >> v2:172.21.15.163:3300/0 conn(0x7f7d0c06bbc0 msgr2=0x7f7d0c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:43.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d0b400640 1 --2- 172.21.15.29:0/3111979531 >> v2:172.21.15.163:3300/0 conn(0x7f7d0c06bbc0 0x7f7d0c06c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d0b400640 1 -- 172.21.15.29:0/3111979531 >> v1:172.21.15.29:6789/0 conn(0x7f7d0c06fe50 legacy=0x7f7d0c070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d0b400640 1 -- 172.21.15.29:0/3111979531 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c070970 con 0x7f7d0c158ca0 2024-01-24T13:04:43.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d0a000640 1 -- 172.21.15.29:0/3111979531 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480264561 0 0) 0x7f7d0c06c560 con 0x7f7d0c06fe50 2024-01-24T13:04:43.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.779+0000 7f7d0aa00640 1 --2- 172.21.15.29:0/3111979531 >> v2:172.21.15.163:3300/0 conn(0x7f7d0c06bbc0 0x7f7d0c06c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:43.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.783+0000 7f7d0b400640 1 --2- 172.21.15.29:0/3111979531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d0c158ca0 0x7f7d0c0b2680 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c06abc0 tx=0x7f7cfc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43fe2be337ef24f5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:43.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.783+0000 7f7d0a000640 1 -- 172.21.15.29:0/3111979531 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0ac410 con 0x7f7d0c158ca0 2024-01-24T13:04:43.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.783+0000 7f7d0a000640 1 -- 172.21.15.29:0/3111979531 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc0ac570 con 0x7f7d0c158ca0 2024-01-24T13:04:43.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.783+0000 7f7d0a000640 1 -- 172.21.15.29:0/3111979531 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0ac900 con 0x7f7d0c158ca0 2024-01-24T13:04:43.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.783+0000 7f7d12000640 1 -- 172.21.15.29:0/3111979531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d0c158ca0 msgr2=0x7f7d0c0b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.783+0000 7f7d12000640 1 --2- 172.21.15.29:0/3111979531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d0c158ca0 0x7f7d0c0b2680 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c06abc0 tx=0x7f7cfc01c430 comp rx=0 tx=0).stop 2024-01-24T13:04:43.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.783+0000 7f7d12000640 1 -- 172.21.15.29:0/3111979531 shutdown_connections 2024-01-24T13:04:43.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.783+0000 7f7d12000640 1 --2- 172.21.15.29:0/3111979531 >> v2:172.21.15.163:3300/0 conn(0x7f7d0c06bbc0 0x7f7d0c06c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.783+0000 7f7d12000640 1 --2- 172.21.15.29:0/3111979531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d0c158ca0 0x7f7d0c0b2680 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.783+0000 7f7d12000640 1 -- 172.21.15.29:0/3111979531 >> 172.21.15.29:0/3111979531 conn(0x7f7d0c06d700 msgr2=0x7f7d0c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:43.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.783+0000 7f7d12000640 1 -- 172.21.15.29:0/3111979531 shutdown_connections 2024-01-24T13:04:43.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.783+0000 7f7d12000640 1 -- 172.21.15.29:0/3111979531 wait complete. 2024-01-24T13:04:43.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d12000640 1 Processor -- start 2024-01-24T13:04:43.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d12000640 1 -- start start 2024-01-24T13:04:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d12000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d0c06bbc0 0x7f7d0c14bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d12000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7d0c06fe50 0x7f7d0c14da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d12000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d0c158ca0 0x7f7d0c0c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d12000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c14c9c0 con 0x7f7d0c158ca0 2024-01-24T13:04:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d12000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c151b00 con 0x7f7d0c06bbc0 2024-01-24T13:04:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d12000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c151de0 con 0x7f7d0c06fe50 2024-01-24T13:04:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d0be00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d0c158ca0 0x7f7d0c0c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d0be00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d0c158ca0 0x7f7d0c0c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52556/0 (socket says 172.21.15.29:52556) 2024-01-24T13:04:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d0be00640 1 -- 172.21.15.29:0/3976116578 learned_addr learned my addr 172.21.15.29:0/3976116578 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d0b400640 1 --2- 172.21.15.29:0/3976116578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d0c06bbc0 0x7f7d0c14bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d0aa00640 1 --2- 172.21.15.29:0/3976116578 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7d0c06fe50 0x7f7d0c14da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d0be00640 1 -- 172.21.15.29:0/3976116578 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7d0c06fe50 msgr2=0x7f7d0c14da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d0be00640 1 --2- 172.21.15.29:0/3976116578 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7d0c06fe50 0x7f7d0c14da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d0be00640 1 -- 172.21.15.29:0/3976116578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d0c06bbc0 msgr2=0x7f7d0c14bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d0be00640 1 --2- 172.21.15.29:0/3976116578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d0c06bbc0 0x7f7d0c14bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d0be00640 1 -- 172.21.15.29:0/3976116578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc009420 con 0x7f7d0c158ca0 2024-01-24T13:04:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d0be00640 1 --2- 172.21.15.29:0/3976116578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d0c158ca0 0x7f7d0c0c8900 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7d04001570 tx=0x7f7d0400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d03400640 1 -- 172.21.15.29:0/3976116578 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400a640 con 0x7f7d0c158ca0 2024-01-24T13:04:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d03400640 1 -- 172.21.15.29:0/3976116578 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0400a7c0 con 0x7f7d0c158ca0 2024-01-24T13:04:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d03400640 1 -- 172.21.15.29:0/3976116578 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400ab70 con 0x7f7d0c158ca0 2024-01-24T13:04:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d12000640 1 -- 172.21.15.29:0/3976116578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c1520c0 con 0x7f7d0c158ca0 2024-01-24T13:04:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d12000640 1 -- 172.21.15.29:0/3976116578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c14c600 con 0x7f7d0c158ca0 2024-01-24T13:04:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.787+0000 7f7d12000640 1 -- 172.21.15.29:0/3976116578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c04e850 con 0x7f7d0c158ca0 2024-01-24T13:04:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.791+0000 7f7d03400640 1 -- 172.21.15.29:0/3976116578 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7d0400acd0 con 0x7f7d0c158ca0 2024-01-24T13:04:43.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.791+0000 7f7d03400640 1 --2- 172.21.15.29:0/3976116578 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ce4065a60 0x7f7ce4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:43.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.791+0000 7f7d03400640 1 -- 172.21.15.29:0/3976116578 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f7d04082a00 con 0x7f7d0c158ca0 2024-01-24T13:04:43.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.791+0000 7f7d0b400640 1 --2- 172.21.15.29:0/3976116578 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ce4065a60 0x7f7ce4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:43.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.791+0000 7f7d0b400640 1 --2- 172.21.15.29:0/3976116578 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ce4065a60 0x7f7ce4067f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0ae000 tx=0x7f7cfc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.795+0000 7f7d03400640 1 -- 172.21.15.29:0/3976116578 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7d04050130 con 0x7f7d0c158ca0 2024-01-24T13:04:43.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.951+0000 7f7d12000640 1 -- 172.21.15.29:0/3976116578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d0c1551a0 con 0x7f7d0c158ca0 2024-01-24T13:04:43.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.951+0000 7f7d03400640 1 -- 172.21.15.29:0/3976116578 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d04018020 con 0x7f7d0c158ca0 2024-01-24T13:04:43.956 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.955+0000 7f7d12000640 1 -- 172.21.15.29:0/3976116578 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ce4065a60 msgr2=0x7f7ce4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.955+0000 7f7d12000640 1 --2- 172.21.15.29:0/3976116578 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ce4065a60 0x7f7ce4067f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0ae000 tx=0x7f7cfc008040 comp rx=0 tx=0).stop 2024-01-24T13:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.955+0000 7f7d12000640 1 -- 172.21.15.29:0/3976116578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d0c158ca0 msgr2=0x7f7d0c0c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.955+0000 7f7d12000640 1 --2- 172.21.15.29:0/3976116578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d0c158ca0 0x7f7d0c0c8900 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7d04001570 tx=0x7f7d0400cca0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.955+0000 7f7d12000640 1 -- 172.21.15.29:0/3976116578 shutdown_connections 2024-01-24T13:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.955+0000 7f7d12000640 1 --2- 172.21.15.29:0/3976116578 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ce4065a60 0x7f7ce4067f20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.955+0000 7f7d12000640 1 --2- 172.21.15.29:0/3976116578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d0c158ca0 0x7f7d0c0c8900 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.955+0000 7f7d12000640 1 --2- 172.21.15.29:0/3976116578 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7d0c06fe50 0x7f7d0c14da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.955+0000 7f7d12000640 1 --2- 172.21.15.29:0/3976116578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d0c06bbc0 0x7f7d0c14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:43.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.955+0000 7f7d12000640 1 -- 172.21.15.29:0/3976116578 >> 172.21.15.29:0/3976116578 conn(0x7f7d0c06d700 msgr2=0x7f7d0c152f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:43.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.955+0000 7f7d12000640 1 -- 172.21.15.29:0/3976116578 shutdown_connections 2024-01-24T13:04:43.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:43.955+0000 7f7d12000640 1 -- 172.21.15.29:0/3976116578 wait complete. 2024-01-24T13:04:43.978 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:04:44.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.119+0000 7fe529400640 1 Processor -- start 2024-01-24T13:04:44.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe529400640 1 -- start start 2024-01-24T13:04:44.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe529400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe524158ca0 0x7fe5240b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe529400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5240ce1e0 0x7fe52406bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe529400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe5240ce640 0x7fe52406c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe529400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe524159080 con 0x7fe5240ce1e0 2024-01-24T13:04:44.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe529400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe524070ba0 con 0x7fe5240ce640 2024-01-24T13:04:44.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe529400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5240b18c0 con 0x7fe524158ca0 2024-01-24T13:04:44.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe521e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5240ce1e0 0x7fe52406bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe521e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5240ce1e0 0x7fe52406bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52572/0 (socket says 172.21.15.29:52572) 2024-01-24T13:04:44.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe521e00640 1 -- 172.21.15.29:0/1192822486 learned_addr learned my addr 172.21.15.29:0/1192822486 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:44.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe523200640 1 --2- 172.21.15.29:0/1192822486 >> v2:172.21.15.163:3300/0 conn(0x7fe5240ce640 0x7fe52406c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe522800640 1 --2- 172.21.15.29:0/1192822486 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe524158ca0 0x7fe5240b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe521e00640 1 -- 172.21.15.29:0/1192822486 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe524158ca0 msgr2=0x7fe5240b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:44.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe521e00640 1 --2- 172.21.15.29:0/1192822486 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe524158ca0 0x7fe5240b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe521e00640 1 -- 172.21.15.29:0/1192822486 >> v2:172.21.15.163:3300/0 conn(0x7fe5240ce640 msgr2=0x7fe52406c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:44.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe521e00640 1 --2- 172.21.15.29:0/1192822486 >> v2:172.21.15.163:3300/0 conn(0x7fe5240ce640 0x7fe52406c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe521e00640 1 -- 172.21.15.29:0/1192822486 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5240b1ba0 con 0x7fe5240ce1e0 2024-01-24T13:04:44.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.123+0000 7fe522800640 1 --2- 172.21.15.29:0/1192822486 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe524158ca0 0x7fe5240b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:44.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.127+0000 7fe521e00640 1 --2- 172.21.15.29:0/1192822486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5240ce1e0 0x7fe52406bbc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe52406ce60 tx=0x7fe50c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382c6348f3a3cb05 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:44.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.127+0000 7fe521400640 1 -- 172.21.15.29:0/1192822486 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c0aa5f0 con 0x7fe5240ce1e0 2024-01-24T13:04:44.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.127+0000 7fe521400640 1 -- 172.21.15.29:0/1192822486 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c0aa750 con 0x7fe5240ce1e0 2024-01-24T13:04:44.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.127+0000 7fe521400640 1 -- 172.21.15.29:0/1192822486 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c0aaae0 con 0x7fe5240ce1e0 2024-01-24T13:04:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.127+0000 7fe529400640 1 -- 172.21.15.29:0/1192822486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5240ce1e0 msgr2=0x7fe52406bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.127+0000 7fe529400640 1 --2- 172.21.15.29:0/1192822486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5240ce1e0 0x7fe52406bbc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe52406ce60 tx=0x7fe50c01c4d0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.127+0000 7fe529400640 1 -- 172.21.15.29:0/1192822486 shutdown_connections 2024-01-24T13:04:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.127+0000 7fe529400640 1 --2- 172.21.15.29:0/1192822486 >> v2:172.21.15.163:3300/0 conn(0x7fe5240ce640 0x7fe52406c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.127+0000 7fe529400640 1 --2- 172.21.15.29:0/1192822486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5240ce1e0 0x7fe52406bbc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.127+0000 7fe529400640 1 --2- 172.21.15.29:0/1192822486 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe524158ca0 0x7fe5240b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.127+0000 7fe529400640 1 -- 172.21.15.29:0/1192822486 >> 172.21.15.29:0/1192822486 conn(0x7fe52406d700 msgr2=0x7fe524069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.127+0000 7fe529400640 1 -- 172.21.15.29:0/1192822486 shutdown_connections 2024-01-24T13:04:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.127+0000 7fe529400640 1 -- 172.21.15.29:0/1192822486 wait complete. 2024-01-24T13:04:44.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.127+0000 7fe529400640 1 Processor -- start 2024-01-24T13:04:44.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe529400640 1 -- start start 2024-01-24T13:04:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe529400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5240ce1e0 0x7fe52413a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe529400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5240ce640 0x7fe524159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe529400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe524158ca0 0x7fe5240cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe529400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52415b030 con 0x7fe524158ca0 2024-01-24T13:04:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe529400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52415a420 con 0x7fe5240ce640 2024-01-24T13:04:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe529400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52415a700 con 0x7fe5240ce1e0 2024-01-24T13:04:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe523200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe524158ca0 0x7fe5240cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe523200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe524158ca0 0x7fe5240cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52584/0 (socket says 172.21.15.29:52584) 2024-01-24T13:04:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe523200640 1 -- 172.21.15.29:0/2838712640 learned_addr learned my addr 172.21.15.29:0/2838712640 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe522800640 1 --2- 172.21.15.29:0/2838712640 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5240ce1e0 0x7fe52413a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe521e00640 1 --2- 172.21.15.29:0/2838712640 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5240ce640 0x7fe524159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe523200640 1 -- 172.21.15.29:0/2838712640 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5240ce1e0 msgr2=0x7fe52413a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe523200640 1 --2- 172.21.15.29:0/2838712640 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5240ce1e0 0x7fe52413a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe523200640 1 -- 172.21.15.29:0/2838712640 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5240ce640 msgr2=0x7fe524159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe523200640 1 --2- 172.21.15.29:0/2838712640 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5240ce640 0x7fe524159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe523200640 1 -- 172.21.15.29:0/2838712640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c0094d0 con 0x7fe524158ca0 2024-01-24T13:04:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe523200640 1 --2- 172.21.15.29:0/2838712640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe524158ca0 0x7fe5240cc660 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe51c007e30 tx=0x7fe51c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe51aa00640 1 -- 172.21.15.29:0/2838712640 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c014620 con 0x7fe524158ca0 2024-01-24T13:04:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe51aa00640 1 -- 172.21.15.29:0/2838712640 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c00ee90 con 0x7fe524158ca0 2024-01-24T13:04:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe529400640 1 -- 172.21.15.29:0/2838712640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52415a9e0 con 0x7fe524158ca0 2024-01-24T13:04:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe51aa00640 1 -- 172.21.15.29:0/2838712640 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0149c0 con 0x7fe524158ca0 2024-01-24T13:04:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe529400640 1 -- 172.21.15.29:0/2838712640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52413a820 con 0x7fe524158ca0 2024-01-24T13:04:44.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.131+0000 7fe529400640 1 -- 172.21.15.29:0/2838712640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52415b1a0 con 0x7fe524158ca0 2024-01-24T13:04:44.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.135+0000 7fe51aa00640 1 -- 172.21.15.29:0/2838712640 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe51c014b20 con 0x7fe524158ca0 2024-01-24T13:04:44.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.135+0000 7fe51aa00640 1 --2- 172.21.15.29:0/2838712640 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe4fc065a60 0x7fe4fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.135+0000 7fe51aa00640 1 -- 172.21.15.29:0/2838712640 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fe51c083e00 con 0x7fe524158ca0 2024-01-24T13:04:44.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.135+0000 7fe522800640 1 --2- 172.21.15.29:0/2838712640 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe4fc065a60 0x7fe4fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.135+0000 7fe522800640 1 --2- 172.21.15.29:0/2838712640 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe4fc065a60 0x7fe4fc067f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe514006fd0 tx=0x7fe514008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:44.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.139+0000 7fe51aa00640 1 -- 172.21.15.29:0/2838712640 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe51c051420 con 0x7fe524158ca0 2024-01-24T13:04:44.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.295+0000 7fe529400640 1 -- 172.21.15.29:0/2838712640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe52404e850 con 0x7fe524158ca0 2024-01-24T13:04:44.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.299+0000 7fe51aa00640 1 -- 172.21.15.29:0/2838712640 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe51c054a40 con 0x7fe524158ca0 2024-01-24T13:04:44.301 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:44.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.299+0000 7fe529400640 1 -- 172.21.15.29:0/2838712640 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe4fc065a60 msgr2=0x7fe4fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.299+0000 7fe529400640 1 --2- 172.21.15.29:0/2838712640 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe4fc065a60 0x7fe4fc067f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe514006fd0 tx=0x7fe514008040 comp rx=0 tx=0).stop 2024-01-24T13:04:44.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.299+0000 7fe529400640 1 -- 172.21.15.29:0/2838712640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe524158ca0 msgr2=0x7fe5240cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.299+0000 7fe529400640 1 --2- 172.21.15.29:0/2838712640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe524158ca0 0x7fe5240cc660 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe51c007e30 tx=0x7fe51c00e4b0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.299+0000 7fe529400640 1 -- 172.21.15.29:0/2838712640 shutdown_connections 2024-01-24T13:04:44.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.299+0000 7fe529400640 1 --2- 172.21.15.29:0/2838712640 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe4fc065a60 0x7fe4fc067f20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.299+0000 7fe529400640 1 --2- 172.21.15.29:0/2838712640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe524158ca0 0x7fe5240cc660 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.299+0000 7fe529400640 1 --2- 172.21.15.29:0/2838712640 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5240ce640 0x7fe524159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.299+0000 7fe529400640 1 --2- 172.21.15.29:0/2838712640 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5240ce1e0 0x7fe52413a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.299+0000 7fe529400640 1 -- 172.21.15.29:0/2838712640 >> 172.21.15.29:0/2838712640 conn(0x7fe52406d700 msgr2=0x7fe52415c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:44.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.299+0000 7fe529400640 1 -- 172.21.15.29:0/2838712640 shutdown_connections 2024-01-24T13:04:44.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.299+0000 7fe529400640 1 -- 172.21.15.29:0/2838712640 wait complete. 2024-01-24T13:04:44.323 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:04:44.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.463+0000 7fc4bdc00640 1 Processor -- start 2024-01-24T13:04:44.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.463+0000 7fc4bdc00640 1 -- start start 2024-01-24T13:04:44.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.467+0000 7fc4bdc00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc4b806be20 0x7fc4b815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.467+0000 7fc4bdc00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc4b813d4b0 0x7fc4b815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.467+0000 7fc4bdc00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b815b4f0 con 0x7fc4b806c200 2024-01-24T13:04:44.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.467+0000 7fc4bdc00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b815b7d0 con 0x7fc4b806be20 2024-01-24T13:04:44.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.467+0000 7fc4bdc00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b80cd0c0 con 0x7fc4b813d4b0 2024-01-24T13:04:44.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.467+0000 7fc4b6a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc4b806be20 0x7fc4b815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.467+0000 7fc4b6a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc4b806be20 0x7fc4b815a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52600/0 (socket says 172.21.15.29:52600) 2024-01-24T13:04:44.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.467+0000 7fc4b6a00640 1 -- 172.21.15.29:0/3409936116 learned_addr learned my addr 172.21.15.29:0/3409936116 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:44.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.467+0000 7fc4b7400640 1 --2- 172.21.15.29:0/3409936116 >> v2:172.21.15.163:3300/0 conn(0x7fc4b813d4b0 0x7fc4b815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.467+0000 7fc4b6a00640 1 -- 172.21.15.29:0/3409936116 >> v2:172.21.15.163:3300/0 conn(0x7fc4b813d4b0 msgr2=0x7fc4b815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:44.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.467+0000 7fc4b6a00640 1 --2- 172.21.15.29:0/3409936116 >> v2:172.21.15.163:3300/0 conn(0x7fc4b813d4b0 0x7fc4b815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.467+0000 7fc4b6a00640 1 -- 172.21.15.29:0/3409936116 >> v1:172.21.15.163:6789/0 conn(0x7fc4b806c200 legacy=0x7fc4b813cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.467+0000 7fc4b6a00640 1 -- 172.21.15.29:0/3409936116 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b80cd3a0 con 0x7fc4b806be20 2024-01-24T13:04:44.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.467+0000 7fc4b6a00640 1 --2- 172.21.15.29:0/3409936116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4b806be20 0x7fc4b815a9c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8155010 tx=0x7fc4a801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3759dfc2fd7e40b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:44.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4b5600640 1 -- 172.21.15.29:0/3409936116 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80aa680 con 0x7fc4b806be20 2024-01-24T13:04:44.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4b5600640 1 -- 172.21.15.29:0/3409936116 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a80aa7e0 con 0x7fc4b806be20 2024-01-24T13:04:44.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4b5600640 1 -- 172.21.15.29:0/3409936116 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80aab70 con 0x7fc4b806be20 2024-01-24T13:04:44.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 -- 172.21.15.29:0/3409936116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4b806be20 msgr2=0x7fc4b815a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 --2- 172.21.15.29:0/3409936116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4b806be20 0x7fc4b815a9c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8155010 tx=0x7fc4a801c4c0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 -- 172.21.15.29:0/3409936116 shutdown_connections 2024-01-24T13:04:44.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 --2- 172.21.15.29:0/3409936116 >> v2:172.21.15.163:3300/0 conn(0x7fc4b813d4b0 0x7fc4b815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 --2- 172.21.15.29:0/3409936116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4b806be20 0x7fc4b815a9c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 -- 172.21.15.29:0/3409936116 >> 172.21.15.29:0/3409936116 conn(0x7fc4b806d700 msgr2=0x7fc4b8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:44.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 -- 172.21.15.29:0/3409936116 shutdown_connections 2024-01-24T13:04:44.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 -- 172.21.15.29:0/3409936116 wait complete. 2024-01-24T13:04:44.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 Processor -- start 2024-01-24T13:04:44.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 -- start start 2024-01-24T13:04:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4b806be20 0x7fc4b8138630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4b806c200 0x7fc4b814ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4b813d4b0 0x7fc4b80b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b8149460 con 0x7fc4b813d4b0 2024-01-24T13:04:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b8150e30 con 0x7fc4b806c200 2024-01-24T13:04:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.471+0000 7fc4bdc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b8138b70 con 0x7fc4b806be20 2024-01-24T13:04:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4b813d4b0 0x7fc4b80b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4b813d4b0 0x7fc4b80b0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52610/0 (socket says 172.21.15.29:52610) 2024-01-24T13:04:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4b7400640 1 -- 172.21.15.29:0/704040125 learned_addr learned my addr 172.21.15.29:0/704040125 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4b6000640 1 --2- 172.21.15.29:0/704040125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4b806c200 0x7fc4b814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4b6a00640 1 --2- 172.21.15.29:0/704040125 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4b806be20 0x7fc4b8138630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4b7400640 1 -- 172.21.15.29:0/704040125 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4b806be20 msgr2=0x7fc4b8138630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4b7400640 1 --2- 172.21.15.29:0/704040125 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4b806be20 0x7fc4b8138630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4b7400640 1 -- 172.21.15.29:0/704040125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4b806c200 msgr2=0x7fc4b814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4b7400640 1 --2- 172.21.15.29:0/704040125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4b806c200 0x7fc4b814ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4b7400640 1 -- 172.21.15.29:0/704040125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a80094d0 con 0x7fc4b813d4b0 2024-01-24T13:04:44.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4b7400640 1 --2- 172.21.15.29:0/704040125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4b813d4b0 0x7fc4b80b0ce0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009fd0 tx=0x7fc4b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:44.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4aea00640 1 -- 172.21.15.29:0/704040125 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0014420 con 0x7fc4b813d4b0 2024-01-24T13:04:44.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4aea00640 1 -- 172.21.15.29:0/704040125 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b0014580 con 0x7fc4b813d4b0 2024-01-24T13:04:44.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4aea00640 1 -- 172.21.15.29:0/704040125 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0014930 con 0x7fc4b813d4b0 2024-01-24T13:04:44.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4bdc00640 1 -- 172.21.15.29:0/704040125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b814f260 con 0x7fc4b813d4b0 2024-01-24T13:04:44.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4bdc00640 1 -- 172.21.15.29:0/704040125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b8150b50 con 0x7fc4b813d4b0 2024-01-24T13:04:44.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4bdc00640 1 -- 172.21.15.29:0/704040125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b81495a0 con 0x7fc4b813d4b0 2024-01-24T13:04:44.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4aea00640 1 -- 172.21.15.29:0/704040125 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc4b0014a90 con 0x7fc4b813d4b0 2024-01-24T13:04:44.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.475+0000 7fc4aea00640 1 --2- 172.21.15.29:0/704040125 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc490065a60 0x7fc490067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.479+0000 7fc4aea00640 1 -- 172.21.15.29:0/704040125 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fc4b0083e60 con 0x7fc4b813d4b0 2024-01-24T13:04:44.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.479+0000 7fc4b6a00640 1 --2- 172.21.15.29:0/704040125 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc490065a60 0x7fc490067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.479+0000 7fc4b6a00640 1 --2- 172.21.15.29:0/704040125 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc490065a60 0x7fc490067f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80ae000 tx=0x7fc4a80a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:44.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.483+0000 7fc4aea00640 1 -- 172.21.15.29:0/704040125 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc4b81495a0 con 0x7fc4b813d4b0 2024-01-24T13:04:44.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.643+0000 7fc4bdc00640 1 -- 172.21.15.29:0/704040125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc4b81495a0 con 0x7fc4b813d4b0 2024-01-24T13:04:44.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.647+0000 7fc4aea00640 1 -- 172.21.15.29:0/704040125 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc4b81495a0 con 0x7fc4b813d4b0 2024-01-24T13:04:44.649 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:04:44.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.647+0000 7fc4bdc00640 1 -- 172.21.15.29:0/704040125 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc490065a60 msgr2=0x7fc490067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.647+0000 7fc4bdc00640 1 --2- 172.21.15.29:0/704040125 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc490065a60 0x7fc490067f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80ae000 tx=0x7fc4a80a7000 comp rx=0 tx=0).stop 2024-01-24T13:04:44.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.647+0000 7fc4bdc00640 1 -- 172.21.15.29:0/704040125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4b813d4b0 msgr2=0x7fc4b80b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.647+0000 7fc4bdc00640 1 --2- 172.21.15.29:0/704040125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4b813d4b0 0x7fc4b80b0ce0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009fd0 tx=0x7fc4b000e4b0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.647+0000 7fc4bdc00640 1 -- 172.21.15.29:0/704040125 shutdown_connections 2024-01-24T13:04:44.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.647+0000 7fc4bdc00640 1 --2- 172.21.15.29:0/704040125 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc490065a60 0x7fc490067f20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.647+0000 7fc4bdc00640 1 --2- 172.21.15.29:0/704040125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4b813d4b0 0x7fc4b80b0ce0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.647+0000 7fc4bdc00640 1 --2- 172.21.15.29:0/704040125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4b806c200 0x7fc4b814ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.647+0000 7fc4bdc00640 1 --2- 172.21.15.29:0/704040125 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4b806be20 0x7fc4b8138630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.647+0000 7fc4bdc00640 1 -- 172.21.15.29:0/704040125 >> 172.21.15.29:0/704040125 conn(0x7fc4b806d700 msgr2=0x7fc4b814a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:44.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.647+0000 7fc4bdc00640 1 -- 172.21.15.29:0/704040125 shutdown_connections 2024-01-24T13:04:44.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.647+0000 7fc4bdc00640 1 -- 172.21.15.29:0/704040125 wait complete. 2024-01-24T13:04:44.671 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:04:44.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.811+0000 7f90dc800640 1 Processor -- start 2024-01-24T13:04:44.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.811+0000 7f90dc800640 1 -- start start 2024-01-24T13:04:44.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.811+0000 7f90dc800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f90d415a6f0 0x7f90d40c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.811+0000 7f90dc800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d40ceb10 0x7f90d40cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.811+0000 7f90dc800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f90d40caad0 0x7f90d40caf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.811+0000 7f90dc800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d40cb4a0 con 0x7f90d40caad0 2024-01-24T13:04:44.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.811+0000 7f90dc800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d415aad0 con 0x7f90d415a6f0 2024-01-24T13:04:44.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.811+0000 7f90dc800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40cd1e0 con 0x7f90d40ceb10 2024-01-24T13:04:44.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.811+0000 7f90da800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f90d40caad0 0x7f90d40caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.811+0000 7f90da800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f90d40caad0 0x7f90d40caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52616/0 (socket says 172.21.15.29:52616) 2024-01-24T13:04:44.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.811+0000 7f90da800640 1 -- 172.21.15.29:0/3676127722 learned_addr learned my addr 172.21.15.29:0/3676127722 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:44.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.815+0000 7f90d9e00640 1 --2- 172.21.15.29:0/3676127722 >> v2:172.21.15.163:3300/0 conn(0x7f90d415a6f0 0x7f90d40c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.815+0000 7f90d9400640 1 --2- 172.21.15.29:0/3676127722 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d40ceb10 0x7f90d40cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.815+0000 7f90da800640 1 -- 172.21.15.29:0/3676127722 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d40ceb10 msgr2=0x7f90d40cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:44.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.815+0000 7f90da800640 1 --2- 172.21.15.29:0/3676127722 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d40ceb10 0x7f90d40cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.815+0000 7f90da800640 1 -- 172.21.15.29:0/3676127722 >> v2:172.21.15.163:3300/0 conn(0x7f90d415a6f0 msgr2=0x7f90d40c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:44.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.815+0000 7f90da800640 1 --2- 172.21.15.29:0/3676127722 >> v2:172.21.15.163:3300/0 conn(0x7f90d415a6f0 0x7f90d40c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.815+0000 7f90da800640 1 -- 172.21.15.29:0/3676127722 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d40cd4c0 con 0x7f90d40caad0 2024-01-24T13:04:44.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.815+0000 7f90d9e00640 1 --2- 172.21.15.29:0/3676127722 >> v2:172.21.15.163:3300/0 conn(0x7f90d415a6f0 0x7f90d40c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:44.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.815+0000 7f90da800640 1 --2- 172.21.15.29:0/3676127722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40caad0 0x7f90d40caf60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f90d40cce60 tx=0x7f90cc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07e796a3cb318de server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:44.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.815+0000 7f90d8a00640 1 -- 172.21.15.29:0/3676127722 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc0a5790 con 0x7f90d40caad0 2024-01-24T13:04:44.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.815+0000 7f90d8a00640 1 -- 172.21.15.29:0/3676127722 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90cc0a58f0 con 0x7f90d40caad0 2024-01-24T13:04:44.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.815+0000 7f90d8a00640 1 -- 172.21.15.29:0/3676127722 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc0a5c80 con 0x7f90d40caad0 2024-01-24T13:04:44.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 -- 172.21.15.29:0/3676127722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40caad0 msgr2=0x7f90d40caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 --2- 172.21.15.29:0/3676127722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40caad0 0x7f90d40caf60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f90d40cce60 tx=0x7f90cc01c910 comp rx=0 tx=0).stop 2024-01-24T13:04:44.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 -- 172.21.15.29:0/3676127722 shutdown_connections 2024-01-24T13:04:44.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 --2- 172.21.15.29:0/3676127722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40caad0 0x7f90d40caf60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 --2- 172.21.15.29:0/3676127722 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d40ceb10 0x7f90d40cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 --2- 172.21.15.29:0/3676127722 >> v2:172.21.15.163:3300/0 conn(0x7f90d415a6f0 0x7f90d40c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 -- 172.21.15.29:0/3676127722 >> 172.21.15.29:0/3676127722 conn(0x7f90d4069cd0 msgr2=0x7f90d406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:44.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 -- 172.21.15.29:0/3676127722 shutdown_connections 2024-01-24T13:04:44.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 -- 172.21.15.29:0/3676127722 wait complete. 2024-01-24T13:04:44.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 Processor -- start 2024-01-24T13:04:44.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 -- start start 2024-01-24T13:04:44.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40caad0 0x7f90d40ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d40ceb10 0x7f90d40b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90d415a6f0 0x7f90d41f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40ca540 con 0x7f90d40caad0 2024-01-24T13:04:44.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40b3940 con 0x7f90d415a6f0 2024-01-24T13:04:44.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90dc800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40b3610 con 0x7f90d40ceb10 2024-01-24T13:04:44.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90d9e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40caad0 0x7f90d40ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90d9e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40caad0 0x7f90d40ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52620/0 (socket says 172.21.15.29:52620) 2024-01-24T13:04:44.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90d9e00640 1 -- 172.21.15.29:0/1695400229 learned_addr learned my addr 172.21.15.29:0/1695400229 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:44.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90da800640 1 --2- 172.21.15.29:0/1695400229 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90d415a6f0 0x7f90d41f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90d9400640 1 --2- 172.21.15.29:0/1695400229 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d40ceb10 0x7f90d40b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90d9e00640 1 -- 172.21.15.29:0/1695400229 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d40ceb10 msgr2=0x7f90d40b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90d9e00640 1 --2- 172.21.15.29:0/1695400229 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d40ceb10 0x7f90d40b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90d9e00640 1 -- 172.21.15.29:0/1695400229 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90d415a6f0 msgr2=0x7f90d41f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90d9e00640 1 --2- 172.21.15.29:0/1695400229 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90d415a6f0 0x7f90d41f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.819+0000 7f90d9e00640 1 -- 172.21.15.29:0/1695400229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc009b30 con 0x7f90d40caad0 2024-01-24T13:04:44.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.823+0000 7f90d9e00640 1 --2- 172.21.15.29:0/1695400229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40caad0 0x7f90d40ca000 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f90c400d800 tx=0x7f90c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:44.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.823+0000 7f90d2000640 1 -- 172.21.15.29:0/1695400229 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400b6c0 con 0x7f90d40caad0 2024-01-24T13:04:44.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.823+0000 7f90d2000640 1 -- 172.21.15.29:0/1695400229 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c400b820 con 0x7f90d40caad0 2024-01-24T13:04:44.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.823+0000 7f90d2000640 1 -- 172.21.15.29:0/1695400229 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400bbd0 con 0x7f90d40caad0 2024-01-24T13:04:44.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.823+0000 7f90dc800640 1 -- 172.21.15.29:0/1695400229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d40b5d80 con 0x7f90d40caad0 2024-01-24T13:04:44.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.823+0000 7f90dc800640 1 -- 172.21.15.29:0/1695400229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d40b6340 con 0x7f90d40caad0 2024-01-24T13:04:44.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.823+0000 7f90dc800640 1 -- 172.21.15.29:0/1695400229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d404e850 con 0x7f90d40caad0 2024-01-24T13:04:44.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.823+0000 7f90d2000640 1 -- 172.21.15.29:0/1695400229 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f90c400bd30 con 0x7f90d40caad0 2024-01-24T13:04:44.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.823+0000 7f90d2000640 1 --2- 172.21.15.29:0/1695400229 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f90ac065a60 0x7f90ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.823+0000 7f90d2000640 1 -- 172.21.15.29:0/1695400229 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f90c4083850 con 0x7f90d40caad0 2024-01-24T13:04:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.823+0000 7f90d9400640 1 --2- 172.21.15.29:0/1695400229 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f90ac065a60 0x7f90ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:44.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.827+0000 7f90d9400640 1 --2- 172.21.15.29:0/1695400229 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f90ac065a60 0x7f90ac067f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f90d406a220 tx=0x7f90bc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:44.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.827+0000 7f90d2000640 1 -- 172.21.15.29:0/1695400229 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f90c4050f80 con 0x7f90d40caad0 2024-01-24T13:04:44.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.987+0000 7f90dc800640 1 -- 172.21.15.29:0/1695400229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f90d40b29c0 con 0x7f90d40caad0 2024-01-24T13:04:44.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.987+0000 7f90d2000640 1 -- 172.21.15.29:0/1695400229 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f90c40545a0 con 0x7f90d40caad0 2024-01-24T13:04:44.990 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:44.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.987+0000 7f90dc800640 1 -- 172.21.15.29:0/1695400229 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f90ac065a60 msgr2=0x7f90ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.987+0000 7f90dc800640 1 --2- 172.21.15.29:0/1695400229 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f90ac065a60 0x7f90ac067f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f90d406a220 tx=0x7f90bc008040 comp rx=0 tx=0).stop 2024-01-24T13:04:44.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.987+0000 7f90dc800640 1 -- 172.21.15.29:0/1695400229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40caad0 msgr2=0x7f90d40ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:44.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.987+0000 7f90dc800640 1 --2- 172.21.15.29:0/1695400229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40caad0 0x7f90d40ca000 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f90c400d800 tx=0x7f90c400dcc0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.987+0000 7f90dc800640 1 -- 172.21.15.29:0/1695400229 shutdown_connections 2024-01-24T13:04:44.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.987+0000 7f90dc800640 1 --2- 172.21.15.29:0/1695400229 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f90ac065a60 0x7f90ac067f20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.987+0000 7f90dc800640 1 --2- 172.21.15.29:0/1695400229 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90d415a6f0 0x7f90d41f4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.987+0000 7f90dc800640 1 --2- 172.21.15.29:0/1695400229 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f90d40ceb10 0x7f90d40b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.987+0000 7f90dc800640 1 --2- 172.21.15.29:0/1695400229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90d40caad0 0x7f90d40ca000 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:44.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.987+0000 7f90dc800640 1 -- 172.21.15.29:0/1695400229 >> 172.21.15.29:0/1695400229 conn(0x7f90d4069cd0 msgr2=0x7f90d4159960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:44.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.987+0000 7f90dc800640 1 -- 172.21.15.29:0/1695400229 shutdown_connections 2024-01-24T13:04:44.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:44.987+0000 7f90dc800640 1 -- 172.21.15.29:0/1695400229 wait complete. 2024-01-24T13:04:45.011 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:45.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.147+0000 7f0889a00640 1 Processor -- start 2024-01-24T13:04:45.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0889a00640 1 -- start start 2024-01-24T13:04:45.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0889a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f08841588d0 0x7f0884158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0889a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0884070950 0x7f08840b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0889a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088415c830 con 0x7f08841591f0 2024-01-24T13:04:45.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0889a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088415cb10 con 0x7f0884070950 2024-01-24T13:04:45.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0889a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088415cdf0 con 0x7f08841588d0 2024-01-24T13:04:45.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0883400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0884070950 0x7f08840b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0883400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0884070950 0x7f08840b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52636/0 (socket says 172.21.15.29:52636) 2024-01-24T13:04:45.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0883400640 1 -- 172.21.15.29:0/1189285975 learned_addr learned my addr 172.21.15.29:0/1189285975 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:45.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0882a00640 1 --2- 172.21.15.29:0/1189285975 >> v2:172.21.15.163:3300/0 conn(0x7f08841588d0 0x7f0884158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0883400640 1 -- 172.21.15.29:0/1189285975 >> v2:172.21.15.163:3300/0 conn(0x7f08841588d0 msgr2=0x7f0884158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:45.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0883400640 1 --2- 172.21.15.29:0/1189285975 >> v2:172.21.15.163:3300/0 conn(0x7f08841588d0 0x7f0884158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0883400640 1 -- 172.21.15.29:0/1189285975 >> v1:172.21.15.163:6789/0 conn(0x7f08841591f0 legacy=0x7f0884070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:45.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0883400640 1 -- 172.21.15.29:0/1189285975 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088415d0d0 con 0x7f0884070950 2024-01-24T13:04:45.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.151+0000 7f0882a00640 1 --2- 172.21.15.29:0/1189285975 >> v2:172.21.15.163:3300/0 conn(0x7f08841588d0 0x7f0884158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:45.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.155+0000 7f0883400640 1 --2- 172.21.15.29:0/1189285975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0884070950 0x7f08840b1fb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f08840cf260 tx=0x7f087c01c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206cd7df91ee69aa server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:45.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.155+0000 7f0881600640 1 -- 172.21.15.29:0/1189285975 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c0a64a0 con 0x7f0884070950 2024-01-24T13:04:45.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.155+0000 7f0881600640 1 -- 172.21.15.29:0/1189285975 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c0a6600 con 0x7f0884070950 2024-01-24T13:04:45.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.155+0000 7f0881600640 1 -- 172.21.15.29:0/1189285975 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c0a6990 con 0x7f0884070950 2024-01-24T13:04:45.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.155+0000 7f0889a00640 1 -- 172.21.15.29:0/1189285975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0884070950 msgr2=0x7f08840b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:45.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.155+0000 7f0889a00640 1 --2- 172.21.15.29:0/1189285975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0884070950 0x7f08840b1fb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f08840cf260 tx=0x7f087c01c840 comp rx=0 tx=0).stop 2024-01-24T13:04:45.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.155+0000 7f0889a00640 1 -- 172.21.15.29:0/1189285975 shutdown_connections 2024-01-24T13:04:45.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.155+0000 7f0889a00640 1 --2- 172.21.15.29:0/1189285975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0884070950 0x7f08840b1fb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.155+0000 7f0889a00640 1 --2- 172.21.15.29:0/1189285975 >> v2:172.21.15.163:3300/0 conn(0x7f08841588d0 0x7f0884158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.155+0000 7f0889a00640 1 -- 172.21.15.29:0/1189285975 >> 172.21.15.29:0/1189285975 conn(0x7f08840b3950 msgr2=0x7f0884069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:45.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.155+0000 7f0889a00640 1 -- 172.21.15.29:0/1189285975 shutdown_connections 2024-01-24T13:04:45.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.155+0000 7f0889a00640 1 -- 172.21.15.29:0/1189285975 wait complete. 2024-01-24T13:04:45.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0889a00640 1 Processor -- start 2024-01-24T13:04:45.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0889a00640 1 -- start start 2024-01-24T13:04:45.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0889a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0884070950 0x7f08841500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0889a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08841588d0 0x7f088415b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0889a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08840cbfb0 0x7f08840cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0889a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08841505f0 con 0x7f08840cbfb0 2024-01-24T13:04:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0889a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08840cb560 con 0x7f08841588d0 2024-01-24T13:04:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0889a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088415c130 con 0x7f0884070950 2024-01-24T13:04:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0883400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08840cbfb0 0x7f08840cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0883400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08840cbfb0 0x7f08840cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52640/0 (socket says 172.21.15.29:52640) 2024-01-24T13:04:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0883400640 1 -- 172.21.15.29:0/3792146915 learned_addr learned my addr 172.21.15.29:0/3792146915 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0882a00640 1 --2- 172.21.15.29:0/3792146915 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0884070950 0x7f08841500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0882000640 1 --2- 172.21.15.29:0/3792146915 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08841588d0 0x7f088415b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0883400640 1 -- 172.21.15.29:0/3792146915 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0884070950 msgr2=0x7f08841500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0883400640 1 --2- 172.21.15.29:0/3792146915 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0884070950 0x7f08841500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0883400640 1 -- 172.21.15.29:0/3792146915 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08841588d0 msgr2=0x7f088415b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0883400640 1 --2- 172.21.15.29:0/3792146915 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08841588d0 0x7f088415b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0883400640 1 -- 172.21.15.29:0/3792146915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c009b30 con 0x7f08840cbfb0 2024-01-24T13:04:45.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0883400640 1 --2- 172.21.15.29:0/3792146915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08840cbfb0 0x7f08840cce80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f087c01a470 tx=0x7f087c0195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:45.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f087aa00640 1 -- 172.21.15.29:0/3792146915 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c0a7680 con 0x7f08840cbfb0 2024-01-24T13:04:45.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f087aa00640 1 -- 172.21.15.29:0/3792146915 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c0a77e0 con 0x7f08840cbfb0 2024-01-24T13:04:45.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0889a00640 1 -- 172.21.15.29:0/3792146915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088415a3e0 con 0x7f08840cbfb0 2024-01-24T13:04:45.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f087aa00640 1 -- 172.21.15.29:0/3792146915 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c0a7b50 con 0x7f08840cbfb0 2024-01-24T13:04:45.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0889a00640 1 -- 172.21.15.29:0/3792146915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08840cb7b0 con 0x7f08840cbfb0 2024-01-24T13:04:45.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.159+0000 7f0889a00640 1 -- 172.21.15.29:0/3792146915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088404e850 con 0x7f08840cbfb0 2024-01-24T13:04:45.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.163+0000 7f087aa00640 1 -- 172.21.15.29:0/3792146915 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f087c0a7cb0 con 0x7f08840cbfb0 2024-01-24T13:04:45.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.163+0000 7f087aa00640 1 --2- 172.21.15.29:0/3792146915 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f085c065a60 0x7f085c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.163+0000 7f087aa00640 1 -- 172.21.15.29:0/3792146915 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f087c11db00 con 0x7f08840cbfb0 2024-01-24T13:04:45.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.163+0000 7f0882a00640 1 --2- 172.21.15.29:0/3792146915 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f085c065a60 0x7f085c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.163+0000 7f0882a00640 1 --2- 172.21.15.29:0/3792146915 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f085c065a60 0x7f085c067f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f088406ff40 tx=0x7f0874008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:45.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.167+0000 7f087aa00640 1 -- 172.21.15.29:0/3792146915 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f087c11fe60 con 0x7f08840cbfb0 2024-01-24T13:04:45.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.323+0000 7f0889a00640 1 -- 172.21.15.29:0/3792146915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0884163780 con 0x7f08840cbfb0 2024-01-24T13:04:45.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.323+0000 7f087aa00640 1 -- 172.21.15.29:0/3792146915 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7f087c0eb1a0 con 0x7f08840cbfb0 2024-01-24T13:04:45.328 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:45.328 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:45.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.327+0000 7f0889a00640 1 -- 172.21.15.29:0/3792146915 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f085c065a60 msgr2=0x7f085c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:45.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.327+0000 7f0889a00640 1 --2- 172.21.15.29:0/3792146915 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f085c065a60 0x7f085c067f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f088406ff40 tx=0x7f0874008040 comp rx=0 tx=0).stop 2024-01-24T13:04:45.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.327+0000 7f0889a00640 1 -- 172.21.15.29:0/3792146915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08840cbfb0 msgr2=0x7f08840cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:45.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.327+0000 7f0889a00640 1 --2- 172.21.15.29:0/3792146915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08840cbfb0 0x7f08840cce80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f087c01a470 tx=0x7f087c0195e0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.327+0000 7f0889a00640 1 -- 172.21.15.29:0/3792146915 shutdown_connections 2024-01-24T13:04:45.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.327+0000 7f0889a00640 1 --2- 172.21.15.29:0/3792146915 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f085c065a60 0x7f085c067f20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.327+0000 7f0889a00640 1 --2- 172.21.15.29:0/3792146915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08840cbfb0 0x7f08840cce80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.327+0000 7f0889a00640 1 --2- 172.21.15.29:0/3792146915 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08841588d0 0x7f088415b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.327+0000 7f0889a00640 1 --2- 172.21.15.29:0/3792146915 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0884070950 0x7f08841500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.327+0000 7f0889a00640 1 -- 172.21.15.29:0/3792146915 >> 172.21.15.29:0/3792146915 conn(0x7f08840b3950 msgr2=0x7f08840b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:45.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.327+0000 7f0889a00640 1 -- 172.21.15.29:0/3792146915 shutdown_connections 2024-01-24T13:04:45.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.327+0000 7f0889a00640 1 -- 172.21.15.29:0/3792146915 wait complete. 2024-01-24T13:04:45.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:04:45.352 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:04:45.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.491+0000 7fb6fbe00640 1 Processor -- start 2024-01-24T13:04:45.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.491+0000 7fb6fbe00640 1 -- start start 2024-01-24T13:04:45.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6fbe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb6f4158ca0 0x7fb6f40b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6fbe00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6f406bbc0 0x7fb6f406c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6fbe00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb6f406fe50 0x7fb6f40702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6fbe00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f4159080 con 0x7fb6f4158ca0 2024-01-24T13:04:45.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6fbe00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f406c560 con 0x7fb6f406fe50 2024-01-24T13:04:45.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6fbe00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f4070ba0 con 0x7fb6f406bbc0 2024-01-24T13:04:45.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6f9400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb6f4158ca0 0x7fb6f40b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6f9400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb6f4158ca0 0x7fb6f40b2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52652/0 (socket says 172.21.15.29:52652) 2024-01-24T13:04:45.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6f9400640 1 -- 172.21.15.29:0/3986951419 learned_addr learned my addr 172.21.15.29:0/3986951419 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:45.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6f9e00640 1 --2- 172.21.15.29:0/3986951419 >> v2:172.21.15.163:3300/0 conn(0x7fb6f406fe50 0x7fb6f40702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6f8a00640 1 --2- 172.21.15.29:0/3986951419 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6f406bbc0 0x7fb6f406c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6f9400640 1 -- 172.21.15.29:0/3986951419 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6f406bbc0 msgr2=0x7fb6f406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:45.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6f9400640 1 --2- 172.21.15.29:0/3986951419 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6f406bbc0 0x7fb6f406c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6f9400640 1 -- 172.21.15.29:0/3986951419 >> v2:172.21.15.163:3300/0 conn(0x7fb6f406fe50 msgr2=0x7fb6f40702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:45.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6f9400640 1 --2- 172.21.15.29:0/3986951419 >> v2:172.21.15.163:3300/0 conn(0x7fb6f406fe50 0x7fb6f40702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6f9400640 1 -- 172.21.15.29:0/3986951419 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f40b18c0 con 0x7fb6f4158ca0 2024-01-24T13:04:45.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.495+0000 7fb6f9400640 1 --2- 172.21.15.29:0/3986951419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6f4158ca0 0x7fb6f40b2680 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb6f406ce60 tx=0x7fb6e401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3813e455e398bfae server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:45.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6f3e00640 1 -- 172.21.15.29:0/3986951419 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e40a7bb0 con 0x7fb6f4158ca0 2024-01-24T13:04:45.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6f3e00640 1 -- 172.21.15.29:0/3986951419 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e40a7d10 con 0x7fb6f4158ca0 2024-01-24T13:04:45.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6f3e00640 1 -- 172.21.15.29:0/3986951419 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e40af660 con 0x7fb6f4158ca0 2024-01-24T13:04:45.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6fbe00640 1 -- 172.21.15.29:0/3986951419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6f4158ca0 msgr2=0x7fb6f40b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:45.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6fbe00640 1 --2- 172.21.15.29:0/3986951419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6f4158ca0 0x7fb6f40b2680 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb6f406ce60 tx=0x7fb6e401eba0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6fbe00640 1 -- 172.21.15.29:0/3986951419 shutdown_connections 2024-01-24T13:04:45.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6fbe00640 1 --2- 172.21.15.29:0/3986951419 >> v2:172.21.15.163:3300/0 conn(0x7fb6f406fe50 0x7fb6f40702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6fbe00640 1 --2- 172.21.15.29:0/3986951419 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6f406bbc0 0x7fb6f406c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6fbe00640 1 --2- 172.21.15.29:0/3986951419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6f4158ca0 0x7fb6f40b2680 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6fbe00640 1 -- 172.21.15.29:0/3986951419 >> 172.21.15.29:0/3986951419 conn(0x7fb6f406d700 msgr2=0x7fb6f4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:45.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6fbe00640 1 -- 172.21.15.29:0/3986951419 shutdown_connections 2024-01-24T13:04:45.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6fbe00640 1 -- 172.21.15.29:0/3986951419 wait complete. 2024-01-24T13:04:45.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6fbe00640 1 Processor -- start 2024-01-24T13:04:45.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6fbe00640 1 -- start start 2024-01-24T13:04:45.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.499+0000 7fb6fbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6f406bbc0 0x7fb6f4154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6fbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6f406fe50 0x7fb6f40cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6fbe00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6f4158ca0 0x7fb6f41528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6fbe00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f4153480 con 0x7fb6f406fe50 2024-01-24T13:04:45.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6fbe00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f40cc020 con 0x7fb6f406bbc0 2024-01-24T13:04:45.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6fbe00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f40cc300 con 0x7fb6f4158ca0 2024-01-24T13:04:45.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f8a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6f406fe50 0x7fb6f40cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f8a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6f406fe50 0x7fb6f40cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52660/0 (socket says 172.21.15.29:52660) 2024-01-24T13:04:45.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f8a00640 1 -- 172.21.15.29:0/1088814225 learned_addr learned my addr 172.21.15.29:0/1088814225 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:45.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f9400640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6f406bbc0 0x7fb6f4154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f9e00640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6f4158ca0 0x7fb6f41528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f8a00640 1 -- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6f4158ca0 msgr2=0x7fb6f41528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:45.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f8a00640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6f4158ca0 0x7fb6f41528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f8a00640 1 -- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6f406bbc0 msgr2=0x7fb6f4154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:45.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f8a00640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6f406bbc0 0x7fb6f4154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f8a00640 1 -- 172.21.15.29:0/1088814225 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e400b770 con 0x7fb6f406fe50 2024-01-24T13:04:45.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f9400640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6f406bbc0 0x7fb6f4154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:45.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f8a00640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6f406fe50 0x7fb6f40cc820 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00d800 tx=0x7fb6dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:45.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f1600640 1 -- 172.21.15.29:0/1088814225 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc00b6c0 con 0x7fb6f406fe50 2024-01-24T13:04:45.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f1600640 1 -- 172.21.15.29:0/1088814225 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6dc00b820 con 0x7fb6f406fe50 2024-01-24T13:04:45.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6fbe00640 1 -- 172.21.15.29:0/1088814225 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f40ccd60 con 0x7fb6f406fe50 2024-01-24T13:04:45.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f1600640 1 -- 172.21.15.29:0/1088814225 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc00bb90 con 0x7fb6f406fe50 2024-01-24T13:04:45.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6fbe00640 1 -- 172.21.15.29:0/1088814225 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f4142590 con 0x7fb6f406fe50 2024-01-24T13:04:45.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6fbe00640 1 -- 172.21.15.29:0/1088814225 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f404e850 con 0x7fb6f406fe50 2024-01-24T13:04:45.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.503+0000 7fb6f1600640 1 -- 172.21.15.29:0/1088814225 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb6dc00bcf0 con 0x7fb6f406fe50 2024-01-24T13:04:45.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.507+0000 7fb6f1600640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb6cc065a60 0x7fb6cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.507+0000 7fb6f1600640 1 -- 172.21.15.29:0/1088814225 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fb6dc083a20 con 0x7fb6f406fe50 2024-01-24T13:04:45.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.507+0000 7fb6f9400640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb6cc065a60 0x7fb6cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.507+0000 7fb6f9400640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb6cc065a60 0x7fb6cc067f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40b1000 tx=0x7fb6e40a9070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:45.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.511+0000 7fb6f1600640 1 -- 172.21.15.29:0/1088814225 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb6dc0510a0 con 0x7fb6f406fe50 2024-01-24T13:04:45.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.671+0000 7fb6fbe00640 1 -- 172.21.15.29:0/1088814225 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6f40cc4c0 con 0x7fb6f406fe50 2024-01-24T13:04:45.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.671+0000 7fb6f1600640 1 -- 172.21.15.29:0/1088814225 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6dc0546c0 con 0x7fb6f406fe50 2024-01-24T13:04:45.674 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:04:45.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.671+0000 7fb6fbe00640 1 -- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb6cc065a60 msgr2=0x7fb6cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.671+0000 7fb6fbe00640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb6cc065a60 0x7fb6cc067f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40b1000 tx=0x7fb6e40a9070 comp rx=0 tx=0).stop 2024-01-24T13:04:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.671+0000 7fb6fbe00640 1 -- 172.21.15.29:0/1088814225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6f406fe50 msgr2=0x7fb6f40cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.671+0000 7fb6fbe00640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6f406fe50 0x7fb6f40cc820 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00d800 tx=0x7fb6dc00dcc0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.675+0000 7fb6fbe00640 1 -- 172.21.15.29:0/1088814225 shutdown_connections 2024-01-24T13:04:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.675+0000 7fb6fbe00640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb6cc065a60 0x7fb6cc067f20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.675+0000 7fb6fbe00640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6f4158ca0 0x7fb6f41528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.675+0000 7fb6fbe00640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6f406fe50 0x7fb6f40cc820 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.675+0000 7fb6fbe00640 1 --2- 172.21.15.29:0/1088814225 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6f406bbc0 0x7fb6f4154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.675+0000 7fb6fbe00640 1 -- 172.21.15.29:0/1088814225 >> 172.21.15.29:0/1088814225 conn(0x7fb6f406d700 msgr2=0x7fb6f415bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.675+0000 7fb6fbe00640 1 -- 172.21.15.29:0/1088814225 shutdown_connections 2024-01-24T13:04:45.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.675+0000 7fb6fbe00640 1 -- 172.21.15.29:0/1088814225 wait complete. 2024-01-24T13:04:45.696 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:04:45.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.835+0000 7f3539800640 1 Processor -- start 2024-01-24T13:04:45.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.839+0000 7f3539800640 1 -- start start 2024-01-24T13:04:45.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.839+0000 7f3539800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3534153a00 0x7f3534071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.839+0000 7f3539800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f35340b2760 0x7f35340b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.839+0000 7f3539800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3534153de0 con 0x7f35340b1130 2024-01-24T13:04:45.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.839+0000 7f3539800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35340b3150 con 0x7f3534153a00 2024-01-24T13:04:45.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.839+0000 7f3539800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353415df00 con 0x7f35340b2760 2024-01-24T13:04:45.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.839+0000 7f3532a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3534153a00 0x7f3534071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.839+0000 7f3532a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3534153a00 0x7f3534071600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52674/0 (socket says 172.21.15.29:52674) 2024-01-24T13:04:45.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.839+0000 7f3532a00640 1 -- 172.21.15.29:0/3618032116 learned_addr learned my addr 172.21.15.29:0/3618032116 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:45.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.839+0000 7f3532a00640 1 -- 172.21.15.29:0/3618032116 >> v2:172.21.15.163:3300/0 conn(0x7f35340b2760 msgr2=0x7f35340b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:45.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.839+0000 7f3532a00640 1 --2- 172.21.15.29:0/3618032116 >> v2:172.21.15.163:3300/0 conn(0x7f35340b2760 0x7f35340b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.839+0000 7f3532a00640 1 -- 172.21.15.29:0/3618032116 >> v1:172.21.15.163:6789/0 conn(0x7f35340b1130 legacy=0x7f35340b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:45.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.839+0000 7f3532a00640 1 -- 172.21.15.29:0/3618032116 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3534159900 con 0x7f3534153a00 2024-01-24T13:04:45.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.843+0000 7f3532a00640 1 --2- 172.21.15.29:0/3618032116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3534153a00 0x7f3534071600 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f353406a8c0 tx=0x7f352401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33522771dfef74e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:45.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.843+0000 7f3531600640 1 -- 172.21.15.29:0/3618032116 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240ab600 con 0x7f3534153a00 2024-01-24T13:04:45.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.843+0000 7f3531600640 1 -- 172.21.15.29:0/3618032116 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35240ab760 con 0x7f3534153a00 2024-01-24T13:04:45.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.843+0000 7f3531600640 1 -- 172.21.15.29:0/3618032116 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240abaf0 con 0x7f3534153a00 2024-01-24T13:04:45.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.843+0000 7f3539800640 1 -- 172.21.15.29:0/3618032116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3534153a00 msgr2=0x7f3534071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:45.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.843+0000 7f3539800640 1 --2- 172.21.15.29:0/3618032116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3534153a00 0x7f3534071600 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f353406a8c0 tx=0x7f352401c400 comp rx=0 tx=0).stop 2024-01-24T13:04:45.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.843+0000 7f3539800640 1 -- 172.21.15.29:0/3618032116 shutdown_connections 2024-01-24T13:04:45.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.843+0000 7f3539800640 1 --2- 172.21.15.29:0/3618032116 >> v2:172.21.15.163:3300/0 conn(0x7f35340b2760 0x7f35340b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.843+0000 7f3539800640 1 --2- 172.21.15.29:0/3618032116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3534153a00 0x7f3534071600 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.843+0000 7f3539800640 1 -- 172.21.15.29:0/3618032116 >> 172.21.15.29:0/3618032116 conn(0x7f353406d700 msgr2=0x7f3534069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:45.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.843+0000 7f3539800640 1 -- 172.21.15.29:0/3618032116 shutdown_connections 2024-01-24T13:04:45.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.843+0000 7f3539800640 1 -- 172.21.15.29:0/3618032116 wait complete. 2024-01-24T13:04:45.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.843+0000 7f3539800640 1 Processor -- start 2024-01-24T13:04:45.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.843+0000 7f3539800640 1 -- start start 2024-01-24T13:04:45.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3539800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35340b1130 0x7f353413ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3539800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f35340b2760 0x7f353415d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3539800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3534153a00 0x7f353415af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3539800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353413fa90 con 0x7f3534153a00 2024-01-24T13:04:45.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3539800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353413fd70 con 0x7f35340b2760 2024-01-24T13:04:45.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3539800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35340ccbf0 con 0x7f35340b1130 2024-01-24T13:04:45.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3533400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3534153a00 0x7f353415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3533400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3534153a00 0x7f353415af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52680/0 (socket says 172.21.15.29:52680) 2024-01-24T13:04:45.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3533400640 1 -- 172.21.15.29:0/2504190591 learned_addr learned my addr 172.21.15.29:0/2504190591 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:45.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3532a00640 1 --2- 172.21.15.29:0/2504190591 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35340b1130 0x7f353413ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3532000640 1 --2- 172.21.15.29:0/2504190591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f35340b2760 0x7f353415d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3533400640 1 -- 172.21.15.29:0/2504190591 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35340b1130 msgr2=0x7f353413ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:45.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3533400640 1 --2- 172.21.15.29:0/2504190591 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35340b1130 0x7f353413ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3533400640 1 -- 172.21.15.29:0/2504190591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f35340b2760 msgr2=0x7f353415d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:45.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3533400640 1 --2- 172.21.15.29:0/2504190591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f35340b2760 0x7f353415d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:45.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3533400640 1 -- 172.21.15.29:0/2504190591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35240094d0 con 0x7f3534153a00 2024-01-24T13:04:45.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3533400640 1 --2- 172.21.15.29:0/2504190591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3534153a00 0x7f353415af50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f352c00b990 tx=0x7f352c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:45.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f352aa00640 1 -- 172.21.15.29:0/2504190591 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c00cba0 con 0x7f3534153a00 2024-01-24T13:04:45.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f352aa00640 1 -- 172.21.15.29:0/2504190591 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c00cd00 con 0x7f3534153a00 2024-01-24T13:04:45.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f352aa00640 1 -- 172.21.15.29:0/2504190591 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c014680 con 0x7f3534153a00 2024-01-24T13:04:45.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3539800640 1 -- 172.21.15.29:0/2504190591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35340cced0 con 0x7f3534153a00 2024-01-24T13:04:45.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3539800640 1 -- 172.21.15.29:0/2504190591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353415bd40 con 0x7f3534153a00 2024-01-24T13:04:45.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.847+0000 7f3539800640 1 -- 172.21.15.29:0/2504190591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35340cd3f0 con 0x7f3534153a00 2024-01-24T13:04:45.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.851+0000 7f352aa00640 1 -- 172.21.15.29:0/2504190591 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f352c01d3b0 con 0x7f3534153a00 2024-01-24T13:04:45.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.851+0000 7f352aa00640 1 --2- 172.21.15.29:0/2504190591 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f350c065a60 0x7f350c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:45.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.851+0000 7f352aa00640 1 -- 172.21.15.29:0/2504190591 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f352c083440 con 0x7f3534153a00 2024-01-24T13:04:45.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.851+0000 7f3532a00640 1 --2- 172.21.15.29:0/2504190591 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f350c065a60 0x7f350c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:45.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.851+0000 7f3532a00640 1 --2- 172.21.15.29:0/2504190591 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f350c065a60 0x7f350c067f20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f35240af000 tx=0x7f35240b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:45.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:45.855+0000 7f352aa00640 1 -- 172.21.15.29:0/2504190591 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f35340cd3f0 con 0x7f3534153a00 2024-01-24T13:04:46.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.011+0000 7f3539800640 1 -- 172.21.15.29:0/2504190591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f35340cd3f0 con 0x7f3534153a00 2024-01-24T13:04:46.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.011+0000 7f352aa00640 1 -- 172.21.15.29:0/2504190591 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f35340cd3f0 con 0x7f3534153a00 2024-01-24T13:04:46.015 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:46.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.011+0000 7f3539800640 1 -- 172.21.15.29:0/2504190591 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f350c065a60 msgr2=0x7f350c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.011+0000 7f3539800640 1 --2- 172.21.15.29:0/2504190591 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f350c065a60 0x7f350c067f20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f35240af000 tx=0x7f35240b6040 comp rx=0 tx=0).stop 2024-01-24T13:04:46.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.011+0000 7f3539800640 1 -- 172.21.15.29:0/2504190591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3534153a00 msgr2=0x7f353415af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.011+0000 7f3539800640 1 --2- 172.21.15.29:0/2504190591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3534153a00 0x7f353415af50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f352c00b990 tx=0x7f352c00be50 comp rx=0 tx=0).stop 2024-01-24T13:04:46.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.015+0000 7f3539800640 1 -- 172.21.15.29:0/2504190591 shutdown_connections 2024-01-24T13:04:46.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.015+0000 7f3539800640 1 --2- 172.21.15.29:0/2504190591 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f350c065a60 0x7f350c067f20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.015+0000 7f3539800640 1 --2- 172.21.15.29:0/2504190591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3534153a00 0x7f353415af50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.015+0000 7f3539800640 1 --2- 172.21.15.29:0/2504190591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f35340b2760 0x7f353415d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.015+0000 7f3539800640 1 --2- 172.21.15.29:0/2504190591 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35340b1130 0x7f353413ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.015+0000 7f3539800640 1 -- 172.21.15.29:0/2504190591 >> 172.21.15.29:0/2504190591 conn(0x7f353406d700 msgr2=0x7f35340cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:46.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.015+0000 7f3539800640 1 -- 172.21.15.29:0/2504190591 shutdown_connections 2024-01-24T13:04:46.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.015+0000 7f3539800640 1 -- 172.21.15.29:0/2504190591 wait complete. 2024-01-24T13:04:46.036 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:04:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.175+0000 7f300e400640 1 Processor -- start 2024-01-24T13:04:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.175+0000 7f300e400640 1 -- start start 2024-01-24T13:04:46.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f300e400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3008153a00 0x7f3008071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f300e400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f30080b2c10 0x7f30080b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f300e400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3008153de0 con 0x7f30080b2760 2024-01-24T13:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f300e400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f300815df00 con 0x7f3008153a00 2024-01-24T13:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f300e400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30080b30a0 con 0x7f30080b2c10 2024-01-24T13:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f3006a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f30080b2760 0x7f30080b1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33708/0 (socket says 172.21.15.29:33708) 2024-01-24T13:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f3006a00640 1 -- 172.21.15.29:0/3023113714 learned_addr learned my addr 172.21.15.29:0/3023113714 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f3007400640 1 --2- 172.21.15.29:0/3023113714 >> v2:172.21.15.163:3300/0 conn(0x7f3008153a00 0x7f3008071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f3007e00640 1 --2- 172.21.15.29:0/3023113714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f30080b2c10 0x7f30080b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f3006000640 1 -- 172.21.15.29:0/3023113714 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693918451 0 0) 0x7f3008153de0 con 0x7f30080b2760 2024-01-24T13:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f3006000640 1 -- 172.21.15.29:0/3023113714 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe8003530 con 0x7f30080b2760 2024-01-24T13:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f3006000640 1 -- 172.21.15.29:0/3023113714 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 390611303 0 0) 0x7f2fe8003530 con 0x7f30080b2760 2024-01-24T13:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f3007400640 1 -- 172.21.15.29:0/3023113714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f30080b2c10 msgr2=0x7f30080b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f3007400640 1 --2- 172.21.15.29:0/3023113714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f30080b2c10 0x7f30080b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f3007400640 1 -- 172.21.15.29:0/3023113714 >> v1:172.21.15.29:6789/0 conn(0x7f30080b2760 legacy=0x7f30080b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.179+0000 7f3007400640 1 -- 172.21.15.29:0/3023113714 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3008159900 con 0x7f3008153a00 2024-01-24T13:04:46.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.183+0000 7f3007400640 1 --2- 172.21.15.29:0/3023113714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3008153a00 0x7f3008071600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80097c0 tx=0x7f2ff801c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c4d09be1a43b870 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.183+0000 7f3006000640 1 -- 172.21.15.29:0/3023113714 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0001680 con 0x7f3008153a00 2024-01-24T13:04:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.183+0000 7f3006000640 1 -- 172.21.15.29:0/3023113714 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff80a7050 con 0x7f3008153a00 2024-01-24T13:04:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.183+0000 7f3006000640 1 -- 172.21.15.29:0/3023113714 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80ab620 con 0x7f3008153a00 2024-01-24T13:04:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.183+0000 7f300e400640 1 -- 172.21.15.29:0/3023113714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3008153a00 msgr2=0x7f3008071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.183+0000 7f300e400640 1 --2- 172.21.15.29:0/3023113714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3008153a00 0x7f3008071600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80097c0 tx=0x7f2ff801c2e0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.183+0000 7f300e400640 1 -- 172.21.15.29:0/3023113714 shutdown_connections 2024-01-24T13:04:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.183+0000 7f300e400640 1 --2- 172.21.15.29:0/3023113714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f30080b2c10 0x7f30080b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.183+0000 7f300e400640 1 --2- 172.21.15.29:0/3023113714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3008153a00 0x7f3008071600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.183+0000 7f300e400640 1 -- 172.21.15.29:0/3023113714 >> 172.21.15.29:0/3023113714 conn(0x7f300806d700 msgr2=0x7f3008069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.183+0000 7f300e400640 1 -- 172.21.15.29:0/3023113714 shutdown_connections 2024-01-24T13:04:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.183+0000 7f300e400640 1 -- 172.21.15.29:0/3023113714 wait complete. 2024-01-24T13:04:46.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f300e400640 1 Processor -- start 2024-01-24T13:04:46.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f300e400640 1 -- start start 2024-01-24T13:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f300e400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30080b2760 0x7f300815d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f300e400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30080b2c10 0x7f300815bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f300e400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3008153a00 0x7f3008145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f300e400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300815ae20 con 0x7f30080b2760 2024-01-24T13:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f300e400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300815b100 con 0x7f30080b2c10 2024-01-24T13:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f300e400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300815b3e0 con 0x7f3008153a00 2024-01-24T13:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f3007400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30080b2760 0x7f300815d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f3007400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30080b2760 0x7f300815d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52692/0 (socket says 172.21.15.29:52692) 2024-01-24T13:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f3007400640 1 -- 172.21.15.29:0/1738406008 learned_addr learned my addr 172.21.15.29:0/1738406008 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f3006a00640 1 --2- 172.21.15.29:0/1738406008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30080b2c10 0x7f300815bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f3007e00640 1 --2- 172.21.15.29:0/1738406008 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3008153a00 0x7f3008145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f3007400640 1 -- 172.21.15.29:0/1738406008 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3008153a00 msgr2=0x7f3008145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f3007400640 1 --2- 172.21.15.29:0/1738406008 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3008153a00 0x7f3008145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f3007400640 1 -- 172.21.15.29:0/1738406008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30080b2c10 msgr2=0x7f300815bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f3007400640 1 --2- 172.21.15.29:0/1738406008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30080b2c10 0x7f300815bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f3007400640 1 -- 172.21.15.29:0/1738406008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff8009420 con 0x7f30080b2760 2024-01-24T13:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f3007400640 1 --2- 172.21.15.29:0/1738406008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30080b2760 0x7f300815d990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8019f10 tx=0x7f2ff8019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f2fff400640 1 -- 172.21.15.29:0/1738406008 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80b4400 con 0x7f30080b2760 2024-01-24T13:04:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f2fff400640 1 -- 172.21.15.29:0/1738406008 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff80b4560 con 0x7f30080b2760 2024-01-24T13:04:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f300e400640 1 -- 172.21.15.29:0/1738406008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300815b6c0 con 0x7f30080b2760 2024-01-24T13:04:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f2fff400640 1 -- 172.21.15.29:0/1738406008 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80b4910 con 0x7f30080b2760 2024-01-24T13:04:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.187+0000 7f300e400640 1 -- 172.21.15.29:0/1738406008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3008146070 con 0x7f30080b2760 2024-01-24T13:04:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.191+0000 7f300e400640 1 -- 172.21.15.29:0/1738406008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300804e850 con 0x7f30080b2760 2024-01-24T13:04:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.191+0000 7f2fff400640 1 -- 172.21.15.29:0/1738406008 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2ff80b2040 con 0x7f30080b2760 2024-01-24T13:04:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.191+0000 7f2fff400640 1 --2- 172.21.15.29:0/1738406008 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2fe0065a60 0x7f2fe0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.191+0000 7f2fff400640 1 -- 172.21.15.29:0/1738406008 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f2ff811d570 con 0x7f30080b2760 2024-01-24T13:04:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.191+0000 7f3006a00640 1 --2- 172.21.15.29:0/1738406008 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2fe0065a60 0x7f2fe0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.191+0000 7f3006a00640 1 --2- 172.21.15.29:0/1738406008 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2fe0065a60 0x7f2fe0067f20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00011f0 tx=0x7f2ff00016e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:46.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.195+0000 7f2fff400640 1 -- 172.21.15.29:0/1738406008 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2ff80eac10 con 0x7f30080b2760 2024-01-24T13:04:46.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.351+0000 7f300e400640 1 -- 172.21.15.29:0/1738406008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3008070ed0 con 0x7f30080b2760 2024-01-24T13:04:46.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.351+0000 7f2fff400640 1 -- 172.21.15.29:0/1738406008 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ff80b00a0 con 0x7f30080b2760 2024-01-24T13:04:46.356 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:04:46.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.355+0000 7f300e400640 1 -- 172.21.15.29:0/1738406008 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2fe0065a60 msgr2=0x7f2fe0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.355+0000 7f300e400640 1 --2- 172.21.15.29:0/1738406008 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2fe0065a60 0x7f2fe0067f20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00011f0 tx=0x7f2ff00016e0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.355+0000 7f300e400640 1 -- 172.21.15.29:0/1738406008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30080b2760 msgr2=0x7f300815d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.355+0000 7f300e400640 1 --2- 172.21.15.29:0/1738406008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30080b2760 0x7f300815d990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8019f10 tx=0x7f2ff8019080 comp rx=0 tx=0).stop 2024-01-24T13:04:46.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.355+0000 7f300e400640 1 -- 172.21.15.29:0/1738406008 shutdown_connections 2024-01-24T13:04:46.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.355+0000 7f300e400640 1 --2- 172.21.15.29:0/1738406008 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2fe0065a60 0x7f2fe0067f20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.355+0000 7f300e400640 1 --2- 172.21.15.29:0/1738406008 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3008153a00 0x7f3008145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.355+0000 7f300e400640 1 --2- 172.21.15.29:0/1738406008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30080b2c10 0x7f300815bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.355+0000 7f300e400640 1 --2- 172.21.15.29:0/1738406008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30080b2760 0x7f300815d990 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.355+0000 7f300e400640 1 -- 172.21.15.29:0/1738406008 >> 172.21.15.29:0/1738406008 conn(0x7f300806d700 msgr2=0x7f30080cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:46.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.355+0000 7f300e400640 1 -- 172.21.15.29:0/1738406008 shutdown_connections 2024-01-24T13:04:46.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.355+0000 7f300e400640 1 -- 172.21.15.29:0/1738406008 wait complete. 2024-01-24T13:04:46.378 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:04:46.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.519+0000 7f7c6dc00640 1 Processor -- start 2024-01-24T13:04:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.519+0000 7f7c6dc00640 1 -- start start 2024-01-24T13:04:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.519+0000 7f7c6dc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c68153710 0x7f7c68160d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.519+0000 7f7c6dc00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7c680ce760 0x7f7c680ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.519+0000 7f7c6dc00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6815daf0 con 0x7f7c6806c7d0 2024-01-24T13:04:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.519+0000 7f7c6dc00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c68161280 con 0x7f7c680ce760 2024-01-24T13:04:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.519+0000 7f7c6dc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6815cee0 con 0x7f7c68153710 2024-01-24T13:04:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.519+0000 7f7c66000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7c6806c7d0 0x7f7c680ce050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33724/0 (socket says 172.21.15.29:33724) 2024-01-24T13:04:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.519+0000 7f7c66000640 1 -- 172.21.15.29:0/1313752681 learned_addr learned my addr 172.21.15.29:0/1313752681 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.523+0000 7f7c67400640 1 --2- 172.21.15.29:0/1313752681 >> v2:172.21.15.163:3300/0 conn(0x7f7c680ce760 0x7f7c680ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.523+0000 7f7c66a00640 1 --2- 172.21.15.29:0/1313752681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c68153710 0x7f7c68160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.523+0000 7f7c65600640 1 -- 172.21.15.29:0/1313752681 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974143269 0 0) 0x7f7c6815daf0 con 0x7f7c6806c7d0 2024-01-24T13:04:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.523+0000 7f7c65600640 1 -- 172.21.15.29:0/1313752681 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c48003530 con 0x7f7c6806c7d0 2024-01-24T13:04:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.523+0000 7f7c67400640 1 -- 172.21.15.29:0/1313752681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c68153710 msgr2=0x7f7c68160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.523+0000 7f7c67400640 1 --2- 172.21.15.29:0/1313752681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c68153710 0x7f7c68160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.523+0000 7f7c67400640 1 -- 172.21.15.29:0/1313752681 >> v1:172.21.15.29:6789/0 conn(0x7f7c6806c7d0 legacy=0x7f7c680ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.523+0000 7f7c65600640 1 -- 172.21.15.29:0/1313752681 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4097527838 0 0) 0x7f7c48003530 con 0x7f7c6806c7d0 2024-01-24T13:04:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.523+0000 7f7c67400640 1 -- 172.21.15.29:0/1313752681 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6815d1c0 con 0x7f7c680ce760 2024-01-24T13:04:46.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.523+0000 7f7c67400640 1 --2- 172.21.15.29:0/1313752681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c680ce760 0x7f7c680ccaf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009d90 tx=0x7f7c6001c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e5db600bb3b8d47 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:46.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.523+0000 7f7c65600640 1 -- 172.21.15.29:0/1313752681 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50001680 con 0x7f7c680ce760 2024-01-24T13:04:46.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.523+0000 7f7c65600640 1 -- 172.21.15.29:0/1313752681 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c600a5640 con 0x7f7c680ce760 2024-01-24T13:04:46.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.523+0000 7f7c65600640 1 -- 172.21.15.29:0/1313752681 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c600a59d0 con 0x7f7c680ce760 2024-01-24T13:04:46.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 -- 172.21.15.29:0/1313752681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c680ce760 msgr2=0x7f7c680ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 --2- 172.21.15.29:0/1313752681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c680ce760 0x7f7c680ccaf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009d90 tx=0x7f7c6001c840 comp rx=0 tx=0).stop 2024-01-24T13:04:46.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 -- 172.21.15.29:0/1313752681 shutdown_connections 2024-01-24T13:04:46.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 --2- 172.21.15.29:0/1313752681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c680ce760 0x7f7c680ccaf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 --2- 172.21.15.29:0/1313752681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c68153710 0x7f7c68160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 -- 172.21.15.29:0/1313752681 >> 172.21.15.29:0/1313752681 conn(0x7f7c68069cd0 msgr2=0x7f7c6806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 -- 172.21.15.29:0/1313752681 shutdown_connections 2024-01-24T13:04:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 -- 172.21.15.29:0/1313752681 wait complete. 2024-01-24T13:04:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 Processor -- start 2024-01-24T13:04:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 -- start start 2024-01-24T13:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c6806c7d0 0x7f7c680c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c680ce760 0x7f7c680b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c68153710 0x7f7c68149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6814e420 con 0x7f7c68153710 2024-01-24T13:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6814b4b0 con 0x7f7c680ce760 2024-01-24T13:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c6dc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6814bf50 con 0x7f7c6806c7d0 2024-01-24T13:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c67400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c68153710 0x7f7c68149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c67400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c68153710 0x7f7c68149a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52706/0 (socket says 172.21.15.29:52706) 2024-01-24T13:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.527+0000 7f7c67400640 1 -- 172.21.15.29:0/4082149742 learned_addr learned my addr 172.21.15.29:0/4082149742 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c66a00640 1 --2- 172.21.15.29:0/4082149742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c6806c7d0 0x7f7c680c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c66000640 1 --2- 172.21.15.29:0/4082149742 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c680ce760 0x7f7c680b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c67400640 1 -- 172.21.15.29:0/4082149742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c6806c7d0 msgr2=0x7f7c680c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c67400640 1 --2- 172.21.15.29:0/4082149742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c6806c7d0 0x7f7c680c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c67400640 1 -- 172.21.15.29:0/4082149742 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c680ce760 msgr2=0x7f7c680b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c67400640 1 --2- 172.21.15.29:0/4082149742 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c680ce760 0x7f7c680b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c67400640 1 -- 172.21.15.29:0/4082149742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60009a70 con 0x7f7c68153710 2024-01-24T13:04:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c67400640 1 --2- 172.21.15.29:0/4082149742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c68153710 0x7f7c68149a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7c600b0040 tx=0x7f7c600195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:46.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c5ea00640 1 -- 172.21.15.29:0/4082149742 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c600b9860 con 0x7f7c68153710 2024-01-24T13:04:46.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c5ea00640 1 -- 172.21.15.29:0/4082149742 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c600b99c0 con 0x7f7c68153710 2024-01-24T13:04:46.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c5ea00640 1 -- 172.21.15.29:0/4082149742 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c600b9d50 con 0x7f7c68153710 2024-01-24T13:04:46.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c6dc00640 1 -- 172.21.15.29:0/4082149742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6814c1f0 con 0x7f7c68153710 2024-01-24T13:04:46.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c6dc00640 1 -- 172.21.15.29:0/4082149742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c680c4560 con 0x7f7c68153710 2024-01-24T13:04:46.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c6dc00640 1 -- 172.21.15.29:0/4082149742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6804e850 con 0x7f7c68153710 2024-01-24T13:04:46.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c5ea00640 1 -- 172.21.15.29:0/4082149742 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7c600ad440 con 0x7f7c68153710 2024-01-24T13:04:46.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.531+0000 7f7c5ea00640 1 --2- 172.21.15.29:0/4082149742 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7c40065a60 0x7f7c40067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.535+0000 7f7c5ea00640 1 -- 172.21.15.29:0/4082149742 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f7c6011e5c0 con 0x7f7c68153710 2024-01-24T13:04:46.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.535+0000 7f7c66a00640 1 --2- 172.21.15.29:0/4082149742 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7c40065a60 0x7f7c40067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.535+0000 7f7c66a00640 1 --2- 172.21.15.29:0/4082149742 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7c40065a60 0x7f7c40067f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7c680cef50 tx=0x7f7c58009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:46.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.535+0000 7f7c5ea00640 1 -- 172.21.15.29:0/4082149742 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7c600ebd90 con 0x7f7c68153710 2024-01-24T13:04:46.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.691+0000 7f7c6dc00640 1 -- 172.21.15.29:0/4082149742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7c680cbd10 con 0x7f7c68153710 2024-01-24T13:04:46.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.695+0000 7f7c5ea00640 1 -- 172.21.15.29:0/4082149742 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7c60009450 con 0x7f7c68153710 2024-01-24T13:04:46.697 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:46.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.695+0000 7f7c6dc00640 1 -- 172.21.15.29:0/4082149742 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7c40065a60 msgr2=0x7f7c40067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.695+0000 7f7c6dc00640 1 --2- 172.21.15.29:0/4082149742 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7c40065a60 0x7f7c40067f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7c680cef50 tx=0x7f7c58009190 comp rx=0 tx=0).stop 2024-01-24T13:04:46.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.695+0000 7f7c6dc00640 1 -- 172.21.15.29:0/4082149742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c68153710 msgr2=0x7f7c68149a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.695+0000 7f7c6dc00640 1 --2- 172.21.15.29:0/4082149742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c68153710 0x7f7c68149a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7c600b0040 tx=0x7f7c600195e0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.695+0000 7f7c6dc00640 1 -- 172.21.15.29:0/4082149742 shutdown_connections 2024-01-24T13:04:46.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.695+0000 7f7c6dc00640 1 --2- 172.21.15.29:0/4082149742 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7c40065a60 0x7f7c40067f20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.695+0000 7f7c6dc00640 1 --2- 172.21.15.29:0/4082149742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c68153710 0x7f7c68149a30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.695+0000 7f7c6dc00640 1 --2- 172.21.15.29:0/4082149742 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c680ce760 0x7f7c680b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.695+0000 7f7c6dc00640 1 --2- 172.21.15.29:0/4082149742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c6806c7d0 0x7f7c680c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.695+0000 7f7c6dc00640 1 -- 172.21.15.29:0/4082149742 >> 172.21.15.29:0/4082149742 conn(0x7f7c68069cd0 msgr2=0x7f7c680d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:46.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.695+0000 7f7c6dc00640 1 -- 172.21.15.29:0/4082149742 shutdown_connections 2024-01-24T13:04:46.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.695+0000 7f7c6dc00640 1 -- 172.21.15.29:0/4082149742 wait complete. 2024-01-24T13:04:46.719 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:46.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.855+0000 7fab48400640 1 Processor -- start 2024-01-24T13:04:46.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.855+0000 7fab48400640 1 -- start start 2024-01-24T13:04:46.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab48400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab4015fb50 0x7fab4015dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab48400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fab4015d730 0x7fab400cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab48400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab400ce900 con 0x7fab400ce4b0 2024-01-24T13:04:46.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab48400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4006c0e0 con 0x7fab4015d730 2024-01-24T13:04:46.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab48400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4006cb20 con 0x7fab4015fb50 2024-01-24T13:04:46.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab46400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fab400ce4b0 0x7fab40152f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33732/0 (socket says 172.21.15.29:33732) 2024-01-24T13:04:46.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab46400640 1 -- 172.21.15.29:0/1296742543 learned_addr learned my addr 172.21.15.29:0/1296742543 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:46.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab45000640 1 --2- 172.21.15.29:0/1296742543 >> v2:172.21.15.29:3300/0 conn(0x7fab4015d730 0x7fab400cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab45a00640 1 --2- 172.21.15.29:0/1296742543 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab4015fb50 0x7fab4015dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab3fe00640 1 -- 172.21.15.29:0/1296742543 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34939878 0 0) 0x7fab380014a0 con 0x7fab400ce4b0 2024-01-24T13:04:46.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab3fe00640 1 -- 172.21.15.29:0/1296742543 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab20003530 con 0x7fab400ce4b0 2024-01-24T13:04:46.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab45000640 1 -- 172.21.15.29:0/1296742543 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab4015fb50 msgr2=0x7fab4015dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:46.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab45000640 1 --2- 172.21.15.29:0/1296742543 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab4015fb50 0x7fab4015dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab45000640 1 -- 172.21.15.29:0/1296742543 >> v1:172.21.15.29:6789/0 conn(0x7fab400ce4b0 legacy=0x7fab40152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab45000640 1 -- 172.21.15.29:0/1296742543 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4006b4d0 con 0x7fab4015d730 2024-01-24T13:04:46.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.859+0000 7fab45a00640 1 --2- 172.21.15.29:0/1296742543 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab4015fb50 0x7fab4015dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:46.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.863+0000 7fab45000640 1 --2- 172.21.15.29:0/1296742543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab4015d730 0x7fab400cdf70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fab280097c0 tx=0x7fab2801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c5aaaf337e9e55 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:46.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.863+0000 7fab3fe00640 1 -- 172.21.15.29:0/1296742543 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab280ab650 con 0x7fab4015d730 2024-01-24T13:04:46.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.863+0000 7fab3fe00640 1 -- 172.21.15.29:0/1296742543 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab280ab7b0 con 0x7fab4015d730 2024-01-24T13:04:46.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.863+0000 7fab3fe00640 1 -- 172.21.15.29:0/1296742543 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab280abb40 con 0x7fab4015d730 2024-01-24T13:04:46.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.863+0000 7fab48400640 1 -- 172.21.15.29:0/1296742543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab4015d730 msgr2=0x7fab400cdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.863+0000 7fab48400640 1 --2- 172.21.15.29:0/1296742543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab4015d730 0x7fab400cdf70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fab280097c0 tx=0x7fab2801c450 comp rx=0 tx=0).stop 2024-01-24T13:04:46.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.863+0000 7fab48400640 1 -- 172.21.15.29:0/1296742543 shutdown_connections 2024-01-24T13:04:46.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.863+0000 7fab48400640 1 --2- 172.21.15.29:0/1296742543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab4015d730 0x7fab400cdf70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.863+0000 7fab48400640 1 --2- 172.21.15.29:0/1296742543 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab4015fb50 0x7fab4015dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.863+0000 7fab48400640 1 -- 172.21.15.29:0/1296742543 >> 172.21.15.29:0/1296742543 conn(0x7fab40070570 msgr2=0x7fab40069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:46.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.863+0000 7fab48400640 1 -- 172.21.15.29:0/1296742543 shutdown_connections 2024-01-24T13:04:46.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.863+0000 7fab48400640 1 -- 172.21.15.29:0/1296742543 wait complete. 2024-01-24T13:04:46.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.863+0000 7fab48400640 1 Processor -- start 2024-01-24T13:04:46.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.863+0000 7fab48400640 1 -- start start 2024-01-24T13:04:46.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab48400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab400ce4b0 0x7fab400c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab48400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab4015d730 0x7fab400c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab48400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab4015fb50 0x7fab400cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab48400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab400c9800 con 0x7fab4015fb50 2024-01-24T13:04:46.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab48400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab400c9ae0 con 0x7fab4015d730 2024-01-24T13:04:46.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab48400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab400c9dc0 con 0x7fab400ce4b0 2024-01-24T13:04:46.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab46400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab4015fb50 0x7fab400cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab46400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab4015fb50 0x7fab400cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52724/0 (socket says 172.21.15.29:52724) 2024-01-24T13:04:46.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab46400640 1 -- 172.21.15.29:0/3887374331 learned_addr learned my addr 172.21.15.29:0/3887374331 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:46.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab45000640 1 --2- 172.21.15.29:0/3887374331 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab4015d730 0x7fab400c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab45a00640 1 --2- 172.21.15.29:0/3887374331 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab400ce4b0 0x7fab400c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab46400640 1 -- 172.21.15.29:0/3887374331 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab400ce4b0 msgr2=0x7fab400c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab46400640 1 --2- 172.21.15.29:0/3887374331 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab400ce4b0 0x7fab400c2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab46400640 1 -- 172.21.15.29:0/3887374331 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab4015d730 msgr2=0x7fab400c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:46.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab46400640 1 --2- 172.21.15.29:0/3887374331 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab4015d730 0x7fab400c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:46.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab46400640 1 -- 172.21.15.29:0/3887374331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab28009420 con 0x7fab4015fb50 2024-01-24T13:04:46.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab46400640 1 --2- 172.21.15.29:0/3887374331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab4015fb50 0x7fab400cbca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fab3800cae0 tx=0x7fab3800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:46.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab3d600640 1 -- 172.21.15.29:0/3887374331 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3800ac40 con 0x7fab4015fb50 2024-01-24T13:04:46.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab3d600640 1 -- 172.21.15.29:0/3887374331 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3800ada0 con 0x7fab4015fb50 2024-01-24T13:04:46.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab48400640 1 -- 172.21.15.29:0/3887374331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab400ca0a0 con 0x7fab4015fb50 2024-01-24T13:04:46.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab3d600640 1 -- 172.21.15.29:0/3887374331 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38012620 con 0x7fab4015fb50 2024-01-24T13:04:46.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab48400640 1 -- 172.21.15.29:0/3887374331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab400c2d70 con 0x7fab4015fb50 2024-01-24T13:04:46.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab48400640 1 -- 172.21.15.29:0/3887374331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4004e850 con 0x7fab4015fb50 2024-01-24T13:04:46.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.867+0000 7fab3d600640 1 -- 172.21.15.29:0/3887374331 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fab38007070 con 0x7fab4015fb50 2024-01-24T13:04:46.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.871+0000 7fab3d600640 1 --2- 172.21.15.29:0/3887374331 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fab18065a60 0x7fab18067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:46.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.871+0000 7fab3d600640 1 -- 172.21.15.29:0/3887374331 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fab380832c0 con 0x7fab4015fb50 2024-01-24T13:04:46.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.871+0000 7fab45a00640 1 --2- 172.21.15.29:0/3887374331 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fab18065a60 0x7fab18067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:46.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.871+0000 7fab45a00640 1 --2- 172.21.15.29:0/3887374331 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fab18065a60 0x7fab18067f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fab30009950 tx=0x7fab30008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:46.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:46.875+0000 7fab3d600640 1 -- 172.21.15.29:0/3887374331 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fab38050960 con 0x7fab4015fb50 2024-01-24T13:04:47.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.031+0000 7fab48400640 1 -- 172.21.15.29:0/3887374331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab400ce900 con 0x7fab4015fb50 2024-01-24T13:04:47.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.035+0000 7fab3d600640 1 -- 172.21.15.29:0/3887374331 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7fab400ce900 con 0x7fab4015fb50 2024-01-24T13:04:47.037 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:47.037 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:47.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.035+0000 7fab48400640 1 -- 172.21.15.29:0/3887374331 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fab18065a60 msgr2=0x7fab18067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.035+0000 7fab48400640 1 --2- 172.21.15.29:0/3887374331 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fab18065a60 0x7fab18067f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fab30009950 tx=0x7fab30008040 comp rx=0 tx=0).stop 2024-01-24T13:04:47.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.035+0000 7fab48400640 1 -- 172.21.15.29:0/3887374331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab4015fb50 msgr2=0x7fab400cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.035+0000 7fab48400640 1 --2- 172.21.15.29:0/3887374331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab4015fb50 0x7fab400cbca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fab3800cae0 tx=0x7fab3800a060 comp rx=0 tx=0).stop 2024-01-24T13:04:47.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.035+0000 7fab48400640 1 -- 172.21.15.29:0/3887374331 shutdown_connections 2024-01-24T13:04:47.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.035+0000 7fab48400640 1 --2- 172.21.15.29:0/3887374331 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fab18065a60 0x7fab18067f20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.035+0000 7fab48400640 1 --2- 172.21.15.29:0/3887374331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab4015fb50 0x7fab400cbca0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.035+0000 7fab48400640 1 --2- 172.21.15.29:0/3887374331 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab4015d730 0x7fab400c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.035+0000 7fab48400640 1 --2- 172.21.15.29:0/3887374331 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab400ce4b0 0x7fab400c2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.035+0000 7fab48400640 1 -- 172.21.15.29:0/3887374331 >> 172.21.15.29:0/3887374331 conn(0x7fab40070570 msgr2=0x7fab400afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:47.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.035+0000 7fab48400640 1 -- 172.21.15.29:0/3887374331 shutdown_connections 2024-01-24T13:04:47.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.035+0000 7fab48400640 1 -- 172.21.15.29:0/3887374331 wait complete. 2024-01-24T13:04:47.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:04:47.060 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:04:47.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.199+0000 7f31c9a00640 1 Processor -- start 2024-01-24T13:04:47.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.199+0000 7f31c9a00640 1 -- start start 2024-01-24T13:04:47.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c9a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f31c4143ce0 0x7f31c40cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c9a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31c40cd3f0 0x7f31c406bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c9a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31c406c100 0x7f31c40b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c9a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c406c5b0 con 0x7f31c406c100 2024-01-24T13:04:47.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c9a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c40caf30 con 0x7f31c4143ce0 2024-01-24T13:04:47.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c9a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c40b2090 con 0x7f31c40cd3f0 2024-01-24T13:04:47.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c3400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31c406c100 0x7f31c40b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c3400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31c406c100 0x7f31c40b2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52738/0 (socket says 172.21.15.29:52738) 2024-01-24T13:04:47.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c3400640 1 -- 172.21.15.29:0/724950548 learned_addr learned my addr 172.21.15.29:0/724950548 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:47.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c2000640 1 --2- 172.21.15.29:0/724950548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31c40cd3f0 0x7f31c406bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c2a00640 1 --2- 172.21.15.29:0/724950548 >> v2:172.21.15.163:3300/0 conn(0x7f31c4143ce0 0x7f31c40cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c3400640 1 -- 172.21.15.29:0/724950548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31c40cd3f0 msgr2=0x7f31c406bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:47.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c3400640 1 --2- 172.21.15.29:0/724950548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31c40cd3f0 0x7f31c406bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c3400640 1 -- 172.21.15.29:0/724950548 >> v2:172.21.15.163:3300/0 conn(0x7f31c4143ce0 msgr2=0x7f31c40cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:47.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c3400640 1 --2- 172.21.15.29:0/724950548 >> v2:172.21.15.163:3300/0 conn(0x7f31c4143ce0 0x7f31c40cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.203+0000 7f31c3400640 1 -- 172.21.15.29:0/724950548 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c415ba40 con 0x7f31c406c100 2024-01-24T13:04:47.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c3400640 1 --2- 172.21.15.29:0/724950548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c406c100 0x7f31c40b2520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f31c4071e50 tx=0x7f31bc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cb5a3f83fb8eb server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:47.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c1600640 1 -- 172.21.15.29:0/724950548 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0a5790 con 0x7f31c406c100 2024-01-24T13:04:47.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c1600640 1 -- 172.21.15.29:0/724950548 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc0a58f0 con 0x7f31c406c100 2024-01-24T13:04:47.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c1600640 1 -- 172.21.15.29:0/724950548 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0a5c80 con 0x7f31c406c100 2024-01-24T13:04:47.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c9a00640 1 -- 172.21.15.29:0/724950548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c406c100 msgr2=0x7f31c40b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c9a00640 1 --2- 172.21.15.29:0/724950548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c406c100 0x7f31c40b2520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f31c4071e50 tx=0x7f31bc01c910 comp rx=0 tx=0).stop 2024-01-24T13:04:47.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c9a00640 1 -- 172.21.15.29:0/724950548 shutdown_connections 2024-01-24T13:04:47.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c9a00640 1 --2- 172.21.15.29:0/724950548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c406c100 0x7f31c40b2520 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c9a00640 1 --2- 172.21.15.29:0/724950548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31c40cd3f0 0x7f31c406bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c9a00640 1 --2- 172.21.15.29:0/724950548 >> v2:172.21.15.163:3300/0 conn(0x7f31c4143ce0 0x7f31c40cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c9a00640 1 -- 172.21.15.29:0/724950548 >> 172.21.15.29:0/724950548 conn(0x7f31c406d700 msgr2=0x7f31c4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:47.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c9a00640 1 -- 172.21.15.29:0/724950548 shutdown_connections 2024-01-24T13:04:47.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c9a00640 1 -- 172.21.15.29:0/724950548 wait complete. 2024-01-24T13:04:47.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c9a00640 1 Processor -- start 2024-01-24T13:04:47.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.207+0000 7f31c9a00640 1 -- start start 2024-01-24T13:04:47.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c9a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31c406c100 0x7f31c4159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c9a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31c40cd3f0 0x7f31c41412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c9a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c4143ce0 0x7f31c415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c9a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4142ce0 con 0x7f31c4143ce0 2024-01-24T13:04:47.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c9a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4141c40 con 0x7f31c40cd3f0 2024-01-24T13:04:47.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c9a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4141f20 con 0x7f31c406c100 2024-01-24T13:04:47.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c3400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c4143ce0 0x7f31c415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c3400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c4143ce0 0x7f31c415ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52742/0 (socket says 172.21.15.29:52742) 2024-01-24T13:04:47.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c3400640 1 -- 172.21.15.29:0/3953415781 learned_addr learned my addr 172.21.15.29:0/3953415781 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:47.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c2a00640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31c406c100 0x7f31c4159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c2000640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31c40cd3f0 0x7f31c41412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c3400640 1 -- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31c406c100 msgr2=0x7f31c4159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c3400640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31c406c100 0x7f31c4159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c3400640 1 -- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31c40cd3f0 msgr2=0x7f31c41412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c3400640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31c40cd3f0 0x7f31c41412a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c3400640 1 -- 172.21.15.29:0/3953415781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc009b30 con 0x7f31c4143ce0 2024-01-24T13:04:47.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c2a00640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31c406c100 0x7f31c4159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:47.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c3400640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c4143ce0 0x7f31c415ca60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0af040 tx=0x7f31bc0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:47.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31baa00640 1 -- 172.21.15.29:0/3953415781 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0b8670 con 0x7f31c4143ce0 2024-01-24T13:04:47.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31baa00640 1 -- 172.21.15.29:0/3953415781 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc0b87d0 con 0x7f31c4143ce0 2024-01-24T13:04:47.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31baa00640 1 -- 172.21.15.29:0/3953415781 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0b8b60 con 0x7f31c4143ce0 2024-01-24T13:04:47.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c9a00640 1 -- 172.21.15.29:0/3953415781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c4142200 con 0x7f31c4143ce0 2024-01-24T13:04:47.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c9a00640 1 -- 172.21.15.29:0/3953415781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c41427c0 con 0x7f31c4143ce0 2024-01-24T13:04:47.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31c9a00640 1 -- 172.21.15.29:0/3953415781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c41429b0 con 0x7f31c4143ce0 2024-01-24T13:04:47.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.211+0000 7f31baa00640 1 -- 172.21.15.29:0/3953415781 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f31bc0b8cc0 con 0x7f31c4143ce0 2024-01-24T13:04:47.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.215+0000 7f31baa00640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f319c065a60 0x7f319c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.215+0000 7f31baa00640 1 -- 172.21.15.29:0/3953415781 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f31bc11eba0 con 0x7f31c4143ce0 2024-01-24T13:04:47.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.215+0000 7f31c2a00640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f319c065a60 0x7f319c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.215+0000 7f31c2a00640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f319c065a60 0x7f319c067f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f31b400b9f0 tx=0x7f31b4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:47.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.219+0000 7f31baa00640 1 -- 172.21.15.29:0/3953415781 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f31bc0ec370 con 0x7f31c4143ce0 2024-01-24T13:04:47.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.375+0000 7f31c9a00640 1 -- 172.21.15.29:0/3953415781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31c404e850 con 0x7f31c4143ce0 2024-01-24T13:04:47.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.375+0000 7f31baa00640 1 -- 172.21.15.29:0/3953415781 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31bc0ef990 con 0x7f31c4143ce0 2024-01-24T13:04:47.379 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:04:47.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.379+0000 7f31c9a00640 1 -- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f319c065a60 msgr2=0x7f319c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.379+0000 7f31c9a00640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f319c065a60 0x7f319c067f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f31b400b9f0 tx=0x7f31b4008040 comp rx=0 tx=0).stop 2024-01-24T13:04:47.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.379+0000 7f31c9a00640 1 -- 172.21.15.29:0/3953415781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c4143ce0 msgr2=0x7f31c415ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.379+0000 7f31c9a00640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c4143ce0 0x7f31c415ca60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0af040 tx=0x7f31bc0196b0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.379+0000 7f31c9a00640 1 -- 172.21.15.29:0/3953415781 shutdown_connections 2024-01-24T13:04:47.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.379+0000 7f31c9a00640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f319c065a60 0x7f319c067f20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.379+0000 7f31c9a00640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c4143ce0 0x7f31c415ca60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.379+0000 7f31c9a00640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31c40cd3f0 0x7f31c41412a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.379+0000 7f31c9a00640 1 --2- 172.21.15.29:0/3953415781 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31c406c100 0x7f31c4159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.379+0000 7f31c9a00640 1 -- 172.21.15.29:0/3953415781 >> 172.21.15.29:0/3953415781 conn(0x7f31c406d700 msgr2=0x7f31c4072820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:47.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.379+0000 7f31c9a00640 1 -- 172.21.15.29:0/3953415781 shutdown_connections 2024-01-24T13:04:47.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.379+0000 7f31c9a00640 1 -- 172.21.15.29:0/3953415781 wait complete. 2024-01-24T13:04:47.401 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:04:47.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f2872200640 1 Processor -- start 2024-01-24T13:04:47.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f2872200640 1 -- start start 2024-01-24T13:04:47.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f2872200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f286c0ce050 0x7f286c0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f2872200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f286c06b0a0 0x7f286c06b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f2872200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286c161130 con 0x7f286c0cd300 2024-01-24T13:04:47.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f2872200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286c0cea20 con 0x7f286c0ce050 2024-01-24T13:04:47.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f2872200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c1605b0 con 0x7f286c06b0a0 2024-01-24T13:04:47.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286b400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f286c0cd300 0x7f286c15d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33744/0 (socket says 172.21.15.29:33744) 2024-01-24T13:04:47.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286b400640 1 -- 172.21.15.29:0/873237490 learned_addr learned my addr 172.21.15.29:0/873237490 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286aa00640 1 --2- 172.21.15.29:0/873237490 >> v2:172.21.15.163:3300/0 conn(0x7f286c0ce050 0x7f286c0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286be00640 1 --2- 172.21.15.29:0/873237490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f286c06b0a0 0x7f286c06b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 -- 172.21.15.29:0/873237490 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866558532 0 0) 0x7f286c161130 con 0x7f286c0cd300 2024-01-24T13:04:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 -- 172.21.15.29:0/873237490 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f284c003530 con 0x7f286c0cd300 2024-01-24T13:04:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 -- 172.21.15.29:0/873237490 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4115205720 0 0) 0x7f284c003530 con 0x7f286c0cd300 2024-01-24T13:04:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 -- 172.21.15.29:0/873237490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f286c06b0a0 msgr2=0x7f286c06b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 --2- 172.21.15.29:0/873237490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f286c06b0a0 0x7f286c06b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 -- 172.21.15.29:0/873237490 >> v2:172.21.15.163:3300/0 conn(0x7f286c0ce050 msgr2=0x7f286c0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 --2- 172.21.15.29:0/873237490 >> v2:172.21.15.163:3300/0 conn(0x7f286c0ce050 0x7f286c0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 -- 172.21.15.29:0/873237490 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c160890 con 0x7f286c0cd300 2024-01-24T13:04:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 -- 172.21.15.29:0/873237490 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f285c001680 con 0x7f286c0cd300 2024-01-24T13:04:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286aa00640 1 --2- 172.21.15.29:0/873237490 >> v2:172.21.15.163:3300/0 conn(0x7f286c0ce050 0x7f286c0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 -- 172.21.15.29:0/873237490 >> v1:172.21.15.29:6789/0 conn(0x7f286c0cd300 legacy=0x7f286c15d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 --2- 172.21.15.29:0/873237490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f284c003980 0x7f284c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 --2- 172.21.15.29:0/873237490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f284c0047d0 0x7f284c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 --2- 172.21.15.29:0/873237490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f286c06b0a0 0x7f284c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 -- 172.21.15.29:0/873237490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0cea20 con 0x7f284c0047d0 2024-01-24T13:04:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 -- 172.21.15.29:0/873237490 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c1605b0 con 0x7f284c003980 2024-01-24T13:04:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286a000640 1 -- 172.21.15.29:0/873237490 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c00b990 con 0x7f286c06b0a0 2024-01-24T13:04:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286aa00640 1 --2- 172.21.15.29:0/873237490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f284c0047d0 0x7f284c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286b400640 1 --2- 172.21.15.29:0/873237490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f284c003980 0x7f284c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286be00640 1 --2- 172.21.15.29:0/873237490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f286c06b0a0 0x7f284c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286aa00640 1 -- 172.21.15.29:0/873237490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f286c06b0a0 msgr2=0x7f284c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286aa00640 1 --2- 172.21.15.29:0/873237490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f286c06b0a0 0x7f284c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286aa00640 1 -- 172.21.15.29:0/873237490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f284c003980 msgr2=0x7f284c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286aa00640 1 --2- 172.21.15.29:0/873237490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f284c003980 0x7f284c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.543+0000 7f286aa00640 1 -- 172.21.15.29:0/873237490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c003530 con 0x7f284c0047d0 2024-01-24T13:04:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.547+0000 7f286aa00640 1 --2- 172.21.15.29:0/873237490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f284c0047d0 0x7f284c004c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2854009cb0 tx=0x7f285401cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440ebe83b7c1a8eb server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.547+0000 7f286a000640 1 -- 172.21.15.29:0/873237490 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540a5740 con 0x7f284c0047d0 2024-01-24T13:04:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.547+0000 7f286a000640 1 -- 172.21.15.29:0/873237490 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28540a58a0 con 0x7f284c0047d0 2024-01-24T13:04:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.547+0000 7f286a000640 1 -- 172.21.15.29:0/873237490 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540a5c50 con 0x7f284c0047d0 2024-01-24T13:04:47.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.547+0000 7f2872200640 1 -- 172.21.15.29:0/873237490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f284c0047d0 msgr2=0x7f284c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.547+0000 7f2872200640 1 --2- 172.21.15.29:0/873237490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f284c0047d0 0x7f284c004c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2854009cb0 tx=0x7f285401cc70 comp rx=0 tx=0).stop 2024-01-24T13:04:47.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.547+0000 7f286be00640 1 -- 172.21.15.29:0/873237490 reap_dead start 2024-01-24T13:04:47.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.547+0000 7f2872200640 1 -- 172.21.15.29:0/873237490 shutdown_connections 2024-01-24T13:04:47.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.547+0000 7f2872200640 1 -- 172.21.15.29:0/873237490 >> 172.21.15.29:0/873237490 conn(0x7f286c069cd0 msgr2=0x7f286c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:47.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.547+0000 7f2872200640 1 -- 172.21.15.29:0/873237490 shutdown_connections 2024-01-24T13:04:47.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.547+0000 7f2872200640 1 -- 172.21.15.29:0/873237490 wait complete. 2024-01-24T13:04:47.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f2872200640 1 Processor -- start 2024-01-24T13:04:47.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f2872200640 1 -- start start 2024-01-24T13:04:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f2872200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f284c0047d0 0x7f286c154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f2872200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f286c1f1e80 0x7f286c0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f2872200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f286c0aeff0 0x7f286c15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f2872200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c1550b0 con 0x7f286c0aeff0 2024-01-24T13:04:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f2872200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0b45c0 con 0x7f286c1f1e80 2024-01-24T13:04:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f2872200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0af530 con 0x7f284c0047d0 2024-01-24T13:04:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f286be00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f286c0aeff0 0x7f286c15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f286be00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f286c0aeff0 0x7f286c15d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52768/0 (socket says 172.21.15.29:52768) 2024-01-24T13:04:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f286be00640 1 -- 172.21.15.29:0/2494007876 learned_addr learned my addr 172.21.15.29:0/2494007876 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f286aa00640 1 --2- 172.21.15.29:0/2494007876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f286c1f1e80 0x7f286c0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f286b400640 1 --2- 172.21.15.29:0/2494007876 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f284c0047d0 0x7f286c154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f286be00640 1 -- 172.21.15.29:0/2494007876 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f284c0047d0 msgr2=0x7f286c154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f286be00640 1 --2- 172.21.15.29:0/2494007876 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f284c0047d0 0x7f286c154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f286be00640 1 -- 172.21.15.29:0/2494007876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f286c1f1e80 msgr2=0x7f286c0aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f286be00640 1 --2- 172.21.15.29:0/2494007876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f286c1f1e80 0x7f286c0aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f286be00640 1 -- 172.21.15.29:0/2494007876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c0b3f70 con 0x7f286c0aeff0 2024-01-24T13:04:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f286be00640 1 --2- 172.21.15.29:0/2494007876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f286c0aeff0 0x7f286c15d6a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f286c0cdde0 tx=0x7f28640115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:47.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f2863400640 1 -- 172.21.15.29:0/2494007876 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400e070 con 0x7f286c0aeff0 2024-01-24T13:04:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f2863400640 1 -- 172.21.15.29:0/2494007876 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2864011e10 con 0x7f286c0aeff0 2024-01-24T13:04:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.551+0000 7f2872200640 1 -- 172.21.15.29:0/2494007876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286c0b4250 con 0x7f286c0aeff0 2024-01-24T13:04:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.555+0000 7f2863400640 1 -- 172.21.15.29:0/2494007876 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28640039a0 con 0x7f286c0aeff0 2024-01-24T13:04:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.555+0000 7f2872200640 1 -- 172.21.15.29:0/2494007876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286c15dbe0 con 0x7f286c0aeff0 2024-01-24T13:04:47.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.555+0000 7f2872200640 1 -- 172.21.15.29:0/2494007876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286c0b3dd0 con 0x7f286c0aeff0 2024-01-24T13:04:47.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.555+0000 7f2863400640 1 -- 172.21.15.29:0/2494007876 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2864003b00 con 0x7f286c0aeff0 2024-01-24T13:04:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.555+0000 7f2863400640 1 --2- 172.21.15.29:0/2494007876 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2844065a90 0x7f2844067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.555+0000 7f2863400640 1 -- 172.21.15.29:0/2494007876 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f2864083d40 con 0x7f286c0aeff0 2024-01-24T13:04:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.555+0000 7f286b400640 1 --2- 172.21.15.29:0/2494007876 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2844065a90 0x7f2844067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.559+0000 7f286b400640 1 --2- 172.21.15.29:0/2494007876 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2844065a90 0x7f2844067f50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f285c005360 tx=0x7f285c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:47.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.559+0000 7f2863400640 1 -- 172.21.15.29:0/2494007876 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f286c0b3dd0 con 0x7f286c0aeff0 2024-01-24T13:04:47.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.715+0000 7f2872200640 1 -- 172.21.15.29:0/2494007876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f286c0b3dd0 con 0x7f286c0aeff0 2024-01-24T13:04:47.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.719+0000 7f2863400640 1 -- 172.21.15.29:0/2494007876 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f286c0b3dd0 con 0x7f286c0aeff0 2024-01-24T13:04:47.721 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:47.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.719+0000 7f2872200640 1 -- 172.21.15.29:0/2494007876 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2844065a90 msgr2=0x7f2844067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.719+0000 7f2872200640 1 --2- 172.21.15.29:0/2494007876 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2844065a90 0x7f2844067f50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f285c005360 tx=0x7f285c009040 comp rx=0 tx=0).stop 2024-01-24T13:04:47.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.719+0000 7f2872200640 1 -- 172.21.15.29:0/2494007876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f286c0aeff0 msgr2=0x7f286c15d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.719+0000 7f2872200640 1 --2- 172.21.15.29:0/2494007876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f286c0aeff0 0x7f286c15d6a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f286c0cdde0 tx=0x7f28640115a0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.719+0000 7f2872200640 1 -- 172.21.15.29:0/2494007876 shutdown_connections 2024-01-24T13:04:47.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.719+0000 7f2872200640 1 --2- 172.21.15.29:0/2494007876 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2844065a90 0x7f2844067f50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.719+0000 7f2872200640 1 --2- 172.21.15.29:0/2494007876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f286c0aeff0 0x7f286c15d6a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.719+0000 7f2872200640 1 --2- 172.21.15.29:0/2494007876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f286c1f1e80 0x7f286c0aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.719+0000 7f2872200640 1 --2- 172.21.15.29:0/2494007876 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f284c0047d0 0x7f286c154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.719+0000 7f2872200640 1 -- 172.21.15.29:0/2494007876 >> 172.21.15.29:0/2494007876 conn(0x7f286c069cd0 msgr2=0x7f286c0b09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:47.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.719+0000 7f2872200640 1 -- 172.21.15.29:0/2494007876 shutdown_connections 2024-01-24T13:04:47.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.719+0000 7f2872200640 1 -- 172.21.15.29:0/2494007876 wait complete. 2024-01-24T13:04:47.742 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:04:47.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe40a600640 1 Processor -- start 2024-01-24T13:04:47.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe40a600640 1 -- start start 2024-01-24T13:04:47.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe40a600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe404153a00 0x7fe404071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe40a600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4040b2760 0x7fe4040b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe40a600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe4040b1130 0x7fe4040b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe40a600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4040b3120 con 0x7fe404153a00 2024-01-24T13:04:47.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe40a600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe404153de0 con 0x7fe4040b1130 2024-01-24T13:04:47.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe40a600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe404159900 con 0x7fe4040b2760 2024-01-24T13:04:47.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe403400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe404153a00 0x7fe404071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe403400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe404153a00 0x7fe404071600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52778/0 (socket says 172.21.15.29:52778) 2024-01-24T13:04:47.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe403400640 1 -- 172.21.15.29:0/1641874192 learned_addr learned my addr 172.21.15.29:0/1641874192 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:47.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe403e00640 1 --2- 172.21.15.29:0/1641874192 >> v2:172.21.15.163:3300/0 conn(0x7fe4040b1130 0x7fe4040b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe402a00640 1 --2- 172.21.15.29:0/1641874192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4040b2760 0x7fe4040b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe403400640 1 -- 172.21.15.29:0/1641874192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4040b2760 msgr2=0x7fe4040b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:47.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe403400640 1 --2- 172.21.15.29:0/1641874192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4040b2760 0x7fe4040b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe403400640 1 -- 172.21.15.29:0/1641874192 >> v2:172.21.15.163:3300/0 conn(0x7fe4040b1130 msgr2=0x7fe4040b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:47.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe403400640 1 --2- 172.21.15.29:0/1641874192 >> v2:172.21.15.163:3300/0 conn(0x7fe4040b1130 0x7fe4040b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.883+0000 7fe403400640 1 -- 172.21.15.29:0/1641874192 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe404159bc0 con 0x7fe404153a00 2024-01-24T13:04:47.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.887+0000 7fe403400640 1 --2- 172.21.15.29:0/1641874192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe404153a00 0x7fe404071600 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe4040cf090 tx=0x7fe3f401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc855331f83622f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:47.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.887+0000 7fe402000640 1 -- 172.21.15.29:0/1641874192 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f40ab600 con 0x7fe404153a00 2024-01-24T13:04:47.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.887+0000 7fe402000640 1 -- 172.21.15.29:0/1641874192 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f40ab760 con 0x7fe404153a00 2024-01-24T13:04:47.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.887+0000 7fe402000640 1 -- 172.21.15.29:0/1641874192 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f40abaf0 con 0x7fe404153a00 2024-01-24T13:04:47.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.887+0000 7fe40a600640 1 -- 172.21.15.29:0/1641874192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe404153a00 msgr2=0x7fe404071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.887+0000 7fe40a600640 1 --2- 172.21.15.29:0/1641874192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe404153a00 0x7fe404071600 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe4040cf090 tx=0x7fe3f401c440 comp rx=0 tx=0).stop 2024-01-24T13:04:47.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.887+0000 7fe40a600640 1 -- 172.21.15.29:0/1641874192 shutdown_connections 2024-01-24T13:04:47.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.887+0000 7fe40a600640 1 --2- 172.21.15.29:0/1641874192 >> v2:172.21.15.163:3300/0 conn(0x7fe4040b1130 0x7fe4040b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.887+0000 7fe40a600640 1 --2- 172.21.15.29:0/1641874192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4040b2760 0x7fe4040b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe40a600640 1 --2- 172.21.15.29:0/1641874192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe404153a00 0x7fe404071600 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe40a600640 1 -- 172.21.15.29:0/1641874192 >> 172.21.15.29:0/1641874192 conn(0x7fe40406d700 msgr2=0x7fe404069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:47.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe40a600640 1 -- 172.21.15.29:0/1641874192 shutdown_connections 2024-01-24T13:04:47.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe40a600640 1 -- 172.21.15.29:0/1641874192 wait complete. 2024-01-24T13:04:47.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe40a600640 1 Processor -- start 2024-01-24T13:04:47.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe40a600640 1 -- start start 2024-01-24T13:04:47.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe40a600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4040b1130 0x7fe4041465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe40a600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4040b2760 0x7fe404142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe40a600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe404153a00 0x7fe404144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe40a600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe404146180 con 0x7fe4040b2760 2024-01-24T13:04:47.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe40a600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe404145500 con 0x7fe4040b1130 2024-01-24T13:04:47.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe40a600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4041457e0 con 0x7fe404153a00 2024-01-24T13:04:47.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe402a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4040b2760 0x7fe404142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe402a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4040b2760 0x7fe404142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52780/0 (socket says 172.21.15.29:52780) 2024-01-24T13:04:47.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe402a00640 1 -- 172.21.15.29:0/2730300694 learned_addr learned my addr 172.21.15.29:0/2730300694 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:47.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe403e00640 1 --2- 172.21.15.29:0/2730300694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe404153a00 0x7fe404144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe403400640 1 --2- 172.21.15.29:0/2730300694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4040b1130 0x7fe4041465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe402a00640 1 -- 172.21.15.29:0/2730300694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe404153a00 msgr2=0x7fe404144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe402a00640 1 --2- 172.21.15.29:0/2730300694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe404153a00 0x7fe404144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe402a00640 1 -- 172.21.15.29:0/2730300694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4040b1130 msgr2=0x7fe4041465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:47.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe402a00640 1 --2- 172.21.15.29:0/2730300694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4040b1130 0x7fe4041465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:47.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe402a00640 1 -- 172.21.15.29:0/2730300694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f40094d0 con 0x7fe4040b2760 2024-01-24T13:04:47.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.891+0000 7fe402a00640 1 --2- 172.21.15.29:0/2730300694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4040b2760 0x7fe404142580 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00d5f0 tx=0x7fe3ec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:47.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.895+0000 7fe3fb400640 1 -- 172.21.15.29:0/2730300694 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec0125f0 con 0x7fe4040b2760 2024-01-24T13:04:47.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.895+0000 7fe3fb400640 1 -- 172.21.15.29:0/2730300694 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec012750 con 0x7fe4040b2760 2024-01-24T13:04:47.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.895+0000 7fe3fb400640 1 -- 172.21.15.29:0/2730300694 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec012ae0 con 0x7fe4040b2760 2024-01-24T13:04:47.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.895+0000 7fe40a600640 1 -- 172.21.15.29:0/2730300694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe404145ac0 con 0x7fe4040b2760 2024-01-24T13:04:47.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.895+0000 7fe40a600640 1 -- 172.21.15.29:0/2730300694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe404146ae0 con 0x7fe4040b2760 2024-01-24T13:04:47.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.895+0000 7fe40a600640 1 -- 172.21.15.29:0/2730300694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe40404e850 con 0x7fe4040b2760 2024-01-24T13:04:47.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.895+0000 7fe3fb400640 1 -- 172.21.15.29:0/2730300694 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe3ec012c40 con 0x7fe4040b2760 2024-01-24T13:04:47.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.895+0000 7fe3fb400640 1 --2- 172.21.15.29:0/2730300694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe3dc065a60 0x7fe3dc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:47.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.895+0000 7fe3fb400640 1 -- 172.21.15.29:0/2730300694 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fe3ec0838f0 con 0x7fe4040b2760 2024-01-24T13:04:47.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.895+0000 7fe403400640 1 --2- 172.21.15.29:0/2730300694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe3dc065a60 0x7fe3dc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:47.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.899+0000 7fe403400640 1 --2- 172.21.15.29:0/2730300694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe3dc065a60 0x7fe3dc067f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe3f40af000 tx=0x7fe3f40b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:47.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:47.899+0000 7fe3fb400640 1 -- 172.21.15.29:0/2730300694 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe3ec050f10 con 0x7fe4040b2760 2024-01-24T13:04:48.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.059+0000 7fe40a600640 1 -- 172.21.15.29:0/2730300694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe404070ed0 con 0x7fe4040b2760 2024-01-24T13:04:48.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.059+0000 7fe3fb400640 1 -- 172.21.15.29:0/2730300694 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3ec054530 con 0x7fe4040b2760 2024-01-24T13:04:48.064 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:04:48.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.063+0000 7fe40a600640 1 -- 172.21.15.29:0/2730300694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe3dc065a60 msgr2=0x7fe3dc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:48.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.063+0000 7fe40a600640 1 --2- 172.21.15.29:0/2730300694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe3dc065a60 0x7fe3dc067f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe3f40af000 tx=0x7fe3f40b6040 comp rx=0 tx=0).stop 2024-01-24T13:04:48.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.063+0000 7fe40a600640 1 -- 172.21.15.29:0/2730300694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4040b2760 msgr2=0x7fe404142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:48.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.063+0000 7fe40a600640 1 --2- 172.21.15.29:0/2730300694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4040b2760 0x7fe404142580 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00d5f0 tx=0x7fe3ec00dab0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.063+0000 7fe40a600640 1 -- 172.21.15.29:0/2730300694 shutdown_connections 2024-01-24T13:04:48.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.063+0000 7fe40a600640 1 --2- 172.21.15.29:0/2730300694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe3dc065a60 0x7fe3dc067f20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.063+0000 7fe40a600640 1 --2- 172.21.15.29:0/2730300694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe404153a00 0x7fe404144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.063+0000 7fe40a600640 1 --2- 172.21.15.29:0/2730300694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4040b2760 0x7fe404142580 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.063+0000 7fe40a600640 1 --2- 172.21.15.29:0/2730300694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4040b1130 0x7fe4041465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.063+0000 7fe40a600640 1 -- 172.21.15.29:0/2730300694 >> 172.21.15.29:0/2730300694 conn(0x7fe40406d700 msgr2=0x7fe40415c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:48.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.063+0000 7fe40a600640 1 -- 172.21.15.29:0/2730300694 shutdown_connections 2024-01-24T13:04:48.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.063+0000 7fe40a600640 1 -- 172.21.15.29:0/2730300694 wait complete. 2024-01-24T13:04:48.085 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:04:48.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa76200640 1 Processor -- start 2024-01-24T13:04:48.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa76200640 1 -- start start 2024-01-24T13:04:48.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa76200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7faa7006be20 0x7faa7015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:48.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa76200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faa7006c200 0x7faa7015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa76200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa7013cda0 0x7faa7013d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa76200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7013d720 con 0x7faa7006c200 2024-01-24T13:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa76200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7015b4f0 con 0x7faa7006be20 2024-01-24T13:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa76200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7015b7d0 con 0x7faa7013cda0 2024-01-24T13:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa6ea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faa7006c200 0x7faa7015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa6ea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faa7006c200 0x7faa7015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52788/0 (socket says 172.21.15.29:52788) 2024-01-24T13:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa6ea00640 1 -- 172.21.15.29:0/2839017072 learned_addr learned my addr 172.21.15.29:0/2839017072 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa6fe00640 1 --2- 172.21.15.29:0/2839017072 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa7013cda0 0x7faa7013d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa6f400640 1 --2- 172.21.15.29:0/2839017072 >> v2:172.21.15.163:3300/0 conn(0x7faa7006be20 0x7faa7015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa6ea00640 1 -- 172.21.15.29:0/2839017072 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa7013cda0 msgr2=0x7faa7013d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa6ea00640 1 --2- 172.21.15.29:0/2839017072 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa7013cda0 0x7faa7013d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa6ea00640 1 -- 172.21.15.29:0/2839017072 >> v2:172.21.15.163:3300/0 conn(0x7faa7006be20 msgr2=0x7faa7015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:48.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa6ea00640 1 --2- 172.21.15.29:0/2839017072 >> v2:172.21.15.163:3300/0 conn(0x7faa7006be20 0x7faa7015a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.227+0000 7faa6ea00640 1 -- 172.21.15.29:0/2839017072 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa700cd0c0 con 0x7faa7006c200 2024-01-24T13:04:48.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.231+0000 7faa6ea00640 1 --2- 172.21.15.29:0/2839017072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa7006c200 0x7faa7015af00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faa700cefb0 tx=0x7faa5801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495d3046e4a59b60 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:48.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.231+0000 7faa6e000640 1 -- 172.21.15.29:0/2839017072 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa580ab670 con 0x7faa7006c200 2024-01-24T13:04:48.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.231+0000 7faa6e000640 1 -- 172.21.15.29:0/2839017072 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa580ab7d0 con 0x7faa7006c200 2024-01-24T13:04:48.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.231+0000 7faa6e000640 1 -- 172.21.15.29:0/2839017072 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa580abb60 con 0x7faa7006c200 2024-01-24T13:04:48.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.231+0000 7faa76200640 1 -- 172.21.15.29:0/2839017072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa7006c200 msgr2=0x7faa7015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:48.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.231+0000 7faa76200640 1 --2- 172.21.15.29:0/2839017072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa7006c200 0x7faa7015af00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faa700cefb0 tx=0x7faa5801c4d0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.231+0000 7faa76200640 1 -- 172.21.15.29:0/2839017072 shutdown_connections 2024-01-24T13:04:48.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.231+0000 7faa76200640 1 --2- 172.21.15.29:0/2839017072 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa7013cda0 0x7faa7013d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.231+0000 7faa76200640 1 --2- 172.21.15.29:0/2839017072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa7006c200 0x7faa7015af00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.231+0000 7faa76200640 1 --2- 172.21.15.29:0/2839017072 >> v2:172.21.15.163:3300/0 conn(0x7faa7006be20 0x7faa7015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.231+0000 7faa76200640 1 -- 172.21.15.29:0/2839017072 >> 172.21.15.29:0/2839017072 conn(0x7faa7006d700 msgr2=0x7faa70069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:48.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.231+0000 7faa76200640 1 -- 172.21.15.29:0/2839017072 shutdown_connections 2024-01-24T13:04:48.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.231+0000 7faa76200640 1 -- 172.21.15.29:0/2839017072 wait complete. 2024-01-24T13:04:48.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa76200640 1 Processor -- start 2024-01-24T13:04:48.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa76200640 1 -- start start 2024-01-24T13:04:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa76200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faa7006be20 0x7faa7013c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa76200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa7006c200 0x7faa70138a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa76200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa7013cda0 0x7faa701505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa76200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7014f0c0 con 0x7faa7006c200 2024-01-24T13:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa76200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7013c6c0 con 0x7faa7006be20 2024-01-24T13:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa76200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7014ede0 con 0x7faa7013cda0 2024-01-24T13:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa6ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa7006c200 0x7faa70138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa6ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa7006c200 0x7faa70138a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52792/0 (socket says 172.21.15.29:52792) 2024-01-24T13:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa6ea00640 1 -- 172.21.15.29:0/469916877 learned_addr learned my addr 172.21.15.29:0/469916877 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa6f400640 1 --2- 172.21.15.29:0/469916877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faa7006be20 0x7faa7013c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa6ea00640 1 -- 172.21.15.29:0/469916877 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa7013cda0 msgr2=0x7faa701505c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-24T13:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa6ea00640 1 --2- 172.21.15.29:0/469916877 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa7013cda0 0x7faa701505c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa6ea00640 1 -- 172.21.15.29:0/469916877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faa7006be20 msgr2=0x7faa7013c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa6ea00640 1 --2- 172.21.15.29:0/469916877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faa7006be20 0x7faa7013c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa6ea00640 1 -- 172.21.15.29:0/469916877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa580094d0 con 0x7faa7006c200 2024-01-24T13:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa6ea00640 1 --2- 172.21.15.29:0/469916877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa7006c200 0x7faa70138a70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7faa5801ab80 tx=0x7faa5801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:48.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa67400640 1 -- 172.21.15.29:0/469916877 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa580b4800 con 0x7faa7006c200 2024-01-24T13:04:48.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa67400640 1 -- 172.21.15.29:0/469916877 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa580b4960 con 0x7faa7006c200 2024-01-24T13:04:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa67400640 1 -- 172.21.15.29:0/469916877 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa580b4cd0 con 0x7faa7006c200 2024-01-24T13:04:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa76200640 1 -- 172.21.15.29:0/469916877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa700b2060 con 0x7faa7006c200 2024-01-24T13:04:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.235+0000 7faa76200640 1 -- 172.21.15.29:0/469916877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa700b2620 con 0x7faa7006c200 2024-01-24T13:04:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.239+0000 7faa76200640 1 -- 172.21.15.29:0/469916877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa70151950 con 0x7faa7006c200 2024-01-24T13:04:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.239+0000 7faa67400640 1 -- 172.21.15.29:0/469916877 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faa580b3380 con 0x7faa7006c200 2024-01-24T13:04:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.239+0000 7faa67400640 1 --2- 172.21.15.29:0/469916877 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7faa48065a60 0x7faa48067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.239+0000 7faa67400640 1 -- 172.21.15.29:0/469916877 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7faa5811dce0 con 0x7faa7006c200 2024-01-24T13:04:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.239+0000 7faa6f400640 1 --2- 172.21.15.29:0/469916877 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7faa48065a60 0x7faa48067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:48.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.239+0000 7faa6f400640 1 --2- 172.21.15.29:0/469916877 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7faa48065a60 0x7faa48067f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faa700cc5a0 tx=0x7faa60008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:48.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.243+0000 7faa67400640 1 -- 172.21.15.29:0/469916877 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7faa580eb4b0 con 0x7faa7006c200 2024-01-24T13:04:48.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.399+0000 7faa76200640 1 -- 172.21.15.29:0/469916877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faa700b2810 con 0x7faa7006c200 2024-01-24T13:04:48.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.399+0000 7faa67400640 1 -- 172.21.15.29:0/469916877 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7faa580c4020 con 0x7faa7006c200 2024-01-24T13:04:48.401 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:48.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.399+0000 7faa76200640 1 -- 172.21.15.29:0/469916877 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7faa48065a60 msgr2=0x7faa48067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:48.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.399+0000 7faa76200640 1 --2- 172.21.15.29:0/469916877 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7faa48065a60 0x7faa48067f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faa700cc5a0 tx=0x7faa60008040 comp rx=0 tx=0).stop 2024-01-24T13:04:48.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.399+0000 7faa76200640 1 -- 172.21.15.29:0/469916877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa7006c200 msgr2=0x7faa70138a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:48.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.399+0000 7faa76200640 1 --2- 172.21.15.29:0/469916877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa7006c200 0x7faa70138a70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7faa5801ab80 tx=0x7faa5801ad10 comp rx=0 tx=0).stop 2024-01-24T13:04:48.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.399+0000 7faa76200640 1 -- 172.21.15.29:0/469916877 shutdown_connections 2024-01-24T13:04:48.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.399+0000 7faa76200640 1 --2- 172.21.15.29:0/469916877 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7faa48065a60 0x7faa48067f20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.399+0000 7faa76200640 1 --2- 172.21.15.29:0/469916877 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa7013cda0 0x7faa701505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.399+0000 7faa76200640 1 --2- 172.21.15.29:0/469916877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa7006c200 0x7faa70138a70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.399+0000 7faa76200640 1 --2- 172.21.15.29:0/469916877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faa7006be20 0x7faa7013c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.399+0000 7faa76200640 1 -- 172.21.15.29:0/469916877 >> 172.21.15.29:0/469916877 conn(0x7faa7006d700 msgr2=0x7faa700ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:48.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.399+0000 7faa76200640 1 -- 172.21.15.29:0/469916877 shutdown_connections 2024-01-24T13:04:48.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.399+0000 7faa76200640 1 -- 172.21.15.29:0/469916877 wait complete. 2024-01-24T13:04:48.431 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2024-01-24T13:04:48.431 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-01-24T13:04:48.431 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-01-24T13:04:48.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d1a000640 1 Processor -- start 2024-01-24T13:04:48.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d1a000640 1 -- start start 2024-01-24T13:04:48.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d1a000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4d14070240 0x7f4d14070680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:48.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d1a000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d14070bc0 0x7f4d140b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:48.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d1a000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d14071050 con 0x7f4d141588d0 2024-01-24T13:04:48.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d1a000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d141593c0 con 0x7f4d14070bc0 2024-01-24T13:04:48.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d1a000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1415c830 con 0x7f4d14070240 2024-01-24T13:04:48.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d13e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d14070bc0 0x7f4d140b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:48.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d13400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4d141588d0 0x7f4d14158cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33756/0 (socket says 172.21.15.29:33756) 2024-01-24T13:04:48.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d13400640 1 -- 172.21.15.29:0/2618414249 learned_addr learned my addr 172.21.15.29:0/2618414249 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:48.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d12a00640 1 --2- 172.21.15.29:0/2618414249 >> v2:172.21.15.163:3300/0 conn(0x7f4d14070240 0x7f4d14070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:48.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d13e00640 1 -- 172.21.15.29:0/2618414249 >> v2:172.21.15.163:3300/0 conn(0x7f4d14070240 msgr2=0x7f4d14070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:48.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d13e00640 1 --2- 172.21.15.29:0/2618414249 >> v2:172.21.15.163:3300/0 conn(0x7f4d14070240 0x7f4d14070680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d13e00640 1 -- 172.21.15.29:0/2618414249 >> v1:172.21.15.29:6789/0 conn(0x7f4d141588d0 legacy=0x7f4d14158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:48.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d12000640 1 -- 172.21.15.29:0/2618414249 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154748025 0 0) 0x7f4d14071050 con 0x7f4d141588d0 2024-01-24T13:04:48.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.571+0000 7f4d13e00640 1 -- 172.21.15.29:0/2618414249 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1415cb10 con 0x7f4d14070bc0 2024-01-24T13:04:48.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.575+0000 7f4d13e00640 1 --2- 172.21.15.29:0/2618414249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d14070bc0 0x7f4d140b1fb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4d1406e0f0 tx=0x7f4d0c01c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6618cf14b5250a65 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:48.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.575+0000 7f4d12000640 1 -- 172.21.15.29:0/2618414249 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0a5800 con 0x7f4d14070bc0 2024-01-24T13:04:48.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.575+0000 7f4d12000640 1 -- 172.21.15.29:0/2618414249 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c0a5960 con 0x7f4d14070bc0 2024-01-24T13:04:48.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.575+0000 7f4d12000640 1 -- 172.21.15.29:0/2618414249 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0a5cf0 con 0x7f4d14070bc0 2024-01-24T13:04:48.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.575+0000 7f4d1a000640 1 -- 172.21.15.29:0/2618414249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d14070bc0 msgr2=0x7f4d140b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:48.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.575+0000 7f4d1a000640 1 --2- 172.21.15.29:0/2618414249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d14070bc0 0x7f4d140b1fb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4d1406e0f0 tx=0x7f4d0c01c7c0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.575+0000 7f4d1a000640 1 -- 172.21.15.29:0/2618414249 shutdown_connections 2024-01-24T13:04:48.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.575+0000 7f4d1a000640 1 --2- 172.21.15.29:0/2618414249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d14070bc0 0x7f4d140b1fb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.575+0000 7f4d1a000640 1 --2- 172.21.15.29:0/2618414249 >> v2:172.21.15.163:3300/0 conn(0x7f4d14070240 0x7f4d14070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.575+0000 7f4d1a000640 1 -- 172.21.15.29:0/2618414249 >> 172.21.15.29:0/2618414249 conn(0x7f4d140b3950 msgr2=0x7f4d14069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:48.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.575+0000 7f4d1a000640 1 -- 172.21.15.29:0/2618414249 shutdown_connections 2024-01-24T13:04:48.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.575+0000 7f4d1a000640 1 -- 172.21.15.29:0/2618414249 wait complete. 2024-01-24T13:04:48.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d1a000640 1 Processor -- start 2024-01-24T13:04:48.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d1a000640 1 -- start start 2024-01-24T13:04:48.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d1a000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d14070240 0x7f4d1414ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:48.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d1a000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d14070bc0 0x7f4d14157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:48.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d1a000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d141588d0 0x7f4d14151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:48.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d1a000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d14151250 con 0x7f4d14070240 2024-01-24T13:04:48.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d1a000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d14156590 con 0x7f4d141588d0 2024-01-24T13:04:48.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d1a000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140b2660 con 0x7f4d14070bc0 2024-01-24T13:04:48.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d13400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d14070240 0x7f4d1414ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:48.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d13400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d14070240 0x7f4d1414ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52824/0 (socket says 172.21.15.29:52824) 2024-01-24T13:04:48.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d13400640 1 -- 172.21.15.29:0/4016248658 learned_addr learned my addr 172.21.15.29:0/4016248658 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:48.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d13e00640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d141588d0 0x7f4d14151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:48.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d12a00640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d14070bc0 0x7f4d14157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:48.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d13e00640 1 -- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d14070bc0 msgr2=0x7f4d14157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:48.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d13e00640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d14070bc0 0x7f4d14157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d13e00640 1 -- 172.21.15.29:0/4016248658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d14070240 msgr2=0x7f4d1414ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:48.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d13e00640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d14070240 0x7f4d1414ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:48.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d13e00640 1 -- 172.21.15.29:0/4016248658 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c009a70 con 0x7f4d141588d0 2024-01-24T13:04:48.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d13400640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d14070240 0x7f4d1414ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:48.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d13e00640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d141588d0 0x7f4d14151af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0ac000 tx=0x7f4d0c019560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:48.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d0b400640 1 -- 172.21.15.29:0/4016248658 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0a5780 con 0x7f4d141588d0 2024-01-24T13:04:48.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d0b400640 1 -- 172.21.15.29:0/4016248658 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c0b9660 con 0x7f4d141588d0 2024-01-24T13:04:48.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d1a000640 1 -- 172.21.15.29:0/4016248658 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d14071540 con 0x7f4d141588d0 2024-01-24T13:04:48.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d0b400640 1 -- 172.21.15.29:0/4016248658 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0b99f0 con 0x7f4d141588d0 2024-01-24T13:04:48.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.579+0000 7f4d1a000640 1 -- 172.21.15.29:0/4016248658 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d141514f0 con 0x7f4d141588d0 2024-01-24T13:04:48.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.583+0000 7f4d1a000640 1 -- 172.21.15.29:0/4016248658 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d141510b0 con 0x7f4d141588d0 2024-01-24T13:04:48.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.583+0000 7f4d0b400640 1 -- 172.21.15.29:0/4016248658 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4d0c0b9b50 con 0x7f4d141588d0 2024-01-24T13:04:48.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.583+0000 7f4d0b400640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4cec065a90 0x7f4cec067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:48.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.583+0000 7f4d0b400640 1 -- 172.21.15.29:0/4016248658 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4d0c11e340 con 0x7f4d141588d0 2024-01-24T13:04:48.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.583+0000 7f4d13400640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4cec065a90 0x7f4cec067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:48.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.583+0000 7f4d13400640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4cec065a90 0x7f4cec067f50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4d04000f70 tx=0x7f4d04007eb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:48.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.587+0000 7f4d0b400640 1 -- 172.21.15.29:0/4016248658 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4d0c0ebb20 con 0x7f4d141588d0 2024-01-24T13:04:48.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:48.803+0000 7f4d1a000640 1 -- 172.21.15.29:0/4016248658 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f4d141510b0 con 0x7f4d141588d0 2024-01-24T13:04:49.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.639+0000 7f4d0b400640 1 -- 172.21.15.29:0/4016248658 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v71) v1 ==== 150+0+0 (secure 0 0 0) 0x7f4d141510b0 con 0x7f4d141588d0 2024-01-24T13:04:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.643+0000 7f4d1a000640 1 -- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4cec065a90 msgr2=0x7f4cec067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.643+0000 7f4d1a000640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4cec065a90 0x7f4cec067f50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4d04000f70 tx=0x7f4d04007eb0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.643+0000 7f4d1a000640 1 -- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d141588d0 msgr2=0x7f4d14151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.643+0000 7f4d1a000640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d141588d0 0x7f4d14151af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0ac000 tx=0x7f4d0c019560 comp rx=0 tx=0).stop 2024-01-24T13:04:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.643+0000 7f4d1a000640 1 -- 172.21.15.29:0/4016248658 shutdown_connections 2024-01-24T13:04:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.643+0000 7f4d1a000640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4cec065a90 0x7f4cec067f50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.643+0000 7f4d1a000640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d141588d0 0x7f4d14151af0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.643+0000 7f4d1a000640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d14070bc0 0x7f4d14157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.643+0000 7f4d1a000640 1 --2- 172.21.15.29:0/4016248658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d14070240 0x7f4d1414ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.643+0000 7f4d1a000640 1 -- 172.21.15.29:0/4016248658 >> 172.21.15.29:0/4016248658 conn(0x7f4d140b3950 msgr2=0x7f4d14158cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.643+0000 7f4d1a000640 1 -- 172.21.15.29:0/4016248658 shutdown_connections 2024-01-24T13:04:49.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.643+0000 7f4d1a000640 1 -- 172.21.15.29:0/4016248658 wait complete. 2024-01-24T13:04:49.669 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-24T13:04:49.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f1495c00640 1 Processor -- start 2024-01-24T13:04:49.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f1495c00640 1 -- start start 2024-01-24T13:04:49.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f1495c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14900b5730 0x7f14901643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:49.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f1495c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f14900b1280 0x7f1490166900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:49.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f1495c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14900d3010 con 0x7f14900b40c0 2024-01-24T13:04:49.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f1495c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14900cd9b0 con 0x7f14900b1280 2024-01-24T13:04:49.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f1495c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14900cdc90 con 0x7f14900b5730 2024-01-24T13:04:49.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f148f400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f14900b1280 0x7f1490166900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:49.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f148ea00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f14900b40c0 0x7f14900b44a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33764/0 (socket says 172.21.15.29:33764) 2024-01-24T13:04:49.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f148ea00640 1 -- 172.21.15.29:0/680975536 learned_addr learned my addr 172.21.15.29:0/680975536 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:49.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f148e000640 1 --2- 172.21.15.29:0/680975536 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14900b5730 0x7f14901643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:49.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f148f400640 1 -- 172.21.15.29:0/680975536 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14900b5730 msgr2=0x7f14901643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:49.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f148f400640 1 --2- 172.21.15.29:0/680975536 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14900b5730 0x7f14901643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f148f400640 1 -- 172.21.15.29:0/680975536 >> v1:172.21.15.29:6789/0 conn(0x7f14900b40c0 legacy=0x7f14900b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:49.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f148f400640 1 -- 172.21.15.29:0/680975536 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14900d1520 con 0x7f14900b1280 2024-01-24T13:04:49.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.815+0000 7f148d600640 1 -- 172.21.15.29:0/680975536 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045307421 0 0) 0x7f14900d3010 con 0x7f14900b40c0 2024-01-24T13:04:49.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.819+0000 7f148f400640 1 --2- 172.21.15.29:0/680975536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14900b1280 0x7f1490166900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1488009d90 tx=0x7f148801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136b0cdbe486a12a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:49.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.819+0000 7f148d600640 1 -- 172.21.15.29:0/680975536 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14880af600 con 0x7f14900b1280 2024-01-24T13:04:49.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.819+0000 7f148d600640 1 -- 172.21.15.29:0/680975536 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14880ab050 con 0x7f14900b1280 2024-01-24T13:04:49.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.819+0000 7f148d600640 1 -- 172.21.15.29:0/680975536 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14880af980 con 0x7f14900b1280 2024-01-24T13:04:49.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.819+0000 7f1495c00640 1 -- 172.21.15.29:0/680975536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14900b1280 msgr2=0x7f1490166900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:49.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.819+0000 7f1495c00640 1 --2- 172.21.15.29:0/680975536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14900b1280 0x7f1490166900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1488009d90 tx=0x7f148801f130 comp rx=0 tx=0).stop 2024-01-24T13:04:49.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.819+0000 7f1495c00640 1 -- 172.21.15.29:0/680975536 shutdown_connections 2024-01-24T13:04:49.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.819+0000 7f1495c00640 1 --2- 172.21.15.29:0/680975536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14900b1280 0x7f1490166900 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.819+0000 7f1495c00640 1 --2- 172.21.15.29:0/680975536 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14900b5730 0x7f14901643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.819+0000 7f1495c00640 1 -- 172.21.15.29:0/680975536 >> 172.21.15.29:0/680975536 conn(0x7f1490071800 msgr2=0x7f1490071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f1495c00640 1 -- 172.21.15.29:0/680975536 shutdown_connections 2024-01-24T13:04:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f1495c00640 1 -- 172.21.15.29:0/680975536 wait complete. 2024-01-24T13:04:49.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f1495c00640 1 Processor -- start 2024-01-24T13:04:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f1495c00640 1 -- start start 2024-01-24T13:04:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f1495c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14900b1280 0x7f1490153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f1495c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14900b40c0 0x7f14900cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f1495c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14900b5730 0x7f14900cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f1495c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14900cb050 con 0x7f14900b1280 2024-01-24T13:04:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f1495c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14900ca440 con 0x7f14900b5730 2024-01-24T13:04:49.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f1495c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14900ca720 con 0x7f14900b40c0 2024-01-24T13:04:49.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f148ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14900b1280 0x7f1490153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:49.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f148ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14900b1280 0x7f1490153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52844/0 (socket says 172.21.15.29:52844) 2024-01-24T13:04:49.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f148ea00640 1 -- 172.21.15.29:0/1664310156 learned_addr learned my addr 172.21.15.29:0/1664310156 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:49.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f148e000640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14900b40c0 0x7f14900cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:49.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f148f400640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14900b5730 0x7f14900cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f148ea00640 1 -- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14900b40c0 msgr2=0x7f14900cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f148ea00640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14900b40c0 0x7f14900cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f148ea00640 1 -- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14900b5730 msgr2=0x7f14900cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f148ea00640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14900b5730 0x7f14900cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f148ea00640 1 -- 172.21.15.29:0/1664310156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1488009a70 con 0x7f14900b1280 2024-01-24T13:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f148e000640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14900b40c0 0x7f14900cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f148f400640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14900b5730 0x7f14900cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f148ea00640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14900b1280 0x7f1490153c70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f14800011f0 tx=0x7f148000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f1486a00640 1 -- 172.21.15.29:0/1664310156 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14800074e0 con 0x7f14900b1280 2024-01-24T13:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f1486a00640 1 -- 172.21.15.29:0/1664310156 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1480007640 con 0x7f14900b1280 2024-01-24T13:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f1495c00640 1 -- 172.21.15.29:0/1664310156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14900caa00 con 0x7f14900b1280 2024-01-24T13:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.823+0000 7f1486a00640 1 -- 172.21.15.29:0/1664310156 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480004a10 con 0x7f14900b1280 2024-01-24T13:04:49.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.827+0000 7f1495c00640 1 -- 172.21.15.29:0/1664310156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14900c9710 con 0x7f14900b1280 2024-01-24T13:04:49.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.827+0000 7f1495c00640 1 -- 172.21.15.29:0/1664310156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14900cf660 con 0x7f14900b1280 2024-01-24T13:04:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.827+0000 7f1486a00640 1 -- 172.21.15.29:0/1664310156 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1480004b70 con 0x7f14900b1280 2024-01-24T13:04:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.827+0000 7f1486a00640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1468065a60 0x7f1468067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:49.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.827+0000 7f1486a00640 1 -- 172.21.15.29:0/1664310156 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f1480082800 con 0x7f14900b1280 2024-01-24T13:04:49.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.827+0000 7f148e000640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1468065a60 0x7f1468067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:49.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.831+0000 7f148e000640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1468065a60 0x7f1468067f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f149015c720 tx=0x7f1478008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:49.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.831+0000 7f1486a00640 1 -- 172.21.15.29:0/1664310156 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f148004fe10 con 0x7f14900b1280 2024-01-24T13:04:49.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.987+0000 7f1495c00640 1 -- 172.21.15.29:0/1664310156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f149004e850 con 0x7f14900b1280 2024-01-24T13:04:49.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.991+0000 7f1486a00640 1 -- 172.21.15.29:0/1664310156 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f14800180c0 con 0x7f14900b1280 2024-01-24T13:04:49.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.995+0000 7f1495c00640 1 -- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1468065a60 msgr2=0x7f1468067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:49.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.995+0000 7f1495c00640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1468065a60 0x7f1468067f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f149015c720 tx=0x7f1478008040 comp rx=0 tx=0).stop 2024-01-24T13:04:49.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.995+0000 7f1495c00640 1 -- 172.21.15.29:0/1664310156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14900b1280 msgr2=0x7f1490153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:49.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.995+0000 7f1495c00640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14900b1280 0x7f1490153c70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f14800011f0 tx=0x7f148000c9b0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.995+0000 7f1495c00640 1 -- 172.21.15.29:0/1664310156 shutdown_connections 2024-01-24T13:04:49.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.995+0000 7f1495c00640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1468065a60 0x7f1468067f20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.995+0000 7f1495c00640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14900b5730 0x7f14900cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.995+0000 7f1495c00640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14900b40c0 0x7f14900cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.995+0000 7f1495c00640 1 --2- 172.21.15.29:0/1664310156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14900b1280 0x7f1490153c70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:49.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.995+0000 7f1495c00640 1 -- 172.21.15.29:0/1664310156 >> 172.21.15.29:0/1664310156 conn(0x7f1490071800 msgr2=0x7f14900b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:49.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.995+0000 7f1495c00640 1 -- 172.21.15.29:0/1664310156 shutdown_connections 2024-01-24T13:04:49.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:49.995+0000 7f1495c00640 1 -- 172.21.15.29:0/1664310156 wait complete. 2024-01-24T13:04:50.024 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-24T13:04:50.024 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-24T13:04:50.115 DEBUG:teuthology.orchestra.run.smithi163:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-24T13:04:50.197 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-24T13:04:50.197 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:04:50.197 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:04:50.208 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:04:50.208 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:04:50.257 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:50.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.435+0000 7f4063400640 1 Processor -- start 2024-01-24T13:04:50.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.435+0000 7f4063400640 1 -- start start 2024-01-24T13:04:50.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4063400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f405c159300 0x7f405c0b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:50.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4063400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c06bc10 0x7f405c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:50.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4063400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f405c15cf50 0x7f405c15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:50.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4063400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c071140 con 0x7f405c159300 2024-01-24T13:04:50.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4063400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c15d920 con 0x7f405c15cf50 2024-01-24T13:04:50.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4063400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c06c5b0 con 0x7f405c06bc10 2024-01-24T13:04:50.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4060a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f405c159300 0x7f405c0b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:50.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4060a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f405c159300 0x7f405c0b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52858/0 (socket says 172.21.15.29:52858) 2024-01-24T13:04:50.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4060a00640 1 -- 172.21.15.29:0/2825195686 learned_addr learned my addr 172.21.15.29:0/2825195686 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:50.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4061400640 1 --2- 172.21.15.29:0/2825195686 >> v2:172.21.15.163:3300/0 conn(0x7f405c15cf50 0x7f405c15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:50.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f405be00640 1 --2- 172.21.15.29:0/2825195686 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c06bc10 0x7f405c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:50.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4060a00640 1 -- 172.21.15.29:0/2825195686 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c06bc10 msgr2=0x7f405c06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:50.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4060a00640 1 --2- 172.21.15.29:0/2825195686 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c06bc10 0x7f405c06c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4060a00640 1 -- 172.21.15.29:0/2825195686 >> v2:172.21.15.163:3300/0 conn(0x7f405c15cf50 msgr2=0x7f405c15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:50.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4060a00640 1 --2- 172.21.15.29:0/2825195686 >> v2:172.21.15.163:3300/0 conn(0x7f405c15cf50 0x7f405c15d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.439+0000 7f4060a00640 1 -- 172.21.15.29:0/2825195686 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c15de10 con 0x7f405c159300 2024-01-24T13:04:50.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f4060a00640 1 --2- 172.21.15.29:0/2825195686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f405c159300 0x7f405c0b1c40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f405c0cb810 tx=0x7f404c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae6cddec211b13e server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:50.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f405b400640 1 -- 172.21.15.29:0/2825195686 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0ab600 con 0x7f405c159300 2024-01-24T13:04:50.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f405b400640 1 -- 172.21.15.29:0/2825195686 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c0ab760 con 0x7f405c159300 2024-01-24T13:04:50.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f405b400640 1 -- 172.21.15.29:0/2825195686 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0abaf0 con 0x7f405c159300 2024-01-24T13:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f4063400640 1 -- 172.21.15.29:0/2825195686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f405c159300 msgr2=0x7f405c0b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f4063400640 1 --2- 172.21.15.29:0/2825195686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f405c159300 0x7f405c0b1c40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f405c0cb810 tx=0x7f404c01c440 comp rx=0 tx=0).stop 2024-01-24T13:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f4063400640 1 -- 172.21.15.29:0/2825195686 shutdown_connections 2024-01-24T13:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f4063400640 1 --2- 172.21.15.29:0/2825195686 >> v2:172.21.15.163:3300/0 conn(0x7f405c15cf50 0x7f405c15d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f4063400640 1 --2- 172.21.15.29:0/2825195686 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c06bc10 0x7f405c06c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f4063400640 1 --2- 172.21.15.29:0/2825195686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f405c159300 0x7f405c0b1c40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f4063400640 1 -- 172.21.15.29:0/2825195686 >> 172.21.15.29:0/2825195686 conn(0x7f405c0b3950 msgr2=0x7f405c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:50.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f4063400640 1 -- 172.21.15.29:0/2825195686 shutdown_connections 2024-01-24T13:04:50.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f4063400640 1 -- 172.21.15.29:0/2825195686 wait complete. 2024-01-24T13:04:50.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f4063400640 1 Processor -- start 2024-01-24T13:04:50.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.443+0000 7f4063400640 1 -- start start 2024-01-24T13:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4063400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c06bc10 0x7f405c1f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4063400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f405c159300 0x7f405c149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4063400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f405c15cf50 0x7f405c149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4063400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0adb10 con 0x7f405c15cf50 2024-01-24T13:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4063400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c14a280 con 0x7f405c159300 2024-01-24T13:04:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4063400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0add60 con 0x7f405c06bc10 2024-01-24T13:04:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4060a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c06bc10 0x7f405c1f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4061400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f405c15cf50 0x7f405c149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4060a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c06bc10 0x7f405c1f42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:35782/0 (socket says 172.21.15.29:35782) 2024-01-24T13:04:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4060a00640 1 -- 172.21.15.29:0/1250683451 learned_addr learned my addr 172.21.15.29:0/1250683451 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f405be00640 1 --2- 172.21.15.29:0/1250683451 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f405c159300 0x7f405c149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:50.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4060a00640 1 -- 172.21.15.29:0/1250683451 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f405c159300 msgr2=0x7f405c149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:50.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4060a00640 1 --2- 172.21.15.29:0/1250683451 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f405c159300 0x7f405c149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4060a00640 1 -- 172.21.15.29:0/1250683451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f405c15cf50 msgr2=0x7f405c149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:50.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4060a00640 1 --2- 172.21.15.29:0/1250683451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f405c15cf50 0x7f405c149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4060a00640 1 -- 172.21.15.29:0/1250683451 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c0094d0 con 0x7f405c06bc10 2024-01-24T13:04:50.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4061400640 1 --2- 172.21.15.29:0/1250683451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f405c15cf50 0x7f405c149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:50.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4060a00640 1 --2- 172.21.15.29:0/1250683451 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c06bc10 0x7f405c1f42f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f404c01aaf0 tx=0x7f404c01ac80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:50.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4058c00640 1 -- 172.21.15.29:0/1250683451 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0ab600 con 0x7f405c06bc10 2024-01-24T13:04:50.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4058c00640 1 -- 172.21.15.29:0/1250683451 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c0b4800 con 0x7f405c06bc10 2024-01-24T13:04:50.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4058c00640 1 -- 172.21.15.29:0/1250683451 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0b4b90 con 0x7f405c06bc10 2024-01-24T13:04:50.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4063400640 1 -- 172.21.15.29:0/1250683451 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c0ae040 con 0x7f405c06bc10 2024-01-24T13:04:50.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4063400640 1 -- 172.21.15.29:0/1250683451 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405c0ae600 con 0x7f405c06bc10 2024-01-24T13:04:50.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.447+0000 7f4063400640 1 -- 172.21.15.29:0/1250683451 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c04e850 con 0x7f405c06bc10 2024-01-24T13:04:50.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.451+0000 7f4058c00640 1 -- 172.21.15.29:0/1250683451 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f404c0b4cf0 con 0x7f405c06bc10 2024-01-24T13:04:50.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.451+0000 7f4058c00640 1 --2- 172.21.15.29:0/1250683451 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4034065a60 0x7f4034067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:50.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.451+0000 7f4058c00640 1 -- 172.21.15.29:0/1250683451 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f404c11daf0 con 0x7f405c06bc10 2024-01-24T13:04:50.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.451+0000 7f405be00640 1 --2- 172.21.15.29:0/1250683451 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4034065a60 0x7f4034067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:50.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.451+0000 7f405be00640 1 --2- 172.21.15.29:0/1250683451 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4034065a60 0x7f4034067f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f405c1f7fe0 tx=0x7f4044008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:50.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.455+0000 7f4058c00640 1 -- 172.21.15.29:0/1250683451 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f404c0eb190 con 0x7f405c06bc10 2024-01-24T13:04:50.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.615+0000 7f4063400640 1 -- 172.21.15.29:0/1250683451 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f405c0b0df0 con 0x7f405c06bc10 2024-01-24T13:04:50.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.615+0000 7f4058c00640 1 -- 172.21.15.29:0/1250683451 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7f404c0ee7b0 con 0x7f405c06bc10 2024-01-24T13:04:50.619 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:50.619 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:50.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.619+0000 7f4063400640 1 -- 172.21.15.29:0/1250683451 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4034065a60 msgr2=0x7f4034067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:50.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.619+0000 7f4063400640 1 --2- 172.21.15.29:0/1250683451 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4034065a60 0x7f4034067f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f405c1f7fe0 tx=0x7f4044008040 comp rx=0 tx=0).stop 2024-01-24T13:04:50.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.619+0000 7f4063400640 1 -- 172.21.15.29:0/1250683451 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c06bc10 msgr2=0x7f405c1f42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:50.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.619+0000 7f4063400640 1 --2- 172.21.15.29:0/1250683451 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c06bc10 0x7f405c1f42f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f404c01aaf0 tx=0x7f404c01ac80 comp rx=0 tx=0).stop 2024-01-24T13:04:50.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.619+0000 7f4063400640 1 -- 172.21.15.29:0/1250683451 shutdown_connections 2024-01-24T13:04:50.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.619+0000 7f4063400640 1 --2- 172.21.15.29:0/1250683451 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4034065a60 0x7f4034067f20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.619+0000 7f4063400640 1 --2- 172.21.15.29:0/1250683451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f405c15cf50 0x7f405c149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.619+0000 7f4063400640 1 --2- 172.21.15.29:0/1250683451 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f405c159300 0x7f405c149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.619+0000 7f4063400640 1 --2- 172.21.15.29:0/1250683451 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f405c06bc10 0x7f405c1f42f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.619+0000 7f4063400640 1 -- 172.21.15.29:0/1250683451 >> 172.21.15.29:0/1250683451 conn(0x7f405c0b3950 msgr2=0x7f405c0b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:50.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.619+0000 7f4063400640 1 -- 172.21.15.29:0/1250683451 shutdown_connections 2024-01-24T13:04:50.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.619+0000 7f4063400640 1 -- 172.21.15.29:0/1250683451 wait complete. 2024-01-24T13:04:50.642 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:04:50.643 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:04:50.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.783+0000 7f5e32a00640 1 Processor -- start 2024-01-24T13:04:50.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.783+0000 7f5e32a00640 1 -- start start 2024-01-24T13:04:50.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.783+0000 7f5e32a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5e2c0ce760 0x7f5e2c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:50.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.783+0000 7f5e32a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2c15daf0 con 0x7f5e2c153710 2024-01-24T13:04:50.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.783+0000 7f5e32a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2c15cee0 con 0x7f5e2c06c7d0 2024-01-24T13:04:50.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.783+0000 7f5e32a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c15d1c0 con 0x7f5e2c0ce760 2024-01-24T13:04:50.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.783+0000 7f5e2be00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5e2c153710 0x7f5e2c160d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33772/0 (socket says 172.21.15.29:33772) 2024-01-24T13:04:50.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.783+0000 7f5e2be00640 1 -- 172.21.15.29:0/2786568968 learned_addr learned my addr 172.21.15.29:0/2786568968 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:50.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.783+0000 7f5e30a00640 1 --2- 172.21.15.29:0/2786568968 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5e2c0ce760 0x7f5e2c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:50.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.783+0000 7f5e2aa00640 1 -- 172.21.15.29:0/2786568968 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494166683 0 0) 0x7f5e2c15daf0 con 0x7f5e2c153710 2024-01-24T13:04:50.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.783+0000 7f5e2aa00640 1 -- 172.21.15.29:0/2786568968 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e0c003530 con 0x7f5e2c153710 2024-01-24T13:04:50.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.783+0000 7f5e30a00640 1 -- 172.21.15.29:0/2786568968 >> v1:172.21.15.163:6789/0 conn(0x7f5e2c06c7d0 legacy=0x7f5e2c0ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:50.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.783+0000 7f5e30a00640 1 -- 172.21.15.29:0/2786568968 >> v1:172.21.15.29:6789/0 conn(0x7f5e2c153710 legacy=0x7f5e2c160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:50.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.783+0000 7f5e30a00640 1 -- 172.21.15.29:0/2786568968 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c15d4a0 con 0x7f5e2c0ce760 2024-01-24T13:04:50.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.787+0000 7f5e30a00640 1 --2- 172.21.15.29:0/2786568968 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5e2c0ce760 0x7f5e2c0ccaf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009df0 tx=0x7f5e2401c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa3383e22f64d9c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:50.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.787+0000 7f5e2aa00640 1 -- 172.21.15.29:0/2786568968 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c153d00 con 0x7f5e2c0ce760 2024-01-24T13:04:50.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.787+0000 7f5e2aa00640 1 -- 172.21.15.29:0/2786568968 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e240a5890 con 0x7f5e2c0ce760 2024-01-24T13:04:50.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.787+0000 7f5e2aa00640 1 -- 172.21.15.29:0/2786568968 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e240a5c20 con 0x7f5e2c0ce760 2024-01-24T13:04:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.787+0000 7f5e32a00640 1 -- 172.21.15.29:0/2786568968 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5e2c0ce760 msgr2=0x7f5e2c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.787+0000 7f5e32a00640 1 --2- 172.21.15.29:0/2786568968 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5e2c0ce760 0x7f5e2c0ccaf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009df0 tx=0x7f5e2401c7f0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.787+0000 7f5e32a00640 1 -- 172.21.15.29:0/2786568968 shutdown_connections 2024-01-24T13:04:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.787+0000 7f5e32a00640 1 --2- 172.21.15.29:0/2786568968 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5e2c0ce760 0x7f5e2c0ccaf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.787+0000 7f5e32a00640 1 -- 172.21.15.29:0/2786568968 >> 172.21.15.29:0/2786568968 conn(0x7f5e2c069cd0 msgr2=0x7f5e2c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:50.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e32a00640 1 -- 172.21.15.29:0/2786568968 shutdown_connections 2024-01-24T13:04:50.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e32a00640 1 -- 172.21.15.29:0/2786568968 wait complete. 2024-01-24T13:04:50.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e32a00640 1 Processor -- start 2024-01-24T13:04:50.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e32a00640 1 -- start start 2024-01-24T13:04:50.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e32a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5e2c06c7d0 0x7f5e2c0c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:50.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e32a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e2c0ce760 0x7f5e2c151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:50.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e32a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5e2c153710 0x7f5e2c1520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:50.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e32a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c0c7680 con 0x7f5e2c0ce760 2024-01-24T13:04:50.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e32a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c0c4f40 con 0x7f5e2c153710 2024-01-24T13:04:50.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e32a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c0c7920 con 0x7f5e2c06c7d0 2024-01-24T13:04:50.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e2b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e2c0ce760 0x7f5e2c151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:50.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e2b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e2c0ce760 0x7f5e2c151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52880/0 (socket says 172.21.15.29:52880) 2024-01-24T13:04:50.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e2b400640 1 -- 172.21.15.29:0/1877555483 learned_addr learned my addr 172.21.15.29:0/1877555483 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:50.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e2be00640 1 --2- 172.21.15.29:0/1877555483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5e2c06c7d0 0x7f5e2c0c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:50.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e30a00640 1 --2- 172.21.15.29:0/1877555483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5e2c153710 0x7f5e2c1520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:50.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e2b400640 1 -- 172.21.15.29:0/1877555483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5e2c06c7d0 msgr2=0x7f5e2c0c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:50.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e2b400640 1 --2- 172.21.15.29:0/1877555483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5e2c06c7d0 0x7f5e2c0c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e2b400640 1 -- 172.21.15.29:0/1877555483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5e2c153710 msgr2=0x7f5e2c1520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:50.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e2b400640 1 --2- 172.21.15.29:0/1877555483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5e2c153710 0x7f5e2c1520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e2b400640 1 -- 172.21.15.29:0/1877555483 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e24009a70 con 0x7f5e2c0ce760 2024-01-24T13:04:50.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e2b400640 1 --2- 172.21.15.29:0/1877555483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e2c0ce760 0x7f5e2c151ba0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400c780 tx=0x7f5e1400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:50.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e23e00640 1 -- 172.21.15.29:0/1877555483 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14005270 con 0x7f5e2c0ce760 2024-01-24T13:04:50.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e23e00640 1 -- 172.21.15.29:0/1877555483 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e140053d0 con 0x7f5e2c0ce760 2024-01-24T13:04:50.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.791+0000 7f5e32a00640 1 -- 172.21.15.29:0/1877555483 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2c0c7c00 con 0x7f5e2c0ce760 2024-01-24T13:04:50.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.795+0000 7f5e23e00640 1 -- 172.21.15.29:0/1877555483 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1400a880 con 0x7f5e2c0ce760 2024-01-24T13:04:50.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.795+0000 7f5e32a00640 1 -- 172.21.15.29:0/1877555483 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2c0c6e00 con 0x7f5e2c0ce760 2024-01-24T13:04:50.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.795+0000 7f5e32a00640 1 -- 172.21.15.29:0/1877555483 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2c0c7e40 con 0x7f5e2c0ce760 2024-01-24T13:04:50.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.795+0000 7f5e23e00640 1 -- 172.21.15.29:0/1877555483 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5e1400a9e0 con 0x7f5e2c0ce760 2024-01-24T13:04:50.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.795+0000 7f5e23e00640 1 --2- 172.21.15.29:0/1877555483 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5e04065a60 0x7f5e04067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:50.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.795+0000 7f5e23e00640 1 -- 172.21.15.29:0/1877555483 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f5e14082fe0 con 0x7f5e2c0ce760 2024-01-24T13:04:50.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.795+0000 7f5e2be00640 1 --2- 172.21.15.29:0/1877555483 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5e04065a60 0x7f5e04067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:50.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.795+0000 7f5e2be00640 1 --2- 172.21.15.29:0/1877555483 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5e04065a60 0x7f5e04067f20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0011f0 tx=0x7f5e1c007d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:50.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.799+0000 7f5e23e00640 1 -- 172.21.15.29:0/1877555483 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f5e2c0c7e40 con 0x7f5e2c0ce760 2024-01-24T13:04:50.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.955+0000 7f5e32a00640 1 -- 172.21.15.29:0/1877555483 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e2c0c7e40 con 0x7f5e2c0ce760 2024-01-24T13:04:50.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.955+0000 7f5e23e00640 1 -- 172.21.15.29:0/1877555483 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e2c0c7e40 con 0x7f5e2c0ce760 2024-01-24T13:04:50.959 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:04:50.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.955+0000 7f5e32a00640 1 -- 172.21.15.29:0/1877555483 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5e04065a60 msgr2=0x7f5e04067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:50.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.955+0000 7f5e32a00640 1 --2- 172.21.15.29:0/1877555483 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5e04065a60 0x7f5e04067f20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0011f0 tx=0x7f5e1c007d40 comp rx=0 tx=0).stop 2024-01-24T13:04:50.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.955+0000 7f5e32a00640 1 -- 172.21.15.29:0/1877555483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e2c0ce760 msgr2=0x7f5e2c151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:50.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.955+0000 7f5e32a00640 1 --2- 172.21.15.29:0/1877555483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e2c0ce760 0x7f5e2c151ba0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400c780 tx=0x7f5e1400cc40 comp rx=0 tx=0).stop 2024-01-24T13:04:50.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.959+0000 7f5e32a00640 1 -- 172.21.15.29:0/1877555483 shutdown_connections 2024-01-24T13:04:50.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.959+0000 7f5e32a00640 1 --2- 172.21.15.29:0/1877555483 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5e04065a60 0x7f5e04067f20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.959+0000 7f5e32a00640 1 --2- 172.21.15.29:0/1877555483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5e2c153710 0x7f5e2c1520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.959+0000 7f5e32a00640 1 --2- 172.21.15.29:0/1877555483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e2c0ce760 0x7f5e2c151ba0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.959+0000 7f5e32a00640 1 --2- 172.21.15.29:0/1877555483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5e2c06c7d0 0x7f5e2c0c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:50.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.959+0000 7f5e32a00640 1 -- 172.21.15.29:0/1877555483 >> 172.21.15.29:0/1877555483 conn(0x7f5e2c069cd0 msgr2=0x7f5e2c0ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:50.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.959+0000 7f5e32a00640 1 -- 172.21.15.29:0/1877555483 shutdown_connections 2024-01-24T13:04:50.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:50.959+0000 7f5e32a00640 1 -- 172.21.15.29:0/1877555483 wait complete. 2024-01-24T13:04:50.981 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:04:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.119+0000 7f8990c00640 1 Processor -- start 2024-01-24T13:04:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.119+0000 7f8990c00640 1 -- start start 2024-01-24T13:04:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.123+0000 7f8990c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f898c0c3fd0 0x7f898c0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.123+0000 7f8990c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f898c0cb010 0x7f898c0d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.123+0000 7f8990c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898c0cd1e0 con 0x7f898c15a6f0 2024-01-24T13:04:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.123+0000 7f8990c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898c15aad0 con 0x7f898c0c3fd0 2024-01-24T13:04:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.123+0000 7f8990c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0cb480 con 0x7f898c0cb010 2024-01-24T13:04:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.123+0000 7f8989400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f898c0c3fd0 0x7f898c0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.123+0000 7f898a800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f898c0cb010 0x7f898c0d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.123+0000 7f8989400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f898c0c3fd0 0x7f898c0caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50578/0 (socket says 172.21.15.29:50578) 2024-01-24T13:04:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.123+0000 7f8989400640 1 -- 172.21.15.29:0/1748394913 learned_addr learned my addr 172.21.15.29:0/1748394913 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.123+0000 7f8989e00640 1 --1- 172.21.15.29:0/1748394913 >> v1:172.21.15.29:6789/0 conn(0x7f898c15a6f0 0x7f898c0ceb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37046/0 (socket says 172.21.15.29:37046) 2024-01-24T13:04:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.123+0000 7f8989400640 1 -- 172.21.15.29:0/1748394913 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f898c0cb010 msgr2=0x7f898c0d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.123+0000 7f8989400640 1 --2- 172.21.15.29:0/1748394913 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f898c0cb010 0x7f898c0d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.123+0000 7f8989400640 1 -- 172.21.15.29:0/1748394913 >> v1:172.21.15.29:6789/0 conn(0x7f898c15a6f0 legacy=0x7f898c0ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.123+0000 7f8989400640 1 -- 172.21.15.29:0/1748394913 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c0cd4c0 con 0x7f898c0c3fd0 2024-01-24T13:04:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.127+0000 7f8989400640 1 --2- 172.21.15.29:0/1748394913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f898c0c3fd0 0x7f898c0caad0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f89740098a0 tx=0x7f897401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b53edccd91bc81 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.127+0000 7f8988a00640 1 -- 172.21.15.29:0/1748394913 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89740aa650 con 0x7f898c0c3fd0 2024-01-24T13:04:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.127+0000 7f8988a00640 1 -- 172.21.15.29:0/1748394913 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89740aa7b0 con 0x7f898c0c3fd0 2024-01-24T13:04:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.127+0000 7f8988a00640 1 -- 172.21.15.29:0/1748394913 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89740aab40 con 0x7f898c0c3fd0 2024-01-24T13:04:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.127+0000 7f8990c00640 1 -- 172.21.15.29:0/1748394913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f898c0c3fd0 msgr2=0x7f898c0caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.127+0000 7f8990c00640 1 --2- 172.21.15.29:0/1748394913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f898c0c3fd0 0x7f898c0caad0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f89740098a0 tx=0x7f897401c4f0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.127+0000 7f8990c00640 1 -- 172.21.15.29:0/1748394913 shutdown_connections 2024-01-24T13:04:51.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.127+0000 7f8990c00640 1 --2- 172.21.15.29:0/1748394913 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f898c0cb010 0x7f898c0d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.127+0000 7f8990c00640 1 --2- 172.21.15.29:0/1748394913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f898c0c3fd0 0x7f898c0caad0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.127+0000 7f8990c00640 1 -- 172.21.15.29:0/1748394913 >> 172.21.15.29:0/1748394913 conn(0x7f898c069cd0 msgr2=0x7f898c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:51.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.127+0000 7f8990c00640 1 -- 172.21.15.29:0/1748394913 shutdown_connections 2024-01-24T13:04:51.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.127+0000 7f8990c00640 1 -- 172.21.15.29:0/1748394913 wait complete. 2024-01-24T13:04:51.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.127+0000 7f8990c00640 1 Processor -- start 2024-01-24T13:04:51.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.127+0000 7f8990c00640 1 -- start start 2024-01-24T13:04:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f8990c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f898c0c3fd0 0x7f898c1f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f8990c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f898c0cb010 0x7f898c0c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f8990c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f898c15a6f0 0x7f898c0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f8990c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c1629b0 con 0x7f898c15a6f0 2024-01-24T13:04:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f8990c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c158c10 con 0x7f898c0c3fd0 2024-01-24T13:04:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f8990c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c158ef0 con 0x7f898c0cb010 2024-01-24T13:04:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f898a800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f898c15a6f0 0x7f898c0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f898a800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f898c15a6f0 0x7f898c0c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50594/0 (socket says 172.21.15.29:50594) 2024-01-24T13:04:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f898a800640 1 -- 172.21.15.29:0/1682543735 learned_addr learned my addr 172.21.15.29:0/1682543735 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f8989e00640 1 --2- 172.21.15.29:0/1682543735 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f898c0c3fd0 0x7f898c1f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f8989400640 1 --2- 172.21.15.29:0/1682543735 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f898c0cb010 0x7f898c0c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f898a800640 1 -- 172.21.15.29:0/1682543735 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f898c0cb010 msgr2=0x7f898c0c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f898a800640 1 --2- 172.21.15.29:0/1682543735 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f898c0cb010 0x7f898c0c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f898a800640 1 -- 172.21.15.29:0/1682543735 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f898c0c3fd0 msgr2=0x7f898c1f7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f898a800640 1 --2- 172.21.15.29:0/1682543735 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f898c0c3fd0 0x7f898c1f7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f898a800640 1 -- 172.21.15.29:0/1682543735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89740094d0 con 0x7f898c15a6f0 2024-01-24T13:04:51.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f898a800640 1 --2- 172.21.15.29:0/1682543735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f898c15a6f0 0x7f898c0c5810 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f898400efc0 tx=0x7f898400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:51.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f8982000640 1 -- 172.21.15.29:0/1682543735 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984014480 con 0x7f898c15a6f0 2024-01-24T13:04:51.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f8982000640 1 -- 172.21.15.29:0/1682543735 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898400f040 con 0x7f898c15a6f0 2024-01-24T13:04:51.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f8982000640 1 -- 172.21.15.29:0/1682543735 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984014820 con 0x7f898c15a6f0 2024-01-24T13:04:51.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f8990c00640 1 -- 172.21.15.29:0/1682543735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898c162c00 con 0x7f898c15a6f0 2024-01-24T13:04:51.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f8990c00640 1 -- 172.21.15.29:0/1682543735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898c1f6390 con 0x7f898c15a6f0 2024-01-24T13:04:51.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.131+0000 7f8990c00640 1 -- 172.21.15.29:0/1682543735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898c04e850 con 0x7f898c15a6f0 2024-01-24T13:04:51.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.135+0000 7f8982000640 1 -- 172.21.15.29:0/1682543735 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8984014980 con 0x7f898c15a6f0 2024-01-24T13:04:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.135+0000 7f8982000640 1 --2- 172.21.15.29:0/1682543735 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8964065a60 0x7f8964067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.135+0000 7f8982000640 1 -- 172.21.15.29:0/1682543735 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f8984083ed0 con 0x7f898c15a6f0 2024-01-24T13:04:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.135+0000 7f8989e00640 1 --2- 172.21.15.29:0/1682543735 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8964065a60 0x7f8964067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.135+0000 7f8989e00640 1 --2- 172.21.15.29:0/1682543735 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8964065a60 0x7f8964067f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f897c000f70 tx=0x7f897c007e50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:51.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.139+0000 7f8982000640 1 -- 172.21.15.29:0/1682543735 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f8984051600 con 0x7f898c15a6f0 2024-01-24T13:04:51.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.295+0000 7f8990c00640 1 -- 172.21.15.29:0/1682543735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f898c1630b0 con 0x7f898c15a6f0 2024-01-24T13:04:51.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.295+0000 7f8982000640 1 -- 172.21.15.29:0/1682543735 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8984018020 con 0x7f898c15a6f0 2024-01-24T13:04:51.298 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:51.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.295+0000 7f8990c00640 1 -- 172.21.15.29:0/1682543735 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8964065a60 msgr2=0x7f8964067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.295+0000 7f8990c00640 1 --2- 172.21.15.29:0/1682543735 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8964065a60 0x7f8964067f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f897c000f70 tx=0x7f897c007e50 comp rx=0 tx=0).stop 2024-01-24T13:04:51.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.295+0000 7f8990c00640 1 -- 172.21.15.29:0/1682543735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f898c15a6f0 msgr2=0x7f898c0c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.295+0000 7f8990c00640 1 --2- 172.21.15.29:0/1682543735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f898c15a6f0 0x7f898c0c5810 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f898400efc0 tx=0x7f898400c490 comp rx=0 tx=0).stop 2024-01-24T13:04:51.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.295+0000 7f8990c00640 1 -- 172.21.15.29:0/1682543735 shutdown_connections 2024-01-24T13:04:51.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.295+0000 7f8990c00640 1 --2- 172.21.15.29:0/1682543735 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8964065a60 0x7f8964067f20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.295+0000 7f8990c00640 1 --2- 172.21.15.29:0/1682543735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f898c15a6f0 0x7f898c0c5810 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.295+0000 7f8990c00640 1 --2- 172.21.15.29:0/1682543735 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f898c0cb010 0x7f898c0c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.295+0000 7f8990c00640 1 --2- 172.21.15.29:0/1682543735 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f898c0c3fd0 0x7f898c1f7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.295+0000 7f8990c00640 1 -- 172.21.15.29:0/1682543735 >> 172.21.15.29:0/1682543735 conn(0x7f898c069cd0 msgr2=0x7f898c0c6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:51.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.299+0000 7f8990c00640 1 -- 172.21.15.29:0/1682543735 shutdown_connections 2024-01-24T13:04:51.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.299+0000 7f8990c00640 1 -- 172.21.15.29:0/1682543735 wait complete. 2024-01-24T13:04:51.321 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:04:51.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.459+0000 7f7118e00640 1 Processor -- start 2024-01-24T13:04:51.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.459+0000 7f7118e00640 1 -- start start 2024-01-24T13:04:51.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7118e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f711406be20 0x7f711415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7118e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f711413d4b0 0x7f711415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7118e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711415b4f0 con 0x7f711406c200 2024-01-24T13:04:51.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7118e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711415b7d0 con 0x7f711406be20 2024-01-24T13:04:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7118e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71140cd0c0 con 0x7f711413d4b0 2024-01-24T13:04:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7111400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f711406c200 0x7f711413cda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37048/0 (socket says 172.21.15.29:37048) 2024-01-24T13:04:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7111400640 1 -- 172.21.15.29:0/574111117 learned_addr learned my addr 172.21.15.29:0/574111117 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7111e00640 1 --2- 172.21.15.29:0/574111117 >> v2:172.21.15.163:3300/0 conn(0x7f711406be20 0x7f711415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7112800640 1 --2- 172.21.15.29:0/574111117 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f711413d4b0 0x7f711415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 -- 172.21.15.29:0/574111117 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334211390 0 0) 0x7f711415b4f0 con 0x7f711406c200 2024-01-24T13:04:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 -- 172.21.15.29:0/574111117 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70f4003530 con 0x7f711406c200 2024-01-24T13:04:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 -- 172.21.15.29:0/574111117 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3895963395 0 0) 0x7f70f4003530 con 0x7f711406c200 2024-01-24T13:04:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 -- 172.21.15.29:0/574111117 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f711413d4b0 msgr2=0x7f711415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 --2- 172.21.15.29:0/574111117 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f711413d4b0 0x7f711415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 -- 172.21.15.29:0/574111117 >> v2:172.21.15.163:3300/0 conn(0x7f711406be20 msgr2=0x7f711415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 --2- 172.21.15.29:0/574111117 >> v2:172.21.15.163:3300/0 conn(0x7f711406be20 0x7f711415a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 -- 172.21.15.29:0/574111117 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71140cd3a0 con 0x7f711406c200 2024-01-24T13:04:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 -- 172.21.15.29:0/574111117 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f70fc001680 con 0x7f711406c200 2024-01-24T13:04:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 -- 172.21.15.29:0/574111117 >> v1:172.21.15.29:6789/0 conn(0x7f711406c200 legacy=0x7f711413cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 --2- 172.21.15.29:0/574111117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70f4003980 0x7f70f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 --2- 172.21.15.29:0/574111117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70f40047d0 0x7f70f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 --2- 172.21.15.29:0/574111117 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f711413d4b0 0x7f70f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 -- 172.21.15.29:0/574111117 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711415b7d0 con 0x7f70f4003980 2024-01-24T13:04:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 -- 172.21.15.29:0/574111117 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71140cd0c0 con 0x7f70f40047d0 2024-01-24T13:04:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7110a00640 1 -- 172.21.15.29:0/574111117 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f400b990 con 0x7f711413d4b0 2024-01-24T13:04:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7111e00640 1 --2- 172.21.15.29:0/574111117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70f4003980 0x7f70f4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7112800640 1 --2- 172.21.15.29:0/574111117 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f711413d4b0 0x7f70f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7111400640 1 --2- 172.21.15.29:0/574111117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70f40047d0 0x7f70f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7111e00640 1 -- 172.21.15.29:0/574111117 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f711413d4b0 msgr2=0x7f70f4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7111e00640 1 --2- 172.21.15.29:0/574111117 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f711413d4b0 0x7f70f4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7111e00640 1 -- 172.21.15.29:0/574111117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70f40047d0 msgr2=0x7f70f4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7111e00640 1 --2- 172.21.15.29:0/574111117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70f40047d0 0x7f70f4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7111e00640 1 -- 172.21.15.29:0/574111117 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f4003530 con 0x7f70f4003980 2024-01-24T13:04:51.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7112800640 1 --2- 172.21.15.29:0/574111117 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f711413d4b0 0x7f70f4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:51.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.463+0000 7f7111400640 1 --2- 172.21.15.29:0/574111117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70f40047d0 0x7f70f4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:51.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.467+0000 7f7111e00640 1 --2- 172.21.15.29:0/574111117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70f4003980 0x7f70f4003da0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7104009ae0 tx=0x7f710401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51f6a7bae95a6f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:51.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.467+0000 7f7110a00640 1 -- 172.21.15.29:0/574111117 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040a64a0 con 0x7f70f4003980 2024-01-24T13:04:51.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.467+0000 7f7110a00640 1 -- 172.21.15.29:0/574111117 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71040a6600 con 0x7f70f4003980 2024-01-24T13:04:51.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.467+0000 7f7110a00640 1 -- 172.21.15.29:0/574111117 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040a69b0 con 0x7f70f4003980 2024-01-24T13:04:51.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.467+0000 7f7118e00640 1 -- 172.21.15.29:0/574111117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70f4003980 msgr2=0x7f70f4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.467+0000 7f7118e00640 1 --2- 172.21.15.29:0/574111117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70f4003980 0x7f70f4003da0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7104009ae0 tx=0x7f710401c9f0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.467+0000 7f7112800640 1 -- 172.21.15.29:0/574111117 reap_dead start 2024-01-24T13:04:51.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.467+0000 7f7118e00640 1 -- 172.21.15.29:0/574111117 shutdown_connections 2024-01-24T13:04:51.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.467+0000 7f7118e00640 1 -- 172.21.15.29:0/574111117 >> 172.21.15.29:0/574111117 conn(0x7f711406d700 msgr2=0x7f7114069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:51.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.467+0000 7f7118e00640 1 -- 172.21.15.29:0/574111117 shutdown_connections 2024-01-24T13:04:51.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.467+0000 7f7118e00640 1 -- 172.21.15.29:0/574111117 wait complete. 2024-01-24T13:04:51.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7118e00640 1 Processor -- start 2024-01-24T13:04:51.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7118e00640 1 -- start start 2024-01-24T13:04:51.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7118e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70f4003980 0x7f7114139c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7118e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7114152150 0x7f711414f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7118e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f711414fdb0 0x7f71140b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7118e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711414df60 con 0x7f711414fdb0 2024-01-24T13:04:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7118e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7114150230 con 0x7f7114152150 2024-01-24T13:04:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7118e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71140b2830 con 0x7f70f4003980 2024-01-24T13:04:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7112800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f711414fdb0 0x7f71140b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7112800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f711414fdb0 0x7f71140b1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50600/0 (socket says 172.21.15.29:50600) 2024-01-24T13:04:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7112800640 1 -- 172.21.15.29:0/6235188 learned_addr learned my addr 172.21.15.29:0/6235188 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7111e00640 1 --2- 172.21.15.29:0/6235188 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70f4003980 0x7f7114139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7111400640 1 --2- 172.21.15.29:0/6235188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7114152150 0x7f711414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7112800640 1 -- 172.21.15.29:0/6235188 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70f4003980 msgr2=0x7f7114139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7112800640 1 --2- 172.21.15.29:0/6235188 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70f4003980 0x7f7114139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7112800640 1 -- 172.21.15.29:0/6235188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7114152150 msgr2=0x7f711414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7112800640 1 --2- 172.21.15.29:0/6235188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7114152150 0x7f711414f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7112800640 1 -- 172.21.15.29:0/6235188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711413a160 con 0x7f711414fdb0 2024-01-24T13:04:51.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7112800640 1 --2- 172.21.15.29:0/6235188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f711414fdb0 0x7f71140b1820 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f711406acb0 tx=0x7f710c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:51.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f710a000640 1 -- 172.21.15.29:0/6235188 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c01b070 con 0x7f711414fdb0 2024-01-24T13:04:51.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f710a000640 1 -- 172.21.15.29:0/6235188 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c00f040 con 0x7f711414fdb0 2024-01-24T13:04:51.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f710a000640 1 -- 172.21.15.29:0/6235188 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c00e050 con 0x7f711414fdb0 2024-01-24T13:04:51.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7118e00640 1 -- 172.21.15.29:0/6235188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71140b2550 con 0x7f711414fdb0 2024-01-24T13:04:51.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.471+0000 7f7118e00640 1 -- 172.21.15.29:0/6235188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711414db80 con 0x7f711414fdb0 2024-01-24T13:04:51.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.475+0000 7f7118e00640 1 -- 172.21.15.29:0/6235188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711414dd40 con 0x7f711414fdb0 2024-01-24T13:04:51.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.475+0000 7f710a000640 1 -- 172.21.15.29:0/6235188 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f710c015440 con 0x7f711414fdb0 2024-01-24T13:04:51.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.475+0000 7f710a000640 1 --2- 172.21.15.29:0/6235188 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f70ec065a90 0x7f70ec067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.475+0000 7f710a000640 1 -- 172.21.15.29:0/6235188 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f710c0836d0 con 0x7f711414fdb0 2024-01-24T13:04:51.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.475+0000 7f7111e00640 1 --2- 172.21.15.29:0/6235188 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f70ec065a90 0x7f70ec067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.475+0000 7f7111e00640 1 --2- 172.21.15.29:0/6235188 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f70ec065a90 0x7f70ec067f50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f71040ad000 tx=0x7f71040b3040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:51.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.479+0000 7f710a000640 1 -- 172.21.15.29:0/6235188 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f710c050d70 con 0x7f711414fdb0 2024-01-24T13:04:51.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.635+0000 7f7118e00640 1 -- 172.21.15.29:0/6235188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f711414d700 con 0x7f711414fdb0 2024-01-24T13:04:51.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.635+0000 7f710a000640 1 -- 172.21.15.29:0/6235188 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f711414d700 con 0x7f711414fdb0 2024-01-24T13:04:51.640 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:04:51.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.639+0000 7f7118e00640 1 -- 172.21.15.29:0/6235188 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f70ec065a90 msgr2=0x7f70ec067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.639+0000 7f7118e00640 1 --2- 172.21.15.29:0/6235188 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f70ec065a90 0x7f70ec067f50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f71040ad000 tx=0x7f71040b3040 comp rx=0 tx=0).stop 2024-01-24T13:04:51.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.639+0000 7f7118e00640 1 -- 172.21.15.29:0/6235188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f711414fdb0 msgr2=0x7f71140b1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.639+0000 7f7118e00640 1 --2- 172.21.15.29:0/6235188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f711414fdb0 0x7f71140b1820 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f711406acb0 tx=0x7f710c009f90 comp rx=0 tx=0).stop 2024-01-24T13:04:51.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.639+0000 7f7118e00640 1 -- 172.21.15.29:0/6235188 shutdown_connections 2024-01-24T13:04:51.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.639+0000 7f7118e00640 1 --2- 172.21.15.29:0/6235188 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f70ec065a90 0x7f70ec067f50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.639+0000 7f7118e00640 1 --2- 172.21.15.29:0/6235188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f711414fdb0 0x7f71140b1820 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.639+0000 7f7118e00640 1 --2- 172.21.15.29:0/6235188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7114152150 0x7f711414f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.639+0000 7f7118e00640 1 --2- 172.21.15.29:0/6235188 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70f4003980 0x7f7114139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.639+0000 7f7118e00640 1 -- 172.21.15.29:0/6235188 >> 172.21.15.29:0/6235188 conn(0x7f711406d700 msgr2=0x7f71140af090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:51.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.639+0000 7f7118e00640 1 -- 172.21.15.29:0/6235188 shutdown_connections 2024-01-24T13:04:51.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.639+0000 7f7118e00640 1 -- 172.21.15.29:0/6235188 wait complete. 2024-01-24T13:04:51.663 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:04:51.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.803+0000 7f19f0000640 1 Processor -- start 2024-01-24T13:04:51.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.803+0000 7f19f0000640 1 -- start start 2024-01-24T13:04:51.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.803+0000 7f19f0000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19e815c690 0x7f19e80cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.803+0000 7f19f0000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19e80abae0 0x7f19e80ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.803+0000 7f19f0000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e8160fc0 con 0x7f19e80b3360 2024-01-24T13:04:51.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.803+0000 7f19f0000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e80b2ef0 con 0x7f19e80abae0 2024-01-24T13:04:51.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.803+0000 7f19f0000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e81603f0 con 0x7f19e815c690 2024-01-24T13:04:51.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.803+0000 7f19ee000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19e80abae0 0x7f19e80ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.803+0000 7f19ee000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19e80abae0 0x7f19e80ce3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50604/0 (socket says 172.21.15.29:50604) 2024-01-24T13:04:51.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.803+0000 7f19ee000640 1 -- 172.21.15.29:0/3217253648 learned_addr learned my addr 172.21.15.29:0/3217253648 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:51.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.803+0000 7f19ecc00640 1 --1- 172.21.15.29:0/3217253648 >> v1:172.21.15.29:6789/0 conn(0x7f19e80b3360 0x7f19e806bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37060/0 (socket says 172.21.15.29:37060) 2024-01-24T13:04:51.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.807+0000 7f19ed600640 1 --2- 172.21.15.29:0/3217253648 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19e815c690 0x7f19e80cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.807+0000 7f19ee000640 1 -- 172.21.15.29:0/3217253648 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19e815c690 msgr2=0x7f19e80cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:51.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.807+0000 7f19ee000640 1 --2- 172.21.15.29:0/3217253648 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19e815c690 0x7f19e80cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.807+0000 7f19ee000640 1 -- 172.21.15.29:0/3217253648 >> v1:172.21.15.29:6789/0 conn(0x7f19e80b3360 legacy=0x7f19e806bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.807+0000 7f19e7e00640 1 -- 172.21.15.29:0/3217253648 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158111995 0 0) 0x7f19e8160fc0 con 0x7f19e80b3360 2024-01-24T13:04:51.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.807+0000 7f19ee000640 1 -- 172.21.15.29:0/3217253648 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8160690 con 0x7f19e80abae0 2024-01-24T13:04:51.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.807+0000 7f19ee000640 1 --2- 172.21.15.29:0/3217253648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e80abae0 0x7f19e80ce3e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009e50 tx=0x7f19e001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2704a3cea8fca4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:51.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.807+0000 7f19e7e00640 1 -- 172.21.15.29:0/3217253648 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00a5760 con 0x7f19e80abae0 2024-01-24T13:04:51.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.807+0000 7f19e7e00640 1 -- 172.21.15.29:0/3217253648 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e00a58c0 con 0x7f19e80abae0 2024-01-24T13:04:51.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.807+0000 7f19e7e00640 1 -- 172.21.15.29:0/3217253648 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00a5c50 con 0x7f19e80abae0 2024-01-24T13:04:51.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 -- 172.21.15.29:0/3217253648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e80abae0 msgr2=0x7f19e80ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 --2- 172.21.15.29:0/3217253648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e80abae0 0x7f19e80ce3e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009e50 tx=0x7f19e001c980 comp rx=0 tx=0).stop 2024-01-24T13:04:51.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 -- 172.21.15.29:0/3217253648 shutdown_connections 2024-01-24T13:04:51.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 --2- 172.21.15.29:0/3217253648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e80abae0 0x7f19e80ce3e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 --2- 172.21.15.29:0/3217253648 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19e815c690 0x7f19e80cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 -- 172.21.15.29:0/3217253648 >> 172.21.15.29:0/3217253648 conn(0x7f19e806d700 msgr2=0x7f19e8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:51.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 -- 172.21.15.29:0/3217253648 shutdown_connections 2024-01-24T13:04:51.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 -- 172.21.15.29:0/3217253648 wait complete. 2024-01-24T13:04:51.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 Processor -- start 2024-01-24T13:04:51.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 -- start start 2024-01-24T13:04:51.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e80abae0 0x7f19e813fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19e80b3360 0x7f19e8144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19e815c690 0x7f19e8144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8141fc0 con 0x7f19e80abae0 2024-01-24T13:04:51.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e815cbf0 con 0x7f19e815c690 2024-01-24T13:04:51.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19f0000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8141660 con 0x7f19e80b3360 2024-01-24T13:04:51.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19ed600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e80abae0 0x7f19e813fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19ed600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e80abae0 0x7f19e813fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50612/0 (socket says 172.21.15.29:50612) 2024-01-24T13:04:51.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.811+0000 7f19ed600640 1 -- 172.21.15.29:0/1603212694 learned_addr learned my addr 172.21.15.29:0/1603212694 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:51.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19ee000640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19e815c690 0x7f19e8144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19ecc00640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19e80b3360 0x7f19e8144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19ed600640 1 -- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19e80b3360 msgr2=0x7f19e8144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19ed600640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19e80b3360 0x7f19e8144a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19ed600640 1 -- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19e815c690 msgr2=0x7f19e8144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19ed600640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19e815c690 0x7f19e8144f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19ed600640 1 -- 172.21.15.29:0/1603212694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e0009b30 con 0x7f19e80abae0 2024-01-24T13:04:51.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19ecc00640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19e80b3360 0x7f19e8144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:51.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19ed600640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e80abae0 0x7f19e813fc80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f19d800d800 tx=0x7f19d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:51.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19e5600640 1 -- 172.21.15.29:0/1603212694 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d800b6c0 con 0x7f19e80abae0 2024-01-24T13:04:51.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19e5600640 1 -- 172.21.15.29:0/1603212694 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d800b820 con 0x7f19e80abae0 2024-01-24T13:04:51.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19e5600640 1 -- 172.21.15.29:0/1603212694 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d800bb90 con 0x7f19e80abae0 2024-01-24T13:04:51.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19f0000640 1 -- 172.21.15.29:0/1603212694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e8141900 con 0x7f19e80abae0 2024-01-24T13:04:51.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19f0000640 1 -- 172.21.15.29:0/1603212694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e8151120 con 0x7f19e80abae0 2024-01-24T13:04:51.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19f0000640 1 -- 172.21.15.29:0/1603212694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e804e850 con 0x7f19e80abae0 2024-01-24T13:04:51.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19e5600640 1 -- 172.21.15.29:0/1603212694 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f19d800bcf0 con 0x7f19e80abae0 2024-01-24T13:04:51.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19e5600640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f19c0065a90 0x7f19c0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:51.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.815+0000 7f19e5600640 1 -- 172.21.15.29:0/1603212694 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f19d8083950 con 0x7f19e80abae0 2024-01-24T13:04:51.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.819+0000 7f19ecc00640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f19c0065a90 0x7f19c0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:51.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.819+0000 7f19ecc00640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f19c0065a90 0x7f19c0067f50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f19e8144260 tx=0x7f19d0007cb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:51.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.819+0000 7f19e5600640 1 -- 172.21.15.29:0/1603212694 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f19d8050fd0 con 0x7f19e80abae0 2024-01-24T13:04:51.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.975+0000 7f19f0000640 1 -- 172.21.15.29:0/1603212694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f19e80ae620 con 0x7f19e80abae0 2024-01-24T13:04:51.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.975+0000 7f19e5600640 1 -- 172.21.15.29:0/1603212694 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f19d80545f0 con 0x7f19e80abae0 2024-01-24T13:04:51.981 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:51.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.979+0000 7f19f0000640 1 -- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f19c0065a90 msgr2=0x7f19c0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.979+0000 7f19f0000640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f19c0065a90 0x7f19c0067f50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f19e8144260 tx=0x7f19d0007cb0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.979+0000 7f19f0000640 1 -- 172.21.15.29:0/1603212694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e80abae0 msgr2=0x7f19e813fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:51.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.979+0000 7f19f0000640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e80abae0 0x7f19e813fc80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f19d800d800 tx=0x7f19d800dcc0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.979+0000 7f19f0000640 1 -- 172.21.15.29:0/1603212694 shutdown_connections 2024-01-24T13:04:51.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.979+0000 7f19f0000640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f19c0065a90 0x7f19c0067f50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.979+0000 7f19f0000640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19e815c690 0x7f19e8144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.979+0000 7f19f0000640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19e80b3360 0x7f19e8144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.979+0000 7f19f0000640 1 --2- 172.21.15.29:0/1603212694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e80abae0 0x7f19e813fc80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:51.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.979+0000 7f19f0000640 1 -- 172.21.15.29:0/1603212694 >> 172.21.15.29:0/1603212694 conn(0x7f19e806d700 msgr2=0x7f19e80aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:51.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.979+0000 7f19f0000640 1 -- 172.21.15.29:0/1603212694 shutdown_connections 2024-01-24T13:04:51.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:51.979+0000 7f19f0000640 1 -- 172.21.15.29:0/1603212694 wait complete. 2024-01-24T13:04:52.003 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:04:52.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.143+0000 7f118d400640 1 Processor -- start 2024-01-24T13:04:52.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.143+0000 7f118d400640 1 -- start start 2024-01-24T13:04:52.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.143+0000 7f118d400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f118815c6d0 0x7f118806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.143+0000 7f118d400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f118815cab0 0x7f11880ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.143+0000 7f118d400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11880ce5c0 con 0x7f11880d0ca0 2024-01-24T13:04:52.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.143+0000 7f118d400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11880ce7f0 con 0x7f118815c6d0 2024-01-24T13:04:52.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.143+0000 7f118d400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11880cead0 con 0x7f118815cab0 2024-01-24T13:04:52.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.143+0000 7f1186800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f118815c6d0 0x7f118806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.143+0000 7f1186800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f118815c6d0 0x7f118806bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50622/0 (socket says 172.21.15.29:50622) 2024-01-24T13:04:52.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.143+0000 7f1186800640 1 -- 172.21.15.29:0/1703338649 learned_addr learned my addr 172.21.15.29:0/1703338649 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:52.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.147+0000 7f1185e00640 1 --2- 172.21.15.29:0/1703338649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f118815cab0 0x7f11880ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.147+0000 7f1186800640 1 -- 172.21.15.29:0/1703338649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f118815cab0 msgr2=0x7f11880ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:52.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.147+0000 7f1186800640 1 --2- 172.21.15.29:0/1703338649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f118815cab0 0x7f11880ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.147+0000 7f1186800640 1 -- 172.21.15.29:0/1703338649 >> v1:172.21.15.163:6789/0 conn(0x7f11880d0ca0 legacy=0x7f11880ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.147+0000 7f1186800640 1 -- 172.21.15.29:0/1703338649 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11880d04a0 con 0x7f118815c6d0 2024-01-24T13:04:52.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.147+0000 7f1185e00640 1 --2- 172.21.15.29:0/1703338649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f118815cab0 0x7f11880ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:52.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.147+0000 7f1186800640 1 --2- 172.21.15.29:0/1703338649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118815c6d0 0x7f118806bcc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f11780098a0 tx=0x7f117801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e55dce714f1a90 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:52.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.147+0000 7f1185400640 1 -- 172.21.15.29:0/1703338649 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11780a9400 con 0x7f118815c6d0 2024-01-24T13:04:52.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.147+0000 7f1185400640 1 -- 172.21.15.29:0/1703338649 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11780a9560 con 0x7f118815c6d0 2024-01-24T13:04:52.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.147+0000 7f1185400640 1 -- 172.21.15.29:0/1703338649 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11780a98f0 con 0x7f118815c6d0 2024-01-24T13:04:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 -- 172.21.15.29:0/1703338649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118815c6d0 msgr2=0x7f118806bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 --2- 172.21.15.29:0/1703338649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118815c6d0 0x7f118806bcc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f11780098a0 tx=0x7f117801c520 comp rx=0 tx=0).stop 2024-01-24T13:04:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 -- 172.21.15.29:0/1703338649 shutdown_connections 2024-01-24T13:04:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 --2- 172.21.15.29:0/1703338649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f118815cab0 0x7f11880ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 --2- 172.21.15.29:0/1703338649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118815c6d0 0x7f118806bcc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 -- 172.21.15.29:0/1703338649 >> 172.21.15.29:0/1703338649 conn(0x7f1188069cd0 msgr2=0x7f118806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 -- 172.21.15.29:0/1703338649 shutdown_connections 2024-01-24T13:04:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 -- 172.21.15.29:0/1703338649 wait complete. 2024-01-24T13:04:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 Processor -- start 2024-01-24T13:04:52.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 -- start start 2024-01-24T13:04:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11880d0ca0 0x7f1188158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118815c6d0 0x7f1188156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f118815f310 0x7f1188155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118815f7a0 con 0x7f118815c6d0 2024-01-24T13:04:52.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118815fa80 con 0x7f118815f310 2024-01-24T13:04:52.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f118d400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118815fd60 con 0x7f11880d0ca0 2024-01-24T13:04:52.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f1185e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118815c6d0 0x7f1188156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f1185e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118815c6d0 0x7f1188156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50628/0 (socket says 172.21.15.29:50628) 2024-01-24T13:04:52.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f1185e00640 1 -- 172.21.15.29:0/3739349698 learned_addr learned my addr 172.21.15.29:0/3739349698 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:52.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f1186800640 1 --2- 172.21.15.29:0/3739349698 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11880d0ca0 0x7f1188158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.151+0000 7f1187200640 1 --2- 172.21.15.29:0/3739349698 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f118815f310 0x7f1188155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f1185e00640 1 -- 172.21.15.29:0/3739349698 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11880d0ca0 msgr2=0x7f1188158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f1185e00640 1 --2- 172.21.15.29:0/3739349698 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11880d0ca0 0x7f1188158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f1185e00640 1 -- 172.21.15.29:0/3739349698 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f118815f310 msgr2=0x7f1188155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f1185e00640 1 --2- 172.21.15.29:0/3739349698 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f118815f310 0x7f1188155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f1185e00640 1 -- 172.21.15.29:0/3739349698 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11780094d0 con 0x7f118815c6d0 2024-01-24T13:04:52.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f1185e00640 1 --2- 172.21.15.29:0/3739349698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118815c6d0 0x7f1188156910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f117000d800 tx=0x7f117000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:52.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f117ea00640 1 -- 172.21.15.29:0/3739349698 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11700096c0 con 0x7f118815c6d0 2024-01-24T13:04:52.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f117ea00640 1 -- 172.21.15.29:0/3739349698 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1170009820 con 0x7f118815c6d0 2024-01-24T13:04:52.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f118d400640 1 -- 172.21.15.29:0/3739349698 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118815cea0 con 0x7f118815c6d0 2024-01-24T13:04:52.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f117ea00640 1 -- 172.21.15.29:0/3739349698 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170009bd0 con 0x7f118815c6d0 2024-01-24T13:04:52.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f118d400640 1 -- 172.21.15.29:0/3739349698 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1188155b80 con 0x7f118815c6d0 2024-01-24T13:04:52.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f118d400640 1 -- 172.21.15.29:0/3739349698 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118804e850 con 0x7f118815c6d0 2024-01-24T13:04:52.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f117ea00640 1 -- 172.21.15.29:0/3739349698 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1170009d30 con 0x7f118815c6d0 2024-01-24T13:04:52.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f117ea00640 1 --2- 172.21.15.29:0/3739349698 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1160065a60 0x7f1160067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.155+0000 7f117ea00640 1 -- 172.21.15.29:0/3739349698 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f1170083b50 con 0x7f118815c6d0 2024-01-24T13:04:52.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.159+0000 7f1186800640 1 --2- 172.21.15.29:0/3739349698 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1160065a60 0x7f1160067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.159+0000 7f1186800640 1 --2- 172.21.15.29:0/3739349698 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1160065a60 0x7f1160067f20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11780ae000 tx=0x7f11780b3040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:52.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.163+0000 7f117ea00640 1 -- 172.21.15.29:0/3739349698 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f11700511f0 con 0x7f118815c6d0 2024-01-24T13:04:52.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.331+0000 7f118d400640 1 -- 172.21.15.29:0/3739349698 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f11880b2ab0 con 0x7f118815c6d0 2024-01-24T13:04:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.331+0000 7f117ea00640 1 -- 172.21.15.29:0/3739349698 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1170054810 con 0x7f118815c6d0 2024-01-24T13:04:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:04:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.331+0000 7f118d400640 1 -- 172.21.15.29:0/3739349698 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1160065a60 msgr2=0x7f1160067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.331+0000 7f118d400640 1 --2- 172.21.15.29:0/3739349698 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1160065a60 0x7f1160067f20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11780ae000 tx=0x7f11780b3040 comp rx=0 tx=0).stop 2024-01-24T13:04:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.331+0000 7f118d400640 1 -- 172.21.15.29:0/3739349698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118815c6d0 msgr2=0x7f1188156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.331+0000 7f118d400640 1 --2- 172.21.15.29:0/3739349698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118815c6d0 0x7f1188156910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f117000d800 tx=0x7f117000dcc0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.331+0000 7f118d400640 1 -- 172.21.15.29:0/3739349698 shutdown_connections 2024-01-24T13:04:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.331+0000 7f118d400640 1 --2- 172.21.15.29:0/3739349698 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1160065a60 0x7f1160067f20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.331+0000 7f118d400640 1 --2- 172.21.15.29:0/3739349698 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f118815f310 0x7f1188155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.331+0000 7f118d400640 1 --2- 172.21.15.29:0/3739349698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118815c6d0 0x7f1188156910 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.331+0000 7f118d400640 1 --2- 172.21.15.29:0/3739349698 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11880d0ca0 0x7f1188158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.331+0000 7f118d400640 1 -- 172.21.15.29:0/3739349698 >> 172.21.15.29:0/3739349698 conn(0x7f1188069cd0 msgr2=0x7f11880aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:52.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.331+0000 7f118d400640 1 -- 172.21.15.29:0/3739349698 shutdown_connections 2024-01-24T13:04:52.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.331+0000 7f118d400640 1 -- 172.21.15.29:0/3739349698 wait complete. 2024-01-24T13:04:52.356 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:04:52.356 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:04:52.366 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:52.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.543+0000 7fb6efc00640 1 Processor -- start 2024-01-24T13:04:52.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.543+0000 7fb6efc00640 1 -- start start 2024-01-24T13:04:52.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.547+0000 7fb6efc00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb6e80ce950 0x7fb6e80ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.547+0000 7fb6efc00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e80d0b80 con 0x7fb6e80cd2f0 2024-01-24T13:04:52.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.547+0000 7fb6efc00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e806bdf0 con 0x7fb6e815d7a0 2024-01-24T13:04:52.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.547+0000 7fb6efc00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e80cd7a0 con 0x7fb6e80ce950 2024-01-24T13:04:52.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.547+0000 7fb6ed200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb6e80ce950 0x7fb6e80ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.547+0000 7fb6e7e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb6e80cd2f0 0x7fb6e815d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37068/0 (socket says 172.21.15.29:37068) 2024-01-24T13:04:52.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.547+0000 7fb6e7e00640 1 -- 172.21.15.29:0/871171247 learned_addr learned my addr 172.21.15.29:0/871171247 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:52.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.547+0000 7fb6ed200640 1 -- 172.21.15.29:0/871171247 >> v1:172.21.15.163:6789/0 conn(0x7fb6e815d7a0 legacy=0x7fb6e8152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:52.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.547+0000 7fb6ed200640 1 -- 172.21.15.29:0/871171247 >> v1:172.21.15.29:6789/0 conn(0x7fb6e80cd2f0 legacy=0x7fb6e815d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.547+0000 7fb6ed200640 1 -- 172.21.15.29:0/871171247 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e815ddc0 con 0x7fb6e80ce950 2024-01-24T13:04:52.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.551+0000 7fb6ed200640 1 --2- 172.21.15.29:0/871171247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e80ce950 0x7fb6e80ccdb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80097c0 tx=0x7fb6d801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6b78cb4be3263b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:52.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.551+0000 7fb6e7400640 1 -- 172.21.15.29:0/871171247 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80ab600 con 0x7fb6e80ce950 2024-01-24T13:04:52.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.551+0000 7fb6e7400640 1 -- 172.21.15.29:0/871171247 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d80a7050 con 0x7fb6e80ce950 2024-01-24T13:04:52.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.551+0000 7fb6e7400640 1 -- 172.21.15.29:0/871171247 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80ab980 con 0x7fb6e80ce950 2024-01-24T13:04:52.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.551+0000 7fb6efc00640 1 -- 172.21.15.29:0/871171247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e80ce950 msgr2=0x7fb6e80ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.551+0000 7fb6efc00640 1 --2- 172.21.15.29:0/871171247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e80ce950 0x7fb6e80ccdb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80097c0 tx=0x7fb6d801c320 comp rx=0 tx=0).stop 2024-01-24T13:04:52.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.551+0000 7fb6efc00640 1 -- 172.21.15.29:0/871171247 shutdown_connections 2024-01-24T13:04:52.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.551+0000 7fb6efc00640 1 --2- 172.21.15.29:0/871171247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e80ce950 0x7fb6e80ccdb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.551+0000 7fb6efc00640 1 -- 172.21.15.29:0/871171247 >> 172.21.15.29:0/871171247 conn(0x7fb6e8070570 msgr2=0x7fb6e8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:52.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.551+0000 7fb6efc00640 1 -- 172.21.15.29:0/871171247 shutdown_connections 2024-01-24T13:04:52.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.551+0000 7fb6efc00640 1 -- 172.21.15.29:0/871171247 wait complete. 2024-01-24T13:04:52.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.551+0000 7fb6efc00640 1 Processor -- start 2024-01-24T13:04:52.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.551+0000 7fb6efc00640 1 -- start start 2024-01-24T13:04:52.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6efc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e80cd2f0 0x7fb6e81f8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6efc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6e80ce950 0x7fb6e8154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6efc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6e815d7a0 0x7fb6e8155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6efc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e814cc60 con 0x7fb6e80cd2f0 2024-01-24T13:04:52.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6efc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e814b3b0 con 0x7fb6e80ce950 2024-01-24T13:04:52.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6efc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e81f9590 con 0x7fb6e815d7a0 2024-01-24T13:04:52.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6ed200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e80cd2f0 0x7fb6e81f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6ed200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e80cd2f0 0x7fb6e81f8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50658/0 (socket says 172.21.15.29:50658) 2024-01-24T13:04:52.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6ed200640 1 -- 172.21.15.29:0/950055457 learned_addr learned my addr 172.21.15.29:0/950055457 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:52.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6e7e00640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6e80ce950 0x7fb6e8154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6edc00640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6e815d7a0 0x7fb6e8155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6ed200640 1 -- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6e815d7a0 msgr2=0x7fb6e8155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6ed200640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6e815d7a0 0x7fb6e8155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6ed200640 1 -- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6e80ce950 msgr2=0x7fb6e8154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6ed200640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6e80ce950 0x7fb6e8154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6ed200640 1 -- 172.21.15.29:0/950055457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d8009420 con 0x7fb6e80cd2f0 2024-01-24T13:04:52.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6edc00640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6e815d7a0 0x7fb6e8155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:52.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6ed200640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e80cd2f0 0x7fb6e81f8710 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80ae040 tx=0x7fb6d80190c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:52.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6e4c00640 1 -- 172.21.15.29:0/950055457 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80b7650 con 0x7fb6e80cd2f0 2024-01-24T13:04:52.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6e4c00640 1 -- 172.21.15.29:0/950055457 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d80b77d0 con 0x7fb6e80cd2f0 2024-01-24T13:04:52.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6e4c00640 1 -- 172.21.15.29:0/950055457 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80b7b80 con 0x7fb6e80cd2f0 2024-01-24T13:04:52.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6efc00640 1 -- 172.21.15.29:0/950055457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e80d1190 con 0x7fb6e80cd2f0 2024-01-24T13:04:52.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6efc00640 1 -- 172.21.15.29:0/950055457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e81f8fd0 con 0x7fb6e80cd2f0 2024-01-24T13:04:52.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.555+0000 7fb6efc00640 1 -- 172.21.15.29:0/950055457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e81612f0 con 0x7fb6e80cd2f0 2024-01-24T13:04:52.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.559+0000 7fb6e4c00640 1 -- 172.21.15.29:0/950055457 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb6d80b7ce0 con 0x7fb6e80cd2f0 2024-01-24T13:04:52.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.559+0000 7fb6e4c00640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb6c0065a90 0x7fb6c0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.559+0000 7fb6e4c00640 1 -- 172.21.15.29:0/950055457 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fb6d811dd00 con 0x7fb6e80cd2f0 2024-01-24T13:04:52.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.559+0000 7fb6e7e00640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb6c0065a90 0x7fb6c0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.559+0000 7fb6e7e00640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb6c0065a90 0x7fb6c0067f50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb6e814fae0 tx=0x7fb6d0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:52.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.563+0000 7fb6e4c00640 1 -- 172.21.15.29:0/950055457 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb6d80eb380 con 0x7fb6e80cd2f0 2024-01-24T13:04:52.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.723+0000 7fb6efc00640 1 -- 172.21.15.29:0/950055457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6e804e850 con 0x7fb6e80cd2f0 2024-01-24T13:04:52.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.723+0000 7fb6e4c00640 1 -- 172.21.15.29:0/950055457 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7fb6d80ee9a0 con 0x7fb6e80cd2f0 2024-01-24T13:04:52.727 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:52.727 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:52.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.727+0000 7fb6efc00640 1 -- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb6c0065a90 msgr2=0x7fb6c0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.727+0000 7fb6efc00640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb6c0065a90 0x7fb6c0067f50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb6e814fae0 tx=0x7fb6d0009040 comp rx=0 tx=0).stop 2024-01-24T13:04:52.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.727+0000 7fb6efc00640 1 -- 172.21.15.29:0/950055457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e80cd2f0 msgr2=0x7fb6e81f8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.727+0000 7fb6efc00640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e80cd2f0 0x7fb6e81f8710 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80ae040 tx=0x7fb6d80190c0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.727+0000 7fb6efc00640 1 -- 172.21.15.29:0/950055457 shutdown_connections 2024-01-24T13:04:52.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.727+0000 7fb6efc00640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb6c0065a90 0x7fb6c0067f50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.727+0000 7fb6efc00640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb6e815d7a0 0x7fb6e8155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.727+0000 7fb6efc00640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6e80ce950 0x7fb6e8154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.727+0000 7fb6efc00640 1 --2- 172.21.15.29:0/950055457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e80cd2f0 0x7fb6e81f8710 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.727+0000 7fb6efc00640 1 -- 172.21.15.29:0/950055457 >> 172.21.15.29:0/950055457 conn(0x7fb6e8070570 msgr2=0x7fb6e806e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:52.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.727+0000 7fb6efc00640 1 -- 172.21.15.29:0/950055457 shutdown_connections 2024-01-24T13:04:52.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.727+0000 7fb6efc00640 1 -- 172.21.15.29:0/950055457 wait complete. 2024-01-24T13:04:52.750 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:04:52.750 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:04:52.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.891+0000 7fcfa4e00640 1 Processor -- start 2024-01-24T13:04:52.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.891+0000 7fcfa4e00640 1 -- start start 2024-01-24T13:04:52.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.891+0000 7fcfa4e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfa006c860 0x7fcfa006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.891+0000 7fcfa4e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcfa00cd520 0x7fcfa015d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.891+0000 7fcfa4e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa006b320 con 0x7fcfa0142980 2024-01-24T13:04:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.891+0000 7fcfa4e00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa01611b0 con 0x7fcfa00cd520 2024-01-24T13:04:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.891+0000 7fcfa4e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa0160630 con 0x7fcfa006c860 2024-01-24T13:04:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.895+0000 7fcf9e800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcfa00cd520 0x7fcfa015d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.895+0000 7fcf9e800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcfa00cd520 0x7fcfa015d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50666/0 (socket says 172.21.15.29:50666) 2024-01-24T13:04:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.895+0000 7fcf9e800640 1 -- 172.21.15.29:0/1307238300 learned_addr learned my addr 172.21.15.29:0/1307238300 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:52.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.895+0000 7fcf9e800640 1 -- 172.21.15.29:0/1307238300 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfa006c860 msgr2=0x7fcfa006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:52.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.895+0000 7fcf9e800640 1 --2- 172.21.15.29:0/1307238300 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfa006c860 0x7fcfa006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.895+0000 7fcf9e800640 1 -- 172.21.15.29:0/1307238300 >> v1:172.21.15.163:6789/0 conn(0x7fcfa0142980 legacy=0x7fcfa00cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:52.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.895+0000 7fcf9e800640 1 -- 172.21.15.29:0/1307238300 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0160910 con 0x7fcfa00cd520 2024-01-24T13:04:52.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.895+0000 7fcf9e800640 1 --2- 172.21.15.29:0/1307238300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa00cd520 0x7fcfa015d080 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009e50 tx=0x7fcf9801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d8305b853d270f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:52.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.895+0000 7fcf9ca00640 1 -- 172.21.15.29:0/1307238300 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf980a5820 con 0x7fcfa00cd520 2024-01-24T13:04:52.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.895+0000 7fcf9ca00640 1 -- 172.21.15.29:0/1307238300 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf980a5980 con 0x7fcfa00cd520 2024-01-24T13:04:52.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.895+0000 7fcf9ca00640 1 -- 172.21.15.29:0/1307238300 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf980a5d10 con 0x7fcfa00cd520 2024-01-24T13:04:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 -- 172.21.15.29:0/1307238300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa00cd520 msgr2=0x7fcfa015d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 --2- 172.21.15.29:0/1307238300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa00cd520 0x7fcfa015d080 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009e50 tx=0x7fcf9801c9a0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 -- 172.21.15.29:0/1307238300 shutdown_connections 2024-01-24T13:04:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 --2- 172.21.15.29:0/1307238300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa00cd520 0x7fcfa015d080 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 --2- 172.21.15.29:0/1307238300 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfa006c860 0x7fcfa006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 -- 172.21.15.29:0/1307238300 >> 172.21.15.29:0/1307238300 conn(0x7fcfa0069cd0 msgr2=0x7fcfa006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 -- 172.21.15.29:0/1307238300 shutdown_connections 2024-01-24T13:04:52.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 -- 172.21.15.29:0/1307238300 wait complete. 2024-01-24T13:04:52.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 Processor -- start 2024-01-24T13:04:52.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 -- start start 2024-01-24T13:04:52.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa006c860 0x7fcfa01549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfa00cd520 0x7fcfa015bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcfa0142980 0x7fcfa01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa0154ef0 con 0x7fcfa006c860 2024-01-24T13:04:52.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa0155120 con 0x7fcfa0142980 2024-01-24T13:04:52.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcfa4e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa0155400 con 0x7fcfa00cd520 2024-01-24T13:04:52.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcf9de00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa006c860 0x7fcfa01549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcf9de00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa006c860 0x7fcfa01549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50668/0 (socket says 172.21.15.29:50668) 2024-01-24T13:04:52.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcf9de00640 1 -- 172.21.15.29:0/646680954 learned_addr learned my addr 172.21.15.29:0/646680954 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:52.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcf9e800640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcfa0142980 0x7fcfa01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.899+0000 7fcf9d400640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfa00cd520 0x7fcfa015bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.903+0000 7fcf9de00640 1 -- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfa00cd520 msgr2=0x7fcfa015bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.903+0000 7fcf9de00640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfa00cd520 0x7fcfa015bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.903+0000 7fcf9de00640 1 -- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcfa0142980 msgr2=0x7fcfa01569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:52.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.903+0000 7fcf9de00640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcfa0142980 0x7fcfa01569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:52.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.903+0000 7fcf9de00640 1 -- 172.21.15.29:0/646680954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf98009b30 con 0x7fcfa006c860 2024-01-24T13:04:52.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.903+0000 7fcf9d400640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfa00cd520 0x7fcfa015bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:52.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.903+0000 7fcf9de00640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa006c860 0x7fcfa01549b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000b550 tx=0x7fcf9000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:52.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.903+0000 7fcf96000640 1 -- 172.21.15.29:0/646680954 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90010870 con 0x7fcfa006c860 2024-01-24T13:04:52.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.903+0000 7fcf96000640 1 -- 172.21.15.29:0/646680954 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf900109f0 con 0x7fcfa006c860 2024-01-24T13:04:52.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.903+0000 7fcf96000640 1 -- 172.21.15.29:0/646680954 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90010da0 con 0x7fcfa006c860 2024-01-24T13:04:52.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.903+0000 7fcfa4e00640 1 -- 172.21.15.29:0/646680954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa01556e0 con 0x7fcfa006c860 2024-01-24T13:04:52.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.903+0000 7fcfa4e00640 1 -- 172.21.15.29:0/646680954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa015c2f0 con 0x7fcfa006c860 2024-01-24T13:04:52.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.903+0000 7fcfa4e00640 1 -- 172.21.15.29:0/646680954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa004e850 con 0x7fcfa006c860 2024-01-24T13:04:52.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.903+0000 7fcf96000640 1 -- 172.21.15.29:0/646680954 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcf9000f3c0 con 0x7fcfa006c860 2024-01-24T13:04:52.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.907+0000 7fcf96000640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcf78065a60 0x7fcf78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:52.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.907+0000 7fcf96000640 1 -- 172.21.15.29:0/646680954 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fcf90083400 con 0x7fcfa006c860 2024-01-24T13:04:52.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.907+0000 7fcf9d400640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcf78065a60 0x7fcf78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:52.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.907+0000 7fcf9d400640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcf78065a60 0x7fcf78067f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcfa006a2d0 tx=0x7fcf88008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:52.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:52.907+0000 7fcf96000640 1 -- 172.21.15.29:0/646680954 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fcf90050b30 con 0x7fcfa006c860 2024-01-24T13:04:53.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.063+0000 7fcfa4e00640 1 -- 172.21.15.29:0/646680954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfa00cab40 con 0x7fcfa006c860 2024-01-24T13:04:53.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.063+0000 7fcf96000640 1 -- 172.21.15.29:0/646680954 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf90054150 con 0x7fcfa006c860 2024-01-24T13:04:53.069 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:04:53.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.067+0000 7fcfa4e00640 1 -- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcf78065a60 msgr2=0x7fcf78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.067+0000 7fcfa4e00640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcf78065a60 0x7fcf78067f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcfa006a2d0 tx=0x7fcf88008040 comp rx=0 tx=0).stop 2024-01-24T13:04:53.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.067+0000 7fcfa4e00640 1 -- 172.21.15.29:0/646680954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa006c860 msgr2=0x7fcfa01549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.067+0000 7fcfa4e00640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa006c860 0x7fcfa01549b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000b550 tx=0x7fcf9000ba10 comp rx=0 tx=0).stop 2024-01-24T13:04:53.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.067+0000 7fcfa4e00640 1 -- 172.21.15.29:0/646680954 shutdown_connections 2024-01-24T13:04:53.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.067+0000 7fcfa4e00640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcf78065a60 0x7fcf78067f20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.067+0000 7fcfa4e00640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcfa0142980 0x7fcfa01569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.067+0000 7fcfa4e00640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfa00cd520 0x7fcfa015bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.067+0000 7fcfa4e00640 1 --2- 172.21.15.29:0/646680954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfa006c860 0x7fcfa01549b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.067+0000 7fcfa4e00640 1 -- 172.21.15.29:0/646680954 >> 172.21.15.29:0/646680954 conn(0x7fcfa0069cd0 msgr2=0x7fcfa015de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:53.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.067+0000 7fcfa4e00640 1 -- 172.21.15.29:0/646680954 shutdown_connections 2024-01-24T13:04:53.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.067+0000 7fcfa4e00640 1 -- 172.21.15.29:0/646680954 wait complete. 2024-01-24T13:04:53.090 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:04:53.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.231+0000 7fc306600640 1 Processor -- start 2024-01-24T13:04:53.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.231+0000 7fc306600640 1 -- start start 2024-01-24T13:04:53.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.231+0000 7fc306600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc300142980 0x7fc3000cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.231+0000 7fc306600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc3000cd350 0x7fc30015d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.231+0000 7fc306600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3001611b0 con 0x7fc30006c860 2024-01-24T13:04:53.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.231+0000 7fc306600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3000cd7b0 con 0x7fc300142980 2024-01-24T13:04:53.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.231+0000 7fc306600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc300160630 con 0x7fc3000cd350 2024-01-24T13:04:53.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.235+0000 7fc2fea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc300142980 0x7fc3000cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.235+0000 7fc2fea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc300142980 0x7fc3000cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50682/0 (socket says 172.21.15.29:50682) 2024-01-24T13:04:53.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.235+0000 7fc2ff400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc30006c860 0x7fc30006ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37074/0 (socket says 172.21.15.29:37074) 2024-01-24T13:04:53.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.235+0000 7fc2fea00640 1 -- 172.21.15.29:0/1013806115 learned_addr learned my addr 172.21.15.29:0/1013806115 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:53.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.235+0000 7fc2ffe00640 1 --2- 172.21.15.29:0/1013806115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc3000cd350 0x7fc30015d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.235+0000 7fc2fea00640 1 -- 172.21.15.29:0/1013806115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc3000cd350 msgr2=0x7fc30015d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:53.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.235+0000 7fc2fea00640 1 --2- 172.21.15.29:0/1013806115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc3000cd350 0x7fc30015d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.235+0000 7fc2fea00640 1 -- 172.21.15.29:0/1013806115 >> v1:172.21.15.29:6789/0 conn(0x7fc30006c860 legacy=0x7fc30006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.235+0000 7fc2fe000640 1 -- 172.21.15.29:0/1013806115 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113751610 0 0) 0x7fc3001611b0 con 0x7fc30006c860 2024-01-24T13:04:53.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.235+0000 7fc2fea00640 1 -- 172.21.15.29:0/1013806115 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc300160910 con 0x7fc300142980 2024-01-24T13:04:53.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.235+0000 7fc2fea00640 1 --2- 172.21.15.29:0/1013806115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc300142980 0x7fc3000cce10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009870 tx=0x7fc2e801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac20b1e6fc7f5f86 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:53.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.239+0000 7fc2fe000640 1 -- 172.21.15.29:0/1013806115 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80aa670 con 0x7fc300142980 2024-01-24T13:04:53.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.239+0000 7fc2fe000640 1 -- 172.21.15.29:0/1013806115 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e80aa7d0 con 0x7fc300142980 2024-01-24T13:04:53.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.239+0000 7fc2fe000640 1 -- 172.21.15.29:0/1013806115 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80aab60 con 0x7fc300142980 2024-01-24T13:04:53.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.239+0000 7fc306600640 1 -- 172.21.15.29:0/1013806115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc300142980 msgr2=0x7fc3000cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.239+0000 7fc306600640 1 --2- 172.21.15.29:0/1013806115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc300142980 0x7fc3000cce10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009870 tx=0x7fc2e801c510 comp rx=0 tx=0).stop 2024-01-24T13:04:53.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.239+0000 7fc306600640 1 -- 172.21.15.29:0/1013806115 shutdown_connections 2024-01-24T13:04:53.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.239+0000 7fc306600640 1 --2- 172.21.15.29:0/1013806115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc3000cd350 0x7fc30015d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.239+0000 7fc306600640 1 --2- 172.21.15.29:0/1013806115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc300142980 0x7fc3000cce10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.239+0000 7fc306600640 1 -- 172.21.15.29:0/1013806115 >> 172.21.15.29:0/1013806115 conn(0x7fc300069cd0 msgr2=0x7fc30006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:53.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.239+0000 7fc306600640 1 -- 172.21.15.29:0/1013806115 shutdown_connections 2024-01-24T13:04:53.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.239+0000 7fc306600640 1 -- 172.21.15.29:0/1013806115 wait complete. 2024-01-24T13:04:53.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.239+0000 7fc306600640 1 Processor -- start 2024-01-24T13:04:53.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.239+0000 7fc306600640 1 -- start start 2024-01-24T13:04:53.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.239+0000 7fc306600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc30006c860 0x7fc300156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc306600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3000cd350 0x7fc30015b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc306600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc300142980 0x7fc30015b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc306600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc300156b50 con 0x7fc30006c860 2024-01-24T13:04:53.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc306600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc300154d90 con 0x7fc3000cd350 2024-01-24T13:04:53.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc306600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc300155070 con 0x7fc300142980 2024-01-24T13:04:53.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc2ff400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc30006c860 0x7fc300156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc2ff400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc30006c860 0x7fc300156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50694/0 (socket says 172.21.15.29:50694) 2024-01-24T13:04:53.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc2ff400640 1 -- 172.21.15.29:0/2936516409 learned_addr learned my addr 172.21.15.29:0/2936516409 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:53.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc2ff400640 1 -- 172.21.15.29:0/2936516409 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc300142980 msgr2=0x7fc30015b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc2ff400640 1 --2- 172.21.15.29:0/2936516409 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc300142980 0x7fc30015b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc2ff400640 1 -- 172.21.15.29:0/2936516409 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3000cd350 msgr2=0x7fc30015b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc2ff400640 1 --2- 172.21.15.29:0/2936516409 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3000cd350 0x7fc30015b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc2ff400640 1 -- 172.21.15.29:0/2936516409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e80094d0 con 0x7fc30006c860 2024-01-24T13:04:53.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc2ff400640 1 --2- 172.21.15.29:0/2936516409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc30006c860 0x7fc300156610 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00011f0 tx=0x7fc2f000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:53.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc2f7400640 1 -- 172.21.15.29:0/2936516409 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f00074e0 con 0x7fc30006c860 2024-01-24T13:04:53.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc2f7400640 1 -- 172.21.15.29:0/2936516409 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f0007640 con 0x7fc30006c860 2024-01-24T13:04:53.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc2f7400640 1 -- 172.21.15.29:0/2936516409 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0004a10 con 0x7fc30006c860 2024-01-24T13:04:53.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc306600640 1 -- 172.21.15.29:0/2936516409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc300155350 con 0x7fc30006c860 2024-01-24T13:04:53.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc306600640 1 -- 172.21.15.29:0/2936516409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc300155910 con 0x7fc30006c860 2024-01-24T13:04:53.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc306600640 1 -- 172.21.15.29:0/2936516409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc300155b00 con 0x7fc30006c860 2024-01-24T13:04:53.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.243+0000 7fc2f7400640 1 -- 172.21.15.29:0/2936516409 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc2f0004b70 con 0x7fc30006c860 2024-01-24T13:04:53.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.247+0000 7fc2f7400640 1 --2- 172.21.15.29:0/2936516409 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc2d8065a60 0x7fc2d8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.247+0000 7fc2f7400640 1 -- 172.21.15.29:0/2936516409 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fc2f00827a0 con 0x7fc30006c860 2024-01-24T13:04:53.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.247+0000 7fc2fea00640 1 --2- 172.21.15.29:0/2936516409 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc2d8065a60 0x7fc2d8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.247+0000 7fc2fea00640 1 --2- 172.21.15.29:0/2936516409 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc2d8065a60 0x7fc2d8067f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80ae000 tx=0x7fc2e80046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:53.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.251+0000 7fc2f7400640 1 -- 172.21.15.29:0/2936516409 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc2f004fda0 con 0x7fc30006c860 2024-01-24T13:04:53.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.407+0000 7fc306600640 1 -- 172.21.15.29:0/2936516409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc30004e850 con 0x7fc30006c860 2024-01-24T13:04:53.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.407+0000 7fc2f7400640 1 -- 172.21.15.29:0/2936516409 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc2f00180a0 con 0x7fc30006c860 2024-01-24T13:04:53.412 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:53.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.411+0000 7fc306600640 1 -- 172.21.15.29:0/2936516409 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc2d8065a60 msgr2=0x7fc2d8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.411+0000 7fc306600640 1 --2- 172.21.15.29:0/2936516409 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc2d8065a60 0x7fc2d8067f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80ae000 tx=0x7fc2e80046d0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.411+0000 7fc306600640 1 -- 172.21.15.29:0/2936516409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc30006c860 msgr2=0x7fc300156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.411+0000 7fc306600640 1 --2- 172.21.15.29:0/2936516409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc30006c860 0x7fc300156610 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00011f0 tx=0x7fc2f000c9b0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.411+0000 7fc306600640 1 -- 172.21.15.29:0/2936516409 shutdown_connections 2024-01-24T13:04:53.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.411+0000 7fc306600640 1 --2- 172.21.15.29:0/2936516409 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc2d8065a60 0x7fc2d8067f20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.411+0000 7fc306600640 1 --2- 172.21.15.29:0/2936516409 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc300142980 0x7fc30015b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.411+0000 7fc306600640 1 --2- 172.21.15.29:0/2936516409 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3000cd350 0x7fc30015b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.411+0000 7fc306600640 1 --2- 172.21.15.29:0/2936516409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc30006c860 0x7fc300156610 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.411+0000 7fc306600640 1 -- 172.21.15.29:0/2936516409 >> 172.21.15.29:0/2936516409 conn(0x7fc300069cd0 msgr2=0x7fc3000b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:53.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.411+0000 7fc306600640 1 -- 172.21.15.29:0/2936516409 shutdown_connections 2024-01-24T13:04:53.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.411+0000 7fc306600640 1 -- 172.21.15.29:0/2936516409 wait complete. 2024-01-24T13:04:53.434 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:04:53.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f338a600640 1 Processor -- start 2024-01-24T13:04:53.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f338a600640 1 -- start start 2024-01-24T13:04:53.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f338a600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f338406c200 0x7f338413cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f338a600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f338413d2e0 0x7f33840cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f338a600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338413d750 con 0x7f338406be20 2024-01-24T13:04:53.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f338a600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338415b4f0 con 0x7f338406c200 2024-01-24T13:04:53.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f338a600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338415b7d0 con 0x7f338413d2e0 2024-01-24T13:04:53.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f3382a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f338406c200 0x7f338413cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f3382a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f338406c200 0x7f338413cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50710/0 (socket says 172.21.15.29:50710) 2024-01-24T13:04:53.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f3382a00640 1 -- 172.21.15.29:0/1458299127 learned_addr learned my addr 172.21.15.29:0/1458299127 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:53.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f3383e00640 1 --2- 172.21.15.29:0/1458299127 >> v2:172.21.15.163:3300/0 conn(0x7f338413d2e0 0x7f33840cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f3382a00640 1 -- 172.21.15.29:0/1458299127 >> v2:172.21.15.163:3300/0 conn(0x7f338413d2e0 msgr2=0x7f33840cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:53.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f3382a00640 1 --2- 172.21.15.29:0/1458299127 >> v2:172.21.15.163:3300/0 conn(0x7f338413d2e0 0x7f33840cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f3382a00640 1 -- 172.21.15.29:0/1458299127 >> v1:172.21.15.163:6789/0 conn(0x7f338406be20 legacy=0x7f338415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.575+0000 7f3382a00640 1 -- 172.21.15.29:0/1458299127 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33840cd0c0 con 0x7f338406c200 2024-01-24T13:04:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.579+0000 7f3382a00640 1 --2- 172.21.15.29:0/1458299127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338406c200 0x7f338413cda0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3384155010 tx=0x7f336c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d476a0de2228c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.579+0000 7f3382000640 1 -- 172.21.15.29:0/1458299127 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c0aa610 con 0x7f338406c200 2024-01-24T13:04:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.579+0000 7f3382000640 1 -- 172.21.15.29:0/1458299127 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c0a6040 con 0x7f338406c200 2024-01-24T13:04:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.579+0000 7f3382000640 1 -- 172.21.15.29:0/1458299127 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c0aa990 con 0x7f338406c200 2024-01-24T13:04:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.579+0000 7f338a600640 1 -- 172.21.15.29:0/1458299127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338406c200 msgr2=0x7f338413cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.579+0000 7f338a600640 1 --2- 172.21.15.29:0/1458299127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338406c200 0x7f338413cda0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3384155010 tx=0x7f336c01c4d0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f338a600640 1 -- 172.21.15.29:0/1458299127 shutdown_connections 2024-01-24T13:04:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f338a600640 1 --2- 172.21.15.29:0/1458299127 >> v2:172.21.15.163:3300/0 conn(0x7f338413d2e0 0x7f33840cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f338a600640 1 --2- 172.21.15.29:0/1458299127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338406c200 0x7f338413cda0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f338a600640 1 -- 172.21.15.29:0/1458299127 >> 172.21.15.29:0/1458299127 conn(0x7f338406d700 msgr2=0x7f3384069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f338a600640 1 -- 172.21.15.29:0/1458299127 shutdown_connections 2024-01-24T13:04:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f338a600640 1 -- 172.21.15.29:0/1458299127 wait complete. 2024-01-24T13:04:53.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f338a600640 1 Processor -- start 2024-01-24T13:04:53.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f338a600640 1 -- start start 2024-01-24T13:04:53.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f338a600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f338406be20 0x7f33840713f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f338a600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338406c200 0x7f33841f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f338a600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f338413d2e0 0x7f338414fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f338a600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3384139740 con 0x7f338406c200 2024-01-24T13:04:53.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f338a600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3384071930 con 0x7f338406be20 2024-01-24T13:04:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f338a600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33841f5ba0 con 0x7f338413d2e0 2024-01-24T13:04:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f3382a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338406c200 0x7f33841f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f3382a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338406c200 0x7f33841f5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50722/0 (socket says 172.21.15.29:50722) 2024-01-24T13:04:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f3382a00640 1 -- 172.21.15.29:0/434564867 learned_addr learned my addr 172.21.15.29:0/434564867 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f3383400640 1 --2- 172.21.15.29:0/434564867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f338406be20 0x7f33840713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f3383e00640 1 --2- 172.21.15.29:0/434564867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f338413d2e0 0x7f338414fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f3382a00640 1 -- 172.21.15.29:0/434564867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f338413d2e0 msgr2=0x7f338414fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f3382a00640 1 --2- 172.21.15.29:0/434564867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f338413d2e0 0x7f338414fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f3382a00640 1 -- 172.21.15.29:0/434564867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f338406be20 msgr2=0x7f33840713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f3382a00640 1 --2- 172.21.15.29:0/434564867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f338406be20 0x7f33840713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.583+0000 7f3382a00640 1 -- 172.21.15.29:0/434564867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c0094d0 con 0x7f338406c200 2024-01-24T13:04:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.587+0000 7f3382a00640 1 --2- 172.21.15.29:0/434564867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338406c200 0x7f33841f5660 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f336c0190e0 tx=0x7f336c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:53.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.587+0000 7f337b400640 1 -- 172.21.15.29:0/434564867 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c0bd5f0 con 0x7f338406c200 2024-01-24T13:04:53.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.587+0000 7f337b400640 1 -- 172.21.15.29:0/434564867 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c0bd750 con 0x7f338406c200 2024-01-24T13:04:53.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.587+0000 7f338a600640 1 -- 172.21.15.29:0/434564867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3384138b30 con 0x7f338406c200 2024-01-24T13:04:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.587+0000 7f337b400640 1 -- 172.21.15.29:0/434564867 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c0bdb00 con 0x7f338406c200 2024-01-24T13:04:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.587+0000 7f338a600640 1 -- 172.21.15.29:0/434564867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33841390f0 con 0x7f338406c200 2024-01-24T13:04:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.587+0000 7f338a600640 1 -- 172.21.15.29:0/434564867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33841398b0 con 0x7f338406c200 2024-01-24T13:04:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.587+0000 7f337b400640 1 -- 172.21.15.29:0/434564867 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f336c0b33f0 con 0x7f338406c200 2024-01-24T13:04:53.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.587+0000 7f337b400640 1 --2- 172.21.15.29:0/434564867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f335c065a90 0x7f335c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.587+0000 7f337b400640 1 -- 172.21.15.29:0/434564867 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f336c11e300 con 0x7f338406c200 2024-01-24T13:04:53.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.591+0000 7f3383400640 1 --2- 172.21.15.29:0/434564867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f335c065a90 0x7f335c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.591+0000 7f3383400640 1 --2- 172.21.15.29:0/434564867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f335c065a90 0x7f335c067f50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3374007fd0 tx=0x7f3374009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:53.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.591+0000 7f337b400640 1 -- 172.21.15.29:0/434564867 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f336c0eb9a0 con 0x7f338406c200 2024-01-24T13:04:53.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.751+0000 7f338a600640 1 -- 172.21.15.29:0/434564867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f338404e850 con 0x7f338406c200 2024-01-24T13:04:53.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.751+0000 7f337b400640 1 -- 172.21.15.29:0/434564867 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f336c0aae60 con 0x7f338406c200 2024-01-24T13:04:53.756 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:04:53.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.751+0000 7f338a600640 1 -- 172.21.15.29:0/434564867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f335c065a90 msgr2=0x7f335c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.751+0000 7f338a600640 1 --2- 172.21.15.29:0/434564867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f335c065a90 0x7f335c067f50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3374007fd0 tx=0x7f3374009040 comp rx=0 tx=0).stop 2024-01-24T13:04:53.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.751+0000 7f338a600640 1 -- 172.21.15.29:0/434564867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338406c200 msgr2=0x7f33841f5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.751+0000 7f338a600640 1 --2- 172.21.15.29:0/434564867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338406c200 0x7f33841f5660 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f336c0190e0 tx=0x7f336c01ad10 comp rx=0 tx=0).stop 2024-01-24T13:04:53.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.751+0000 7f338a600640 1 -- 172.21.15.29:0/434564867 shutdown_connections 2024-01-24T13:04:53.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.751+0000 7f338a600640 1 --2- 172.21.15.29:0/434564867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f335c065a90 0x7f335c067f50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.751+0000 7f338a600640 1 --2- 172.21.15.29:0/434564867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f338413d2e0 0x7f338414fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.751+0000 7f338a600640 1 --2- 172.21.15.29:0/434564867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338406c200 0x7f33841f5660 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.751+0000 7f338a600640 1 --2- 172.21.15.29:0/434564867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f338406be20 0x7f33840713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.751+0000 7f338a600640 1 -- 172.21.15.29:0/434564867 >> 172.21.15.29:0/434564867 conn(0x7f338406d700 msgr2=0x7f3384159490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:53.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.751+0000 7f338a600640 1 -- 172.21.15.29:0/434564867 shutdown_connections 2024-01-24T13:04:53.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.751+0000 7f338a600640 1 -- 172.21.15.29:0/434564867 wait complete. 2024-01-24T13:04:53.776 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:04:53.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.915+0000 7f5421000640 1 Processor -- start 2024-01-24T13:04:53.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.915+0000 7f5421000640 1 -- start start 2024-01-24T13:04:53.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.919+0000 7f5421000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f541c0c3fd0 0x7f541c0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.919+0000 7f5421000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541c0cb440 con 0x7f541c0cb010 2024-01-24T13:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.919+0000 7f5421000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541c0cd1e0 con 0x7f541c15a6f0 2024-01-24T13:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.919+0000 7f5421000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541c15aad0 con 0x7f541c0c3fd0 2024-01-24T13:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.919+0000 7f5419400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f541c0c3fd0 0x7f541c0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.919+0000 7f541a800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f541c0cb010 0x7f541c0d0520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37090/0 (socket says 172.21.15.29:37090) 2024-01-24T13:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.919+0000 7f5419400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f541c0c3fd0 0x7f541c0caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50736/0 (socket says 172.21.15.29:50736) 2024-01-24T13:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.919+0000 7f541a800640 1 -- 172.21.15.29:0/3299441297 learned_addr learned my addr 172.21.15.29:0/3299441297 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.919+0000 7f5419400640 1 -- 172.21.15.29:0/3299441297 >> v1:172.21.15.163:6789/0 conn(0x7f541c15a6f0 legacy=0x7f541c0ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.919+0000 7f5419400640 1 -- 172.21.15.29:0/3299441297 >> v1:172.21.15.29:6789/0 conn(0x7f541c0cb010 legacy=0x7f541c0d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.919+0000 7f5418a00640 1 -- 172.21.15.29:0/3299441297 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042163395 0 0) 0x7f541c0cb440 con 0x7f541c0cb010 2024-01-24T13:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.919+0000 7f5419400640 1 -- 172.21.15.29:0/3299441297 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c0cd4c0 con 0x7f541c0c3fd0 2024-01-24T13:04:53.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.919+0000 7f5419400640 1 --2- 172.21.15.29:0/3299441297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541c0c3fd0 0x7f541c0caad0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f54040097c0 tx=0x7f540401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34dd4ab605337422 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:53.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5418a00640 1 -- 172.21.15.29:0/3299441297 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040ab650 con 0x7f541c0c3fd0 2024-01-24T13:04:53.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5418a00640 1 -- 172.21.15.29:0/3299441297 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54040ab7b0 con 0x7f541c0c3fd0 2024-01-24T13:04:53.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5418a00640 1 -- 172.21.15.29:0/3299441297 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040abb40 con 0x7f541c0c3fd0 2024-01-24T13:04:53.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 -- 172.21.15.29:0/3299441297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541c0c3fd0 msgr2=0x7f541c0caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 --2- 172.21.15.29:0/3299441297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541c0c3fd0 0x7f541c0caad0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f54040097c0 tx=0x7f540401c450 comp rx=0 tx=0).stop 2024-01-24T13:04:53.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 -- 172.21.15.29:0/3299441297 shutdown_connections 2024-01-24T13:04:53.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 --2- 172.21.15.29:0/3299441297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541c0c3fd0 0x7f541c0caad0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 -- 172.21.15.29:0/3299441297 >> 172.21.15.29:0/3299441297 conn(0x7f541c069cd0 msgr2=0x7f541c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:53.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 -- 172.21.15.29:0/3299441297 shutdown_connections 2024-01-24T13:04:53.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 -- 172.21.15.29:0/3299441297 wait complete. 2024-01-24T13:04:53.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 Processor -- start 2024-01-24T13:04:53.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 -- start start 2024-01-24T13:04:53.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f541c0c3fd0 0x7f541c15d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541c0cb010 0x7f541c06c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f541c15a6f0 0x7f541c1542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c15cda0 con 0x7f541c0cb010 2024-01-24T13:04:53.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c156eb0 con 0x7f541c0c3fd0 2024-01-24T13:04:53.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.923+0000 7f5421000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c15c120 con 0x7f541c15a6f0 2024-01-24T13:04:53.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5419400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541c0cb010 0x7f541c06c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5419400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541c0cb010 0x7f541c06c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50752/0 (socket says 172.21.15.29:50752) 2024-01-24T13:04:53.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5419400640 1 -- 172.21.15.29:0/415748890 learned_addr learned my addr 172.21.15.29:0/415748890 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:53.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f541a800640 1 --2- 172.21.15.29:0/415748890 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f541c15a6f0 0x7f541c1542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5419e00640 1 --2- 172.21.15.29:0/415748890 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f541c0c3fd0 0x7f541c15d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5419400640 1 -- 172.21.15.29:0/415748890 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f541c15a6f0 msgr2=0x7f541c1542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5419400640 1 --2- 172.21.15.29:0/415748890 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f541c15a6f0 0x7f541c1542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5419400640 1 -- 172.21.15.29:0/415748890 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f541c0c3fd0 msgr2=0x7f541c15d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:53.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5419400640 1 --2- 172.21.15.29:0/415748890 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f541c0c3fd0 0x7f541c15d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:53.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5419400640 1 -- 172.21.15.29:0/415748890 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404009420 con 0x7f541c0cb010 2024-01-24T13:04:53.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5419400640 1 --2- 172.21.15.29:0/415748890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541c0cb010 0x7f541c06c780 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f54040ad040 tx=0x7f540401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:53.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5412000640 1 -- 172.21.15.29:0/415748890 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040b5810 con 0x7f541c0cb010 2024-01-24T13:04:53.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5412000640 1 -- 172.21.15.29:0/415748890 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54040b59b0 con 0x7f541c0cb010 2024-01-24T13:04:53.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5421000640 1 -- 172.21.15.29:0/415748890 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541c15c400 con 0x7f541c0cb010 2024-01-24T13:04:53.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5412000640 1 -- 172.21.15.29:0/415748890 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040b5d60 con 0x7f541c0cb010 2024-01-24T13:04:53.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5421000640 1 -- 172.21.15.29:0/415748890 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541c15c9c0 con 0x7f541c0cb010 2024-01-24T13:04:53.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5421000640 1 -- 172.21.15.29:0/415748890 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541c15cee0 con 0x7f541c0cb010 2024-01-24T13:04:53.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.927+0000 7f5412000640 1 -- 172.21.15.29:0/415748890 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f54040b4390 con 0x7f541c0cb010 2024-01-24T13:04:53.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.931+0000 7f5412000640 1 --2- 172.21.15.29:0/415748890 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f53f4065a90 0x7f53f4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:53.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.931+0000 7f5412000640 1 -- 172.21.15.29:0/415748890 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f540411dff0 con 0x7f541c0cb010 2024-01-24T13:04:53.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.931+0000 7f5419e00640 1 --2- 172.21.15.29:0/415748890 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f53f4065a90 0x7f53f4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:53.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.931+0000 7f5419e00640 1 --2- 172.21.15.29:0/415748890 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f53f4065a90 0x7f53f4067f50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f540c007fd0 tx=0x7f540c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:53.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:53.935+0000 7f5412000640 1 -- 172.21.15.29:0/415748890 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f541c15cee0 con 0x7f541c0cb010 2024-01-24T13:04:54.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.087+0000 7f5421000640 1 -- 172.21.15.29:0/415748890 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f541c15cee0 con 0x7f541c0cb010 2024-01-24T13:04:54.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.091+0000 7f5412000640 1 -- 172.21.15.29:0/415748890 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f541c15cee0 con 0x7f541c0cb010 2024-01-24T13:04:54.093 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:54.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.091+0000 7f5421000640 1 -- 172.21.15.29:0/415748890 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f53f4065a90 msgr2=0x7f53f4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:54.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.091+0000 7f5421000640 1 --2- 172.21.15.29:0/415748890 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f53f4065a90 0x7f53f4067f50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f540c007fd0 tx=0x7f540c009040 comp rx=0 tx=0).stop 2024-01-24T13:04:54.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.091+0000 7f5421000640 1 -- 172.21.15.29:0/415748890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541c0cb010 msgr2=0x7f541c06c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:54.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.091+0000 7f5421000640 1 --2- 172.21.15.29:0/415748890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541c0cb010 0x7f541c06c780 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f54040ad040 tx=0x7f540401ac90 comp rx=0 tx=0).stop 2024-01-24T13:04:54.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.091+0000 7f5421000640 1 -- 172.21.15.29:0/415748890 shutdown_connections 2024-01-24T13:04:54.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.091+0000 7f5421000640 1 --2- 172.21.15.29:0/415748890 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f53f4065a90 0x7f53f4067f50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.091+0000 7f5421000640 1 --2- 172.21.15.29:0/415748890 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f541c15a6f0 0x7f541c1542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.091+0000 7f5421000640 1 --2- 172.21.15.29:0/415748890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541c0cb010 0x7f541c06c780 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.091+0000 7f5421000640 1 --2- 172.21.15.29:0/415748890 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f541c0c3fd0 0x7f541c15d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.091+0000 7f5421000640 1 -- 172.21.15.29:0/415748890 >> 172.21.15.29:0/415748890 conn(0x7f541c069cd0 msgr2=0x7f541c0c7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:54.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.091+0000 7f5421000640 1 -- 172.21.15.29:0/415748890 shutdown_connections 2024-01-24T13:04:54.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.091+0000 7f5421000640 1 -- 172.21.15.29:0/415748890 wait complete. 2024-01-24T13:04:54.114 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:04:54.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd34600640 1 Processor -- start 2024-01-24T13:04:54.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd34600640 1 -- start start 2024-01-24T13:04:54.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd34600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbd2c0cb250 0x7fbd2c15ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:54.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd34600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbd2c15aab0 0x7fbd2c15af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:54.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd34600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2c15e220 con 0x7fbd2c06fbc0 2024-01-24T13:04:54.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd34600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c0cb630 con 0x7fbd2c15aab0 2024-01-24T13:04:54.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd34600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c15b570 con 0x7fbd2c0cb250 2024-01-24T13:04:54.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd31200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbd2c15aab0 0x7fbd2c15af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:54.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd31200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbd2c15aab0 0x7fbd2c15af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50758/0 (socket says 172.21.15.29:50758) 2024-01-24T13:04:54.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd31200640 1 -- 172.21.15.29:0/3766308416 learned_addr learned my addr 172.21.15.29:0/3766308416 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:54.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd31c00640 1 --2- 172.21.15.29:0/3766308416 >> v2:172.21.15.163:3300/0 conn(0x7fbd2c0cb250 0x7fbd2c15ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:54.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd31200640 1 -- 172.21.15.29:0/3766308416 >> v2:172.21.15.163:3300/0 conn(0x7fbd2c0cb250 msgr2=0x7fbd2c15ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:54.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd31200640 1 --2- 172.21.15.29:0/3766308416 >> v2:172.21.15.163:3300/0 conn(0x7fbd2c0cb250 0x7fbd2c15ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd31200640 1 -- 172.21.15.29:0/3766308416 >> v1:172.21.15.163:6789/0 conn(0x7fbd2c06fbc0 legacy=0x7fbd2c06ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:54.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd31200640 1 -- 172.21.15.29:0/3766308416 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c15b850 con 0x7fbd2c15aab0 2024-01-24T13:04:54.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.255+0000 7fbd31c00640 1 --2- 172.21.15.29:0/3766308416 >> v2:172.21.15.163:3300/0 conn(0x7fbd2c0cb250 0x7fbd2c15ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:54.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.259+0000 7fbd31200640 1 --2- 172.21.15.29:0/3766308416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c15aab0 0x7fbd2c15af40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c06cc70 tx=0x7fbd1401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb5d048b626b0ed server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:54.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.259+0000 7fbd2be00640 1 -- 172.21.15.29:0/3766308416 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd140aa680 con 0x7fbd2c15aab0 2024-01-24T13:04:54.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.259+0000 7fbd2be00640 1 -- 172.21.15.29:0/3766308416 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd140aa7e0 con 0x7fbd2c15aab0 2024-01-24T13:04:54.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.259+0000 7fbd2be00640 1 -- 172.21.15.29:0/3766308416 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd140aab70 con 0x7fbd2c15aab0 2024-01-24T13:04:54.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.259+0000 7fbd34600640 1 -- 172.21.15.29:0/3766308416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c15aab0 msgr2=0x7fbd2c15af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:54.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.259+0000 7fbd34600640 1 --2- 172.21.15.29:0/3766308416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c15aab0 0x7fbd2c15af40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c06cc70 tx=0x7fbd1401c500 comp rx=0 tx=0).stop 2024-01-24T13:04:54.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.259+0000 7fbd34600640 1 -- 172.21.15.29:0/3766308416 shutdown_connections 2024-01-24T13:04:54.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.259+0000 7fbd34600640 1 --2- 172.21.15.29:0/3766308416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c15aab0 0x7fbd2c15af40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.259+0000 7fbd34600640 1 --2- 172.21.15.29:0/3766308416 >> v2:172.21.15.163:3300/0 conn(0x7fbd2c0cb250 0x7fbd2c15ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.259+0000 7fbd34600640 1 -- 172.21.15.29:0/3766308416 >> 172.21.15.29:0/3766308416 conn(0x7fbd2c06a2d0 msgr2=0x7fbd2c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:54.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.259+0000 7fbd34600640 1 -- 172.21.15.29:0/3766308416 shutdown_connections 2024-01-24T13:04:54.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.259+0000 7fbd34600640 1 -- 172.21.15.29:0/3766308416 wait complete. 2024-01-24T13:04:54.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd34600640 1 Processor -- start 2024-01-24T13:04:54.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd34600640 1 -- start start 2024-01-24T13:04:54.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd34600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd2c06fbc0 0x7fbd2c14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:54.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd34600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0cb250 0x7fbd2c14e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:54.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd34600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c15aab0 0x7fbd2c0b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:54.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd34600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c0b3f70 con 0x7fbd2c15aab0 2024-01-24T13:04:54.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd34600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c14fb20 con 0x7fbd2c06fbc0 2024-01-24T13:04:54.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd34600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c0b3d20 con 0x7fbd2c0cb250 2024-01-24T13:04:54.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd32600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c15aab0 0x7fbd2c0b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:54.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd32600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c15aab0 0x7fbd2c0b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50764/0 (socket says 172.21.15.29:50764) 2024-01-24T13:04:54.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd32600640 1 -- 172.21.15.29:0/1816527849 learned_addr learned my addr 172.21.15.29:0/1816527849 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:54.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd31200640 1 --2- 172.21.15.29:0/1816527849 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0cb250 0x7fbd2c14e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:54.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd31c00640 1 --2- 172.21.15.29:0/1816527849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd2c06fbc0 0x7fbd2c14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:54.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd32600640 1 -- 172.21.15.29:0/1816527849 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0cb250 msgr2=0x7fbd2c14e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:54.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd32600640 1 --2- 172.21.15.29:0/1816527849 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0cb250 0x7fbd2c14e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd32600640 1 -- 172.21.15.29:0/1816527849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd2c06fbc0 msgr2=0x7fbd2c14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:54.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd32600640 1 --2- 172.21.15.29:0/1816527849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd2c06fbc0 0x7fbd2c14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd32600640 1 -- 172.21.15.29:0/1816527849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd140094d0 con 0x7fbd2c15aab0 2024-01-24T13:04:54.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd32600640 1 --2- 172.21.15.29:0/1816527849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c15aab0 0x7fbd2c0b37e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400c770 tx=0x7fbd2400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:54.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd29600640 1 -- 172.21.15.29:0/1816527849 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24003b80 con 0x7fbd2c15aab0 2024-01-24T13:04:54.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd29600640 1 -- 172.21.15.29:0/1816527849 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd24003ce0 con 0x7fbd2c15aab0 2024-01-24T13:04:54.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd34600640 1 -- 172.21.15.29:0/1816527849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2c14f1f0 con 0x7fbd2c15aab0 2024-01-24T13:04:54.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd29600640 1 -- 172.21.15.29:0/1816527849 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2400aa90 con 0x7fbd2c15aab0 2024-01-24T13:04:54.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd34600640 1 -- 172.21.15.29:0/1816527849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2c14f7b0 con 0x7fbd2c15aab0 2024-01-24T13:04:54.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.263+0000 7fbd34600640 1 -- 172.21.15.29:0/1816527849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2c14fc90 con 0x7fbd2c15aab0 2024-01-24T13:04:54.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.267+0000 7fbd29600640 1 -- 172.21.15.29:0/1816527849 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbd2400abf0 con 0x7fbd2c15aab0 2024-01-24T13:04:54.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.267+0000 7fbd29600640 1 --2- 172.21.15.29:0/1816527849 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd04065a90 0x7fbd04067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:54.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.267+0000 7fbd29600640 1 -- 172.21.15.29:0/1816527849 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fbd24083210 con 0x7fbd2c15aab0 2024-01-24T13:04:54.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.267+0000 7fbd31c00640 1 --2- 172.21.15.29:0/1816527849 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd04065a90 0x7fbd04067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:54.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.267+0000 7fbd31c00640 1 --2- 172.21.15.29:0/1816527849 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd04065a90 0x7fbd04067f50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c006fd0 tx=0x7fbd1c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:54.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.271+0000 7fbd29600640 1 -- 172.21.15.29:0/1816527849 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fbd240508b0 con 0x7fbd2c15aab0 2024-01-24T13:04:54.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.443+0000 7fbd34600640 1 -- 172.21.15.29:0/1816527849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbd2c04e850 con 0x7fbd2c15aab0 2024-01-24T13:04:54.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.443+0000 7fbd29600640 1 -- 172.21.15.29:0/1816527849 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbd24053ed0 con 0x7fbd2c15aab0 2024-01-24T13:04:54.445 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:04:54.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.443+0000 7fbd34600640 1 -- 172.21.15.29:0/1816527849 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd04065a90 msgr2=0x7fbd04067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:54.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.443+0000 7fbd34600640 1 --2- 172.21.15.29:0/1816527849 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd04065a90 0x7fbd04067f50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c006fd0 tx=0x7fbd1c008040 comp rx=0 tx=0).stop 2024-01-24T13:04:54.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.443+0000 7fbd34600640 1 -- 172.21.15.29:0/1816527849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c15aab0 msgr2=0x7fbd2c0b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:54.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.443+0000 7fbd34600640 1 --2- 172.21.15.29:0/1816527849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c15aab0 0x7fbd2c0b37e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400c770 tx=0x7fbd2400cc30 comp rx=0 tx=0).stop 2024-01-24T13:04:54.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.443+0000 7fbd34600640 1 -- 172.21.15.29:0/1816527849 shutdown_connections 2024-01-24T13:04:54.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.443+0000 7fbd34600640 1 --2- 172.21.15.29:0/1816527849 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd04065a90 0x7fbd04067f50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.443+0000 7fbd34600640 1 --2- 172.21.15.29:0/1816527849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c15aab0 0x7fbd2c0b37e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.443+0000 7fbd34600640 1 --2- 172.21.15.29:0/1816527849 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0cb250 0x7fbd2c14e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.443+0000 7fbd34600640 1 --2- 172.21.15.29:0/1816527849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd2c06fbc0 0x7fbd2c14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.443+0000 7fbd34600640 1 -- 172.21.15.29:0/1816527849 >> 172.21.15.29:0/1816527849 conn(0x7fbd2c06a2d0 msgr2=0x7fbd2c151b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:54.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.443+0000 7fbd34600640 1 -- 172.21.15.29:0/1816527849 shutdown_connections 2024-01-24T13:04:54.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.443+0000 7fbd34600640 1 -- 172.21.15.29:0/1816527849 wait complete. 2024-01-24T13:04:54.467 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-01-24T13:04:54.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:54.467 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-24T13:04:54.487 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:04:54.488 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:04:54.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:54.488 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-24T13:04:54.537 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:04:54.537 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:04:54.546 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:04:54.547 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:04:54.598 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:54.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.735+0000 7f3fa0000640 1 Processor -- start 2024-01-24T13:04:54.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.735+0000 7f3fa0000640 1 -- start start 2024-01-24T13:04:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.739+0000 7f3fa0000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3f98143910 0x7f3f98143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.739+0000 7f3fa0000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f9806c320 0x7f3f980cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.739+0000 7f3fa0000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9815aa30 con 0x7f3f98070ac0 2024-01-24T13:04:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.739+0000 7f3fa0000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f980712a0 con 0x7f3f9806c320 2024-01-24T13:04:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.739+0000 7f3fa0000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f98071580 con 0x7f3f98143910 2024-01-24T13:04:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.739+0000 7f3f9e000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f9806c320 0x7f3f980cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.739+0000 7f3f9e000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f9806c320 0x7f3f980cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50776/0 (socket says 172.21.15.29:50776) 2024-01-24T13:04:54.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.739+0000 7f3f9e000640 1 -- 172.21.15.29:0/3717457879 learned_addr learned my addr 172.21.15.29:0/3717457879 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:54.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.739+0000 7f3f9d600640 1 --2- 172.21.15.29:0/3717457879 >> v2:172.21.15.163:3300/0 conn(0x7f3f98143910 0x7f3f98143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:54.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.739+0000 7f3f9e000640 1 -- 172.21.15.29:0/3717457879 >> v2:172.21.15.163:3300/0 conn(0x7f3f98143910 msgr2=0x7f3f98143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:54.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.739+0000 7f3f9e000640 1 --2- 172.21.15.29:0/3717457879 >> v2:172.21.15.163:3300/0 conn(0x7f3f98143910 0x7f3f98143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.739+0000 7f3f9e000640 1 -- 172.21.15.29:0/3717457879 >> v1:172.21.15.163:6789/0 conn(0x7f3f98070ac0 legacy=0x7f3f9806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:54.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.739+0000 7f3f9e000640 1 -- 172.21.15.29:0/3717457879 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980cd090 con 0x7f3f9806c320 2024-01-24T13:04:54.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.739+0000 7f3f9e000640 1 --2- 172.21.15.29:0/3717457879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f9806c320 0x7f3f980cd890 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3f9806dd90 tx=0x7f3f9001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d05f892d21107b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:54.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3f97e00640 1 -- 172.21.15.29:0/3717457879 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900a5800 con 0x7f3f9806c320 2024-01-24T13:04:54.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3f97e00640 1 -- 172.21.15.29:0/3717457879 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f900a5960 con 0x7f3f9806c320 2024-01-24T13:04:54.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3f97e00640 1 -- 172.21.15.29:0/3717457879 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900a5cf0 con 0x7f3f9806c320 2024-01-24T13:04:54.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3fa0000640 1 -- 172.21.15.29:0/3717457879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f9806c320 msgr2=0x7f3f980cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:54.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3fa0000640 1 --2- 172.21.15.29:0/3717457879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f9806c320 0x7f3f980cd890 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3f9806dd90 tx=0x7f3f9001c960 comp rx=0 tx=0).stop 2024-01-24T13:04:54.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3fa0000640 1 -- 172.21.15.29:0/3717457879 shutdown_connections 2024-01-24T13:04:54.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3fa0000640 1 --2- 172.21.15.29:0/3717457879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f9806c320 0x7f3f980cd890 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3fa0000640 1 --2- 172.21.15.29:0/3717457879 >> v2:172.21.15.163:3300/0 conn(0x7f3f98143910 0x7f3f98143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3fa0000640 1 -- 172.21.15.29:0/3717457879 >> 172.21.15.29:0/3717457879 conn(0x7f3f980b3950 msgr2=0x7f3f98069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:54.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3fa0000640 1 -- 172.21.15.29:0/3717457879 shutdown_connections 2024-01-24T13:04:54.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3fa0000640 1 -- 172.21.15.29:0/3717457879 wait complete. 2024-01-24T13:04:54.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3fa0000640 1 Processor -- start 2024-01-24T13:04:54.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3fa0000640 1 -- start start 2024-01-24T13:04:54.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3fa0000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f9806c320 0x7f3f98155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:54.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3fa0000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f98070ac0 0x7f3f981579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:54.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.743+0000 7f3fa0000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f98143910 0x7f3f98139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:54.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3fa0000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98155250 con 0x7f3f98070ac0 2024-01-24T13:04:54.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3fa0000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f981543c0 con 0x7f3f98143910 2024-01-24T13:04:54.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3fa0000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98157f20 con 0x7f3f9806c320 2024-01-24T13:04:54.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f9cc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f98070ac0 0x7f3f981579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:54.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f9cc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f98070ac0 0x7f3f981579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50790/0 (socket says 172.21.15.29:50790) 2024-01-24T13:04:54.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f9cc00640 1 -- 172.21.15.29:0/828582000 learned_addr learned my addr 172.21.15.29:0/828582000 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:54.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f9e000640 1 --2- 172.21.15.29:0/828582000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f98143910 0x7f3f98139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:54.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f9d600640 1 --2- 172.21.15.29:0/828582000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f9806c320 0x7f3f98155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:54.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f9cc00640 1 -- 172.21.15.29:0/828582000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f9806c320 msgr2=0x7f3f98155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:54.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f9cc00640 1 --2- 172.21.15.29:0/828582000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f9806c320 0x7f3f98155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f9cc00640 1 -- 172.21.15.29:0/828582000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f98143910 msgr2=0x7f3f98139be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:54.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f9cc00640 1 --2- 172.21.15.29:0/828582000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f98143910 0x7f3f98139be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f9cc00640 1 -- 172.21.15.29:0/828582000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90009b30 con 0x7f3f98070ac0 2024-01-24T13:04:54.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f9cc00640 1 --2- 172.21.15.29:0/828582000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f98070ac0 0x7f3f981579e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000c450 tx=0x7f3f8000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:54.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f95600640 1 -- 172.21.15.29:0/828582000 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f80012830 con 0x7f3f98070ac0 2024-01-24T13:04:54.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f95600640 1 -- 172.21.15.29:0/828582000 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f800129b0 con 0x7f3f98070ac0 2024-01-24T13:04:54.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f95600640 1 -- 172.21.15.29:0/828582000 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f80012d60 con 0x7f3f98070ac0 2024-01-24T13:04:54.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3fa0000640 1 -- 172.21.15.29:0/828582000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9813a120 con 0x7f3f98070ac0 2024-01-24T13:04:54.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3fa0000640 1 -- 172.21.15.29:0/828582000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f981548b0 con 0x7f3f98070ac0 2024-01-24T13:04:54.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3fa0000640 1 -- 172.21.15.29:0/828582000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f98155390 con 0x7f3f98070ac0 2024-01-24T13:04:54.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.747+0000 7f3f95600640 1 -- 172.21.15.29:0/828582000 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3f8001c460 con 0x7f3f98070ac0 2024-01-24T13:04:54.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.751+0000 7f3f95600640 1 --2- 172.21.15.29:0/828582000 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f70065a60 0x7f3f70067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:54.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.751+0000 7f3f95600640 1 -- 172.21.15.29:0/828582000 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f3f80083210 con 0x7f3f98070ac0 2024-01-24T13:04:54.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.751+0000 7f3f9d600640 1 --2- 172.21.15.29:0/828582000 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f70065a60 0x7f3f70067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:54.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.751+0000 7f3f9d600640 1 --2- 172.21.15.29:0/828582000 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f70065a60 0x7f3f70067f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3f880079c0 tx=0x7f3f88008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:54.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.755+0000 7f3f95600640 1 -- 172.21.15.29:0/828582000 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3f98155390 con 0x7f3f98070ac0 2024-01-24T13:04:54.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.911+0000 7f3fa0000640 1 -- 172.21.15.29:0/828582000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f98155390 con 0x7f3f98070ac0 2024-01-24T13:04:54.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.911+0000 7f3f95600640 1 -- 172.21.15.29:0/828582000 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7f3f98155390 con 0x7f3f98070ac0 2024-01-24T13:04:54.916 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:54.916 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.915+0000 7f3fa0000640 1 -- 172.21.15.29:0/828582000 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f70065a60 msgr2=0x7f3f70067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.915+0000 7f3fa0000640 1 --2- 172.21.15.29:0/828582000 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f70065a60 0x7f3f70067f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3f880079c0 tx=0x7f3f88008040 comp rx=0 tx=0).stop 2024-01-24T13:04:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.915+0000 7f3fa0000640 1 -- 172.21.15.29:0/828582000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f98070ac0 msgr2=0x7f3f981579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.915+0000 7f3fa0000640 1 --2- 172.21.15.29:0/828582000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f98070ac0 0x7f3f981579e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000c450 tx=0x7f3f8000c910 comp rx=0 tx=0).stop 2024-01-24T13:04:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.915+0000 7f3fa0000640 1 -- 172.21.15.29:0/828582000 shutdown_connections 2024-01-24T13:04:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.915+0000 7f3fa0000640 1 --2- 172.21.15.29:0/828582000 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f70065a60 0x7f3f70067f20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.915+0000 7f3fa0000640 1 --2- 172.21.15.29:0/828582000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f98143910 0x7f3f98139be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.915+0000 7f3fa0000640 1 --2- 172.21.15.29:0/828582000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f98070ac0 0x7f3f981579e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.915+0000 7f3fa0000640 1 --2- 172.21.15.29:0/828582000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f9806c320 0x7f3f98155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.915+0000 7f3fa0000640 1 -- 172.21.15.29:0/828582000 >> 172.21.15.29:0/828582000 conn(0x7f3f980b3950 msgr2=0x7f3f980cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.915+0000 7f3fa0000640 1 -- 172.21.15.29:0/828582000 shutdown_connections 2024-01-24T13:04:54.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:54.915+0000 7f3fa0000640 1 -- 172.21.15.29:0/828582000 wait complete. 2024-01-24T13:04:54.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:04:54.939 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:04:55.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.079+0000 7ff31ca00640 1 Processor -- start 2024-01-24T13:04:55.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.079+0000 7ff31ca00640 1 -- start start 2024-01-24T13:04:55.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.079+0000 7ff31ca00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff3140b2760 0x7ff3140b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.079+0000 7ff31ca00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff31415cef0 0x7ff31415d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.079+0000 7ff31ca00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff314153de0 con 0x7ff314153a00 2024-01-24T13:04:55.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.079+0000 7ff31ca00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3140b3150 con 0x7ff3140b2760 2024-01-24T13:04:55.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.079+0000 7ff31ca00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff314071d10 con 0x7ff31415cef0 2024-01-24T13:04:55.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.083+0000 7ff319600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff3140b2760 0x7ff3140b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.083+0000 7ff31aa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff31415cef0 0x7ff31415d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.083+0000 7ff319600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff3140b2760 0x7ff3140b2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:38980/0 (socket says 172.21.15.29:38980) 2024-01-24T13:04:55.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.083+0000 7ff31aa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff31415cef0 0x7ff31415d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:50056/0 (socket says 172.21.15.29:50056) 2024-01-24T13:04:55.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.083+0000 7ff31a000640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7ff314153a00 0x7ff314071600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:43322/0 (socket says 172.21.15.29:43322) 2024-01-24T13:04:55.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.083+0000 7ff319600640 1 -- 172.21.15.29:0/2214523528 learned_addr learned my addr 172.21.15.29:0/2214523528 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:55.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.083+0000 7ff319600640 1 -- 172.21.15.29:0/2214523528 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff31415cef0 msgr2=0x7ff31415d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:55.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.083+0000 7ff319600640 1 --2- 172.21.15.29:0/2214523528 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff31415cef0 0x7ff31415d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.083+0000 7ff319600640 1 -- 172.21.15.29:0/2214523528 >> v1:172.21.15.163:6789/0 conn(0x7ff314153a00 legacy=0x7ff314071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.083+0000 7ff319600640 1 -- 172.21.15.29:0/2214523528 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff314159900 con 0x7ff3140b2760 2024-01-24T13:04:55.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.087+0000 7ff319600640 1 --2- 172.21.15.29:0/2214523528 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3140b2760 0x7ff3140b2c10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00bb10 tx=0x7ff2fc01eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=190380260596d84b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:55.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.087+0000 7ff318c00640 1 -- 172.21.15.29:0/2214523528 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc0a7b20 con 0x7ff3140b2760 2024-01-24T13:04:55.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.087+0000 7ff318c00640 1 -- 172.21.15.29:0/2214523528 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc0a7c80 con 0x7ff3140b2760 2024-01-24T13:04:55.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.087+0000 7ff318c00640 1 -- 172.21.15.29:0/2214523528 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc0af440 con 0x7ff3140b2760 2024-01-24T13:04:55.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.087+0000 7ff31ca00640 1 -- 172.21.15.29:0/2214523528 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3140b2760 msgr2=0x7ff3140b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.087+0000 7ff31ca00640 1 --2- 172.21.15.29:0/2214523528 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3140b2760 0x7ff3140b2c10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00bb10 tx=0x7ff2fc01eb50 comp rx=0 tx=0).stop 2024-01-24T13:04:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.087+0000 7ff31ca00640 1 -- 172.21.15.29:0/2214523528 shutdown_connections 2024-01-24T13:04:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.087+0000 7ff31ca00640 1 --2- 172.21.15.29:0/2214523528 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff31415cef0 0x7ff31415d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.087+0000 7ff31ca00640 1 --2- 172.21.15.29:0/2214523528 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3140b2760 0x7ff3140b2c10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.087+0000 7ff31ca00640 1 -- 172.21.15.29:0/2214523528 >> 172.21.15.29:0/2214523528 conn(0x7ff31406d700 msgr2=0x7ff314069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.087+0000 7ff31ca00640 1 -- 172.21.15.29:0/2214523528 shutdown_connections 2024-01-24T13:04:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.087+0000 7ff31ca00640 1 -- 172.21.15.29:0/2214523528 wait complete. 2024-01-24T13:04:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.087+0000 7ff31ca00640 1 Processor -- start 2024-01-24T13:04:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.087+0000 7ff31ca00640 1 -- start start 2024-01-24T13:04:55.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31ca00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3140b2760 0x7ff314148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31ca00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff314153a00 0x7ff31414da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31ca00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff31415cef0 0x7ff31414c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31ca00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31414c210 con 0x7ff31415cef0 2024-01-24T13:04:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31ca00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff314148690 con 0x7ff3140b2760 2024-01-24T13:04:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31ca00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31414e920 con 0x7ff314153a00 2024-01-24T13:04:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff31415cef0 0x7ff31414c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff31415cef0 0x7ff31414c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50804/0 (socket says 172.21.15.29:50804) 2024-01-24T13:04:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31aa00640 1 -- 172.21.15.29:0/2051317275 learned_addr learned my addr 172.21.15.29:0/2051317275 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff319600640 1 --2- 172.21.15.29:0/2051317275 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff314153a00 0x7ff31414da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31a000640 1 --2- 172.21.15.29:0/2051317275 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3140b2760 0x7ff314148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31aa00640 1 -- 172.21.15.29:0/2051317275 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff314153a00 msgr2=0x7ff31414da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31aa00640 1 --2- 172.21.15.29:0/2051317275 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff314153a00 0x7ff31414da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31aa00640 1 -- 172.21.15.29:0/2051317275 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3140b2760 msgr2=0x7ff314148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31aa00640 1 --2- 172.21.15.29:0/2051317275 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3140b2760 0x7ff314148150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31aa00640 1 -- 172.21.15.29:0/2051317275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc00b770 con 0x7ff31415cef0 2024-01-24T13:04:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31aa00640 1 --2- 172.21.15.29:0/2051317275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff31415cef0 0x7ff31414c6a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00efc0 tx=0x7ff30c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:55.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff312000640 1 -- 172.21.15.29:0/2051317275 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c014480 con 0x7ff31415cef0 2024-01-24T13:04:55.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff312000640 1 -- 172.21.15.29:0/2051317275 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c00f040 con 0x7ff31415cef0 2024-01-24T13:04:55.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff312000640 1 -- 172.21.15.29:0/2051317275 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c014820 con 0x7ff31415cef0 2024-01-24T13:04:55.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31ca00640 1 -- 172.21.15.29:0/2051317275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31414e360 con 0x7ff31415cef0 2024-01-24T13:04:55.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31ca00640 1 -- 172.21.15.29:0/2051317275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31414bea0 con 0x7ff31415cef0 2024-01-24T13:04:55.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff31ca00640 1 -- 172.21.15.29:0/2051317275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31414c380 con 0x7ff31415cef0 2024-01-24T13:04:55.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.091+0000 7ff312000640 1 -- 172.21.15.29:0/2051317275 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff30c014980 con 0x7ff31415cef0 2024-01-24T13:04:55.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.095+0000 7ff312000640 1 --2- 172.21.15.29:0/2051317275 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff2ec065a90 0x7ff2ec067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.095+0000 7ff312000640 1 -- 172.21.15.29:0/2051317275 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff30c083ec0 con 0x7ff31415cef0 2024-01-24T13:04:55.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.095+0000 7ff31a000640 1 --2- 172.21.15.29:0/2051317275 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff2ec065a90 0x7ff2ec067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.095+0000 7ff31a000640 1 --2- 172.21.15.29:0/2051317275 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff2ec065a90 0x7ff2ec067f50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff304000f70 tx=0x7ff304007e50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:55.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.099+0000 7ff312000640 1 -- 172.21.15.29:0/2051317275 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff30c051600 con 0x7ff31415cef0 2024-01-24T13:04:55.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.251+0000 7ff31ca00640 1 -- 172.21.15.29:0/2051317275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff31404e850 con 0x7ff31415cef0 2024-01-24T13:04:55.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.251+0000 7ff312000640 1 -- 172.21.15.29:0/2051317275 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff30c0180a0 con 0x7ff31415cef0 2024-01-24T13:04:55.256 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:04:55.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.255+0000 7ff31ca00640 1 -- 172.21.15.29:0/2051317275 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff2ec065a90 msgr2=0x7ff2ec067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.255+0000 7ff31ca00640 1 --2- 172.21.15.29:0/2051317275 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff2ec065a90 0x7ff2ec067f50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff304000f70 tx=0x7ff304007e50 comp rx=0 tx=0).stop 2024-01-24T13:04:55.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.255+0000 7ff31ca00640 1 -- 172.21.15.29:0/2051317275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff31415cef0 msgr2=0x7ff31414c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.255+0000 7ff31ca00640 1 --2- 172.21.15.29:0/2051317275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff31415cef0 0x7ff31414c6a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00efc0 tx=0x7ff30c00c490 comp rx=0 tx=0).stop 2024-01-24T13:04:55.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.255+0000 7ff31ca00640 1 -- 172.21.15.29:0/2051317275 shutdown_connections 2024-01-24T13:04:55.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.255+0000 7ff31ca00640 1 --2- 172.21.15.29:0/2051317275 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff2ec065a90 0x7ff2ec067f50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.255+0000 7ff31ca00640 1 --2- 172.21.15.29:0/2051317275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff31415cef0 0x7ff31414c6a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.255+0000 7ff31ca00640 1 --2- 172.21.15.29:0/2051317275 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff314153a00 0x7ff31414da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.255+0000 7ff31ca00640 1 --2- 172.21.15.29:0/2051317275 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3140b2760 0x7ff314148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.255+0000 7ff31ca00640 1 -- 172.21.15.29:0/2051317275 >> 172.21.15.29:0/2051317275 conn(0x7ff31406d700 msgr2=0x7ff314070550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:55.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.255+0000 7ff31ca00640 1 -- 172.21.15.29:0/2051317275 shutdown_connections 2024-01-24T13:04:55.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.255+0000 7ff31ca00640 1 -- 172.21.15.29:0/2051317275 wait complete. 2024-01-24T13:04:55.278 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:04:55.297 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:04:55.328 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:04:55.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.419+0000 7fbd33a00640 1 Processor -- start 2024-01-24T13:04:55.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.419+0000 7fbd33a00640 1 -- start start 2024-01-24T13:04:55.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd33a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbd2c0cd300 0x7fbd2c15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd33a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0ce4e0 0x7fbd2c0d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd33a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2c161130 con 0x7fbd2c0ce050 2024-01-24T13:04:55.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd33a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c15dbe0 con 0x7fbd2c0cd300 2024-01-24T13:04:55.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd33a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c1605b0 con 0x7fbd2c0ce4e0 2024-01-24T13:04:55.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd2be00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbd2c0ce050 0x7fbd2c0d0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37100/0 (socket says 172.21.15.29:37100) 2024-01-24T13:04:55.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd31000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbd2c0cd300 0x7fbd2c15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd2be00640 1 -- 172.21.15.29:0/3262055557 learned_addr learned my addr 172.21.15.29:0/3262055557 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:55.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd31a00640 1 --2- 172.21.15.29:0/3262055557 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0ce4e0 0x7fbd2c0d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd2b400640 1 -- 172.21.15.29:0/3262055557 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094888310 0 0) 0x7fbd2c161130 con 0x7fbd2c0ce050 2024-01-24T13:04:55.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd2b400640 1 -- 172.21.15.29:0/3262055557 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd0c003530 con 0x7fbd2c0ce050 2024-01-24T13:04:55.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd31000640 1 -- 172.21.15.29:0/3262055557 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0ce4e0 msgr2=0x7fbd2c0d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:55.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd31000640 1 --2- 172.21.15.29:0/3262055557 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0ce4e0 0x7fbd2c0d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd31000640 1 -- 172.21.15.29:0/3262055557 >> v1:172.21.15.29:6789/0 conn(0x7fbd2c0ce050 legacy=0x7fbd2c0d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.423+0000 7fbd31000640 1 -- 172.21.15.29:0/3262055557 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c160890 con 0x7fbd2c0cd300 2024-01-24T13:04:55.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.427+0000 7fbd31000640 1 --2- 172.21.15.29:0/3262055557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c0cd300 0x7fbd2c15d6a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0097c0 tx=0x7fbd1c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bfcefeb65e537b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:55.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.427+0000 7fbd2b400640 1 -- 172.21.15.29:0/3262055557 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0ab680 con 0x7fbd2c0cd300 2024-01-24T13:04:55.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.427+0000 7fbd2b400640 1 -- 172.21.15.29:0/3262055557 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c0ab7e0 con 0x7fbd2c0cd300 2024-01-24T13:04:55.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.427+0000 7fbd2b400640 1 -- 172.21.15.29:0/3262055557 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0abb70 con 0x7fbd2c0cd300 2024-01-24T13:04:55.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.427+0000 7fbd33a00640 1 -- 172.21.15.29:0/3262055557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c0cd300 msgr2=0x7fbd2c15d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.427+0000 7fbd33a00640 1 --2- 172.21.15.29:0/3262055557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c0cd300 0x7fbd2c15d6a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0097c0 tx=0x7fbd1c01c480 comp rx=0 tx=0).stop 2024-01-24T13:04:55.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.427+0000 7fbd33a00640 1 -- 172.21.15.29:0/3262055557 shutdown_connections 2024-01-24T13:04:55.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.427+0000 7fbd33a00640 1 --2- 172.21.15.29:0/3262055557 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0ce4e0 0x7fbd2c0d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.427+0000 7fbd33a00640 1 --2- 172.21.15.29:0/3262055557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c0cd300 0x7fbd2c15d6a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.427+0000 7fbd33a00640 1 -- 172.21.15.29:0/3262055557 >> 172.21.15.29:0/3262055557 conn(0x7fbd2c069cd0 msgr2=0x7fbd2c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:55.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.427+0000 7fbd33a00640 1 -- 172.21.15.29:0/3262055557 shutdown_connections 2024-01-24T13:04:55.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.427+0000 7fbd33a00640 1 -- 172.21.15.29:0/3262055557 wait complete. 2024-01-24T13:04:55.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.427+0000 7fbd33a00640 1 Processor -- start 2024-01-24T13:04:55.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.427+0000 7fbd33a00640 1 -- start start 2024-01-24T13:04:55.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd33a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c0cd300 0x7fbd2c153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd33a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0ce050 0x7fbd2c142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd33a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd2c0ce4e0 0x7fbd2c142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd33a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c154400 con 0x7fbd2c0cd300 2024-01-24T13:04:55.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd33a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c141d70 con 0x7fbd2c0ce4e0 2024-01-24T13:04:55.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd33a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c1555a0 con 0x7fbd2c0ce050 2024-01-24T13:04:55.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd31000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c0cd300 0x7fbd2c153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd31000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c0cd300 0x7fbd2c153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50826/0 (socket says 172.21.15.29:50826) 2024-01-24T13:04:55.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd31000640 1 -- 172.21.15.29:0/3503515729 learned_addr learned my addr 172.21.15.29:0/3503515729 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:55.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd2be00640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0ce050 0x7fbd2c142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd31a00640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd2c0ce4e0 0x7fbd2c142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd31000640 1 -- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0ce050 msgr2=0x7fbd2c142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd31000640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0ce050 0x7fbd2c142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd31000640 1 -- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd2c0ce4e0 msgr2=0x7fbd2c142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd31000640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd2c0ce4e0 0x7fbd2c142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd31000640 1 -- 172.21.15.29:0/3503515729 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c009420 con 0x7fbd2c0cd300 2024-01-24T13:04:55.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd2be00640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0ce050 0x7fbd2c142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:55.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd31a00640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd2c0ce4e0 0x7fbd2c142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:55.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd31000640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c0cd300 0x7fbd2c153ec0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0ad040 tx=0x7fbd1c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:55.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd28c00640 1 -- 172.21.15.29:0/3503515729 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0bf610 con 0x7fbd2c0cd300 2024-01-24T13:04:55.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd28c00640 1 -- 172.21.15.29:0/3503515729 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c0bf770 con 0x7fbd2c0cd300 2024-01-24T13:04:55.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd33a00640 1 -- 172.21.15.29:0/3503515729 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2c141160 con 0x7fbd2c0cd300 2024-01-24T13:04:55.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd28c00640 1 -- 172.21.15.29:0/3503515729 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0bfb20 con 0x7fbd2c0cd300 2024-01-24T13:04:55.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd33a00640 1 -- 172.21.15.29:0/3503515729 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2c141720 con 0x7fbd2c0cd300 2024-01-24T13:04:55.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd33a00640 1 -- 172.21.15.29:0/3503515729 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2c04e850 con 0x7fbd2c0cd300 2024-01-24T13:04:55.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.431+0000 7fbd28c00640 1 -- 172.21.15.29:0/3503515729 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbd1c0b5400 con 0x7fbd2c0cd300 2024-01-24T13:04:55.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.435+0000 7fbd28c00640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd04065a60 0x7fbd04067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.435+0000 7fbd28c00640 1 -- 172.21.15.29:0/3503515729 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fbd1c11e540 con 0x7fbd2c0cd300 2024-01-24T13:04:55.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.435+0000 7fbd2be00640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd04065a60 0x7fbd04067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.435+0000 7fbd2be00640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd04065a60 0x7fbd04067f20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c06c3f0 tx=0x7fbd14009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:55.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.439+0000 7fbd28c00640 1 -- 172.21.15.29:0/3503515729 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fbd1c0ebb30 con 0x7fbd2c0cd300 2024-01-24T13:04:55.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.595+0000 7fbd33a00640 1 -- 172.21.15.29:0/3503515729 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd2c0b2980 con 0x7fbd2c0cd300 2024-01-24T13:04:55.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.595+0000 7fbd28c00640 1 -- 172.21.15.29:0/3503515729 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd1c0ef150 con 0x7fbd2c0cd300 2024-01-24T13:04:55.600 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:55.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.599+0000 7fbd33a00640 1 -- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd04065a60 msgr2=0x7fbd04067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.599+0000 7fbd33a00640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd04065a60 0x7fbd04067f20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c06c3f0 tx=0x7fbd14009040 comp rx=0 tx=0).stop 2024-01-24T13:04:55.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.599+0000 7fbd33a00640 1 -- 172.21.15.29:0/3503515729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c0cd300 msgr2=0x7fbd2c153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.599+0000 7fbd33a00640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c0cd300 0x7fbd2c153ec0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0ad040 tx=0x7fbd1c01acc0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.599+0000 7fbd33a00640 1 -- 172.21.15.29:0/3503515729 shutdown_connections 2024-01-24T13:04:55.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.599+0000 7fbd33a00640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbd04065a60 0x7fbd04067f20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.599+0000 7fbd33a00640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd2c0ce4e0 0x7fbd2c142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.599+0000 7fbd33a00640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd2c0ce050 0x7fbd2c142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.599+0000 7fbd33a00640 1 --2- 172.21.15.29:0/3503515729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2c0cd300 0x7fbd2c153ec0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.599+0000 7fbd33a00640 1 -- 172.21.15.29:0/3503515729 >> 172.21.15.29:0/3503515729 conn(0x7fbd2c069cd0 msgr2=0x7fbd2c15f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:55.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.599+0000 7fbd33a00640 1 -- 172.21.15.29:0/3503515729 shutdown_connections 2024-01-24T13:04:55.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.599+0000 7fbd33a00640 1 -- 172.21.15.29:0/3503515729 wait complete. 2024-01-24T13:04:55.622 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:04:55.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1669c00640 1 Processor -- start 2024-01-24T13:04:55.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1669c00640 1 -- start start 2024-01-24T13:04:55.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1669c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f16640c3fd0 0x7f16640caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1669c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f16640cb010 0x7f16640d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1669c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16640cd1e0 con 0x7f166415a6f0 2024-01-24T13:04:55.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1669c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16640cb4a0 con 0x7f16640cb010 2024-01-24T13:04:55.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1669c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166415aad0 con 0x7f16640c3fd0 2024-01-24T13:04:55.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1663400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f16640cb010 0x7f16640d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1662000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f16640c3fd0 0x7f16640caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1663400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f16640cb010 0x7f16640d0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:39010/0 (socket says 172.21.15.29:39010) 2024-01-24T13:04:55.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1663400640 1 -- 172.21.15.29:0/2882091548 learned_addr learned my addr 172.21.15.29:0/2882091548 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:55.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1662000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f16640c3fd0 0x7f16640caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:50092/0 (socket says 172.21.15.29:50092) 2024-01-24T13:04:55.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1662a00640 1 --1- 172.21.15.29:0/2882091548 >> v1:172.21.15.163:6789/0 conn(0x7f166415a6f0 0x7f16640ceb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:43326/0 (socket says 172.21.15.29:43326) 2024-01-24T13:04:55.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1663400640 1 -- 172.21.15.29:0/2882091548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f16640c3fd0 msgr2=0x7f16640caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:55.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1663400640 1 --2- 172.21.15.29:0/2882091548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f16640c3fd0 0x7f16640caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1663400640 1 -- 172.21.15.29:0/2882091548 >> v1:172.21.15.163:6789/0 conn(0x7f166415a6f0 legacy=0x7f16640ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1663400640 1 -- 172.21.15.29:0/2882091548 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16640cd4c0 con 0x7f16640cb010 2024-01-24T13:04:55.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1662000640 1 --2- 172.21.15.29:0/2882091548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f16640c3fd0 0x7f16640caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:04:55.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.763+0000 7f1661600640 1 -- 172.21.15.29:0/2882091548 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798509093 0 0) 0x7f16640cd1e0 con 0x7f166415a6f0 2024-01-24T13:04:55.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.767+0000 7f1663400640 1 --2- 172.21.15.29:0/2882091548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f16640cb010 0x7f16640d0520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f165c009e80 tx=0x7f165c01c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ac8a5a5aac59a2d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:55.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.767+0000 7f1661600640 1 -- 172.21.15.29:0/2882091548 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c0a5790 con 0x7f16640cb010 2024-01-24T13:04:55.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.767+0000 7f1661600640 1 -- 172.21.15.29:0/2882091548 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c0a58f0 con 0x7f16640cb010 2024-01-24T13:04:55.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.767+0000 7f1661600640 1 -- 172.21.15.29:0/2882091548 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c0a5c80 con 0x7f16640cb010 2024-01-24T13:04:55.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.767+0000 7f1669c00640 1 -- 172.21.15.29:0/2882091548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f16640cb010 msgr2=0x7f16640d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.767+0000 7f1669c00640 1 --2- 172.21.15.29:0/2882091548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f16640cb010 0x7f16640d0520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f165c009e80 tx=0x7f165c01c9c0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.767+0000 7f1669c00640 1 -- 172.21.15.29:0/2882091548 shutdown_connections 2024-01-24T13:04:55.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.767+0000 7f1669c00640 1 --2- 172.21.15.29:0/2882091548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f16640cb010 0x7f16640d0520 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.767+0000 7f1669c00640 1 --2- 172.21.15.29:0/2882091548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f16640c3fd0 0x7f16640caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.767+0000 7f1669c00640 1 -- 172.21.15.29:0/2882091548 >> 172.21.15.29:0/2882091548 conn(0x7f1664069cd0 msgr2=0x7f166406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:55.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1669c00640 1 -- 172.21.15.29:0/2882091548 shutdown_connections 2024-01-24T13:04:55.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1669c00640 1 -- 172.21.15.29:0/2882091548 wait complete. 2024-01-24T13:04:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1669c00640 1 Processor -- start 2024-01-24T13:04:55.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1669c00640 1 -- start start 2024-01-24T13:04:55.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1669c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f16640c3fd0 0x7f166414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1669c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f16640cb010 0x7f16641501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1669c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f166415a6f0 0x7f16640c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1669c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16640c4530 con 0x7f166415a6f0 2024-01-24T13:04:55.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1669c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16640c50b0 con 0x7f16640cb010 2024-01-24T13:04:55.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1669c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16640c4780 con 0x7f16640c3fd0 2024-01-24T13:04:55.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1663400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f166415a6f0 0x7f16640c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1663400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f166415a6f0 0x7f16640c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50842/0 (socket says 172.21.15.29:50842) 2024-01-24T13:04:55.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1663400640 1 -- 172.21.15.29:0/3077096714 learned_addr learned my addr 172.21.15.29:0/3077096714 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:55.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1662a00640 1 --2- 172.21.15.29:0/3077096714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f16640c3fd0 0x7f166414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1662000640 1 --2- 172.21.15.29:0/3077096714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f16640cb010 0x7f16641501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1663400640 1 -- 172.21.15.29:0/3077096714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f16640c3fd0 msgr2=0x7f166414f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1663400640 1 --2- 172.21.15.29:0/3077096714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f16640c3fd0 0x7f166414f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1663400640 1 -- 172.21.15.29:0/3077096714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f16640cb010 msgr2=0x7f16641501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1663400640 1 --2- 172.21.15.29:0/3077096714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f16640cb010 0x7f16641501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1663400640 1 -- 172.21.15.29:0/3077096714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c009420 con 0x7f166415a6f0 2024-01-24T13:04:55.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.771+0000 7f1663400640 1 --2- 172.21.15.29:0/3077096714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f166415a6f0 0x7f16640c5540 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f165c0af040 tx=0x7f165c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:55.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.775+0000 7f165aa00640 1 -- 172.21.15.29:0/3077096714 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c0b8670 con 0x7f166415a6f0 2024-01-24T13:04:55.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.775+0000 7f165aa00640 1 -- 172.21.15.29:0/3077096714 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c0b87d0 con 0x7f166415a6f0 2024-01-24T13:04:55.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.775+0000 7f1669c00640 1 -- 172.21.15.29:0/3077096714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f165c009b30 con 0x7f166415a6f0 2024-01-24T13:04:55.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.775+0000 7f165aa00640 1 -- 172.21.15.29:0/3077096714 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c0b8b60 con 0x7f166415a6f0 2024-01-24T13:04:55.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.775+0000 7f1669c00640 1 -- 172.21.15.29:0/3077096714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16640c4d40 con 0x7f166415a6f0 2024-01-24T13:04:55.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.775+0000 7f1669c00640 1 -- 172.21.15.29:0/3077096714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166404e850 con 0x7f166415a6f0 2024-01-24T13:04:55.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.775+0000 7f165aa00640 1 -- 172.21.15.29:0/3077096714 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f165c0b8cc0 con 0x7f166415a6f0 2024-01-24T13:04:55.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.775+0000 7f165aa00640 1 --2- 172.21.15.29:0/3077096714 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f163c065a60 0x7f163c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:55.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.775+0000 7f165aa00640 1 -- 172.21.15.29:0/3077096714 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f165c11ea20 con 0x7f166415a6f0 2024-01-24T13:04:55.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.775+0000 7f1662a00640 1 --2- 172.21.15.29:0/3077096714 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f163c065a60 0x7f163c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:55.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.779+0000 7f1662a00640 1 --2- 172.21.15.29:0/3077096714 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f163c065a60 0x7f163c067f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1654000f70 tx=0x7f1654007b60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.779+0000 7f165aa00640 1 -- 172.21.15.29:0/3077096714 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f165c0ec150 con 0x7f166415a6f0 2024-01-24T13:04:55.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.939+0000 7f1669c00640 1 -- 172.21.15.29:0/3077096714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1664066480 con 0x7f166415a6f0 2024-01-24T13:04:55.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.939+0000 7f165aa00640 1 -- 172.21.15.29:0/3077096714 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f165c0bc0a0 con 0x7f166415a6f0 2024-01-24T13:04:55.943 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:04:55.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.943+0000 7f1669c00640 1 -- 172.21.15.29:0/3077096714 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f163c065a60 msgr2=0x7f163c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.943+0000 7f1669c00640 1 --2- 172.21.15.29:0/3077096714 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f163c065a60 0x7f163c067f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1654000f70 tx=0x7f1654007b60 comp rx=0 tx=0).stop 2024-01-24T13:04:55.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.943+0000 7f1669c00640 1 -- 172.21.15.29:0/3077096714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f166415a6f0 msgr2=0x7f16640c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:55.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.943+0000 7f1669c00640 1 --2- 172.21.15.29:0/3077096714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f166415a6f0 0x7f16640c5540 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f165c0af040 tx=0x7f165c019760 comp rx=0 tx=0).stop 2024-01-24T13:04:55.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.943+0000 7f1669c00640 1 -- 172.21.15.29:0/3077096714 shutdown_connections 2024-01-24T13:04:55.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.943+0000 7f1669c00640 1 --2- 172.21.15.29:0/3077096714 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f163c065a60 0x7f163c067f20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.943+0000 7f1669c00640 1 --2- 172.21.15.29:0/3077096714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f166415a6f0 0x7f16640c5540 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.943+0000 7f1669c00640 1 --2- 172.21.15.29:0/3077096714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f16640cb010 0x7f16641501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.943+0000 7f1669c00640 1 --2- 172.21.15.29:0/3077096714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f16640c3fd0 0x7f166414f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:55.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.943+0000 7f1669c00640 1 -- 172.21.15.29:0/3077096714 >> 172.21.15.29:0/3077096714 conn(0x7f1664069cd0 msgr2=0x7f166406bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:55.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.943+0000 7f1669c00640 1 -- 172.21.15.29:0/3077096714 shutdown_connections 2024-01-24T13:04:55.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:55.943+0000 7f1669c00640 1 -- 172.21.15.29:0/3077096714 wait complete. 2024-01-24T13:04:55.965 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:04:56.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.107+0000 7fa2ed600640 1 Processor -- start 2024-01-24T13:04:56.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.107+0000 7fa2ed600640 1 -- start start 2024-01-24T13:04:56.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.107+0000 7fa2ed600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa2e806c860 0x7fa2e806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.107+0000 7fa2ed600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e806b320 con 0x7fa2e8142980 2024-01-24T13:04:56.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.107+0000 7fa2ed600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e81611b0 con 0x7fa2e80cd520 2024-01-24T13:04:56.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.107+0000 7fa2ed600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e8160630 con 0x7fa2e806c860 2024-01-24T13:04:56.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.111+0000 7fa2e6000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa2e8142980 0x7fa2e80cce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37116/0 (socket says 172.21.15.29:37116) 2024-01-24T13:04:56.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.111+0000 7fa2e6000640 1 -- 172.21.15.29:0/4109816612 learned_addr learned my addr 172.21.15.29:0/4109816612 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:56.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.111+0000 7fa2e6a00640 1 --2- 172.21.15.29:0/4109816612 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa2e806c860 0x7fa2e806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.111+0000 7fa2e5600640 1 -- 172.21.15.29:0/4109816612 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785531207 0 0) 0x7fa2e806b320 con 0x7fa2e8142980 2024-01-24T13:04:56.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.111+0000 7fa2e5600640 1 -- 172.21.15.29:0/4109816612 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2c8003530 con 0x7fa2e8142980 2024-01-24T13:04:56.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.111+0000 7fa2e5600640 1 -- 172.21.15.29:0/4109816612 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2489414410 0 0) 0x7fa2c8003530 con 0x7fa2e8142980 2024-01-24T13:04:56.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.111+0000 7fa2e6a00640 1 -- 172.21.15.29:0/4109816612 >> v1:172.21.15.163:6789/0 conn(0x7fa2e80cd520 legacy=0x7fa2e815d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.111+0000 7fa2e6a00640 1 -- 172.21.15.29:0/4109816612 >> v1:172.21.15.29:6789/0 conn(0x7fa2e8142980 legacy=0x7fa2e80cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.111+0000 7fa2e6a00640 1 -- 172.21.15.29:0/4109816612 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e8160910 con 0x7fa2e806c860 2024-01-24T13:04:56.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.111+0000 7fa2e6a00640 1 --2- 172.21.15.29:0/4109816612 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa2e806c860 0x7fa2e806ade0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80097f0 tx=0x7fa2d801c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=894de9a80f18daf2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:56.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2e5600640 1 -- 172.21.15.29:0/4109816612 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0001680 con 0x7fa2e806c860 2024-01-24T13:04:56.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2e5600640 1 -- 172.21.15.29:0/4109816612 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d80a7050 con 0x7fa2e806c860 2024-01-24T13:04:56.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2e5600640 1 -- 172.21.15.29:0/4109816612 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d80ab620 con 0x7fa2e806c860 2024-01-24T13:04:56.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 -- 172.21.15.29:0/4109816612 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa2e806c860 msgr2=0x7fa2e806ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 --2- 172.21.15.29:0/4109816612 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa2e806c860 0x7fa2e806ade0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80097f0 tx=0x7fa2d801c290 comp rx=0 tx=0).stop 2024-01-24T13:04:56.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 -- 172.21.15.29:0/4109816612 shutdown_connections 2024-01-24T13:04:56.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 --2- 172.21.15.29:0/4109816612 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa2e806c860 0x7fa2e806ade0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 -- 172.21.15.29:0/4109816612 >> 172.21.15.29:0/4109816612 conn(0x7fa2e8069cd0 msgr2=0x7fa2e806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:56.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 -- 172.21.15.29:0/4109816612 shutdown_connections 2024-01-24T13:04:56.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 -- 172.21.15.29:0/4109816612 wait complete. 2024-01-24T13:04:56.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 Processor -- start 2024-01-24T13:04:56.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 -- start start 2024-01-24T13:04:56.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa2e806c860 0x7fa2e815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2e80cd520 0x7fa2e815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa2e8142980 0x7fa2e815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e815c030 con 0x7fa2e80cd520 2024-01-24T13:04:56.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e80cae40 con 0x7fa2e806c860 2024-01-24T13:04:56.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.115+0000 7fa2ed600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e80cb120 con 0x7fa2e8142980 2024-01-24T13:04:56.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2e6000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2e80cd520 0x7fa2e815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2e6000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2e80cd520 0x7fa2e815ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50850/0 (socket says 172.21.15.29:50850) 2024-01-24T13:04:56.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2e6000640 1 -- 172.21.15.29:0/3253034023 learned_addr learned my addr 172.21.15.29:0/3253034023 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:56.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2e6a00640 1 --2- 172.21.15.29:0/3253034023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa2e806c860 0x7fa2e815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2e7400640 1 --2- 172.21.15.29:0/3253034023 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa2e8142980 0x7fa2e815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2e6000640 1 -- 172.21.15.29:0/3253034023 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa2e8142980 msgr2=0x7fa2e815ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2e6000640 1 --2- 172.21.15.29:0/3253034023 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa2e8142980 0x7fa2e815ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2e6000640 1 -- 172.21.15.29:0/3253034023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa2e806c860 msgr2=0x7fa2e815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2e6000640 1 --2- 172.21.15.29:0/3253034023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa2e806c860 0x7fa2e815baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2e6000640 1 -- 172.21.15.29:0/3253034023 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d8009420 con 0x7fa2e80cd520 2024-01-24T13:04:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2e6000640 1 --2- 172.21.15.29:0/3253034023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2e80cd520 0x7fa2e815ea00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000c730 tx=0x7fa2d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2dea00640 1 -- 172.21.15.29:0/3253034023 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00072d0 con 0x7fa2e80cd520 2024-01-24T13:04:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2dea00640 1 -- 172.21.15.29:0/3253034023 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d0007470 con 0x7fa2e80cd520 2024-01-24T13:04:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2dea00640 1 -- 172.21.15.29:0/3253034023 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00047f0 con 0x7fa2e80cd520 2024-01-24T13:04:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2ed600640 1 -- 172.21.15.29:0/3253034023 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e80c8070 con 0x7fa2e80cd520 2024-01-24T13:04:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2ed600640 1 -- 172.21.15.29:0/3253034023 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e80cb400 con 0x7fa2e80cd520 2024-01-24T13:04:56.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2ed600640 1 -- 172.21.15.29:0/3253034023 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e80c8590 con 0x7fa2e80cd520 2024-01-24T13:04:56.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.119+0000 7fa2dea00640 1 -- 172.21.15.29:0/3253034023 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa2d0004950 con 0x7fa2e80cd520 2024-01-24T13:04:56.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.123+0000 7fa2dea00640 1 --2- 172.21.15.29:0/3253034023 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa2c0065a60 0x7fa2c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.123+0000 7fa2dea00640 1 -- 172.21.15.29:0/3253034023 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fa2d0082810 con 0x7fa2e80cd520 2024-01-24T13:04:56.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.123+0000 7fa2e6a00640 1 --2- 172.21.15.29:0/3253034023 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa2c0065a60 0x7fa2c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.123+0000 7fa2e6a00640 1 --2- 172.21.15.29:0/3253034023 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa2c0065a60 0x7fa2c0067f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80ad000 tx=0x7fa2d80a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.127+0000 7fa2dea00640 1 -- 172.21.15.29:0/3253034023 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa2e80c8590 con 0x7fa2e80cd520 2024-01-24T13:04:56.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.283+0000 7fa2ed600640 1 -- 172.21.15.29:0/3253034023 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa2e80c8590 con 0x7fa2e80cd520 2024-01-24T13:04:56.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.283+0000 7fa2dea00640 1 -- 172.21.15.29:0/3253034023 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa2e80c8590 con 0x7fa2e80cd520 2024-01-24T13:04:56.287 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:56.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.287+0000 7fa2ed600640 1 -- 172.21.15.29:0/3253034023 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa2c0065a60 msgr2=0x7fa2c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.287+0000 7fa2ed600640 1 --2- 172.21.15.29:0/3253034023 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa2c0065a60 0x7fa2c0067f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80ad000 tx=0x7fa2d80a6000 comp rx=0 tx=0).stop 2024-01-24T13:04:56.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.287+0000 7fa2ed600640 1 -- 172.21.15.29:0/3253034023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2e80cd520 msgr2=0x7fa2e815ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.287+0000 7fa2ed600640 1 --2- 172.21.15.29:0/3253034023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2e80cd520 0x7fa2e815ea00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000c730 tx=0x7fa2d000cbf0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.287+0000 7fa2ed600640 1 -- 172.21.15.29:0/3253034023 shutdown_connections 2024-01-24T13:04:56.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.287+0000 7fa2ed600640 1 --2- 172.21.15.29:0/3253034023 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa2c0065a60 0x7fa2c0067f20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.287+0000 7fa2ed600640 1 --2- 172.21.15.29:0/3253034023 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa2e8142980 0x7fa2e815ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.287+0000 7fa2ed600640 1 --2- 172.21.15.29:0/3253034023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2e80cd520 0x7fa2e815ea00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.287+0000 7fa2ed600640 1 --2- 172.21.15.29:0/3253034023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa2e806c860 0x7fa2e815baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.287+0000 7fa2ed600640 1 -- 172.21.15.29:0/3253034023 >> 172.21.15.29:0/3253034023 conn(0x7fa2e8069cd0 msgr2=0x7fa2e806a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:56.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.287+0000 7fa2ed600640 1 -- 172.21.15.29:0/3253034023 shutdown_connections 2024-01-24T13:04:56.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.287+0000 7fa2ed600640 1 -- 172.21.15.29:0/3253034023 wait complete. 2024-01-24T13:04:56.308 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:04:56.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f397ea00640 1 Processor -- start 2024-01-24T13:04:56.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f397ea00640 1 -- start start 2024-01-24T13:04:56.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f397ea00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f39780cd160 0x7f39780cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f397ea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f397815e0f0 0x7f397815b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f397ea00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397815e920 con 0x7f397815b8b0 2024-01-24T13:04:56.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f397ea00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f397815ec00 con 0x7f397815e0f0 2024-01-24T13:04:56.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f397ea00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f397815eee0 con 0x7f39780cd160 2024-01-24T13:04:56.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f3977400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f397815e0f0 0x7f397815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f3977400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f397815e0f0 0x7f397815b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50856/0 (socket says 172.21.15.29:50856) 2024-01-24T13:04:56.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f3977400640 1 -- 172.21.15.29:0/4127211129 learned_addr learned my addr 172.21.15.29:0/4127211129 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:56.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f3977e00640 1 --2- 172.21.15.29:0/4127211129 >> v2:172.21.15.163:3300/0 conn(0x7f39780cd160 0x7f39780cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f3977400640 1 -- 172.21.15.29:0/4127211129 >> v2:172.21.15.163:3300/0 conn(0x7f39780cd160 msgr2=0x7f39780cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:56.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f3977400640 1 --2- 172.21.15.29:0/4127211129 >> v2:172.21.15.163:3300/0 conn(0x7f39780cd160 0x7f39780cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f3977400640 1 -- 172.21.15.29:0/4127211129 >> v1:172.21.15.163:6789/0 conn(0x7f397815b8b0 legacy=0x7f39780cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:56.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.447+0000 7f3977400640 1 -- 172.21.15.29:0/4127211129 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397815ae50 con 0x7f397815e0f0 2024-01-24T13:04:56.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.451+0000 7f3977400640 1 --2- 172.21.15.29:0/4127211129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f397815e0f0 0x7f397815b370 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f39780b6620 tx=0x7f396001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67d057b39f5972c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:56.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.451+0000 7f3976a00640 1 -- 172.21.15.29:0/4127211129 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39600ac640 con 0x7f397815e0f0 2024-01-24T13:04:56.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.451+0000 7f3976a00640 1 -- 172.21.15.29:0/4127211129 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39600ac7a0 con 0x7f397815e0f0 2024-01-24T13:04:56.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.451+0000 7f3976a00640 1 -- 172.21.15.29:0/4127211129 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39600acb30 con 0x7f397815e0f0 2024-01-24T13:04:56.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.451+0000 7f397ea00640 1 -- 172.21.15.29:0/4127211129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f397815e0f0 msgr2=0x7f397815b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.451+0000 7f397ea00640 1 --2- 172.21.15.29:0/4127211129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f397815e0f0 0x7f397815b370 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f39780b6620 tx=0x7f396001c4c0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.451+0000 7f397ea00640 1 -- 172.21.15.29:0/4127211129 shutdown_connections 2024-01-24T13:04:56.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.451+0000 7f397ea00640 1 --2- 172.21.15.29:0/4127211129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f397815e0f0 0x7f397815b370 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.451+0000 7f397ea00640 1 --2- 172.21.15.29:0/4127211129 >> v2:172.21.15.163:3300/0 conn(0x7f39780cd160 0x7f39780cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.451+0000 7f397ea00640 1 -- 172.21.15.29:0/4127211129 >> 172.21.15.29:0/4127211129 conn(0x7f3978069cd0 msgr2=0x7f397806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:56.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.451+0000 7f397ea00640 1 -- 172.21.15.29:0/4127211129 shutdown_connections 2024-01-24T13:04:56.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.451+0000 7f397ea00640 1 -- 172.21.15.29:0/4127211129 wait complete. 2024-01-24T13:04:56.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f397ea00640 1 Processor -- start 2024-01-24T13:04:56.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f397ea00640 1 -- start start 2024-01-24T13:04:56.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f397ea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f39780cd160 0x7f397814d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f397ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f397815e0f0 0x7f397814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f397ea00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f397814d2c0 0x7f39780d0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f397ea00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397814e470 con 0x7f397815e0f0 2024-01-24T13:04:56.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f397ea00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3978150910 con 0x7f39780cd160 2024-01-24T13:04:56.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f397ea00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397814fd00 con 0x7f397814d2c0 2024-01-24T13:04:56.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f3977400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f397815e0f0 0x7f397814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f3977400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f397815e0f0 0x7f397814cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50862/0 (socket says 172.21.15.29:50862) 2024-01-24T13:04:56.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f3977400640 1 -- 172.21.15.29:0/1348954489 learned_addr learned my addr 172.21.15.29:0/1348954489 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:56.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f397ca00640 1 --2- 172.21.15.29:0/1348954489 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f397814d2c0 0x7f39780d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f3977e00640 1 --2- 172.21.15.29:0/1348954489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f39780cd160 0x7f397814d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f3977400640 1 -- 172.21.15.29:0/1348954489 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f397814d2c0 msgr2=0x7f39780d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f3977400640 1 --2- 172.21.15.29:0/1348954489 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f397814d2c0 0x7f39780d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f3977400640 1 -- 172.21.15.29:0/1348954489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f39780cd160 msgr2=0x7f397814d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f3977400640 1 --2- 172.21.15.29:0/1348954489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f39780cd160 0x7f397814d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f3977400640 1 -- 172.21.15.29:0/1348954489 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600094d0 con 0x7f397815e0f0 2024-01-24T13:04:56.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f3977400640 1 --2- 172.21.15.29:0/1348954489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f397815e0f0 0x7f397814cb20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f39600af040 tx=0x7f3960019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:56.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f396fe00640 1 -- 172.21.15.29:0/1348954489 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39600b7850 con 0x7f397815e0f0 2024-01-24T13:04:56.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f396fe00640 1 -- 172.21.15.29:0/1348954489 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39600b79b0 con 0x7f397815e0f0 2024-01-24T13:04:56.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f396fe00640 1 -- 172.21.15.29:0/1348954489 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39600b7d40 con 0x7f397815e0f0 2024-01-24T13:04:56.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.455+0000 7f397ea00640 1 -- 172.21.15.29:0/1348954489 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397814ffe0 con 0x7f397815e0f0 2024-01-24T13:04:56.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.459+0000 7f397ea00640 1 -- 172.21.15.29:0/1348954489 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39781505a0 con 0x7f397815e0f0 2024-01-24T13:04:56.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.459+0000 7f397ea00640 1 -- 172.21.15.29:0/1348954489 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397804e850 con 0x7f397815e0f0 2024-01-24T13:04:56.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.459+0000 7f396fe00640 1 -- 172.21.15.29:0/1348954489 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f39600b3040 con 0x7f397815e0f0 2024-01-24T13:04:56.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.459+0000 7f396fe00640 1 --2- 172.21.15.29:0/1348954489 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3950065a60 0x7f3950067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.459+0000 7f396fe00640 1 -- 172.21.15.29:0/1348954489 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f396011d910 con 0x7f397815e0f0 2024-01-24T13:04:56.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.459+0000 7f3977e00640 1 --2- 172.21.15.29:0/1348954489 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3950065a60 0x7f3950067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.459+0000 7f3977e00640 1 --2- 172.21.15.29:0/1348954489 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3950065a60 0x7f3950067f20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f39781f8800 tx=0x7f3968008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:56.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.463+0000 7f396fe00640 1 -- 172.21.15.29:0/1348954489 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f39600eafa0 con 0x7f397815e0f0 2024-01-24T13:04:56.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.631+0000 7f397ea00640 1 -- 172.21.15.29:0/1348954489 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f397804e850 con 0x7f397815e0f0 2024-01-24T13:04:56.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.631+0000 7f396fe00640 1 -- 172.21.15.29:0/1348954489 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f39600ac600 con 0x7f397815e0f0 2024-01-24T13:04:56.636 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:04:56.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.635+0000 7f397ea00640 1 -- 172.21.15.29:0/1348954489 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3950065a60 msgr2=0x7f3950067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.635+0000 7f397ea00640 1 --2- 172.21.15.29:0/1348954489 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3950065a60 0x7f3950067f20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f39781f8800 tx=0x7f3968008040 comp rx=0 tx=0).stop 2024-01-24T13:04:56.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.635+0000 7f397ea00640 1 -- 172.21.15.29:0/1348954489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f397815e0f0 msgr2=0x7f397814cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.635+0000 7f397ea00640 1 --2- 172.21.15.29:0/1348954489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f397815e0f0 0x7f397814cb20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f39600af040 tx=0x7f3960019260 comp rx=0 tx=0).stop 2024-01-24T13:04:56.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.635+0000 7f397ea00640 1 -- 172.21.15.29:0/1348954489 shutdown_connections 2024-01-24T13:04:56.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.635+0000 7f397ea00640 1 --2- 172.21.15.29:0/1348954489 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3950065a60 0x7f3950067f20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.635+0000 7f397ea00640 1 --2- 172.21.15.29:0/1348954489 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f397814d2c0 0x7f39780d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.635+0000 7f397ea00640 1 --2- 172.21.15.29:0/1348954489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f397815e0f0 0x7f397814cb20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.635+0000 7f397ea00640 1 --2- 172.21.15.29:0/1348954489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f39780cd160 0x7f397814d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.635+0000 7f397ea00640 1 -- 172.21.15.29:0/1348954489 >> 172.21.15.29:0/1348954489 conn(0x7f3978069cd0 msgr2=0x7f39780aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:56.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.635+0000 7f397ea00640 1 -- 172.21.15.29:0/1348954489 shutdown_connections 2024-01-24T13:04:56.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.635+0000 7f397ea00640 1 -- 172.21.15.29:0/1348954489 wait complete. 2024-01-24T13:04:56.658 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:04:56.658 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:04:56.668 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:56.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a56200640 1 Processor -- start 2024-01-24T13:04:56.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a56200640 1 -- start start 2024-01-24T13:04:56.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a56200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a5015a630 0x7f3a500cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a56200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a500c3ef0 0x7f3a500ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a56200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3a500ca9f0 0x7f3a500cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a56200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a500cf380 con 0x7f3a500c3ef0 2024-01-24T13:04:56.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a56200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a500cfe50 con 0x7f3a500ca9f0 2024-01-24T13:04:56.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a56200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500cb3c0 con 0x7f3a5015a630 2024-01-24T13:04:56.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a4ea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a500c3ef0 0x7f3a500ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a4ea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a500c3ef0 0x7f3a500ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50874/0 (socket says 172.21.15.29:50874) 2024-01-24T13:04:56.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a4ea00640 1 -- 172.21.15.29:0/1315702529 learned_addr learned my addr 172.21.15.29:0/1315702529 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:56.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a4ea00640 1 -- 172.21.15.29:0/1315702529 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a5015a630 msgr2=0x7f3a500cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:56.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a4ea00640 1 --2- 172.21.15.29:0/1315702529 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a5015a630 0x7f3a500cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a4ea00640 1 -- 172.21.15.29:0/1315702529 >> v2:172.21.15.163:3300/0 conn(0x7f3a500ca9f0 msgr2=0x7f3a500cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:56.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a4ea00640 1 --2- 172.21.15.29:0/1315702529 >> v2:172.21.15.163:3300/0 conn(0x7f3a500ca9f0 0x7f3a500cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.807+0000 7f3a4ea00640 1 -- 172.21.15.29:0/1315702529 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5015aa10 con 0x7f3a500c3ef0 2024-01-24T13:04:56.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.811+0000 7f3a4ea00640 1 --2- 172.21.15.29:0/1315702529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a500c3ef0 0x7f3a500ce4b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3a500afa90 tx=0x7f3a3801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876a10a8eb31a24c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:56.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.811+0000 7f3a4e000640 1 -- 172.21.15.29:0/1315702529 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a380a6040 con 0x7f3a500c3ef0 2024-01-24T13:04:56.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.811+0000 7f3a4e000640 1 -- 172.21.15.29:0/1315702529 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a380aa600 con 0x7f3a500c3ef0 2024-01-24T13:04:56.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.811+0000 7f3a4e000640 1 -- 172.21.15.29:0/1315702529 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a380aa990 con 0x7f3a500c3ef0 2024-01-24T13:04:56.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.811+0000 7f3a56200640 1 -- 172.21.15.29:0/1315702529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a500c3ef0 msgr2=0x7f3a500ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.811+0000 7f3a56200640 1 --2- 172.21.15.29:0/1315702529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a500c3ef0 0x7f3a500ce4b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3a500afa90 tx=0x7f3a3801c4e0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.811+0000 7f3a56200640 1 -- 172.21.15.29:0/1315702529 shutdown_connections 2024-01-24T13:04:56.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.811+0000 7f3a56200640 1 --2- 172.21.15.29:0/1315702529 >> v2:172.21.15.163:3300/0 conn(0x7f3a500ca9f0 0x7f3a500cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.811+0000 7f3a56200640 1 --2- 172.21.15.29:0/1315702529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a500c3ef0 0x7f3a500ce4b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.811+0000 7f3a56200640 1 --2- 172.21.15.29:0/1315702529 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a5015a630 0x7f3a500cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.811+0000 7f3a56200640 1 -- 172.21.15.29:0/1315702529 >> 172.21.15.29:0/1315702529 conn(0x7f3a50070570 msgr2=0x7f3a50069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:56.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.811+0000 7f3a56200640 1 -- 172.21.15.29:0/1315702529 shutdown_connections 2024-01-24T13:04:56.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.811+0000 7f3a56200640 1 -- 172.21.15.29:0/1315702529 wait complete. 2024-01-24T13:04:56.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a56200640 1 Processor -- start 2024-01-24T13:04:56.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a56200640 1 -- start start 2024-01-24T13:04:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a56200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a500c3ef0 0x7f3a500c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a56200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a500ca9f0 0x7f3a5014f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a56200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a5015a630 0x7f3a50163ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a56200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500c9450 con 0x7f3a5015a630 2024-01-24T13:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a56200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5014fdd0 con 0x7f3a500ca9f0 2024-01-24T13:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a56200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a501502a0 con 0x7f3a500c3ef0 2024-01-24T13:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a4fe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a5015a630 0x7f3a50163ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a4fe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a5015a630 0x7f3a50163ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50886/0 (socket says 172.21.15.29:50886) 2024-01-24T13:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a4fe00640 1 -- 172.21.15.29:0/3826411774 learned_addr learned my addr 172.21.15.29:0/3826411774 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a4ea00640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a500ca9f0 0x7f3a5014f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a4f400640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a500c3ef0 0x7f3a500c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a4fe00640 1 -- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a500c3ef0 msgr2=0x7f3a500c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a4fe00640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a500c3ef0 0x7f3a500c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a4fe00640 1 -- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a500ca9f0 msgr2=0x7f3a5014f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a4fe00640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a500ca9f0 0x7f3a5014f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a4fe00640 1 -- 172.21.15.29:0/3826411774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a380094d0 con 0x7f3a5015a630 2024-01-24T13:04:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a4f400640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a500c3ef0 0x7f3a500c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a4ea00640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a500ca9f0 0x7f3a5014f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:04:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a4fe00640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a5015a630 0x7f3a50163ec0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800b970 tx=0x7f3a4800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a47400640 1 -- 172.21.15.29:0/3826411774 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4800cb40 con 0x7f3a5015a630 2024-01-24T13:04:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a47400640 1 -- 172.21.15.29:0/3826411774 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4800ccc0 con 0x7f3a5015a630 2024-01-24T13:04:56.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a56200640 1 -- 172.21.15.29:0/3826411774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a50164850 con 0x7f3a5015a630 2024-01-24T13:04:56.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a47400640 1 -- 172.21.15.29:0/3826411774 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a48014680 con 0x7f3a5015a630 2024-01-24T13:04:56.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a56200640 1 -- 172.21.15.29:0/3826411774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a50164e10 con 0x7f3a5015a630 2024-01-24T13:04:56.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.815+0000 7f3a56200640 1 -- 172.21.15.29:0/3826411774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5004e850 con 0x7f3a5015a630 2024-01-24T13:04:56.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.819+0000 7f3a47400640 1 -- 172.21.15.29:0/3826411774 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3a4801d3b0 con 0x7f3a5015a630 2024-01-24T13:04:56.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.819+0000 7f3a47400640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a28065a60 0x7f3a28067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:56.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.819+0000 7f3a47400640 1 -- 172.21.15.29:0/3826411774 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f3a48083430 con 0x7f3a5015a630 2024-01-24T13:04:56.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.819+0000 7f3a4f400640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a28065a60 0x7f3a28067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:56.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.819+0000 7f3a4f400640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a28065a60 0x7f3a28067f20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3a40006fd0 tx=0x7f3a40008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:56.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.823+0000 7f3a47400640 1 -- 172.21.15.29:0/3826411774 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3a48050ac0 con 0x7f3a5015a630 2024-01-24T13:04:56.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.979+0000 7f3a56200640 1 -- 172.21.15.29:0/3826411774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a500cae80 con 0x7f3a5015a630 2024-01-24T13:04:56.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.983+0000 7f3a47400640 1 -- 172.21.15.29:0/3826411774 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7f3a480540e0 con 0x7f3a5015a630 2024-01-24T13:04:56.985 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:56.985 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.983+0000 7f3a56200640 1 -- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a28065a60 msgr2=0x7f3a28067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.983+0000 7f3a56200640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a28065a60 0x7f3a28067f20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3a40006fd0 tx=0x7f3a40008040 comp rx=0 tx=0).stop 2024-01-24T13:04:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.983+0000 7f3a56200640 1 -- 172.21.15.29:0/3826411774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a5015a630 msgr2=0x7f3a50163ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.983+0000 7f3a56200640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a5015a630 0x7f3a50163ec0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800b970 tx=0x7f3a4800be30 comp rx=0 tx=0).stop 2024-01-24T13:04:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.983+0000 7f3a56200640 1 -- 172.21.15.29:0/3826411774 shutdown_connections 2024-01-24T13:04:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.983+0000 7f3a56200640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a28065a60 0x7f3a28067f20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.983+0000 7f3a56200640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a5015a630 0x7f3a50163ec0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.983+0000 7f3a56200640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a500ca9f0 0x7f3a5014f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.983+0000 7f3a56200640 1 --2- 172.21.15.29:0/3826411774 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a500c3ef0 0x7f3a500c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.983+0000 7f3a56200640 1 -- 172.21.15.29:0/3826411774 >> 172.21.15.29:0/3826411774 conn(0x7f3a50070570 msgr2=0x7f3a500b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.983+0000 7f3a56200640 1 -- 172.21.15.29:0/3826411774 shutdown_connections 2024-01-24T13:04:56.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:56.983+0000 7f3a56200640 1 -- 172.21.15.29:0/3826411774 wait complete. 2024-01-24T13:04:57.007 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:04:57.008 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:04:57.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.147+0000 7f85d6e00640 1 Processor -- start 2024-01-24T13:04:57.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.147+0000 7f85d6e00640 1 -- start start 2024-01-24T13:04:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85d6e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85d0158ca0 0x7f85d00b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85d6e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f85d0070560 0x7f85d006c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85d6e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d006c560 con 0x7f85d006bbc0 2024-01-24T13:04:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85d6e00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d0159080 con 0x7f85d0070560 2024-01-24T13:04:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85d6e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d0070ba0 con 0x7f85d0158ca0 2024-01-24T13:04:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85d4e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f85d0070560 0x7f85d006c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85cf400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f85d006bbc0 0x7f85d006fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37124/0 (socket says 172.21.15.29:37124) 2024-01-24T13:04:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85cf400640 1 -- 172.21.15.29:0/275272543 learned_addr learned my addr 172.21.15.29:0/275272543 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85d4e00640 1 -- 172.21.15.29:0/275272543 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85d0158ca0 msgr2=0x7f85d00b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85cfe00640 1 --2- 172.21.15.29:0/275272543 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85d0158ca0 0x7f85d00b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85d4e00640 1 --2- 172.21.15.29:0/275272543 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85d0158ca0 0x7f85d00b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85d4e00640 1 -- 172.21.15.29:0/275272543 >> v1:172.21.15.29:6789/0 conn(0x7f85d006bbc0 legacy=0x7f85d006fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85cea00640 1 -- 172.21.15.29:0/275272543 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003600426 0 0) 0x7f85d006c560 con 0x7f85d006bbc0 2024-01-24T13:04:57.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85d4e00640 1 -- 172.21.15.29:0/275272543 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d00b18c0 con 0x7f85d0070560 2024-01-24T13:04:57.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.151+0000 7f85cfe00640 1 --2- 172.21.15.29:0/275272543 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85d0158ca0 0x7f85d00b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:57.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.155+0000 7f85d4e00640 1 --2- 172.21.15.29:0/275272543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85d0070560 0x7f85d006c020 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f85c800bfa0 tx=0x7f85c801eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c12b26d0f06f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:57.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.155+0000 7f85cea00640 1 -- 172.21.15.29:0/275272543 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c80a7a90 con 0x7f85d0070560 2024-01-24T13:04:57.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.155+0000 7f85cea00640 1 -- 172.21.15.29:0/275272543 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c80ab070 con 0x7f85d0070560 2024-01-24T13:04:57.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.155+0000 7f85cea00640 1 -- 172.21.15.29:0/275272543 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c80a7e10 con 0x7f85d0070560 2024-01-24T13:04:57.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.155+0000 7f85d6e00640 1 -- 172.21.15.29:0/275272543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85d0070560 msgr2=0x7f85d006c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.155+0000 7f85d6e00640 1 --2- 172.21.15.29:0/275272543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85d0070560 0x7f85d006c020 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f85c800bfa0 tx=0x7f85c801eb50 comp rx=0 tx=0).stop 2024-01-24T13:04:57.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.155+0000 7f85d6e00640 1 -- 172.21.15.29:0/275272543 shutdown_connections 2024-01-24T13:04:57.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.155+0000 7f85d6e00640 1 --2- 172.21.15.29:0/275272543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85d0070560 0x7f85d006c020 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.155+0000 7f85d6e00640 1 --2- 172.21.15.29:0/275272543 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85d0158ca0 0x7f85d00b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.155+0000 7f85d6e00640 1 -- 172.21.15.29:0/275272543 >> 172.21.15.29:0/275272543 conn(0x7f85d006d700 msgr2=0x7f85d0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:57.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.155+0000 7f85d6e00640 1 -- 172.21.15.29:0/275272543 shutdown_connections 2024-01-24T13:04:57.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.155+0000 7f85d6e00640 1 -- 172.21.15.29:0/275272543 wait complete. 2024-01-24T13:04:57.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.155+0000 7f85d6e00640 1 Processor -- start 2024-01-24T13:04:57.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.155+0000 7f85d6e00640 1 -- start start 2024-01-24T13:04:57.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85d6e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85d006bbc0 0x7f85d0153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85d6e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85d0070560 0x7f85d014e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85d6e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85d0158ca0 0x7f85d013cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85d6e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d014e690 con 0x7f85d0070560 2024-01-24T13:04:57.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85d6e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d0152f30 con 0x7f85d0158ca0 2024-01-24T13:04:57.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85d6e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d0153210 con 0x7f85d006bbc0 2024-01-24T13:04:57.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85cf400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85d0070560 0x7f85d014e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85cf400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85d0070560 0x7f85d014e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50902/0 (socket says 172.21.15.29:50902) 2024-01-24T13:04:57.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85cf400640 1 -- 172.21.15.29:0/4222997879 learned_addr learned my addr 172.21.15.29:0/4222997879 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:57.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85cfe00640 1 --2- 172.21.15.29:0/4222997879 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85d006bbc0 0x7f85d0153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85d4e00640 1 --2- 172.21.15.29:0/4222997879 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85d0158ca0 0x7f85d013cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85cf400640 1 -- 172.21.15.29:0/4222997879 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85d006bbc0 msgr2=0x7f85d0153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85cf400640 1 --2- 172.21.15.29:0/4222997879 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85d006bbc0 0x7f85d0153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85cf400640 1 -- 172.21.15.29:0/4222997879 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85d0158ca0 msgr2=0x7f85d013cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85cf400640 1 --2- 172.21.15.29:0/4222997879 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85d0158ca0 0x7f85d013cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85cf400640 1 -- 172.21.15.29:0/4222997879 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c800bc80 con 0x7f85d0070560 2024-01-24T13:04:57.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85cf400640 1 --2- 172.21.15.29:0/4222997879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85d0070560 0x7f85d014e000 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f85b80011f0 tx=0x7f85b800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:57.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85c7e00640 1 -- 172.21.15.29:0/4222997879 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b80074e0 con 0x7f85d0070560 2024-01-24T13:04:57.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85c7e00640 1 -- 172.21.15.29:0/4222997879 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b8007640 con 0x7f85d0070560 2024-01-24T13:04:57.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85c7e00640 1 -- 172.21.15.29:0/4222997879 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b8004a10 con 0x7f85d0070560 2024-01-24T13:04:57.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85d6e00640 1 -- 172.21.15.29:0/4222997879 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d01534f0 con 0x7f85d0070560 2024-01-24T13:04:57.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85d6e00640 1 -- 172.21.15.29:0/4222997879 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d0149200 con 0x7f85d0070560 2024-01-24T13:04:57.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85d6e00640 1 -- 172.21.15.29:0/4222997879 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d004e850 con 0x7f85d0070560 2024-01-24T13:04:57.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.159+0000 7f85c7e00640 1 -- 172.21.15.29:0/4222997879 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f85b8004b70 con 0x7f85d0070560 2024-01-24T13:04:57.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.163+0000 7f85c7e00640 1 --2- 172.21.15.29:0/4222997879 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f85a8065a60 0x7f85a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.163+0000 7f85c7e00640 1 -- 172.21.15.29:0/4222997879 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f85b8082780 con 0x7f85d0070560 2024-01-24T13:04:57.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.163+0000 7f85cfe00640 1 --2- 172.21.15.29:0/4222997879 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f85a8065a60 0x7f85a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.163+0000 7f85cfe00640 1 --2- 172.21.15.29:0/4222997879 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f85a8065a60 0x7f85a8067f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f85c0006fd0 tx=0x7f85c0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:57.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.167+0000 7f85c7e00640 1 -- 172.21.15.29:0/4222997879 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f85b804fe20 con 0x7f85d0070560 2024-01-24T13:04:57.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.323+0000 7f85d6e00640 1 -- 172.21.15.29:0/4222997879 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85d0151ad0 con 0x7f85d0070560 2024-01-24T13:04:57.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.323+0000 7f85c7e00640 1 -- 172.21.15.29:0/4222997879 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85b80180a0 con 0x7f85d0070560 2024-01-24T13:04:57.328 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:04:57.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.327+0000 7f85d6e00640 1 -- 172.21.15.29:0/4222997879 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f85a8065a60 msgr2=0x7f85a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.327+0000 7f85d6e00640 1 --2- 172.21.15.29:0/4222997879 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f85a8065a60 0x7f85a8067f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f85c0006fd0 tx=0x7f85c0008040 comp rx=0 tx=0).stop 2024-01-24T13:04:57.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.327+0000 7f85d6e00640 1 -- 172.21.15.29:0/4222997879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85d0070560 msgr2=0x7f85d014e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.327+0000 7f85d6e00640 1 --2- 172.21.15.29:0/4222997879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85d0070560 0x7f85d014e000 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f85b80011f0 tx=0x7f85b800c9b0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.327+0000 7f85d6e00640 1 -- 172.21.15.29:0/4222997879 shutdown_connections 2024-01-24T13:04:57.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.327+0000 7f85d6e00640 1 --2- 172.21.15.29:0/4222997879 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f85a8065a60 0x7f85a8067f20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.327+0000 7f85d6e00640 1 --2- 172.21.15.29:0/4222997879 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85d0158ca0 0x7f85d013cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.327+0000 7f85d6e00640 1 --2- 172.21.15.29:0/4222997879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85d0070560 0x7f85d014e000 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.327+0000 7f85d6e00640 1 --2- 172.21.15.29:0/4222997879 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85d006bbc0 0x7f85d0153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.327+0000 7f85d6e00640 1 -- 172.21.15.29:0/4222997879 >> 172.21.15.29:0/4222997879 conn(0x7f85d006d700 msgr2=0x7f85d006fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:57.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.327+0000 7f85d6e00640 1 -- 172.21.15.29:0/4222997879 shutdown_connections 2024-01-24T13:04:57.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.327+0000 7f85d6e00640 1 -- 172.21.15.29:0/4222997879 wait complete. 2024-01-24T13:04:57.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:04:57.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1ff200640 1 Processor -- start 2024-01-24T13:04:57.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1ff200640 1 -- start start 2024-01-24T13:04:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1ff200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff1f806c860 0x7ff1f806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1ff200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff1f8142980 0x7ff1f80cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1ff200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f806b320 con 0x7ff1f80cd350 2024-01-24T13:04:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1ff200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f80cd7e0 con 0x7ff1f806c860 2024-01-24T13:04:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1ff200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f81611b0 con 0x7ff1f8142980 2024-01-24T13:04:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1f7e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff1f806c860 0x7ff1f806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1f7e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff1f806c860 0x7ff1f806ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50910/0 (socket says 172.21.15.29:50910) 2024-01-24T13:04:57.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1fd200640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff1f80cd350 0x7ff1f815d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37132/0 (socket says 172.21.15.29:37132) 2024-01-24T13:04:57.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1f7e00640 1 -- 172.21.15.29:0/178287631 learned_addr learned my addr 172.21.15.29:0/178287631 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:57.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1f7400640 1 --2- 172.21.15.29:0/178287631 >> v2:172.21.15.163:3300/0 conn(0x7ff1f8142980 0x7ff1f80cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1f7e00640 1 -- 172.21.15.29:0/178287631 >> v2:172.21.15.163:3300/0 conn(0x7ff1f8142980 msgr2=0x7ff1f80cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:57.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1f7e00640 1 --2- 172.21.15.29:0/178287631 >> v2:172.21.15.163:3300/0 conn(0x7ff1f8142980 0x7ff1f80cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1f7e00640 1 -- 172.21.15.29:0/178287631 >> v1:172.21.15.29:6789/0 conn(0x7ff1f80cd350 legacy=0x7ff1f815d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.491+0000 7ff1f7e00640 1 -- 172.21.15.29:0/178287631 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f8160630 con 0x7ff1f806c860 2024-01-24T13:04:57.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.495+0000 7ff1f7e00640 1 --2- 172.21.15.29:0/178287631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1f806c860 0x7ff1f806ade0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff1f80b1fb0 tx=0x7ff1e801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f41e4fd21719f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:57.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.495+0000 7ff1f6a00640 1 -- 172.21.15.29:0/178287631 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e80aa430 con 0x7ff1f806c860 2024-01-24T13:04:57.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.495+0000 7ff1f6a00640 1 -- 172.21.15.29:0/178287631 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e80aa590 con 0x7ff1f806c860 2024-01-24T13:04:57.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.495+0000 7ff1f6a00640 1 -- 172.21.15.29:0/178287631 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e80aa920 con 0x7ff1f806c860 2024-01-24T13:04:57.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.495+0000 7ff1ff200640 1 -- 172.21.15.29:0/178287631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1f806c860 msgr2=0x7ff1f806ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.495+0000 7ff1ff200640 1 --2- 172.21.15.29:0/178287631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1f806c860 0x7ff1f806ade0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff1f80b1fb0 tx=0x7ff1e801c4d0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.495+0000 7ff1ff200640 1 -- 172.21.15.29:0/178287631 shutdown_connections 2024-01-24T13:04:57.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.495+0000 7ff1ff200640 1 --2- 172.21.15.29:0/178287631 >> v2:172.21.15.163:3300/0 conn(0x7ff1f8142980 0x7ff1f80cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.495+0000 7ff1ff200640 1 --2- 172.21.15.29:0/178287631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1f806c860 0x7ff1f806ade0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.495+0000 7ff1ff200640 1 -- 172.21.15.29:0/178287631 >> 172.21.15.29:0/178287631 conn(0x7ff1f8069cd0 msgr2=0x7ff1f806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:57.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.495+0000 7ff1ff200640 1 -- 172.21.15.29:0/178287631 shutdown_connections 2024-01-24T13:04:57.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.495+0000 7ff1ff200640 1 -- 172.21.15.29:0/178287631 wait complete. 2024-01-24T13:04:57.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1ff200640 1 Processor -- start 2024-01-24T13:04:57.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1ff200640 1 -- start start 2024-01-24T13:04:57.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1ff200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1f806c860 0x7ff1f80b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1ff200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1f80cd350 0x7ff1f80b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1ff200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1f8142980 0x7ff1f80c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1ff200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f80b54e0 con 0x7ff1f8142980 2024-01-24T13:04:57.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1ff200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f80b4c10 con 0x7ff1f80cd350 2024-01-24T13:04:57.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1ff200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f80c5420 con 0x7ff1f806c860 2024-01-24T13:04:57.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1fd200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1f8142980 0x7ff1f80c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1fd200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1f8142980 0x7ff1f80c5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50926/0 (socket says 172.21.15.29:50926) 2024-01-24T13:04:57.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1fd200640 1 -- 172.21.15.29:0/2286417884 learned_addr learned my addr 172.21.15.29:0/2286417884 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:57.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1f7e00640 1 --2- 172.21.15.29:0/2286417884 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1f806c860 0x7ff1f80b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1f7400640 1 --2- 172.21.15.29:0/2286417884 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1f80cd350 0x7ff1f80b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1fd200640 1 -- 172.21.15.29:0/2286417884 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1f806c860 msgr2=0x7ff1f80b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1fd200640 1 --2- 172.21.15.29:0/2286417884 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1f806c860 0x7ff1f80b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1fd200640 1 -- 172.21.15.29:0/2286417884 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1f80cd350 msgr2=0x7ff1f80b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1fd200640 1 --2- 172.21.15.29:0/2286417884 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1f80cd350 0x7ff1f80b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1fd200640 1 -- 172.21.15.29:0/2286417884 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e80094d0 con 0x7ff1f8142980 2024-01-24T13:04:57.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1fd200640 1 --2- 172.21.15.29:0/2286417884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1f8142980 0x7ff1f80c5f00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000c7a0 tx=0x7ff1f000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:57.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1efe00640 1 -- 172.21.15.29:0/2286417884 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f000a640 con 0x7ff1f8142980 2024-01-24T13:04:57.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1efe00640 1 -- 172.21.15.29:0/2286417884 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f000a7a0 con 0x7ff1f8142980 2024-01-24T13:04:57.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1ff200640 1 -- 172.21.15.29:0/2286417884 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f80c5700 con 0x7ff1f8142980 2024-01-24T13:04:57.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1efe00640 1 -- 172.21.15.29:0/2286417884 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f000ab10 con 0x7ff1f8142980 2024-01-24T13:04:57.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.499+0000 7ff1ff200640 1 -- 172.21.15.29:0/2286417884 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f80c6440 con 0x7ff1f8142980 2024-01-24T13:04:57.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.503+0000 7ff1ff200640 1 -- 172.21.15.29:0/2286417884 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f804e850 con 0x7ff1f8142980 2024-01-24T13:04:57.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.503+0000 7ff1efe00640 1 -- 172.21.15.29:0/2286417884 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff1f000ac70 con 0x7ff1f8142980 2024-01-24T13:04:57.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.503+0000 7ff1efe00640 1 --2- 172.21.15.29:0/2286417884 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff1d0065a60 0x7ff1d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.503+0000 7ff1efe00640 1 -- 172.21.15.29:0/2286417884 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff1f0082cc0 con 0x7ff1f8142980 2024-01-24T13:04:57.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.503+0000 7ff1f7e00640 1 --2- 172.21.15.29:0/2286417884 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff1d0065a60 0x7ff1d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.503+0000 7ff1f7e00640 1 --2- 172.21.15.29:0/2286417884 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff1d0065a60 0x7ff1d0067f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80ae000 tx=0x7ff1e80b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:57.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.507+0000 7ff1efe00640 1 -- 172.21.15.29:0/2286417884 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff1f0089080 con 0x7ff1f8142980 2024-01-24T13:04:57.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.667+0000 7ff1ff200640 1 -- 172.21.15.29:0/2286417884 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff1f80ce240 con 0x7ff1f8142980 2024-01-24T13:04:57.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.667+0000 7ff1efe00640 1 -- 172.21.15.29:0/2286417884 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff1f00170a0 con 0x7ff1f8142980 2024-01-24T13:04:57.671 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.671+0000 7ff1ff200640 1 -- 172.21.15.29:0/2286417884 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff1d0065a60 msgr2=0x7ff1d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.671+0000 7ff1ff200640 1 --2- 172.21.15.29:0/2286417884 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff1d0065a60 0x7ff1d0067f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80ae000 tx=0x7ff1e80b5040 comp rx=0 tx=0).stop 2024-01-24T13:04:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.671+0000 7ff1ff200640 1 -- 172.21.15.29:0/2286417884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1f8142980 msgr2=0x7ff1f80c5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.671+0000 7ff1ff200640 1 --2- 172.21.15.29:0/2286417884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1f8142980 0x7ff1f80c5f00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000c7a0 tx=0x7ff1f000cc60 comp rx=0 tx=0).stop 2024-01-24T13:04:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.671+0000 7ff1ff200640 1 -- 172.21.15.29:0/2286417884 shutdown_connections 2024-01-24T13:04:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.671+0000 7ff1ff200640 1 --2- 172.21.15.29:0/2286417884 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff1d0065a60 0x7ff1d0067f20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.671+0000 7ff1ff200640 1 --2- 172.21.15.29:0/2286417884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1f8142980 0x7ff1f80c5f00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.671+0000 7ff1ff200640 1 --2- 172.21.15.29:0/2286417884 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1f80cd350 0x7ff1f80b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.671+0000 7ff1ff200640 1 --2- 172.21.15.29:0/2286417884 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1f806c860 0x7ff1f80b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.671+0000 7ff1ff200640 1 -- 172.21.15.29:0/2286417884 >> 172.21.15.29:0/2286417884 conn(0x7ff1f8069cd0 msgr2=0x7ff1f80ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:57.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.671+0000 7ff1ff200640 1 -- 172.21.15.29:0/2286417884 shutdown_connections 2024-01-24T13:04:57.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.671+0000 7ff1ff200640 1 -- 172.21.15.29:0/2286417884 wait complete. 2024-01-24T13:04:57.694 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:04:57.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.835+0000 7febee400640 1 Processor -- start 2024-01-24T13:04:57.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.835+0000 7febee400640 1 -- start start 2024-01-24T13:04:57.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.835+0000 7febee400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febe8142980 0x7febe80cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.835+0000 7febee400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7febe80cd350 0x7febe815d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.835+0000 7febee400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe80cd7e0 con 0x7febe806c860 2024-01-24T13:04:57.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.835+0000 7febee400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe81611b0 con 0x7febe80cd350 2024-01-24T13:04:57.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.835+0000 7febee400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe8160630 con 0x7febe8142980 2024-01-24T13:04:57.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.835+0000 7febe7e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7febe80cd350 0x7febe815d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.839+0000 7febe7e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7febe80cd350 0x7febe815d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50934/0 (socket says 172.21.15.29:50934) 2024-01-24T13:04:57.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.839+0000 7febe7e00640 1 -- 172.21.15.29:0/745691133 learned_addr learned my addr 172.21.15.29:0/745691133 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:57.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.839+0000 7febe6a00640 1 --2- 172.21.15.29:0/745691133 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febe8142980 0x7febe80cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.839+0000 7febe7e00640 1 -- 172.21.15.29:0/745691133 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febe8142980 msgr2=0x7febe80cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:57.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.839+0000 7febe7e00640 1 --2- 172.21.15.29:0/745691133 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febe8142980 0x7febe80cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.839+0000 7febe7e00640 1 -- 172.21.15.29:0/745691133 >> v1:172.21.15.163:6789/0 conn(0x7febe806c860 legacy=0x7febe806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.839+0000 7febe7e00640 1 -- 172.21.15.29:0/745691133 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8160910 con 0x7febe80cd350 2024-01-24T13:04:57.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.839+0000 7febe7e00640 1 --2- 172.21.15.29:0/745691133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febe80cd350 0x7febe815d080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7febe0009e50 tx=0x7febe001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c6703e24cde7d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:57.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.839+0000 7febe6000640 1 -- 172.21.15.29:0/745691133 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00a58a0 con 0x7febe80cd350 2024-01-24T13:04:57.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.839+0000 7febe6000640 1 -- 172.21.15.29:0/745691133 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe00a5a00 con 0x7febe80cd350 2024-01-24T13:04:57.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.839+0000 7febe6000640 1 -- 172.21.15.29:0/745691133 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00a5d90 con 0x7febe80cd350 2024-01-24T13:04:57.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 -- 172.21.15.29:0/745691133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febe80cd350 msgr2=0x7febe815d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 --2- 172.21.15.29:0/745691133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febe80cd350 0x7febe815d080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7febe0009e50 tx=0x7febe001c9e0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 -- 172.21.15.29:0/745691133 shutdown_connections 2024-01-24T13:04:57.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 --2- 172.21.15.29:0/745691133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febe80cd350 0x7febe815d080 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 --2- 172.21.15.29:0/745691133 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febe8142980 0x7febe80cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 -- 172.21.15.29:0/745691133 >> 172.21.15.29:0/745691133 conn(0x7febe8069cd0 msgr2=0x7febe806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:57.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 -- 172.21.15.29:0/745691133 shutdown_connections 2024-01-24T13:04:57.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 -- 172.21.15.29:0/745691133 wait complete. 2024-01-24T13:04:57.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 Processor -- start 2024-01-24T13:04:57.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 -- start start 2024-01-24T13:04:57.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febe806c860 0x7febe80b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febe80cd350 0x7febe80c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febe8142980 0x7febe8156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe8156190 con 0x7febe80cd350 2024-01-24T13:04:57.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe80b5d10 con 0x7febe8142980 2024-01-24T13:04:57.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febee400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe80b4c70 con 0x7febe806c860 2024-01-24T13:04:57.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febe6a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febe80cd350 0x7febe80c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febe6a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febe80cd350 0x7febe80c5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50946/0 (socket says 172.21.15.29:50946) 2024-01-24T13:04:57.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febe6a00640 1 -- 172.21.15.29:0/3933835151 learned_addr learned my addr 172.21.15.29:0/3933835151 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:57.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febe7400640 1 --2- 172.21.15.29:0/3933835151 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febe806c860 0x7febe80b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febe6a00640 1 -- 172.21.15.29:0/3933835151 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febe806c860 msgr2=0x7febe80b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febe6a00640 1 --2- 172.21.15.29:0/3933835151 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febe806c860 0x7febe80b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febe6a00640 1 -- 172.21.15.29:0/3933835151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febe8142980 msgr2=0x7febe8156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:57.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febe6a00640 1 --2- 172.21.15.29:0/3933835151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febe8142980 0x7febe8156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:57.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.843+0000 7febe6a00640 1 -- 172.21.15.29:0/3933835151 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe0009b30 con 0x7febe80cd350 2024-01-24T13:04:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.847+0000 7febe6a00640 1 --2- 172.21.15.29:0/3933835151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febe80cd350 0x7febe80c5e70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7febd000d620 tx=0x7febd000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.847+0000 7febdf400640 1 -- 172.21.15.29:0/3933835151 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd000b620 con 0x7febe80cd350 2024-01-24T13:04:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.847+0000 7febdf400640 1 -- 172.21.15.29:0/3933835151 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd000b780 con 0x7febe80cd350 2024-01-24T13:04:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.847+0000 7febee400640 1 -- 172.21.15.29:0/3933835151 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe80b4f50 con 0x7febe80cd350 2024-01-24T13:04:57.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.847+0000 7febdf400640 1 -- 172.21.15.29:0/3933835151 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd000bb10 con 0x7febe80cd350 2024-01-24T13:04:57.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.847+0000 7febee400640 1 -- 172.21.15.29:0/3933835151 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe80b5510 con 0x7febe80cd350 2024-01-24T13:04:57.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.847+0000 7febee400640 1 -- 172.21.15.29:0/3933835151 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe804e850 con 0x7febe80cd350 2024-01-24T13:04:57.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.847+0000 7febdf400640 1 -- 172.21.15.29:0/3933835151 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7febd000bc70 con 0x7febe80cd350 2024-01-24T13:04:57.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.847+0000 7febdf400640 1 --2- 172.21.15.29:0/3933835151 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7febc0065a60 0x7febc0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:57.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.847+0000 7febdf400640 1 -- 172.21.15.29:0/3933835151 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7febd00839a0 con 0x7febe80cd350 2024-01-24T13:04:57.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.847+0000 7febe7400640 1 --2- 172.21.15.29:0/3933835151 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7febc0065a60 0x7febc0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:57.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.851+0000 7febe7400640 1 --2- 172.21.15.29:0/3933835151 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7febc0065a60 0x7febc0067f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7febe80c6920 tx=0x7febd8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:57.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:57.851+0000 7febdf400640 1 -- 172.21.15.29:0/3933835151 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7febd0050f90 con 0x7febe80cd350 2024-01-24T13:04:58.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.007+0000 7febee400640 1 -- 172.21.15.29:0/3933835151 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7febe80b2930 con 0x7febe80cd350 2024-01-24T13:04:58.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.011+0000 7febdf400640 1 -- 172.21.15.29:0/3933835151 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7febd0007380 con 0x7febe80cd350 2024-01-24T13:04:58.013 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:04:58.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.011+0000 7febee400640 1 -- 172.21.15.29:0/3933835151 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7febc0065a60 msgr2=0x7febc0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:58.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.011+0000 7febee400640 1 --2- 172.21.15.29:0/3933835151 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7febc0065a60 0x7febc0067f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7febe80c6920 tx=0x7febd8009040 comp rx=0 tx=0).stop 2024-01-24T13:04:58.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.011+0000 7febee400640 1 -- 172.21.15.29:0/3933835151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febe80cd350 msgr2=0x7febe80c5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:58.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.011+0000 7febee400640 1 --2- 172.21.15.29:0/3933835151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febe80cd350 0x7febe80c5e70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7febd000d620 tx=0x7febd000dae0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.011+0000 7febee400640 1 -- 172.21.15.29:0/3933835151 shutdown_connections 2024-01-24T13:04:58.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.011+0000 7febee400640 1 --2- 172.21.15.29:0/3933835151 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7febc0065a60 0x7febc0067f20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.011+0000 7febee400640 1 --2- 172.21.15.29:0/3933835151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febe8142980 0x7febe8156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.011+0000 7febee400640 1 --2- 172.21.15.29:0/3933835151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febe80cd350 0x7febe80c5e70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.011+0000 7febee400640 1 --2- 172.21.15.29:0/3933835151 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7febe806c860 0x7febe80b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.011+0000 7febee400640 1 -- 172.21.15.29:0/3933835151 >> 172.21.15.29:0/3933835151 conn(0x7febe8069cd0 msgr2=0x7febe815f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:58.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.011+0000 7febee400640 1 -- 172.21.15.29:0/3933835151 shutdown_connections 2024-01-24T13:04:58.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.011+0000 7febee400640 1 -- 172.21.15.29:0/3933835151 wait complete. 2024-01-24T13:04:58.035 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:04:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5289600640 1 Processor -- start 2024-01-24T13:04:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5289600640 1 -- start start 2024-01-24T13:04:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5289600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f528406be20 0x7f528415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5289600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f528406c200 0x7f528415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5289600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528415b4f0 con 0x7f528413cda0 2024-01-24T13:04:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5289600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528415b7d0 con 0x7f528406be20 2024-01-24T13:04:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5289600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52840cd0c0 con 0x7f528406c200 2024-01-24T13:04:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5282000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f528406c200 0x7f528415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5282a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f528406be20 0x7f528415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5282000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f528406c200 0x7f528415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:50188/0 (socket says 172.21.15.29:50188) 2024-01-24T13:04:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5282a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f528406be20 0x7f528415a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:39068/0 (socket says 172.21.15.29:39068) 2024-01-24T13:04:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5282000640 1 -- 172.21.15.29:0/3425296208 learned_addr learned my addr 172.21.15.29:0/3425296208 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5283400640 1 --1- 172.21.15.29:0/3425296208 >> v1:172.21.15.163:6789/0 conn(0x7f528413cda0 0x7f528413d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:43366/0 (socket says 172.21.15.29:43366) 2024-01-24T13:04:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5282000640 1 -- 172.21.15.29:0/3425296208 >> v2:172.21.15.163:3300/0 conn(0x7f528406be20 msgr2=0x7f528415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5282000640 1 --2- 172.21.15.29:0/3425296208 >> v2:172.21.15.163:3300/0 conn(0x7f528406be20 0x7f528415a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5282000640 1 -- 172.21.15.29:0/3425296208 >> v1:172.21.15.163:6789/0 conn(0x7f528413cda0 legacy=0x7f528413d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:58.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.175+0000 7f5282000640 1 -- 172.21.15.29:0/3425296208 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52840cd3a0 con 0x7f528406c200 2024-01-24T13:04:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.179+0000 7f5282000640 1 --2- 172.21.15.29:0/3425296208 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f528406c200 0x7f528415af00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f526c009870 tx=0x7f526c01c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccc434609787e7ec server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.179+0000 7f5281600640 1 -- 172.21.15.29:0/3425296208 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0a9620 con 0x7f528406c200 2024-01-24T13:04:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.179+0000 7f5281600640 1 -- 172.21.15.29:0/3425296208 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0a9780 con 0x7f528406c200 2024-01-24T13:04:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.179+0000 7f5281600640 1 -- 172.21.15.29:0/3425296208 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0a9b10 con 0x7f528406c200 2024-01-24T13:04:58.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.179+0000 7f5289600640 1 -- 172.21.15.29:0/3425296208 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f528406c200 msgr2=0x7f528415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:58.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.179+0000 7f5289600640 1 --2- 172.21.15.29:0/3425296208 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f528406c200 0x7f528415af00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f526c009870 tx=0x7f526c01c500 comp rx=0 tx=0).stop 2024-01-24T13:04:58.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.179+0000 7f5289600640 1 -- 172.21.15.29:0/3425296208 shutdown_connections 2024-01-24T13:04:58.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.179+0000 7f5289600640 1 --2- 172.21.15.29:0/3425296208 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f528406c200 0x7f528415af00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.179+0000 7f5289600640 1 --2- 172.21.15.29:0/3425296208 >> v2:172.21.15.163:3300/0 conn(0x7f528406be20 0x7f528415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.179+0000 7f5289600640 1 -- 172.21.15.29:0/3425296208 >> 172.21.15.29:0/3425296208 conn(0x7f528406d700 msgr2=0x7f5284069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:58.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5289600640 1 -- 172.21.15.29:0/3425296208 shutdown_connections 2024-01-24T13:04:58.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5289600640 1 -- 172.21.15.29:0/3425296208 wait complete. 2024-01-24T13:04:58.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5289600640 1 Processor -- start 2024-01-24T13:04:58.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5289600640 1 -- start start 2024-01-24T13:04:58.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5289600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f528406be20 0x7f5284138ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:58.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5289600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f528406c200 0x7f5284070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:58.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5289600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f528413cda0 0x7f5284071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:58.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5289600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5284152fb0 con 0x7f528413cda0 2024-01-24T13:04:58.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5289600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52841f5940 con 0x7f528406be20 2024-01-24T13:04:58.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5289600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5284153200 con 0x7f528406c200 2024-01-24T13:04:58.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5283400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f528413cda0 0x7f5284071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:58.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5283400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f528413cda0 0x7f5284071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50956/0 (socket says 172.21.15.29:50956) 2024-01-24T13:04:58.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5283400640 1 -- 172.21.15.29:0/135356765 learned_addr learned my addr 172.21.15.29:0/135356765 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:58.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5282a00640 1 --2- 172.21.15.29:0/135356765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f528406be20 0x7f5284138ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:58.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5282000640 1 --2- 172.21.15.29:0/135356765 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f528406c200 0x7f5284070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:58.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5283400640 1 -- 172.21.15.29:0/135356765 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f528406c200 msgr2=0x7f5284070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:58.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5283400640 1 --2- 172.21.15.29:0/135356765 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f528406c200 0x7f5284070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5283400640 1 -- 172.21.15.29:0/135356765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f528406be20 msgr2=0x7f5284138ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:58.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5283400640 1 --2- 172.21.15.29:0/135356765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f528406be20 0x7f5284138ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5283400640 1 -- 172.21.15.29:0/135356765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c0094d0 con 0x7f528413cda0 2024-01-24T13:04:58.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f5283400640 1 --2- 172.21.15.29:0/135356765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f528413cda0 0x7f5284071380 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c700 tx=0x7f527c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:58.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.183+0000 7f527aa00640 1 -- 172.21.15.29:0/135356765 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c00ce10 con 0x7f528413cda0 2024-01-24T13:04:58.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.187+0000 7f527aa00640 1 -- 172.21.15.29:0/135356765 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c00a640 con 0x7f528413cda0 2024-01-24T13:04:58.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.187+0000 7f527aa00640 1 -- 172.21.15.29:0/135356765 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c00a9b0 con 0x7f528413cda0 2024-01-24T13:04:58.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.187+0000 7f5289600640 1 -- 172.21.15.29:0/135356765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52841534e0 con 0x7f528413cda0 2024-01-24T13:04:58.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.187+0000 7f5289600640 1 -- 172.21.15.29:0/135356765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52841390e0 con 0x7f528413cda0 2024-01-24T13:04:58.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.187+0000 7f5289600640 1 -- 172.21.15.29:0/135356765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528404e850 con 0x7f528413cda0 2024-01-24T13:04:58.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.187+0000 7f527aa00640 1 -- 172.21.15.29:0/135356765 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f527c00ab10 con 0x7f528413cda0 2024-01-24T13:04:58.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.187+0000 7f527aa00640 1 --2- 172.21.15.29:0/135356765 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f525c065a60 0x7f525c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:58.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.187+0000 7f527aa00640 1 -- 172.21.15.29:0/135356765 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f527c082c40 con 0x7f528413cda0 2024-01-24T13:04:58.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.187+0000 7f5282a00640 1 --2- 172.21.15.29:0/135356765 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f525c065a60 0x7f525c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:58.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.191+0000 7f5282a00640 1 --2- 172.21.15.29:0/135356765 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f525c065a60 0x7f525c067f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5284070dd0 tx=0x7f5274009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:58.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.191+0000 7f527aa00640 1 -- 172.21.15.29:0/135356765 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f527c0502f0 con 0x7f528413cda0 2024-01-24T13:04:58.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.347+0000 7f5289600640 1 -- 172.21.15.29:0/135356765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5284150da0 con 0x7f528413cda0 2024-01-24T13:04:58.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.347+0000 7f527aa00640 1 -- 172.21.15.29:0/135356765 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f527c0170a0 con 0x7f528413cda0 2024-01-24T13:04:58.351 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:58.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.347+0000 7f5289600640 1 -- 172.21.15.29:0/135356765 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f525c065a60 msgr2=0x7f525c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:58.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.347+0000 7f5289600640 1 --2- 172.21.15.29:0/135356765 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f525c065a60 0x7f525c067f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5284070dd0 tx=0x7f5274009190 comp rx=0 tx=0).stop 2024-01-24T13:04:58.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.347+0000 7f5289600640 1 -- 172.21.15.29:0/135356765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f528413cda0 msgr2=0x7f5284071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:58.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.347+0000 7f5289600640 1 --2- 172.21.15.29:0/135356765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f528413cda0 0x7f5284071380 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c700 tx=0x7f527c00cbc0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.351+0000 7f5289600640 1 -- 172.21.15.29:0/135356765 shutdown_connections 2024-01-24T13:04:58.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.351+0000 7f5289600640 1 --2- 172.21.15.29:0/135356765 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f525c065a60 0x7f525c067f20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.351+0000 7f5289600640 1 --2- 172.21.15.29:0/135356765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f528413cda0 0x7f5284071380 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.351+0000 7f5289600640 1 --2- 172.21.15.29:0/135356765 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f528406c200 0x7f5284070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.351+0000 7f5289600640 1 --2- 172.21.15.29:0/135356765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f528406be20 0x7f5284138ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.351+0000 7f5289600640 1 -- 172.21.15.29:0/135356765 >> 172.21.15.29:0/135356765 conn(0x7f528406d700 msgr2=0x7f528415cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:58.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.351+0000 7f5289600640 1 -- 172.21.15.29:0/135356765 shutdown_connections 2024-01-24T13:04:58.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.351+0000 7f5289600640 1 -- 172.21.15.29:0/135356765 wait complete. 2024-01-24T13:04:58.372 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:04:58.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff68fa00640 1 Processor -- start 2024-01-24T13:04:58.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff68fa00640 1 -- start start 2024-01-24T13:04:58.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff68fa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6880cd590 0x7ff6880d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:58.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff68fa00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff68815d870 0x7ff6880ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:58.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff68fa00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6880cd970 con 0x7ff6880ce5c0 2024-01-24T13:04:58.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff68fa00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68806c1b0 con 0x7ff6880cd590 2024-01-24T13:04:58.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff68fa00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6880ce9c0 con 0x7ff68815d870 2024-01-24T13:04:58.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff68d000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6880cd590 0x7ff6880d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:58.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff68d000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6880cd590 0x7ff6880d0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50964/0 (socket says 172.21.15.29:50964) 2024-01-24T13:04:58.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff68d000640 1 -- 172.21.15.29:0/1270579071 learned_addr learned my addr 172.21.15.29:0/1270579071 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:58.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff687e00640 1 --2- 172.21.15.29:0/1270579071 >> v2:172.21.15.163:3300/0 conn(0x7ff68815d870 0x7ff6880ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:58.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff68d000640 1 -- 172.21.15.29:0/1270579071 >> v2:172.21.15.163:3300/0 conn(0x7ff68815d870 msgr2=0x7ff6880ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:58.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff68d000640 1 --2- 172.21.15.29:0/1270579071 >> v2:172.21.15.163:3300/0 conn(0x7ff68815d870 0x7ff6880ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff68d000640 1 -- 172.21.15.29:0/1270579071 >> v1:172.21.15.163:6789/0 conn(0x7ff6880ce5c0 legacy=0x7ff6881603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:58.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.511+0000 7ff68d000640 1 -- 172.21.15.29:0/1270579071 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6880d0810 con 0x7ff6880cd590 2024-01-24T13:04:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.515+0000 7ff68d000640 1 --2- 172.21.15.29:0/1270579071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6880cd590 0x7ff6880d0150 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff6880b20e0 tx=0x7ff67801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df9e68c0b36ea84 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.515+0000 7ff687400640 1 -- 172.21.15.29:0/1270579071 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6780ab5f0 con 0x7ff6880cd590 2024-01-24T13:04:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.515+0000 7ff687400640 1 -- 172.21.15.29:0/1270579071 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6780ab750 con 0x7ff6880cd590 2024-01-24T13:04:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.515+0000 7ff687400640 1 -- 172.21.15.29:0/1270579071 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6780abae0 con 0x7ff6880cd590 2024-01-24T13:04:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.515+0000 7ff68fa00640 1 -- 172.21.15.29:0/1270579071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6880cd590 msgr2=0x7ff6880d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.515+0000 7ff68fa00640 1 --2- 172.21.15.29:0/1270579071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6880cd590 0x7ff6880d0150 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff6880b20e0 tx=0x7ff67801c4d0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.515+0000 7ff68fa00640 1 -- 172.21.15.29:0/1270579071 shutdown_connections 2024-01-24T13:04:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.515+0000 7ff68fa00640 1 --2- 172.21.15.29:0/1270579071 >> v2:172.21.15.163:3300/0 conn(0x7ff68815d870 0x7ff6880ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.515+0000 7ff68fa00640 1 --2- 172.21.15.29:0/1270579071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6880cd590 0x7ff6880d0150 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.515+0000 7ff68fa00640 1 -- 172.21.15.29:0/1270579071 >> 172.21.15.29:0/1270579071 conn(0x7ff688069cd0 msgr2=0x7ff68806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:58.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.515+0000 7ff68fa00640 1 -- 172.21.15.29:0/1270579071 shutdown_connections 2024-01-24T13:04:58.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.515+0000 7ff68fa00640 1 -- 172.21.15.29:0/1270579071 wait complete. 2024-01-24T13:04:58.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68fa00640 1 Processor -- start 2024-01-24T13:04:58.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68fa00640 1 -- start start 2024-01-24T13:04:58.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68fa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6880cd590 0x7ff6880b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68fa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6880ce5c0 0x7ff68815f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68fa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff68815d870 0x7ff6880c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68fa00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6881594e0 con 0x7ff68815d870 2024-01-24T13:04:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68fa00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6881605d0 con 0x7ff6880ce5c0 2024-01-24T13:04:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68fa00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff688158860 con 0x7ff6880cd590 2024-01-24T13:04:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68da00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff68815d870 0x7ff6880c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68da00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff68815d870 0x7ff6880c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50980/0 (socket says 172.21.15.29:50980) 2024-01-24T13:04:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68da00640 1 -- 172.21.15.29:0/3733929664 learned_addr learned my addr 172.21.15.29:0/3733929664 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68d000640 1 --2- 172.21.15.29:0/3733929664 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6880cd590 0x7ff6880b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff687e00640 1 --2- 172.21.15.29:0/3733929664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6880ce5c0 0x7ff68815f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:58.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68da00640 1 -- 172.21.15.29:0/3733929664 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6880cd590 msgr2=0x7ff6880b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:58.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68da00640 1 --2- 172.21.15.29:0/3733929664 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6880cd590 0x7ff6880b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68da00640 1 -- 172.21.15.29:0/3733929664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6880ce5c0 msgr2=0x7ff68815f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:58.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68da00640 1 --2- 172.21.15.29:0/3733929664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6880ce5c0 0x7ff68815f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68da00640 1 -- 172.21.15.29:0/3733929664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6780094d0 con 0x7ff68815d870 2024-01-24T13:04:58.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68da00640 1 --2- 172.21.15.29:0/3733929664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff68815d870 0x7ff6880c3fc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff68000c770 tx=0x7ff68000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:58.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff684c00640 1 -- 172.21.15.29:0/3733929664 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff680003b80 con 0x7ff68815d870 2024-01-24T13:04:58.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff684c00640 1 -- 172.21.15.29:0/3733929664 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff680003ce0 con 0x7ff68815d870 2024-01-24T13:04:58.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff684c00640 1 -- 172.21.15.29:0/3733929664 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68000aa90 con 0x7ff68815d870 2024-01-24T13:04:58.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.519+0000 7ff68fa00640 1 -- 172.21.15.29:0/3733929664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68815de00 con 0x7ff68815d870 2024-01-24T13:04:58.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.523+0000 7ff68fa00640 1 -- 172.21.15.29:0/3733929664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff688158e20 con 0x7ff68815d870 2024-01-24T13:04:58.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.523+0000 7ff68fa00640 1 -- 172.21.15.29:0/3733929664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff688159620 con 0x7ff68815d870 2024-01-24T13:04:58.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.523+0000 7ff684c00640 1 -- 172.21.15.29:0/3733929664 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff68000abf0 con 0x7ff68815d870 2024-01-24T13:04:58.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.523+0000 7ff684c00640 1 --2- 172.21.15.29:0/3733929664 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff660065a60 0x7ff660067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:58.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.523+0000 7ff684c00640 1 -- 172.21.15.29:0/3733929664 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff680083100 con 0x7ff68815d870 2024-01-24T13:04:58.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.523+0000 7ff68d000640 1 --2- 172.21.15.29:0/3733929664 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff660065a60 0x7ff660067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:58.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.527+0000 7ff68d000640 1 --2- 172.21.15.29:0/3733929664 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff660065a60 0x7ff660067f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff6780af000 tx=0x7ff6780b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:58.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.527+0000 7ff684c00640 1 -- 172.21.15.29:0/3733929664 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff688159620 con 0x7ff68815d870 2024-01-24T13:04:58.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.695+0000 7ff68fa00640 1 -- 172.21.15.29:0/3733929664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff688159620 con 0x7ff68815d870 2024-01-24T13:04:58.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.695+0000 7ff684c00640 1 -- 172.21.15.29:0/3733929664 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff688159620 con 0x7ff68815d870 2024-01-24T13:04:58.700 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:04:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.699+0000 7ff68fa00640 1 -- 172.21.15.29:0/3733929664 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff660065a60 msgr2=0x7ff660067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.699+0000 7ff68fa00640 1 --2- 172.21.15.29:0/3733929664 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff660065a60 0x7ff660067f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff6780af000 tx=0x7ff6780b6040 comp rx=0 tx=0).stop 2024-01-24T13:04:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.699+0000 7ff68fa00640 1 -- 172.21.15.29:0/3733929664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff68815d870 msgr2=0x7ff6880c3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.699+0000 7ff68fa00640 1 --2- 172.21.15.29:0/3733929664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff68815d870 0x7ff6880c3fc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff68000c770 tx=0x7ff68000cc30 comp rx=0 tx=0).stop 2024-01-24T13:04:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.699+0000 7ff68fa00640 1 -- 172.21.15.29:0/3733929664 shutdown_connections 2024-01-24T13:04:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.699+0000 7ff68fa00640 1 --2- 172.21.15.29:0/3733929664 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff660065a60 0x7ff660067f20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.699+0000 7ff68fa00640 1 --2- 172.21.15.29:0/3733929664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff68815d870 0x7ff6880c3fc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.699+0000 7ff68fa00640 1 --2- 172.21.15.29:0/3733929664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6880ce5c0 0x7ff68815f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.699+0000 7ff68fa00640 1 --2- 172.21.15.29:0/3733929664 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6880cd590 0x7ff6880b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.699+0000 7ff68fa00640 1 -- 172.21.15.29:0/3733929664 >> 172.21.15.29:0/3733929664 conn(0x7ff688069cd0 msgr2=0x7ff68806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.699+0000 7ff68fa00640 1 -- 172.21.15.29:0/3733929664 shutdown_connections 2024-01-24T13:04:58.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:58.699+0000 7ff68fa00640 1 -- 172.21.15.29:0/3733929664 wait complete. 2024-01-24T13:04:58.722 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi163.front.sepia.ceph.com... 2024-01-24T13:04:58.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:58.722 DEBUG:teuthology.orchestra.run.smithi163:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-01-24T13:04:58.755 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:04:58.755 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:04:58.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:04:58.755 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-24T13:04:58.824 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:04:58.824 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:04:58.833 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:04:58.833 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:04:58.885 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:04:59.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.063+0000 7ff5b9a00640 1 Processor -- start 2024-01-24T13:04:59.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b9a00640 1 -- start start 2024-01-24T13:04:59.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b9a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff5b4143910 0x7ff5b4143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b9a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b406c320 0x7ff5b40cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b9a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b415aa30 con 0x7ff5b4070ac0 2024-01-24T13:04:59.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b9a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b40712a0 con 0x7ff5b4143910 2024-01-24T13:04:59.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b9a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b4071580 con 0x7ff5b406c320 2024-01-24T13:04:59.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b2000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff5b4070ac0 0x7ff5b406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37134/0 (socket says 172.21.15.29:37134) 2024-01-24T13:04:59.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b2000640 1 -- 172.21.15.29:0/88397681 learned_addr learned my addr 172.21.15.29:0/88397681 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:59.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b3400640 1 --2- 172.21.15.29:0/88397681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b406c320 0x7ff5b40cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b2a00640 1 --2- 172.21.15.29:0/88397681 >> v2:172.21.15.163:3300/0 conn(0x7ff5b4143910 0x7ff5b4143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 -- 172.21.15.29:0/88397681 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762765435 0 0) 0x7ff59c001120 con 0x7ff5b4070ac0 2024-01-24T13:04:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 -- 172.21.15.29:0/88397681 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff594003530 con 0x7ff5b4070ac0 2024-01-24T13:04:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 -- 172.21.15.29:0/88397681 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2506296088 0 0) 0x7ff594003530 con 0x7ff5b4070ac0 2024-01-24T13:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 -- 172.21.15.29:0/88397681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b406c320 msgr2=0x7ff5b40cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 --2- 172.21.15.29:0/88397681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b406c320 0x7ff5b40cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 -- 172.21.15.29:0/88397681 >> v2:172.21.15.163:3300/0 conn(0x7ff5b4143910 msgr2=0x7ff5b4143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 --2- 172.21.15.29:0/88397681 >> v2:172.21.15.163:3300/0 conn(0x7ff5b4143910 0x7ff5b4143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 -- 172.21.15.29:0/88397681 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b40cd090 con 0x7ff5b4070ac0 2024-01-24T13:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 -- 172.21.15.29:0/88397681 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7ff59c001810 con 0x7ff5b4070ac0 2024-01-24T13:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 -- 172.21.15.29:0/88397681 >> v1:172.21.15.29:6789/0 conn(0x7ff5b4070ac0 legacy=0x7ff5b406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 --2- 172.21.15.29:0/88397681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff594003980 0x7ff594003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 --2- 172.21.15.29:0/88397681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff594004370 0x7ff594004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 --2- 172.21.15.29:0/88397681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff594004ec0 0x7ff59400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 -- 172.21.15.29:0/88397681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b40712a0 con 0x7ff594004370 2024-01-24T13:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 -- 172.21.15.29:0/88397681 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b4071580 con 0x7ff594004ec0 2024-01-24T13:04:59.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b1600640 1 -- 172.21.15.29:0/88397681 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59400bed0 con 0x7ff594003980 2024-01-24T13:04:59.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b2000640 1 --2- 172.21.15.29:0/88397681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff594004370 0x7ff594004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b2a00640 1 --2- 172.21.15.29:0/88397681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff594003980 0x7ff594003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b3400640 1 --2- 172.21.15.29:0/88397681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff594004ec0 0x7ff59400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b2000640 1 -- 172.21.15.29:0/88397681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff594003980 msgr2=0x7ff594003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:59.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b2000640 1 --2- 172.21.15.29:0/88397681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff594003980 0x7ff594003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b2000640 1 -- 172.21.15.29:0/88397681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff594004ec0 msgr2=0x7ff59400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:59.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b2000640 1 --2- 172.21.15.29:0/88397681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff594004ec0 0x7ff59400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.067+0000 7ff5b2000640 1 -- 172.21.15.29:0/88397681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff594003530 con 0x7ff594004370 2024-01-24T13:04:59.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.071+0000 7ff5b2000640 1 --2- 172.21.15.29:0/88397681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff594004370 0x7ff594004850 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00c210 tx=0x7ff59c01f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7077a8d73dfe8ec1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:59.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.071+0000 7ff5b1600640 1 -- 172.21.15.29:0/88397681 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c005ae0 con 0x7ff594004370 2024-01-24T13:04:59.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.071+0000 7ff5b1600640 1 -- 172.21.15.29:0/88397681 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c0ab070 con 0x7ff594004370 2024-01-24T13:04:59.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.071+0000 7ff5b1600640 1 -- 172.21.15.29:0/88397681 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c007070 con 0x7ff594004370 2024-01-24T13:04:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.071+0000 7ff5b9a00640 1 -- 172.21.15.29:0/88397681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff594004370 msgr2=0x7ff594004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.071+0000 7ff5b9a00640 1 --2- 172.21.15.29:0/88397681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff594004370 0x7ff594004850 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00c210 tx=0x7ff59c01f3b0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.071+0000 7ff5b3400640 1 -- 172.21.15.29:0/88397681 reap_dead start 2024-01-24T13:04:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.071+0000 7ff5b9a00640 1 -- 172.21.15.29:0/88397681 shutdown_connections 2024-01-24T13:04:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.071+0000 7ff5b9a00640 1 -- 172.21.15.29:0/88397681 >> 172.21.15.29:0/88397681 conn(0x7ff5b40b3950 msgr2=0x7ff5b4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.071+0000 7ff5b9a00640 1 -- 172.21.15.29:0/88397681 shutdown_connections 2024-01-24T13:04:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.071+0000 7ff5b9a00640 1 -- 172.21.15.29:0/88397681 wait complete. 2024-01-24T13:04:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b9a00640 1 Processor -- start 2024-01-24T13:04:59.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b9a00640 1 -- start start 2024-01-24T13:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b9a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff594004370 0x7ff5b4159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b9a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b413aff0 0x7ff5b413b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b9a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b415acd0 0x7ff5b415b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b9a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b41f0dd0 con 0x7ff5b415acd0 2024-01-24T13:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b9a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b4159da0 con 0x7ff594004370 2024-01-24T13:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b9a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b413b9b0 con 0x7ff5b413aff0 2024-01-24T13:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b3400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b415acd0 0x7ff5b415b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b3400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b415acd0 0x7ff5b415b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51002/0 (socket says 172.21.15.29:51002) 2024-01-24T13:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b3400640 1 -- 172.21.15.29:0/3954099112 learned_addr learned my addr 172.21.15.29:0/3954099112 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b2a00640 1 --2- 172.21.15.29:0/3954099112 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff594004370 0x7ff5b4159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b2000640 1 --2- 172.21.15.29:0/3954099112 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b413aff0 0x7ff5b413b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b3400640 1 -- 172.21.15.29:0/3954099112 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b413aff0 msgr2=0x7ff5b413b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b3400640 1 --2- 172.21.15.29:0/3954099112 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b413aff0 0x7ff5b413b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b3400640 1 -- 172.21.15.29:0/3954099112 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff594004370 msgr2=0x7ff5b4159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b3400640 1 --2- 172.21.15.29:0/3954099112 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff594004370 0x7ff5b4159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b3400640 1 -- 172.21.15.29:0/3954099112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b41f0150 con 0x7ff5b415acd0 2024-01-24T13:04:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b3400640 1 --2- 172.21.15.29:0/3954099112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b415acd0 0x7ff5b415b150 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40b3450 tx=0x7ff5ac00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5aaa00640 1 -- 172.21.15.29:0/3954099112 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00e040 con 0x7ff5b415acd0 2024-01-24T13:04:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5aaa00640 1 -- 172.21.15.29:0/3954099112 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac00f040 con 0x7ff5b415acd0 2024-01-24T13:04:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b9a00640 1 -- 172.21.15.29:0/3954099112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b41f0430 con 0x7ff5b415acd0 2024-01-24T13:04:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5aaa00640 1 -- 172.21.15.29:0/3954099112 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00fb10 con 0x7ff5b415acd0 2024-01-24T13:04:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.075+0000 7ff5b9a00640 1 -- 172.21.15.29:0/3954099112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b41f09f0 con 0x7ff5b415acd0 2024-01-24T13:04:59.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.079+0000 7ff5b9a00640 1 -- 172.21.15.29:0/3954099112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b41f0f10 con 0x7ff5b415acd0 2024-01-24T13:04:59.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.079+0000 7ff5aaa00640 1 -- 172.21.15.29:0/3954099112 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff5ac00fc70 con 0x7ff5b415acd0 2024-01-24T13:04:59.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.079+0000 7ff5aaa00640 1 --2- 172.21.15.29:0/3954099112 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff58c065a60 0x7ff58c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.079+0000 7ff5aaa00640 1 -- 172.21.15.29:0/3954099112 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff5ac083a50 con 0x7ff5b415acd0 2024-01-24T13:04:59.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.079+0000 7ff5b2a00640 1 --2- 172.21.15.29:0/3954099112 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff58c065a60 0x7ff58c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.079+0000 7ff5b2a00640 1 --2- 172.21.15.29:0/3954099112 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff58c065a60 0x7ff58c067f20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4141780 tx=0x7ff5a4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:59.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.083+0000 7ff5aaa00640 1 -- 172.21.15.29:0/3954099112 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff5b41f0f10 con 0x7ff5b415acd0 2024-01-24T13:04:59.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.239+0000 7ff5b9a00640 1 -- 172.21.15.29:0/3954099112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5b41f0f10 con 0x7ff5b415acd0 2024-01-24T13:04:59.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.239+0000 7ff5aaa00640 1 -- 172.21.15.29:0/3954099112 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7ff5b41f0f10 con 0x7ff5b415acd0 2024-01-24T13:04:59.244 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:04:59.244 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:04:59.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.243+0000 7ff5b9a00640 1 -- 172.21.15.29:0/3954099112 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff58c065a60 msgr2=0x7ff58c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.243+0000 7ff5b9a00640 1 --2- 172.21.15.29:0/3954099112 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff58c065a60 0x7ff58c067f20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4141780 tx=0x7ff5a4009190 comp rx=0 tx=0).stop 2024-01-24T13:04:59.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.243+0000 7ff5b9a00640 1 -- 172.21.15.29:0/3954099112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b415acd0 msgr2=0x7ff5b415b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.243+0000 7ff5b9a00640 1 --2- 172.21.15.29:0/3954099112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b415acd0 0x7ff5b415b150 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40b3450 tx=0x7ff5ac00f1b0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.243+0000 7ff5b9a00640 1 -- 172.21.15.29:0/3954099112 shutdown_connections 2024-01-24T13:04:59.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.243+0000 7ff5b9a00640 1 --2- 172.21.15.29:0/3954099112 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff58c065a60 0x7ff58c067f20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.243+0000 7ff5b9a00640 1 --2- 172.21.15.29:0/3954099112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b415acd0 0x7ff5b415b150 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.243+0000 7ff5b9a00640 1 --2- 172.21.15.29:0/3954099112 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b413aff0 0x7ff5b413b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.243+0000 7ff5b9a00640 1 --2- 172.21.15.29:0/3954099112 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff594004370 0x7ff5b4159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.243+0000 7ff5b9a00640 1 -- 172.21.15.29:0/3954099112 >> 172.21.15.29:0/3954099112 conn(0x7ff5b40b3950 msgr2=0x7ff5b415df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:59.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.243+0000 7ff5b9a00640 1 -- 172.21.15.29:0/3954099112 shutdown_connections 2024-01-24T13:04:59.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.243+0000 7ff5b9a00640 1 -- 172.21.15.29:0/3954099112 wait complete. 2024-01-24T13:04:59.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:04:59.267 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:04:59.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc172c00640 1 Processor -- start 2024-01-24T13:04:59.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc172c00640 1 -- start start 2024-01-24T13:04:59.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc172c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc16c0cb1e0 0x7fc16c0d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc172c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc16c0cd1e0 con 0x7fc16c0c3fd0 2024-01-24T13:04:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc172c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc16c0cd4c0 con 0x7fc16c15a6f0 2024-01-24T13:04:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc172c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c15aad0 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc16be00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fc16c15a6f0 0x7fc16c0ceb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:43374/0 (socket says 172.21.15.29:43374) 2024-01-24T13:04:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc16b400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc16c0c3fd0 0x7fc16c0caad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37140/0 (socket says 172.21.15.29:37140) 2024-01-24T13:04:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc16be00640 1 -- 172.21.15.29:0/78070539 learned_addr learned my addr 172.21.15.29:0/78070539 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:04:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc170c00640 1 --2- 172.21.15.29:0/78070539 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc16c0cb1e0 0x7fc16c0d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc16aa00640 1 -- 172.21.15.29:0/78070539 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142368860 0 0) 0x7fc16c0cd1e0 con 0x7fc16c0c3fd0 2024-01-24T13:04:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc16aa00640 1 -- 172.21.15.29:0/78070539 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc14c003530 con 0x7fc16c0c3fd0 2024-01-24T13:04:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc16aa00640 1 -- 172.21.15.29:0/78070539 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087248751 0 0) 0x7fc16c0cd4c0 con 0x7fc16c15a6f0 2024-01-24T13:04:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc170c00640 1 -- 172.21.15.29:0/78070539 >> v1:172.21.15.163:6789/0 conn(0x7fc16c15a6f0 legacy=0x7fc16c0ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc170c00640 1 -- 172.21.15.29:0/78070539 >> v1:172.21.15.29:6789/0 conn(0x7fc16c0c3fd0 legacy=0x7fc16c0caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.407+0000 7fc170c00640 1 -- 172.21.15.29:0/78070539 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c0cd7a0 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.411+0000 7fc170c00640 1 --2- 172.21.15.29:0/78070539 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc16c0cb1e0 0x7fc16c0d0520 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc164009dc0 tx=0x7fc16401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad24a8184e9fdf60 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:59.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.411+0000 7fc16aa00640 1 -- 172.21.15.29:0/78070539 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1640a5910 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.411+0000 7fc16aa00640 1 -- 172.21.15.29:0/78070539 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1640a5a70 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.411+0000 7fc16aa00640 1 -- 172.21.15.29:0/78070539 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1640a5de0 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.411+0000 7fc172c00640 1 -- 172.21.15.29:0/78070539 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc16c0cb1e0 msgr2=0x7fc16c0d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.411+0000 7fc172c00640 1 --2- 172.21.15.29:0/78070539 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc16c0cb1e0 0x7fc16c0d0520 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc164009dc0 tx=0x7fc16401c940 comp rx=0 tx=0).stop 2024-01-24T13:04:59.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc172c00640 1 -- 172.21.15.29:0/78070539 shutdown_connections 2024-01-24T13:04:59.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc172c00640 1 --2- 172.21.15.29:0/78070539 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc16c0cb1e0 0x7fc16c0d0520 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc172c00640 1 -- 172.21.15.29:0/78070539 >> 172.21.15.29:0/78070539 conn(0x7fc16c069cd0 msgr2=0x7fc16c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:59.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc172c00640 1 -- 172.21.15.29:0/78070539 shutdown_connections 2024-01-24T13:04:59.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc172c00640 1 -- 172.21.15.29:0/78070539 wait complete. 2024-01-24T13:04:59.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc172c00640 1 Processor -- start 2024-01-24T13:04:59.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc172c00640 1 -- start start 2024-01-24T13:04:59.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc172c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc16c0c3fd0 0x7fc16c156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc172c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c0cb1e0 0x7fc16c0b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc172c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc16c15a6f0 0x7fc16c0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc172c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c0b51f0 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc172c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c156760 con 0x7fc16c0c3fd0 2024-01-24T13:04:59.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc172c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c0b4570 con 0x7fc16c15a6f0 2024-01-24T13:04:59.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc16b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c0cb1e0 0x7fc16c0b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc16b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c0cb1e0 0x7fc16c0b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51018/0 (socket says 172.21.15.29:51018) 2024-01-24T13:04:59.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc16b400640 1 -- 172.21.15.29:0/566558301 learned_addr learned my addr 172.21.15.29:0/566558301 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:59.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc16be00640 1 --2- 172.21.15.29:0/566558301 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc16c0c3fd0 0x7fc16c156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc170c00640 1 --2- 172.21.15.29:0/566558301 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc16c15a6f0 0x7fc16c0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc16b400640 1 -- 172.21.15.29:0/566558301 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc16c15a6f0 msgr2=0x7fc16c0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc16b400640 1 --2- 172.21.15.29:0/566558301 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc16c15a6f0 0x7fc16c0c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc16b400640 1 -- 172.21.15.29:0/566558301 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc16c0c3fd0 msgr2=0x7fc16c156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc16b400640 1 --2- 172.21.15.29:0/566558301 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc16c0c3fd0 0x7fc16c156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc16b400640 1 -- 172.21.15.29:0/566558301 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc164009a70 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.415+0000 7fc16b400640 1 --2- 172.21.15.29:0/566558301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c0cb1e0 0x7fc16c0b5610 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc15400c4d0 tx=0x7fc15400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:59.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.419+0000 7fc163e00640 1 -- 172.21.15.29:0/566558301 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154007480 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.419+0000 7fc163e00640 1 -- 172.21.15.29:0/566558301 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1540075e0 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.419+0000 7fc163e00640 1 -- 172.21.15.29:0/566558301 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154004a30 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.419+0000 7fc172c00640 1 -- 172.21.15.29:0/566558301 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16c0b4850 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.419+0000 7fc172c00640 1 -- 172.21.15.29:0/566558301 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16c0b4e10 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.419+0000 7fc172c00640 1 -- 172.21.15.29:0/566558301 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16c04e850 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.419+0000 7fc163e00640 1 -- 172.21.15.29:0/566558301 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc154004b90 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.419+0000 7fc163e00640 1 --2- 172.21.15.29:0/566558301 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc144065a60 0x7fc144067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.419+0000 7fc163e00640 1 -- 172.21.15.29:0/566558301 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fc154082560 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.419+0000 7fc16be00640 1 --2- 172.21.15.29:0/566558301 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc144065a60 0x7fc144067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.423+0000 7fc16be00640 1 --2- 172.21.15.29:0/566558301 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc144065a60 0x7fc144067f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc15c000f70 tx=0x7fc15c007c10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:59.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.423+0000 7fc163e00640 1 -- 172.21.15.29:0/566558301 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc15404fc80 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.583+0000 7fc172c00640 1 -- 172.21.15.29:0/566558301 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc16c0b29c0 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.583+0000 7fc163e00640 1 -- 172.21.15.29:0/566558301 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1540532a0 con 0x7fc16c0cb1e0 2024-01-24T13:04:59.586 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:04:59.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.583+0000 7fc172c00640 1 -- 172.21.15.29:0/566558301 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc144065a60 msgr2=0x7fc144067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.583+0000 7fc172c00640 1 --2- 172.21.15.29:0/566558301 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc144065a60 0x7fc144067f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc15c000f70 tx=0x7fc15c007c10 comp rx=0 tx=0).stop 2024-01-24T13:04:59.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.583+0000 7fc172c00640 1 -- 172.21.15.29:0/566558301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c0cb1e0 msgr2=0x7fc16c0b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.583+0000 7fc172c00640 1 --2- 172.21.15.29:0/566558301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c0cb1e0 0x7fc16c0b5610 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc15400c4d0 tx=0x7fc15400c990 comp rx=0 tx=0).stop 2024-01-24T13:04:59.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.583+0000 7fc172c00640 1 -- 172.21.15.29:0/566558301 shutdown_connections 2024-01-24T13:04:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.583+0000 7fc172c00640 1 --2- 172.21.15.29:0/566558301 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc144065a60 0x7fc144067f20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.583+0000 7fc172c00640 1 --2- 172.21.15.29:0/566558301 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc16c15a6f0 0x7fc16c0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.583+0000 7fc172c00640 1 --2- 172.21.15.29:0/566558301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc16c0cb1e0 0x7fc16c0b5610 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.583+0000 7fc172c00640 1 --2- 172.21.15.29:0/566558301 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc16c0c3fd0 0x7fc16c156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.583+0000 7fc172c00640 1 -- 172.21.15.29:0/566558301 >> 172.21.15.29:0/566558301 conn(0x7fc16c069cd0 msgr2=0x7fc16c15cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.583+0000 7fc172c00640 1 -- 172.21.15.29:0/566558301 shutdown_connections 2024-01-24T13:04:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.583+0000 7fc172c00640 1 -- 172.21.15.29:0/566558301 wait complete. 2024-01-24T13:04:59.609 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:04:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.751+0000 7fb2dca00640 1 Processor -- start 2024-01-24T13:04:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.751+0000 7fb2dca00640 1 -- start start 2024-01-24T13:04:59.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.755+0000 7fb2dca00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2d40ce050 0x7fb2d40ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.755+0000 7fb2dca00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2d406b0a0 0x7fb2d406b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.755+0000 7fb2dca00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d4161130 con 0x7fb2d40cd300 2024-01-24T13:04:59.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.755+0000 7fb2dca00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d40cea20 con 0x7fb2d40ce050 2024-01-24T13:04:59.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.755+0000 7fb2dca00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d41605b0 con 0x7fb2d406b0a0 2024-01-24T13:04:59.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.755+0000 7fb2d9600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2d40ce050 0x7fb2d40ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.755+0000 7fb2d9600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2d40ce050 0x7fb2d40ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51020/0 (socket says 172.21.15.29:51020) 2024-01-24T13:04:59.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.755+0000 7fb2d9600640 1 -- 172.21.15.29:0/1777590798 learned_addr learned my addr 172.21.15.29:0/1777590798 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:59.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.755+0000 7fb2daa00640 1 --2- 172.21.15.29:0/1777590798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2d406b0a0 0x7fb2d406b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.755+0000 7fb2d9600640 1 -- 172.21.15.29:0/1777590798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2d406b0a0 msgr2=0x7fb2d406b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:04:59.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.755+0000 7fb2d9600640 1 --2- 172.21.15.29:0/1777590798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2d406b0a0 0x7fb2d406b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.755+0000 7fb2d9600640 1 -- 172.21.15.29:0/1777590798 >> v1:172.21.15.29:6789/0 conn(0x7fb2d40cd300 legacy=0x7fb2d415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.755+0000 7fb2d9600640 1 -- 172.21.15.29:0/1777590798 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d4160890 con 0x7fb2d40ce050 2024-01-24T13:04:59.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.755+0000 7fb2daa00640 1 --2- 172.21.15.29:0/1777590798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2d406b0a0 0x7fb2d406b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:04:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.759+0000 7fb2d9600640 1 --2- 172.21.15.29:0/1777590798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d40ce050 0x7fb2d40ce4e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009870 tx=0x7fb2bc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8ff1257602944c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.759+0000 7fb2d8c00640 1 -- 172.21.15.29:0/1777590798 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0a9400 con 0x7fb2d40ce050 2024-01-24T13:04:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.759+0000 7fb2d8c00640 1 -- 172.21.15.29:0/1777590798 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2bc0a9560 con 0x7fb2d40ce050 2024-01-24T13:04:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.759+0000 7fb2d8c00640 1 -- 172.21.15.29:0/1777590798 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0a98f0 con 0x7fb2d40ce050 2024-01-24T13:04:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.759+0000 7fb2dca00640 1 -- 172.21.15.29:0/1777590798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d40ce050 msgr2=0x7fb2d40ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.759+0000 7fb2dca00640 1 --2- 172.21.15.29:0/1777590798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d40ce050 0x7fb2d40ce4e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009870 tx=0x7fb2bc01c540 comp rx=0 tx=0).stop 2024-01-24T13:04:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.759+0000 7fb2dca00640 1 -- 172.21.15.29:0/1777590798 shutdown_connections 2024-01-24T13:04:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.759+0000 7fb2dca00640 1 --2- 172.21.15.29:0/1777590798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2d406b0a0 0x7fb2d406b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.759+0000 7fb2dca00640 1 --2- 172.21.15.29:0/1777590798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d40ce050 0x7fb2d40ce4e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.759+0000 7fb2dca00640 1 -- 172.21.15.29:0/1777590798 >> 172.21.15.29:0/1777590798 conn(0x7fb2d4069cd0 msgr2=0x7fb2d406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.759+0000 7fb2dca00640 1 -- 172.21.15.29:0/1777590798 shutdown_connections 2024-01-24T13:04:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.759+0000 7fb2dca00640 1 -- 172.21.15.29:0/1777590798 wait complete. 2024-01-24T13:04:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.759+0000 7fb2dca00640 1 Processor -- start 2024-01-24T13:04:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.759+0000 7fb2dca00640 1 -- start start 2024-01-24T13:04:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2dca00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2d406b0a0 0x7fb2d414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2dca00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2d40cd300 0x7fb2d4155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2dca00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d40ce050 0x7fb2d4152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2dca00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40b3360 con 0x7fb2d40ce050 2024-01-24T13:04:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2dca00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40b3080 con 0x7fb2d406b0a0 2024-01-24T13:04:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2dca00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40b54c0 con 0x7fb2d40cd300 2024-01-24T13:04:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2daa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d40ce050 0x7fb2d4152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2daa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d40ce050 0x7fb2d4152220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51024/0 (socket says 172.21.15.29:51024) 2024-01-24T13:04:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2daa00640 1 -- 172.21.15.29:0/161580363 learned_addr learned my addr 172.21.15.29:0/161580363 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:04:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2da000640 1 --2- 172.21.15.29:0/161580363 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2d406b0a0 0x7fb2d414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2d9600640 1 --2- 172.21.15.29:0/161580363 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2d40cd300 0x7fb2d4155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2daa00640 1 -- 172.21.15.29:0/161580363 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2d40cd300 msgr2=0x7fb2d4155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2daa00640 1 --2- 172.21.15.29:0/161580363 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2d40cd300 0x7fb2d4155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2daa00640 1 -- 172.21.15.29:0/161580363 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2d406b0a0 msgr2=0x7fb2d414ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2daa00640 1 --2- 172.21.15.29:0/161580363 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2d406b0a0 0x7fb2d414ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2daa00640 1 -- 172.21.15.29:0/161580363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc0094d0 con 0x7fb2d40ce050 2024-01-24T13:04:59.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2daa00640 1 --2- 172.21.15.29:0/161580363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d40ce050 0x7fb2d4152220 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00cef0 tx=0x7fb2cc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:59.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2d2000640 1 -- 172.21.15.29:0/161580363 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc00d840 con 0x7fb2d40ce050 2024-01-24T13:04:59.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2d2000640 1 -- 172.21.15.29:0/161580363 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc00d9c0 con 0x7fb2d40ce050 2024-01-24T13:04:59.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2d2000640 1 -- 172.21.15.29:0/161580363 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc00dd70 con 0x7fb2d40ce050 2024-01-24T13:04:59.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2dca00640 1 -- 172.21.15.29:0/161580363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d40b57a0 con 0x7fb2d40ce050 2024-01-24T13:04:59.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2dca00640 1 -- 172.21.15.29:0/161580363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d414f3d0 con 0x7fb2d40ce050 2024-01-24T13:04:59.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.763+0000 7fb2dca00640 1 -- 172.21.15.29:0/161580363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d40b5cc0 con 0x7fb2d40ce050 2024-01-24T13:04:59.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.767+0000 7fb2d2000640 1 -- 172.21.15.29:0/161580363 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb2cc01e3b0 con 0x7fb2d40ce050 2024-01-24T13:04:59.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.767+0000 7fb2d2000640 1 --2- 172.21.15.29:0/161580363 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb2ac065a60 0x7fb2ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:04:59.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.767+0000 7fb2d2000640 1 -- 172.21.15.29:0/161580363 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fb2cc083f70 con 0x7fb2d40ce050 2024-01-24T13:04:59.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.767+0000 7fb2da000640 1 --2- 172.21.15.29:0/161580363 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb2ac065a60 0x7fb2ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:04:59.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.767+0000 7fb2da000640 1 --2- 172.21.15.29:0/161580363 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb2ac065a60 0x7fb2ac067f20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4007fd0 tx=0x7fb2c4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:04:59.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.771+0000 7fb2d2000640 1 -- 172.21.15.29:0/161580363 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb2d40b5cc0 con 0x7fb2d40ce050 2024-01-24T13:04:59.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.927+0000 7fb2dca00640 1 -- 172.21.15.29:0/161580363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2d40b5cc0 con 0x7fb2d40ce050 2024-01-24T13:04:59.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.927+0000 7fb2d2000640 1 -- 172.21.15.29:0/161580363 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb2cc01a020 con 0x7fb2d40ce050 2024-01-24T13:04:59.932 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:04:59.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.931+0000 7fb2dca00640 1 -- 172.21.15.29:0/161580363 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb2ac065a60 msgr2=0x7fb2ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.931+0000 7fb2dca00640 1 --2- 172.21.15.29:0/161580363 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb2ac065a60 0x7fb2ac067f20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4007fd0 tx=0x7fb2c4009040 comp rx=0 tx=0).stop 2024-01-24T13:04:59.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.931+0000 7fb2dca00640 1 -- 172.21.15.29:0/161580363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d40ce050 msgr2=0x7fb2d4152220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:04:59.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.931+0000 7fb2dca00640 1 --2- 172.21.15.29:0/161580363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d40ce050 0x7fb2d4152220 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00cef0 tx=0x7fb2cc00a710 comp rx=0 tx=0).stop 2024-01-24T13:04:59.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.931+0000 7fb2dca00640 1 -- 172.21.15.29:0/161580363 shutdown_connections 2024-01-24T13:04:59.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.931+0000 7fb2dca00640 1 --2- 172.21.15.29:0/161580363 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb2ac065a60 0x7fb2ac067f20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.931+0000 7fb2dca00640 1 --2- 172.21.15.29:0/161580363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d40ce050 0x7fb2d4152220 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.931+0000 7fb2dca00640 1 --2- 172.21.15.29:0/161580363 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb2d40cd300 0x7fb2d4155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.931+0000 7fb2dca00640 1 --2- 172.21.15.29:0/161580363 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2d406b0a0 0x7fb2d414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:04:59.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.931+0000 7fb2dca00640 1 -- 172.21.15.29:0/161580363 >> 172.21.15.29:0/161580363 conn(0x7fb2d4069cd0 msgr2=0x7fb2d415f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:04:59.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.931+0000 7fb2dca00640 1 -- 172.21.15.29:0/161580363 shutdown_connections 2024-01-24T13:04:59.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:04:59.931+0000 7fb2dca00640 1 -- 172.21.15.29:0/161580363 wait complete. 2024-01-24T13:04:59.954 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:05:00.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f4843600640 1 Processor -- start 2024-01-24T13:05:00.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f4843600640 1 -- start start 2024-01-24T13:05:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f4843600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f483c06be20 0x7f483c15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f4843600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f483c06c200 0x7f483c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f4843600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483c15b4f0 con 0x7f483c13cda0 2024-01-24T13:05:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f4843600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483c15b7d0 con 0x7f483c06be20 2024-01-24T13:05:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f4843600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483c0cd0c0 con 0x7f483c06c200 2024-01-24T13:05:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f4840c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f483c06be20 0x7f483c15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f4840c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f483c06be20 0x7f483c15a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51040/0 (socket says 172.21.15.29:51040) 2024-01-24T13:05:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f4840c00640 1 -- 172.21.15.29:0/2866027540 learned_addr learned my addr 172.21.15.29:0/2866027540 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f483be00640 1 --2- 172.21.15.29:0/2866027540 >> v2:172.21.15.163:3300/0 conn(0x7f483c06c200 0x7f483c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f4840c00640 1 -- 172.21.15.29:0/2866027540 >> v2:172.21.15.163:3300/0 conn(0x7f483c06c200 msgr2=0x7f483c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f4840c00640 1 --2- 172.21.15.29:0/2866027540 >> v2:172.21.15.163:3300/0 conn(0x7f483c06c200 0x7f483c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f4840c00640 1 -- 172.21.15.29:0/2866027540 >> v1:172.21.15.29:6789/0 conn(0x7f483c13cda0 legacy=0x7f483c15dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.099+0000 7f4840c00640 1 -- 172.21.15.29:0/2866027540 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c0cd3a0 con 0x7f483c06be20 2024-01-24T13:05:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.103+0000 7f4840c00640 1 --2- 172.21.15.29:0/2866027540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06be20 0x7f483c15a9c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f483c0cf2b0 tx=0x7f482c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5ebd6f8e5632da server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.103+0000 7f483b400640 1 -- 172.21.15.29:0/2866027540 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c0aa680 con 0x7f483c06be20 2024-01-24T13:05:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.103+0000 7f483b400640 1 -- 172.21.15.29:0/2866027540 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482c0aa7e0 con 0x7f483c06be20 2024-01-24T13:05:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.103+0000 7f483b400640 1 -- 172.21.15.29:0/2866027540 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c0aab70 con 0x7f483c06be20 2024-01-24T13:05:00.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.103+0000 7f4843600640 1 -- 172.21.15.29:0/2866027540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06be20 msgr2=0x7f483c15a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.103+0000 7f4843600640 1 --2- 172.21.15.29:0/2866027540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06be20 0x7f483c15a9c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f483c0cf2b0 tx=0x7f482c01c4c0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.103+0000 7f4843600640 1 -- 172.21.15.29:0/2866027540 shutdown_connections 2024-01-24T13:05:00.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.103+0000 7f4843600640 1 --2- 172.21.15.29:0/2866027540 >> v2:172.21.15.163:3300/0 conn(0x7f483c06c200 0x7f483c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.103+0000 7f4843600640 1 --2- 172.21.15.29:0/2866027540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06be20 0x7f483c15a9c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.103+0000 7f4843600640 1 -- 172.21.15.29:0/2866027540 >> 172.21.15.29:0/2866027540 conn(0x7f483c06d700 msgr2=0x7f483c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:00.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.103+0000 7f4843600640 1 -- 172.21.15.29:0/2866027540 shutdown_connections 2024-01-24T13:05:00.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.103+0000 7f4843600640 1 -- 172.21.15.29:0/2866027540 wait complete. 2024-01-24T13:05:00.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4843600640 1 Processor -- start 2024-01-24T13:05:00.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4843600640 1 -- start start 2024-01-24T13:05:00.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4843600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06be20 0x7f483c1388e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4843600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f483c06c200 0x7f483c14a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4843600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f483c13cda0 0x7f483c13a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4843600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c14c270 con 0x7f483c06be20 2024-01-24T13:05:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4843600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c14b1d0 con 0x7f483c06c200 2024-01-24T13:05:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4843600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483c14b4b0 con 0x7f483c13cda0 2024-01-24T13:05:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4840c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06be20 0x7f483c1388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4840c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06be20 0x7f483c1388e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51056/0 (socket says 172.21.15.29:51056) 2024-01-24T13:05:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4840c00640 1 -- 172.21.15.29:0/1009059493 learned_addr learned my addr 172.21.15.29:0/1009059493 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f483be00640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f483c06c200 0x7f483c14a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4841600640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f483c13cda0 0x7f483c13a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4840c00640 1 -- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f483c13cda0 msgr2=0x7f483c13a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4840c00640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f483c13cda0 0x7f483c13a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4840c00640 1 -- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f483c06c200 msgr2=0x7f483c14a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4840c00640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f483c06c200 0x7f483c14a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4840c00640 1 -- 172.21.15.29:0/1009059493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c0094d0 con 0x7f483c06be20 2024-01-24T13:05:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4841600640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f483c13cda0 0x7f483c13a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f483be00640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f483c06c200 0x7f483c14a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4840c00640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06be20 0x7f483c1388e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f482c0190d0 tx=0x7f482c01ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:00.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4838c00640 1 -- 172.21.15.29:0/1009059493 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c0aa680 con 0x7f483c06be20 2024-01-24T13:05:00.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4838c00640 1 -- 172.21.15.29:0/1009059493 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482c0b3800 con 0x7f483c06be20 2024-01-24T13:05:00.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4838c00640 1 -- 172.21.15.29:0/1009059493 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c0b3b90 con 0x7f483c06be20 2024-01-24T13:05:00.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.107+0000 7f4843600640 1 -- 172.21.15.29:0/1009059493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483c14b790 con 0x7f483c06be20 2024-01-24T13:05:00.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.111+0000 7f4843600640 1 -- 172.21.15.29:0/1009059493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483c14bd50 con 0x7f483c06be20 2024-01-24T13:05:00.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.111+0000 7f4843600640 1 -- 172.21.15.29:0/1009059493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483c14b5f0 con 0x7f483c06be20 2024-01-24T13:05:00.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.111+0000 7f4838c00640 1 -- 172.21.15.29:0/1009059493 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f482c0b3cf0 con 0x7f483c06be20 2024-01-24T13:05:00.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.111+0000 7f4838c00640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4814065a60 0x7f4814067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.111+0000 7f4838c00640 1 -- 172.21.15.29:0/1009059493 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f482c11dce0 con 0x7f483c06be20 2024-01-24T13:05:00.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.111+0000 7f483be00640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4814065a60 0x7f4814067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.115+0000 7f483be00640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4814065a60 0x7f4814067f20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f483c15e660 tx=0x7f4824008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:00.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.115+0000 7f4838c00640 1 -- 172.21.15.29:0/1009059493 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f483c14b5f0 con 0x7f483c06be20 2024-01-24T13:05:00.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.271+0000 7f4843600640 1 -- 172.21.15.29:0/1009059493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f483c14b5f0 con 0x7f483c06be20 2024-01-24T13:05:00.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.271+0000 7f4838c00640 1 -- 172.21.15.29:0/1009059493 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f482c0c3020 con 0x7f483c06be20 2024-01-24T13:05:00.275 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:05:00.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.275+0000 7f4843600640 1 -- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4814065a60 msgr2=0x7f4814067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.275+0000 7f4843600640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4814065a60 0x7f4814067f20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f483c15e660 tx=0x7f4824008040 comp rx=0 tx=0).stop 2024-01-24T13:05:00.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.275+0000 7f4843600640 1 -- 172.21.15.29:0/1009059493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06be20 msgr2=0x7f483c1388e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.275+0000 7f4843600640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06be20 0x7f483c1388e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f482c0190d0 tx=0x7f482c01ad00 comp rx=0 tx=0).stop 2024-01-24T13:05:00.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.275+0000 7f4843600640 1 -- 172.21.15.29:0/1009059493 shutdown_connections 2024-01-24T13:05:00.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.275+0000 7f4843600640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4814065a60 0x7f4814067f20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.275+0000 7f4843600640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f483c13cda0 0x7f483c13a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.275+0000 7f4843600640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f483c06c200 0x7f483c14a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.275+0000 7f4843600640 1 --2- 172.21.15.29:0/1009059493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06be20 0x7f483c1388e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.275+0000 7f4843600640 1 -- 172.21.15.29:0/1009059493 >> 172.21.15.29:0/1009059493 conn(0x7f483c06d700 msgr2=0x7f483c15c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:00.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.275+0000 7f4843600640 1 -- 172.21.15.29:0/1009059493 shutdown_connections 2024-01-24T13:05:00.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.275+0000 7f4843600640 1 -- 172.21.15.29:0/1009059493 wait complete. 2024-01-24T13:05:00.299 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:05:00.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.439+0000 7f9efa400640 1 Processor -- start 2024-01-24T13:05:00.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.439+0000 7f9efa400640 1 -- start start 2024-01-24T13:05:00.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.443+0000 7f9efa400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ef40b2760 0x7f9ef40b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.443+0000 7f9efa400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef4153de0 con 0x7f9ef415cef0 2024-01-24T13:05:00.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.443+0000 7f9efa400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef4071d10 con 0x7f9ef4153a00 2024-01-24T13:05:00.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.443+0000 7f9efa400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40b3120 con 0x7f9ef40b2760 2024-01-24T13:05:00.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.443+0000 7f9ef3e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9ef415cef0 0x7f9ef415d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37168/0 (socket says 172.21.15.29:37168) 2024-01-24T13:05:00.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.443+0000 7f9ef3e00640 1 -- 172.21.15.29:0/2899483866 learned_addr learned my addr 172.21.15.29:0/2899483866 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:00.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.443+0000 7f9ef2a00640 1 --2- 172.21.15.29:0/2899483866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ef40b2760 0x7f9ef40b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.443+0000 7f9ef2000640 1 -- 172.21.15.29:0/2899483866 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437206845 0 0) 0x7f9ef4153de0 con 0x7f9ef415cef0 2024-01-24T13:05:00.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.443+0000 7f9ef2000640 1 -- 172.21.15.29:0/2899483866 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ed4003530 con 0x7f9ef415cef0 2024-01-24T13:05:00.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.443+0000 7f9ef2000640 1 -- 172.21.15.29:0/2899483866 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402682755 0 0) 0x7f9ef4071d10 con 0x7f9ef4153a00 2024-01-24T13:05:00.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.443+0000 7f9ef2000640 1 -- 172.21.15.29:0/2899483866 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ef4153de0 con 0x7f9ef4153a00 2024-01-24T13:05:00.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.443+0000 7f9ef2a00640 1 -- 172.21.15.29:0/2899483866 >> v1:172.21.15.163:6789/0 conn(0x7f9ef4153a00 legacy=0x7f9ef4071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.443+0000 7f9ef2a00640 1 -- 172.21.15.29:0/2899483866 >> v1:172.21.15.29:6789/0 conn(0x7f9ef415cef0 legacy=0x7f9ef415d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.443+0000 7f9ef2a00640 1 -- 172.21.15.29:0/2899483866 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4159900 con 0x7f9ef40b2760 2024-01-24T13:05:00.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.447+0000 7f9ef2a00640 1 --2- 172.21.15.29:0/2899483866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ef40b2760 0x7f9ef40b2be0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0097f0 tx=0x7f9edc01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebaa6badd460ee2b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:00.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.447+0000 7f9ef2000640 1 -- 172.21.15.29:0/2899483866 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0a4ea0 con 0x7f9ef40b2760 2024-01-24T13:05:00.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.447+0000 7f9ef2000640 1 -- 172.21.15.29:0/2899483866 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc0a7050 con 0x7f9ef40b2760 2024-01-24T13:05:00.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.447+0000 7f9ef2000640 1 -- 172.21.15.29:0/2899483866 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0ab820 con 0x7f9ef40b2760 2024-01-24T13:05:00.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.447+0000 7f9efa400640 1 -- 172.21.15.29:0/2899483866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ef40b2760 msgr2=0x7f9ef40b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.447+0000 7f9efa400640 1 --2- 172.21.15.29:0/2899483866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ef40b2760 0x7f9ef40b2be0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0097f0 tx=0x7f9edc01c400 comp rx=0 tx=0).stop 2024-01-24T13:05:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.447+0000 7f9efa400640 1 -- 172.21.15.29:0/2899483866 shutdown_connections 2024-01-24T13:05:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.447+0000 7f9efa400640 1 --2- 172.21.15.29:0/2899483866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ef40b2760 0x7f9ef40b2be0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.447+0000 7f9efa400640 1 -- 172.21.15.29:0/2899483866 >> 172.21.15.29:0/2899483866 conn(0x7f9ef406d700 msgr2=0x7f9ef4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.447+0000 7f9efa400640 1 -- 172.21.15.29:0/2899483866 shutdown_connections 2024-01-24T13:05:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.447+0000 7f9efa400640 1 -- 172.21.15.29:0/2899483866 wait complete. 2024-01-24T13:05:00.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.447+0000 7f9efa400640 1 Processor -- start 2024-01-24T13:05:00.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.447+0000 7f9efa400640 1 -- start start 2024-01-24T13:05:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9efa400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ef40b2760 0x7f9ef414a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9efa400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ef4153a00 0x7f9ef40b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9efa400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ef415cef0 0x7f9ef4140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9efa400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef4151070 con 0x7f9ef40b2760 2024-01-24T13:05:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9efa400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40ada30 con 0x7f9ef415cef0 2024-01-24T13:05:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9efa400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40b12b0 con 0x7f9ef4153a00 2024-01-24T13:05:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9ef3400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ef40b2760 0x7f9ef414a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9ef3400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ef40b2760 0x7f9ef414a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51070/0 (socket says 172.21.15.29:51070) 2024-01-24T13:05:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9ef3400640 1 -- 172.21.15.29:0/1457165136 learned_addr learned my addr 172.21.15.29:0/1457165136 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9ef2a00640 1 --2- 172.21.15.29:0/1457165136 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ef4153a00 0x7f9ef40b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9ef3e00640 1 --2- 172.21.15.29:0/1457165136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ef415cef0 0x7f9ef4140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9ef3400640 1 -- 172.21.15.29:0/1457165136 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ef4153a00 msgr2=0x7f9ef40b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9ef3400640 1 --2- 172.21.15.29:0/1457165136 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ef4153a00 0x7f9ef40b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9ef3400640 1 -- 172.21.15.29:0/1457165136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ef415cef0 msgr2=0x7f9ef4140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9ef3400640 1 --2- 172.21.15.29:0/1457165136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ef415cef0 0x7f9ef4140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9ef3400640 1 -- 172.21.15.29:0/1457165136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc009420 con 0x7f9ef40b2760 2024-01-24T13:05:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9ef3400640 1 --2- 172.21.15.29:0/1457165136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ef40b2760 0x7f9ef414a500 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400c430 tx=0x7f9ee400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9eeb400640 1 -- 172.21.15.29:0/1457165136 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee40052d0 con 0x7f9ef40b2760 2024-01-24T13:05:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9eeb400640 1 -- 172.21.15.29:0/1457165136 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee4005450 con 0x7f9ef40b2760 2024-01-24T13:05:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9eeb400640 1 -- 172.21.15.29:0/1457165136 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4003840 con 0x7f9ef40b2760 2024-01-24T13:05:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9efa400640 1 -- 172.21.15.29:0/1457165136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef41512c0 con 0x7f9ef40b2760 2024-01-24T13:05:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9efa400640 1 -- 172.21.15.29:0/1457165136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef4151880 con 0x7f9ef40b2760 2024-01-24T13:05:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9efa400640 1 -- 172.21.15.29:0/1457165136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef404e850 con 0x7f9ef40b2760 2024-01-24T13:05:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.451+0000 7f9eeb400640 1 -- 172.21.15.29:0/1457165136 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9ee40039a0 con 0x7f9ef40b2760 2024-01-24T13:05:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.455+0000 7f9eeb400640 1 --2- 172.21.15.29:0/1457165136 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9ecc065a60 0x7f9ecc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.455+0000 7f9eeb400640 1 -- 172.21.15.29:0/1457165136 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f9ee4082a40 con 0x7f9ef40b2760 2024-01-24T13:05:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.455+0000 7f9ef2a00640 1 --2- 172.21.15.29:0/1457165136 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9ecc065a60 0x7f9ecc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.455+0000 7f9ef2a00640 1 --2- 172.21.15.29:0/1457165136 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9ecc065a60 0x7f9ecc067f20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0ad000 tx=0x7f9edc0a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:00.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.459+0000 7f9eeb400640 1 -- 172.21.15.29:0/1457165136 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9ee4050170 con 0x7f9ef40b2760 2024-01-24T13:05:00.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.615+0000 7f9efa400640 1 -- 172.21.15.29:0/1457165136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9ef415a150 con 0x7f9ef40b2760 2024-01-24T13:05:00.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.615+0000 7f9eeb400640 1 -- 172.21.15.29:0/1457165136 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9ee4017020 con 0x7f9ef40b2760 2024-01-24T13:05:00.621 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:00.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.619+0000 7f9efa400640 1 -- 172.21.15.29:0/1457165136 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9ecc065a60 msgr2=0x7f9ecc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.619+0000 7f9efa400640 1 --2- 172.21.15.29:0/1457165136 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9ecc065a60 0x7f9ecc067f20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0ad000 tx=0x7f9edc0a6000 comp rx=0 tx=0).stop 2024-01-24T13:05:00.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.619+0000 7f9efa400640 1 -- 172.21.15.29:0/1457165136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ef40b2760 msgr2=0x7f9ef414a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.619+0000 7f9efa400640 1 --2- 172.21.15.29:0/1457165136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ef40b2760 0x7f9ef414a500 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400c430 tx=0x7f9ee400c8f0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.619+0000 7f9efa400640 1 -- 172.21.15.29:0/1457165136 shutdown_connections 2024-01-24T13:05:00.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.619+0000 7f9efa400640 1 --2- 172.21.15.29:0/1457165136 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9ecc065a60 0x7f9ecc067f20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.619+0000 7f9efa400640 1 --2- 172.21.15.29:0/1457165136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ef415cef0 0x7f9ef4140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.619+0000 7f9efa400640 1 --2- 172.21.15.29:0/1457165136 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ef4153a00 0x7f9ef40b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.619+0000 7f9efa400640 1 --2- 172.21.15.29:0/1457165136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ef40b2760 0x7f9ef414a500 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.619+0000 7f9efa400640 1 -- 172.21.15.29:0/1457165136 >> 172.21.15.29:0/1457165136 conn(0x7f9ef406d700 msgr2=0x7f9ef406fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.619+0000 7f9efa400640 1 -- 172.21.15.29:0/1457165136 shutdown_connections 2024-01-24T13:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.619+0000 7f9efa400640 1 -- 172.21.15.29:0/1457165136 wait complete. 2024-01-24T13:05:00.643 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:05:00.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3178c00640 1 Processor -- start 2024-01-24T13:05:00.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3178c00640 1 -- start start 2024-01-24T13:05:00.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3178c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31740c87e0 0x7f31741599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3178c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f317415d800 0x7f3174071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3178c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317415a960 con 0x7f317406ba60 2024-01-24T13:05:00.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3178c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3174153f30 con 0x7f31740c87e0 2024-01-24T13:05:00.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3178c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3174070a00 con 0x7f317415d800 2024-01-24T13:05:00.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3171400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31740c87e0 0x7f31741599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3171400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31740c87e0 0x7f31741599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51082/0 (socket says 172.21.15.29:51082) 2024-01-24T13:05:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3171400640 1 -- 172.21.15.29:0/4150068073 learned_addr learned my addr 172.21.15.29:0/4150068073 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3172800640 1 --2- 172.21.15.29:0/4150068073 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f317415d800 0x7f3174071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3171400640 1 -- 172.21.15.29:0/4150068073 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f317415d800 msgr2=0x7f3174071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3171400640 1 --2- 172.21.15.29:0/4150068073 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f317415d800 0x7f3174071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3171400640 1 -- 172.21.15.29:0/4150068073 >> v1:172.21.15.29:6789/0 conn(0x7f317406ba60 legacy=0x7f317406be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.783+0000 7f3171400640 1 -- 172.21.15.29:0/4150068073 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3174070ca0 con 0x7f31740c87e0 2024-01-24T13:05:00.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.787+0000 7f3171400640 1 --2- 172.21.15.29:0/4150068073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31740c87e0 0x7f31741599c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f315c009870 tx=0x7f315c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b0cef6d50543cf server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.787+0000 7f3170a00640 1 -- 172.21.15.29:0/4150068073 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c0a9400 con 0x7f31740c87e0 2024-01-24T13:05:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.787+0000 7f3170a00640 1 -- 172.21.15.29:0/4150068073 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c0a9560 con 0x7f31740c87e0 2024-01-24T13:05:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.787+0000 7f3170a00640 1 -- 172.21.15.29:0/4150068073 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c0a98f0 con 0x7f31740c87e0 2024-01-24T13:05:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.787+0000 7f3178c00640 1 -- 172.21.15.29:0/4150068073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31740c87e0 msgr2=0x7f31741599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.787+0000 7f3178c00640 1 --2- 172.21.15.29:0/4150068073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31740c87e0 0x7f31741599c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f315c009870 tx=0x7f315c01c540 comp rx=0 tx=0).stop 2024-01-24T13:05:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.787+0000 7f3178c00640 1 -- 172.21.15.29:0/4150068073 shutdown_connections 2024-01-24T13:05:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.787+0000 7f3178c00640 1 --2- 172.21.15.29:0/4150068073 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f317415d800 0x7f3174071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.787+0000 7f3178c00640 1 --2- 172.21.15.29:0/4150068073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31740c87e0 0x7f31741599c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.787+0000 7f3178c00640 1 -- 172.21.15.29:0/4150068073 >> 172.21.15.29:0/4150068073 conn(0x7f317406a2d0 msgr2=0x7f31740afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.787+0000 7f3178c00640 1 -- 172.21.15.29:0/4150068073 shutdown_connections 2024-01-24T13:05:00.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.787+0000 7f3178c00640 1 -- 172.21.15.29:0/4150068073 wait complete. 2024-01-24T13:05:00.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3178c00640 1 Processor -- start 2024-01-24T13:05:00.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3178c00640 1 -- start start 2024-01-24T13:05:00.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3178c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f317406ba60 0x7f317414d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3178c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31740c87e0 0x7f31740c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3178c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f317415d800 0x7f31740c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3178c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3174150390 con 0x7f31740c87e0 2024-01-24T13:05:00.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3178c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317414d940 con 0x7f317406ba60 2024-01-24T13:05:00.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3178c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317414fa60 con 0x7f317415d800 2024-01-24T13:05:00.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3171400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31740c87e0 0x7f31740c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3171400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31740c87e0 0x7f31740c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51096/0 (socket says 172.21.15.29:51096) 2024-01-24T13:05:00.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3171400640 1 -- 172.21.15.29:0/2354513628 learned_addr learned my addr 172.21.15.29:0/2354513628 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:00.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3171e00640 1 --2- 172.21.15.29:0/2354513628 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f317406ba60 0x7f317414d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3172800640 1 --2- 172.21.15.29:0/2354513628 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f317415d800 0x7f31740c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3171400640 1 -- 172.21.15.29:0/2354513628 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f317415d800 msgr2=0x7f31740c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3171400640 1 --2- 172.21.15.29:0/2354513628 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f317415d800 0x7f31740c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3171400640 1 -- 172.21.15.29:0/2354513628 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f317406ba60 msgr2=0x7f317414d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3171400640 1 --2- 172.21.15.29:0/2354513628 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f317406ba60 0x7f317414d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3171400640 1 -- 172.21.15.29:0/2354513628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c0094d0 con 0x7f31740c87e0 2024-01-24T13:05:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3171400640 1 --2- 172.21.15.29:0/2354513628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31740c87e0 0x7f31740c74b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f315c01abf0 tx=0x7f315c01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f316a000640 1 -- 172.21.15.29:0/2354513628 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c0b8870 con 0x7f31740c87e0 2024-01-24T13:05:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f316a000640 1 -- 172.21.15.29:0/2354513628 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c0b89f0 con 0x7f31740c87e0 2024-01-24T13:05:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f316a000640 1 -- 172.21.15.29:0/2354513628 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c0b8da0 con 0x7f31740c87e0 2024-01-24T13:05:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3178c00640 1 -- 172.21.15.29:0/2354513628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317414fd40 con 0x7f31740c87e0 2024-01-24T13:05:00.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.791+0000 7f3178c00640 1 -- 172.21.15.29:0/2354513628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31740c7f30 con 0x7f31740c87e0 2024-01-24T13:05:00.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.795+0000 7f3178c00640 1 -- 172.21.15.29:0/2354513628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3174150500 con 0x7f31740c87e0 2024-01-24T13:05:00.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.795+0000 7f316a000640 1 -- 172.21.15.29:0/2354513628 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f315c0c5460 con 0x7f31740c87e0 2024-01-24T13:05:00.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.795+0000 7f316a000640 1 --2- 172.21.15.29:0/2354513628 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f314c065a60 0x7f314c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:00.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.795+0000 7f316a000640 1 -- 172.21.15.29:0/2354513628 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f315c120820 con 0x7f31740c87e0 2024-01-24T13:05:00.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.795+0000 7f3171e00640 1 --2- 172.21.15.29:0/2354513628 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f314c065a60 0x7f314c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:00.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.795+0000 7f3171e00640 1 --2- 172.21.15.29:0/2354513628 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f314c065a60 0x7f314c067f20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3164007fd0 tx=0x7f3164009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:00.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.799+0000 7f316a000640 1 -- 172.21.15.29:0/2354513628 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f315c0edfe0 con 0x7f31740c87e0 2024-01-24T13:05:00.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.967+0000 7f3178c00640 1 -- 172.21.15.29:0/2354513628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f317404e850 con 0x7f31740c87e0 2024-01-24T13:05:00.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.971+0000 7f316a000640 1 -- 172.21.15.29:0/2354513628 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f315c0a6020 con 0x7f31740c87e0 2024-01-24T13:05:00.973 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:05:00.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.971+0000 7f3178c00640 1 -- 172.21.15.29:0/2354513628 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f314c065a60 msgr2=0x7f314c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.971+0000 7f3178c00640 1 --2- 172.21.15.29:0/2354513628 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f314c065a60 0x7f314c067f20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3164007fd0 tx=0x7f3164009040 comp rx=0 tx=0).stop 2024-01-24T13:05:00.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.971+0000 7f3178c00640 1 -- 172.21.15.29:0/2354513628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31740c87e0 msgr2=0x7f31740c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:00.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.971+0000 7f3178c00640 1 --2- 172.21.15.29:0/2354513628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31740c87e0 0x7f31740c74b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f315c01abf0 tx=0x7f315c01ad80 comp rx=0 tx=0).stop 2024-01-24T13:05:00.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.971+0000 7f3178c00640 1 -- 172.21.15.29:0/2354513628 shutdown_connections 2024-01-24T13:05:00.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.971+0000 7f3178c00640 1 --2- 172.21.15.29:0/2354513628 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f314c065a60 0x7f314c067f20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.971+0000 7f3178c00640 1 --2- 172.21.15.29:0/2354513628 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f317415d800 0x7f31740c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.971+0000 7f3178c00640 1 --2- 172.21.15.29:0/2354513628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31740c87e0 0x7f31740c74b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.971+0000 7f3178c00640 1 --2- 172.21.15.29:0/2354513628 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f317406ba60 0x7f317414d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:00.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.971+0000 7f3178c00640 1 -- 172.21.15.29:0/2354513628 >> 172.21.15.29:0/2354513628 conn(0x7f317406a2d0 msgr2=0x7f317415c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:00.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.971+0000 7f3178c00640 1 -- 172.21.15.29:0/2354513628 shutdown_connections 2024-01-24T13:05:00.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:00.971+0000 7f3178c00640 1 -- 172.21.15.29:0/2354513628 wait complete. 2024-01-24T13:05:00.995 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:05:00.995 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:05:01.004 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:01.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.183+0000 7ff371c00640 1 Processor -- start 2024-01-24T13:05:01.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.183+0000 7ff371c00640 1 -- start start 2024-01-24T13:05:01.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff371c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff36c143910 0x7ff36c143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff371c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff36c06c320 0x7ff36c0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff371c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36c15aa30 con 0x7ff36c070ac0 2024-01-24T13:05:01.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff371c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36c0712a0 con 0x7ff36c06c320 2024-01-24T13:05:01.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff371c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c071580 con 0x7ff36c143910 2024-01-24T13:05:01.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff36a000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff36c070ac0 0x7ff36c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37138/0 (socket says 172.21.15.29:37138) 2024-01-24T13:05:01.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff36a000640 1 -- 172.21.15.29:0/3228615565 learned_addr learned my addr 172.21.15.29:0/3228615565 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:01.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff36aa00640 1 --2- 172.21.15.29:0/3228615565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff36c143910 0x7ff36c143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff36b400640 1 --2- 172.21.15.29:0/3228615565 >> v2:172.21.15.163:3300/0 conn(0x7ff36c06c320 0x7ff36c0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff369600640 1 -- 172.21.15.29:0/3228615565 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996624418 0 0) 0x7ff354001120 con 0x7ff36c070ac0 2024-01-24T13:05:01.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff369600640 1 -- 172.21.15.29:0/3228615565 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff34c003530 con 0x7ff36c070ac0 2024-01-24T13:05:01.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff36aa00640 1 -- 172.21.15.29:0/3228615565 >> v2:172.21.15.163:3300/0 conn(0x7ff36c06c320 msgr2=0x7ff36c0cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:01.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff36aa00640 1 --2- 172.21.15.29:0/3228615565 >> v2:172.21.15.163:3300/0 conn(0x7ff36c06c320 0x7ff36c0cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff36aa00640 1 -- 172.21.15.29:0/3228615565 >> v1:172.21.15.29:6789/0 conn(0x7ff36c070ac0 legacy=0x7ff36c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.187+0000 7ff36aa00640 1 -- 172.21.15.29:0/3228615565 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c0cd090 con 0x7ff36c143910 2024-01-24T13:05:01.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.191+0000 7ff36aa00640 1 --2- 172.21.15.29:0/3228615565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff36c143910 0x7ff36c143d30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0097c0 tx=0x7ff35c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bca83a149e72659 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:01.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.191+0000 7ff369600640 1 -- 172.21.15.29:0/3228615565 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0a7070 con 0x7ff36c143910 2024-01-24T13:05:01.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.191+0000 7ff369600640 1 -- 172.21.15.29:0/3228615565 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c0ab430 con 0x7ff36c143910 2024-01-24T13:05:01.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.191+0000 7ff369600640 1 -- 172.21.15.29:0/3228615565 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0ab7c0 con 0x7ff36c143910 2024-01-24T13:05:01.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.191+0000 7ff371c00640 1 -- 172.21.15.29:0/3228615565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff36c143910 msgr2=0x7ff36c143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.191+0000 7ff371c00640 1 --2- 172.21.15.29:0/3228615565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff36c143910 0x7ff36c143d30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0097c0 tx=0x7ff35c01c450 comp rx=0 tx=0).stop 2024-01-24T13:05:01.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.191+0000 7ff371c00640 1 -- 172.21.15.29:0/3228615565 shutdown_connections 2024-01-24T13:05:01.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.191+0000 7ff371c00640 1 --2- 172.21.15.29:0/3228615565 >> v2:172.21.15.163:3300/0 conn(0x7ff36c06c320 0x7ff36c0cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.191+0000 7ff371c00640 1 --2- 172.21.15.29:0/3228615565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff36c143910 0x7ff36c143d30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.191+0000 7ff371c00640 1 -- 172.21.15.29:0/3228615565 >> 172.21.15.29:0/3228615565 conn(0x7ff36c0b3950 msgr2=0x7ff36c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.191+0000 7ff371c00640 1 -- 172.21.15.29:0/3228615565 shutdown_connections 2024-01-24T13:05:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.191+0000 7ff371c00640 1 -- 172.21.15.29:0/3228615565 wait complete. 2024-01-24T13:05:01.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.191+0000 7ff371c00640 1 Processor -- start 2024-01-24T13:05:01.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.191+0000 7ff371c00640 1 -- start start 2024-01-24T13:05:01.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff371c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff36c06c320 0x7ff36c137a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff371c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff36c070ac0 0x7ff36c139460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff371c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff36c143910 0x7ff36c14d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff371c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c14d900 con 0x7ff36c070ac0 2024-01-24T13:05:01.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff371c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c158b30 con 0x7ff36c143910 2024-01-24T13:05:01.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff371c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c14d660 con 0x7ff36c06c320 2024-01-24T13:05:01.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff36a000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff36c070ac0 0x7ff36c139460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff36a000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff36c070ac0 0x7ff36c139460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40548/0 (socket says 172.21.15.29:40548) 2024-01-24T13:05:01.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff36a000640 1 -- 172.21.15.29:0/4083750284 learned_addr learned my addr 172.21.15.29:0/4083750284 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:01.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff36aa00640 1 --2- 172.21.15.29:0/4083750284 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff36c06c320 0x7ff36c137a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff36b400640 1 --2- 172.21.15.29:0/4083750284 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff36c143910 0x7ff36c14d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff36a000640 1 -- 172.21.15.29:0/4083750284 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff36c06c320 msgr2=0x7ff36c137a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff36a000640 1 --2- 172.21.15.29:0/4083750284 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff36c06c320 0x7ff36c137a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff36a000640 1 -- 172.21.15.29:0/4083750284 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff36c143910 msgr2=0x7ff36c14d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff36a000640 1 --2- 172.21.15.29:0/4083750284 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff36c143910 0x7ff36c14d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff36a000640 1 -- 172.21.15.29:0/4083750284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c009420 con 0x7ff36c070ac0 2024-01-24T13:05:01.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff36a000640 1 --2- 172.21.15.29:0/4083750284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff36c070ac0 0x7ff36c139460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff35400c4d0 tx=0x7ff35400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:01.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff362a00640 1 -- 172.21.15.29:0/4083750284 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354005cf0 con 0x7ff36c070ac0 2024-01-24T13:05:01.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff362a00640 1 -- 172.21.15.29:0/4083750284 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff354005e50 con 0x7ff36c070ac0 2024-01-24T13:05:01.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff371c00640 1 -- 172.21.15.29:0/4083750284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36c138bc0 con 0x7ff36c070ac0 2024-01-24T13:05:01.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff362a00640 1 -- 172.21.15.29:0/4083750284 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354007290 con 0x7ff36c070ac0 2024-01-24T13:05:01.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff371c00640 1 -- 172.21.15.29:0/4083750284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36c139180 con 0x7ff36c070ac0 2024-01-24T13:05:01.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.195+0000 7ff371c00640 1 -- 172.21.15.29:0/4083750284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36c0cd8d0 con 0x7ff36c070ac0 2024-01-24T13:05:01.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.199+0000 7ff362a00640 1 -- 172.21.15.29:0/4083750284 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff3540073f0 con 0x7ff36c070ac0 2024-01-24T13:05:01.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.199+0000 7ff362a00640 1 --2- 172.21.15.29:0/4083750284 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff344065a60 0x7ff344067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.199+0000 7ff362a00640 1 -- 172.21.15.29:0/4083750284 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff354082970 con 0x7ff36c070ac0 2024-01-24T13:05:01.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.199+0000 7ff36aa00640 1 --2- 172.21.15.29:0/4083750284 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff344065a60 0x7ff344067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.199+0000 7ff36aa00640 1 --2- 172.21.15.29:0/4083750284 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff344065a60 0x7ff344067f20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0af000 tx=0x7ff35c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:01.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.203+0000 7ff362a00640 1 -- 172.21.15.29:0/4083750284 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff354050010 con 0x7ff36c070ac0 2024-01-24T13:05:01.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.363+0000 7ff371c00640 1 -- 172.21.15.29:0/4083750284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff36c15aa30 con 0x7ff36c070ac0 2024-01-24T13:05:01.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.363+0000 7ff362a00640 1 -- 172.21.15.29:0/4083750284 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7ff36c15aa30 con 0x7ff36c070ac0 2024-01-24T13:05:01.367 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:01.367 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.367+0000 7ff371c00640 1 -- 172.21.15.29:0/4083750284 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff344065a60 msgr2=0x7ff344067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.367+0000 7ff371c00640 1 --2- 172.21.15.29:0/4083750284 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff344065a60 0x7ff344067f20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0af000 tx=0x7ff35c008040 comp rx=0 tx=0).stop 2024-01-24T13:05:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.367+0000 7ff371c00640 1 -- 172.21.15.29:0/4083750284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff36c070ac0 msgr2=0x7ff36c139460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.367+0000 7ff371c00640 1 --2- 172.21.15.29:0/4083750284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff36c070ac0 0x7ff36c139460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff35400c4d0 tx=0x7ff35400c990 comp rx=0 tx=0).stop 2024-01-24T13:05:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.367+0000 7ff371c00640 1 -- 172.21.15.29:0/4083750284 shutdown_connections 2024-01-24T13:05:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.367+0000 7ff371c00640 1 --2- 172.21.15.29:0/4083750284 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff344065a60 0x7ff344067f20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.367+0000 7ff371c00640 1 --2- 172.21.15.29:0/4083750284 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff36c143910 0x7ff36c14d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.367+0000 7ff371c00640 1 --2- 172.21.15.29:0/4083750284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff36c070ac0 0x7ff36c139460 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.367+0000 7ff371c00640 1 --2- 172.21.15.29:0/4083750284 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff36c06c320 0x7ff36c137a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.367+0000 7ff371c00640 1 -- 172.21.15.29:0/4083750284 >> 172.21.15.29:0/4083750284 conn(0x7ff36c0b3950 msgr2=0x7ff36c06bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.367+0000 7ff371c00640 1 -- 172.21.15.29:0/4083750284 shutdown_connections 2024-01-24T13:05:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.367+0000 7ff371c00640 1 -- 172.21.15.29:0/4083750284 wait complete. 2024-01-24T13:05:01.390 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:05:01.390 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:05:01.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.531+0000 7f0f87e00640 1 Processor -- start 2024-01-24T13:05:01.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.531+0000 7f0f87e00640 1 -- start start 2024-01-24T13:05:01.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.531+0000 7f0f87e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0f8015a6f0 0x7f0f800c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.531+0000 7f0f87e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0f800ceb10 0x7f0f800cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.531+0000 7f0f87e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f800caad0 0x7f0f800caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.531+0000 7f0f87e00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f8015aad0 con 0x7f0f8015a6f0 2024-01-24T13:05:01.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.531+0000 7f0f87e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f800cb480 con 0x7f0f800ceb10 2024-01-24T13:05:01.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.531+0000 7f0f87e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800cd1e0 con 0x7f0f800caad0 2024-01-24T13:05:01.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f85400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0f8015a6f0 0x7f0f800c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f85400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0f8015a6f0 0x7f0f800c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40552/0 (socket says 172.21.15.29:40552) 2024-01-24T13:05:01.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f85400640 1 -- 172.21.15.29:0/2620951378 learned_addr learned my addr 172.21.15.29:0/2620951378 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:01.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f85e00640 1 --2- 172.21.15.29:0/2620951378 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f800caad0 0x7f0f800caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f84a00640 1 --2- 172.21.15.29:0/2620951378 >> v2:172.21.15.163:3300/0 conn(0x7f0f800ceb10 0x7f0f800cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f85400640 1 -- 172.21.15.29:0/2620951378 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f800caad0 msgr2=0x7f0f800caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:01.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f85400640 1 --2- 172.21.15.29:0/2620951378 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f800caad0 0x7f0f800caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f85400640 1 -- 172.21.15.29:0/2620951378 >> v2:172.21.15.163:3300/0 conn(0x7f0f800ceb10 msgr2=0x7f0f800cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:01.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f85400640 1 --2- 172.21.15.29:0/2620951378 >> v2:172.21.15.163:3300/0 conn(0x7f0f800ceb10 0x7f0f800cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f85400640 1 -- 172.21.15.29:0/2620951378 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f800cd4c0 con 0x7f0f8015a6f0 2024-01-24T13:05:01.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f84a00640 1 --2- 172.21.15.29:0/2620951378 >> v2:172.21.15.163:3300/0 conn(0x7f0f800ceb10 0x7f0f800cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:01.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f85400640 1 --2- 172.21.15.29:0/2620951378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f8015a6f0 0x7f0f800c3fd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0f8006f050 tx=0x7f0f7001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f88c6929b2fb99 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:01.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f7fe00640 1 -- 172.21.15.29:0/2620951378 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f700ab600 con 0x7f0f8015a6f0 2024-01-24T13:05:01.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f7fe00640 1 -- 172.21.15.29:0/2620951378 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f700ab760 con 0x7f0f8015a6f0 2024-01-24T13:05:01.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.535+0000 7f0f7fe00640 1 -- 172.21.15.29:0/2620951378 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f700abaf0 con 0x7f0f8015a6f0 2024-01-24T13:05:01.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 -- 172.21.15.29:0/2620951378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f8015a6f0 msgr2=0x7f0f800c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 --2- 172.21.15.29:0/2620951378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f8015a6f0 0x7f0f800c3fd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0f8006f050 tx=0x7f0f7001c440 comp rx=0 tx=0).stop 2024-01-24T13:05:01.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 -- 172.21.15.29:0/2620951378 shutdown_connections 2024-01-24T13:05:01.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 --2- 172.21.15.29:0/2620951378 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f800caad0 0x7f0f800caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 --2- 172.21.15.29:0/2620951378 >> v2:172.21.15.163:3300/0 conn(0x7f0f800ceb10 0x7f0f800cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 --2- 172.21.15.29:0/2620951378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f8015a6f0 0x7f0f800c3fd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 -- 172.21.15.29:0/2620951378 >> 172.21.15.29:0/2620951378 conn(0x7f0f80069cd0 msgr2=0x7f0f8006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:01.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 -- 172.21.15.29:0/2620951378 shutdown_connections 2024-01-24T13:05:01.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 -- 172.21.15.29:0/2620951378 wait complete. 2024-01-24T13:05:01.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 Processor -- start 2024-01-24T13:05:01.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 -- start start 2024-01-24T13:05:01.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f800caad0 0x7f0f8014c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f800ceb10 0x7f0f801622a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f8015a6f0 0x7f0f80157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8006b840 con 0x7f0f800ceb10 2024-01-24T13:05:01.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800c5e80 con 0x7f0f800caad0 2024-01-24T13:05:01.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f87e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8006af10 con 0x7f0f8015a6f0 2024-01-24T13:05:01.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.539+0000 7f0f84a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f800ceb10 0x7f0f801622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f84a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f800ceb10 0x7f0f801622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40554/0 (socket says 172.21.15.29:40554) 2024-01-24T13:05:01.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f84a00640 1 -- 172.21.15.29:0/4075009976 learned_addr learned my addr 172.21.15.29:0/4075009976 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:01.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f85400640 1 --2- 172.21.15.29:0/4075009976 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f800caad0 0x7f0f8014c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f85e00640 1 --2- 172.21.15.29:0/4075009976 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f8015a6f0 0x7f0f80157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f84a00640 1 -- 172.21.15.29:0/4075009976 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f8015a6f0 msgr2=0x7f0f80157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f84a00640 1 --2- 172.21.15.29:0/4075009976 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f8015a6f0 0x7f0f80157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f84a00640 1 -- 172.21.15.29:0/4075009976 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f800caad0 msgr2=0x7f0f8014c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f84a00640 1 --2- 172.21.15.29:0/4075009976 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f800caad0 0x7f0f8014c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f84a00640 1 -- 172.21.15.29:0/4075009976 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f700094d0 con 0x7f0f800ceb10 2024-01-24T13:05:01.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f84a00640 1 --2- 172.21.15.29:0/4075009976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f800ceb10 0x7f0f801622a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800e810 tx=0x7f0f6800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:01.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f7d600640 1 -- 172.21.15.29:0/4075009976 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800c8d0 con 0x7f0f800ceb10 2024-01-24T13:05:01.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f7d600640 1 -- 172.21.15.29:0/4075009976 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6800ca30 con 0x7f0f800ceb10 2024-01-24T13:05:01.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f87e00640 1 -- 172.21.15.29:0/4075009976 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8006b1f0 con 0x7f0f800ceb10 2024-01-24T13:05:01.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f7d600640 1 -- 172.21.15.29:0/4075009976 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800cde0 con 0x7f0f800ceb10 2024-01-24T13:05:01.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f87e00640 1 -- 172.21.15.29:0/4075009976 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8014cbe0 con 0x7f0f800ceb10 2024-01-24T13:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f87e00640 1 -- 172.21.15.29:0/4075009976 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8006b9f0 con 0x7f0f800ceb10 2024-01-24T13:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.543+0000 7f0f7d600640 1 -- 172.21.15.29:0/4075009976 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0f68013410 con 0x7f0f800ceb10 2024-01-24T13:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.547+0000 7f0f7d600640 1 --2- 172.21.15.29:0/4075009976 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0f58065a60 0x7f0f58067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.547+0000 7f0f7d600640 1 -- 172.21.15.29:0/4075009976 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f0f68083210 con 0x7f0f800ceb10 2024-01-24T13:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.547+0000 7f0f85400640 1 --2- 172.21.15.29:0/4075009976 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0f58065a60 0x7f0f58067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.547+0000 7f0f85400640 1 --2- 172.21.15.29:0/4075009976 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0f58065a60 0x7f0f58067f20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0f700af000 tx=0x7f0f700a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:01.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.551+0000 7f0f7d600640 1 -- 172.21.15.29:0/4075009976 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f0f8006b9f0 con 0x7f0f800ceb10 2024-01-24T13:05:01.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.707+0000 7f0f87e00640 1 -- 172.21.15.29:0/4075009976 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f8004e850 con 0x7f0f800ceb10 2024-01-24T13:05:01.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.707+0000 7f0f7d600640 1 -- 172.21.15.29:0/4075009976 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f68050940 con 0x7f0f800ceb10 2024-01-24T13:05:01.712 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:05:01.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.711+0000 7f0f87e00640 1 -- 172.21.15.29:0/4075009976 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0f58065a60 msgr2=0x7f0f58067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.711+0000 7f0f87e00640 1 --2- 172.21.15.29:0/4075009976 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0f58065a60 0x7f0f58067f20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0f700af000 tx=0x7f0f700a7000 comp rx=0 tx=0).stop 2024-01-24T13:05:01.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.711+0000 7f0f87e00640 1 -- 172.21.15.29:0/4075009976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f800ceb10 msgr2=0x7f0f801622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.711+0000 7f0f87e00640 1 --2- 172.21.15.29:0/4075009976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f800ceb10 0x7f0f801622a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800e810 tx=0x7f0f6800ecd0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.711+0000 7f0f87e00640 1 -- 172.21.15.29:0/4075009976 shutdown_connections 2024-01-24T13:05:01.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.711+0000 7f0f87e00640 1 --2- 172.21.15.29:0/4075009976 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0f58065a60 0x7f0f58067f20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.711+0000 7f0f87e00640 1 --2- 172.21.15.29:0/4075009976 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0f8015a6f0 0x7f0f80157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.711+0000 7f0f87e00640 1 --2- 172.21.15.29:0/4075009976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f800ceb10 0x7f0f801622a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.711+0000 7f0f87e00640 1 --2- 172.21.15.29:0/4075009976 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f800caad0 0x7f0f8014c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.711+0000 7f0f87e00640 1 -- 172.21.15.29:0/4075009976 >> 172.21.15.29:0/4075009976 conn(0x7f0f80069cd0 msgr2=0x7f0f800b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:01.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.711+0000 7f0f87e00640 1 -- 172.21.15.29:0/4075009976 shutdown_connections 2024-01-24T13:05:01.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.711+0000 7f0f87e00640 1 -- 172.21.15.29:0/4075009976 wait complete. 2024-01-24T13:05:01.734 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:05:01.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.875+0000 7fd963400640 1 Processor -- start 2024-01-24T13:05:01.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.875+0000 7fd963400640 1 -- start start 2024-01-24T13:05:01.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.875+0000 7fd963400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd95c158ca0 0x7fd95c0b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.875+0000 7fd963400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd95c070560 0x7fd95c06c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.875+0000 7fd963400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95c06c560 con 0x7fd95c06bbc0 2024-01-24T13:05:01.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.875+0000 7fd963400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c0709b0 con 0x7fd95c158ca0 2024-01-24T13:05:01.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.875+0000 7fd963400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c159080 con 0x7fd95c070560 2024-01-24T13:05:01.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.875+0000 7fd95be00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd95c06bbc0 0x7fd95c06fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37152/0 (socket says 172.21.15.29:37152) 2024-01-24T13:05:01.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.875+0000 7fd95be00640 1 -- 172.21.15.29:0/2617340483 learned_addr learned my addr 172.21.15.29:0/2617340483 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:01.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.875+0000 7fd960a00640 1 --2- 172.21.15.29:0/2617340483 >> v2:172.21.15.163:3300/0 conn(0x7fd95c158ca0 0x7fd95c0b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.875+0000 7fd961400640 1 --2- 172.21.15.29:0/2617340483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd95c070560 0x7fd95c06c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.875+0000 7fd95b400640 1 -- 172.21.15.29:0/2617340483 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229282256 0 0) 0x7fd95c06c560 con 0x7fd95c06bbc0 2024-01-24T13:05:01.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.875+0000 7fd95b400640 1 -- 172.21.15.29:0/2617340483 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd93c003530 con 0x7fd95c06bbc0 2024-01-24T13:05:01.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95b400640 1 -- 172.21.15.29:0/2617340483 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2435404762 0 0) 0x7fd93c003530 con 0x7fd95c06bbc0 2024-01-24T13:05:01.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95b400640 1 -- 172.21.15.29:0/2617340483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd95c070560 msgr2=0x7fd95c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95b400640 1 --2- 172.21.15.29:0/2617340483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd95c070560 0x7fd95c06c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95b400640 1 -- 172.21.15.29:0/2617340483 >> v2:172.21.15.163:3300/0 conn(0x7fd95c158ca0 msgr2=0x7fd95c0b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95b400640 1 --2- 172.21.15.29:0/2617340483 >> v2:172.21.15.163:3300/0 conn(0x7fd95c158ca0 0x7fd95c0b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95b400640 1 -- 172.21.15.29:0/2617340483 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c070ba0 con 0x7fd95c06bbc0 2024-01-24T13:05:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95b400640 1 -- 172.21.15.29:0/2617340483 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7fd944001680 con 0x7fd95c06bbc0 2024-01-24T13:05:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95b400640 1 -- 172.21.15.29:0/2617340483 >> v1:172.21.15.29:6789/0 conn(0x7fd95c06bbc0 legacy=0x7fd95c06fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95b400640 1 --2- 172.21.15.29:0/2617340483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd95c070560 0x7fd93c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95b400640 1 --2- 172.21.15.29:0/2617340483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd93c003f00 0x7fd93c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95b400640 1 --2- 172.21.15.29:0/2617340483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd93c004d10 0x7fd93c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95b400640 1 -- 172.21.15.29:0/2617340483 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c159080 con 0x7fd93c004d10 2024-01-24T13:05:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95b400640 1 -- 172.21.15.29:0/2617340483 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c00b990 con 0x7fd93c003f00 2024-01-24T13:05:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95b400640 1 -- 172.21.15.29:0/2617340483 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c00bad0 con 0x7fd95c070560 2024-01-24T13:05:01.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd961400640 1 --2- 172.21.15.29:0/2617340483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd93c004d10 0x7fd93c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd95be00640 1 --2- 172.21.15.29:0/2617340483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd93c003f00 0x7fd93c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd960a00640 1 --2- 172.21.15.29:0/2617340483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd95c070560 0x7fd93c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd961400640 1 -- 172.21.15.29:0/2617340483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd95c070560 msgr2=0x7fd93c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:01.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd961400640 1 --2- 172.21.15.29:0/2617340483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd95c070560 0x7fd93c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd961400640 1 -- 172.21.15.29:0/2617340483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd93c003f00 msgr2=0x7fd93c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:01.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd961400640 1 --2- 172.21.15.29:0/2617340483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd93c003f00 0x7fd93c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd961400640 1 -- 172.21.15.29:0/2617340483 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c003530 con 0x7fd93c004d10 2024-01-24T13:05:01.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.879+0000 7fd961400640 1 --2- 172.21.15.29:0/2617340483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd93c004d10 0x7fd93c005190 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd954009fc0 tx=0x7fd95401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5648e2803d2ea87 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:01.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd95b400640 1 -- 172.21.15.29:0/2617340483 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540a5c70 con 0x7fd93c004d10 2024-01-24T13:05:01.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd95b400640 1 -- 172.21.15.29:0/2617340483 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95400f040 con 0x7fd93c004d10 2024-01-24T13:05:01.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd95b400640 1 -- 172.21.15.29:0/2617340483 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540ad440 con 0x7fd93c004d10 2024-01-24T13:05:01.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd963400640 1 -- 172.21.15.29:0/2617340483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd93c004d10 msgr2=0x7fd93c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd963400640 1 --2- 172.21.15.29:0/2617340483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd93c004d10 0x7fd93c005190 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd954009fc0 tx=0x7fd95401cc00 comp rx=0 tx=0).stop 2024-01-24T13:05:01.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd961400640 1 -- 172.21.15.29:0/2617340483 reap_dead start 2024-01-24T13:05:01.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd963400640 1 -- 172.21.15.29:0/2617340483 shutdown_connections 2024-01-24T13:05:01.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd963400640 1 -- 172.21.15.29:0/2617340483 >> 172.21.15.29:0/2617340483 conn(0x7fd95c06d700 msgr2=0x7fd95c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:01.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd963400640 1 -- 172.21.15.29:0/2617340483 shutdown_connections 2024-01-24T13:05:01.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd963400640 1 -- 172.21.15.29:0/2617340483 wait complete. 2024-01-24T13:05:01.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd963400640 1 Processor -- start 2024-01-24T13:05:01.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd963400640 1 -- start start 2024-01-24T13:05:01.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd963400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd93c004d10 0x7fd95c1483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd963400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd95c14a7a0 0x7fd95c14ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd963400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd95c0cc730 0x7fd95c0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd963400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0c6610 con 0x7fd93c004d10 2024-01-24T13:05:01.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd963400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c14b140 con 0x7fd95c14a7a0 2024-01-24T13:05:01.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.883+0000 7fd963400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0cd4d0 con 0x7fd95c0cc730 2024-01-24T13:05:01.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd960a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd93c004d10 0x7fd95c1483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd960a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd93c004d10 0x7fd95c1483c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40572/0 (socket says 172.21.15.29:40572) 2024-01-24T13:05:01.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd960a00640 1 -- 172.21.15.29:0/3044459565 learned_addr learned my addr 172.21.15.29:0/3044459565 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:01.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd95be00640 1 --2- 172.21.15.29:0/3044459565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd95c14a7a0 0x7fd95c14ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd961400640 1 --2- 172.21.15.29:0/3044459565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd95c0cc730 0x7fd95c0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd960a00640 1 -- 172.21.15.29:0/3044459565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd95c0cc730 msgr2=0x7fd95c0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd960a00640 1 --2- 172.21.15.29:0/3044459565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd95c0cc730 0x7fd95c0ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd960a00640 1 -- 172.21.15.29:0/3044459565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd95c14a7a0 msgr2=0x7fd95c14ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:01.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd960a00640 1 --2- 172.21.15.29:0/3044459565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd95c14a7a0 0x7fd95c14ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:01.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd960a00640 1 -- 172.21.15.29:0/3044459565 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c149d70 con 0x7fd93c004d10 2024-01-24T13:05:01.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd960a00640 1 --2- 172.21.15.29:0/3044459565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd93c004d10 0x7fd95c1483c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009fd0 tx=0x7fd94c011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:01.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd958c00640 1 -- 172.21.15.29:0/3044459565 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00faf0 con 0x7fd93c004d10 2024-01-24T13:05:01.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd958c00640 1 -- 172.21.15.29:0/3044459565 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c00fc50 con 0x7fd93c004d10 2024-01-24T13:05:01.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd963400640 1 -- 172.21.15.29:0/3044459565 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95c0cb640 con 0x7fd93c004d10 2024-01-24T13:05:01.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd958c00640 1 -- 172.21.15.29:0/3044459565 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c014440 con 0x7fd93c004d10 2024-01-24T13:05:01.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd963400640 1 -- 172.21.15.29:0/3044459565 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95c0cbc00 con 0x7fd93c004d10 2024-01-24T13:05:01.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd963400640 1 -- 172.21.15.29:0/3044459565 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95c04e850 con 0x7fd93c004d10 2024-01-24T13:05:01.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.887+0000 7fd958c00640 1 -- 172.21.15.29:0/3044459565 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd94c0145a0 con 0x7fd93c004d10 2024-01-24T13:05:01.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.891+0000 7fd958c00640 1 --2- 172.21.15.29:0/3044459565 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd934065ab0 0x7fd934067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:01.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.891+0000 7fd958c00640 1 -- 172.21.15.29:0/3044459565 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fd94c083c10 con 0x7fd93c004d10 2024-01-24T13:05:01.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.891+0000 7fd95be00640 1 --2- 172.21.15.29:0/3044459565 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd934065ab0 0x7fd934067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:01.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.891+0000 7fd95be00640 1 --2- 172.21.15.29:0/3044459565 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd934065ab0 0x7fd934067f70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0c46d0 tx=0x7fd944007900 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:01.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:01.895+0000 7fd958c00640 1 -- 172.21.15.29:0/3044459565 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd94c0513d0 con 0x7fd93c004d10 2024-01-24T13:05:02.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.047+0000 7fd963400640 1 -- 172.21.15.29:0/3044459565 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd95c14ee40 con 0x7fd93c004d10 2024-01-24T13:05:02.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.051+0000 7fd958c00640 1 -- 172.21.15.29:0/3044459565 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd94c0549f0 con 0x7fd93c004d10 2024-01-24T13:05:02.053 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:02.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.051+0000 7fd963400640 1 -- 172.21.15.29:0/3044459565 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd934065ab0 msgr2=0x7fd934067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.051+0000 7fd963400640 1 --2- 172.21.15.29:0/3044459565 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd934065ab0 0x7fd934067f70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0c46d0 tx=0x7fd944007900 comp rx=0 tx=0).stop 2024-01-24T13:05:02.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.051+0000 7fd963400640 1 -- 172.21.15.29:0/3044459565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd93c004d10 msgr2=0x7fd95c1483c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.051+0000 7fd963400640 1 --2- 172.21.15.29:0/3044459565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd93c004d10 0x7fd95c1483c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009fd0 tx=0x7fd94c011e40 comp rx=0 tx=0).stop 2024-01-24T13:05:02.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.051+0000 7fd963400640 1 -- 172.21.15.29:0/3044459565 shutdown_connections 2024-01-24T13:05:02.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.051+0000 7fd963400640 1 --2- 172.21.15.29:0/3044459565 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd934065ab0 0x7fd934067f70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.051+0000 7fd963400640 1 --2- 172.21.15.29:0/3044459565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd95c0cc730 0x7fd95c0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.051+0000 7fd963400640 1 --2- 172.21.15.29:0/3044459565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd95c14a7a0 0x7fd95c14ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.051+0000 7fd963400640 1 --2- 172.21.15.29:0/3044459565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd93c004d10 0x7fd95c1483c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.051+0000 7fd963400640 1 -- 172.21.15.29:0/3044459565 >> 172.21.15.29:0/3044459565 conn(0x7fd95c06d700 msgr2=0x7fd95c14f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:02.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.051+0000 7fd963400640 1 -- 172.21.15.29:0/3044459565 shutdown_connections 2024-01-24T13:05:02.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.051+0000 7fd963400640 1 -- 172.21.15.29:0/3044459565 wait complete. 2024-01-24T13:05:02.075 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:05:02.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.215+0000 7f247d600640 1 Processor -- start 2024-01-24T13:05:02.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.215+0000 7f247d600640 1 -- start start 2024-01-24T13:05:02.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.215+0000 7f247d600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f247806be20 0x7f247815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.215+0000 7f247d600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f247806c200 0x7f247815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.215+0000 7f247d600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247815b4f0 con 0x7f247813cda0 2024-01-24T13:05:02.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.215+0000 7f247d600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247815b7d0 con 0x7f247806be20 2024-01-24T13:05:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.215+0000 7f247d600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24780cd0c0 con 0x7f247806c200 2024-01-24T13:05:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.215+0000 7f2476a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f247806be20 0x7f247815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.215+0000 7f2476a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f247806be20 0x7f247815a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40576/0 (socket says 172.21.15.29:40576) 2024-01-24T13:05:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.215+0000 7f2476a00640 1 -- 172.21.15.29:0/2371571806 learned_addr learned my addr 172.21.15.29:0/2371571806 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.215+0000 7f2476000640 1 --2- 172.21.15.29:0/2371571806 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f247806c200 0x7f247815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.219+0000 7f2476a00640 1 -- 172.21.15.29:0/2371571806 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f247806c200 msgr2=0x7f247815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.219+0000 7f2476a00640 1 --2- 172.21.15.29:0/2371571806 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f247806c200 0x7f247815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.219+0000 7f2476a00640 1 -- 172.21.15.29:0/2371571806 >> v1:172.21.15.29:6789/0 conn(0x7f247813cda0 legacy=0x7f247813d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.219+0000 7f2476a00640 1 -- 172.21.15.29:0/2371571806 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24780cd3a0 con 0x7f247806be20 2024-01-24T13:05:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.219+0000 7f2476a00640 1 --2- 172.21.15.29:0/2371571806 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f247806be20 0x7f247815a9c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2468009870 tx=0x7f246801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1468ceb288116daf server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.219+0000 7f2475600640 1 -- 172.21.15.29:0/2371571806 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24680a9620 con 0x7f247806be20 2024-01-24T13:05:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.219+0000 7f2475600640 1 -- 172.21.15.29:0/2371571806 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24680a9780 con 0x7f247806be20 2024-01-24T13:05:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.219+0000 7f2475600640 1 -- 172.21.15.29:0/2371571806 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24680a9b10 con 0x7f247806be20 2024-01-24T13:05:02.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.219+0000 7f247d600640 1 -- 172.21.15.29:0/2371571806 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f247806be20 msgr2=0x7f247815a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.219+0000 7f247d600640 1 --2- 172.21.15.29:0/2371571806 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f247806be20 0x7f247815a9c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2468009870 tx=0x7f246801c500 comp rx=0 tx=0).stop 2024-01-24T13:05:02.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f247d600640 1 -- 172.21.15.29:0/2371571806 shutdown_connections 2024-01-24T13:05:02.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f247d600640 1 --2- 172.21.15.29:0/2371571806 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f247806c200 0x7f247815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f247d600640 1 --2- 172.21.15.29:0/2371571806 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f247806be20 0x7f247815a9c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f247d600640 1 -- 172.21.15.29:0/2371571806 >> 172.21.15.29:0/2371571806 conn(0x7f247806d700 msgr2=0x7f2478069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:02.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f247d600640 1 -- 172.21.15.29:0/2371571806 shutdown_connections 2024-01-24T13:05:02.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f247d600640 1 -- 172.21.15.29:0/2371571806 wait complete. 2024-01-24T13:05:02.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f247d600640 1 Processor -- start 2024-01-24T13:05:02.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f247d600640 1 -- start start 2024-01-24T13:05:02.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f247d600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f247806be20 0x7f2478071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f247d600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f247806c200 0x7f2478148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f247d600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f247813cda0 0x7f24781f8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f247d600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24781f8f10 con 0x7f247813cda0 2024-01-24T13:05:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f247d600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2478071090 con 0x7f247806c200 2024-01-24T13:05:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f247d600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2478070760 con 0x7f247806be20 2024-01-24T13:05:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f2477400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f247813cda0 0x7f24781f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f2477400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f247813cda0 0x7f24781f8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40580/0 (socket says 172.21.15.29:40580) 2024-01-24T13:05:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f2477400640 1 -- 172.21.15.29:0/2201672433 learned_addr learned my addr 172.21.15.29:0/2201672433 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f2476000640 1 --2- 172.21.15.29:0/2201672433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f247806c200 0x7f2478148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f2476a00640 1 --2- 172.21.15.29:0/2201672433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f247806be20 0x7f2478071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f2477400640 1 -- 172.21.15.29:0/2201672433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f247806be20 msgr2=0x7f2478071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f2477400640 1 --2- 172.21.15.29:0/2201672433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f247806be20 0x7f2478071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f2477400640 1 -- 172.21.15.29:0/2201672433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f247806c200 msgr2=0x7f2478148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f2477400640 1 --2- 172.21.15.29:0/2201672433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f247806c200 0x7f2478148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.223+0000 7f2477400640 1 -- 172.21.15.29:0/2201672433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24680094d0 con 0x7f247813cda0 2024-01-24T13:05:02.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.227+0000 7f2477400640 1 --2- 172.21.15.29:0/2201672433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f247813cda0 0x7f24781f8090 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f247000c730 tx=0x7f247000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:02.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.227+0000 7f246ea00640 1 -- 172.21.15.29:0/2201672433 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470003b80 con 0x7f247813cda0 2024-01-24T13:05:02.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.227+0000 7f246ea00640 1 -- 172.21.15.29:0/2201672433 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2470003ce0 con 0x7f247813cda0 2024-01-24T13:05:02.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.227+0000 7f246ea00640 1 -- 172.21.15.29:0/2201672433 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247000aa30 con 0x7f247813cda0 2024-01-24T13:05:02.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.227+0000 7f247d600640 1 -- 172.21.15.29:0/2201672433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2478070a40 con 0x7f247813cda0 2024-01-24T13:05:02.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.227+0000 7f247d600640 1 -- 172.21.15.29:0/2201672433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2478071a60 con 0x7f247813cda0 2024-01-24T13:05:02.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.227+0000 7f247d600640 1 -- 172.21.15.29:0/2201672433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2478071200 con 0x7f247813cda0 2024-01-24T13:05:02.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.227+0000 7f246ea00640 1 -- 172.21.15.29:0/2201672433 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f247000ab90 con 0x7f247813cda0 2024-01-24T13:05:02.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.227+0000 7f246ea00640 1 --2- 172.21.15.29:0/2201672433 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2450065a90 0x7f2450067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.227+0000 7f246ea00640 1 -- 172.21.15.29:0/2201672433 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f24700830c0 con 0x7f247813cda0 2024-01-24T13:05:02.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.227+0000 7f2476a00640 1 --2- 172.21.15.29:0/2201672433 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2450065a90 0x7f2450067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.231+0000 7f2476a00640 1 --2- 172.21.15.29:0/2201672433 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2450065a90 0x7f2450067f50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f24680ae000 tx=0x7f24680b3040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:02.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.231+0000 7f246ea00640 1 -- 172.21.15.29:0/2201672433 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f24700507f0 con 0x7f247813cda0 2024-01-24T13:05:02.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.387+0000 7f247d600640 1 -- 172.21.15.29:0/2201672433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f247804e850 con 0x7f247813cda0 2024-01-24T13:05:02.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.387+0000 7f246ea00640 1 -- 172.21.15.29:0/2201672433 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2470053e10 con 0x7f247813cda0 2024-01-24T13:05:02.392 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:05:02.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.391+0000 7f247d600640 1 -- 172.21.15.29:0/2201672433 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2450065a90 msgr2=0x7f2450067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.391+0000 7f247d600640 1 --2- 172.21.15.29:0/2201672433 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2450065a90 0x7f2450067f50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f24680ae000 tx=0x7f24680b3040 comp rx=0 tx=0).stop 2024-01-24T13:05:02.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.391+0000 7f247d600640 1 -- 172.21.15.29:0/2201672433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f247813cda0 msgr2=0x7f24781f8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.391+0000 7f247d600640 1 --2- 172.21.15.29:0/2201672433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f247813cda0 0x7f24781f8090 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f247000c730 tx=0x7f247000cbf0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.391+0000 7f247d600640 1 -- 172.21.15.29:0/2201672433 shutdown_connections 2024-01-24T13:05:02.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.391+0000 7f247d600640 1 --2- 172.21.15.29:0/2201672433 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2450065a90 0x7f2450067f50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.391+0000 7f247d600640 1 --2- 172.21.15.29:0/2201672433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f247813cda0 0x7f24781f8090 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.391+0000 7f247d600640 1 --2- 172.21.15.29:0/2201672433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f247806c200 0x7f2478148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.391+0000 7f247d600640 1 --2- 172.21.15.29:0/2201672433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f247806be20 0x7f2478071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.391+0000 7f247d600640 1 -- 172.21.15.29:0/2201672433 >> 172.21.15.29:0/2201672433 conn(0x7f247806d700 msgr2=0x7f24780ac600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:02.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.391+0000 7f247d600640 1 -- 172.21.15.29:0/2201672433 shutdown_connections 2024-01-24T13:05:02.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.391+0000 7f247d600640 1 -- 172.21.15.29:0/2201672433 wait complete. 2024-01-24T13:05:02.414 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:05:02.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.555+0000 7f51f2c00640 1 Processor -- start 2024-01-24T13:05:02.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.555+0000 7f51f2c00640 1 -- start start 2024-01-24T13:05:02.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.555+0000 7f51f2c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f51ec142980 0x7f51ec0cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.555+0000 7f51f2c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec0cd7e0 con 0x7f51ec0cd350 2024-01-24T13:05:02.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.555+0000 7f51f2c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec1611b0 con 0x7f51ec06c860 2024-01-24T13:05:02.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.555+0000 7f51f2c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec160630 con 0x7f51ec142980 2024-01-24T13:05:02.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.555+0000 7f51eb400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f51ec142980 0x7f51ec0cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.559+0000 7f51eb400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f51ec142980 0x7f51ec0cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40592/0 (socket says 172.21.15.29:40592) 2024-01-24T13:05:02.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.559+0000 7f51eb400640 1 -- 172.21.15.29:0/1907498780 learned_addr learned my addr 172.21.15.29:0/1907498780 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:02.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.559+0000 7f51eb400640 1 -- 172.21.15.29:0/1907498780 >> v1:172.21.15.163:6789/0 conn(0x7f51ec06c860 legacy=0x7f51ec06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.559+0000 7f51eb400640 1 -- 172.21.15.29:0/1907498780 >> v1:172.21.15.29:6789/0 conn(0x7f51ec0cd350 legacy=0x7f51ec15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.559+0000 7f51eb400640 1 -- 172.21.15.29:0/1907498780 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec160910 con 0x7f51ec142980 2024-01-24T13:05:02.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.559+0000 7f51eb400640 1 --2- 172.21.15.29:0/1907498780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51ec142980 0x7f51ec0cce10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009870 tx=0x7f51d401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8049fe5c728ee9ba server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:02.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.559+0000 7f51eaa00640 1 -- 172.21.15.29:0/1907498780 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40aa670 con 0x7f51ec142980 2024-01-24T13:05:02.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.559+0000 7f51eaa00640 1 -- 172.21.15.29:0/1907498780 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d40aa7d0 con 0x7f51ec142980 2024-01-24T13:05:02.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.559+0000 7f51eaa00640 1 -- 172.21.15.29:0/1907498780 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40aab60 con 0x7f51ec142980 2024-01-24T13:05:02.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 -- 172.21.15.29:0/1907498780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51ec142980 msgr2=0x7f51ec0cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 --2- 172.21.15.29:0/1907498780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51ec142980 0x7f51ec0cce10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009870 tx=0x7f51d401c510 comp rx=0 tx=0).stop 2024-01-24T13:05:02.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 -- 172.21.15.29:0/1907498780 shutdown_connections 2024-01-24T13:05:02.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 --2- 172.21.15.29:0/1907498780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51ec142980 0x7f51ec0cce10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 -- 172.21.15.29:0/1907498780 >> 172.21.15.29:0/1907498780 conn(0x7f51ec069cd0 msgr2=0x7f51ec06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:02.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 -- 172.21.15.29:0/1907498780 shutdown_connections 2024-01-24T13:05:02.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 -- 172.21.15.29:0/1907498780 wait complete. 2024-01-24T13:05:02.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 Processor -- start 2024-01-24T13:05:02.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 -- start start 2024-01-24T13:05:02.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51ec06c860 0x7f51ec156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51ec0cd350 0x7f51ec0c3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51ec142980 0x7f51ec15afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0c3560 con 0x7f51ec142980 2024-01-24T13:05:02.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec15b4e0 con 0x7f51ec06c860 2024-01-24T13:05:02.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f2c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0b31b0 con 0x7f51ec0cd350 2024-01-24T13:05:02.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f0c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51ec142980 0x7f51ec15afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51ebe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51ec06c860 0x7f51ec156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f0c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51ec142980 0x7f51ec15afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40604/0 (socket says 172.21.15.29:40604) 2024-01-24T13:05:02.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51f0c00640 1 -- 172.21.15.29:0/2108220859 learned_addr learned my addr 172.21.15.29:0/2108220859 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:02.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.563+0000 7f51eb400640 1 --2- 172.21.15.29:0/2108220859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51ec0cd350 0x7f51ec0c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51f0c00640 1 -- 172.21.15.29:0/2108220859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51ec0cd350 msgr2=0x7f51ec0c3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51f0c00640 1 --2- 172.21.15.29:0/2108220859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51ec0cd350 0x7f51ec0c3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51f0c00640 1 -- 172.21.15.29:0/2108220859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51ec06c860 msgr2=0x7f51ec156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51f0c00640 1 --2- 172.21.15.29:0/2108220859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51ec06c860 0x7f51ec156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51f0c00640 1 -- 172.21.15.29:0/2108220859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d40094d0 con 0x7f51ec142980 2024-01-24T13:05:02.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51f0c00640 1 --2- 172.21.15.29:0/2108220859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51ec142980 0x7f51ec15afa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f51e400c770 tx=0x7f51e400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:02.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51e3e00640 1 -- 172.21.15.29:0/2108220859 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4003b80 con 0x7f51ec142980 2024-01-24T13:05:02.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51e3e00640 1 -- 172.21.15.29:0/2108220859 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e4003ce0 con 0x7f51ec142980 2024-01-24T13:05:02.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51e3e00640 1 -- 172.21.15.29:0/2108220859 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400aa90 con 0x7f51ec142980 2024-01-24T13:05:02.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51f2c00640 1 -- 172.21.15.29:0/2108220859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec0b3490 con 0x7f51ec142980 2024-01-24T13:05:02.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51f2c00640 1 -- 172.21.15.29:0/2108220859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec0b3a50 con 0x7f51ec142980 2024-01-24T13:05:02.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51f2c00640 1 -- 172.21.15.29:0/2108220859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec0b3c40 con 0x7f51ec142980 2024-01-24T13:05:02.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51e3e00640 1 -- 172.21.15.29:0/2108220859 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f51e400abf0 con 0x7f51ec142980 2024-01-24T13:05:02.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51e3e00640 1 --2- 172.21.15.29:0/2108220859 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f51c4065a60 0x7f51c4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.567+0000 7f51e3e00640 1 -- 172.21.15.29:0/2108220859 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f51e4083240 con 0x7f51ec142980 2024-01-24T13:05:02.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.571+0000 7f51ebe00640 1 --2- 172.21.15.29:0/2108220859 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f51c4065a60 0x7f51c4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.571+0000 7f51ebe00640 1 --2- 172.21.15.29:0/2108220859 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f51c4065a60 0x7f51c4067f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f51dc007fd0 tx=0x7f51dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:02.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.571+0000 7f51e3e00640 1 -- 172.21.15.29:0/2108220859 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f51e40508e0 con 0x7f51ec142980 2024-01-24T13:05:02.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.727+0000 7f51f2c00640 1 -- 172.21.15.29:0/2108220859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f51ec04e850 con 0x7f51ec142980 2024-01-24T13:05:02.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.727+0000 7f51e3e00640 1 -- 172.21.15.29:0/2108220859 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f51e4053f00 con 0x7f51ec142980 2024-01-24T13:05:02.732 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:02.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.731+0000 7f51f2c00640 1 -- 172.21.15.29:0/2108220859 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f51c4065a60 msgr2=0x7f51c4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.731+0000 7f51f2c00640 1 --2- 172.21.15.29:0/2108220859 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f51c4065a60 0x7f51c4067f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f51dc007fd0 tx=0x7f51dc009040 comp rx=0 tx=0).stop 2024-01-24T13:05:02.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.731+0000 7f51f2c00640 1 -- 172.21.15.29:0/2108220859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51ec142980 msgr2=0x7f51ec15afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.731+0000 7f51f2c00640 1 --2- 172.21.15.29:0/2108220859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51ec142980 0x7f51ec15afa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f51e400c770 tx=0x7f51e400cc30 comp rx=0 tx=0).stop 2024-01-24T13:05:02.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.731+0000 7f51f2c00640 1 -- 172.21.15.29:0/2108220859 shutdown_connections 2024-01-24T13:05:02.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.731+0000 7f51f2c00640 1 --2- 172.21.15.29:0/2108220859 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f51c4065a60 0x7f51c4067f20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.731+0000 7f51f2c00640 1 --2- 172.21.15.29:0/2108220859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51ec142980 0x7f51ec15afa0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.731+0000 7f51f2c00640 1 --2- 172.21.15.29:0/2108220859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f51ec0cd350 0x7f51ec0c3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.731+0000 7f51f2c00640 1 --2- 172.21.15.29:0/2108220859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51ec06c860 0x7f51ec156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.731+0000 7f51f2c00640 1 -- 172.21.15.29:0/2108220859 >> 172.21.15.29:0/2108220859 conn(0x7f51ec069cd0 msgr2=0x7f51ec0d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:02.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.731+0000 7f51f2c00640 1 -- 172.21.15.29:0/2108220859 shutdown_connections 2024-01-24T13:05:02.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.731+0000 7f51f2c00640 1 -- 172.21.15.29:0/2108220859 wait complete. 2024-01-24T13:05:02.755 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:05:02.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.891+0000 7f131e200640 1 Processor -- start 2024-01-24T13:05:02.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.891+0000 7f131e200640 1 -- start start 2024-01-24T13:05:02.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.895+0000 7f131e200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f131815aab0 0x7f131815af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.895+0000 7f131e200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131815e220 con 0x7f131806fbc0 2024-01-24T13:05:02.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.895+0000 7f131e200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13180cb630 con 0x7f13180cb250 2024-01-24T13:05:02.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.895+0000 7f131e200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131815b570 con 0x7f131815aab0 2024-01-24T13:05:02.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.895+0000 7f1316a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f131815aab0 0x7f131815af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.895+0000 7f1316a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f131815aab0 0x7f131815af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40616/0 (socket says 172.21.15.29:40616) 2024-01-24T13:05:02.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.895+0000 7f1316a00640 1 -- 172.21.15.29:0/2015332072 learned_addr learned my addr 172.21.15.29:0/2015332072 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:02.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.895+0000 7f1316a00640 1 -- 172.21.15.29:0/2015332072 >> v1:172.21.15.163:6789/0 conn(0x7f13180cb250 legacy=0x7f131815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:02.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.895+0000 7f1316a00640 1 -- 172.21.15.29:0/2015332072 >> v1:172.21.15.29:6789/0 conn(0x7f131806fbc0 legacy=0x7f131806ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.895+0000 7f1316a00640 1 -- 172.21.15.29:0/2015332072 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131815b850 con 0x7f131815aab0 2024-01-24T13:05:02.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.899+0000 7f1316a00640 1 --2- 172.21.15.29:0/2015332072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f131815aab0 0x7f131815af40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1300009870 tx=0x7f130001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6740582545b61bd9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:02.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.899+0000 7f1316000640 1 -- 172.21.15.29:0/2015332072 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000ab610 con 0x7f131815aab0 2024-01-24T13:05:02.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.899+0000 7f1316000640 1 -- 172.21.15.29:0/2015332072 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13000ab770 con 0x7f131815aab0 2024-01-24T13:05:02.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.899+0000 7f1316000640 1 -- 172.21.15.29:0/2015332072 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000abb00 con 0x7f131815aab0 2024-01-24T13:05:02.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.899+0000 7f131e200640 1 -- 172.21.15.29:0/2015332072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f131815aab0 msgr2=0x7f131815af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.899+0000 7f131e200640 1 --2- 172.21.15.29:0/2015332072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f131815aab0 0x7f131815af40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1300009870 tx=0x7f130001c500 comp rx=0 tx=0).stop 2024-01-24T13:05:02.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.899+0000 7f131e200640 1 -- 172.21.15.29:0/2015332072 shutdown_connections 2024-01-24T13:05:02.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.899+0000 7f131e200640 1 --2- 172.21.15.29:0/2015332072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f131815aab0 0x7f131815af40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.899+0000 7f131e200640 1 -- 172.21.15.29:0/2015332072 >> 172.21.15.29:0/2015332072 conn(0x7f131806a2d0 msgr2=0x7f13180afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:02.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.899+0000 7f131e200640 1 -- 172.21.15.29:0/2015332072 shutdown_connections 2024-01-24T13:05:02.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.899+0000 7f131e200640 1 -- 172.21.15.29:0/2015332072 wait complete. 2024-01-24T13:05:02.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.899+0000 7f131e200640 1 Processor -- start 2024-01-24T13:05:02.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.899+0000 7f131e200640 1 -- start start 2024-01-24T13:05:02.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.899+0000 7f131e200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f131806fbc0 0x7f131814e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f131e200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f13180cb250 0x7f13180c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f131e200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f131815aab0 0x7f131814a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f131e200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1318151b40 con 0x7f131815aab0 2024-01-24T13:05:02.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f131e200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131814abf0 con 0x7f131806fbc0 2024-01-24T13:05:02.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f131e200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13180c4550 con 0x7f13180cb250 2024-01-24T13:05:02.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f1317e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f131815aab0 0x7f131814a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f1317e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f131815aab0 0x7f131814a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40630/0 (socket says 172.21.15.29:40630) 2024-01-24T13:05:02.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f1317e00640 1 -- 172.21.15.29:0/2227994275 learned_addr learned my addr 172.21.15.29:0/2227994275 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:02.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f1316a00640 1 --2- 172.21.15.29:0/2227994275 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f13180cb250 0x7f13180c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f1317400640 1 --2- 172.21.15.29:0/2227994275 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f131806fbc0 0x7f131814e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f1317e00640 1 -- 172.21.15.29:0/2227994275 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f13180cb250 msgr2=0x7f13180c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f1317e00640 1 --2- 172.21.15.29:0/2227994275 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f13180cb250 0x7f13180c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f1317e00640 1 -- 172.21.15.29:0/2227994275 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f131806fbc0 msgr2=0x7f131814e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:02.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f1317e00640 1 --2- 172.21.15.29:0/2227994275 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f131806fbc0 0x7f131814e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:02.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f1317e00640 1 -- 172.21.15.29:0/2227994275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000094d0 con 0x7f131815aab0 2024-01-24T13:05:02.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f1317e00640 1 --2- 172.21.15.29:0/2227994275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f131815aab0 0x7f131814a2c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f131000c730 tx=0x7f131000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:02.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f130f400640 1 -- 172.21.15.29:0/2227994275 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310003b80 con 0x7f131815aab0 2024-01-24T13:05:02.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f130f400640 1 -- 172.21.15.29:0/2227994275 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1310003ce0 con 0x7f131815aab0 2024-01-24T13:05:02.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f130f400640 1 -- 172.21.15.29:0/2227994275 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131000aa30 con 0x7f131815aab0 2024-01-24T13:05:02.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f131e200640 1 -- 172.21.15.29:0/2227994275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13180cd370 con 0x7f131815aab0 2024-01-24T13:05:02.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f131e200640 1 -- 172.21.15.29:0/2227994275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131814a800 con 0x7f131815aab0 2024-01-24T13:05:02.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f131e200640 1 -- 172.21.15.29:0/2227994275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13181518a0 con 0x7f131815aab0 2024-01-24T13:05:02.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.903+0000 7f130f400640 1 -- 172.21.15.29:0/2227994275 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f131000ab90 con 0x7f131815aab0 2024-01-24T13:05:02.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.907+0000 7f130f400640 1 --2- 172.21.15.29:0/2227994275 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f12f0065a60 0x7f12f0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:02.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.907+0000 7f130f400640 1 -- 172.21.15.29:0/2227994275 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f1310083160 con 0x7f131815aab0 2024-01-24T13:05:02.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.907+0000 7f1317400640 1 --2- 172.21.15.29:0/2227994275 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f12f0065a60 0x7f12f0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:02.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.907+0000 7f1317400640 1 --2- 172.21.15.29:0/2227994275 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f12f0065a60 0x7f12f0067f20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1308004fc0 tx=0x7f1308007e90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:02.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:02.911+0000 7f130f400640 1 -- 172.21.15.29:0/2227994275 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f13181518a0 con 0x7f131815aab0 2024-01-24T13:05:03.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.079+0000 7f131e200640 1 -- 172.21.15.29:0/2227994275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1318151c80 con 0x7f131815aab0 2024-01-24T13:05:03.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.079+0000 7f130f400640 1 -- 172.21.15.29:0/2227994275 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1318151c80 con 0x7f131815aab0 2024-01-24T13:05:03.083 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:05:03.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.083+0000 7f131e200640 1 -- 172.21.15.29:0/2227994275 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f12f0065a60 msgr2=0x7f12f0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:03.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.083+0000 7f131e200640 1 --2- 172.21.15.29:0/2227994275 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f12f0065a60 0x7f12f0067f20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1308004fc0 tx=0x7f1308007e90 comp rx=0 tx=0).stop 2024-01-24T13:05:03.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.083+0000 7f131e200640 1 -- 172.21.15.29:0/2227994275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f131815aab0 msgr2=0x7f131814a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.083+0000 7f131e200640 1 --2- 172.21.15.29:0/2227994275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f131815aab0 0x7f131814a2c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f131000c730 tx=0x7f131000cbf0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.083+0000 7f131e200640 1 -- 172.21.15.29:0/2227994275 shutdown_connections 2024-01-24T13:05:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.083+0000 7f131e200640 1 --2- 172.21.15.29:0/2227994275 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f12f0065a60 0x7f12f0067f20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.083+0000 7f131e200640 1 --2- 172.21.15.29:0/2227994275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f131815aab0 0x7f131814a2c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.083+0000 7f131e200640 1 --2- 172.21.15.29:0/2227994275 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f13180cb250 0x7f13180c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.083+0000 7f131e200640 1 --2- 172.21.15.29:0/2227994275 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f131806fbc0 0x7f131814e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.083+0000 7f131e200640 1 -- 172.21.15.29:0/2227994275 >> 172.21.15.29:0/2227994275 conn(0x7f131806a2d0 msgr2=0x7f131815bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.083+0000 7f131e200640 1 -- 172.21.15.29:0/2227994275 shutdown_connections 2024-01-24T13:05:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.083+0000 7f131e200640 1 -- 172.21.15.29:0/2227994275 wait complete. 2024-01-24T13:05:03.106 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-01-24T13:05:03.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:03.106 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-01-24T13:05:03.127 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:05:03.127 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:05:03.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:03.128 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-01-24T13:05:03.181 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:05:03.181 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:05:03.191 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:05:03.191 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:05:03.242 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:03.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.379+0000 7fb921600640 1 Processor -- start 2024-01-24T13:05:03.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.379+0000 7fb921600640 1 -- start start 2024-01-24T13:05:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb921600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91c143910 0x7fb91c143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb921600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb91c070ac0 0x7fb91c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb921600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb91c06c150 0x7fb91c15dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb921600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91c06c5e0 con 0x7fb91c070ac0 2024-01-24T13:05:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb921600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91c15aa30 con 0x7fb91c06c150 2024-01-24T13:05:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb921600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c0712a0 con 0x7fb91c143910 2024-01-24T13:05:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb91a000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb91c070ac0 0x7fb91c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb91a000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb91c070ac0 0x7fb91c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40646/0 (socket says 172.21.15.29:40646) 2024-01-24T13:05:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb91a000640 1 -- 172.21.15.29:0/105313910 learned_addr learned my addr 172.21.15.29:0/105313910 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb91aa00640 1 --2- 172.21.15.29:0/105313910 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91c143910 0x7fb91c143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb91b400640 1 --2- 172.21.15.29:0/105313910 >> v2:172.21.15.163:3300/0 conn(0x7fb91c06c150 0x7fb91c15dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb91a000640 1 -- 172.21.15.29:0/105313910 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91c143910 msgr2=0x7fb91c143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb91a000640 1 --2- 172.21.15.29:0/105313910 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91c143910 0x7fb91c143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb91a000640 1 -- 172.21.15.29:0/105313910 >> v2:172.21.15.163:3300/0 conn(0x7fb91c06c150 msgr2=0x7fb91c15dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:03.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb91a000640 1 --2- 172.21.15.29:0/105313910 >> v2:172.21.15.163:3300/0 conn(0x7fb91c06c150 0x7fb91c15dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb91a000640 1 -- 172.21.15.29:0/105313910 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c071580 con 0x7fb91c070ac0 2024-01-24T13:05:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.383+0000 7fb91a000640 1 --2- 172.21.15.29:0/105313910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb91c070ac0 0x7fb91c06bc10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb91c06a970 tx=0x7fb90401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55c0994a5851d5b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb919600640 1 -- 172.21.15.29:0/105313910 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9040ab600 con 0x7fb91c070ac0 2024-01-24T13:05:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb919600640 1 -- 172.21.15.29:0/105313910 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9040a7050 con 0x7fb91c070ac0 2024-01-24T13:05:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb919600640 1 -- 172.21.15.29:0/105313910 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9040ab980 con 0x7fb91c070ac0 2024-01-24T13:05:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 -- 172.21.15.29:0/105313910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb91c070ac0 msgr2=0x7fb91c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 --2- 172.21.15.29:0/105313910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb91c070ac0 0x7fb91c06bc10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb91c06a970 tx=0x7fb90401c210 comp rx=0 tx=0).stop 2024-01-24T13:05:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 -- 172.21.15.29:0/105313910 shutdown_connections 2024-01-24T13:05:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 --2- 172.21.15.29:0/105313910 >> v2:172.21.15.163:3300/0 conn(0x7fb91c06c150 0x7fb91c15dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 --2- 172.21.15.29:0/105313910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb91c070ac0 0x7fb91c06bc10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 --2- 172.21.15.29:0/105313910 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91c143910 0x7fb91c143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 -- 172.21.15.29:0/105313910 >> 172.21.15.29:0/105313910 conn(0x7fb91c0b3950 msgr2=0x7fb91c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 -- 172.21.15.29:0/105313910 shutdown_connections 2024-01-24T13:05:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 -- 172.21.15.29:0/105313910 wait complete. 2024-01-24T13:05:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 Processor -- start 2024-01-24T13:05:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 -- start start 2024-01-24T13:05:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb91c06c150 0x7fb91c1427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91c070ac0 0x7fb91c0aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb91c143910 0x7fb91c153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c140f10 con 0x7fb91c06c150 2024-01-24T13:05:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c1411f0 con 0x7fb91c143910 2024-01-24T13:05:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.387+0000 7fb921600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c1414d0 con 0x7fb91c070ac0 2024-01-24T13:05:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb91aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb91c06c150 0x7fb91c1427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb91aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb91c06c150 0x7fb91c1427d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40648/0 (socket says 172.21.15.29:40648) 2024-01-24T13:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb91aa00640 1 -- 172.21.15.29:0/780689332 learned_addr learned my addr 172.21.15.29:0/780689332 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb91b400640 1 --2- 172.21.15.29:0/780689332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb91c143910 0x7fb91c153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb91a000640 1 --2- 172.21.15.29:0/780689332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91c070ac0 0x7fb91c0aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb91aa00640 1 -- 172.21.15.29:0/780689332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91c070ac0 msgr2=0x7fb91c0aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb91aa00640 1 --2- 172.21.15.29:0/780689332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91c070ac0 0x7fb91c0aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb91aa00640 1 -- 172.21.15.29:0/780689332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb91c143910 msgr2=0x7fb91c153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb91aa00640 1 --2- 172.21.15.29:0/780689332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb91c143910 0x7fb91c153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb91aa00640 1 -- 172.21.15.29:0/780689332 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9040094d0 con 0x7fb91c06c150 2024-01-24T13:05:03.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb91aa00640 1 --2- 172.21.15.29:0/780689332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb91c06c150 0x7fb91c1427d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00d5f0 tx=0x7fb90c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:03.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb912a00640 1 -- 172.21.15.29:0/780689332 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c0125f0 con 0x7fb91c06c150 2024-01-24T13:05:03.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb912a00640 1 -- 172.21.15.29:0/780689332 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c012750 con 0x7fb91c06c150 2024-01-24T13:05:03.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb912a00640 1 -- 172.21.15.29:0/780689332 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c012b00 con 0x7fb91c06c150 2024-01-24T13:05:03.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb921600640 1 -- 172.21.15.29:0/780689332 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91c1417b0 con 0x7fb91c06c150 2024-01-24T13:05:03.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb921600640 1 -- 172.21.15.29:0/780689332 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91c139e70 con 0x7fb91c06c150 2024-01-24T13:05:03.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb921600640 1 -- 172.21.15.29:0/780689332 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91c137b80 con 0x7fb91c06c150 2024-01-24T13:05:03.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.391+0000 7fb912a00640 1 -- 172.21.15.29:0/780689332 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb90c012c60 con 0x7fb91c06c150 2024-01-24T13:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.395+0000 7fb912a00640 1 --2- 172.21.15.29:0/780689332 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb8f4065a60 0x7fb8f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.395+0000 7fb912a00640 1 -- 172.21.15.29:0/780689332 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fb90c083990 con 0x7fb91c06c150 2024-01-24T13:05:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.395+0000 7fb91a000640 1 --2- 172.21.15.29:0/780689332 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb8f4065a60 0x7fb8f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.395+0000 7fb91a000640 1 --2- 172.21.15.29:0/780689332 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb8f4065a60 0x7fb8f4067f20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb9040ad000 tx=0x7fb9040a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.399+0000 7fb912a00640 1 -- 172.21.15.29:0/780689332 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb91c137b80 con 0x7fb91c06c150 2024-01-24T13:05:03.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.555+0000 7fb921600640 1 -- 172.21.15.29:0/780689332 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb91c137b80 con 0x7fb91c06c150 2024-01-24T13:05:03.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.559+0000 7fb912a00640 1 -- 172.21.15.29:0/780689332 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7fb91c137b80 con 0x7fb91c06c150 2024-01-24T13:05:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:03.561 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:03.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.559+0000 7fb921600640 1 -- 172.21.15.29:0/780689332 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb8f4065a60 msgr2=0x7fb8f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:03.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.559+0000 7fb921600640 1 --2- 172.21.15.29:0/780689332 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb8f4065a60 0x7fb8f4067f20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb9040ad000 tx=0x7fb9040a6000 comp rx=0 tx=0).stop 2024-01-24T13:05:03.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.559+0000 7fb921600640 1 -- 172.21.15.29:0/780689332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb91c06c150 msgr2=0x7fb91c1427d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:03.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.559+0000 7fb921600640 1 --2- 172.21.15.29:0/780689332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb91c06c150 0x7fb91c1427d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00d5f0 tx=0x7fb90c00dab0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.559+0000 7fb921600640 1 -- 172.21.15.29:0/780689332 shutdown_connections 2024-01-24T13:05:03.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.559+0000 7fb921600640 1 --2- 172.21.15.29:0/780689332 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb8f4065a60 0x7fb8f4067f20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.559+0000 7fb921600640 1 --2- 172.21.15.29:0/780689332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb91c143910 0x7fb91c153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.559+0000 7fb921600640 1 --2- 172.21.15.29:0/780689332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb91c070ac0 0x7fb91c0aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.559+0000 7fb921600640 1 --2- 172.21.15.29:0/780689332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb91c06c150 0x7fb91c1427d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.559+0000 7fb921600640 1 -- 172.21.15.29:0/780689332 >> 172.21.15.29:0/780689332 conn(0x7fb91c0b3950 msgr2=0x7fb91c0adaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:03.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.559+0000 7fb921600640 1 -- 172.21.15.29:0/780689332 shutdown_connections 2024-01-24T13:05:03.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.559+0000 7fb921600640 1 -- 172.21.15.29:0/780689332 wait complete. 2024-01-24T13:05:03.583 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:05:03.584 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:05:03.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f263aa00640 1 Processor -- start 2024-01-24T13:05:03.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f263aa00640 1 -- start start 2024-01-24T13:05:03.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f263aa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2634151550 0x7f26340ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:03.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f263aa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f26340cefa0 0x7f26340caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:03.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f263aa00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26340ceb10 con 0x7f263415ad10 2024-01-24T13:05:03.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f263aa00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263415ba70 con 0x7f26340cefa0 2024-01-24T13:05:03.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f263aa00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26340ce1e0 con 0x7f2634151550 2024-01-24T13:05:03.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f2633400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f26340cefa0 0x7f26340caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:03.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f2633400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f26340cefa0 0x7f26340caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40654/0 (socket says 172.21.15.29:40654) 2024-01-24T13:05:03.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f2633400640 1 -- 172.21.15.29:0/3140228544 learned_addr learned my addr 172.21.15.29:0/3140228544 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:03.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f2633e00640 1 --2- 172.21.15.29:0/3140228544 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2634151550 0x7f26340ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:03.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f2633400640 1 -- 172.21.15.29:0/3140228544 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2634151550 msgr2=0x7f26340ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:03.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f2633400640 1 --2- 172.21.15.29:0/3140228544 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2634151550 0x7f26340ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f2633400640 1 -- 172.21.15.29:0/3140228544 >> v1:172.21.15.29:6789/0 conn(0x7f263415ad10 legacy=0x7f263415b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:03.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.727+0000 7f2633400640 1 -- 172.21.15.29:0/3140228544 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26340ce4c0 con 0x7f26340cefa0 2024-01-24T13:05:03.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.731+0000 7f2633400640 1 --2- 172.21.15.29:0/3140228544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26340cefa0 0x7f26340caee0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f261c009870 tx=0x7f261c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d842ebf6421ac713 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:03.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.731+0000 7f2632a00640 1 -- 172.21.15.29:0/3140228544 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c0ab650 con 0x7f26340cefa0 2024-01-24T13:05:03.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.731+0000 7f2632a00640 1 -- 172.21.15.29:0/3140228544 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c0ab7b0 con 0x7f26340cefa0 2024-01-24T13:05:03.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.731+0000 7f2632a00640 1 -- 172.21.15.29:0/3140228544 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c0abb40 con 0x7f26340cefa0 2024-01-24T13:05:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.731+0000 7f263aa00640 1 -- 172.21.15.29:0/3140228544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26340cefa0 msgr2=0x7f26340caee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.731+0000 7f263aa00640 1 --2- 172.21.15.29:0/3140228544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26340cefa0 0x7f26340caee0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f261c009870 tx=0x7f261c01c540 comp rx=0 tx=0).stop 2024-01-24T13:05:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.731+0000 7f263aa00640 1 -- 172.21.15.29:0/3140228544 shutdown_connections 2024-01-24T13:05:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.731+0000 7f263aa00640 1 --2- 172.21.15.29:0/3140228544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26340cefa0 0x7f26340caee0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.731+0000 7f263aa00640 1 --2- 172.21.15.29:0/3140228544 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2634151550 0x7f26340ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.731+0000 7f263aa00640 1 -- 172.21.15.29:0/3140228544 >> 172.21.15.29:0/3140228544 conn(0x7f26340704f0 msgr2=0x7f263406e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.731+0000 7f263aa00640 1 -- 172.21.15.29:0/3140228544 shutdown_connections 2024-01-24T13:05:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.731+0000 7f263aa00640 1 -- 172.21.15.29:0/3140228544 wait complete. 2024-01-24T13:05:03.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f263aa00640 1 Processor -- start 2024-01-24T13:05:03.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f263aa00640 1 -- start start 2024-01-24T13:05:03.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f263aa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26340cefa0 0x7f263414a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:03.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f263aa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2634151550 0x7f263414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:03.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f263aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f263415ad10 0x7f263414bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:03.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f263aa00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26340c5dd0 con 0x7f263415ad10 2024-01-24T13:05:03.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f263aa00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26340c5fe0 con 0x7f2634151550 2024-01-24T13:05:03.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f263aa00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26340c62c0 con 0x7f26340cefa0 2024-01-24T13:05:03.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f2633e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26340cefa0 0x7f263414a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:03.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f2633400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2634151550 0x7f263414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:03.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f2638a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f263415ad10 0x7f263414bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:03.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f2633e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26340cefa0 0x7f263414a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:47716/0 (socket says 172.21.15.29:47716) 2024-01-24T13:05:03.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f2633e00640 1 -- 172.21.15.29:0/2500066119 learned_addr learned my addr 172.21.15.29:0/2500066119 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f2633e00640 1 -- 172.21.15.29:0/2500066119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2634151550 msgr2=0x7f263414b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f2633e00640 1 --2- 172.21.15.29:0/2500066119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2634151550 0x7f263414b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f2633e00640 1 -- 172.21.15.29:0/2500066119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f263415ad10 msgr2=0x7f263414bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f2633e00640 1 --2- 172.21.15.29:0/2500066119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f263415ad10 0x7f263414bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f2633e00640 1 -- 172.21.15.29:0/2500066119 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0094d0 con 0x7f26340cefa0 2024-01-24T13:05:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f2633400640 1 --2- 172.21.15.29:0/2500066119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2634151550 0x7f263414b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f2638a00640 1 --2- 172.21.15.29:0/2500066119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f263415ad10 0x7f263414bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f2633e00640 1 --2- 172.21.15.29:0/2500066119 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26340cefa0 0x7f263414a4c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f262400d800 tx=0x7f262400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f262be00640 1 -- 172.21.15.29:0/2500066119 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262400b6c0 con 0x7f26340cefa0 2024-01-24T13:05:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f262be00640 1 -- 172.21.15.29:0/2500066119 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262400b820 con 0x7f26340cefa0 2024-01-24T13:05:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f262be00640 1 -- 172.21.15.29:0/2500066119 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262400bb90 con 0x7f26340cefa0 2024-01-24T13:05:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f263aa00640 1 -- 172.21.15.29:0/2500066119 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26340c65a0 con 0x7f26340cefa0 2024-01-24T13:05:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.735+0000 7f263aa00640 1 -- 172.21.15.29:0/2500066119 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26340c6b60 con 0x7f26340cefa0 2024-01-24T13:05:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.739+0000 7f263aa00640 1 -- 172.21.15.29:0/2500066119 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263404e850 con 0x7f26340cefa0 2024-01-24T13:05:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.739+0000 7f262be00640 1 -- 172.21.15.29:0/2500066119 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f262400bcf0 con 0x7f26340cefa0 2024-01-24T13:05:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.739+0000 7f262be00640 1 --2- 172.21.15.29:0/2500066119 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f260c065a60 0x7f260c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.739+0000 7f262be00640 1 -- 172.21.15.29:0/2500066119 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f2624083880 con 0x7f26340cefa0 2024-01-24T13:05:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.739+0000 7f2633400640 1 --2- 172.21.15.29:0/2500066119 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f260c065a60 0x7f260c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.739+0000 7f2633400640 1 --2- 172.21.15.29:0/2500066119 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f260c065a60 0x7f260c067f20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f261c0af000 tx=0x7f261c0b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.743+0000 7f262be00640 1 -- 172.21.15.29:0/2500066119 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2624051050 con 0x7f26340cefa0 2024-01-24T13:05:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.903+0000 7f263aa00640 1 -- 172.21.15.29:0/2500066119 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2634154c70 con 0x7f26340cefa0 2024-01-24T13:05:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.907+0000 7f262be00640 1 -- 172.21.15.29:0/2500066119 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2624054670 con 0x7f26340cefa0 2024-01-24T13:05:03.909 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:05:03.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.907+0000 7f263aa00640 1 -- 172.21.15.29:0/2500066119 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f260c065a60 msgr2=0x7f260c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:03.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.907+0000 7f263aa00640 1 --2- 172.21.15.29:0/2500066119 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f260c065a60 0x7f260c067f20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f261c0af000 tx=0x7f261c0b6040 comp rx=0 tx=0).stop 2024-01-24T13:05:03.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.907+0000 7f263aa00640 1 -- 172.21.15.29:0/2500066119 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26340cefa0 msgr2=0x7f263414a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:03.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.907+0000 7f263aa00640 1 --2- 172.21.15.29:0/2500066119 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26340cefa0 0x7f263414a4c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f262400d800 tx=0x7f262400dcc0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.907+0000 7f263aa00640 1 -- 172.21.15.29:0/2500066119 shutdown_connections 2024-01-24T13:05:03.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.907+0000 7f263aa00640 1 --2- 172.21.15.29:0/2500066119 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f260c065a60 0x7f260c067f20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.907+0000 7f263aa00640 1 --2- 172.21.15.29:0/2500066119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f263415ad10 0x7f263414bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.907+0000 7f263aa00640 1 --2- 172.21.15.29:0/2500066119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2634151550 0x7f263414b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.907+0000 7f263aa00640 1 --2- 172.21.15.29:0/2500066119 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f26340cefa0 0x7f263414a4c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:03.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.907+0000 7f263aa00640 1 -- 172.21.15.29:0/2500066119 >> 172.21.15.29:0/2500066119 conn(0x7f26340704f0 msgr2=0x7f263415e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:03.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.907+0000 7f263aa00640 1 -- 172.21.15.29:0/2500066119 shutdown_connections 2024-01-24T13:05:03.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:03.907+0000 7f263aa00640 1 -- 172.21.15.29:0/2500066119 wait complete. 2024-01-24T13:05:03.930 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:05:04.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f9771800640 1 Processor -- start 2024-01-24T13:05:04.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f9771800640 1 -- start start 2024-01-24T13:05:04.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f9771800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f976c0ce710 0x7f976c15d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f9771800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f976c0ae970 0x7f976c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f9771800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f976c06f1e0 0x7f976c06e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f9771800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976c0cde00 con 0x7f976c0ce710 2024-01-24T13:05:04.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f9771800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976c1599e0 con 0x7f976c0ae970 2024-01-24T13:05:04.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f9771800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c0cd280 con 0x7f976c06f1e0 2024-01-24T13:05:04.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f976aa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f976c0ce710 0x7f976c15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f976a000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f976c0ae970 0x7f976c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f976aa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f976c0ce710 0x7f976c15d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40672/0 (socket says 172.21.15.29:40672) 2024-01-24T13:05:04.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f976aa00640 1 -- 172.21.15.29:0/3280559357 learned_addr learned my addr 172.21.15.29:0/3280559357 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:04.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f976b400640 1 --2- 172.21.15.29:0/3280559357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f976c06f1e0 0x7f976c06e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f976aa00640 1 -- 172.21.15.29:0/3280559357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f976c06f1e0 msgr2=0x7f976c06e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:04.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f976aa00640 1 --2- 172.21.15.29:0/3280559357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f976c06f1e0 0x7f976c06e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f976aa00640 1 -- 172.21.15.29:0/3280559357 >> v2:172.21.15.163:3300/0 conn(0x7f976c0ae970 msgr2=0x7f976c06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:04.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f976aa00640 1 --2- 172.21.15.29:0/3280559357 >> v2:172.21.15.163:3300/0 conn(0x7f976c0ae970 0x7f976c06e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.075+0000 7f976aa00640 1 -- 172.21.15.29:0/3280559357 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c0cd560 con 0x7f976c0ce710 2024-01-24T13:05:04.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.079+0000 7f976aa00640 1 --2- 172.21.15.29:0/3280559357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f976c0ce710 0x7f976c15d020 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f976c0672d0 tx=0x7f975c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ccf6cc038a7781 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:04.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.079+0000 7f9769600640 1 -- 172.21.15.29:0/3280559357 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c0ab600 con 0x7f976c0ce710 2024-01-24T13:05:04.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.079+0000 7f9769600640 1 -- 172.21.15.29:0/3280559357 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c0ab760 con 0x7f976c0ce710 2024-01-24T13:05:04.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.079+0000 7f9769600640 1 -- 172.21.15.29:0/3280559357 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c0abaf0 con 0x7f976c0ce710 2024-01-24T13:05:04.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.079+0000 7f9771800640 1 -- 172.21.15.29:0/3280559357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f976c0ce710 msgr2=0x7f976c15d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.079+0000 7f9771800640 1 --2- 172.21.15.29:0/3280559357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f976c0ce710 0x7f976c15d020 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f976c0672d0 tx=0x7f975c01c440 comp rx=0 tx=0).stop 2024-01-24T13:05:04.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.079+0000 7f9771800640 1 -- 172.21.15.29:0/3280559357 shutdown_connections 2024-01-24T13:05:04.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.079+0000 7f9771800640 1 --2- 172.21.15.29:0/3280559357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f976c06f1e0 0x7f976c06e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.079+0000 7f9771800640 1 --2- 172.21.15.29:0/3280559357 >> v2:172.21.15.163:3300/0 conn(0x7f976c0ae970 0x7f976c06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.079+0000 7f9771800640 1 --2- 172.21.15.29:0/3280559357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f976c0ce710 0x7f976c15d020 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.079+0000 7f9771800640 1 -- 172.21.15.29:0/3280559357 >> 172.21.15.29:0/3280559357 conn(0x7f976c0cbd50 msgr2=0x7f976c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:04.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.079+0000 7f9771800640 1 -- 172.21.15.29:0/3280559357 shutdown_connections 2024-01-24T13:05:04.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.079+0000 7f9771800640 1 -- 172.21.15.29:0/3280559357 wait complete. 2024-01-24T13:05:04.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f9771800640 1 Processor -- start 2024-01-24T13:05:04.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f9771800640 1 -- start start 2024-01-24T13:05:04.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f9771800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f976c06f1e0 0x7f976c158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f9771800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f976c0ae970 0x7f976c1f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f9771800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f976c0ce710 0x7f976c1f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f9771800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c14f510 con 0x7f976c06f1e0 2024-01-24T13:05:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f9771800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c0c6540 con 0x7f976c0ce710 2024-01-24T13:05:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f9771800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c0c6820 con 0x7f976c0ae970 2024-01-24T13:05:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f976aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f976c06f1e0 0x7f976c158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f976aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f976c06f1e0 0x7f976c158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40674/0 (socket says 172.21.15.29:40674) 2024-01-24T13:05:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f976aa00640 1 -- 172.21.15.29:0/890573044 learned_addr learned my addr 172.21.15.29:0/890573044 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f976b400640 1 --2- 172.21.15.29:0/890573044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f976c0ce710 0x7f976c1f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f976a000640 1 --2- 172.21.15.29:0/890573044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f976c0ae970 0x7f976c1f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f976aa00640 1 -- 172.21.15.29:0/890573044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f976c0ae970 msgr2=0x7f976c1f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f976aa00640 1 --2- 172.21.15.29:0/890573044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f976c0ae970 0x7f976c1f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f976aa00640 1 -- 172.21.15.29:0/890573044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f976c0ce710 msgr2=0x7f976c1f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f976aa00640 1 --2- 172.21.15.29:0/890573044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f976c0ce710 0x7f976c1f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f976aa00640 1 -- 172.21.15.29:0/890573044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c0094d0 con 0x7f976c06f1e0 2024-01-24T13:05:04.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f976aa00640 1 --2- 172.21.15.29:0/890573044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f976c06f1e0 0x7f976c158760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f975c01cce0 tx=0x7f975c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:04.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f9762a00640 1 -- 172.21.15.29:0/890573044 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c0be5f0 con 0x7f976c06f1e0 2024-01-24T13:05:04.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f9762a00640 1 -- 172.21.15.29:0/890573044 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c0be750 con 0x7f976c06f1e0 2024-01-24T13:05:04.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f9762a00640 1 -- 172.21.15.29:0/890573044 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c0beae0 con 0x7f976c06f1e0 2024-01-24T13:05:04.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f9771800640 1 -- 172.21.15.29:0/890573044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c0c6b00 con 0x7f976c06f1e0 2024-01-24T13:05:04.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.083+0000 7f9771800640 1 -- 172.21.15.29:0/890573044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976c158e70 con 0x7f976c06f1e0 2024-01-24T13:05:04.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.087+0000 7f9771800640 1 -- 172.21.15.29:0/890573044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976c13e4b0 con 0x7f976c06f1e0 2024-01-24T13:05:04.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.087+0000 7f9762a00640 1 -- 172.21.15.29:0/890573044 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f975c0b43f0 con 0x7f976c06f1e0 2024-01-24T13:05:04.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.087+0000 7f9762a00640 1 --2- 172.21.15.29:0/890573044 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9744065a60 0x7f9744067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.087+0000 7f9762a00640 1 -- 172.21.15.29:0/890573044 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f975c11e080 con 0x7f976c06f1e0 2024-01-24T13:05:04.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.087+0000 7f976a000640 1 --2- 172.21.15.29:0/890573044 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9744065a60 0x7f9744067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.087+0000 7f976a000640 1 --2- 172.21.15.29:0/890573044 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9744065a60 0x7f9744067f20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f976c0c60c0 tx=0x7f9754009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:04.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.091+0000 7f9762a00640 1 -- 172.21.15.29:0/890573044 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f975c0eb720 con 0x7f976c06f1e0 2024-01-24T13:05:04.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.247+0000 7f9771800640 1 -- 172.21.15.29:0/890573044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f976c04e850 con 0x7f976c06f1e0 2024-01-24T13:05:04.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.247+0000 7f9762a00640 1 -- 172.21.15.29:0/890573044 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f975c0eed40 con 0x7f976c06f1e0 2024-01-24T13:05:04.252 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:04.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.251+0000 7f9771800640 1 -- 172.21.15.29:0/890573044 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9744065a60 msgr2=0x7f9744067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.251+0000 7f9771800640 1 --2- 172.21.15.29:0/890573044 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9744065a60 0x7f9744067f20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f976c0c60c0 tx=0x7f9754009190 comp rx=0 tx=0).stop 2024-01-24T13:05:04.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.251+0000 7f9771800640 1 -- 172.21.15.29:0/890573044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f976c06f1e0 msgr2=0x7f976c158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.251+0000 7f9771800640 1 --2- 172.21.15.29:0/890573044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f976c06f1e0 0x7f976c158760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f975c01cce0 tx=0x7f975c01ac80 comp rx=0 tx=0).stop 2024-01-24T13:05:04.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.251+0000 7f9771800640 1 -- 172.21.15.29:0/890573044 shutdown_connections 2024-01-24T13:05:04.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.251+0000 7f9771800640 1 --2- 172.21.15.29:0/890573044 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9744065a60 0x7f9744067f20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.251+0000 7f9771800640 1 --2- 172.21.15.29:0/890573044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f976c0ce710 0x7f976c1f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.251+0000 7f9771800640 1 --2- 172.21.15.29:0/890573044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f976c0ae970 0x7f976c1f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.251+0000 7f9771800640 1 --2- 172.21.15.29:0/890573044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f976c06f1e0 0x7f976c158760 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.251+0000 7f9771800640 1 -- 172.21.15.29:0/890573044 >> 172.21.15.29:0/890573044 conn(0x7f976c0cbd50 msgr2=0x7f976c0aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:04.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.251+0000 7f9771800640 1 -- 172.21.15.29:0/890573044 shutdown_connections 2024-01-24T13:05:04.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.251+0000 7f9771800640 1 -- 172.21.15.29:0/890573044 wait complete. 2024-01-24T13:05:04.274 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:05:04.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c50400640 1 Processor -- start 2024-01-24T13:05:04.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c50400640 1 -- start start 2024-01-24T13:05:04.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c50400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9c4806be20 0x7f9c4815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c50400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c4813d4b0 0x7f9c4815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c50400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4815b4f0 con 0x7f9c4806c200 2024-01-24T13:05:04.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c50400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4815b7d0 con 0x7f9c4806be20 2024-01-24T13:05:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c50400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480cd0c0 con 0x7f9c4813d4b0 2024-01-24T13:05:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c4da00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9c4806be20 0x7f9c4815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c4da00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9c4806be20 0x7f9c4815a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40686/0 (socket says 172.21.15.29:40686) 2024-01-24T13:05:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c4da00640 1 -- 172.21.15.29:0/2844560996 learned_addr learned my addr 172.21.15.29:0/2844560996 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c4e400640 1 --2- 172.21.15.29:0/2844560996 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c4813d4b0 0x7f9c4815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c4da00640 1 -- 172.21.15.29:0/2844560996 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c4813d4b0 msgr2=0x7f9c4815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:04.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c4da00640 1 --2- 172.21.15.29:0/2844560996 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c4813d4b0 0x7f9c4815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c4da00640 1 -- 172.21.15.29:0/2844560996 >> v1:172.21.15.29:6789/0 conn(0x7f9c4806c200 legacy=0x7f9c4813cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c4da00640 1 -- 172.21.15.29:0/2844560996 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c480cd3a0 con 0x7f9c4806be20 2024-01-24T13:05:04.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.415+0000 7f9c4e400640 1 --2- 172.21.15.29:0/2844560996 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c4813d4b0 0x7f9c4815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:04.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.419+0000 7f9c4da00640 1 --2- 172.21.15.29:0/2844560996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4806be20 0x7f9c4815a9c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009870 tx=0x7f9c3801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf036e05784d6f36 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:04.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.419+0000 7f9c47e00640 1 -- 172.21.15.29:0/2844560996 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c380a9620 con 0x7f9c4806be20 2024-01-24T13:05:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.419+0000 7f9c47e00640 1 -- 172.21.15.29:0/2844560996 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c380a9780 con 0x7f9c4806be20 2024-01-24T13:05:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.419+0000 7f9c47e00640 1 -- 172.21.15.29:0/2844560996 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c380a9b10 con 0x7f9c4806be20 2024-01-24T13:05:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.419+0000 7f9c50400640 1 -- 172.21.15.29:0/2844560996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4806be20 msgr2=0x7f9c4815a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.419+0000 7f9c50400640 1 --2- 172.21.15.29:0/2844560996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4806be20 0x7f9c4815a9c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009870 tx=0x7f9c3801c500 comp rx=0 tx=0).stop 2024-01-24T13:05:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.419+0000 7f9c50400640 1 -- 172.21.15.29:0/2844560996 shutdown_connections 2024-01-24T13:05:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.419+0000 7f9c50400640 1 --2- 172.21.15.29:0/2844560996 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c4813d4b0 0x7f9c4815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.419+0000 7f9c50400640 1 --2- 172.21.15.29:0/2844560996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4806be20 0x7f9c4815a9c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.419+0000 7f9c50400640 1 -- 172.21.15.29:0/2844560996 >> 172.21.15.29:0/2844560996 conn(0x7f9c4806d700 msgr2=0x7f9c48069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:04.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.419+0000 7f9c50400640 1 -- 172.21.15.29:0/2844560996 shutdown_connections 2024-01-24T13:05:04.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.419+0000 7f9c50400640 1 -- 172.21.15.29:0/2844560996 wait complete. 2024-01-24T13:05:04.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c50400640 1 Processor -- start 2024-01-24T13:05:04.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c50400640 1 -- start start 2024-01-24T13:05:04.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c50400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4806be20 0x7f9c4813b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c50400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c4806c200 0x7f9c4813aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c50400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c4813d4b0 0x7f9c48151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c50400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4814ab90 con 0x7f9c4806be20 2024-01-24T13:05:04.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c50400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c481547c0 con 0x7f9c4806c200 2024-01-24T13:05:04.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c50400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c48154aa0 con 0x7f9c4813d4b0 2024-01-24T13:05:04.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c4da00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4806be20 0x7f9c4813b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c4da00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4806be20 0x7f9c4813b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40692/0 (socket says 172.21.15.29:40692) 2024-01-24T13:05:04.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c4da00640 1 -- 172.21.15.29:0/1329697520 learned_addr learned my addr 172.21.15.29:0/1329697520 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:04.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c4e400640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c4813d4b0 0x7f9c48151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c4d000640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c4806c200 0x7f9c4813aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c4da00640 1 -- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c4813d4b0 msgr2=0x7f9c48151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c4da00640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c4813d4b0 0x7f9c48151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c4da00640 1 -- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c4806c200 msgr2=0x7f9c4813aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c4da00640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c4806c200 0x7f9c4813aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c4da00640 1 -- 172.21.15.29:0/1329697520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c380094d0 con 0x7f9c4806be20 2024-01-24T13:05:04.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c4d000640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c4806c200 0x7f9c4813aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:04.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c4da00640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4806be20 0x7f9c4813b3f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9c380ab040 tx=0x7f9c3801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:04.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c45600640 1 -- 172.21.15.29:0/1329697520 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c380a9e80 con 0x7f9c4806be20 2024-01-24T13:05:04.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c45600640 1 -- 172.21.15.29:0/1329697520 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c380bc450 con 0x7f9c4806be20 2024-01-24T13:05:04.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c45600640 1 -- 172.21.15.29:0/1329697520 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c380bc800 con 0x7f9c4806be20 2024-01-24T13:05:04.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.423+0000 7f9c50400640 1 -- 172.21.15.29:0/1329697520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4814a820 con 0x7f9c4806be20 2024-01-24T13:05:04.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.427+0000 7f9c50400640 1 -- 172.21.15.29:0/1329697520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4813bbb0 con 0x7f9c4806be20 2024-01-24T13:05:04.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.427+0000 7f9c50400640 1 -- 172.21.15.29:0/1329697520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4804e850 con 0x7f9c4806be20 2024-01-24T13:05:04.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.427+0000 7f9c45600640 1 -- 172.21.15.29:0/1329697520 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9c380bc960 con 0x7f9c4806be20 2024-01-24T13:05:04.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.427+0000 7f9c45600640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9c20065a60 0x7f9c20067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.427+0000 7f9c45600640 1 -- 172.21.15.29:0/1329697520 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f9c3811da90 con 0x7f9c4806be20 2024-01-24T13:05:04.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.427+0000 7f9c4d000640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9c20065a60 0x7f9c20067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.427+0000 7f9c4d000640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9c20065a60 0x7f9c20067f20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9c480abaf0 tx=0x7f9c30009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:04.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.431+0000 7f9c45600640 1 -- 172.21.15.29:0/1329697520 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9c380eb120 con 0x7f9c4806be20 2024-01-24T13:05:04.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.587+0000 7f9c50400640 1 -- 172.21.15.29:0/1329697520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c480cba20 con 0x7f9c4806be20 2024-01-24T13:05:04.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.587+0000 7f9c45600640 1 -- 172.21.15.29:0/1329697520 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c380ee740 con 0x7f9c4806be20 2024-01-24T13:05:04.592 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:05:04.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.591+0000 7f9c50400640 1 -- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9c20065a60 msgr2=0x7f9c20067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.591+0000 7f9c50400640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9c20065a60 0x7f9c20067f20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9c480abaf0 tx=0x7f9c30009040 comp rx=0 tx=0).stop 2024-01-24T13:05:04.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.591+0000 7f9c50400640 1 -- 172.21.15.29:0/1329697520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4806be20 msgr2=0x7f9c4813b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.591+0000 7f9c50400640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4806be20 0x7f9c4813b3f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9c380ab040 tx=0x7f9c3801ad40 comp rx=0 tx=0).stop 2024-01-24T13:05:04.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.591+0000 7f9c50400640 1 -- 172.21.15.29:0/1329697520 shutdown_connections 2024-01-24T13:05:04.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.591+0000 7f9c50400640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9c20065a60 0x7f9c20067f20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.591+0000 7f9c50400640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c4813d4b0 0x7f9c48151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.591+0000 7f9c50400640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c4806c200 0x7f9c4813aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.591+0000 7f9c50400640 1 --2- 172.21.15.29:0/1329697520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4806be20 0x7f9c4813b3f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.591+0000 7f9c50400640 1 -- 172.21.15.29:0/1329697520 >> 172.21.15.29:0/1329697520 conn(0x7f9c4806d700 msgr2=0x7f9c4814d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:04.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.591+0000 7f9c50400640 1 -- 172.21.15.29:0/1329697520 shutdown_connections 2024-01-24T13:05:04.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.591+0000 7f9c50400640 1 -- 172.21.15.29:0/1329697520 wait complete. 2024-01-24T13:05:04.614 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:05:04.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.755+0000 7f5b5ce00640 1 Processor -- start 2024-01-24T13:05:04.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.755+0000 7f5b5ce00640 1 -- start start 2024-01-24T13:05:04.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.755+0000 7f5b5ce00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5b58158ca0 0x7f5b580b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.755+0000 7f5b5ce00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b58070970 con 0x7f5b5806bbc0 2024-01-24T13:05:04.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.755+0000 7f5b5ce00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b58070ba0 con 0x7f5b58070560 2024-01-24T13:05:04.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.755+0000 7f5b5ce00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b58159080 con 0x7f5b58158ca0 2024-01-24T13:05:04.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.755+0000 7f5b55400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5b5806bbc0 0x7f5b5806fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37190/0 (socket says 172.21.15.29:37190) 2024-01-24T13:05:04.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.755+0000 7f5b55400640 1 -- 172.21.15.29:0/2047598020 learned_addr learned my addr 172.21.15.29:0/2047598020 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:04.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.755+0000 7f5b55e00640 1 --2- 172.21.15.29:0/2047598020 >> v2:172.21.15.163:3300/0 conn(0x7f5b58158ca0 0x7f5b580b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.755+0000 7f5b54a00640 1 -- 172.21.15.29:0/2047598020 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248455855 0 0) 0x7f5b58070970 con 0x7f5b5806bbc0 2024-01-24T13:05:04.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.755+0000 7f5b54a00640 1 -- 172.21.15.29:0/2047598020 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b38003530 con 0x7f5b5806bbc0 2024-01-24T13:05:04.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.755+0000 7f5b55e00640 1 -- 172.21.15.29:0/2047598020 >> v1:172.21.15.163:6789/0 conn(0x7f5b58070560 legacy=0x7f5b580cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.755+0000 7f5b55e00640 1 -- 172.21.15.29:0/2047598020 >> v1:172.21.15.29:6789/0 conn(0x7f5b5806bbc0 legacy=0x7f5b5806fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.755+0000 7f5b55e00640 1 -- 172.21.15.29:0/2047598020 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b580b18c0 con 0x7f5b58158ca0 2024-01-24T13:05:04.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.759+0000 7f5b55e00640 1 --2- 172.21.15.29:0/2047598020 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b58158ca0 0x7f5b580b2680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5b480097c0 tx=0x7f5b4801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbe0f6e52d6240df server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:04.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.759+0000 7f5b54a00640 1 -- 172.21.15.29:0/2047598020 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b480ab650 con 0x7f5b58158ca0 2024-01-24T13:05:04.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.759+0000 7f5b54a00640 1 -- 172.21.15.29:0/2047598020 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b480ab7b0 con 0x7f5b58158ca0 2024-01-24T13:05:04.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.759+0000 7f5b54a00640 1 -- 172.21.15.29:0/2047598020 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b480abb40 con 0x7f5b58158ca0 2024-01-24T13:05:04.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.759+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2047598020 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b58158ca0 msgr2=0x7f5b580b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.759+0000 7f5b5ce00640 1 --2- 172.21.15.29:0/2047598020 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b58158ca0 0x7f5b580b2680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5b480097c0 tx=0x7f5b4801c450 comp rx=0 tx=0).stop 2024-01-24T13:05:04.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.759+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2047598020 shutdown_connections 2024-01-24T13:05:04.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.759+0000 7f5b5ce00640 1 --2- 172.21.15.29:0/2047598020 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b58158ca0 0x7f5b580b2680 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.759+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2047598020 >> 172.21.15.29:0/2047598020 conn(0x7f5b5806d700 msgr2=0x7f5b58069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:04.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.759+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2047598020 shutdown_connections 2024-01-24T13:05:04.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.759+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2047598020 wait complete. 2024-01-24T13:05:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b5ce00640 1 Processor -- start 2024-01-24T13:05:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b5ce00640 1 -- start start 2024-01-24T13:05:04.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b5ce00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b5806bbc0 0x7f5b580c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b5ce00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b58070560 0x7f5b58149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b5ce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b58158ca0 0x7f5b58156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b5ce00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b580ca280 con 0x7f5b58070560 2024-01-24T13:05:04.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b5ce00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b580c9c20 con 0x7f5b58158ca0 2024-01-24T13:05:04.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b5ce00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b58150d60 con 0x7f5b5806bbc0 2024-01-24T13:05:04.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b55400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b58070560 0x7f5b58149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b55e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b5806bbc0 0x7f5b580c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b55e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b5806bbc0 0x7f5b580c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:47772/0 (socket says 172.21.15.29:47772) 2024-01-24T13:05:04.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b55e00640 1 -- 172.21.15.29:0/2923146425 learned_addr learned my addr 172.21.15.29:0/2923146425 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:04.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b55400640 1 --2- 172.21.15.29:0/2923146425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b58070560 0x7f5b58149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40706/0 (socket says 172.21.15.29:40706) 2024-01-24T13:05:04.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b56800640 1 --2- 172.21.15.29:0/2923146425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b58158ca0 0x7f5b58156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b55400640 1 -- 172.21.15.29:0/2923146425 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b5806bbc0 msgr2=0x7f5b580c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b55400640 1 --2- 172.21.15.29:0/2923146425 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b5806bbc0 0x7f5b580c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b55400640 1 -- 172.21.15.29:0/2923146425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b58158ca0 msgr2=0x7f5b58156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b55400640 1 --2- 172.21.15.29:0/2923146425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b58158ca0 0x7f5b58156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b55400640 1 -- 172.21.15.29:0/2923146425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b48009420 con 0x7f5b58070560 2024-01-24T13:05:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b55400640 1 --2- 172.21.15.29:0/2923146425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b58070560 0x7f5b58149630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000c400 tx=0x7f5b4000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b4e000640 1 -- 172.21.15.29:0/2923146425 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40005cf0 con 0x7f5b58070560 2024-01-24T13:05:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b4e000640 1 -- 172.21.15.29:0/2923146425 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b40005e50 con 0x7f5b58070560 2024-01-24T13:05:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2923146425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b58151040 con 0x7f5b58070560 2024-01-24T13:05:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b4e000640 1 -- 172.21.15.29:0/2923146425 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b400072d0 con 0x7f5b58070560 2024-01-24T13:05:04.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.763+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2923146425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b58151600 con 0x7f5b58070560 2024-01-24T13:05:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.767+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2923146425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5804e850 con 0x7f5b58070560 2024-01-24T13:05:04.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.767+0000 7f5b4e000640 1 -- 172.21.15.29:0/2923146425 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5b40007430 con 0x7f5b58070560 2024-01-24T13:05:04.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.767+0000 7f5b4e000640 1 --2- 172.21.15.29:0/2923146425 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5b30065a60 0x7f5b30067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:04.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.767+0000 7f5b4e000640 1 -- 172.21.15.29:0/2923146425 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f5b40082a70 con 0x7f5b58070560 2024-01-24T13:05:04.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.767+0000 7f5b55e00640 1 --2- 172.21.15.29:0/2923146425 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5b30065a60 0x7f5b30067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:04.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.767+0000 7f5b55e00640 1 --2- 172.21.15.29:0/2923146425 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5b30065a60 0x7f5b30067f20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b480097c0 tx=0x7f5b480a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:04.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.771+0000 7f5b4e000640 1 -- 172.21.15.29:0/2923146425 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f5b40050110 con 0x7f5b58070560 2024-01-24T13:05:04.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.927+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2923146425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5b580cb5e0 con 0x7f5b58070560 2024-01-24T13:05:04.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.931+0000 7f5b4e000640 1 -- 172.21.15.29:0/2923146425 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5b400170a0 con 0x7f5b58070560 2024-01-24T13:05:04.933 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:04.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.931+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2923146425 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5b30065a60 msgr2=0x7f5b30067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.931+0000 7f5b5ce00640 1 --2- 172.21.15.29:0/2923146425 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5b30065a60 0x7f5b30067f20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b480097c0 tx=0x7f5b480a7000 comp rx=0 tx=0).stop 2024-01-24T13:05:04.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.931+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2923146425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b58070560 msgr2=0x7f5b58149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:04.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.931+0000 7f5b5ce00640 1 --2- 172.21.15.29:0/2923146425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b58070560 0x7f5b58149630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000c400 tx=0x7f5b4000c8c0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.931+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2923146425 shutdown_connections 2024-01-24T13:05:04.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.931+0000 7f5b5ce00640 1 --2- 172.21.15.29:0/2923146425 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5b30065a60 0x7f5b30067f20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.931+0000 7f5b5ce00640 1 --2- 172.21.15.29:0/2923146425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b58158ca0 0x7f5b58156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.931+0000 7f5b5ce00640 1 --2- 172.21.15.29:0/2923146425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b58070560 0x7f5b58149630 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.931+0000 7f5b5ce00640 1 --2- 172.21.15.29:0/2923146425 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b5806bbc0 0x7f5b580c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:04.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.931+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2923146425 >> 172.21.15.29:0/2923146425 conn(0x7f5b5806d700 msgr2=0x7f5b580714a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:04.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.931+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2923146425 shutdown_connections 2024-01-24T13:05:04.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:04.931+0000 7f5b5ce00640 1 -- 172.21.15.29:0/2923146425 wait complete. 2024-01-24T13:05:04.954 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:05:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f620d000640 1 Processor -- start 2024-01-24T13:05:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f620d000640 1 -- start start 2024-01-24T13:05:05.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f620d000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62080cd540 0x7f620815b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f620d000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620815e920 con 0x7f620815b8b0 2024-01-24T13:05:05.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f620d000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620815ec00 con 0x7f62080cd160 2024-01-24T13:05:05.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f620d000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620815eee0 con 0x7f62080cd540 2024-01-24T13:05:05.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f6206800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f620815b8b0 0x7f62080cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37200/0 (socket says 172.21.15.29:37200) 2024-01-24T13:05:05.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f6206800640 1 -- 172.21.15.29:0/1888895 learned_addr learned my addr 172.21.15.29:0/1888895 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:05.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f6205400640 1 --2- 172.21.15.29:0/1888895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62080cd540 0x7f620815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f6204a00640 1 -- 172.21.15.29:0/1888895 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748901007 0 0) 0x7f620815e920 con 0x7f620815b8b0 2024-01-24T13:05:05.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f6204a00640 1 -- 172.21.15.29:0/1888895 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e8003530 con 0x7f620815b8b0 2024-01-24T13:05:05.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f6204a00640 1 -- 172.21.15.29:0/1888895 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735436045 0 0) 0x7f620815ec00 con 0x7f62080cd160 2024-01-24T13:05:05.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f6204a00640 1 -- 172.21.15.29:0/1888895 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f620815e920 con 0x7f62080cd160 2024-01-24T13:05:05.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f6205400640 1 -- 172.21.15.29:0/1888895 >> v1:172.21.15.163:6789/0 conn(0x7f62080cd160 legacy=0x7f620815e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f6205400640 1 -- 172.21.15.29:0/1888895 >> v1:172.21.15.29:6789/0 conn(0x7f620815b8b0 legacy=0x7f62080cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.095+0000 7f6205400640 1 -- 172.21.15.29:0/1888895 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620815ae50 con 0x7f62080cd540 2024-01-24T13:05:05.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.099+0000 7f6205400640 1 --2- 172.21.15.29:0/1888895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62080cd540 0x7f620815b370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f61f00097f0 tx=0x7f61f001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=514176a3fca4980 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:05.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.099+0000 7f6204a00640 1 -- 172.21.15.29:0/1888895 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00ac630 con 0x7f62080cd540 2024-01-24T13:05:05.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.099+0000 7f6204a00640 1 -- 172.21.15.29:0/1888895 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f00ac790 con 0x7f62080cd540 2024-01-24T13:05:05.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.099+0000 7f6204a00640 1 -- 172.21.15.29:0/1888895 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00acb20 con 0x7f62080cd540 2024-01-24T13:05:05.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.099+0000 7f620d000640 1 -- 172.21.15.29:0/1888895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62080cd540 msgr2=0x7f620815b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.099+0000 7f620d000640 1 --2- 172.21.15.29:0/1888895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62080cd540 0x7f620815b370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f61f00097f0 tx=0x7f61f001c4c0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.099+0000 7f620d000640 1 -- 172.21.15.29:0/1888895 shutdown_connections 2024-01-24T13:05:05.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.099+0000 7f620d000640 1 --2- 172.21.15.29:0/1888895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62080cd540 0x7f620815b370 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.099+0000 7f620d000640 1 -- 172.21.15.29:0/1888895 >> 172.21.15.29:0/1888895 conn(0x7f6208069cd0 msgr2=0x7f620806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:05.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.099+0000 7f620d000640 1 -- 172.21.15.29:0/1888895 shutdown_connections 2024-01-24T13:05:05.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.099+0000 7f620d000640 1 -- 172.21.15.29:0/1888895 wait complete. 2024-01-24T13:05:05.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f620d000640 1 Processor -- start 2024-01-24T13:05:05.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f620d000640 1 -- start start 2024-01-24T13:05:05.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f620d000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62080cd160 0x7f620814f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f620d000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62080cd540 0x7f6208151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f620d000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6208154530 0x7f6208153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f620d000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62080ca670 con 0x7f6208154530 2024-01-24T13:05:05.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f620d000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620814fd30 con 0x7f62080cd160 2024-01-24T13:05:05.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f620d000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620814ef80 con 0x7f62080cd540 2024-01-24T13:05:05.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f6206800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6208154530 0x7f6208153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f6206800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6208154530 0x7f6208153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40710/0 (socket says 172.21.15.29:40710) 2024-01-24T13:05:05.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f6206800640 1 -- 172.21.15.29:0/1296772923 learned_addr learned my addr 172.21.15.29:0/1296772923 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:05.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f6205400640 1 --2- 172.21.15.29:0/1296772923 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62080cd540 0x7f6208151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f6205e00640 1 --2- 172.21.15.29:0/1296772923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62080cd160 0x7f620814f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f6206800640 1 -- 172.21.15.29:0/1296772923 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62080cd540 msgr2=0x7f6208151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f6206800640 1 --2- 172.21.15.29:0/1296772923 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62080cd540 0x7f6208151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f6206800640 1 -- 172.21.15.29:0/1296772923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62080cd160 msgr2=0x7f620814f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f6206800640 1 --2- 172.21.15.29:0/1296772923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62080cd160 0x7f620814f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f6206800640 1 -- 172.21.15.29:0/1296772923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f0009420 con 0x7f6208154530 2024-01-24T13:05:05.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f6206800640 1 --2- 172.21.15.29:0/1296772923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6208154530 0x7f6208153900 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f620000ca80 tx=0x7f620000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:05.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f61fe000640 1 -- 172.21.15.29:0/1296772923 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620000ac30 con 0x7f6208154530 2024-01-24T13:05:05.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f61fe000640 1 -- 172.21.15.29:0/1296772923 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620000ad90 con 0x7f6208154530 2024-01-24T13:05:05.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f61fe000640 1 -- 172.21.15.29:0/1296772923 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200012620 con 0x7f6208154530 2024-01-24T13:05:05.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f620d000640 1 -- 172.21.15.29:0/1296772923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62080ca390 con 0x7f6208154530 2024-01-24T13:05:05.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.103+0000 7f620d000640 1 -- 172.21.15.29:0/1296772923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620814ec10 con 0x7f6208154530 2024-01-24T13:05:05.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.107+0000 7f620d000640 1 -- 172.21.15.29:0/1296772923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f620814e790 con 0x7f6208154530 2024-01-24T13:05:05.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.107+0000 7f61fe000640 1 -- 172.21.15.29:0/1296772923 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6200007070 con 0x7f6208154530 2024-01-24T13:05:05.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.107+0000 7f61fe000640 1 --2- 172.21.15.29:0/1296772923 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f61e0065a90 0x7f61e0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.107+0000 7f61fe000640 1 -- 172.21.15.29:0/1296772923 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f62000833c0 con 0x7f6208154530 2024-01-24T13:05:05.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.107+0000 7f6205e00640 1 --2- 172.21.15.29:0/1296772923 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f61e0065a90 0x7f61e0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.107+0000 7f6205e00640 1 --2- 172.21.15.29:0/1296772923 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f61e0065a90 0x7f61e0067f50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f61f80011f0 tx=0x7f61f8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:05.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.111+0000 7f61fe000640 1 -- 172.21.15.29:0/1296772923 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f620814e790 con 0x7f6208154530 2024-01-24T13:05:05.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.283+0000 7f620d000640 1 -- 172.21.15.29:0/1296772923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f620814e790 con 0x7f6208154530 2024-01-24T13:05:05.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.283+0000 7f61fe000640 1 -- 172.21.15.29:0/1296772923 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f620814e790 con 0x7f6208154530 2024-01-24T13:05:05.286 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:05:05.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.283+0000 7f620d000640 1 -- 172.21.15.29:0/1296772923 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f61e0065a90 msgr2=0x7f61e0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.283+0000 7f620d000640 1 --2- 172.21.15.29:0/1296772923 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f61e0065a90 0x7f61e0067f50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f61f80011f0 tx=0x7f61f8009040 comp rx=0 tx=0).stop 2024-01-24T13:05:05.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.283+0000 7f620d000640 1 -- 172.21.15.29:0/1296772923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6208154530 msgr2=0x7f6208153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.283+0000 7f620d000640 1 --2- 172.21.15.29:0/1296772923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6208154530 0x7f6208153900 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f620000ca80 tx=0x7f620000cf40 comp rx=0 tx=0).stop 2024-01-24T13:05:05.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.283+0000 7f620d000640 1 -- 172.21.15.29:0/1296772923 shutdown_connections 2024-01-24T13:05:05.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.283+0000 7f620d000640 1 --2- 172.21.15.29:0/1296772923 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f61e0065a90 0x7f61e0067f50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.283+0000 7f620d000640 1 --2- 172.21.15.29:0/1296772923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6208154530 0x7f6208153900 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.283+0000 7f620d000640 1 --2- 172.21.15.29:0/1296772923 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62080cd540 0x7f6208151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.283+0000 7f620d000640 1 --2- 172.21.15.29:0/1296772923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62080cd160 0x7f620814f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.283+0000 7f620d000640 1 -- 172.21.15.29:0/1296772923 >> 172.21.15.29:0/1296772923 conn(0x7f6208069cd0 msgr2=0x7f62080caae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:05.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.287+0000 7f620d000640 1 -- 172.21.15.29:0/1296772923 shutdown_connections 2024-01-24T13:05:05.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.287+0000 7f620d000640 1 -- 172.21.15.29:0/1296772923 wait complete. 2024-01-24T13:05:05.308 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:05:05.308 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:05:05.318 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:05.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.455+0000 7f46a8200640 1 Processor -- start 2024-01-24T13:05:05.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.455+0000 7f46a8200640 1 -- start start 2024-01-24T13:05:05.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.459+0000 7f46a8200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f46a015c450 0x7f46a00cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.459+0000 7f46a8200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f46a00b1f50 0x7f46a00ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.459+0000 7f46a8200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a0070230 con 0x7f46a00b1030 2024-01-24T13:05:05.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.459+0000 7f46a8200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a00712d0 con 0x7f46a00b1f50 2024-01-24T13:05:05.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.459+0000 7f46a8200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a0070510 con 0x7f46a015c450 2024-01-24T13:05:05.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.459+0000 7f46a4e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f46a00b1f50 0x7f46a00ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.459+0000 7f46a4e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f46a00b1f50 0x7f46a00ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40722/0 (socket says 172.21.15.29:40722) 2024-01-24T13:05:05.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.459+0000 7f46a4e00640 1 -- 172.21.15.29:0/3556112366 learned_addr learned my addr 172.21.15.29:0/3556112366 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:05.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.459+0000 7f46a5800640 1 --2- 172.21.15.29:0/3556112366 >> v2:172.21.15.163:3300/0 conn(0x7f46a015c450 0x7f46a00cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.459+0000 7f46a4e00640 1 -- 172.21.15.29:0/3556112366 >> v2:172.21.15.163:3300/0 conn(0x7f46a015c450 msgr2=0x7f46a00cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:05.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.459+0000 7f46a4e00640 1 --2- 172.21.15.29:0/3556112366 >> v2:172.21.15.163:3300/0 conn(0x7f46a015c450 0x7f46a00cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.459+0000 7f46a4e00640 1 -- 172.21.15.29:0/3556112366 >> v1:172.21.15.29:6789/0 conn(0x7f46a00b1030 legacy=0x7f46a006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.459+0000 7f46a4e00640 1 -- 172.21.15.29:0/3556112366 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00707f0 con 0x7f46a00b1f50 2024-01-24T13:05:05.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.459+0000 7f46a4e00640 1 --2- 172.21.15.29:0/3556112366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46a00b1f50 0x7f46a00ce410 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f46a006e0f0 tx=0x7f468801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab600ed9b1605459 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:05.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f469fe00640 1 -- 172.21.15.29:0/3556112366 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880aa660 con 0x7f46a00b1f50 2024-01-24T13:05:05.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f469fe00640 1 -- 172.21.15.29:0/3556112366 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46880aa7c0 con 0x7f46a00b1f50 2024-01-24T13:05:05.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f469fe00640 1 -- 172.21.15.29:0/3556112366 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880aab50 con 0x7f46a00b1f50 2024-01-24T13:05:05.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f46a8200640 1 -- 172.21.15.29:0/3556112366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46a00b1f50 msgr2=0x7f46a00ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f46a8200640 1 --2- 172.21.15.29:0/3556112366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46a00b1f50 0x7f46a00ce410 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f46a006e0f0 tx=0x7f468801c500 comp rx=0 tx=0).stop 2024-01-24T13:05:05.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f46a8200640 1 -- 172.21.15.29:0/3556112366 shutdown_connections 2024-01-24T13:05:05.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f46a8200640 1 --2- 172.21.15.29:0/3556112366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46a00b1f50 0x7f46a00ce410 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f46a8200640 1 --2- 172.21.15.29:0/3556112366 >> v2:172.21.15.163:3300/0 conn(0x7f46a015c450 0x7f46a00cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f46a8200640 1 -- 172.21.15.29:0/3556112366 >> 172.21.15.29:0/3556112366 conn(0x7f46a00b3950 msgr2=0x7f46a0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:05.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f46a8200640 1 -- 172.21.15.29:0/3556112366 shutdown_connections 2024-01-24T13:05:05.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f46a8200640 1 -- 172.21.15.29:0/3556112366 wait complete. 2024-01-24T13:05:05.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f46a8200640 1 Processor -- start 2024-01-24T13:05:05.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f46a8200640 1 -- start start 2024-01-24T13:05:05.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f46a8200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f46a00b1030 0x7f46a0156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f46a8200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46a00b1f50 0x7f46a014fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f46a8200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46a015c450 0x7f46a00b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.463+0000 7f46a8200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00b0b80 con 0x7f46a015c450 2024-01-24T13:05:05.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a8200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a014f020 con 0x7f46a00b1030 2024-01-24T13:05:05.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a8200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00b01b0 con 0x7f46a00b1f50 2024-01-24T13:05:05.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a6200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46a015c450 0x7f46a00b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a6200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46a015c450 0x7f46a00b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40730/0 (socket says 172.21.15.29:40730) 2024-01-24T13:05:05.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a6200640 1 -- 172.21.15.29:0/613922115 learned_addr learned my addr 172.21.15.29:0/613922115 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:05.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a5800640 1 --2- 172.21.15.29:0/613922115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f46a00b1030 0x7f46a0156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a4e00640 1 --2- 172.21.15.29:0/613922115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46a00b1f50 0x7f46a014fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a6200640 1 -- 172.21.15.29:0/613922115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46a00b1f50 msgr2=0x7f46a014fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a6200640 1 --2- 172.21.15.29:0/613922115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46a00b1f50 0x7f46a014fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a6200640 1 -- 172.21.15.29:0/613922115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f46a00b1030 msgr2=0x7f46a0156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a6200640 1 --2- 172.21.15.29:0/613922115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f46a00b1030 0x7f46a0156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a6200640 1 -- 172.21.15.29:0/613922115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46880094d0 con 0x7f46a015c450 2024-01-24T13:05:05.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a6200640 1 --2- 172.21.15.29:0/613922115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46a015c450 0x7f46a00b0640 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f469800c770 tx=0x7f469800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:05.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f469d600640 1 -- 172.21.15.29:0/613922115 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698003b80 con 0x7f46a015c450 2024-01-24T13:05:05.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f469d600640 1 -- 172.21.15.29:0/613922115 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4698003ce0 con 0x7f46a015c450 2024-01-24T13:05:05.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a8200640 1 -- 172.21.15.29:0/613922115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a014f830 con 0x7f46a015c450 2024-01-24T13:05:05.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f469d600640 1 -- 172.21.15.29:0/613922115 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800aa90 con 0x7f46a015c450 2024-01-24T13:05:05.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a8200640 1 -- 172.21.15.29:0/613922115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a014f550 con 0x7f46a015c450 2024-01-24T13:05:05.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f46a8200640 1 -- 172.21.15.29:0/613922115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a00b0340 con 0x7f46a015c450 2024-01-24T13:05:05.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.467+0000 7f469d600640 1 -- 172.21.15.29:0/613922115 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f469800abf0 con 0x7f46a015c450 2024-01-24T13:05:05.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.471+0000 7f469d600640 1 --2- 172.21.15.29:0/613922115 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4678065a90 0x7f4678067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.471+0000 7f469d600640 1 -- 172.21.15.29:0/613922115 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4698083180 con 0x7f46a015c450 2024-01-24T13:05:05.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.471+0000 7f46a5800640 1 --2- 172.21.15.29:0/613922115 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4678065a90 0x7f4678067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.471+0000 7f46a5800640 1 --2- 172.21.15.29:0/613922115 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4678065a90 0x7f4678067f50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f46900079c0 tx=0x7f4690008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:05.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.475+0000 7f469d600640 1 -- 172.21.15.29:0/613922115 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f46980508b0 con 0x7f46a015c450 2024-01-24T13:05:05.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.635+0000 7f46a8200640 1 -- 172.21.15.29:0/613922115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46a004e850 con 0x7f46a015c450 2024-01-24T13:05:05.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.635+0000 7f469d600640 1 -- 172.21.15.29:0/613922115 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7f4698053ed0 con 0x7f46a015c450 2024-01-24T13:05:05.639 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:05.639 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:05.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.639+0000 7f46a8200640 1 -- 172.21.15.29:0/613922115 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4678065a90 msgr2=0x7f4678067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.639+0000 7f46a8200640 1 --2- 172.21.15.29:0/613922115 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4678065a90 0x7f4678067f50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f46900079c0 tx=0x7f4690008040 comp rx=0 tx=0).stop 2024-01-24T13:05:05.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.639+0000 7f46a8200640 1 -- 172.21.15.29:0/613922115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46a015c450 msgr2=0x7f46a00b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.639+0000 7f46a8200640 1 --2- 172.21.15.29:0/613922115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46a015c450 0x7f46a00b0640 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f469800c770 tx=0x7f469800cc30 comp rx=0 tx=0).stop 2024-01-24T13:05:05.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.639+0000 7f46a8200640 1 -- 172.21.15.29:0/613922115 shutdown_connections 2024-01-24T13:05:05.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.639+0000 7f46a8200640 1 --2- 172.21.15.29:0/613922115 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4678065a90 0x7f4678067f50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.639+0000 7f46a8200640 1 --2- 172.21.15.29:0/613922115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46a015c450 0x7f46a00b0640 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.639+0000 7f46a8200640 1 --2- 172.21.15.29:0/613922115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46a00b1f50 0x7f46a014fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.639+0000 7f46a8200640 1 --2- 172.21.15.29:0/613922115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f46a00b1030 0x7f46a0156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.639+0000 7f46a8200640 1 -- 172.21.15.29:0/613922115 >> 172.21.15.29:0/613922115 conn(0x7f46a00b3950 msgr2=0x7f46a0153be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:05.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.639+0000 7f46a8200640 1 -- 172.21.15.29:0/613922115 shutdown_connections 2024-01-24T13:05:05.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.639+0000 7f46a8200640 1 -- 172.21.15.29:0/613922115 wait complete. 2024-01-24T13:05:05.661 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:05:05.661 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:05:05.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.803+0000 7f1a99000640 1 Processor -- start 2024-01-24T13:05:05.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.803+0000 7f1a99000640 1 -- start start 2024-01-24T13:05:05.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.803+0000 7f1a99000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1a9406be20 0x7f1a9415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.803+0000 7f1a99000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a9413d4b0 0x7f1a9415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.803+0000 7f1a99000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9415b4f0 con 0x7f1a9406c200 2024-01-24T13:05:05.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.803+0000 7f1a99000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9415b7d0 con 0x7f1a9413d4b0 2024-01-24T13:05:05.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.803+0000 7f1a99000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a940cd0c0 con 0x7f1a9406be20 2024-01-24T13:05:05.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.803+0000 7f1a92800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a9413d4b0 0x7f1a9415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.803+0000 7f1a92800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a9413d4b0 0x7f1a9415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40732/0 (socket says 172.21.15.29:40732) 2024-01-24T13:05:05.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.803+0000 7f1a92800640 1 -- 172.21.15.29:0/1781075623 learned_addr learned my addr 172.21.15.29:0/1781075623 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:05.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.803+0000 7f1a92800640 1 -- 172.21.15.29:0/1781075623 >> v2:172.21.15.163:3300/0 conn(0x7f1a9406be20 msgr2=0x7f1a9415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:05.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.803+0000 7f1a92800640 1 --2- 172.21.15.29:0/1781075623 >> v2:172.21.15.163:3300/0 conn(0x7f1a9406be20 0x7f1a9415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.803+0000 7f1a92800640 1 -- 172.21.15.29:0/1781075623 >> v1:172.21.15.29:6789/0 conn(0x7f1a9406c200 legacy=0x7f1a9413cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.803+0000 7f1a92800640 1 -- 172.21.15.29:0/1781075623 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a940cd3a0 con 0x7f1a9413d4b0 2024-01-24T13:05:05.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.807+0000 7f1a92800640 1 --2- 172.21.15.29:0/1781075623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a9413d4b0 0x7f1a9415af00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1a940cefb0 tx=0x7f1a8c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8d978b697cf110 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:05.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.807+0000 7f1a90a00640 1 -- 172.21.15.29:0/1781075623 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0a58b0 con 0x7f1a9413d4b0 2024-01-24T13:05:05.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.807+0000 7f1a90a00640 1 -- 172.21.15.29:0/1781075623 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c0a5a10 con 0x7f1a9413d4b0 2024-01-24T13:05:05.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.807+0000 7f1a90a00640 1 -- 172.21.15.29:0/1781075623 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0a5da0 con 0x7f1a9413d4b0 2024-01-24T13:05:05.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.807+0000 7f1a99000640 1 -- 172.21.15.29:0/1781075623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a9413d4b0 msgr2=0x7f1a9415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.807+0000 7f1a99000640 1 --2- 172.21.15.29:0/1781075623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a9413d4b0 0x7f1a9415af00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1a940cefb0 tx=0x7f1a8c01c990 comp rx=0 tx=0).stop 2024-01-24T13:05:05.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.807+0000 7f1a99000640 1 -- 172.21.15.29:0/1781075623 shutdown_connections 2024-01-24T13:05:05.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.807+0000 7f1a99000640 1 --2- 172.21.15.29:0/1781075623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a9413d4b0 0x7f1a9415af00 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.807+0000 7f1a99000640 1 --2- 172.21.15.29:0/1781075623 >> v2:172.21.15.163:3300/0 conn(0x7f1a9406be20 0x7f1a9415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.807+0000 7f1a99000640 1 -- 172.21.15.29:0/1781075623 >> 172.21.15.29:0/1781075623 conn(0x7f1a9406d700 msgr2=0x7f1a94069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:05.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.807+0000 7f1a99000640 1 -- 172.21.15.29:0/1781075623 shutdown_connections 2024-01-24T13:05:05.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.807+0000 7f1a99000640 1 -- 172.21.15.29:0/1781075623 wait complete. 2024-01-24T13:05:05.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a99000640 1 Processor -- start 2024-01-24T13:05:05.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a99000640 1 -- start start 2024-01-24T13:05:05.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a99000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a9406be20 0x7f1a94137f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a99000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a9406c200 0x7f1a9414c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a99000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a9413d4b0 0x7f1a9414c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a99000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94138460 con 0x7f1a9413d4b0 2024-01-24T13:05:05.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a99000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9414b300 con 0x7f1a9406c200 2024-01-24T13:05:05.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a99000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9414b5e0 con 0x7f1a9406be20 2024-01-24T13:05:05.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a92800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a9413d4b0 0x7f1a9414c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a92800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a9413d4b0 0x7f1a9414c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40744/0 (socket says 172.21.15.29:40744) 2024-01-24T13:05:05.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a92800640 1 -- 172.21.15.29:0/3346847993 learned_addr learned my addr 172.21.15.29:0/3346847993 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:05.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a91e00640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a9406be20 0x7f1a94137f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a91400640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a9406c200 0x7f1a9414c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a92800640 1 -- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a9406be20 msgr2=0x7f1a94137f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a92800640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a9406be20 0x7f1a94137f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a92800640 1 -- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a9406c200 msgr2=0x7f1a9414c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a92800640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a9406c200 0x7f1a9414c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a92800640 1 -- 172.21.15.29:0/3346847993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c009b30 con 0x7f1a9413d4b0 2024-01-24T13:05:05.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a91e00640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a9406be20 0x7f1a94137f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:05.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a91400640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a9406c200 0x7f1a9414c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:05.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a92800640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a9413d4b0 0x7f1a9414c8e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0195a0 tx=0x7f1a8c019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:05.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a8a000640 1 -- 172.21.15.29:0/3346847993 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0b8670 con 0x7f1a9413d4b0 2024-01-24T13:05:05.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a8a000640 1 -- 172.21.15.29:0/3346847993 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c0b87d0 con 0x7f1a9413d4b0 2024-01-24T13:05:05.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a8a000640 1 -- 172.21.15.29:0/3346847993 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0b8b60 con 0x7f1a9413d4b0 2024-01-24T13:05:05.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a99000640 1 -- 172.21.15.29:0/3346847993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9414b8c0 con 0x7f1a9413d4b0 2024-01-24T13:05:05.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.811+0000 7f1a99000640 1 -- 172.21.15.29:0/3346847993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9414be80 con 0x7f1a9413d4b0 2024-01-24T13:05:05.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.815+0000 7f1a99000640 1 -- 172.21.15.29:0/3346847993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9414c070 con 0x7f1a9413d4b0 2024-01-24T13:05:05.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.815+0000 7f1a8a000640 1 -- 172.21.15.29:0/3346847993 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1a8c0b8cc0 con 0x7f1a9413d4b0 2024-01-24T13:05:05.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.815+0000 7f1a8a000640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1a6c065a60 0x7f1a6c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:05.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.815+0000 7f1a8a000640 1 -- 172.21.15.29:0/3346847993 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f1a8c11ebe0 con 0x7f1a9413d4b0 2024-01-24T13:05:05.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.815+0000 7f1a91e00640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1a6c065a60 0x7f1a6c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:05.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.815+0000 7f1a91e00640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1a6c065a60 0x7f1a6c067f20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400a8b0 tx=0x7f1a84008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:05.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.819+0000 7f1a8a000640 1 -- 172.21.15.29:0/3346847993 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1a8c0ec2f0 con 0x7f1a9413d4b0 2024-01-24T13:05:05.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.975+0000 7f1a99000640 1 -- 172.21.15.29:0/3346847993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a9404e850 con 0x7f1a9413d4b0 2024-01-24T13:05:05.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.975+0000 7f1a8a000640 1 -- 172.21.15.29:0/3346847993 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a8c0ef910 con 0x7f1a9413d4b0 2024-01-24T13:05:05.979 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:05:05.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.979+0000 7f1a99000640 1 -- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1a6c065a60 msgr2=0x7f1a6c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.979+0000 7f1a99000640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1a6c065a60 0x7f1a6c067f20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400a8b0 tx=0x7f1a84008040 comp rx=0 tx=0).stop 2024-01-24T13:05:05.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.979+0000 7f1a99000640 1 -- 172.21.15.29:0/3346847993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a9413d4b0 msgr2=0x7f1a9414c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:05.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.979+0000 7f1a99000640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a9413d4b0 0x7f1a9414c8e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0195a0 tx=0x7f1a8c019730 comp rx=0 tx=0).stop 2024-01-24T13:05:05.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.979+0000 7f1a99000640 1 -- 172.21.15.29:0/3346847993 shutdown_connections 2024-01-24T13:05:05.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.979+0000 7f1a99000640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1a6c065a60 0x7f1a6c067f20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.979+0000 7f1a99000640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a9413d4b0 0x7f1a9414c8e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.979+0000 7f1a99000640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a9406c200 0x7f1a9414c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.979+0000 7f1a99000640 1 --2- 172.21.15.29:0/3346847993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a9406be20 0x7f1a94137f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:05.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.979+0000 7f1a99000640 1 -- 172.21.15.29:0/3346847993 >> 172.21.15.29:0/3346847993 conn(0x7f1a9406d700 msgr2=0x7f1a940af050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:05.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.979+0000 7f1a99000640 1 -- 172.21.15.29:0/3346847993 shutdown_connections 2024-01-24T13:05:05.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:05.979+0000 7f1a99000640 1 -- 172.21.15.29:0/3346847993 wait complete. 2024-01-24T13:05:06.000 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:05:06.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.139+0000 7f5298000640 1 Processor -- start 2024-01-24T13:05:06.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.139+0000 7f5298000640 1 -- start start 2024-01-24T13:05:06.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5298000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f529015ca80 0x7f529006a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5298000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5290070460 0x7f52900708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5298000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5290160600 0x7f5290160a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5298000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5290161580 con 0x7f529015ca80 2024-01-24T13:05:06.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5298000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5290070de0 con 0x7f5290160600 2024-01-24T13:05:06.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5298000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5290160fd0 con 0x7f5290070460 2024-01-24T13:05:06.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5295600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f529015ca80 0x7f529006a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5295600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f529015ca80 0x7f529006a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40754/0 (socket says 172.21.15.29:40754) 2024-01-24T13:05:06.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5295600640 1 -- 172.21.15.29:0/2508514181 learned_addr learned my addr 172.21.15.29:0/2508514181 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:06.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5296000640 1 --2- 172.21.15.29:0/2508514181 >> v2:172.21.15.163:3300/0 conn(0x7f5290160600 0x7f5290160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5294c00640 1 --2- 172.21.15.29:0/2508514181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5290070460 0x7f52900708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5295600640 1 -- 172.21.15.29:0/2508514181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5290070460 msgr2=0x7f52900708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:06.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5295600640 1 --2- 172.21.15.29:0/2508514181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5290070460 0x7f52900708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5295600640 1 -- 172.21.15.29:0/2508514181 >> v2:172.21.15.163:3300/0 conn(0x7f5290160600 msgr2=0x7f5290160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:06.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5295600640 1 --2- 172.21.15.29:0/2508514181 >> v2:172.21.15.163:3300/0 conn(0x7f5290160600 0x7f5290160a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5295600640 1 -- 172.21.15.29:0/2508514181 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52901612a0 con 0x7f529015ca80 2024-01-24T13:05:06.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.143+0000 7f5296000640 1 --2- 172.21.15.29:0/2508514181 >> v2:172.21.15.163:3300/0 conn(0x7f5290160600 0x7f5290160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:06.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.147+0000 7f5295600640 1 --2- 172.21.15.29:0/2508514181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f529015ca80 0x7f529006a950 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f52900711f0 tx=0x7f528001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a432df2f7eec87d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:06.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.147+0000 7f528fe00640 1 -- 172.21.15.29:0/2508514181 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52800ac410 con 0x7f529015ca80 2024-01-24T13:05:06.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.147+0000 7f528fe00640 1 -- 172.21.15.29:0/2508514181 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52800ac570 con 0x7f529015ca80 2024-01-24T13:05:06.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.147+0000 7f528fe00640 1 -- 172.21.15.29:0/2508514181 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52800ac900 con 0x7f529015ca80 2024-01-24T13:05:06.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.147+0000 7f5298000640 1 -- 172.21.15.29:0/2508514181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f529015ca80 msgr2=0x7f529006a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.147+0000 7f5298000640 1 --2- 172.21.15.29:0/2508514181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f529015ca80 0x7f529006a950 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f52900711f0 tx=0x7f528001c500 comp rx=0 tx=0).stop 2024-01-24T13:05:06.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.147+0000 7f5298000640 1 -- 172.21.15.29:0/2508514181 shutdown_connections 2024-01-24T13:05:06.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.147+0000 7f5298000640 1 --2- 172.21.15.29:0/2508514181 >> v2:172.21.15.163:3300/0 conn(0x7f5290160600 0x7f5290160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.147+0000 7f5298000640 1 --2- 172.21.15.29:0/2508514181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5290070460 0x7f52900708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.147+0000 7f5298000640 1 --2- 172.21.15.29:0/2508514181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f529015ca80 0x7f529006a950 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.147+0000 7f5298000640 1 -- 172.21.15.29:0/2508514181 >> 172.21.15.29:0/2508514181 conn(0x7f52900cb6a0 msgr2=0x7f52900cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:06.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.147+0000 7f5298000640 1 -- 172.21.15.29:0/2508514181 shutdown_connections 2024-01-24T13:05:06.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.147+0000 7f5298000640 1 -- 172.21.15.29:0/2508514181 wait complete. 2024-01-24T13:05:06.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.147+0000 7f5298000640 1 Processor -- start 2024-01-24T13:05:06.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5298000640 1 -- start start 2024-01-24T13:05:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5298000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5290070460 0x7f52900c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5298000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f529015ca80 0x7f529014fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5298000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5290160600 0x7f52900af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5298000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52900af180 con 0x7f529015ca80 2024-01-24T13:05:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5298000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52900c6cd0 con 0x7f5290070460 2024-01-24T13:05:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5298000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52900af3f0 con 0x7f5290160600 2024-01-24T13:05:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5294c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f529015ca80 0x7f529014fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5294c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f529015ca80 0x7f529014fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40764/0 (socket says 172.21.15.29:40764) 2024-01-24T13:05:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5294c00640 1 -- 172.21.15.29:0/2978217068 learned_addr learned my addr 172.21.15.29:0/2978217068 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:06.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5296000640 1 --2- 172.21.15.29:0/2978217068 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5290160600 0x7f52900af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5295600640 1 --2- 172.21.15.29:0/2978217068 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5290070460 0x7f52900c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5294c00640 1 -- 172.21.15.29:0/2978217068 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5290160600 msgr2=0x7f52900af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5294c00640 1 --2- 172.21.15.29:0/2978217068 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5290160600 0x7f52900af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5294c00640 1 -- 172.21.15.29:0/2978217068 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5290070460 msgr2=0x7f52900c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5294c00640 1 --2- 172.21.15.29:0/2978217068 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5290070460 0x7f52900c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5294c00640 1 -- 172.21.15.29:0/2978217068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52800094d0 con 0x7f529015ca80 2024-01-24T13:05:06.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5294c00640 1 --2- 172.21.15.29:0/2978217068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f529015ca80 0x7f529014fd80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f527800d800 tx=0x7f527800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:06.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f528d600640 1 -- 172.21.15.29:0/2978217068 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52780096c0 con 0x7f529015ca80 2024-01-24T13:05:06.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f528d600640 1 -- 172.21.15.29:0/2978217068 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5278009820 con 0x7f529015ca80 2024-01-24T13:05:06.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f528d600640 1 -- 172.21.15.29:0/2978217068 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5278009bd0 con 0x7f529015ca80 2024-01-24T13:05:06.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5298000640 1 -- 172.21.15.29:0/2978217068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529014fa10 con 0x7f529015ca80 2024-01-24T13:05:06.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5298000640 1 -- 172.21.15.29:0/2978217068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52900afe50 con 0x7f529015ca80 2024-01-24T13:05:06.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.151+0000 7f5298000640 1 -- 172.21.15.29:0/2978217068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529014fbd0 con 0x7f529015ca80 2024-01-24T13:05:06.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.155+0000 7f528d600640 1 -- 172.21.15.29:0/2978217068 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5278009d30 con 0x7f529015ca80 2024-01-24T13:05:06.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.155+0000 7f528d600640 1 --2- 172.21.15.29:0/2978217068 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5268065a60 0x7f5268067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.155+0000 7f528d600640 1 -- 172.21.15.29:0/2978217068 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f5278083a70 con 0x7f529015ca80 2024-01-24T13:05:06.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.155+0000 7f5295600640 1 --2- 172.21.15.29:0/2978217068 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5268065a60 0x7f5268067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.155+0000 7f5295600640 1 --2- 172.21.15.29:0/2978217068 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5268065a60 0x7f5268067f20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f52800ae000 tx=0x7f5280008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:06.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.159+0000 7f528d600640 1 -- 172.21.15.29:0/2978217068 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f5278051240 con 0x7f529015ca80 2024-01-24T13:05:06.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.315+0000 7f5298000640 1 -- 172.21.15.29:0/2978217068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f529004e850 con 0x7f529015ca80 2024-01-24T13:05:06.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.315+0000 7f528d600640 1 -- 172.21.15.29:0/2978217068 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5278018020 con 0x7f529015ca80 2024-01-24T13:05:06.319 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:06.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.315+0000 7f5298000640 1 -- 172.21.15.29:0/2978217068 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5268065a60 msgr2=0x7f5268067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.315+0000 7f5298000640 1 --2- 172.21.15.29:0/2978217068 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5268065a60 0x7f5268067f20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f52800ae000 tx=0x7f5280008040 comp rx=0 tx=0).stop 2024-01-24T13:05:06.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.315+0000 7f5298000640 1 -- 172.21.15.29:0/2978217068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f529015ca80 msgr2=0x7f529014fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.315+0000 7f5298000640 1 --2- 172.21.15.29:0/2978217068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f529015ca80 0x7f529014fd80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f527800d800 tx=0x7f527800dcc0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.319+0000 7f5298000640 1 -- 172.21.15.29:0/2978217068 shutdown_connections 2024-01-24T13:05:06.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.319+0000 7f5298000640 1 --2- 172.21.15.29:0/2978217068 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5268065a60 0x7f5268067f20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.319+0000 7f5298000640 1 --2- 172.21.15.29:0/2978217068 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5290160600 0x7f52900af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.319+0000 7f5298000640 1 --2- 172.21.15.29:0/2978217068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f529015ca80 0x7f529014fd80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.319+0000 7f5298000640 1 --2- 172.21.15.29:0/2978217068 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5290070460 0x7f52900c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.319+0000 7f5298000640 1 -- 172.21.15.29:0/2978217068 >> 172.21.15.29:0/2978217068 conn(0x7f52900cb6a0 msgr2=0x7f52900ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:06.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.319+0000 7f5298000640 1 -- 172.21.15.29:0/2978217068 shutdown_connections 2024-01-24T13:05:06.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.319+0000 7f5298000640 1 -- 172.21.15.29:0/2978217068 wait complete. 2024-01-24T13:05:06.341 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:05:06.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.483+0000 7f5b85600640 1 Processor -- start 2024-01-24T13:05:06.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.483+0000 7f5b85600640 1 -- start start 2024-01-24T13:05:06.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.483+0000 7f5b85600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5b8006be20 0x7f5b8015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.483+0000 7f5b85600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8015b4f0 con 0x7f5b8013d4b0 2024-01-24T13:05:06.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.483+0000 7f5b85600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8015b7d0 con 0x7f5b8006c200 2024-01-24T13:05:06.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.483+0000 7f5b85600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b800cd0c0 con 0x7f5b8006be20 2024-01-24T13:05:06.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.483+0000 7f5b7ea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5b8006be20 0x7f5b8015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.483+0000 7f5b7ea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5b8006be20 0x7f5b8015a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40770/0 (socket says 172.21.15.29:40770) 2024-01-24T13:05:06.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.483+0000 7f5b7ea00640 1 -- 172.21.15.29:0/1815331850 learned_addr learned my addr 172.21.15.29:0/1815331850 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:06.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.483+0000 7f5b7ea00640 1 -- 172.21.15.29:0/1815331850 >> v1:172.21.15.163:6789/0 conn(0x7f5b8006c200 legacy=0x7f5b8013cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.483+0000 7f5b7ea00640 1 -- 172.21.15.29:0/1815331850 >> v1:172.21.15.29:6789/0 conn(0x7f5b8013d4b0 legacy=0x7f5b800cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.483+0000 7f5b7ea00640 1 -- 172.21.15.29:0/1815331850 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b800cd3a0 con 0x7f5b8006be20 2024-01-24T13:05:06.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.487+0000 7f5b7ea00640 1 --2- 172.21.15.29:0/1815331850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006be20 0x7f5b8015a9c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5b70009870 tx=0x7f5b7001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f597d2e4aed1f340 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:06.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.487+0000 7f5b7d600640 1 -- 172.21.15.29:0/1815331850 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700ab650 con 0x7f5b8006be20 2024-01-24T13:05:06.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.487+0000 7f5b7d600640 1 -- 172.21.15.29:0/1815331850 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b700ab7b0 con 0x7f5b8006be20 2024-01-24T13:05:06.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.487+0000 7f5b7d600640 1 -- 172.21.15.29:0/1815331850 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700abb40 con 0x7f5b8006be20 2024-01-24T13:05:06.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.487+0000 7f5b85600640 1 -- 172.21.15.29:0/1815331850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006be20 msgr2=0x7f5b8015a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.487+0000 7f5b85600640 1 --2- 172.21.15.29:0/1815331850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006be20 0x7f5b8015a9c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5b70009870 tx=0x7f5b7001c500 comp rx=0 tx=0).stop 2024-01-24T13:05:06.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.487+0000 7f5b85600640 1 -- 172.21.15.29:0/1815331850 shutdown_connections 2024-01-24T13:05:06.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.487+0000 7f5b85600640 1 --2- 172.21.15.29:0/1815331850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006be20 0x7f5b8015a9c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.487+0000 7f5b85600640 1 -- 172.21.15.29:0/1815331850 >> 172.21.15.29:0/1815331850 conn(0x7f5b8006d700 msgr2=0x7f5b80069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:06.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.487+0000 7f5b85600640 1 -- 172.21.15.29:0/1815331850 shutdown_connections 2024-01-24T13:05:06.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.487+0000 7f5b85600640 1 -- 172.21.15.29:0/1815331850 wait complete. 2024-01-24T13:05:06.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b85600640 1 Processor -- start 2024-01-24T13:05:06.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b85600640 1 -- start start 2024-01-24T13:05:06.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b85600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b8006be20 0x7f5b8014e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b85600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006c200 0x7f5b8013b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b85600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b8013d4b0 0x7f5b8015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b85600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8014f730 con 0x7f5b8006c200 2024-01-24T13:05:06.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b85600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8014f170 con 0x7f5b8006be20 2024-01-24T13:05:06.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b85600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8014f450 con 0x7f5b8013d4b0 2024-01-24T13:05:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b7e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006c200 0x7f5b8013b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b7e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006c200 0x7f5b8013b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40772/0 (socket says 172.21.15.29:40772) 2024-01-24T13:05:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b7e000640 1 -- 172.21.15.29:0/259670454 learned_addr learned my addr 172.21.15.29:0/259670454 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b7ea00640 1 --2- 172.21.15.29:0/259670454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b8006be20 0x7f5b8014e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b7f400640 1 --2- 172.21.15.29:0/259670454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b8013d4b0 0x7f5b8015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b7e000640 1 -- 172.21.15.29:0/259670454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b8013d4b0 msgr2=0x7f5b8015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b7e000640 1 --2- 172.21.15.29:0/259670454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b8013d4b0 0x7f5b8015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b7e000640 1 -- 172.21.15.29:0/259670454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b8006be20 msgr2=0x7f5b8014e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b7e000640 1 --2- 172.21.15.29:0/259670454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b8006be20 0x7f5b8014e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b7e000640 1 -- 172.21.15.29:0/259670454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b700094d0 con 0x7f5b8006c200 2024-01-24T13:05:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b7e000640 1 --2- 172.21.15.29:0/259670454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006c200 0x7f5b8013b6b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c500 tx=0x7f5b6800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b76a00640 1 -- 172.21.15.29:0/259670454 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68005220 con 0x7f5b8006c200 2024-01-24T13:05:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b76a00640 1 -- 172.21.15.29:0/259670454 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b68005380 con 0x7f5b8006c200 2024-01-24T13:05:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b76a00640 1 -- 172.21.15.29:0/259670454 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68007270 con 0x7f5b8006c200 2024-01-24T13:05:06.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b85600640 1 -- 172.21.15.29:0/259670454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b80152f20 con 0x7f5b8006c200 2024-01-24T13:05:06.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.491+0000 7f5b85600640 1 -- 172.21.15.29:0/259670454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8014edb0 con 0x7f5b8006c200 2024-01-24T13:05:06.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.495+0000 7f5b85600640 1 -- 172.21.15.29:0/259670454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b80152d80 con 0x7f5b8006c200 2024-01-24T13:05:06.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.495+0000 7f5b76a00640 1 -- 172.21.15.29:0/259670454 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5b680073d0 con 0x7f5b8006c200 2024-01-24T13:05:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.495+0000 7f5b76a00640 1 --2- 172.21.15.29:0/259670454 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5b58065a60 0x7f5b58067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.495+0000 7f5b76a00640 1 -- 172.21.15.29:0/259670454 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f5b68082ce0 con 0x7f5b8006c200 2024-01-24T13:05:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.495+0000 7f5b7ea00640 1 --2- 172.21.15.29:0/259670454 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5b58065a60 0x7f5b58067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.495+0000 7f5b7ea00640 1 --2- 172.21.15.29:0/259670454 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5b58065a60 0x7f5b58067f20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5b700af000 tx=0x7f5b700b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:06.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.499+0000 7f5b76a00640 1 -- 172.21.15.29:0/259670454 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f5b80152d80 con 0x7f5b8006c200 2024-01-24T13:05:06.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.655+0000 7f5b85600640 1 -- 172.21.15.29:0/259670454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b80152d80 con 0x7f5b8006c200 2024-01-24T13:05:06.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.655+0000 7f5b76a00640 1 -- 172.21.15.29:0/259670454 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b80152d80 con 0x7f5b8006c200 2024-01-24T13:05:06.659 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:05:06.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.655+0000 7f5b85600640 1 -- 172.21.15.29:0/259670454 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5b58065a60 msgr2=0x7f5b58067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.655+0000 7f5b85600640 1 --2- 172.21.15.29:0/259670454 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5b58065a60 0x7f5b58067f20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5b700af000 tx=0x7f5b700b6040 comp rx=0 tx=0).stop 2024-01-24T13:05:06.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.655+0000 7f5b85600640 1 -- 172.21.15.29:0/259670454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006c200 msgr2=0x7f5b8013b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.655+0000 7f5b85600640 1 --2- 172.21.15.29:0/259670454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006c200 0x7f5b8013b6b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c500 tx=0x7f5b6800c9c0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.659+0000 7f5b85600640 1 -- 172.21.15.29:0/259670454 shutdown_connections 2024-01-24T13:05:06.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.659+0000 7f5b85600640 1 --2- 172.21.15.29:0/259670454 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5b58065a60 0x7f5b58067f20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.659+0000 7f5b85600640 1 --2- 172.21.15.29:0/259670454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b8013d4b0 0x7f5b8015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.659+0000 7f5b85600640 1 --2- 172.21.15.29:0/259670454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006c200 0x7f5b8013b6b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.659+0000 7f5b85600640 1 --2- 172.21.15.29:0/259670454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b8006be20 0x7f5b8014e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.659+0000 7f5b85600640 1 -- 172.21.15.29:0/259670454 >> 172.21.15.29:0/259670454 conn(0x7f5b8006d700 msgr2=0x7f5b800af590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:06.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.659+0000 7f5b85600640 1 -- 172.21.15.29:0/259670454 shutdown_connections 2024-01-24T13:05:06.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.659+0000 7f5b85600640 1 -- 172.21.15.29:0/259670454 wait complete. 2024-01-24T13:05:06.681 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:05:06.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28bce00640 1 Processor -- start 2024-01-24T13:05:06.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28bce00640 1 -- start start 2024-01-24T13:05:06.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28bce00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28b815c830 0x7f28b80c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28bce00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28b81603a0 0x7f28b80ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28bce00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f28b8069cd0 0x7f28b80cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28bce00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b8070cf0 con 0x7f28b81603a0 2024-01-24T13:05:06.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28bce00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b815cc10 con 0x7f28b8069cd0 2024-01-24T13:05:06.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28bce00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8160910 con 0x7f28b815c830 2024-01-24T13:05:06.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28b5400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28b81603a0 0x7f28b80ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28b5400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28b81603a0 0x7f28b80ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40784/0 (socket says 172.21.15.29:40784) 2024-01-24T13:05:06.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28b5400640 1 -- 172.21.15.29:0/4103490050 learned_addr learned my addr 172.21.15.29:0/4103490050 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:06.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28b6800640 1 --2- 172.21.15.29:0/4103490050 >> v2:172.21.15.163:3300/0 conn(0x7f28b8069cd0 0x7f28b80cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28b5e00640 1 --2- 172.21.15.29:0/4103490050 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28b815c830 0x7f28b80c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28b5400640 1 -- 172.21.15.29:0/4103490050 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28b815c830 msgr2=0x7f28b80c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:06.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28b5400640 1 --2- 172.21.15.29:0/4103490050 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28b815c830 0x7f28b80c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28b5400640 1 -- 172.21.15.29:0/4103490050 >> v2:172.21.15.163:3300/0 conn(0x7f28b8069cd0 msgr2=0x7f28b80cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:06.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28b5400640 1 --2- 172.21.15.29:0/4103490050 >> v2:172.21.15.163:3300/0 conn(0x7f28b8069cd0 0x7f28b80cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28b5400640 1 -- 172.21.15.29:0/4103490050 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b8160bf0 con 0x7f28b81603a0 2024-01-24T13:05:06.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.823+0000 7f28b5e00640 1 --2- 172.21.15.29:0/4103490050 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28b815c830 0x7f28b80c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:06.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.827+0000 7f28b5400640 1 --2- 172.21.15.29:0/4103490050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b81603a0 0x7f28b80ccea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f28b8070120 tx=0x7f28a001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ba257876fe92dd server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:06.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.827+0000 7f28b4a00640 1 -- 172.21.15.29:0/4103490050 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a00a89b0 con 0x7f28b81603a0 2024-01-24T13:05:06.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.827+0000 7f28b4a00640 1 -- 172.21.15.29:0/4103490050 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a00a8b10 con 0x7f28b81603a0 2024-01-24T13:05:06.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.827+0000 7f28b4a00640 1 -- 172.21.15.29:0/4103490050 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a00a8ea0 con 0x7f28b81603a0 2024-01-24T13:05:06.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.827+0000 7f28bce00640 1 -- 172.21.15.29:0/4103490050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b81603a0 msgr2=0x7f28b80ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.827+0000 7f28bce00640 1 --2- 172.21.15.29:0/4103490050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b81603a0 0x7f28b80ccea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f28b8070120 tx=0x7f28a001ecf0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.827+0000 7f28bce00640 1 -- 172.21.15.29:0/4103490050 shutdown_connections 2024-01-24T13:05:06.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.827+0000 7f28bce00640 1 --2- 172.21.15.29:0/4103490050 >> v2:172.21.15.163:3300/0 conn(0x7f28b8069cd0 0x7f28b80cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.827+0000 7f28bce00640 1 --2- 172.21.15.29:0/4103490050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b81603a0 0x7f28b80ccea0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.827+0000 7f28bce00640 1 --2- 172.21.15.29:0/4103490050 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28b815c830 0x7f28b80c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.827+0000 7f28bce00640 1 -- 172.21.15.29:0/4103490050 >> 172.21.15.29:0/4103490050 conn(0x7f28b80cbd50 msgr2=0x7f28b80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:06.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.827+0000 7f28bce00640 1 -- 172.21.15.29:0/4103490050 shutdown_connections 2024-01-24T13:05:06.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.827+0000 7f28bce00640 1 -- 172.21.15.29:0/4103490050 wait complete. 2024-01-24T13:05:06.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28bce00640 1 Processor -- start 2024-01-24T13:05:06.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28bce00640 1 -- start start 2024-01-24T13:05:06.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28bce00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b8069cd0 0x7f28b8150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28bce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28b815c830 0x7f28b80b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28bce00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28b81603a0 0x7f28b80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28bce00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80b4500 con 0x7f28b8069cd0 2024-01-24T13:05:06.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28bce00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8150db0 con 0x7f28b815c830 2024-01-24T13:05:06.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28bce00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80c5720 con 0x7f28b81603a0 2024-01-24T13:05:06.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28b5e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b8069cd0 0x7f28b8150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28b5e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b8069cd0 0x7f28b8150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40794/0 (socket says 172.21.15.29:40794) 2024-01-24T13:05:06.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28b5e00640 1 -- 172.21.15.29:0/2239190798 learned_addr learned my addr 172.21.15.29:0/2239190798 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:06.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28b5400640 1 --2- 172.21.15.29:0/2239190798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28b815c830 0x7f28b80b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28b6800640 1 --2- 172.21.15.29:0/2239190798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28b81603a0 0x7f28b80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28b5e00640 1 -- 172.21.15.29:0/2239190798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28b81603a0 msgr2=0x7f28b80c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28b5e00640 1 --2- 172.21.15.29:0/2239190798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28b81603a0 0x7f28b80c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28b5e00640 1 -- 172.21.15.29:0/2239190798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28b815c830 msgr2=0x7f28b80b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:06.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28b5e00640 1 --2- 172.21.15.29:0/2239190798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28b815c830 0x7f28b80b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:06.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28b5e00640 1 -- 172.21.15.29:0/2239190798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a00094d0 con 0x7f28b8069cd0 2024-01-24T13:05:06.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28b5e00640 1 --2- 172.21.15.29:0/2239190798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b8069cd0 0x7f28b8150870 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f28a800e840 tx=0x7f28a800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:06.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28ae000640 1 -- 172.21.15.29:0/2239190798 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800c8d0 con 0x7f28b8069cd0 2024-01-24T13:05:06.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28ae000640 1 -- 172.21.15.29:0/2239190798 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a800ca30 con 0x7f28b8069cd0 2024-01-24T13:05:06.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28bce00640 1 -- 172.21.15.29:0/2239190798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b80b2470 con 0x7f28b8069cd0 2024-01-24T13:05:06.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28ae000640 1 -- 172.21.15.29:0/2239190798 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800cdc0 con 0x7f28b8069cd0 2024-01-24T13:05:06.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.831+0000 7f28bce00640 1 -- 172.21.15.29:0/2239190798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b80b37c0 con 0x7f28b8069cd0 2024-01-24T13:05:06.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.835+0000 7f28bce00640 1 -- 172.21.15.29:0/2239190798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b804e850 con 0x7f28b8069cd0 2024-01-24T13:05:06.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.835+0000 7f28ae000640 1 -- 172.21.15.29:0/2239190798 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f28a8013410 con 0x7f28b8069cd0 2024-01-24T13:05:06.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.835+0000 7f28ae000640 1 --2- 172.21.15.29:0/2239190798 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2890065a60 0x7f2890067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:06.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.835+0000 7f28ae000640 1 -- 172.21.15.29:0/2239190798 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f28a8083210 con 0x7f28b8069cd0 2024-01-24T13:05:06.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.835+0000 7f28b5400640 1 --2- 172.21.15.29:0/2239190798 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2890065a60 0x7f2890067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:06.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.839+0000 7f28b5400640 1 --2- 172.21.15.29:0/2239190798 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2890065a60 0x7f2890067f20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f28a00b2000 tx=0x7f28a0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:06.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.839+0000 7f28ae000640 1 -- 172.21.15.29:0/2239190798 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f28a8050940 con 0x7f28b8069cd0 2024-01-24T13:05:06.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.995+0000 7f28bce00640 1 -- 172.21.15.29:0/2239190798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f28b80661a0 con 0x7f28b8069cd0 2024-01-24T13:05:07.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.995+0000 7f28ae000640 1 -- 172.21.15.29:0/2239190798 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f28a8053f60 con 0x7f28b8069cd0 2024-01-24T13:05:07.000 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.999+0000 7f28bce00640 1 -- 172.21.15.29:0/2239190798 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2890065a60 msgr2=0x7f2890067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.999+0000 7f28bce00640 1 --2- 172.21.15.29:0/2239190798 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2890065a60 0x7f2890067f20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f28a00b2000 tx=0x7f28a0008040 comp rx=0 tx=0).stop 2024-01-24T13:05:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.999+0000 7f28bce00640 1 -- 172.21.15.29:0/2239190798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b8069cd0 msgr2=0x7f28b8150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.999+0000 7f28bce00640 1 --2- 172.21.15.29:0/2239190798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b8069cd0 0x7f28b8150870 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f28a800e840 tx=0x7f28a800ed00 comp rx=0 tx=0).stop 2024-01-24T13:05:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.999+0000 7f28bce00640 1 -- 172.21.15.29:0/2239190798 shutdown_connections 2024-01-24T13:05:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.999+0000 7f28bce00640 1 --2- 172.21.15.29:0/2239190798 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2890065a60 0x7f2890067f20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.999+0000 7f28bce00640 1 --2- 172.21.15.29:0/2239190798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28b81603a0 0x7f28b80c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.999+0000 7f28bce00640 1 --2- 172.21.15.29:0/2239190798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28b815c830 0x7f28b80b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.999+0000 7f28bce00640 1 --2- 172.21.15.29:0/2239190798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b8069cd0 0x7f28b8150870 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.999+0000 7f28bce00640 1 -- 172.21.15.29:0/2239190798 >> 172.21.15.29:0/2239190798 conn(0x7f28b80cbd50 msgr2=0x7f28b815a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.999+0000 7f28bce00640 1 -- 172.21.15.29:0/2239190798 shutdown_connections 2024-01-24T13:05:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:06.999+0000 7f28bce00640 1 -- 172.21.15.29:0/2239190798 wait complete. 2024-01-24T13:05:07.022 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:05:07.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.159+0000 7f99efa00640 1 Processor -- start 2024-01-24T13:05:07.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.159+0000 7f99efa00640 1 -- start start 2024-01-24T13:05:07.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.163+0000 7f99efa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99e815c6d0 0x7f99e806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.163+0000 7f99efa00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f99e80ce080 0x7f99e80ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.163+0000 7f99efa00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e80ce7f0 con 0x7f99e815cab0 2024-01-24T13:05:07.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.163+0000 7f99efa00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e80cead0 con 0x7f99e815c6d0 2024-01-24T13:05:07.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.163+0000 7f99efa00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e80d04a0 con 0x7f99e80ce080 2024-01-24T13:05:07.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.163+0000 7f99ed000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99e815c6d0 0x7f99e806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.163+0000 7f99ed000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99e815c6d0 0x7f99e806bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40800/0 (socket says 172.21.15.29:40800) 2024-01-24T13:05:07.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.163+0000 7f99ed000640 1 -- 172.21.15.29:0/3531175530 learned_addr learned my addr 172.21.15.29:0/3531175530 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:07.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.163+0000 7f99eda00640 1 --2- 172.21.15.29:0/3531175530 >> v2:172.21.15.163:3300/0 conn(0x7f99e80ce080 0x7f99e80ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.163+0000 7f99ed000640 1 -- 172.21.15.29:0/3531175530 >> v2:172.21.15.163:3300/0 conn(0x7f99e80ce080 msgr2=0x7f99e80ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:07.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.163+0000 7f99ed000640 1 --2- 172.21.15.29:0/3531175530 >> v2:172.21.15.163:3300/0 conn(0x7f99e80ce080 0x7f99e80ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.163+0000 7f99ed000640 1 -- 172.21.15.29:0/3531175530 >> v1:172.21.15.163:6789/0 conn(0x7f99e815cab0 legacy=0x7f99e80d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:07.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.163+0000 7f99ed000640 1 -- 172.21.15.29:0/3531175530 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e80d0780 con 0x7f99e815c6d0 2024-01-24T13:05:07.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.167+0000 7f99ed000640 1 --2- 172.21.15.29:0/3531175530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e815c6d0 0x7f99e806bcc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f99e80cf9b0 tx=0x7f99d801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b49ad39616d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:07.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.167+0000 7f99e7400640 1 -- 172.21.15.29:0/3531175530 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d80ac630 con 0x7f99e815c6d0 2024-01-24T13:05:07.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.167+0000 7f99e7400640 1 -- 172.21.15.29:0/3531175530 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d80ac790 con 0x7f99e815c6d0 2024-01-24T13:05:07.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.167+0000 7f99e7400640 1 -- 172.21.15.29:0/3531175530 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d80acb20 con 0x7f99e815c6d0 2024-01-24T13:05:07.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.167+0000 7f99efa00640 1 -- 172.21.15.29:0/3531175530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e815c6d0 msgr2=0x7f99e806bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.167+0000 7f99efa00640 1 --2- 172.21.15.29:0/3531175530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e815c6d0 0x7f99e806bcc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f99e80cf9b0 tx=0x7f99d801c4c0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.167+0000 7f99efa00640 1 -- 172.21.15.29:0/3531175530 shutdown_connections 2024-01-24T13:05:07.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.167+0000 7f99efa00640 1 --2- 172.21.15.29:0/3531175530 >> v2:172.21.15.163:3300/0 conn(0x7f99e80ce080 0x7f99e80ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.167+0000 7f99efa00640 1 --2- 172.21.15.29:0/3531175530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e815c6d0 0x7f99e806bcc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.167+0000 7f99efa00640 1 -- 172.21.15.29:0/3531175530 >> 172.21.15.29:0/3531175530 conn(0x7f99e8069cd0 msgr2=0x7f99e806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:07.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.167+0000 7f99efa00640 1 -- 172.21.15.29:0/3531175530 shutdown_connections 2024-01-24T13:05:07.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.167+0000 7f99efa00640 1 -- 172.21.15.29:0/3531175530 wait complete. 2024-01-24T13:05:07.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.167+0000 7f99efa00640 1 Processor -- start 2024-01-24T13:05:07.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.167+0000 7f99efa00640 1 -- start start 2024-01-24T13:05:07.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99efa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e80ce080 0x7f99e8150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99efa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99e815c6d0 0x7f99e814f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99efa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e81599c0 0x7f99e80cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99efa00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e81509f0 con 0x7f99e80ce080 2024-01-24T13:05:07.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99efa00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e815fab0 con 0x7f99e81599c0 2024-01-24T13:05:07.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99efa00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e8159e50 con 0x7f99e815c6d0 2024-01-24T13:05:07.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99ed000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e80ce080 0x7f99e8150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99ed000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e80ce080 0x7f99e8150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40816/0 (socket says 172.21.15.29:40816) 2024-01-24T13:05:07.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99ed000640 1 -- 172.21.15.29:0/3955924267 learned_addr learned my addr 172.21.15.29:0/3955924267 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:07.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99e7e00640 1 --2- 172.21.15.29:0/3955924267 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99e815c6d0 0x7f99e814f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99eda00640 1 --2- 172.21.15.29:0/3955924267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e81599c0 0x7f99e80cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99ed000640 1 -- 172.21.15.29:0/3955924267 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99e815c6d0 msgr2=0x7f99e814f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99ed000640 1 --2- 172.21.15.29:0/3955924267 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99e815c6d0 0x7f99e814f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99ed000640 1 -- 172.21.15.29:0/3955924267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e81599c0 msgr2=0x7f99e80cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99ed000640 1 --2- 172.21.15.29:0/3955924267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e81599c0 0x7f99e80cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99ed000640 1 -- 172.21.15.29:0/3955924267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d80094d0 con 0x7f99e80ce080 2024-01-24T13:05:07.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99ed000640 1 --2- 172.21.15.29:0/3955924267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e80ce080 0x7f99e8150b70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f99d80af040 tx=0x7f99d8019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:07.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99e4c00640 1 -- 172.21.15.29:0/3955924267 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d80b7670 con 0x7f99e80ce080 2024-01-24T13:05:07.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99e4c00640 1 -- 172.21.15.29:0/3955924267 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d80b77d0 con 0x7f99e80ce080 2024-01-24T13:05:07.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99efa00640 1 -- 172.21.15.29:0/3955924267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e815f180 con 0x7f99e80ce080 2024-01-24T13:05:07.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99e4c00640 1 -- 172.21.15.29:0/3955924267 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d80b7b60 con 0x7f99e80ce080 2024-01-24T13:05:07.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99efa00640 1 -- 172.21.15.29:0/3955924267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e815f740 con 0x7f99e80ce080 2024-01-24T13:05:07.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99efa00640 1 -- 172.21.15.29:0/3955924267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e804e850 con 0x7f99e80ce080 2024-01-24T13:05:07.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.171+0000 7f99e4c00640 1 -- 172.21.15.29:0/3955924267 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f99d80b3070 con 0x7f99e80ce080 2024-01-24T13:05:07.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.175+0000 7f99e4c00640 1 --2- 172.21.15.29:0/3955924267 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f99c0065a60 0x7f99c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.175+0000 7f99e4c00640 1 -- 172.21.15.29:0/3955924267 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f99d811dac0 con 0x7f99e80ce080 2024-01-24T13:05:07.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.175+0000 7f99e7e00640 1 --2- 172.21.15.29:0/3955924267 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f99c0065a60 0x7f99c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.175+0000 7f99e7e00640 1 --2- 172.21.15.29:0/3955924267 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f99c0065a60 0x7f99c0067f20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99d0007fd0 tx=0x7f99d0007e40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:07.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.179+0000 7f99e4c00640 1 -- 172.21.15.29:0/3955924267 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f99d80eb280 con 0x7f99e80ce080 2024-01-24T13:05:07.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.347+0000 7f99efa00640 1 -- 172.21.15.29:0/3955924267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f99e80ca6c0 con 0x7f99e80ce080 2024-01-24T13:05:07.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.347+0000 7f99e4c00640 1 -- 172.21.15.29:0/3955924267 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f99d80a8080 con 0x7f99e80ce080 2024-01-24T13:05:07.350 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:05:07.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.347+0000 7f99efa00640 1 -- 172.21.15.29:0/3955924267 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f99c0065a60 msgr2=0x7f99c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.347+0000 7f99efa00640 1 --2- 172.21.15.29:0/3955924267 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f99c0065a60 0x7f99c0067f20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99d0007fd0 tx=0x7f99d0007e40 comp rx=0 tx=0).stop 2024-01-24T13:05:07.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.347+0000 7f99efa00640 1 -- 172.21.15.29:0/3955924267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e80ce080 msgr2=0x7f99e8150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.347+0000 7f99efa00640 1 --2- 172.21.15.29:0/3955924267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e80ce080 0x7f99e8150b70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f99d80af040 tx=0x7f99d8019260 comp rx=0 tx=0).stop 2024-01-24T13:05:07.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.347+0000 7f99efa00640 1 -- 172.21.15.29:0/3955924267 shutdown_connections 2024-01-24T13:05:07.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.347+0000 7f99efa00640 1 --2- 172.21.15.29:0/3955924267 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f99c0065a60 0x7f99c0067f20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.347+0000 7f99efa00640 1 --2- 172.21.15.29:0/3955924267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e81599c0 0x7f99e80cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.347+0000 7f99efa00640 1 --2- 172.21.15.29:0/3955924267 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99e815c6d0 0x7f99e814f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.347+0000 7f99efa00640 1 --2- 172.21.15.29:0/3955924267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99e80ce080 0x7f99e8150b70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.347+0000 7f99efa00640 1 -- 172.21.15.29:0/3955924267 >> 172.21.15.29:0/3955924267 conn(0x7f99e8069cd0 msgr2=0x7f99e806bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:07.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.347+0000 7f99efa00640 1 -- 172.21.15.29:0/3955924267 shutdown_connections 2024-01-24T13:05:07.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.347+0000 7f99efa00640 1 -- 172.21.15.29:0/3955924267 wait complete. 2024-01-24T13:05:07.372 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi163.front.sepia.ceph.com... 2024-01-24T13:05:07.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:07.372 DEBUG:teuthology.orchestra.run.smithi163:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-01-24T13:05:07.395 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:05:07.395 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:05:07.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:07.396 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-01-24T13:05:07.447 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-24T13:05:07.447 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:05:07.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.587+0000 7fba83200640 1 Processor -- start 2024-01-24T13:05:07.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.587+0000 7fba83200640 1 -- start start 2024-01-24T13:05:07.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.587+0000 7fba83200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fba7c0ae150 0x7fba7c069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.587+0000 7fba83200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c0caed0 con 0x7fba7c1612c0 2024-01-24T13:05:07.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.587+0000 7fba83200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c0caca0 con 0x7fba7c06cfc0 2024-01-24T13:05:07.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.587+0000 7fba83200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c0ca4c0 con 0x7fba7c0ae150 2024-01-24T13:05:07.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.587+0000 7fba7b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fba7c0ae150 0x7fba7c069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.587+0000 7fba7b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fba7c0ae150 0x7fba7c069cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40820/0 (socket says 172.21.15.29:40820) 2024-01-24T13:05:07.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.587+0000 7fba7b400640 1 -- 172.21.15.29:0/406952875 learned_addr learned my addr 172.21.15.29:0/406952875 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:07.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.587+0000 7fba7b400640 1 -- 172.21.15.29:0/406952875 >> v1:172.21.15.163:6789/0 conn(0x7fba7c06cfc0 legacy=0x7fba7c06a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.587+0000 7fba7b400640 1 -- 172.21.15.29:0/406952875 >> v1:172.21.15.29:6789/0 conn(0x7fba7c1612c0 legacy=0x7fba7c06c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.587+0000 7fba7b400640 1 -- 172.21.15.29:0/406952875 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0cb170 con 0x7fba7c0ae150 2024-01-24T13:05:07.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.591+0000 7fba7b400640 1 --2- 172.21.15.29:0/406952875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c0ae150 0x7fba7c069cd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fba64009870 tx=0x7fba6401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91230b86e309ca71 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:07.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.591+0000 7fba7aa00640 1 -- 172.21.15.29:0/406952875 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba640ab680 con 0x7fba7c0ae150 2024-01-24T13:05:07.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.591+0000 7fba7aa00640 1 -- 172.21.15.29:0/406952875 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba640ab7e0 con 0x7fba7c0ae150 2024-01-24T13:05:07.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.591+0000 7fba7aa00640 1 -- 172.21.15.29:0/406952875 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba640abb70 con 0x7fba7c0ae150 2024-01-24T13:05:07.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.591+0000 7fba83200640 1 -- 172.21.15.29:0/406952875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c0ae150 msgr2=0x7fba7c069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.591+0000 7fba83200640 1 --2- 172.21.15.29:0/406952875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c0ae150 0x7fba7c069cd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fba64009870 tx=0x7fba6401c480 comp rx=0 tx=0).stop 2024-01-24T13:05:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.591+0000 7fba83200640 1 -- 172.21.15.29:0/406952875 shutdown_connections 2024-01-24T13:05:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.591+0000 7fba83200640 1 --2- 172.21.15.29:0/406952875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c0ae150 0x7fba7c069cd0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.591+0000 7fba83200640 1 -- 172.21.15.29:0/406952875 >> 172.21.15.29:0/406952875 conn(0x7fba7c0cb700 msgr2=0x7fba7c0cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.591+0000 7fba83200640 1 -- 172.21.15.29:0/406952875 shutdown_connections 2024-01-24T13:05:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.591+0000 7fba83200640 1 -- 172.21.15.29:0/406952875 wait complete. 2024-01-24T13:05:07.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba83200640 1 Processor -- start 2024-01-24T13:05:07.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba83200640 1 -- start start 2024-01-24T13:05:07.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba83200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba7c06cfc0 0x7fba7c158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba83200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fba7c0ae150 0x7fba7c0b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba83200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c1612c0 0x7fba7c0acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba83200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0b1dd0 con 0x7fba7c1612c0 2024-01-24T13:05:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba83200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0b20b0 con 0x7fba7c06cfc0 2024-01-24T13:05:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba83200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0b2390 con 0x7fba7c0ae150 2024-01-24T13:05:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba81200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c1612c0 0x7fba7c0acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba81200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c1612c0 0x7fba7c0acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40830/0 (socket says 172.21.15.29:40830) 2024-01-24T13:05:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba81200640 1 -- 172.21.15.29:0/1500958253 learned_addr learned my addr 172.21.15.29:0/1500958253 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba7b400640 1 --2- 172.21.15.29:0/1500958253 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fba7c0ae150 0x7fba7c0b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba7be00640 1 --2- 172.21.15.29:0/1500958253 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba7c06cfc0 0x7fba7c158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba81200640 1 -- 172.21.15.29:0/1500958253 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fba7c0ae150 msgr2=0x7fba7c0b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba81200640 1 --2- 172.21.15.29:0/1500958253 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fba7c0ae150 0x7fba7c0b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba81200640 1 -- 172.21.15.29:0/1500958253 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba7c06cfc0 msgr2=0x7fba7c158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba81200640 1 --2- 172.21.15.29:0/1500958253 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba7c06cfc0 0x7fba7c158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba81200640 1 -- 172.21.15.29:0/1500958253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba640094d0 con 0x7fba7c1612c0 2024-01-24T13:05:07.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba81200640 1 --2- 172.21.15.29:0/1500958253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c1612c0 0x7fba7c0acb30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fba7400c730 tx=0x7fba7400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:07.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba73e00640 1 -- 172.21.15.29:0/1500958253 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74003b80 con 0x7fba7c1612c0 2024-01-24T13:05:07.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba73e00640 1 -- 172.21.15.29:0/1500958253 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba74003ce0 con 0x7fba7c1612c0 2024-01-24T13:05:07.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba83200640 1 -- 172.21.15.29:0/1500958253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c0b2670 con 0x7fba7c1612c0 2024-01-24T13:05:07.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba73e00640 1 -- 172.21.15.29:0/1500958253 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74005310 con 0x7fba7c1612c0 2024-01-24T13:05:07.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.595+0000 7fba83200640 1 -- 172.21.15.29:0/1500958253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c0b2e70 con 0x7fba7c1612c0 2024-01-24T13:05:07.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.599+0000 7fba83200640 1 -- 172.21.15.29:0/1500958253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c0b3090 con 0x7fba7c1612c0 2024-01-24T13:05:07.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.599+0000 7fba73e00640 1 -- 172.21.15.29:0/1500958253 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fba74005680 con 0x7fba7c1612c0 2024-01-24T13:05:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.599+0000 7fba73e00640 1 --2- 172.21.15.29:0/1500958253 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fba54065a60 0x7fba54067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.599+0000 7fba73e00640 1 -- 172.21.15.29:0/1500958253 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fba74083300 con 0x7fba7c1612c0 2024-01-24T13:05:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.599+0000 7fba7be00640 1 --2- 172.21.15.29:0/1500958253 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fba54065a60 0x7fba54067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.599+0000 7fba7be00640 1 --2- 172.21.15.29:0/1500958253 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fba54065a60 0x7fba54067f20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0b4ad0 tx=0x7fba6c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:07.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.603+0000 7fba73e00640 1 -- 172.21.15.29:0/1500958253 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fba7c0b3090 con 0x7fba7c1612c0 2024-01-24T13:05:07.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.791+0000 7fba83200640 1 -- 172.21.15.29:0/1500958253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba7c0b3090 con 0x7fba7c1612c0 2024-01-24T13:05:07.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.795+0000 7fba73e00640 1 -- 172.21.15.29:0/1500958253 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7fba7c0b3090 con 0x7fba7c1612c0 2024-01-24T13:05:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:07.797 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1485056573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1485056573},{"type":"v1","addr":"172.21.15.29:6834","nonce":1485056573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/447431893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":447431893},{"type":"v1","addr":"172.21.15.163:6836","nonce":447431893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2390785325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2390785325},{"type":"v1","addr":"172.21.15.29:6835","nonce":2390785325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:03:55.981917+0000","modified":"2024-01-24T13:04:19.618027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/1191601563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1191601563},{"type":"v1","addr":"172.21.15.163:6837","nonce":1191601563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T13:05:07.798 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-24T13:05:07.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.795+0000 7fba83200640 1 -- 172.21.15.29:0/1500958253 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fba54065a60 msgr2=0x7fba54067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.795+0000 7fba83200640 1 --2- 172.21.15.29:0/1500958253 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fba54065a60 0x7fba54067f20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0b4ad0 tx=0x7fba6c009040 comp rx=0 tx=0).stop 2024-01-24T13:05:07.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.795+0000 7fba83200640 1 -- 172.21.15.29:0/1500958253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c1612c0 msgr2=0x7fba7c0acb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.795+0000 7fba83200640 1 --2- 172.21.15.29:0/1500958253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c1612c0 0x7fba7c0acb30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fba7400c730 tx=0x7fba7400cbf0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.795+0000 7fba83200640 1 -- 172.21.15.29:0/1500958253 shutdown_connections 2024-01-24T13:05:07.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.795+0000 7fba83200640 1 --2- 172.21.15.29:0/1500958253 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fba54065a60 0x7fba54067f20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.795+0000 7fba83200640 1 --2- 172.21.15.29:0/1500958253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba7c1612c0 0x7fba7c0acb30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.795+0000 7fba83200640 1 --2- 172.21.15.29:0/1500958253 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fba7c0ae150 0x7fba7c0b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.795+0000 7fba83200640 1 --2- 172.21.15.29:0/1500958253 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba7c06cfc0 0x7fba7c158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.795+0000 7fba83200640 1 -- 172.21.15.29:0/1500958253 >> 172.21.15.29:0/1500958253 conn(0x7fba7c0cb700 msgr2=0x7fba7c1605e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:07.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.795+0000 7fba83200640 1 -- 172.21.15.29:0/1500958253 shutdown_connections 2024-01-24T13:05:07.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.795+0000 7fba83200640 1 -- 172.21.15.29:0/1500958253 wait complete. 2024-01-24T13:05:07.820 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:07.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bdcc00640 1 Processor -- start 2024-01-24T13:05:07.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bdcc00640 1 -- start start 2024-01-24T13:05:07.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bdcc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bd80b2700 0x7f2bd806b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bdcc00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2bd80ccdb0 0x7f2bd80cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bdcc00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd80cd720 con 0x7f2bd815c730 2024-01-24T13:05:07.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bdcc00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd806cc10 con 0x7f2bd80ccdb0 2024-01-24T13:05:07.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bdcc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd806b7a0 con 0x7f2bd80b2700 2024-01-24T13:05:07.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd5e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2bd815c730 0x7f2bd80ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37238/0 (socket says 172.21.15.29:37238) 2024-01-24T13:05:07.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd5e00640 1 -- 172.21.15.29:0/3365091492 learned_addr learned my addr 172.21.15.29:0/3365091492 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:07.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd6800640 1 --2- 172.21.15.29:0/3365091492 >> v2:172.21.15.163:3300/0 conn(0x7f2bd80ccdb0 0x7f2bd80cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd5400640 1 --2- 172.21.15.29:0/3365091492 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bd80b2700 0x7f2bd806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 -- 172.21.15.29:0/3365091492 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222103327 0 0) 0x7f2bd80cd720 con 0x7f2bd815c730 2024-01-24T13:05:07.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 -- 172.21.15.29:0/3365091492 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bb8003530 con 0x7f2bd815c730 2024-01-24T13:05:07.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 -- 172.21.15.29:0/3365091492 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2733212035 0 0) 0x7f2bb8003530 con 0x7f2bd815c730 2024-01-24T13:05:07.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 -- 172.21.15.29:0/3365091492 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bd80b2700 msgr2=0x7f2bd806b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:07.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 --2- 172.21.15.29:0/3365091492 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bd80b2700 0x7f2bd806b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 -- 172.21.15.29:0/3365091492 >> v2:172.21.15.163:3300/0 conn(0x7f2bd80ccdb0 msgr2=0x7f2bd80cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:07.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 --2- 172.21.15.29:0/3365091492 >> v2:172.21.15.163:3300/0 conn(0x7f2bd80ccdb0 0x7f2bd80cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 -- 172.21.15.29:0/3365091492 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd806ba80 con 0x7f2bd815c730 2024-01-24T13:05:07.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 -- 172.21.15.29:0/3365091492 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f2bc8001680 con 0x7f2bd815c730 2024-01-24T13:05:07.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 -- 172.21.15.29:0/3365091492 >> v1:172.21.15.29:6789/0 conn(0x7f2bd815c730 legacy=0x7f2bd80ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 --2- 172.21.15.29:0/3365091492 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bb8003980 0x7f2bb8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 --2- 172.21.15.29:0/3365091492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bb8004370 0x7f2bb8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 --2- 172.21.15.29:0/3365091492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb8004ec0 0x7f2bb800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 -- 172.21.15.29:0/3365091492 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd806cc10 con 0x7f2bb8004370 2024-01-24T13:05:07.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 -- 172.21.15.29:0/3365091492 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd806b7a0 con 0x7f2bb8004ec0 2024-01-24T13:05:07.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd4a00640 1 -- 172.21.15.29:0/3365091492 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb800bed0 con 0x7f2bb8003980 2024-01-24T13:05:07.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.959+0000 7f2bd5400640 1 --2- 172.21.15.29:0/3365091492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bb8004370 0x7f2bb8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.963+0000 7f2bd5e00640 1 --2- 172.21.15.29:0/3365091492 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bb8003980 0x7f2bb8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.963+0000 7f2bd6800640 1 --2- 172.21.15.29:0/3365091492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb8004ec0 0x7f2bb800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.963+0000 7f2bd5400640 1 -- 172.21.15.29:0/3365091492 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bb8003980 msgr2=0x7f2bb8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:07.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.963+0000 7f2bd5400640 1 --2- 172.21.15.29:0/3365091492 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bb8003980 0x7f2bb8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.963+0000 7f2bd5400640 1 -- 172.21.15.29:0/3365091492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb8004ec0 msgr2=0x7f2bb800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:07.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.963+0000 7f2bd5400640 1 --2- 172.21.15.29:0/3365091492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb8004ec0 0x7f2bb800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.963+0000 7f2bd5400640 1 -- 172.21.15.29:0/3365091492 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb8003530 con 0x7f2bb8004370 2024-01-24T13:05:07.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.963+0000 7f2bd5400640 1 --2- 172.21.15.29:0/3365091492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bb8004370 0x7f2bb8004850 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00099a0 tx=0x7f2bc001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fe4495049bce12 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:07.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.963+0000 7f2bd4a00640 1 -- 172.21.15.29:0/3365091492 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc00a6510 con 0x7f2bb8004370 2024-01-24T13:05:07.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.963+0000 7f2bd4a00640 1 -- 172.21.15.29:0/3365091492 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc00a6670 con 0x7f2bb8004370 2024-01-24T13:05:07.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.963+0000 7f2bd4a00640 1 -- 172.21.15.29:0/3365091492 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc00a6a20 con 0x7f2bb8004370 2024-01-24T13:05:07.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3365091492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bb8004370 msgr2=0x7f2bb8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bdcc00640 1 --2- 172.21.15.29:0/3365091492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bb8004370 0x7f2bb8004850 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00099a0 tx=0x7f2bc001c910 comp rx=0 tx=0).stop 2024-01-24T13:05:07.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bd6800640 1 -- 172.21.15.29:0/3365091492 reap_dead start 2024-01-24T13:05:07.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3365091492 shutdown_connections 2024-01-24T13:05:07.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3365091492 >> 172.21.15.29:0/3365091492 conn(0x7f2bd8070570 msgr2=0x7f2bd8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:07.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3365091492 shutdown_connections 2024-01-24T13:05:07.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3365091492 wait complete. 2024-01-24T13:05:07.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bdcc00640 1 Processor -- start 2024-01-24T13:05:07.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bdcc00640 1 -- start start 2024-01-24T13:05:07.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bdcc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bb8004370 0x7f2bd8144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bdcc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bd81f6180 0x7f2bd81f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bdcc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bd8158b40 0x7f2bd81f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bdcc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd81586b0 con 0x7f2bd8158b40 2024-01-24T13:05:07.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bdcc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd8145430 con 0x7f2bd81f6180 2024-01-24T13:05:07.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bdcc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd8157aa0 con 0x7f2bb8004370 2024-01-24T13:05:07.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bd6800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bd8158b40 0x7f2bd81f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bd6800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bd8158b40 0x7f2bd81f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40852/0 (socket says 172.21.15.29:40852) 2024-01-24T13:05:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bd6800640 1 -- 172.21.15.29:0/3230593591 learned_addr learned my addr 172.21.15.29:0/3230593591 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bd5e00640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bb8004370 0x7f2bd8144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bd5400640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bd81f6180 0x7f2bd81f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bd6800640 1 -- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bb8004370 msgr2=0x7f2bd8144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bd6800640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bb8004370 0x7f2bd8144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bd6800640 1 -- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bd81f6180 msgr2=0x7f2bd81f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bd6800640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bd81f6180 0x7f2bd81f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bd6800640 1 -- 172.21.15.29:0/3230593591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd8157d80 con 0x7f2bd8158b40 2024-01-24T13:05:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.967+0000 7f2bd5400640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bd81f6180 0x7f2bd81f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.971+0000 7f2bd6800640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bd8158b40 0x7f2bd81f5a70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2bd81602a0 tx=0x7f2bd000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.971+0000 7f2bce000640 1 -- 172.21.15.29:0/3230593591 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd000e040 con 0x7f2bd8158b40 2024-01-24T13:05:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.971+0000 7f2bce000640 1 -- 172.21.15.29:0/3230593591 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd000f040 con 0x7f2bd8158b40 2024-01-24T13:05:07.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.971+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3230593591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd8158060 con 0x7f2bd8158b40 2024-01-24T13:05:07.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.971+0000 7f2bce000640 1 -- 172.21.15.29:0/3230593591 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0015430 con 0x7f2bd8158b40 2024-01-24T13:05:07.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.971+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3230593591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd81577b0 con 0x7f2bd8158b40 2024-01-24T13:05:07.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.971+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3230593591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd80cf430 con 0x7f2bd8158b40 2024-01-24T13:05:07.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.971+0000 7f2bce000640 1 -- 172.21.15.29:0/3230593591 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2bd0015590 con 0x7f2bd8158b40 2024-01-24T13:05:07.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.971+0000 7f2bce000640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2bb0065a60 0x7f2bb0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:07.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.971+0000 7f2bce000640 1 -- 172.21.15.29:0/3230593591 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f2bd0083e60 con 0x7f2bd8158b40 2024-01-24T13:05:07.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.971+0000 7f2bd5e00640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2bb0065a60 0x7f2bb0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:07.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.975+0000 7f2bd5e00640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2bb0065a60 0x7f2bb0067f20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8000c10 tx=0x7f2bc8007900 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:07.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:07.975+0000 7f2bce000640 1 -- 172.21.15.29:0/3230593591 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2bd0051580 con 0x7f2bd8158b40 2024-01-24T13:05:08.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.139+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3230593591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bd8158860 con 0x7f2bd8158b40 2024-01-24T13:05:08.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.139+0000 7f2bce000640 1 -- 172.21.15.29:0/3230593591 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7f2bd8158860 con 0x7f2bd8158b40 2024-01-24T13:05:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:08.142 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:08.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.139+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2bb0065a60 msgr2=0x7f2bb0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.139+0000 7f2bdcc00640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2bb0065a60 0x7f2bb0067f20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8000c10 tx=0x7f2bc8007900 comp rx=0 tx=0).stop 2024-01-24T13:05:08.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.139+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3230593591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bd8158b40 msgr2=0x7f2bd81f5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.139+0000 7f2bdcc00640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bd8158b40 0x7f2bd81f5a70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2bd81602a0 tx=0x7f2bd000f1b0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.139+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3230593591 shutdown_connections 2024-01-24T13:05:08.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.139+0000 7f2bdcc00640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2bb0065a60 0x7f2bb0067f20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.139+0000 7f2bdcc00640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bd8158b40 0x7f2bd81f5a70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.139+0000 7f2bdcc00640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bd81f6180 0x7f2bd81f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.139+0000 7f2bdcc00640 1 --2- 172.21.15.29:0/3230593591 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bb8004370 0x7f2bd8144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.139+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3230593591 >> 172.21.15.29:0/3230593591 conn(0x7f2bd8070570 msgr2=0x7f2bd80b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:08.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.139+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3230593591 shutdown_connections 2024-01-24T13:05:08.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.139+0000 7f2bdcc00640 1 -- 172.21.15.29:0/3230593591 wait complete. 2024-01-24T13:05:08.165 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:03:53.602149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:03:54.965798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-24T13:03:58.047476+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-24T13:05:08.165 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:05:08.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f7021400640 1 Processor -- start 2024-01-24T13:05:08.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f7021400640 1 -- start start 2024-01-24T13:05:08.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f7021400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f701c06c200 0x7f701c13cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:08.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f7021400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f701c13d2e0 0x7f701c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:08.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f7021400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701c13d720 con 0x7f701c06be20 2024-01-24T13:05:08.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f7021400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701c15b4f0 con 0x7f701c06c200 2024-01-24T13:05:08.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f7021400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701c15b7d0 con 0x7f701c13d2e0 2024-01-24T13:05:08.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f701a800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f701c06be20 0x7f701c15a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37250/0 (socket says 172.21.15.29:37250) 2024-01-24T13:05:08.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f701a800640 1 -- 172.21.15.29:0/3788979003 learned_addr learned my addr 172.21.15.29:0/3788979003 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:08.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f701b200640 1 --2- 172.21.15.29:0/3788979003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f701c13d2e0 0x7f701c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:08.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f7019e00640 1 --2- 172.21.15.29:0/3788979003 >> v2:172.21.15.163:3300/0 conn(0x7f701c06c200 0x7f701c13cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:08.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f7019400640 1 -- 172.21.15.29:0/3788979003 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39680835 0 0) 0x7f701c13d720 con 0x7f701c06be20 2024-01-24T13:05:08.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f7019400640 1 -- 172.21.15.29:0/3788979003 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ffc003530 con 0x7f701c06be20 2024-01-24T13:05:08.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f7019e00640 1 -- 172.21.15.29:0/3788979003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f701c13d2e0 msgr2=0x7f701c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:08.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f7019e00640 1 --2- 172.21.15.29:0/3788979003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f701c13d2e0 0x7f701c0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f7019e00640 1 -- 172.21.15.29:0/3788979003 >> v1:172.21.15.29:6789/0 conn(0x7f701c06be20 legacy=0x7f701c15a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.307+0000 7f7019e00640 1 -- 172.21.15.29:0/3788979003 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c0cd0c0 con 0x7f701c06c200 2024-01-24T13:05:08.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.311+0000 7f7019e00640 1 --2- 172.21.15.29:0/3788979003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f701c06c200 0x7f701c13cda0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f70040097c0 tx=0x7f700401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dee21d9823bf4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:08.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.311+0000 7f7019400640 1 -- 172.21.15.29:0/3788979003 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040a7070 con 0x7f701c06c200 2024-01-24T13:05:08.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.311+0000 7f7019400640 1 -- 172.21.15.29:0/3788979003 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70040ab430 con 0x7f701c06c200 2024-01-24T13:05:08.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.311+0000 7f7019400640 1 -- 172.21.15.29:0/3788979003 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040ab7c0 con 0x7f701c06c200 2024-01-24T13:05:08.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.311+0000 7f7021400640 1 -- 172.21.15.29:0/3788979003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f701c06c200 msgr2=0x7f701c13cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.311+0000 7f7021400640 1 --2- 172.21.15.29:0/3788979003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f701c06c200 0x7f701c13cda0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f70040097c0 tx=0x7f700401c450 comp rx=0 tx=0).stop 2024-01-24T13:05:08.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.311+0000 7f7021400640 1 -- 172.21.15.29:0/3788979003 shutdown_connections 2024-01-24T13:05:08.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.311+0000 7f7021400640 1 --2- 172.21.15.29:0/3788979003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f701c13d2e0 0x7f701c0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.311+0000 7f7021400640 1 --2- 172.21.15.29:0/3788979003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f701c06c200 0x7f701c13cda0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.311+0000 7f7021400640 1 -- 172.21.15.29:0/3788979003 >> 172.21.15.29:0/3788979003 conn(0x7f701c06d700 msgr2=0x7f701c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:08.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.311+0000 7f7021400640 1 -- 172.21.15.29:0/3788979003 shutdown_connections 2024-01-24T13:05:08.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.311+0000 7f7021400640 1 -- 172.21.15.29:0/3788979003 wait complete. 2024-01-24T13:05:08.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f7021400640 1 Processor -- start 2024-01-24T13:05:08.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f7021400640 1 -- start start 2024-01-24T13:05:08.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f7021400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f701c06be20 0x7f701c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:08.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f7021400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f701c06c200 0x7f701c138750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f7021400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f701c13d2e0 0x7f701c15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f7021400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c13c8c0 con 0x7f701c06be20 2024-01-24T13:05:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f7021400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c071050 con 0x7f701c06c200 2024-01-24T13:05:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f7021400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701c0712b0 con 0x7f701c13d2e0 2024-01-24T13:05:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f701a800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f701c06be20 0x7f701c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f701a800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f701c06be20 0x7f701c070b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40864/0 (socket says 172.21.15.29:40864) 2024-01-24T13:05:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f701a800640 1 -- 172.21.15.29:0/2330481052 learned_addr learned my addr 172.21.15.29:0/2330481052 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f7019e00640 1 --2- 172.21.15.29:0/2330481052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f701c06c200 0x7f701c138750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f701b200640 1 --2- 172.21.15.29:0/2330481052 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f701c13d2e0 0x7f701c15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f701a800640 1 -- 172.21.15.29:0/2330481052 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f701c13d2e0 msgr2=0x7f701c15cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f701a800640 1 --2- 172.21.15.29:0/2330481052 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f701c13d2e0 0x7f701c15cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f701a800640 1 -- 172.21.15.29:0/2330481052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f701c06c200 msgr2=0x7f701c138750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f701a800640 1 --2- 172.21.15.29:0/2330481052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f701c06c200 0x7f701c138750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f701a800640 1 -- 172.21.15.29:0/2330481052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7004009420 con 0x7f701c06be20 2024-01-24T13:05:08.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f701a800640 1 --2- 172.21.15.29:0/2330481052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f701c06be20 0x7f701c070b10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f700c00c450 tx=0x7f700c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:08.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f7012a00640 1 -- 172.21.15.29:0/2330481052 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c005cf0 con 0x7f701c06be20 2024-01-24T13:05:08.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f7012a00640 1 -- 172.21.15.29:0/2330481052 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c005e50 con 0x7f701c06be20 2024-01-24T13:05:08.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f7021400640 1 -- 172.21.15.29:0/2330481052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701c149fc0 con 0x7f701c06be20 2024-01-24T13:05:08.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.315+0000 7f7012a00640 1 -- 172.21.15.29:0/2330481052 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c007290 con 0x7f701c06be20 2024-01-24T13:05:08.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.319+0000 7f7021400640 1 -- 172.21.15.29:0/2330481052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701c14a580 con 0x7f701c06be20 2024-01-24T13:05:08.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.319+0000 7f7021400640 1 -- 172.21.15.29:0/2330481052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701c04e850 con 0x7f701c06be20 2024-01-24T13:05:08.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.319+0000 7f7012a00640 1 -- 172.21.15.29:0/2330481052 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f700c0073f0 con 0x7f701c06be20 2024-01-24T13:05:08.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.319+0000 7f7012a00640 1 --2- 172.21.15.29:0/2330481052 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6ff4065a60 0x7f6ff4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:08.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.319+0000 7f7012a00640 1 -- 172.21.15.29:0/2330481052 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f700c082970 con 0x7f701c06be20 2024-01-24T13:05:08.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.319+0000 7f7019e00640 1 --2- 172.21.15.29:0/2330481052 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6ff4065a60 0x7f6ff4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:08.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.323+0000 7f7019e00640 1 --2- 172.21.15.29:0/2330481052 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6ff4065a60 0x7f6ff4067f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f70040af000 tx=0x7f7004008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:08.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.323+0000 7f7012a00640 1 -- 172.21.15.29:0/2330481052 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f700c050140 con 0x7f701c06be20 2024-01-24T13:05:08.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.479+0000 7f7021400640 1 -- 172.21.15.29:0/2330481052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f701c0cd9d0 con 0x7f701c06be20 2024-01-24T13:05:08.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.479+0000 7f7012a00640 1 -- 172.21.15.29:0/2330481052 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f700c017020 con 0x7f701c06be20 2024-01-24T13:05:08.483 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:05:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.483+0000 7f7021400640 1 -- 172.21.15.29:0/2330481052 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6ff4065a60 msgr2=0x7f6ff4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.483+0000 7f7021400640 1 --2- 172.21.15.29:0/2330481052 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6ff4065a60 0x7f6ff4067f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f70040af000 tx=0x7f7004008040 comp rx=0 tx=0).stop 2024-01-24T13:05:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.483+0000 7f7021400640 1 -- 172.21.15.29:0/2330481052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f701c06be20 msgr2=0x7f701c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.483+0000 7f7021400640 1 --2- 172.21.15.29:0/2330481052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f701c06be20 0x7f701c070b10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f700c00c450 tx=0x7f700c00c910 comp rx=0 tx=0).stop 2024-01-24T13:05:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.483+0000 7f7021400640 1 -- 172.21.15.29:0/2330481052 shutdown_connections 2024-01-24T13:05:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.483+0000 7f7021400640 1 --2- 172.21.15.29:0/2330481052 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6ff4065a60 0x7f6ff4067f20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.483+0000 7f7021400640 1 --2- 172.21.15.29:0/2330481052 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f701c13d2e0 0x7f701c15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.483+0000 7f7021400640 1 --2- 172.21.15.29:0/2330481052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f701c06c200 0x7f701c138750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.483+0000 7f7021400640 1 --2- 172.21.15.29:0/2330481052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f701c06be20 0x7f701c070b10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.483+0000 7f7021400640 1 -- 172.21.15.29:0/2330481052 >> 172.21.15.29:0/2330481052 conn(0x7f701c06d700 msgr2=0x7f701c15ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:08.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.483+0000 7f7021400640 1 -- 172.21.15.29:0/2330481052 shutdown_connections 2024-01-24T13:05:08.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.483+0000 7f7021400640 1 -- 172.21.15.29:0/2330481052 wait complete. 2024-01-24T13:05:08.504 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:05:08.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.643+0000 7f195f200640 1 Processor -- start 2024-01-24T13:05:08.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.643+0000 7f195f200640 1 -- start start 2024-01-24T13:05:08.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f195f200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19580cd300 0x7f195815d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:08.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f195f200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f19580ce050 0x7f19580ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:08.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f195f200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19580ce9f0 con 0x7f19580d0410 2024-01-24T13:05:08.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f195f200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1958161130 con 0x7f19580ce050 2024-01-24T13:05:08.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f195f200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195815dbe0 con 0x7f19580cd300 2024-01-24T13:05:08.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f195d200640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f19580d0410 0x7f19580d0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37262/0 (socket says 172.21.15.29:37262) 2024-01-24T13:05:08.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f195d200640 1 -- 172.21.15.29:0/1782982565 learned_addr learned my addr 172.21.15.29:0/1782982565 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:08.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f1957400640 1 --2- 172.21.15.29:0/1782982565 >> v2:172.21.15.163:3300/0 conn(0x7f19580ce050 0x7f19580ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:08.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f1957e00640 1 --2- 172.21.15.29:0/1782982565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19580cd300 0x7f195815d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:08.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f1956a00640 1 -- 172.21.15.29:0/1782982565 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314435695 0 0) 0x7f19580ce9f0 con 0x7f19580d0410 2024-01-24T13:05:08.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f1956a00640 1 -- 172.21.15.29:0/1782982565 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1938003530 con 0x7f19580d0410 2024-01-24T13:05:08.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f1956a00640 1 -- 172.21.15.29:0/1782982565 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3066735006 0 0) 0x7f1938003530 con 0x7f19580d0410 2024-01-24T13:05:08.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f1957e00640 1 -- 172.21.15.29:0/1782982565 >> v2:172.21.15.163:3300/0 conn(0x7f19580ce050 msgr2=0x7f19580ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:08.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f1957e00640 1 --2- 172.21.15.29:0/1782982565 >> v2:172.21.15.163:3300/0 conn(0x7f19580ce050 0x7f19580ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f1957e00640 1 -- 172.21.15.29:0/1782982565 >> v1:172.21.15.29:6789/0 conn(0x7f19580d0410 legacy=0x7f19580d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.647+0000 7f1957e00640 1 -- 172.21.15.29:0/1782982565 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19581605b0 con 0x7f19580cd300 2024-01-24T13:05:08.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.651+0000 7f1957e00640 1 --2- 172.21.15.29:0/1782982565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19580cd300 0x7f195815d6a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f19480097c0 tx=0x7f194801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1bf5ff72f6fd580 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:08.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.651+0000 7f1956a00640 1 -- 172.21.15.29:0/1782982565 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1950001a00 con 0x7f19580cd300 2024-01-24T13:05:08.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.651+0000 7f1956a00640 1 -- 172.21.15.29:0/1782982565 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19480a7050 con 0x7f19580cd300 2024-01-24T13:05:08.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.651+0000 7f1956a00640 1 -- 172.21.15.29:0/1782982565 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19480ab620 con 0x7f19580cd300 2024-01-24T13:05:08.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.651+0000 7f195f200640 1 -- 172.21.15.29:0/1782982565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19580cd300 msgr2=0x7f195815d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.651+0000 7f195f200640 1 --2- 172.21.15.29:0/1782982565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19580cd300 0x7f195815d6a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f19480097c0 tx=0x7f194801c3a0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.651+0000 7f195f200640 1 -- 172.21.15.29:0/1782982565 shutdown_connections 2024-01-24T13:05:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.651+0000 7f195f200640 1 --2- 172.21.15.29:0/1782982565 >> v2:172.21.15.163:3300/0 conn(0x7f19580ce050 0x7f19580ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.651+0000 7f195f200640 1 --2- 172.21.15.29:0/1782982565 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19580cd300 0x7f195815d6a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.651+0000 7f195f200640 1 -- 172.21.15.29:0/1782982565 >> 172.21.15.29:0/1782982565 conn(0x7f1958069cd0 msgr2=0x7f195806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.651+0000 7f195f200640 1 -- 172.21.15.29:0/1782982565 shutdown_connections 2024-01-24T13:05:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.651+0000 7f195f200640 1 -- 172.21.15.29:0/1782982565 wait complete. 2024-01-24T13:05:08.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.651+0000 7f195f200640 1 Processor -- start 2024-01-24T13:05:08.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.651+0000 7f195f200640 1 -- start start 2024-01-24T13:05:08.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f195f200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19580cd300 0x7f19580b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f195f200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19580ce050 0x7f19580b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f195f200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19580d0410 0x7f195806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f195f200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19580b3480 con 0x7f19580cd300 2024-01-24T13:05:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f195f200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195806c730 con 0x7f19580d0410 2024-01-24T13:05:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f195f200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195806bf10 con 0x7f19580ce050 2024-01-24T13:05:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f1957e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19580cd300 0x7f19580b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f1957e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19580cd300 0x7f19580b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40872/0 (socket says 172.21.15.29:40872) 2024-01-24T13:05:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f1957e00640 1 -- 172.21.15.29:0/2064418644 learned_addr learned my addr 172.21.15.29:0/2064418644 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f1957400640 1 --2- 172.21.15.29:0/2064418644 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19580ce050 0x7f19580b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f195d200640 1 --2- 172.21.15.29:0/2064418644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19580d0410 0x7f195806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f1957e00640 1 -- 172.21.15.29:0/2064418644 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19580ce050 msgr2=0x7f19580b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f1957e00640 1 --2- 172.21.15.29:0/2064418644 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19580ce050 0x7f19580b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f1957e00640 1 -- 172.21.15.29:0/2064418644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19580d0410 msgr2=0x7f195806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f1957e00640 1 --2- 172.21.15.29:0/2064418644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19580d0410 0x7f195806b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f1957e00640 1 -- 172.21.15.29:0/2064418644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1948009420 con 0x7f19580cd300 2024-01-24T13:05:08.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f1957e00640 1 --2- 172.21.15.29:0/2064418644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19580cd300 0x7f19580b4880 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f19480ae040 tx=0x7f194801abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:08.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f194fe00640 1 -- 172.21.15.29:0/2064418644 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19480abea0 con 0x7f19580cd300 2024-01-24T13:05:08.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f194fe00640 1 -- 172.21.15.29:0/2064418644 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19480b7450 con 0x7f19580cd300 2024-01-24T13:05:08.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f194fe00640 1 -- 172.21.15.29:0/2064418644 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19480b77e0 con 0x7f19580cd300 2024-01-24T13:05:08.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f195f200640 1 -- 172.21.15.29:0/2064418644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195806c170 con 0x7f19580cd300 2024-01-24T13:05:08.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f195f200640 1 -- 172.21.15.29:0/2064418644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1958152510 con 0x7f19580cd300 2024-01-24T13:05:08.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.655+0000 7f195f200640 1 -- 172.21.15.29:0/2064418644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1958152370 con 0x7f19580cd300 2024-01-24T13:05:08.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.659+0000 7f194fe00640 1 -- 172.21.15.29:0/2064418644 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f19480b7940 con 0x7f19580cd300 2024-01-24T13:05:08.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.659+0000 7f194fe00640 1 --2- 172.21.15.29:0/2064418644 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1930065a60 0x7f1930067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:08.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.659+0000 7f194fe00640 1 -- 172.21.15.29:0/2064418644 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f194811dbb0 con 0x7f19580cd300 2024-01-24T13:05:08.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.659+0000 7f1957400640 1 --2- 172.21.15.29:0/2064418644 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1930065a60 0x7f1930067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:08.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.659+0000 7f1957400640 1 --2- 172.21.15.29:0/2064418644 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1930065a60 0x7f1930067f20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f19580b6570 tx=0x7f1940008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:08.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.663+0000 7f194fe00640 1 -- 172.21.15.29:0/2064418644 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1958152370 con 0x7f19580cd300 2024-01-24T13:05:08.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.819+0000 7f195f200640 1 -- 172.21.15.29:0/2064418644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1958152370 con 0x7f19580cd300 2024-01-24T13:05:08.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.819+0000 7f194fe00640 1 -- 172.21.15.29:0/2064418644 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1958152370 con 0x7f19580cd300 2024-01-24T13:05:08.824 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:08.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.823+0000 7f195f200640 1 -- 172.21.15.29:0/2064418644 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1930065a60 msgr2=0x7f1930067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.823+0000 7f195f200640 1 --2- 172.21.15.29:0/2064418644 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1930065a60 0x7f1930067f20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f19580b6570 tx=0x7f1940008040 comp rx=0 tx=0).stop 2024-01-24T13:05:08.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.823+0000 7f195f200640 1 -- 172.21.15.29:0/2064418644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19580cd300 msgr2=0x7f19580b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.823+0000 7f195f200640 1 --2- 172.21.15.29:0/2064418644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19580cd300 0x7f19580b4880 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f19480ae040 tx=0x7f194801abe0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.823+0000 7f195f200640 1 -- 172.21.15.29:0/2064418644 shutdown_connections 2024-01-24T13:05:08.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.823+0000 7f195f200640 1 --2- 172.21.15.29:0/2064418644 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1930065a60 0x7f1930067f20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.823+0000 7f195f200640 1 --2- 172.21.15.29:0/2064418644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19580d0410 0x7f195806b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.823+0000 7f195f200640 1 --2- 172.21.15.29:0/2064418644 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19580ce050 0x7f19580b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.823+0000 7f195f200640 1 --2- 172.21.15.29:0/2064418644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19580cd300 0x7f19580b4880 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.823+0000 7f195f200640 1 -- 172.21.15.29:0/2064418644 >> 172.21.15.29:0/2064418644 conn(0x7f1958069cd0 msgr2=0x7f19580b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:08.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.823+0000 7f195f200640 1 -- 172.21.15.29:0/2064418644 shutdown_connections 2024-01-24T13:05:08.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.823+0000 7f195f200640 1 -- 172.21.15.29:0/2064418644 wait complete. 2024-01-24T13:05:08.846 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:05:08.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.987+0000 7f18f7400640 1 Processor -- start 2024-01-24T13:05:08.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.987+0000 7f18f7400640 1 -- start start 2024-01-24T13:05:08.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.987+0000 7f18f7400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f18f00c3fd0 0x7f18f00caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.987+0000 7f18f7400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f18f00cb010 0x7f18f00d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.987+0000 7f18f7400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f00cb440 con 0x7f18f015a6f0 2024-01-24T13:05:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.987+0000 7f18f7400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f015aad0 con 0x7f18f00c3fd0 2024-01-24T13:05:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.987+0000 7f18f7400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f00cd1e0 con 0x7f18f00cb010 2024-01-24T13:05:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.987+0000 7f18efe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f18f00c3fd0 0x7f18f00caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.987+0000 7f18efe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f18f00c3fd0 0x7f18f00caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40874/0 (socket says 172.21.15.29:40874) 2024-01-24T13:05:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.987+0000 7f18efe00640 1 -- 172.21.15.29:0/1145456216 learned_addr learned my addr 172.21.15.29:0/1145456216 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.991+0000 7f18f5400640 1 --2- 172.21.15.29:0/1145456216 >> v2:172.21.15.163:3300/0 conn(0x7f18f00cb010 0x7f18f00d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.991+0000 7f18efe00640 1 -- 172.21.15.29:0/1145456216 >> v2:172.21.15.163:3300/0 conn(0x7f18f00cb010 msgr2=0x7f18f00d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.991+0000 7f18efe00640 1 --2- 172.21.15.29:0/1145456216 >> v2:172.21.15.163:3300/0 conn(0x7f18f00cb010 0x7f18f00d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.991+0000 7f18efe00640 1 -- 172.21.15.29:0/1145456216 >> v1:172.21.15.163:6789/0 conn(0x7f18f015a6f0 legacy=0x7f18f00ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.991+0000 7f18efe00640 1 -- 172.21.15.29:0/1145456216 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f00cd4c0 con 0x7f18f00c3fd0 2024-01-24T13:05:08.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.991+0000 7f18f5400640 1 --2- 172.21.15.29:0/1145456216 >> v2:172.21.15.163:3300/0 conn(0x7f18f00cb010 0x7f18f00d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:08.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.991+0000 7f18efe00640 1 --2- 172.21.15.29:0/1145456216 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18f00c3fd0 0x7f18f00caad0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f18f006f050 tx=0x7f18d801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb44ed04e77a45 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:08.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.991+0000 7f18ef400640 1 -- 172.21.15.29:0/1145456216 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d80aa5f0 con 0x7f18f00c3fd0 2024-01-24T13:05:08.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.991+0000 7f18ef400640 1 -- 172.21.15.29:0/1145456216 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d80aa750 con 0x7f18f00c3fd0 2024-01-24T13:05:08.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.991+0000 7f18ef400640 1 -- 172.21.15.29:0/1145456216 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d80aaae0 con 0x7f18f00c3fd0 2024-01-24T13:05:08.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 -- 172.21.15.29:0/1145456216 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18f00c3fd0 msgr2=0x7f18f00caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:08.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 --2- 172.21.15.29:0/1145456216 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18f00c3fd0 0x7f18f00caad0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f18f006f050 tx=0x7f18d801c490 comp rx=0 tx=0).stop 2024-01-24T13:05:08.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 -- 172.21.15.29:0/1145456216 shutdown_connections 2024-01-24T13:05:08.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 --2- 172.21.15.29:0/1145456216 >> v2:172.21.15.163:3300/0 conn(0x7f18f00cb010 0x7f18f00d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 --2- 172.21.15.29:0/1145456216 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18f00c3fd0 0x7f18f00caad0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:08.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 -- 172.21.15.29:0/1145456216 >> 172.21.15.29:0/1145456216 conn(0x7f18f0069cd0 msgr2=0x7f18f006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:08.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 -- 172.21.15.29:0/1145456216 shutdown_connections 2024-01-24T13:05:08.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 -- 172.21.15.29:0/1145456216 wait complete. 2024-01-24T13:05:08.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 Processor -- start 2024-01-24T13:05:08.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 -- start start 2024-01-24T13:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18f00c3fd0 0x7f18f0152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18f00cb010 0x7f18f01630c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18f015a6f0 0x7f18f00c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0152d40 con 0x7f18f00c3fd0 2024-01-24T13:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f01f5f50 con 0x7f18f015a6f0 2024-01-24T13:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f7400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f006af80 con 0x7f18f00cb010 2024-01-24T13:05:09.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f4a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18f00c3fd0 0x7f18f0152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f4a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18f00c3fd0 0x7f18f0152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40876/0 (socket says 172.21.15.29:40876) 2024-01-24T13:05:09.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f4a00640 1 -- 172.21.15.29:0/4247998165 learned_addr learned my addr 172.21.15.29:0/4247998165 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:09.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18efe00640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18f00cb010 0x7f18f01630c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.995+0000 7f18f5400640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18f015a6f0 0x7f18f00c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18f4a00640 1 -- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18f00cb010 msgr2=0x7f18f01630c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18f4a00640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18f00cb010 0x7f18f01630c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18f4a00640 1 -- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18f015a6f0 msgr2=0x7f18f00c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18f4a00640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18f015a6f0 0x7f18f00c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18f4a00640 1 -- 172.21.15.29:0/4247998165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d80094d0 con 0x7f18f00c3fd0 2024-01-24T13:05:09.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18f5400640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18f015a6f0 0x7f18f00c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:09.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18f4a00640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18f00c3fd0 0x7f18f0152800 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f18e000b3e0 tx=0x7f18e000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:09.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18ecc00640 1 -- 172.21.15.29:0/4247998165 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0011830 con 0x7f18f00c3fd0 2024-01-24T13:05:09.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18ecc00640 1 -- 172.21.15.29:0/4247998165 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e00119b0 con 0x7f18f00c3fd0 2024-01-24T13:05:09.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18ecc00640 1 -- 172.21.15.29:0/4247998165 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0011d60 con 0x7f18f00c3fd0 2024-01-24T13:05:09.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18f7400640 1 -- 172.21.15.29:0/4247998165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f006b260 con 0x7f18f00c3fd0 2024-01-24T13:05:09.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18f7400640 1 -- 172.21.15.29:0/4247998165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f006b820 con 0x7f18f00c3fd0 2024-01-24T13:05:09.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18f7400640 1 -- 172.21.15.29:0/4247998165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f004e850 con 0x7f18f00c3fd0 2024-01-24T13:05:09.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18ecc00640 1 -- 172.21.15.29:0/4247998165 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f18e001a400 con 0x7f18f00c3fd0 2024-01-24T13:05:09.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:08.999+0000 7f18ecc00640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f18c8065a60 0x7f18c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.003+0000 7f18ecc00640 1 -- 172.21.15.29:0/4247998165 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f18e00836b0 con 0x7f18f00c3fd0 2024-01-24T13:05:09.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.003+0000 7f18efe00640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f18c8065a60 0x7f18c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.003+0000 7f18efe00640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f18c8065a60 0x7f18c8067f20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f18d80ae000 tx=0x7f18d80b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:09.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.007+0000 7f18ecc00640 1 -- 172.21.15.29:0/4247998165 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f18e0050c10 con 0x7f18f00c3fd0 2024-01-24T13:05:09.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.163+0000 7f18f7400640 1 -- 172.21.15.29:0/4247998165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18f00b29c0 con 0x7f18f00c3fd0 2024-01-24T13:05:09.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.163+0000 7f18ecc00640 1 -- 172.21.15.29:0/4247998165 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18e00150a0 con 0x7f18f00c3fd0 2024-01-24T13:05:09.166 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:05:09.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.163+0000 7f18f7400640 1 -- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f18c8065a60 msgr2=0x7f18c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.163+0000 7f18f7400640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f18c8065a60 0x7f18c8067f20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f18d80ae000 tx=0x7f18d80b5040 comp rx=0 tx=0).stop 2024-01-24T13:05:09.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.163+0000 7f18f7400640 1 -- 172.21.15.29:0/4247998165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18f00c3fd0 msgr2=0x7f18f0152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.163+0000 7f18f7400640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18f00c3fd0 0x7f18f0152800 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f18e000b3e0 tx=0x7f18e000b8a0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.163+0000 7f18f7400640 1 -- 172.21.15.29:0/4247998165 shutdown_connections 2024-01-24T13:05:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.163+0000 7f18f7400640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f18c8065a60 0x7f18c8067f20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.163+0000 7f18f7400640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18f015a6f0 0x7f18f00c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.163+0000 7f18f7400640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18f00cb010 0x7f18f01630c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.163+0000 7f18f7400640 1 --2- 172.21.15.29:0/4247998165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18f00c3fd0 0x7f18f0152800 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.163+0000 7f18f7400640 1 -- 172.21.15.29:0/4247998165 >> 172.21.15.29:0/4247998165 conn(0x7f18f0069cd0 msgr2=0x7f18f00ca840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.163+0000 7f18f7400640 1 -- 172.21.15.29:0/4247998165 shutdown_connections 2024-01-24T13:05:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.163+0000 7f18f7400640 1 -- 172.21.15.29:0/4247998165 wait complete. 2024-01-24T13:05:09.188 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-24T13:05:09.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.327+0000 7f2d4c600640 1 Processor -- start 2024-01-24T13:05:09.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.327+0000 7f2d4c600640 1 -- start start 2024-01-24T13:05:09.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d4c600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2d440cd520 0x7f2d4415d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d4c600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d441611b0 con 0x7f2d4406c860 2024-01-24T13:05:09.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d4c600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d44160630 con 0x7f2d44142980 2024-01-24T13:05:09.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d4c600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d44160910 con 0x7f2d440cd520 2024-01-24T13:05:09.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d49c00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2d4406c860 0x7f2d4406ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37266/0 (socket says 172.21.15.29:37266) 2024-01-24T13:05:09.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d49c00640 1 -- 172.21.15.29:0/2039446221 learned_addr learned my addr 172.21.15.29:0/2039446221 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:09.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d4a600640 1 --2- 172.21.15.29:0/2039446221 >> v2:172.21.15.163:3300/0 conn(0x7f2d440cd520 0x7f2d4415d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770096535 0 0) 0x7f2d441611b0 con 0x7f2d4406c860 2024-01-24T13:05:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d24003530 con 0x7f2d4406c860 2024-01-24T13:05:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928003148 0 0) 0x7f2d44160630 con 0x7f2d44142980 2024-01-24T13:05:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d441611b0 con 0x7f2d44142980 2024-01-24T13:05:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4259583263 0 0) 0x7f2d24003530 con 0x7f2d4406c860 2024-01-24T13:05:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 >> v2:172.21.15.163:3300/0 conn(0x7f2d440cd520 msgr2=0x7f2d4415d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 --2- 172.21.15.29:0/2039446221 >> v2:172.21.15.163:3300/0 conn(0x7f2d440cd520 0x7f2d4415d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 >> v1:172.21.15.163:6789/0 conn(0x7f2d44142980 legacy=0x7f2d440cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d44160bf0 con 0x7f2d4406c860 2024-01-24T13:05:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f2d34001680 con 0x7f2d4406c860 2024-01-24T13:05:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 >> v1:172.21.15.29:6789/0 conn(0x7f2d4406c860 legacy=0x7f2d4406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 --2- 172.21.15.29:0/2039446221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d24003b60 0x7f2d24003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 --2- 172.21.15.29:0/2039446221 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d240047d0 0x7f2d24004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 --2- 172.21.15.29:0/2039446221 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d24005190 0x7f2d2400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44160910 con 0x7f2d24003b60 2024-01-24T13:05:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2400c060 con 0x7f2d24005190 2024-01-24T13:05:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2400c220 con 0x7f2d240047d0 2024-01-24T13:05:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d4a600640 1 --2- 172.21.15.29:0/2039446221 >> v2:172.21.15.163:3300/0 conn(0x7f2d440cd520 0x7f2d4415d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d49c00640 1 --2- 172.21.15.29:0/2039446221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d24003b60 0x7f2d24003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d49200640 1 --2- 172.21.15.29:0/2039446221 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d240047d0 0x7f2d24004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d4a600640 1 --2- 172.21.15.29:0/2039446221 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d24005190 0x7f2d2400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d49c00640 1 -- 172.21.15.29:0/2039446221 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d240047d0 msgr2=0x7f2d24004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:09.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d49c00640 1 --2- 172.21.15.29:0/2039446221 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d240047d0 0x7f2d24004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d49c00640 1 -- 172.21.15.29:0/2039446221 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d24005190 msgr2=0x7f2d2400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:09.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d49c00640 1 --2- 172.21.15.29:0/2039446221 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d24005190 0x7f2d2400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d49c00640 1 -- 172.21.15.29:0/2039446221 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d24003530 con 0x7f2d24003b60 2024-01-24T13:05:09.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d4a600640 1 --2- 172.21.15.29:0/2039446221 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d24005190 0x7f2d2400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:09.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.331+0000 7f2d4a600640 1 -- 172.21.15.29:0/2039446221 reap_dead start 2024-01-24T13:05:09.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.335+0000 7f2d49c00640 1 --2- 172.21.15.29:0/2039446221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d24003b60 0x7f2d24003f60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2d34007f80 tx=0x7f2d3401caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52667dbec3fa7155 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:09.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.335+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d34005ae0 con 0x7f2d24003b60 2024-01-24T13:05:09.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.335+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d34005c40 con 0x7f2d24003b60 2024-01-24T13:05:09.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.335+0000 7f2d43e00640 1 -- 172.21.15.29:0/2039446221 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d340072b0 con 0x7f2d24003b60 2024-01-24T13:05:09.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.335+0000 7f2d4c600640 1 -- 172.21.15.29:0/2039446221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d24003b60 msgr2=0x7f2d24003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.335+0000 7f2d4c600640 1 --2- 172.21.15.29:0/2039446221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d24003b60 0x7f2d24003f60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2d34007f80 tx=0x7f2d3401caf0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.335+0000 7f2d4c600640 1 -- 172.21.15.29:0/2039446221 shutdown_connections 2024-01-24T13:05:09.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.335+0000 7f2d4c600640 1 --2- 172.21.15.29:0/2039446221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d24003b60 0x7f2d24003f60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.335+0000 7f2d4c600640 1 -- 172.21.15.29:0/2039446221 >> 172.21.15.29:0/2039446221 conn(0x7f2d44069cd0 msgr2=0x7f2d4406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:09.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.335+0000 7f2d4c600640 1 -- 172.21.15.29:0/2039446221 shutdown_connections 2024-01-24T13:05:09.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.335+0000 7f2d4c600640 1 -- 172.21.15.29:0/2039446221 wait complete. 2024-01-24T13:05:09.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.335+0000 7f2d4c600640 1 Processor -- start 2024-01-24T13:05:09.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d4c600640 1 -- start start 2024-01-24T13:05:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d4c600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d24003b60 0x7f2d440c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d4c600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d44159a50 0x7f2d4414df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d4c600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d441f5040 0x7f2d440ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d4c600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4415a230 con 0x7f2d44159a50 2024-01-24T13:05:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d4c600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440c7e10 con 0x7f2d441f5040 2024-01-24T13:05:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d4c600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440c80f0 con 0x7f2d24003b60 2024-01-24T13:05:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d49200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d44159a50 0x7f2d4414df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d49200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d44159a50 0x7f2d4414df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40902/0 (socket says 172.21.15.29:40902) 2024-01-24T13:05:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d49200640 1 -- 172.21.15.29:0/2034362504 learned_addr learned my addr 172.21.15.29:0/2034362504 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d49c00640 1 --2- 172.21.15.29:0/2034362504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d24003b60 0x7f2d440c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d4a600640 1 --2- 172.21.15.29:0/2034362504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d441f5040 0x7f2d440ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d49200640 1 -- 172.21.15.29:0/2034362504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d24003b60 msgr2=0x7f2d440c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d49200640 1 --2- 172.21.15.29:0/2034362504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d24003b60 0x7f2d440c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d49200640 1 -- 172.21.15.29:0/2034362504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d441f5040 msgr2=0x7f2d440ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d49200640 1 --2- 172.21.15.29:0/2034362504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d441f5040 0x7f2d440ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d49200640 1 -- 172.21.15.29:0/2034362504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d440c83d0 con 0x7f2d44159a50 2024-01-24T13:05:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d49200640 1 --2- 172.21.15.29:0/2034362504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d44159a50 0x7f2d4414df10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00f820 tx=0x7f2d2c00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d41600640 1 -- 172.21.15.29:0/2034362504 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00fed0 con 0x7f2d44159a50 2024-01-24T13:05:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d41600640 1 -- 172.21.15.29:0/2034362504 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c005320 con 0x7f2d44159a50 2024-01-24T13:05:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d4c600640 1 -- 172.21.15.29:0/2034362504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d440c86b0 con 0x7f2d44159a50 2024-01-24T13:05:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d41600640 1 -- 172.21.15.29:0/2034362504 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c007270 con 0x7f2d44159a50 2024-01-24T13:05:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d4c600640 1 -- 172.21.15.29:0/2034362504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4414e450 con 0x7f2d44159a50 2024-01-24T13:05:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.339+0000 7f2d4c600640 1 -- 172.21.15.29:0/2034362504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4404e850 con 0x7f2d44159a50 2024-01-24T13:05:09.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.343+0000 7f2d41600640 1 -- 172.21.15.29:0/2034362504 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2d2c0073d0 con 0x7f2d44159a50 2024-01-24T13:05:09.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.343+0000 7f2d41600640 1 --2- 172.21.15.29:0/2034362504 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2d1c065a60 0x7f2d1c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.343+0000 7f2d41600640 1 -- 172.21.15.29:0/2034362504 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f2d2c082ee0 con 0x7f2d44159a50 2024-01-24T13:05:09.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.343+0000 7f2d49c00640 1 --2- 172.21.15.29:0/2034362504 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2d1c065a60 0x7f2d1c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.343+0000 7f2d49c00640 1 --2- 172.21.15.29:0/2034362504 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2d1c065a60 0x7f2d1c067f20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d340ab000 tx=0x7f2d340b1040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:09.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.347+0000 7f2d41600640 1 -- 172.21.15.29:0/2034362504 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2d2c050610 con 0x7f2d44159a50 2024-01-24T13:05:09.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.503+0000 7f2d4c600640 1 -- 172.21.15.29:0/2034362504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2d440b2930 con 0x7f2d44159a50 2024-01-24T13:05:09.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.507+0000 7f2d41600640 1 -- 172.21.15.29:0/2034362504 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2d2c053c30 con 0x7f2d44159a50 2024-01-24T13:05:09.509 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:09.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.507+0000 7f2d4c600640 1 -- 172.21.15.29:0/2034362504 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2d1c065a60 msgr2=0x7f2d1c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.507+0000 7f2d4c600640 1 --2- 172.21.15.29:0/2034362504 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2d1c065a60 0x7f2d1c067f20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d340ab000 tx=0x7f2d340b1040 comp rx=0 tx=0).stop 2024-01-24T13:05:09.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.507+0000 7f2d4c600640 1 -- 172.21.15.29:0/2034362504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d44159a50 msgr2=0x7f2d4414df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.507+0000 7f2d4c600640 1 --2- 172.21.15.29:0/2034362504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d44159a50 0x7f2d4414df10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00f820 tx=0x7f2d2c00fce0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.507+0000 7f2d4c600640 1 -- 172.21.15.29:0/2034362504 shutdown_connections 2024-01-24T13:05:09.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.507+0000 7f2d4c600640 1 --2- 172.21.15.29:0/2034362504 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2d1c065a60 0x7f2d1c067f20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.507+0000 7f2d4c600640 1 --2- 172.21.15.29:0/2034362504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d441f5040 0x7f2d440ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.507+0000 7f2d4c600640 1 --2- 172.21.15.29:0/2034362504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d44159a50 0x7f2d4414df10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.507+0000 7f2d4c600640 1 --2- 172.21.15.29:0/2034362504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d24003b60 0x7f2d440c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.507+0000 7f2d4c600640 1 -- 172.21.15.29:0/2034362504 >> 172.21.15.29:0/2034362504 conn(0x7f2d44069cd0 msgr2=0x7f2d440d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:09.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.507+0000 7f2d4c600640 1 -- 172.21.15.29:0/2034362504 shutdown_connections 2024-01-24T13:05:09.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.507+0000 7f2d4c600640 1 -- 172.21.15.29:0/2034362504 wait complete. 2024-01-24T13:05:09.531 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:05:09.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.667+0000 7ff783200640 1 Processor -- start 2024-01-24T13:05:09.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.667+0000 7ff783200640 1 -- start start 2024-01-24T13:05:09.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.671+0000 7ff783200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff77c15c730 0x7ff77c06b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.671+0000 7ff783200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff77c0ccdb0 0x7ff77c0cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.671+0000 7ff783200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77c0cd720 con 0x7ff77c0b2700 2024-01-24T13:05:09.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.671+0000 7ff783200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77c06cc10 con 0x7ff77c15c730 2024-01-24T13:05:09.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.671+0000 7ff783200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c06b7a0 con 0x7ff77c0ccdb0 2024-01-24T13:05:09.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.671+0000 7ff77be00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff77c15c730 0x7ff77c06b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.671+0000 7ff77be00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff77c15c730 0x7ff77c06b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:37030/0 (socket says 172.21.15.29:37030) 2024-01-24T13:05:09.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.671+0000 7ff77be00640 1 -- 172.21.15.29:0/258284557 learned_addr learned my addr 172.21.15.29:0/258284557 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:09.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.671+0000 7ff781200640 1 --2- 172.21.15.29:0/258284557 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff77c0ccdb0 0x7ff77c0cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.671+0000 7ff77be00640 1 -- 172.21.15.29:0/258284557 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff77c0ccdb0 msgr2=0x7ff77c0cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:09.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.671+0000 7ff77be00640 1 --2- 172.21.15.29:0/258284557 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff77c0ccdb0 0x7ff77c0cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.671+0000 7ff77be00640 1 -- 172.21.15.29:0/258284557 >> v1:172.21.15.163:6789/0 conn(0x7ff77c0b2700 legacy=0x7ff77c0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.671+0000 7ff77be00640 1 -- 172.21.15.29:0/258284557 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c06ba80 con 0x7ff77c15c730 2024-01-24T13:05:09.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.675+0000 7ff77be00640 1 --2- 172.21.15.29:0/258284557 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff77c15c730 0x7ff77c06b110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009870 tx=0x7ff76c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c80afce3f2992397 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:09.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.675+0000 7ff77aa00640 1 -- 172.21.15.29:0/258284557 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0a7070 con 0x7ff77c15c730 2024-01-24T13:05:09.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.675+0000 7ff77aa00640 1 -- 172.21.15.29:0/258284557 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c0ab430 con 0x7ff77c15c730 2024-01-24T13:05:09.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.675+0000 7ff77aa00640 1 -- 172.21.15.29:0/258284557 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0ab7c0 con 0x7ff77c15c730 2024-01-24T13:05:09.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.675+0000 7ff783200640 1 -- 172.21.15.29:0/258284557 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff77c15c730 msgr2=0x7ff77c06b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.675+0000 7ff783200640 1 --2- 172.21.15.29:0/258284557 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff77c15c730 0x7ff77c06b110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009870 tx=0x7ff76c01c540 comp rx=0 tx=0).stop 2024-01-24T13:05:09.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.675+0000 7ff783200640 1 -- 172.21.15.29:0/258284557 shutdown_connections 2024-01-24T13:05:09.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.675+0000 7ff783200640 1 --2- 172.21.15.29:0/258284557 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff77c0ccdb0 0x7ff77c0cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.675+0000 7ff783200640 1 --2- 172.21.15.29:0/258284557 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff77c15c730 0x7ff77c06b110 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.675+0000 7ff783200640 1 -- 172.21.15.29:0/258284557 >> 172.21.15.29:0/258284557 conn(0x7ff77c070570 msgr2=0x7ff77c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:09.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.675+0000 7ff783200640 1 -- 172.21.15.29:0/258284557 shutdown_connections 2024-01-24T13:05:09.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.675+0000 7ff783200640 1 -- 172.21.15.29:0/258284557 wait complete. 2024-01-24T13:05:09.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.675+0000 7ff783200640 1 Processor -- start 2024-01-24T13:05:09.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff783200640 1 -- start start 2024-01-24T13:05:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff783200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff77c0b2700 0x7ff77c0c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff783200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff77c0ccdb0 0x7ff77c1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff783200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff77c15c730 0x7ff77c156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff783200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0c6ad0 con 0x7ff77c15c730 2024-01-24T13:05:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff783200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0c6d90 con 0x7ff77c0b2700 2024-01-24T13:05:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff783200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0c7510 con 0x7ff77c0ccdb0 2024-01-24T13:05:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff781200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff77c15c730 0x7ff77c156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff781200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff77c15c730 0x7ff77c156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40914/0 (socket says 172.21.15.29:40914) 2024-01-24T13:05:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff781200640 1 -- 172.21.15.29:0/2479014543 learned_addr learned my addr 172.21.15.29:0/2479014543 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff77b400640 1 --2- 172.21.15.29:0/2479014543 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff77c0ccdb0 0x7ff77c1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff77be00640 1 --2- 172.21.15.29:0/2479014543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff77c0b2700 0x7ff77c0c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff781200640 1 -- 172.21.15.29:0/2479014543 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff77c0ccdb0 msgr2=0x7ff77c1569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff781200640 1 --2- 172.21.15.29:0/2479014543 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff77c0ccdb0 0x7ff77c1569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff781200640 1 -- 172.21.15.29:0/2479014543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff77c0b2700 msgr2=0x7ff77c0c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff781200640 1 --2- 172.21.15.29:0/2479014543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff77c0b2700 0x7ff77c0c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff781200640 1 -- 172.21.15.29:0/2479014543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c0094d0 con 0x7ff77c15c730 2024-01-24T13:05:09.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff781200640 1 --2- 172.21.15.29:0/2479014543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff77c15c730 0x7ff77c156f10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff77400efc0 tx=0x7ff77400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:09.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff773e00640 1 -- 172.21.15.29:0/2479014543 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774014480 con 0x7ff77c15c730 2024-01-24T13:05:09.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff773e00640 1 -- 172.21.15.29:0/2479014543 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77400f040 con 0x7ff77c15c730 2024-01-24T13:05:09.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff773e00640 1 -- 172.21.15.29:0/2479014543 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774014820 con 0x7ff77c15c730 2024-01-24T13:05:09.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff783200640 1 -- 172.21.15.29:0/2479014543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77c0c77f0 con 0x7ff77c15c730 2024-01-24T13:05:09.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff783200640 1 -- 172.21.15.29:0/2479014543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77c0c8250 con 0x7ff77c15c730 2024-01-24T13:05:09.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.679+0000 7ff783200640 1 -- 172.21.15.29:0/2479014543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77c0cf430 con 0x7ff77c15c730 2024-01-24T13:05:09.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.683+0000 7ff773e00640 1 -- 172.21.15.29:0/2479014543 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff774014980 con 0x7ff77c15c730 2024-01-24T13:05:09.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.683+0000 7ff773e00640 1 --2- 172.21.15.29:0/2479014543 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff754065a60 0x7ff754067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:09.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.683+0000 7ff773e00640 1 -- 172.21.15.29:0/2479014543 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff774083fd0 con 0x7ff77c15c730 2024-01-24T13:05:09.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.683+0000 7ff77be00640 1 --2- 172.21.15.29:0/2479014543 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff754065a60 0x7ff754067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:09.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.683+0000 7ff77be00640 1 --2- 172.21.15.29:0/2479014543 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff754065a60 0x7ff754067f20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0af000 tx=0x7ff76c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:09.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.687+0000 7ff773e00640 1 -- 172.21.15.29:0/2479014543 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff774051670 con 0x7ff77c15c730 2024-01-24T13:05:09.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.879+0000 7ff783200640 1 -- 172.21.15.29:0/2479014543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff77c04e850 con 0x7ff77c15c730 2024-01-24T13:05:09.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.879+0000 7ff773e00640 1 -- 172.21.15.29:0/2479014543 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7ff774018090 con 0x7ff77c15c730 2024-01-24T13:05:09.881 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:09.882 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1485056573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1485056573},{"type":"v1","addr":"172.21.15.29:6834","nonce":1485056573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/447431893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":447431893},{"type":"v1","addr":"172.21.15.163:6836","nonce":447431893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2390785325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2390785325},{"type":"v1","addr":"172.21.15.29:6835","nonce":2390785325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:03:55.981917+0000","modified":"2024-01-24T13:04:19.618027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/1191601563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1191601563},{"type":"v1","addr":"172.21.15.163:6837","nonce":1191601563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T13:05:09.882 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-24T13:05:09.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.879+0000 7ff783200640 1 -- 172.21.15.29:0/2479014543 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff754065a60 msgr2=0x7ff754067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.879+0000 7ff783200640 1 --2- 172.21.15.29:0/2479014543 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff754065a60 0x7ff754067f20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0af000 tx=0x7ff76c008040 comp rx=0 tx=0).stop 2024-01-24T13:05:09.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.879+0000 7ff783200640 1 -- 172.21.15.29:0/2479014543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff77c15c730 msgr2=0x7ff77c156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:09.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.879+0000 7ff783200640 1 --2- 172.21.15.29:0/2479014543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff77c15c730 0x7ff77c156f10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff77400efc0 tx=0x7ff77400c490 comp rx=0 tx=0).stop 2024-01-24T13:05:09.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.879+0000 7ff783200640 1 -- 172.21.15.29:0/2479014543 shutdown_connections 2024-01-24T13:05:09.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.879+0000 7ff783200640 1 --2- 172.21.15.29:0/2479014543 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff754065a60 0x7ff754067f20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.879+0000 7ff783200640 1 --2- 172.21.15.29:0/2479014543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff77c15c730 0x7ff77c156f10 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.879+0000 7ff783200640 1 --2- 172.21.15.29:0/2479014543 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff77c0ccdb0 0x7ff77c1569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.879+0000 7ff783200640 1 --2- 172.21.15.29:0/2479014543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff77c0b2700 0x7ff77c0c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:09.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.879+0000 7ff783200640 1 -- 172.21.15.29:0/2479014543 >> 172.21.15.29:0/2479014543 conn(0x7ff77c070570 msgr2=0x7ff77c072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:09.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.879+0000 7ff783200640 1 -- 172.21.15.29:0/2479014543 shutdown_connections 2024-01-24T13:05:09.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:09.879+0000 7ff783200640 1 -- 172.21.15.29:0/2479014543 wait complete. 2024-01-24T13:05:09.903 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:10.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.039+0000 7f1c22a00640 1 Processor -- start 2024-01-24T13:05:10.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.039+0000 7f1c22a00640 1 -- start start 2024-01-24T13:05:10.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.043+0000 7f1c22a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1c1c15c730 0x7f1c1c06b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.043+0000 7f1c22a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1c1c0b2700 0x7f1c1c0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.043+0000 7f1c22a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c06cc10 con 0x7f1c1c0ccdb0 2024-01-24T13:05:10.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.043+0000 7f1c22a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c06b7a0 con 0x7f1c1c0b2700 2024-01-24T13:05:10.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.043+0000 7f1c22a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c06ba80 con 0x7f1c1c15c730 2024-01-24T13:05:10.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.043+0000 7f1c1b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1c1c0b2700 0x7f1c1c0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.043+0000 7f1c1b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1c1c0b2700 0x7f1c1c0ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40920/0 (socket says 172.21.15.29:40920) 2024-01-24T13:05:10.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.043+0000 7f1c1b400640 1 -- 172.21.15.29:0/1972411377 learned_addr learned my addr 172.21.15.29:0/1972411377 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:10.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.043+0000 7f1c1be00640 1 --2- 172.21.15.29:0/1972411377 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1c1c15c730 0x7f1c1c06b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.043+0000 7f1c1b400640 1 -- 172.21.15.29:0/1972411377 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1c1c15c730 msgr2=0x7f1c1c06b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:10.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.043+0000 7f1c1b400640 1 --2- 172.21.15.29:0/1972411377 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1c1c15c730 0x7f1c1c06b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.043+0000 7f1c1b400640 1 -- 172.21.15.29:0/1972411377 >> v1:172.21.15.163:6789/0 conn(0x7f1c1c0ccdb0 legacy=0x7f1c1c0cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:10.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.043+0000 7f1c1b400640 1 -- 172.21.15.29:0/1972411377 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c06bd60 con 0x7f1c1c0b2700 2024-01-24T13:05:10.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.043+0000 7f1c1be00640 1 --2- 172.21.15.29:0/1972411377 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1c1c15c730 0x7f1c1c06b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:10.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.047+0000 7f1c1b400640 1 --2- 172.21.15.29:0/1972411377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c1c0b2700 0x7f1c1c0ca9f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009870 tx=0x7f1c0401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ca70c7723b030b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:10.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.047+0000 7f1c1aa00640 1 -- 172.21.15.29:0/1972411377 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c040aa5f0 con 0x7f1c1c0b2700 2024-01-24T13:05:10.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.047+0000 7f1c1aa00640 1 -- 172.21.15.29:0/1972411377 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c040aa750 con 0x7f1c1c0b2700 2024-01-24T13:05:10.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.047+0000 7f1c1aa00640 1 -- 172.21.15.29:0/1972411377 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c040aaae0 con 0x7f1c1c0b2700 2024-01-24T13:05:10.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.047+0000 7f1c22a00640 1 -- 172.21.15.29:0/1972411377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c1c0b2700 msgr2=0x7f1c1c0ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.047+0000 7f1c22a00640 1 --2- 172.21.15.29:0/1972411377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c1c0b2700 0x7f1c1c0ca9f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009870 tx=0x7f1c0401c4d0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.047+0000 7f1c22a00640 1 -- 172.21.15.29:0/1972411377 shutdown_connections 2024-01-24T13:05:10.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.047+0000 7f1c22a00640 1 --2- 172.21.15.29:0/1972411377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c1c0b2700 0x7f1c1c0ca9f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.047+0000 7f1c22a00640 1 --2- 172.21.15.29:0/1972411377 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1c1c15c730 0x7f1c1c06b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.047+0000 7f1c22a00640 1 -- 172.21.15.29:0/1972411377 >> 172.21.15.29:0/1972411377 conn(0x7f1c1c070570 msgr2=0x7f1c1c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:10.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.047+0000 7f1c22a00640 1 -- 172.21.15.29:0/1972411377 shutdown_connections 2024-01-24T13:05:10.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.047+0000 7f1c22a00640 1 -- 172.21.15.29:0/1972411377 wait complete. 2024-01-24T13:05:10.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.047+0000 7f1c22a00640 1 Processor -- start 2024-01-24T13:05:10.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.047+0000 7f1c22a00640 1 -- start start 2024-01-24T13:05:10.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c22a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1c1c0b2700 0x7f1c1c0b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c22a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1c1c0ccdb0 0x7f1c1c15e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c22a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c1c15c730 0x7f1c1c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c22a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c15f9a0 con 0x7f1c1c15c730 2024-01-24T13:05:10.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c22a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0b60d0 con 0x7f1c1c0ccdb0 2024-01-24T13:05:10.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c22a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c15f3e0 con 0x7f1c1c0b2700 2024-01-24T13:05:10.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c20a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c1c15c730 0x7f1c1c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c20a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c1c15c730 0x7f1c1c1531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40936/0 (socket says 172.21.15.29:40936) 2024-01-24T13:05:10.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c20a00640 1 -- 172.21.15.29:0/3238455829 learned_addr learned my addr 172.21.15.29:0/3238455829 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:10.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c1be00640 1 --2- 172.21.15.29:0/3238455829 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1c1c0b2700 0x7f1c1c0b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c1b400640 1 --2- 172.21.15.29:0/3238455829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1c1c0ccdb0 0x7f1c1c15e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c20a00640 1 -- 172.21.15.29:0/3238455829 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1c1c0b2700 msgr2=0x7f1c1c0b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c20a00640 1 --2- 172.21.15.29:0/3238455829 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1c1c0b2700 0x7f1c1c0b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c20a00640 1 -- 172.21.15.29:0/3238455829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1c1c0ccdb0 msgr2=0x7f1c1c15e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c20a00640 1 --2- 172.21.15.29:0/3238455829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1c1c0ccdb0 0x7f1c1c15e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c20a00640 1 -- 172.21.15.29:0/3238455829 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c040094d0 con 0x7f1c1c15c730 2024-01-24T13:05:10.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c20a00640 1 --2- 172.21.15.29:0/3238455829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c1c15c730 0x7f1c1c1531b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400c780 tx=0x7f1c1400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:10.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c13e00640 1 -- 172.21.15.29:0/3238455829 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14004b70 con 0x7f1c1c15c730 2024-01-24T13:05:10.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c13e00640 1 -- 172.21.15.29:0/3238455829 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1400ce90 con 0x7f1c1c15c730 2024-01-24T13:05:10.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c13e00640 1 -- 172.21.15.29:0/3238455829 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400a850 con 0x7f1c1c15c730 2024-01-24T13:05:10.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c22a00640 1 -- 172.21.15.29:0/3238455829 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c15f6c0 con 0x7f1c1c15c730 2024-01-24T13:05:10.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c22a00640 1 -- 172.21.15.29:0/3238455829 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c154d00 con 0x7f1c1c15c730 2024-01-24T13:05:10.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c22a00640 1 -- 172.21.15.29:0/3238455829 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c04e850 con 0x7f1c1c15c730 2024-01-24T13:05:10.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.051+0000 7f1c13e00640 1 -- 172.21.15.29:0/3238455829 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1c1400a9b0 con 0x7f1c1c15c730 2024-01-24T13:05:10.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.055+0000 7f1c13e00640 1 --2- 172.21.15.29:0/3238455829 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1bf4065a60 0x7f1bf4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.055+0000 7f1c13e00640 1 -- 172.21.15.29:0/3238455829 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f1c140835f0 con 0x7f1c1c15c730 2024-01-24T13:05:10.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.055+0000 7f1c1be00640 1 --2- 172.21.15.29:0/3238455829 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1bf4065a60 0x7f1bf4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.055+0000 7f1c1be00640 1 --2- 172.21.15.29:0/3238455829 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1bf4065a60 0x7f1bf4067f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c006fd0 tx=0x7f1c0c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:10.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.059+0000 7f1c13e00640 1 -- 172.21.15.29:0/3238455829 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1c14050c90 con 0x7f1c1c15c730 2024-01-24T13:05:10.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.215+0000 7f1c22a00640 1 -- 172.21.15.29:0/3238455829 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c1c0ce210 con 0x7f1c1c15c730 2024-01-24T13:05:10.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.215+0000 7f1c13e00640 1 -- 172.21.15.29:0/3238455829 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7f1c140542b0 con 0x7f1c1c15c730 2024-01-24T13:05:10.219 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:10.219 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:10.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.219+0000 7f1c22a00640 1 -- 172.21.15.29:0/3238455829 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1bf4065a60 msgr2=0x7f1bf4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.219+0000 7f1c22a00640 1 --2- 172.21.15.29:0/3238455829 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1bf4065a60 0x7f1bf4067f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c006fd0 tx=0x7f1c0c008040 comp rx=0 tx=0).stop 2024-01-24T13:05:10.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.219+0000 7f1c22a00640 1 -- 172.21.15.29:0/3238455829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c1c15c730 msgr2=0x7f1c1c1531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.219+0000 7f1c22a00640 1 --2- 172.21.15.29:0/3238455829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c1c15c730 0x7f1c1c1531b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400c780 tx=0x7f1c1400cc40 comp rx=0 tx=0).stop 2024-01-24T13:05:10.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.219+0000 7f1c22a00640 1 -- 172.21.15.29:0/3238455829 shutdown_connections 2024-01-24T13:05:10.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.219+0000 7f1c22a00640 1 --2- 172.21.15.29:0/3238455829 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1bf4065a60 0x7f1bf4067f20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.219+0000 7f1c22a00640 1 --2- 172.21.15.29:0/3238455829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c1c15c730 0x7f1c1c1531b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.219+0000 7f1c22a00640 1 --2- 172.21.15.29:0/3238455829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1c1c0ccdb0 0x7f1c1c15e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.219+0000 7f1c22a00640 1 --2- 172.21.15.29:0/3238455829 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1c1c0b2700 0x7f1c1c0b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.219+0000 7f1c22a00640 1 -- 172.21.15.29:0/3238455829 >> 172.21.15.29:0/3238455829 conn(0x7f1c1c070570 msgr2=0x7f1c1c0afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:10.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.219+0000 7f1c22a00640 1 -- 172.21.15.29:0/3238455829 shutdown_connections 2024-01-24T13:05:10.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.219+0000 7f1c22a00640 1 -- 172.21.15.29:0/3238455829 wait complete. 2024-01-24T13:05:10.241 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-24T13:05:10.241 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:05:10.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b4b000640 1 Processor -- start 2024-01-24T13:05:10.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b4b000640 1 -- start start 2024-01-24T13:05:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b4b000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b440ce950 0x7f9b440ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b4b000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9b440cd2f0 0x7f9b4415d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b4b000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b440d0b80 con 0x7f9b4415d5d0 2024-01-24T13:05:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b4b000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b440d0040 con 0x7f9b440cd2f0 2024-01-24T13:05:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b4b000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b440cd770 con 0x7f9b440ce950 2024-01-24T13:05:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b43400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9b440cd2f0 0x7f9b4415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b43400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9b440cd2f0 0x7f9b4415d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40940/0 (socket says 172.21.15.29:40940) 2024-01-24T13:05:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b43400640 1 -- 172.21.15.29:0/1058532012 learned_addr learned my addr 172.21.15.29:0/1058532012 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b43e00640 1 --2- 172.21.15.29:0/1058532012 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b440ce950 0x7f9b440ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b43400640 1 -- 172.21.15.29:0/1058532012 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b440ce950 msgr2=0x7f9b440ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:10.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b43400640 1 --2- 172.21.15.29:0/1058532012 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b440ce950 0x7f9b440ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b43400640 1 -- 172.21.15.29:0/1058532012 >> v1:172.21.15.29:6789/0 conn(0x7f9b4415d5d0 legacy=0x7f9b44152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.379+0000 7f9b43400640 1 -- 172.21.15.29:0/1058532012 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4406bdf0 con 0x7f9b440cd2f0 2024-01-24T13:05:10.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.383+0000 7f9b43400640 1 --2- 172.21.15.29:0/1058532012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b440cd2f0 0x7f9b4415d090 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009870 tx=0x7f9b2c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3a53572b83f88e server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:10.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.383+0000 7f9b42a00640 1 -- 172.21.15.29:0/1058532012 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0ac640 con 0x7f9b440cd2f0 2024-01-24T13:05:10.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.383+0000 7f9b42a00640 1 -- 172.21.15.29:0/1058532012 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c0ac7a0 con 0x7f9b440cd2f0 2024-01-24T13:05:10.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.383+0000 7f9b42a00640 1 -- 172.21.15.29:0/1058532012 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0acb30 con 0x7f9b440cd2f0 2024-01-24T13:05:10.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.383+0000 7f9b4b000640 1 -- 172.21.15.29:0/1058532012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b440cd2f0 msgr2=0x7f9b4415d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.383+0000 7f9b4b000640 1 --2- 172.21.15.29:0/1058532012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b440cd2f0 0x7f9b4415d090 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009870 tx=0x7f9b2c01c420 comp rx=0 tx=0).stop 2024-01-24T13:05:10.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.383+0000 7f9b4b000640 1 -- 172.21.15.29:0/1058532012 shutdown_connections 2024-01-24T13:05:10.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.383+0000 7f9b4b000640 1 --2- 172.21.15.29:0/1058532012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b440cd2f0 0x7f9b4415d090 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.383+0000 7f9b4b000640 1 --2- 172.21.15.29:0/1058532012 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b440ce950 0x7f9b440ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.383+0000 7f9b4b000640 1 -- 172.21.15.29:0/1058532012 >> 172.21.15.29:0/1058532012 conn(0x7f9b44070570 msgr2=0x7f9b44069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:10.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.383+0000 7f9b4b000640 1 -- 172.21.15.29:0/1058532012 shutdown_connections 2024-01-24T13:05:10.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.383+0000 7f9b4b000640 1 -- 172.21.15.29:0/1058532012 wait complete. 2024-01-24T13:05:10.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b4b000640 1 Processor -- start 2024-01-24T13:05:10.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b4b000640 1 -- start start 2024-01-24T13:05:10.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b4b000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b440cd2f0 0x7f9b44154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b4b000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b440ce950 0x7f9b440cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b4b000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b4415d5d0 0x7f9b440cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b4b000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441f5e20 con 0x7f9b440cd2f0 2024-01-24T13:05:10.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b4b000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441f56f0 con 0x7f9b4415d5d0 2024-01-24T13:05:10.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b4b000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b44156d50 con 0x7f9b440ce950 2024-01-24T13:05:10.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b43e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b440cd2f0 0x7f9b44154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b43e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b440cd2f0 0x7f9b44154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40942/0 (socket says 172.21.15.29:40942) 2024-01-24T13:05:10.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b43e00640 1 -- 172.21.15.29:0/3536770162 learned_addr learned my addr 172.21.15.29:0/3536770162 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:10.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b43400640 1 --2- 172.21.15.29:0/3536770162 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b440ce950 0x7f9b440cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b49000640 1 --2- 172.21.15.29:0/3536770162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b4415d5d0 0x7f9b440cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b43e00640 1 -- 172.21.15.29:0/3536770162 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b440ce950 msgr2=0x7f9b440cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b43e00640 1 --2- 172.21.15.29:0/3536770162 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b440ce950 0x7f9b440cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b43e00640 1 -- 172.21.15.29:0/3536770162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b4415d5d0 msgr2=0x7f9b440cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b43e00640 1 --2- 172.21.15.29:0/3536770162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b4415d5d0 0x7f9b440cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b43e00640 1 -- 172.21.15.29:0/3536770162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c0094d0 con 0x7f9b440cd2f0 2024-01-24T13:05:10.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b43e00640 1 --2- 172.21.15.29:0/3536770162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b440cd2f0 0x7f9b44154470 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400d800 tx=0x7f9b3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:10.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b3be00640 1 -- 172.21.15.29:0/3536770162 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3400b6c0 con 0x7f9b440cd2f0 2024-01-24T13:05:10.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b3be00640 1 -- 172.21.15.29:0/3536770162 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3400b820 con 0x7f9b440cd2f0 2024-01-24T13:05:10.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b3be00640 1 -- 172.21.15.29:0/3536770162 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3400bb90 con 0x7f9b440cd2f0 2024-01-24T13:05:10.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.387+0000 7f9b4b000640 1 -- 172.21.15.29:0/3536770162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b441f4e00 con 0x7f9b440cd2f0 2024-01-24T13:05:10.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.391+0000 7f9b4b000640 1 -- 172.21.15.29:0/3536770162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b441f5380 con 0x7f9b440cd2f0 2024-01-24T13:05:10.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.391+0000 7f9b4b000640 1 -- 172.21.15.29:0/3536770162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4404e850 con 0x7f9b440cd2f0 2024-01-24T13:05:10.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.391+0000 7f9b3be00640 1 -- 172.21.15.29:0/3536770162 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9b3400bcf0 con 0x7f9b440cd2f0 2024-01-24T13:05:10.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.391+0000 7f9b3be00640 1 --2- 172.21.15.29:0/3536770162 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9b1c065a90 0x7f9b1c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.391+0000 7f9b3be00640 1 -- 172.21.15.29:0/3536770162 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f9b34083980 con 0x7f9b440cd2f0 2024-01-24T13:05:10.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.391+0000 7f9b43400640 1 --2- 172.21.15.29:0/3536770162 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9b1c065a90 0x7f9b1c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.391+0000 7f9b43400640 1 --2- 172.21.15.29:0/3536770162 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9b1c065a90 0x7f9b1c067f50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0ae000 tx=0x7f9b2c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:10.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.395+0000 7f9b3be00640 1 -- 172.21.15.29:0/3536770162 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9b34051000 con 0x7f9b440cd2f0 2024-01-24T13:05:10.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.587+0000 7f9b4b000640 1 -- 172.21.15.29:0/3536770162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b44152f10 con 0x7f9b440cd2f0 2024-01-24T13:05:10.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.587+0000 7f9b3be00640 1 -- 172.21.15.29:0/3536770162 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f9b34054620 con 0x7f9b440cd2f0 2024-01-24T13:05:10.589 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:10.590 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1485056573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1485056573},{"type":"v1","addr":"172.21.15.29:6834","nonce":1485056573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/447431893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":447431893},{"type":"v1","addr":"172.21.15.163:6836","nonce":447431893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2390785325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2390785325},{"type":"v1","addr":"172.21.15.29:6835","nonce":2390785325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:03:55.981917+0000","modified":"2024-01-24T13:04:19.618027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/1191601563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1191601563},{"type":"v1","addr":"172.21.15.163:6837","nonce":1191601563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T13:05:10.590 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-24T13:05:10.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.587+0000 7f9b4b000640 1 -- 172.21.15.29:0/3536770162 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9b1c065a90 msgr2=0x7f9b1c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.587+0000 7f9b4b000640 1 --2- 172.21.15.29:0/3536770162 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9b1c065a90 0x7f9b1c067f50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0ae000 tx=0x7f9b2c008040 comp rx=0 tx=0).stop 2024-01-24T13:05:10.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.587+0000 7f9b4b000640 1 -- 172.21.15.29:0/3536770162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b440cd2f0 msgr2=0x7f9b44154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.587+0000 7f9b4b000640 1 --2- 172.21.15.29:0/3536770162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b440cd2f0 0x7f9b44154470 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400d800 tx=0x7f9b3400dcc0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.587+0000 7f9b4b000640 1 -- 172.21.15.29:0/3536770162 shutdown_connections 2024-01-24T13:05:10.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.587+0000 7f9b4b000640 1 --2- 172.21.15.29:0/3536770162 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9b1c065a90 0x7f9b1c067f50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.587+0000 7f9b4b000640 1 --2- 172.21.15.29:0/3536770162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b4415d5d0 0x7f9b440cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.587+0000 7f9b4b000640 1 --2- 172.21.15.29:0/3536770162 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b440ce950 0x7f9b440cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.587+0000 7f9b4b000640 1 --2- 172.21.15.29:0/3536770162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b440cd2f0 0x7f9b44154470 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.587+0000 7f9b4b000640 1 -- 172.21.15.29:0/3536770162 >> 172.21.15.29:0/3536770162 conn(0x7f9b44070570 msgr2=0x7f9b44069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:10.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.587+0000 7f9b4b000640 1 -- 172.21.15.29:0/3536770162 shutdown_connections 2024-01-24T13:05:10.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.587+0000 7f9b4b000640 1 -- 172.21.15.29:0/3536770162 wait complete. 2024-01-24T13:05:10.612 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:05:10.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48b7e00640 1 Processor -- start 2024-01-24T13:05:10.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48b7e00640 1 -- start start 2024-01-24T13:05:10.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48b7e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f48b00c9fb0 0x7f48b015aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48b7e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b015e000 con 0x7f48b006d6f0 2024-01-24T13:05:10.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48b7e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b015e250 con 0x7f48b006db50 2024-01-24T13:05:10.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48b7e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b015af50 con 0x7f48b00c9fb0 2024-01-24T13:05:10.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48b4a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f48b006d6f0 0x7f48b00cf6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37292/0 (socket says 172.21.15.29:37292) 2024-01-24T13:05:10.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48b4a00640 1 -- 172.21.15.29:0/909779303 learned_addr learned my addr 172.21.15.29:0/909779303 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:10.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48b5400640 1 --2- 172.21.15.29:0/909779303 >> v2:172.21.15.163:3300/0 conn(0x7f48b00c9fb0 0x7f48b015aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48afe00640 1 -- 172.21.15.29:0/909779303 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371244172 0 0) 0x7f48b015e000 con 0x7f48b006d6f0 2024-01-24T13:05:10.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48afe00640 1 -- 172.21.15.29:0/909779303 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4890003530 con 0x7f48b006d6f0 2024-01-24T13:05:10.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48b5400640 1 -- 172.21.15.29:0/909779303 >> v1:172.21.15.163:6789/0 conn(0x7f48b006db50 legacy=0x7f48b0071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48afe00640 1 -- 172.21.15.29:0/909779303 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1636124491 0 0) 0x7f4890003530 con 0x7f48b006d6f0 2024-01-24T13:05:10.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48b5400640 1 -- 172.21.15.29:0/909779303 >> v1:172.21.15.29:6789/0 conn(0x7f48b006d6f0 legacy=0x7f48b00cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.751+0000 7f48b5400640 1 -- 172.21.15.29:0/909779303 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b015e530 con 0x7f48b00c9fb0 2024-01-24T13:05:10.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.755+0000 7f48b5400640 1 --2- 172.21.15.29:0/909779303 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b00c9fb0 0x7f48b015aa10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009740 tx=0x7f48a001c1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7176ccea976cdf5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:10.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.755+0000 7f48afe00640 1 -- 172.21.15.29:0/909779303 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898001680 con 0x7f48b00c9fb0 2024-01-24T13:05:10.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.755+0000 7f48afe00640 1 -- 172.21.15.29:0/909779303 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a00a7050 con 0x7f48b00c9fb0 2024-01-24T13:05:10.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.755+0000 7f48afe00640 1 -- 172.21.15.29:0/909779303 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a00ab620 con 0x7f48b00c9fb0 2024-01-24T13:05:10.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.755+0000 7f48b7e00640 1 -- 172.21.15.29:0/909779303 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b00c9fb0 msgr2=0x7f48b015aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.755+0000 7f48b7e00640 1 --2- 172.21.15.29:0/909779303 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b00c9fb0 0x7f48b015aa10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009740 tx=0x7f48a001c1d0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.755+0000 7f48b7e00640 1 -- 172.21.15.29:0/909779303 shutdown_connections 2024-01-24T13:05:10.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.755+0000 7f48b7e00640 1 --2- 172.21.15.29:0/909779303 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b00c9fb0 0x7f48b015aa10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.755+0000 7f48b7e00640 1 -- 172.21.15.29:0/909779303 >> 172.21.15.29:0/909779303 conn(0x7f48b006b1e0 msgr2=0x7f48b006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:10.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.755+0000 7f48b7e00640 1 -- 172.21.15.29:0/909779303 shutdown_connections 2024-01-24T13:05:10.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.755+0000 7f48b7e00640 1 -- 172.21.15.29:0/909779303 wait complete. 2024-01-24T13:05:10.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b7e00640 1 Processor -- start 2024-01-24T13:05:10.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b7e00640 1 -- start start 2024-01-24T13:05:10.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b7e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b006d6f0 0x7f48b00ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b7e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b00c9fb0 0x7f48b00b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b7e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48b00a79d0 0x7f48b0159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b7e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00b2520 con 0x7f48b00c9fb0 2024-01-24T13:05:10.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b7e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00b2800 con 0x7f48b006d6f0 2024-01-24T13:05:10.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b7e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00b2ae0 con 0x7f48b00a79d0 2024-01-24T13:05:10.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b4a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b00c9fb0 0x7f48b00b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b4a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b00c9fb0 0x7f48b00b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40954/0 (socket says 172.21.15.29:40954) 2024-01-24T13:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b4a00640 1 -- 172.21.15.29:0/3466215646 learned_addr learned my addr 172.21.15.29:0/3466215646 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b5400640 1 --2- 172.21.15.29:0/3466215646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b006d6f0 0x7f48b00ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b4a00640 1 -- 172.21.15.29:0/3466215646 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48b00a79d0 msgr2=0x7f48b0159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b4a00640 1 --2- 172.21.15.29:0/3466215646 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48b00a79d0 0x7f48b0159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b4a00640 1 -- 172.21.15.29:0/3466215646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b006d6f0 msgr2=0x7f48b00ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b4a00640 1 --2- 172.21.15.29:0/3466215646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b006d6f0 0x7f48b00ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b4a00640 1 -- 172.21.15.29:0/3466215646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a0009420 con 0x7f48b00c9fb0 2024-01-24T13:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b5400640 1 --2- 172.21.15.29:0/3466215646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b006d6f0 0x7f48b00ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b4a00640 1 --2- 172.21.15.29:0/3466215646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b00c9fb0 0x7f48b00b1e20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f489800c780 tx=0x7f489800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48ad600640 1 -- 172.21.15.29:0/3466215646 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48980072d0 con 0x7f48b00c9fb0 2024-01-24T13:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48ad600640 1 -- 172.21.15.29:0/3466215646 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4898007430 con 0x7f48b00c9fb0 2024-01-24T13:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b7e00640 1 -- 172.21.15.29:0/3466215646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b00b2dc0 con 0x7f48b00c9fb0 2024-01-24T13:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48ad600640 1 -- 172.21.15.29:0/3466215646 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48980047f0 con 0x7f48b00c9fb0 2024-01-24T13:05:10.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.759+0000 7f48b7e00640 1 -- 172.21.15.29:0/3466215646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b00a7e80 con 0x7f48b00c9fb0 2024-01-24T13:05:10.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.763+0000 7f48b7e00640 1 -- 172.21.15.29:0/3466215646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b004e850 con 0x7f48b00c9fb0 2024-01-24T13:05:10.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.763+0000 7f48ad600640 1 -- 172.21.15.29:0/3466215646 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4898004950 con 0x7f48b00c9fb0 2024-01-24T13:05:10.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.763+0000 7f48ad600640 1 --2- 172.21.15.29:0/3466215646 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4888065a60 0x7f4888067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:10.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.763+0000 7f48ad600640 1 -- 172.21.15.29:0/3466215646 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4898082bf0 con 0x7f48b00c9fb0 2024-01-24T13:05:10.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.763+0000 7f48b5400640 1 --2- 172.21.15.29:0/3466215646 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4888065a60 0x7f4888067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:10.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.767+0000 7f48b5400640 1 --2- 172.21.15.29:0/3466215646 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4888065a60 0x7f4888067f20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f48a00ad000 tx=0x7f48a0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.767+0000 7f48ad600640 1 -- 172.21.15.29:0/3466215646 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4898050270 con 0x7f48b00c9fb0 2024-01-24T13:05:10.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.959+0000 7f48b7e00640 1 -- 172.21.15.29:0/3466215646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48b00b3270 con 0x7f48b00c9fb0 2024-01-24T13:05:10.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.959+0000 7f48ad600640 1 -- 172.21.15.29:0/3466215646 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f4898018020 con 0x7f48b00c9fb0 2024-01-24T13:05:10.963 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:10.963 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1485056573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1485056573},{"type":"v1","addr":"172.21.15.29:6834","nonce":1485056573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/447431893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":447431893},{"type":"v1","addr":"172.21.15.163:6836","nonce":447431893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2390785325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2390785325},{"type":"v1","addr":"172.21.15.29:6835","nonce":2390785325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:03:55.981917+0000","modified":"2024-01-24T13:04:19.618027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/1191601563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1191601563},{"type":"v1","addr":"172.21.15.163:6837","nonce":1191601563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T13:05:10.963 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-24T13:05:10.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.963+0000 7f48b7e00640 1 -- 172.21.15.29:0/3466215646 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4888065a60 msgr2=0x7f4888067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.963+0000 7f48b7e00640 1 --2- 172.21.15.29:0/3466215646 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4888065a60 0x7f4888067f20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f48a00ad000 tx=0x7f48a0008040 comp rx=0 tx=0).stop 2024-01-24T13:05:10.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.963+0000 7f48b7e00640 1 -- 172.21.15.29:0/3466215646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b00c9fb0 msgr2=0x7f48b00b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:10.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.963+0000 7f48b7e00640 1 --2- 172.21.15.29:0/3466215646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b00c9fb0 0x7f48b00b1e20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f489800c780 tx=0x7f489800cc40 comp rx=0 tx=0).stop 2024-01-24T13:05:10.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.963+0000 7f48b7e00640 1 -- 172.21.15.29:0/3466215646 shutdown_connections 2024-01-24T13:05:10.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.963+0000 7f48b7e00640 1 --2- 172.21.15.29:0/3466215646 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4888065a60 0x7f4888067f20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.963+0000 7f48b7e00640 1 --2- 172.21.15.29:0/3466215646 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48b00a79d0 0x7f48b0159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.963+0000 7f48b7e00640 1 --2- 172.21.15.29:0/3466215646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b00c9fb0 0x7f48b00b1e20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.963+0000 7f48b7e00640 1 --2- 172.21.15.29:0/3466215646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b006d6f0 0x7f48b00ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:10.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.963+0000 7f48b7e00640 1 -- 172.21.15.29:0/3466215646 >> 172.21.15.29:0/3466215646 conn(0x7f48b006b1e0 msgr2=0x7f48b00aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:10.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.963+0000 7f48b7e00640 1 -- 172.21.15.29:0/3466215646 shutdown_connections 2024-01-24T13:05:10.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:10.963+0000 7f48b7e00640 1 -- 172.21.15.29:0/3466215646 wait complete. 2024-01-24T13:05:10.985 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:11.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.123+0000 7f7f94400640 1 Processor -- start 2024-01-24T13:05:11.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.123+0000 7f7f94400640 1 -- start start 2024-01-24T13:05:11.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.123+0000 7f7f94400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f8c0c3ef0 0x7f7f8c0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.123+0000 7f7f94400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8c0cfe50 con 0x7f7f8c15a630 2024-01-24T13:05:11.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.123+0000 7f7f94400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8c0cb3c0 con 0x7f7f8c0caf30 2024-01-24T13:05:11.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.123+0000 7f7f94400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8c0cf380 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.123+0000 7f7f91000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f8c0c3ef0 0x7f7f8c0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.123+0000 7f7f91000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f8c0c3ef0 0x7f7f8c0ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48896/0 (socket says 172.21.15.29:48896) 2024-01-24T13:05:11.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.123+0000 7f7f91000640 1 -- 172.21.15.29:0/3838212036 learned_addr learned my addr 172.21.15.29:0/3838212036 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:11.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.123+0000 7f7f91000640 1 -- 172.21.15.29:0/3838212036 >> v1:172.21.15.163:6789/0 conn(0x7f7f8c0caf30 legacy=0x7f7f8c0d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:11.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.123+0000 7f7f91000640 1 -- 172.21.15.29:0/3838212036 >> v1:172.21.15.29:6789/0 conn(0x7f7f8c15a630 legacy=0x7f7f8c0cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:11.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.123+0000 7f7f91000640 1 -- 172.21.15.29:0/3838212036 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c15aa10 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.127+0000 7f7f91000640 1 --2- 172.21.15.29:0/3838212036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f8c0c3ef0 0x7f7f8c0ca9f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009870 tx=0x7f7f7401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a89698bfcbb8357 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:11.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.127+0000 7f7f8be00640 1 -- 172.21.15.29:0/3838212036 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f740aa640 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.127+0000 7f7f8be00640 1 -- 172.21.15.29:0/3838212036 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f740aa7a0 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.127+0000 7f7f8be00640 1 -- 172.21.15.29:0/3838212036 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f740aab30 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.127+0000 7f7f94400640 1 -- 172.21.15.29:0/3838212036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f8c0c3ef0 msgr2=0x7f7f8c0ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:11.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.127+0000 7f7f94400640 1 --2- 172.21.15.29:0/3838212036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f8c0c3ef0 0x7f7f8c0ca9f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009870 tx=0x7f7f7401c4e0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.127+0000 7f7f94400640 1 -- 172.21.15.29:0/3838212036 shutdown_connections 2024-01-24T13:05:11.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.127+0000 7f7f94400640 1 --2- 172.21.15.29:0/3838212036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f8c0c3ef0 0x7f7f8c0ca9f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.127+0000 7f7f94400640 1 -- 172.21.15.29:0/3838212036 >> 172.21.15.29:0/3838212036 conn(0x7f7f8c070570 msgr2=0x7f7f8c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:11.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.127+0000 7f7f94400640 1 -- 172.21.15.29:0/3838212036 shutdown_connections 2024-01-24T13:05:11.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.127+0000 7f7f94400640 1 -- 172.21.15.29:0/3838212036 wait complete. 2024-01-24T13:05:11.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f94400640 1 Processor -- start 2024-01-24T13:05:11.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f94400640 1 -- start start 2024-01-24T13:05:11.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f94400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f8c0c3ef0 0x7f7f8c150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f94400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f8c0caf30 0x7f7f8c151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f94400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f8c15a630 0x7f7f8c147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f94400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c15d540 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f94400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c1516c0 con 0x7f7f8c15a630 2024-01-24T13:05:11.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f94400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0b30f0 con 0x7f7f8c0caf30 2024-01-24T13:05:11.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f91a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f8c0c3ef0 0x7f7f8c150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f91000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f8c0caf30 0x7f7f8c151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f91a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f8c0c3ef0 0x7f7f8c150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48906/0 (socket says 172.21.15.29:48906) 2024-01-24T13:05:11.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f91a00640 1 -- 172.21.15.29:0/3823711974 learned_addr learned my addr 172.21.15.29:0/3823711974 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:11.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f92400640 1 --2- 172.21.15.29:0/3823711974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f8c15a630 0x7f7f8c147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f91a00640 1 -- 172.21.15.29:0/3823711974 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f8c0caf30 msgr2=0x7f7f8c151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:11.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f91a00640 1 --2- 172.21.15.29:0/3823711974 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f8c0caf30 0x7f7f8c151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f91a00640 1 -- 172.21.15.29:0/3823711974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f8c15a630 msgr2=0x7f7f8c147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:11.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f91a00640 1 --2- 172.21.15.29:0/3823711974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f8c15a630 0x7f7f8c147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f91a00640 1 -- 172.21.15.29:0/3823711974 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f740094d0 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f91a00640 1 --2- 172.21.15.29:0/3823711974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f8c0c3ef0 0x7f7f8c150b50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c3c0 tx=0x7f7f7c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:11.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f89600640 1 -- 172.21.15.29:0/3823711974 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c0052d0 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f89600640 1 -- 172.21.15.29:0/3823711974 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c005430 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f94400640 1 -- 172.21.15.29:0/3823711974 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8c15d7e0 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f89600640 1 -- 172.21.15.29:0/3823711974 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c003840 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.131+0000 7f7f94400640 1 -- 172.21.15.29:0/3823711974 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8c0b33d0 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.135+0000 7f7f94400640 1 -- 172.21.15.29:0/3823711974 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8c15da20 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.135+0000 7f7f89600640 1 -- 172.21.15.29:0/3823711974 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7f7c0039a0 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.135+0000 7f7f89600640 1 --2- 172.21.15.29:0/3823711974 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f64065a90 0x7f7f64067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.135+0000 7f7f89600640 1 -- 172.21.15.29:0/3823711974 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f7f7c082910 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.135+0000 7f7f91000640 1 --2- 172.21.15.29:0/3823711974 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f64065a90 0x7f7f64067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.135+0000 7f7f91000640 1 --2- 172.21.15.29:0/3823711974 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f64065a90 0x7f7f64067f50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7f740ae000 tx=0x7f7f740b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:11.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.139+0000 7f7f89600640 1 -- 172.21.15.29:0/3823711974 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7f7c050040 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.299+0000 7f7f94400640 1 -- 172.21.15.29:0/3823711974 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f8c0cf070 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.303+0000 7f7f89600640 1 -- 172.21.15.29:0/3823711974 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17977 (secure 0 0 0) 0x7f7f7c053660 con 0x7f7f8c0c3ef0 2024-01-24T13:05:11.305 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:11.306 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:04:37.320770+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:03:53.602149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T13:03:54.965798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-24T13:03:58.047476+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:11.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.303+0000 7f7f94400640 1 -- 172.21.15.29:0/3823711974 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f64065a90 msgr2=0x7f7f64067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.303+0000 7f7f94400640 1 --2- 172.21.15.29:0/3823711974 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f64065a90 0x7f7f64067f50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7f740ae000 tx=0x7f7f740b5040 comp rx=0 tx=0).stop 2024-01-24T13:05:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.303+0000 7f7f94400640 1 -- 172.21.15.29:0/3823711974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f8c0c3ef0 msgr2=0x7f7f8c150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.303+0000 7f7f94400640 1 --2- 172.21.15.29:0/3823711974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f8c0c3ef0 0x7f7f8c150b50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c3c0 tx=0x7f7f7c00c880 comp rx=0 tx=0).stop 2024-01-24T13:05:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.303+0000 7f7f94400640 1 -- 172.21.15.29:0/3823711974 shutdown_connections 2024-01-24T13:05:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.303+0000 7f7f94400640 1 --2- 172.21.15.29:0/3823711974 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f64065a90 0x7f7f64067f50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.303+0000 7f7f94400640 1 --2- 172.21.15.29:0/3823711974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f8c15a630 0x7f7f8c147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.303+0000 7f7f94400640 1 --2- 172.21.15.29:0/3823711974 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f8c0caf30 0x7f7f8c151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.303+0000 7f7f94400640 1 --2- 172.21.15.29:0/3823711974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f8c0c3ef0 0x7f7f8c150b50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.303+0000 7f7f94400640 1 -- 172.21.15.29:0/3823711974 >> 172.21.15.29:0/3823711974 conn(0x7f7f8c070570 msgr2=0x7f7f8c0c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.303+0000 7f7f94400640 1 -- 172.21.15.29:0/3823711974 shutdown_connections 2024-01-24T13:05:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.303+0000 7f7f94400640 1 -- 172.21.15.29:0/3823711974 wait complete. 2024-01-24T13:05:11.328 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-24T13:05:11.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a4a00640 1 Processor -- start 2024-01-24T13:05:11.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a4a00640 1 -- start start 2024-01-24T13:05:11.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a4a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f169c0cd160 0x7f169c0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a4a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f169c15e0f0 0x7f169c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a4a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f169c15b8b0 0x7f169c0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a4a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c15e920 con 0x7f169c15b8b0 2024-01-24T13:05:11.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a4a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c15ec00 con 0x7f169c15e0f0 2024-01-24T13:05:11.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a4a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c15eee0 con 0x7f169c0cd160 2024-01-24T13:05:11.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a2a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f169c15b8b0 0x7f169c0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a2a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f169c15b8b0 0x7f169c0cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48920/0 (socket says 172.21.15.29:48920) 2024-01-24T13:05:11.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a2a00640 1 -- 172.21.15.29:0/430332097 learned_addr learned my addr 172.21.15.29:0/430332097 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:11.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a2000640 1 --2- 172.21.15.29:0/430332097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f169c0cd160 0x7f169c0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a1600640 1 --2- 172.21.15.29:0/430332097 >> v2:172.21.15.163:3300/0 conn(0x7f169c15e0f0 0x7f169c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a2a00640 1 -- 172.21.15.29:0/430332097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f169c0cd160 msgr2=0x7f169c0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a2a00640 1 --2- 172.21.15.29:0/430332097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f169c0cd160 0x7f169c0cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a2a00640 1 -- 172.21.15.29:0/430332097 >> v2:172.21.15.163:3300/0 conn(0x7f169c15e0f0 msgr2=0x7f169c15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a2a00640 1 --2- 172.21.15.29:0/430332097 >> v2:172.21.15.163:3300/0 conn(0x7f169c15e0f0 0x7f169c15b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.467+0000 7f16a2a00640 1 -- 172.21.15.29:0/430332097 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c15ae50 con 0x7f169c15b8b0 2024-01-24T13:05:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.471+0000 7f16a2a00640 1 --2- 172.21.15.29:0/430332097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f169c15b8b0 0x7f169c0cab00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f169c0d1530 tx=0x7f169401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f6486e944227bb server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.471+0000 7f16a0c00640 1 -- 172.21.15.29:0/430332097 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16940a5680 con 0x7f169c15b8b0 2024-01-24T13:05:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.471+0000 7f16a0c00640 1 -- 172.21.15.29:0/430332097 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16940a57e0 con 0x7f169c15b8b0 2024-01-24T13:05:11.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.471+0000 7f16a0c00640 1 -- 172.21.15.29:0/430332097 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16940a5b70 con 0x7f169c15b8b0 2024-01-24T13:05:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.471+0000 7f16a4a00640 1 -- 172.21.15.29:0/430332097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f169c15b8b0 msgr2=0x7f169c0cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.471+0000 7f16a4a00640 1 --2- 172.21.15.29:0/430332097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f169c15b8b0 0x7f169c0cab00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f169c0d1530 tx=0x7f169401c9d0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.471+0000 7f16a4a00640 1 -- 172.21.15.29:0/430332097 shutdown_connections 2024-01-24T13:05:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.471+0000 7f16a4a00640 1 --2- 172.21.15.29:0/430332097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f169c15b8b0 0x7f169c0cab00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.471+0000 7f16a4a00640 1 --2- 172.21.15.29:0/430332097 >> v2:172.21.15.163:3300/0 conn(0x7f169c15e0f0 0x7f169c15b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.471+0000 7f16a4a00640 1 --2- 172.21.15.29:0/430332097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f169c0cd160 0x7f169c0cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.471+0000 7f16a4a00640 1 -- 172.21.15.29:0/430332097 >> 172.21.15.29:0/430332097 conn(0x7f169c069cd0 msgr2=0x7f169c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.471+0000 7f16a4a00640 1 -- 172.21.15.29:0/430332097 shutdown_connections 2024-01-24T13:05:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.471+0000 7f16a4a00640 1 -- 172.21.15.29:0/430332097 wait complete. 2024-01-24T13:05:11.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a4a00640 1 Processor -- start 2024-01-24T13:05:11.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a4a00640 1 -- start start 2024-01-24T13:05:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a4a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f169c0cd160 0x7f169c154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a4a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f169c15e0f0 0x7f169c153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a4a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f169c0c9750 0x7f169c0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a4a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0ca120 con 0x7f169c15e0f0 2024-01-24T13:05:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a4a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c1579b0 con 0x7f169c0cd160 2024-01-24T13:05:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a4a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c1545c0 con 0x7f169c0c9750 2024-01-24T13:05:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a1600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f169c15e0f0 0x7f169c153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a1600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f169c15e0f0 0x7f169c153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48930/0 (socket says 172.21.15.29:48930) 2024-01-24T13:05:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a1600640 1 -- 172.21.15.29:0/2052368167 learned_addr learned my addr 172.21.15.29:0/2052368167 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a2000640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f169c0cd160 0x7f169c154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a2a00640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f169c0c9750 0x7f169c0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a1600640 1 -- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f169c0c9750 msgr2=0x7f169c0c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a1600640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f169c0c9750 0x7f169c0c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a1600640 1 -- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f169c0cd160 msgr2=0x7f169c154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a1600640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f169c0cd160 0x7f169c154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a1600640 1 -- 172.21.15.29:0/2052368167 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694009b30 con 0x7f169c15e0f0 2024-01-24T13:05:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a2a00640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f169c0c9750 0x7f169c0c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a2000640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f169c0cd160 0x7f169c154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a1600640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f169c15e0f0 0x7f169c153320 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f168400d5f0 tx=0x7f168400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f169a000640 1 -- 172.21.15.29:0/2052368167 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16840125f0 con 0x7f169c15e0f0 2024-01-24T13:05:11.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f169a000640 1 -- 172.21.15.29:0/2052368167 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1684012750 con 0x7f169c15e0f0 2024-01-24T13:05:11.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f169a000640 1 -- 172.21.15.29:0/2052368167 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684012ae0 con 0x7f169c15e0f0 2024-01-24T13:05:11.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a4a00640 1 -- 172.21.15.29:0/2052368167 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c0c54c0 con 0x7f169c15e0f0 2024-01-24T13:05:11.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.475+0000 7f16a4a00640 1 -- 172.21.15.29:0/2052368167 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c153c90 con 0x7f169c15e0f0 2024-01-24T13:05:11.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.479+0000 7f16a4a00640 1 -- 172.21.15.29:0/2052368167 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c04e850 con 0x7f169c15e0f0 2024-01-24T13:05:11.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.479+0000 7f169a000640 1 -- 172.21.15.29:0/2052368167 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1684012c40 con 0x7f169c15e0f0 2024-01-24T13:05:11.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.479+0000 7f169a000640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1674065a90 0x7f1674067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.479+0000 7f169a000640 1 -- 172.21.15.29:0/2052368167 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f1684083970 con 0x7f169c15e0f0 2024-01-24T13:05:11.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.479+0000 7f16a2000640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1674065a90 0x7f1674067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.479+0000 7f16a2000640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1674065a90 0x7f1674067f50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f169c1550f0 tx=0x7f168c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:11.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.483+0000 7f169a000640 1 -- 172.21.15.29:0/2052368167 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1684050ff0 con 0x7f169c15e0f0 2024-01-24T13:05:11.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.671+0000 7f16a4a00640 1 -- 172.21.15.29:0/2052368167 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f169c15d860 con 0x7f169c15e0f0 2024-01-24T13:05:11.676 INFO:tasks.ceph.mon.a.smithi029.stderr:2024-01-24T13:05:11.671+0000 7f8d5fe00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-24T13:05:11.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.683+0000 7f169a000640 1 -- 172.21.15.29:0/2052368167 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1684007380 con 0x7f169c15e0f0 2024-01-24T13:05:11.686 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-24T13:05:11.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.683+0000 7f16a4a00640 1 -- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1674065a90 msgr2=0x7f1674067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:11.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.683+0000 7f16a4a00640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1674065a90 0x7f1674067f50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f169c1550f0 tx=0x7f168c008040 comp rx=0 tx=0).stop 2024-01-24T13:05:11.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.683+0000 7f16a4a00640 1 -- 172.21.15.29:0/2052368167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f169c15e0f0 msgr2=0x7f169c153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:11.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.683+0000 7f16a4a00640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f169c15e0f0 0x7f169c153320 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f168400d5f0 tx=0x7f168400dab0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.683+0000 7f16a4a00640 1 -- 172.21.15.29:0/2052368167 shutdown_connections 2024-01-24T13:05:11.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.683+0000 7f16a4a00640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1674065a90 0x7f1674067f50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.683+0000 7f16a4a00640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f169c0c9750 0x7f169c0c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.683+0000 7f16a4a00640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f169c15e0f0 0x7f169c153320 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.683+0000 7f16a4a00640 1 --2- 172.21.15.29:0/2052368167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f169c0cd160 0x7f169c154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.683+0000 7f16a4a00640 1 -- 172.21.15.29:0/2052368167 >> 172.21.15.29:0/2052368167 conn(0x7f169c069cd0 msgr2=0x7f169c0b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:11.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.687+0000 7f16a4a00640 1 -- 172.21.15.29:0/2052368167 shutdown_connections 2024-01-24T13:05:11.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.687+0000 7f16a4a00640 1 -- 172.21.15.29:0/2052368167 wait complete. 2024-01-24T13:05:11.695 INFO:tasks.ceph.mds.b.smithi163.stderr: -4433> 2024-01-24T13:04:00.891+0000 7f5284800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-24T13:05:11.709 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-24T13:05:11.751 INFO:tasks.ceph.mds.b.smithi163.stdout:starting mds.b at 2024-01-24T13:05:11.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f610c200640 1 Processor -- start 2024-01-24T13:05:11.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f610c200640 1 -- start start 2024-01-24T13:05:11.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f610c200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f610415ca60 0x7f61040b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f610c200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f61040716c0 0x7f61040cde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f610c200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61040b2010 con 0x7f61040ce390 2024-01-24T13:05:11.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f610c200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61040ce840 con 0x7f610415ca60 2024-01-24T13:05:11.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f610c200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61040cdcb0 con 0x7f61040716c0 2024-01-24T13:05:11.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f6109800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f610415ca60 0x7f61040b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f6109800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f610415ca60 0x7f61040b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48938/0 (socket says 172.21.15.29:48938) 2024-01-24T13:05:11.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f6109800640 1 -- 172.21.15.29:0/1620034394 learned_addr learned my addr 172.21.15.29:0/1620034394 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:11.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f6108e00640 1 --2- 172.21.15.29:0/1620034394 >> v2:172.21.15.163:3300/0 conn(0x7f61040716c0 0x7f61040cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f6109800640 1 -- 172.21.15.29:0/1620034394 >> v2:172.21.15.163:3300/0 conn(0x7f61040716c0 msgr2=0x7f61040cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:11.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f6109800640 1 --2- 172.21.15.29:0/1620034394 >> v2:172.21.15.163:3300/0 conn(0x7f61040716c0 0x7f61040cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f6109800640 1 -- 172.21.15.29:0/1620034394 >> v1:172.21.15.163:6789/0 conn(0x7f61040ce390 legacy=0x7f610406fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:11.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.851+0000 7f6109800640 1 -- 172.21.15.29:0/1620034394 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61040b2480 con 0x7f610415ca60 2024-01-24T13:05:11.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.855+0000 7f6109800640 1 --2- 172.21.15.29:0/1620034394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610415ca60 0x7f61040b1ad0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f610415ce40 tx=0x7f60f401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b878e9db32c2cb1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:11.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.855+0000 7f6103e00640 1 -- 172.21.15.29:0/1620034394 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f40ab600 con 0x7f610415ca60 2024-01-24T13:05:11.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.855+0000 7f6103e00640 1 -- 172.21.15.29:0/1620034394 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f40a7050 con 0x7f610415ca60 2024-01-24T13:05:11.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.855+0000 7f6103e00640 1 -- 172.21.15.29:0/1620034394 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f40ab980 con 0x7f610415ca60 2024-01-24T13:05:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.855+0000 7f610c200640 1 -- 172.21.15.29:0/1620034394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610415ca60 msgr2=0x7f61040b1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.855+0000 7f610c200640 1 --2- 172.21.15.29:0/1620034394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610415ca60 0x7f61040b1ad0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f610415ce40 tx=0x7f60f401c490 comp rx=0 tx=0).stop 2024-01-24T13:05:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.855+0000 7f610c200640 1 -- 172.21.15.29:0/1620034394 shutdown_connections 2024-01-24T13:05:11.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.855+0000 7f610c200640 1 --2- 172.21.15.29:0/1620034394 >> v2:172.21.15.163:3300/0 conn(0x7f61040716c0 0x7f61040cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.855+0000 7f610c200640 1 --2- 172.21.15.29:0/1620034394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610415ca60 0x7f61040b1ad0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.855+0000 7f610c200640 1 -- 172.21.15.29:0/1620034394 >> 172.21.15.29:0/1620034394 conn(0x7f610406d790 msgr2=0x7f6104069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:11.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.855+0000 7f610c200640 1 -- 172.21.15.29:0/1620034394 shutdown_connections 2024-01-24T13:05:11.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.855+0000 7f610c200640 1 -- 172.21.15.29:0/1620034394 wait complete. 2024-01-24T13:05:11.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f610c200640 1 Processor -- start 2024-01-24T13:05:11.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f610c200640 1 -- start start 2024-01-24T13:05:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f610c200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61040716c0 0x7f61041470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f610c200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61040ce390 0x7f61041480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f610c200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f610415ca60 0x7f6104152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f610c200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61041475e0 con 0x7f61040ce390 2024-01-24T13:05:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f610c200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6104147dc0 con 0x7f61040716c0 2024-01-24T13:05:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f610c200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6104147800 con 0x7f610415ca60 2024-01-24T13:05:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f6108e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61040ce390 0x7f61041480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f6108e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61040ce390 0x7f61041480f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48942/0 (socket says 172.21.15.29:48942) 2024-01-24T13:05:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f6108e00640 1 -- 172.21.15.29:0/1480372548 learned_addr learned my addr 172.21.15.29:0/1480372548 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f610a200640 1 --2- 172.21.15.29:0/1480372548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f610415ca60 0x7f6104152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f6109800640 1 --2- 172.21.15.29:0/1480372548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61040716c0 0x7f61041470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f6108e00640 1 -- 172.21.15.29:0/1480372548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f610415ca60 msgr2=0x7f6104152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f6108e00640 1 --2- 172.21.15.29:0/1480372548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f610415ca60 0x7f6104152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f6108e00640 1 -- 172.21.15.29:0/1480372548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61040716c0 msgr2=0x7f61041470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f6108e00640 1 --2- 172.21.15.29:0/1480372548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61040716c0 0x7f61041470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f6108e00640 1 -- 172.21.15.29:0/1480372548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f40094d0 con 0x7f61040ce390 2024-01-24T13:05:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f6108e00640 1 --2- 172.21.15.29:0/1480372548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61040ce390 0x7f61041480f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00d7d0 tx=0x7f60ec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f6101600640 1 -- 172.21.15.29:0/1480372548 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec018070 con 0x7f61040ce390 2024-01-24T13:05:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f6101600640 1 -- 172.21.15.29:0/1480372548 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec004020 con 0x7f61040ce390 2024-01-24T13:05:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f6101600640 1 -- 172.21.15.29:0/1480372548 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0041d0 con 0x7f61040ce390 2024-01-24T13:05:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f610c200640 1 -- 172.21.15.29:0/1480372548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6104147ae0 con 0x7f61040ce390 2024-01-24T13:05:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.859+0000 7f610c200640 1 -- 172.21.15.29:0/1480372548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61040af760 con 0x7f61040ce390 2024-01-24T13:05:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.863+0000 7f610c200640 1 -- 172.21.15.29:0/1480372548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61040af8f0 con 0x7f61040ce390 2024-01-24T13:05:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.863+0000 7f6101600640 1 -- 172.21.15.29:0/1480372548 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f60ec004330 con 0x7f61040ce390 2024-01-24T13:05:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.863+0000 7f6101600640 1 --2- 172.21.15.29:0/1480372548 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f60dc065a90 0x7f60dc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.863+0000 7f6101600640 1 -- 172.21.15.29:0/1480372548 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6604+0+0 (secure 0 0 0) 0x7f60ec083260 con 0x7f61040ce390 2024-01-24T13:05:11.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.863+0000 7f6109800640 1 --2- 172.21.15.29:0/1480372548 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f60dc065a90 0x7f60dc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:11.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.863+0000 7f6109800640 1 --2- 172.21.15.29:0/1480372548 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f60dc065a90 0x7f60dc067f50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f60f40ad000 tx=0x7f60f40a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:11.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:11.867+0000 7f6101600640 1 -- 172.21.15.29:0/1480372548 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f60ec050940 con 0x7f61040ce390 2024-01-24T13:05:12.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.063+0000 7f610c200640 1 -- 172.21.15.29:0/1480372548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f610404e850 con 0x7f61040ce390 2024-01-24T13:05:12.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.739+0000 7f6101600640 1 -- 172.21.15.29:0/1480372548 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f60ec053f60 con 0x7f61040ce390 2024-01-24T13:05:12.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.739+0000 7f610c200640 1 -- 172.21.15.29:0/1480372548 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f60dc065a90 msgr2=0x7f60dc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:12.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.739+0000 7f610c200640 1 --2- 172.21.15.29:0/1480372548 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f60dc065a90 0x7f60dc067f50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f60f40ad000 tx=0x7f60f40a6000 comp rx=0 tx=0).stop 2024-01-24T13:05:12.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.739+0000 7f610c200640 1 -- 172.21.15.29:0/1480372548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61040ce390 msgr2=0x7f61041480f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:12.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.739+0000 7f610c200640 1 --2- 172.21.15.29:0/1480372548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61040ce390 0x7f61041480f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00d7d0 tx=0x7f60ec00dc90 comp rx=0 tx=0).stop 2024-01-24T13:05:12.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.739+0000 7f610c200640 1 -- 172.21.15.29:0/1480372548 shutdown_connections 2024-01-24T13:05:12.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.739+0000 7f610c200640 1 --2- 172.21.15.29:0/1480372548 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f60dc065a90 0x7f60dc067f50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:12.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.739+0000 7f610c200640 1 --2- 172.21.15.29:0/1480372548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f610415ca60 0x7f6104152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:12.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.739+0000 7f610c200640 1 --2- 172.21.15.29:0/1480372548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61040ce390 0x7f61041480f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:12.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.739+0000 7f610c200640 1 --2- 172.21.15.29:0/1480372548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61040716c0 0x7f61041470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:12.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.739+0000 7f610c200640 1 -- 172.21.15.29:0/1480372548 >> 172.21.15.29:0/1480372548 conn(0x7f610406d790 msgr2=0x7f61040add30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:12.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.739+0000 7f610c200640 1 -- 172.21.15.29:0/1480372548 shutdown_connections 2024-01-24T13:05:12.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.739+0000 7f610c200640 1 -- 172.21.15.29:0/1480372548 wait complete. 2024-01-24T13:05:12.768 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-24T13:05:12.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.915+0000 7ff738200640 1 Processor -- start 2024-01-24T13:05:12.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.915+0000 7ff738200640 1 -- start start 2024-01-24T13:05:12.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.915+0000 7ff738200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff7300b07d0 0x7ff73015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:12.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.915+0000 7ff738200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73015b6f0 con 0x7ff73015a340 2024-01-24T13:05:12.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.915+0000 7ff738200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73015b9d0 con 0x7ff7300c8a10 2024-01-24T13:05:12.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.915+0000 7ff738200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73015e100 con 0x7ff7300b07d0 2024-01-24T13:05:12.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.915+0000 7ff734e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff7300b07d0 0x7ff73015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:12.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.915+0000 7ff734e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff7300b07d0 0x7ff73015ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48950/0 (socket says 172.21.15.29:48950) 2024-01-24T13:05:12.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.915+0000 7ff734e00640 1 -- 172.21.15.29:0/2940596222 learned_addr learned my addr 172.21.15.29:0/2940596222 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:12.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.915+0000 7ff735800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff73015a340 0x7ff7300b00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51528/0 (socket says 172.21.15.29:51528) 2024-01-24T13:05:12.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.915+0000 7ff734e00640 1 -- 172.21.15.29:0/2940596222 >> v1:172.21.15.163:6789/0 conn(0x7ff7300c8a10 legacy=0x7ff7300c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:12.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.915+0000 7ff734e00640 1 -- 172.21.15.29:0/2940596222 >> v1:172.21.15.29:6789/0 conn(0x7ff73015a340 legacy=0x7ff7300b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:12.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.915+0000 7ff734e00640 1 -- 172.21.15.29:0/2940596222 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73015e3e0 con 0x7ff7300b07d0 2024-01-24T13:05:12.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.919+0000 7ff734e00640 1 --2- 172.21.15.29:0/2940596222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7300b07d0 0x7ff73015ebe0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff7180098a0 tx=0x7ff71801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58177939f9d319b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:12.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.919+0000 7ff72fe00640 1 -- 172.21.15.29:0/2940596222 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7180aa430 con 0x7ff7300b07d0 2024-01-24T13:05:12.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.919+0000 7ff72fe00640 1 -- 172.21.15.29:0/2940596222 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7180aa590 con 0x7ff7300b07d0 2024-01-24T13:05:12.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.919+0000 7ff72fe00640 1 -- 172.21.15.29:0/2940596222 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7180aa920 con 0x7ff7300b07d0 2024-01-24T13:05:12.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.919+0000 7ff738200640 1 -- 172.21.15.29:0/2940596222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7300b07d0 msgr2=0x7ff73015ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:12.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.919+0000 7ff738200640 1 --2- 172.21.15.29:0/2940596222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7300b07d0 0x7ff73015ebe0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff7180098a0 tx=0x7ff71801c4b0 comp rx=0 tx=0).stop 2024-01-24T13:05:12.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.919+0000 7ff738200640 1 -- 172.21.15.29:0/2940596222 shutdown_connections 2024-01-24T13:05:12.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.919+0000 7ff738200640 1 --2- 172.21.15.29:0/2940596222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7300b07d0 0x7ff73015ebe0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:12.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.919+0000 7ff738200640 1 -- 172.21.15.29:0/2940596222 >> 172.21.15.29:0/2940596222 conn(0x7ff73006a0d0 msgr2=0x7ff73006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:12.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.919+0000 7ff738200640 1 -- 172.21.15.29:0/2940596222 shutdown_connections 2024-01-24T13:05:12.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.919+0000 7ff738200640 1 -- 172.21.15.29:0/2940596222 wait complete. 2024-01-24T13:05:12.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff738200640 1 Processor -- start 2024-01-24T13:05:12.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff738200640 1 -- start start 2024-01-24T13:05:12.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff738200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7300b07d0 0x7ff73014c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:12.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff738200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7300c8a10 0x7ff7301542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:12.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff738200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff73015a340 0x7ff730154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:12.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff738200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7300c5280 con 0x7ff7300b07d0 2024-01-24T13:05:12.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff738200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7300c57b0 con 0x7ff7300c8a10 2024-01-24T13:05:12.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff738200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7300c8170 con 0x7ff73015a340 2024-01-24T13:05:12.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff735800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7300b07d0 0x7ff73014c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:12.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff735800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7300b07d0 0x7ff73014c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48954/0 (socket says 172.21.15.29:48954) 2024-01-24T13:05:12.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff735800640 1 -- 172.21.15.29:0/3131350952 learned_addr learned my addr 172.21.15.29:0/3131350952 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:12.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff736200640 1 --2- 172.21.15.29:0/3131350952 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff73015a340 0x7ff730154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:12.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff734e00640 1 --2- 172.21.15.29:0/3131350952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7300c8a10 0x7ff7301542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:12.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff735800640 1 -- 172.21.15.29:0/3131350952 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff73015a340 msgr2=0x7ff730154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:12.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff735800640 1 --2- 172.21.15.29:0/3131350952 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff73015a340 0x7ff730154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:12.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff735800640 1 -- 172.21.15.29:0/3131350952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7300c8a10 msgr2=0x7ff7301542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:12.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff735800640 1 --2- 172.21.15.29:0/3131350952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7300c8a10 0x7ff7301542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:12.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff735800640 1 -- 172.21.15.29:0/3131350952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7180094d0 con 0x7ff7300b07d0 2024-01-24T13:05:12.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff735800640 1 --2- 172.21.15.29:0/3131350952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7300b07d0 0x7ff73014c360 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff72000c490 tx=0x7ff72000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:12.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff72d600640 1 -- 172.21.15.29:0/3131350952 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720007480 con 0x7ff7300b07d0 2024-01-24T13:05:12.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff72d600640 1 -- 172.21.15.29:0/3131350952 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7200075e0 con 0x7ff7300b07d0 2024-01-24T13:05:12.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff738200640 1 -- 172.21.15.29:0/3131350952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7300c54d0 con 0x7ff7300b07d0 2024-01-24T13:05:12.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff72d600640 1 -- 172.21.15.29:0/3131350952 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720004a10 con 0x7ff7300b07d0 2024-01-24T13:05:12.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff738200640 1 -- 172.21.15.29:0/3131350952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73014c8a0 con 0x7ff7300b07d0 2024-01-24T13:05:12.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.923+0000 7ff738200640 1 -- 172.21.15.29:0/3131350952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff730071f70 con 0x7ff7300b07d0 2024-01-24T13:05:12.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.927+0000 7ff72d600640 1 -- 172.21.15.29:0/3131350952 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff720004b70 con 0x7ff7300b07d0 2024-01-24T13:05:12.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.927+0000 7ff72d600640 1 --2- 172.21.15.29:0/3131350952 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff708065a60 0x7ff708067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:12.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.927+0000 7ff72d600640 1 -- 172.21.15.29:0/3131350952 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6604+0+0 (secure 0 0 0) 0x7ff720082820 con 0x7ff7300b07d0 2024-01-24T13:05:12.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.927+0000 7ff734e00640 1 --2- 172.21.15.29:0/3131350952 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff708065a60 0x7ff708067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:12.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.927+0000 7ff734e00640 1 --2- 172.21.15.29:0/3131350952 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff708065a60 0x7ff708067f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff7180ae000 tx=0x7ff7180a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:12.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:12.931+0000 7ff72d600640 1 -- 172.21.15.29:0/3131350952 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff72004ff10 con 0x7ff7300b07d0 2024-01-24T13:05:13.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.087+0000 7ff738200640 1 -- 172.21.15.29:0/3131350952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff73004e000 con 0x7ff7300b07d0 2024-01-24T13:05:13.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.747+0000 7ff72d600640 1 -- 172.21.15.29:0/3131350952 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff720053530 con 0x7ff7300b07d0 2024-01-24T13:05:13.750 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2024-01-24T13:05:13.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.751+0000 7ff738200640 1 -- 172.21.15.29:0/3131350952 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff708065a60 msgr2=0x7ff708067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:13.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.751+0000 7ff738200640 1 --2- 172.21.15.29:0/3131350952 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff708065a60 0x7ff708067f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff7180ae000 tx=0x7ff7180a7000 comp rx=0 tx=0).stop 2024-01-24T13:05:13.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.751+0000 7ff738200640 1 -- 172.21.15.29:0/3131350952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7300b07d0 msgr2=0x7ff73014c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:13.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.751+0000 7ff738200640 1 --2- 172.21.15.29:0/3131350952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7300b07d0 0x7ff73014c360 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff72000c490 tx=0x7ff72000c950 comp rx=0 tx=0).stop 2024-01-24T13:05:13.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.751+0000 7ff738200640 1 -- 172.21.15.29:0/3131350952 shutdown_connections 2024-01-24T13:05:13.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.751+0000 7ff738200640 1 --2- 172.21.15.29:0/3131350952 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff708065a60 0x7ff708067f20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:13.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.751+0000 7ff738200640 1 --2- 172.21.15.29:0/3131350952 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff73015a340 0x7ff730154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:13.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.751+0000 7ff738200640 1 --2- 172.21.15.29:0/3131350952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7300c8a10 0x7ff7301542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:13.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.751+0000 7ff738200640 1 --2- 172.21.15.29:0/3131350952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7300b07d0 0x7ff73014c360 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:13.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.751+0000 7ff738200640 1 -- 172.21.15.29:0/3131350952 >> 172.21.15.29:0/3131350952 conn(0x7ff73006a0d0 msgr2=0x7ff7300c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:13.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.751+0000 7ff738200640 1 -- 172.21.15.29:0/3131350952 shutdown_connections 2024-01-24T13:05:13.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.751+0000 7ff738200640 1 -- 172.21.15.29:0/3131350952 wait complete. 2024-01-24T13:05:13.780 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-24T13:05:13.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.923+0000 7f2f11c00640 1 Processor -- start 2024-01-24T13:05:13.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.923+0000 7f2f11c00640 1 -- start start 2024-01-24T13:05:13.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.923+0000 7f2f11c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f0c15d4c0 0x7f2f0c0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:13.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f11c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c15d970 con 0x7f2f0c0cd500 2024-01-24T13:05:13.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f11c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c15dc50 con 0x7f2f0c0cd120 2024-01-24T13:05:13.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f11c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0d0530 con 0x7f2f0c15d4c0 2024-01-24T13:05:13.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f0a000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2f0c0cd500 0x7f2f0c15cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51530/0 (socket says 172.21.15.29:51530) 2024-01-24T13:05:13.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f0a000640 1 -- 172.21.15.29:0/1258083138 learned_addr learned my addr 172.21.15.29:0/1258083138 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:13.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f0b400640 1 --2- 172.21.15.29:0/1258083138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f0c15d4c0 0x7f2f0c0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:13.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 -- 172.21.15.29:0/1258083138 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649451454 0 0) 0x7f2f0c15d970 con 0x7f2f0c0cd500 2024-01-24T13:05:13.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 -- 172.21.15.29:0/1258083138 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eec003530 con 0x7f2f0c0cd500 2024-01-24T13:05:13.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 -- 172.21.15.29:0/1258083138 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1002216213 0 0) 0x7f2eec003530 con 0x7f2f0c0cd500 2024-01-24T13:05:13.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 -- 172.21.15.29:0/1258083138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f0c15d4c0 msgr2=0x7f2f0c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:13.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 --2- 172.21.15.29:0/1258083138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f0c15d4c0 0x7f2f0c0ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:13.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 -- 172.21.15.29:0/1258083138 >> v1:172.21.15.163:6789/0 conn(0x7f2f0c0cd120 legacy=0x7f2f0c0d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:13.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 -- 172.21.15.29:0/1258083138 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c0d0810 con 0x7f2f0c0cd500 2024-01-24T13:05:13.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 -- 172.21.15.29:0/1258083138 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f2ef4001680 con 0x7f2f0c0cd500 2024-01-24T13:05:13.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 -- 172.21.15.29:0/1258083138 >> v1:172.21.15.29:6789/0 conn(0x7f2f0c0cd500 legacy=0x7f2f0c15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:13.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 --2- 172.21.15.29:0/1258083138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2eec003a20 0x7f2eec003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:13.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 --2- 172.21.15.29:0/1258083138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2eec0047d0 0x7f2eec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:13.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 --2- 172.21.15.29:0/1258083138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f0c15d4c0 0x7f2eec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:13.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 -- 172.21.15.29:0/1258083138 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0d0530 con 0x7f2eec0047d0 2024-01-24T13:05:13.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 -- 172.21.15.29:0/1258083138 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec00ba40 con 0x7f2eec003a20 2024-01-24T13:05:13.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f09600640 1 -- 172.21.15.29:0/1258083138 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec00bbd0 con 0x7f2f0c15d4c0 2024-01-24T13:05:13.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f0a000640 1 --2- 172.21.15.29:0/1258083138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2eec0047d0 0x7f2eec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:13.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f0aa00640 1 --2- 172.21.15.29:0/1258083138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2eec003a20 0x7f2eec003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:13.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f0b400640 1 --2- 172.21.15.29:0/1258083138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f0c15d4c0 0x7f2eec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:13.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f0a000640 1 -- 172.21.15.29:0/1258083138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f0c15d4c0 msgr2=0x7f2eec005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:13.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f0a000640 1 --2- 172.21.15.29:0/1258083138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f0c15d4c0 0x7f2eec005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:13.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f0a000640 1 -- 172.21.15.29:0/1258083138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2eec003a20 msgr2=0x7f2eec003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:13.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f0a000640 1 --2- 172.21.15.29:0/1258083138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2eec003a20 0x7f2eec003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:13.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.927+0000 7f2f0a000640 1 -- 172.21.15.29:0/1258083138 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec003530 con 0x7f2eec0047d0 2024-01-24T13:05:13.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.931+0000 7f2f0a000640 1 --2- 172.21.15.29:0/1258083138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2eec0047d0 0x7f2eec004c50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400c210 tx=0x7f2ef401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ded471e32287b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:13.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.931+0000 7f2f09600640 1 -- 172.21.15.29:0/1258083138 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4005ae0 con 0x7f2eec0047d0 2024-01-24T13:05:13.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.931+0000 7f2f09600640 1 -- 172.21.15.29:0/1258083138 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef4005c60 con 0x7f2eec0047d0 2024-01-24T13:05:13.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.931+0000 7f2f09600640 1 -- 172.21.15.29:0/1258083138 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40a58e0 con 0x7f2eec0047d0 2024-01-24T13:05:13.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.931+0000 7f2f11c00640 1 -- 172.21.15.29:0/1258083138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2eec0047d0 msgr2=0x7f2eec004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:13.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.931+0000 7f2f11c00640 1 --2- 172.21.15.29:0/1258083138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2eec0047d0 0x7f2eec004c50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400c210 tx=0x7f2ef401cbe0 comp rx=0 tx=0).stop 2024-01-24T13:05:13.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.931+0000 7f2f0b400640 1 -- 172.21.15.29:0/1258083138 reap_dead start 2024-01-24T13:05:13.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.931+0000 7f2f11c00640 1 -- 172.21.15.29:0/1258083138 shutdown_connections 2024-01-24T13:05:13.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.931+0000 7f2f11c00640 1 -- 172.21.15.29:0/1258083138 >> 172.21.15.29:0/1258083138 conn(0x7f2f0c069cd0 msgr2=0x7f2f0c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:13.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.931+0000 7f2f11c00640 1 -- 172.21.15.29:0/1258083138 shutdown_connections 2024-01-24T13:05:13.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.931+0000 7f2f11c00640 1 -- 172.21.15.29:0/1258083138 wait complete. 2024-01-24T13:05:13.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f11c00640 1 Processor -- start 2024-01-24T13:05:13.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f11c00640 1 -- start start 2024-01-24T13:05:13.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f11c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2eec0047d0 0x7f2f0c0c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:13.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f11c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f0c0c6e90 0x7f2f0c0c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:13.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f11c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f0c0c54f0 0x7f2f0c160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:13.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f11c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0c3710 con 0x7f2f0c0c54f0 2024-01-24T13:05:13.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f11c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0c5df0 con 0x7f2eec0047d0 2024-01-24T13:05:13.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f11c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0c60d0 con 0x7f2f0c0c6e90 2024-01-24T13:05:13.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f0b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f0c0c54f0 0x7f2f0c160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:13.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f0aa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2eec0047d0 0x7f2f0c0c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:13.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f0b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f0c0c54f0 0x7f2f0c160180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48968/0 (socket says 172.21.15.29:48968) 2024-01-24T13:05:13.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f0b400640 1 -- 172.21.15.29:0/602530728 learned_addr learned my addr 172.21.15.29:0/602530728 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:13.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f0a000640 1 --2- 172.21.15.29:0/602530728 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f0c0c6e90 0x7f2f0c0c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:13.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f0b400640 1 -- 172.21.15.29:0/602530728 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f0c0c6e90 msgr2=0x7f2f0c0c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:13.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f0b400640 1 --2- 172.21.15.29:0/602530728 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f0c0c6e90 0x7f2f0c0c31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:13.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f0b400640 1 -- 172.21.15.29:0/602530728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2eec0047d0 msgr2=0x7f2f0c0c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:13.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f0b400640 1 --2- 172.21.15.29:0/602530728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2eec0047d0 0x7f2f0c0c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:13.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f0b400640 1 -- 172.21.15.29:0/602530728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c0c63b0 con 0x7f2f0c0c54f0 2024-01-24T13:05:13.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f0b400640 1 --2- 172.21.15.29:0/602530728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f0c0c54f0 0x7f2f0c160180 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c15a960 tx=0x7f2f040115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:13.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f02a00640 1 -- 172.21.15.29:0/602530728 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0400e070 con 0x7f2f0c0c54f0 2024-01-24T13:05:13.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f02a00640 1 -- 172.21.15.29:0/602530728 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f04011ed0 con 0x7f2f0c0c54f0 2024-01-24T13:05:13.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f11c00640 1 -- 172.21.15.29:0/602530728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c0c6690 con 0x7f2f0c0c54f0 2024-01-24T13:05:13.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f02a00640 1 -- 172.21.15.29:0/602530728 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f040039f0 con 0x7f2f0c0c54f0 2024-01-24T13:05:13.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f11c00640 1 -- 172.21.15.29:0/602530728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c0c5980 con 0x7f2f0c0c54f0 2024-01-24T13:05:13.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.935+0000 7f2f11c00640 1 -- 172.21.15.29:0/602530728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c0c5b70 con 0x7f2f0c0c54f0 2024-01-24T13:05:13.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.939+0000 7f2f02a00640 1 -- 172.21.15.29:0/602530728 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2f04003b70 con 0x7f2f0c0c54f0 2024-01-24T13:05:13.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.939+0000 7f2f02a00640 1 --2- 172.21.15.29:0/602530728 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2ee4065a90 0x7f2ee4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:13.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.939+0000 7f2f02a00640 1 -- 172.21.15.29:0/602530728 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6166+0+0 (secure 0 0 0) 0x7f2f04083ad0 con 0x7f2f0c0c54f0 2024-01-24T13:05:13.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.939+0000 7f2f0aa00640 1 --2- 172.21.15.29:0/602530728 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2ee4065a90 0x7f2ee4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:13.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.939+0000 7f2f0aa00640 1 --2- 172.21.15.29:0/602530728 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2ee4065a90 0x7f2ee4067f50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2efc007fd0 tx=0x7f2efc0013f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:13.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:13.943+0000 7f2f02a00640 1 -- 172.21.15.29:0/602530728 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2f04054d60 con 0x7f2f0c0c54f0 2024-01-24T13:05:14.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.099+0000 7f2f11c00640 1 -- 172.21.15.29:0/602530728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2f0c04e000 con 0x7f2f0c0c54f0 2024-01-24T13:05:14.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.755+0000 7f2f02a00640 1 -- 172.21.15.29:0/602530728 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2f040548f0 con 0x7f2f0c0c54f0 2024-01-24T13:05:14.761 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2024-01-24T13:05:14.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.759+0000 7f2f11c00640 1 -- 172.21.15.29:0/602530728 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2ee4065a90 msgr2=0x7f2ee4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:14.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.759+0000 7f2f11c00640 1 --2- 172.21.15.29:0/602530728 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2ee4065a90 0x7f2ee4067f50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2efc007fd0 tx=0x7f2efc0013f0 comp rx=0 tx=0).stop 2024-01-24T13:05:14.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.759+0000 7f2f11c00640 1 -- 172.21.15.29:0/602530728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f0c0c54f0 msgr2=0x7f2f0c160180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:14.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.759+0000 7f2f11c00640 1 --2- 172.21.15.29:0/602530728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f0c0c54f0 0x7f2f0c160180 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c15a960 tx=0x7f2f040115a0 comp rx=0 tx=0).stop 2024-01-24T13:05:14.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.759+0000 7f2f11c00640 1 -- 172.21.15.29:0/602530728 shutdown_connections 2024-01-24T13:05:14.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.759+0000 7f2f11c00640 1 --2- 172.21.15.29:0/602530728 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2ee4065a90 0x7f2ee4067f50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:14.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.759+0000 7f2f11c00640 1 --2- 172.21.15.29:0/602530728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f0c0c54f0 0x7f2f0c160180 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:14.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.759+0000 7f2f11c00640 1 --2- 172.21.15.29:0/602530728 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f0c0c6e90 0x7f2f0c0c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:14.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.759+0000 7f2f11c00640 1 --2- 172.21.15.29:0/602530728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2eec0047d0 0x7f2f0c0c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:14.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.759+0000 7f2f11c00640 1 -- 172.21.15.29:0/602530728 >> 172.21.15.29:0/602530728 conn(0x7f2f0c069cd0 msgr2=0x7f2f0c15adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.759+0000 7f2f11c00640 1 -- 172.21.15.29:0/602530728 shutdown_connections 2024-01-24T13:05:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.759+0000 7f2f11c00640 1 -- 172.21.15.29:0/602530728 wait complete. 2024-01-24T13:05:14.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-01-24T13:05:14.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.935+0000 7efc31600640 1 Processor -- start 2024-01-24T13:05:14.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.935+0000 7efc31600640 1 -- start start 2024-01-24T13:05:14.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc31600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc2c15a340 0x7efc2c15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:14.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc31600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efc2c0b00c0 0x7efc2c0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:14.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc31600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7efc2c0c8a10 0x7efc2c0c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:14.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc31600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0b0a60 con 0x7efc2c0b00c0 2024-01-24T13:05:14.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc31600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c15b6f0 con 0x7efc2c0c8a10 2024-01-24T13:05:14.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc31600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c15b9d0 con 0x7efc2c15a340 2024-01-24T13:05:14.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc2a000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efc2c0b00c0 0x7efc2c0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:14.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc2a000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efc2c0b00c0 0x7efc2c0b0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48980/0 (socket says 172.21.15.29:48980) 2024-01-24T13:05:14.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc2a000640 1 -- 172.21.15.29:0/2974818027 learned_addr learned my addr 172.21.15.29:0/2974818027 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:14.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc2b400640 1 --2- 172.21.15.29:0/2974818027 >> v2:172.21.15.163:3300/0 conn(0x7efc2c0c8a10 0x7efc2c0c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:14.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc2aa00640 1 --2- 172.21.15.29:0/2974818027 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc2c15a340 0x7efc2c15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:14.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc2a000640 1 -- 172.21.15.29:0/2974818027 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc2c15a340 msgr2=0x7efc2c15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:14.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc2a000640 1 --2- 172.21.15.29:0/2974818027 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc2c15a340 0x7efc2c15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:14.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc2a000640 1 -- 172.21.15.29:0/2974818027 >> v2:172.21.15.163:3300/0 conn(0x7efc2c0c8a10 msgr2=0x7efc2c0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:14.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc2a000640 1 --2- 172.21.15.29:0/2974818027 >> v2:172.21.15.163:3300/0 conn(0x7efc2c0c8a10 0x7efc2c0c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:14.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.939+0000 7efc2a000640 1 -- 172.21.15.29:0/2974818027 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c15e100 con 0x7efc2c0b00c0 2024-01-24T13:05:14.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc2a000640 1 --2- 172.21.15.29:0/2974818027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c0b00c0 0x7efc2c0b0520 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efc2c071950 tx=0x7efc1401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9711afdfb85996c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:14.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc29600640 1 -- 172.21.15.29:0/2974818027 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc140aa5f0 con 0x7efc2c0b00c0 2024-01-24T13:05:14.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc29600640 1 -- 172.21.15.29:0/2974818027 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc140aa750 con 0x7efc2c0b00c0 2024-01-24T13:05:14.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc29600640 1 -- 172.21.15.29:0/2974818027 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc140aaae0 con 0x7efc2c0b00c0 2024-01-24T13:05:14.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc31600640 1 -- 172.21.15.29:0/2974818027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c0b00c0 msgr2=0x7efc2c0b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:14.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc31600640 1 --2- 172.21.15.29:0/2974818027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c0b00c0 0x7efc2c0b0520 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efc2c071950 tx=0x7efc1401c4d0 comp rx=0 tx=0).stop 2024-01-24T13:05:14.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc31600640 1 -- 172.21.15.29:0/2974818027 shutdown_connections 2024-01-24T13:05:14.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc31600640 1 --2- 172.21.15.29:0/2974818027 >> v2:172.21.15.163:3300/0 conn(0x7efc2c0c8a10 0x7efc2c0c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:14.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc31600640 1 --2- 172.21.15.29:0/2974818027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c0b00c0 0x7efc2c0b0520 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:14.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc31600640 1 --2- 172.21.15.29:0/2974818027 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc2c15a340 0x7efc2c15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:14.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc31600640 1 -- 172.21.15.29:0/2974818027 >> 172.21.15.29:0/2974818027 conn(0x7efc2c06a0d0 msgr2=0x7efc2c06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:14.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc31600640 1 -- 172.21.15.29:0/2974818027 shutdown_connections 2024-01-24T13:05:14.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc31600640 1 -- 172.21.15.29:0/2974818027 wait complete. 2024-01-24T13:05:14.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc31600640 1 Processor -- start 2024-01-24T13:05:14.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.943+0000 7efc31600640 1 -- start start 2024-01-24T13:05:14.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc31600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c0b00c0 0x7efc2c0b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:14.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc31600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc2c0c8a10 0x7efc2c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:14.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc31600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc2c15a340 0x7efc2c14eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:14.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc31600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0b3cd0 con 0x7efc2c0b00c0 2024-01-24T13:05:14.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc31600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c1503c0 con 0x7efc2c0c8a10 2024-01-24T13:05:14.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc31600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0b20f0 con 0x7efc2c15a340 2024-01-24T13:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc2aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c0b00c0 0x7efc2c0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc2aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c0b00c0 0x7efc2c0b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48988/0 (socket says 172.21.15.29:48988) 2024-01-24T13:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc2aa00640 1 -- 172.21.15.29:0/396110970 learned_addr learned my addr 172.21.15.29:0/396110970 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc2b400640 1 --2- 172.21.15.29:0/396110970 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc2c15a340 0x7efc2c14eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc2a000640 1 --2- 172.21.15.29:0/396110970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc2c0c8a10 0x7efc2c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc2aa00640 1 -- 172.21.15.29:0/396110970 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc2c15a340 msgr2=0x7efc2c14eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:14.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc2aa00640 1 --2- 172.21.15.29:0/396110970 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc2c15a340 0x7efc2c14eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:14.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc2aa00640 1 -- 172.21.15.29:0/396110970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc2c0c8a10 msgr2=0x7efc2c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:14.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc2aa00640 1 --2- 172.21.15.29:0/396110970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc2c0c8a10 0x7efc2c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:14.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc2aa00640 1 -- 172.21.15.29:0/396110970 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc140094d0 con 0x7efc2c0b00c0 2024-01-24T13:05:14.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc2aa00640 1 --2- 172.21.15.29:0/396110970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c0b00c0 0x7efc2c0b3790 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00d5f0 tx=0x7efc1c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:14.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc22a00640 1 -- 172.21.15.29:0/396110970 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c0125f0 con 0x7efc2c0b00c0 2024-01-24T13:05:14.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc22a00640 1 -- 172.21.15.29:0/396110970 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c012750 con 0x7efc2c0b00c0 2024-01-24T13:05:14.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc31600640 1 -- 172.21.15.29:0/396110970 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c150610 con 0x7efc2c0b00c0 2024-01-24T13:05:14.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc22a00640 1 -- 172.21.15.29:0/396110970 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c012ae0 con 0x7efc2c0b00c0 2024-01-24T13:05:14.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc31600640 1 -- 172.21.15.29:0/396110970 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c150bd0 con 0x7efc2c0b00c0 2024-01-24T13:05:14.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.947+0000 7efc31600640 1 -- 172.21.15.29:0/396110970 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c071f70 con 0x7efc2c0b00c0 2024-01-24T13:05:14.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.951+0000 7efc22a00640 1 -- 172.21.15.29:0/396110970 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efc1c012c40 con 0x7efc2c0b00c0 2024-01-24T13:05:14.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.951+0000 7efc22a00640 1 --2- 172.21.15.29:0/396110970 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7efc04065a60 0x7efc04067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.951+0000 7efc22a00640 1 -- 172.21.15.29:0/396110970 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5723+0+0 (secure 0 0 0) 0x7efc1c083560 con 0x7efc2c0b00c0 2024-01-24T13:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.951+0000 7efc2a000640 1 --2- 172.21.15.29:0/396110970 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7efc04065a60 0x7efc04067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.951+0000 7efc2a000640 1 --2- 172.21.15.29:0/396110970 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7efc04065a60 0x7efc04067f20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efc140ae000 tx=0x7efc140b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:14.955+0000 7efc22a00640 1 -- 172.21.15.29:0/396110970 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7efc1c050fc0 con 0x7efc2c0b00c0 2024-01-24T13:05:15.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:15.111+0000 7efc31600640 1 -- 172.21.15.29:0/396110970 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efc2c04e000 con 0x7efc2c0b00c0 2024-01-24T13:05:15.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:15.763+0000 7efc22a00640 1 -- 172.21.15.29:0/396110970 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v34) v1 ==== 178+0+0 (secure 0 0 0) 0x7efc1c0545e0 con 0x7efc2c0b00c0 2024-01-24T13:05:15.768 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data_ec' removed 2024-01-24T13:05:15.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:15.767+0000 7efc31600640 1 -- 172.21.15.29:0/396110970 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7efc04065a60 msgr2=0x7efc04067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:15.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:15.767+0000 7efc31600640 1 --2- 172.21.15.29:0/396110970 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7efc04065a60 0x7efc04067f20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efc140ae000 tx=0x7efc140b5040 comp rx=0 tx=0).stop 2024-01-24T13:05:15.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:15.767+0000 7efc31600640 1 -- 172.21.15.29:0/396110970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c0b00c0 msgr2=0x7efc2c0b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:15.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:15.767+0000 7efc31600640 1 --2- 172.21.15.29:0/396110970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c0b00c0 0x7efc2c0b3790 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00d5f0 tx=0x7efc1c00dab0 comp rx=0 tx=0).stop 2024-01-24T13:05:15.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:15.767+0000 7efc31600640 1 -- 172.21.15.29:0/396110970 shutdown_connections 2024-01-24T13:05:15.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:15.767+0000 7efc31600640 1 --2- 172.21.15.29:0/396110970 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7efc04065a60 0x7efc04067f20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:15.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:15.767+0000 7efc31600640 1 --2- 172.21.15.29:0/396110970 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc2c15a340 0x7efc2c14eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:15.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:15.767+0000 7efc31600640 1 --2- 172.21.15.29:0/396110970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc2c0c8a10 0x7efc2c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:15.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:15.767+0000 7efc31600640 1 --2- 172.21.15.29:0/396110970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c0b00c0 0x7efc2c0b3790 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:15.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:15.767+0000 7efc31600640 1 -- 172.21.15.29:0/396110970 >> 172.21.15.29:0/396110970 conn(0x7efc2c06a0d0 msgr2=0x7efc2c0af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:15.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:15.767+0000 7efc31600640 1 -- 172.21.15.29:0/396110970 shutdown_connections 2024-01-24T13:05:15.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:15.767+0000 7efc31600640 1 -- 172.21.15.29:0/396110970 wait complete. 2024-01-24T13:05:15.794 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-24T13:05:15.794 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-24T13:05:15.794 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-24T13:05:15.794 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:05:15.795 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-24T13:05:15.795 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-24T13:05:15.795 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-24T13:05:15.795 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:05:15.795 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-24T13:05:15.795 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-24T13:05:15.796 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-24T13:05:15.796 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:05:15.796 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-24T13:05:15.796 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-24T13:05:15.796 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-24T13:05:15.796 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:05:15.809 INFO:tasks.ceph.mds.c:Stopped 2024-01-24T13:05:15.809 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-24T13:05:15.810 INFO:tasks.ceph.mds.a:Stopped 2024-01-24T13:05:15.810 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-24T13:05:15.811 INFO:tasks.ceph.mds.d:Stopped 2024-01-24T13:05:15.811 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-24T13:05:15.812 INFO:tasks.ceph.mds.b:Stopped 2024-01-24T13:05:15.812 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-24T13:05:15.859 INFO:tasks.ceph.mds.c:Started 2024-01-24T13:05:15.859 DEBUG:teuthology.parallel:result is None 2024-01-24T13:05:15.860 INFO:tasks.ceph.mds.d:Started 2024-01-24T13:05:15.861 DEBUG:teuthology.parallel:result is None 2024-01-24T13:05:15.861 INFO:tasks.ceph.mds.a:Started 2024-01-24T13:05:15.861 DEBUG:teuthology.parallel:result is None 2024-01-24T13:05:15.862 INFO:tasks.ceph.mds.b:Started 2024-01-24T13:05:15.862 DEBUG:teuthology.parallel:result is None 2024-01-24T13:05:15.862 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-24T13:05:15.947 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-01-24T13:05:15.948 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2024-01-24T13:05:15.950 INFO:tasks.ceph.mds.b.smithi163.stdout:starting mds.b at 2024-01-24T13:05:15.950 INFO:tasks.ceph.mds.d.smithi163.stdout:starting mds.d at 2024-01-24T13:05:16.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa422e00640 1 Processor -- start 2024-01-24T13:05:16.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa422e00640 1 -- start start 2024-01-24T13:05:16.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa422e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa41c0d0150 0x7fa41c0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:16.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa422e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41c0ce5c0 0x7fa41c06b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:16.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa422e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41c0d05e0 con 0x7fa41c0cd460 2024-01-24T13:05:16.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa422e00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41c0ce9e0 con 0x7fa41c0d0150 2024-01-24T13:05:16.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa422e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0d0830 con 0x7fa41c0ce5c0 2024-01-24T13:05:16.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa41b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa41c0d0150 0x7fa41c0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:16.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa41b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa41c0d0150 0x7fa41c0ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49036/0 (socket says 172.21.15.29:49036) 2024-01-24T13:05:16.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa41b400640 1 -- 172.21.15.29:0/1814183003 learned_addr learned my addr 172.21.15.29:0/1814183003 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:16.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa420e00640 1 --2- 172.21.15.29:0/1814183003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41c0ce5c0 0x7fa41c06b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:16.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa41b400640 1 -- 172.21.15.29:0/1814183003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41c0ce5c0 msgr2=0x7fa41c06b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:16.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa41b400640 1 --2- 172.21.15.29:0/1814183003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41c0ce5c0 0x7fa41c06b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:16.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa41b400640 1 -- 172.21.15.29:0/1814183003 >> v1:172.21.15.163:6789/0 conn(0x7fa41c0cd460 legacy=0x7fa41c15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:16.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.019+0000 7fa41b400640 1 -- 172.21.15.29:0/1814183003 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c0d0b10 con 0x7fa41c0d0150 2024-01-24T13:05:16.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.023+0000 7fa41b400640 1 --2- 172.21.15.29:0/1814183003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41c0d0150 0x7fa41c0ce080 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa404009870 tx=0x7fa40401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cabf9eeaad2fd3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:16.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.023+0000 7fa41aa00640 1 -- 172.21.15.29:0/1814183003 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040ab680 con 0x7fa41c0d0150 2024-01-24T13:05:16.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.023+0000 7fa41aa00640 1 -- 172.21.15.29:0/1814183003 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4040ab7e0 con 0x7fa41c0d0150 2024-01-24T13:05:16.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.023+0000 7fa41aa00640 1 -- 172.21.15.29:0/1814183003 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040abb70 con 0x7fa41c0d0150 2024-01-24T13:05:16.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.023+0000 7fa422e00640 1 -- 172.21.15.29:0/1814183003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41c0d0150 msgr2=0x7fa41c0ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:16.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.023+0000 7fa422e00640 1 --2- 172.21.15.29:0/1814183003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41c0d0150 0x7fa41c0ce080 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa404009870 tx=0x7fa40401c480 comp rx=0 tx=0).stop 2024-01-24T13:05:16.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.023+0000 7fa422e00640 1 -- 172.21.15.29:0/1814183003 shutdown_connections 2024-01-24T13:05:16.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.023+0000 7fa422e00640 1 --2- 172.21.15.29:0/1814183003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41c0ce5c0 0x7fa41c06b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:16.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.023+0000 7fa422e00640 1 --2- 172.21.15.29:0/1814183003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41c0d0150 0x7fa41c0ce080 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:16.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.023+0000 7fa422e00640 1 -- 172.21.15.29:0/1814183003 >> 172.21.15.29:0/1814183003 conn(0x7fa41c069cd0 msgr2=0x7fa41c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:16.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.023+0000 7fa422e00640 1 -- 172.21.15.29:0/1814183003 shutdown_connections 2024-01-24T13:05:16.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.023+0000 7fa422e00640 1 -- 172.21.15.29:0/1814183003 wait complete. 2024-01-24T13:05:16.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa422e00640 1 Processor -- start 2024-01-24T13:05:16.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa422e00640 1 -- start start 2024-01-24T13:05:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa422e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41c0cd460 0x7fa41c145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa422e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41c0ce5c0 0x7fa41c146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa422e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41c0d0150 0x7fa41c0c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa422e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c155e10 con 0x7fa41c0cd460 2024-01-24T13:05:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa422e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c146e60 con 0x7fa41c0ce5c0 2024-01-24T13:05:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa422e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c155470 con 0x7fa41c0d0150 2024-01-24T13:05:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa41be00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41c0cd460 0x7fa41c145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa420e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41c0d0150 0x7fa41c0c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa41b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41c0ce5c0 0x7fa41c146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa420e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41c0d0150 0x7fa41c0c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:54238/0 (socket says 172.21.15.29:54238) 2024-01-24T13:05:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa41be00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41c0cd460 0x7fa41c145fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49052/0 (socket says 172.21.15.29:49052) 2024-01-24T13:05:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa420e00640 1 -- 172.21.15.29:0/2032624871 learned_addr learned my addr 172.21.15.29:0/2032624871 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa41b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41c0ce5c0 0x7fa41c146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:39166/0 (socket says 172.21.15.29:39166) 2024-01-24T13:05:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa41be00640 1 -- 172.21.15.29:0/2032624871 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41c0d0150 msgr2=0x7fa41c0c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa41be00640 1 --2- 172.21.15.29:0/2032624871 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41c0d0150 0x7fa41c0c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa41be00640 1 -- 172.21.15.29:0/2032624871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41c0ce5c0 msgr2=0x7fa41c146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa41be00640 1 --2- 172.21.15.29:0/2032624871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41c0ce5c0 0x7fa41c146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:16.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa41be00640 1 -- 172.21.15.29:0/2032624871 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4040094d0 con 0x7fa41c0cd460 2024-01-24T13:05:16.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa41be00640 1 --2- 172.21.15.29:0/2032624871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41c0cd460 0x7fa41c145fc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa40c001ec0 tx=0x7fa40c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:16.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa413e00640 1 -- 172.21.15.29:0/2032624871 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0052d0 con 0x7fa41c0cd460 2024-01-24T13:05:16.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa413e00640 1 -- 172.21.15.29:0/2032624871 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40c005430 con 0x7fa41c0cd460 2024-01-24T13:05:16.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa422e00640 1 -- 172.21.15.29:0/2032624871 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c155750 con 0x7fa41c0cd460 2024-01-24T13:05:16.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa413e00640 1 -- 172.21.15.29:0/2032624871 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c003840 con 0x7fa41c0cd460 2024-01-24T13:05:16.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.027+0000 7fa422e00640 1 -- 172.21.15.29:0/2032624871 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c0c6d20 con 0x7fa41c0cd460 2024-01-24T13:05:16.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.031+0000 7fa422e00640 1 -- 172.21.15.29:0/2032624871 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c155f50 con 0x7fa41c0cd460 2024-01-24T13:05:16.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.031+0000 7fa413e00640 1 -- 172.21.15.29:0/2032624871 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa40c0039a0 con 0x7fa41c0cd460 2024-01-24T13:05:16.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.031+0000 7fa413e00640 1 --2- 172.21.15.29:0/2032624871 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3f4065a60 0x7fa3f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:16.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.031+0000 7fa413e00640 1 -- 172.21.15.29:0/2032624871 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa40c0824a0 con 0x7fa41c0cd460 2024-01-24T13:05:16.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.031+0000 7fa41b400640 1 --2- 172.21.15.29:0/2032624871 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3f4065a60 0x7fa3f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:16.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.031+0000 7fa41b400640 1 --2- 172.21.15.29:0/2032624871 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3f4065a60 0x7fa3f4067f20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa4040af000 tx=0x7fa4040b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:16.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.035+0000 7fa413e00640 1 -- 172.21.15.29:0/2032624871 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa40c0500c0 con 0x7fa41c0cd460 2024-01-24T13:05:16.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.207+0000 7fa422e00640 1 -- 172.21.15.29:0/2032624871 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa41c04e850 con 0x7fa41c0cd460 2024-01-24T13:05:16.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.995+0000 7fa413e00640 1 -- 172.21.15.29:0/2032624871 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa40c0536e0 con 0x7fa41c0cd460 2024-01-24T13:05:16.998 INFO:teuthology.orchestra.run.smithi029.stderr: removed all blocklist entries 2024-01-24T13:05:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.999+0000 7fa422e00640 1 -- 172.21.15.29:0/2032624871 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3f4065a60 msgr2=0x7fa3f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.999+0000 7fa422e00640 1 --2- 172.21.15.29:0/2032624871 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3f4065a60 0x7fa3f4067f20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa4040af000 tx=0x7fa4040b6040 comp rx=0 tx=0).stop 2024-01-24T13:05:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.999+0000 7fa422e00640 1 -- 172.21.15.29:0/2032624871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41c0cd460 msgr2=0x7fa41c145fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.999+0000 7fa422e00640 1 --2- 172.21.15.29:0/2032624871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41c0cd460 0x7fa41c145fc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa40c001ec0 tx=0x7fa40c00c890 comp rx=0 tx=0).stop 2024-01-24T13:05:17.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.999+0000 7fa422e00640 1 -- 172.21.15.29:0/2032624871 shutdown_connections 2024-01-24T13:05:17.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.999+0000 7fa422e00640 1 --2- 172.21.15.29:0/2032624871 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3f4065a60 0x7fa3f4067f20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.999+0000 7fa422e00640 1 --2- 172.21.15.29:0/2032624871 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41c0d0150 0x7fa41c0c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.999+0000 7fa422e00640 1 --2- 172.21.15.29:0/2032624871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41c0ce5c0 0x7fa41c146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.999+0000 7fa422e00640 1 --2- 172.21.15.29:0/2032624871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41c0cd460 0x7fa41c145fc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.999+0000 7fa422e00640 1 -- 172.21.15.29:0/2032624871 >> 172.21.15.29:0/2032624871 conn(0x7fa41c069cd0 msgr2=0x7fa41c0c3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:17.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.999+0000 7fa422e00640 1 -- 172.21.15.29:0/2032624871 shutdown_connections 2024-01-24T13:05:17.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:16.999+0000 7fa422e00640 1 -- 172.21.15.29:0/2032624871 wait complete. 2024-01-24T13:05:17.025 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-24T13:05:17.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.167+0000 7ffbb4a00640 1 Processor -- start 2024-01-24T13:05:17.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.167+0000 7ffbb4a00640 1 -- start start 2024-01-24T13:05:17.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb4a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffbac15a630 0x7ffbac0cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb4a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbac0cb100 0x7ffbac0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb4a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbac0cfe50 con 0x7ffbac0c3ef0 2024-01-24T13:05:17.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb4a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbac0cf380 con 0x7ffbac15a630 2024-01-24T13:05:17.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb4a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac15aa10 con 0x7ffbac0cb100 2024-01-24T13:05:17.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb2000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffbac15a630 0x7ffbac0cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb2000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffbac15a630 0x7ffbac0cdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49066/0 (socket says 172.21.15.29:49066) 2024-01-24T13:05:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb2000640 1 -- 172.21.15.29:0/794690121 learned_addr learned my addr 172.21.15.29:0/794690121 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb2a00640 1 --2- 172.21.15.29:0/794690121 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbac0cb100 0x7ffbac0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb2000640 1 -- 172.21.15.29:0/794690121 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbac0cb100 msgr2=0x7ffbac0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb2000640 1 --2- 172.21.15.29:0/794690121 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbac0cb100 0x7ffbac0ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb2000640 1 -- 172.21.15.29:0/794690121 >> v1:172.21.15.163:6789/0 conn(0x7ffbac0c3ef0 legacy=0x7ffbac0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb2000640 1 -- 172.21.15.29:0/794690121 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac0b2b70 con 0x7ffbac15a630 2024-01-24T13:05:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb2000640 1 --2- 172.21.15.29:0/794690121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac15a630 0x7ffbac0cdf70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009870 tx=0x7ffb9c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da722db992707aa server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.171+0000 7ffbb0c00640 1 -- 172.21.15.29:0/794690121 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c0aa5f0 con 0x7ffbac15a630 2024-01-24T13:05:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb0c00640 1 -- 172.21.15.29:0/794690121 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9c0aa750 con 0x7ffbac15a630 2024-01-24T13:05:17.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb0c00640 1 -- 172.21.15.29:0/794690121 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c0aaae0 con 0x7ffbac15a630 2024-01-24T13:05:17.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 -- 172.21.15.29:0/794690121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac15a630 msgr2=0x7ffbac0cdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 --2- 172.21.15.29:0/794690121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac15a630 0x7ffbac0cdf70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009870 tx=0x7ffb9c01c4d0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 -- 172.21.15.29:0/794690121 shutdown_connections 2024-01-24T13:05:17.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 --2- 172.21.15.29:0/794690121 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbac0cb100 0x7ffbac0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 --2- 172.21.15.29:0/794690121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac15a630 0x7ffbac0cdf70 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 -- 172.21.15.29:0/794690121 >> 172.21.15.29:0/794690121 conn(0x7ffbac070570 msgr2=0x7ffbac069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:17.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 -- 172.21.15.29:0/794690121 shutdown_connections 2024-01-24T13:05:17.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 -- 172.21.15.29:0/794690121 wait complete. 2024-01-24T13:05:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 Processor -- start 2024-01-24T13:05:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 -- start start 2024-01-24T13:05:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffbac0c3ef0 0x7ffbac06c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbac0cb100 0x7ffbac162230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac15a630 0x7ffbac163bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac1639d0 con 0x7ffbac15a630 2024-01-24T13:05:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac06c300 con 0x7ffbac0c3ef0 2024-01-24T13:05:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.175+0000 7ffbb4a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac162930 con 0x7ffbac0cb100 2024-01-24T13:05:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb2a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac15a630 0x7ffbac163bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb2000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffbac0c3ef0 0x7ffbac06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb2a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac15a630 0x7ffbac163bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49072/0 (socket says 172.21.15.29:49072) 2024-01-24T13:05:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb2a00640 1 -- 172.21.15.29:0/264069720 learned_addr learned my addr 172.21.15.29:0/264069720 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb1600640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbac0cb100 0x7ffbac162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb2000640 1 -- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbac0cb100 msgr2=0x7ffbac162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb2000640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbac0cb100 0x7ffbac162230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb2000640 1 -- 172.21.15.29:0/264069720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac15a630 msgr2=0x7ffbac163bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb2000640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac15a630 0x7ffbac163bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb2000640 1 -- 172.21.15.29:0/264069720 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c0094d0 con 0x7ffbac0c3ef0 2024-01-24T13:05:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb1600640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbac0cb100 0x7ffbac162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:17.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb2a00640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac15a630 0x7ffbac163bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:17.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb2000640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffbac0c3ef0 0x7ffbac06c800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0ab000 tx=0x7ffb9c01ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:17.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbaa000640 1 -- 172.21.15.29:0/264069720 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c0b3800 con 0x7ffbac0c3ef0 2024-01-24T13:05:17.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbaa000640 1 -- 172.21.15.29:0/264069720 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9c0b3980 con 0x7ffbac0c3ef0 2024-01-24T13:05:17.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbaa000640 1 -- 172.21.15.29:0/264069720 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c0b3d30 con 0x7ffbac0c3ef0 2024-01-24T13:05:17.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb4a00640 1 -- 172.21.15.29:0/264069720 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbac162c10 con 0x7ffbac0c3ef0 2024-01-24T13:05:17.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb4a00640 1 -- 172.21.15.29:0/264069720 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbac1631d0 con 0x7ffbac0c3ef0 2024-01-24T13:05:17.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbb4a00640 1 -- 172.21.15.29:0/264069720 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbac04e850 con 0x7ffbac0c3ef0 2024-01-24T13:05:17.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.179+0000 7ffbaa000640 1 -- 172.21.15.29:0/264069720 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffb9c0bd3f0 con 0x7ffbac0c3ef0 2024-01-24T13:05:17.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.183+0000 7ffbaa000640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ffb84065ab0 0x7ffb84067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.183+0000 7ffbaa000640 1 -- 172.21.15.29:0/264069720 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ffb9c0a7070 con 0x7ffbac0c3ef0 2024-01-24T13:05:17.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.183+0000 7ffbb1600640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ffb84065ab0 0x7ffb84067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.183+0000 7ffbb1600640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ffb84065ab0 0x7ffb84067f70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffbac1f80a0 tx=0x7ffb94007e40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:17.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.187+0000 7ffbaa000640 1 -- 172.21.15.29:0/264069720 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ffb9c0eb3b0 con 0x7ffbac0c3ef0 2024-01-24T13:05:17.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.399+0000 7ffbb4a00640 1 -- 172.21.15.29:0/264069720 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ffbac0b0330 con 0x7ffbac0c3ef0 2024-01-24T13:05:17.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.399+0000 7ffbaa000640 1 -- 172.21.15.29:0/264069720 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7ffb9c0aa5b0 con 0x7ffbac0c3ef0 2024-01-24T13:05:17.404 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:17.404 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:05:17.404 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_dump": [ 2024-01-24T13:05:17.404 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.404 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.a", 2024-01-24T13:05:17.404 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCBCrFlfcc0LxAAcfzIx22lqaFU0QzMcxcnsA==", 2024-01-24T13:05:17.404 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.404 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:05:17.404 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-24T13:05:17.404 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-24T13:05:17.404 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.405 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.405 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.405 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.405 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.b", 2024-01-24T13:05:17.405 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCBCrFlejZvOxAAg3f/x3idsEKvMP7TkC/XVg==", 2024-01-24T13:05:17.405 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.405 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:05:17.405 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-24T13:05:17.405 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-24T13:05:17.405 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.405 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.405 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.405 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.c", 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCBCrFlmpRhNhAAQAXfv9fO1+pk6zLArr63uw==", 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.d", 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCCCrFl8fcPBxAAUGmu768hahYetBTAMaaOqw==", 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:05:17.406 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-24T13:05:17.407 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-24T13:05:17.407 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.407 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.407 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.407 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.407 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.0", 2024-01-24T13:05:17.407 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCDCrFlA2upKBAA/lD3Zf4Zwuct9CuHohEY4Q==", 2024-01-24T13:05:17.407 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.407 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:05:17.407 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:05:17.407 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.407 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.407 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.407 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.408 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.1", 2024-01-24T13:05:17.408 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCGCrFlPxMuMBAAX00zw2rQ5p4gj+6qr8joLQ==", 2024-01-24T13:05:17.408 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.408 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:05:17.408 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:05:17.408 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.408 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.408 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.408 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.408 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.2", 2024-01-24T13:05:17.408 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCJCrFlX09NNhAAs0XO4DOuWxSde/FX27SAlQ==", 2024-01-24T13:05:17.408 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.408 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:05:17.408 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.3", 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCNCrFlYQPpABAAwXMaiadTeodv89ipFnbtfw==", 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.4", 2024-01-24T13:05:17.409 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCTCrFlkicqDBAAwNHahMGIHvoUyoTiGYMipQ==", 2024-01-24T13:05:17.410 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.410 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:05:17.410 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:05:17.410 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.410 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.410 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.410 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.410 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.5", 2024-01-24T13:05:17.410 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCWCrFlOjajEhAAI8zgPXBucICda0RviagEzg==", 2024-01-24T13:05:17.410 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.410 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:05:17.410 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:05:17.411 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.411 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.411 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.411 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.411 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.6", 2024-01-24T13:05:17.411 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCZCrFlp/ISGRAADWHsw5NUXfuuT6mK++jfyQ==", 2024-01-24T13:05:17.411 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.411 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:05:17.411 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:05:17.411 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.411 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.411 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.411 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.411 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.7", 2024-01-24T13:05:17.412 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCcCrFlUUSsHxAASrwuwRULMRoJ8N5268ifPA==", 2024-01-24T13:05:17.412 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.412 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:05:17.412 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:05:17.412 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.412 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.412 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.412 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.412 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.0", 2024-01-24T13:05:17.412 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCCCrFlb6/4ChAAXuhDbbXWzUiqLFkxjl338w==", 2024-01-24T13:05:17.412 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.412 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:05:17.412 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2024-01-24T13:05:17.412 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.1", 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCCCrFlAr33FBAAa9i6dmMB95s9F6uS9H29Tw==", 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.413 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.2", 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCCCrFlgpxlERAAQtpVfRyxSqXBmfFO2TMiuw==", 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.3", 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCCCrFli6DxGhAAvXbTcKz7CyokwecCpCRAhg==", 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2024-01-24T13:05:17.414 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.admin", 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCBCrFlm28DExAAamnPiAr8qULuxfOkv+GlFA==", 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.415 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-mds", 2024-01-24T13:05:17.416 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCiCrFlM2fKHhAAgXPZSdW6h1ob4HeUpT/LpQ==", 2024-01-24T13:05:17.416 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.416 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-mds" 2024-01-24T13:05:17.416 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.416 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.416 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.416 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-mgr", 2024-01-24T13:05:17.416 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCiCrFl1HHKHhAAJBJ10bd6xQ/91WHT/O6jyA==", 2024-01-24T13:05:17.416 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.416 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-24T13:05:17.416 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.416 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.416 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.416 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-osd", 2024-01-24T13:05:17.417 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCiCrFl7HrKHhAAlDKtCaYBCC9GFLJkUQUO8Q==", 2024-01-24T13:05:17.417 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.417 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-osd" 2024-01-24T13:05:17.417 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.417 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.417 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.417 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rbd", 2024-01-24T13:05:17.417 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCiCrFlioPKHhAAePpXQzrIwcbJyYgo4KNVhw==", 2024-01-24T13:05:17.417 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.417 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-24T13:05:17.417 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.417 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.417 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.418 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-24T13:05:17.418 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCiCrFlX4zKHhAAf+ZvtZyfz1rHkXHGVxcrAg==", 2024-01-24T13:05:17.418 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.418 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-24T13:05:17.418 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.418 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.418 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.418 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rgw", 2024-01-24T13:05:17.418 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCiCrFlcpXKHhAA5OI8UtSjVnKBteZOHNELSA==", 2024-01-24T13:05:17.418 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.418 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-24T13:05:17.418 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.418 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.418 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.419 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.x", 2024-01-24T13:05:17.419 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCBCrFlL3vuKhAASZI1JPwrC06IrY+iYb6jvA==", 2024-01-24T13:05:17.419 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.419 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2024-01-24T13:05:17.419 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2024-01-24T13:05:17.419 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.419 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.419 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:17.419 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:17.419 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.y", 2024-01-24T13:05:17.419 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCBCrFl07wJJxAA9zO/ZHwphgGeFXCrWFYJKA==", 2024-01-24T13:05:17.419 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:05:17.419 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2024-01-24T13:05:17.419 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2024-01-24T13:05:17.420 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:05:17.420 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.420 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:17.420 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-01-24T13:05:17.420 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:05:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.403+0000 7ffbb4a00640 1 -- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ffb84065ab0 msgr2=0x7ffb84067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.403+0000 7ffbb4a00640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ffb84065ab0 0x7ffb84067f70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffbac1f80a0 tx=0x7ffb94007e40 comp rx=0 tx=0).stop 2024-01-24T13:05:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.403+0000 7ffbb4a00640 1 -- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffbac0c3ef0 msgr2=0x7ffbac06c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.403+0000 7ffbb4a00640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffbac0c3ef0 0x7ffbac06c800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0ab000 tx=0x7ffb9c01ad10 comp rx=0 tx=0).stop 2024-01-24T13:05:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.403+0000 7ffbb4a00640 1 -- 172.21.15.29:0/264069720 shutdown_connections 2024-01-24T13:05:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.403+0000 7ffbb4a00640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ffb84065ab0 0x7ffb84067f70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.403+0000 7ffbb4a00640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac15a630 0x7ffbac163bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.403+0000 7ffbb4a00640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbac0cb100 0x7ffbac162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.403+0000 7ffbb4a00640 1 --2- 172.21.15.29:0/264069720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffbac0c3ef0 0x7ffbac06c800 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.403+0000 7ffbb4a00640 1 -- 172.21.15.29:0/264069720 >> 172.21.15.29:0/264069720 conn(0x7ffbac070570 msgr2=0x7ffbac0cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:17.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.403+0000 7ffbb4a00640 1 -- 172.21.15.29:0/264069720 shutdown_connections 2024-01-24T13:05:17.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.403+0000 7ffbb4a00640 1 -- 172.21.15.29:0/264069720 wait complete. 2024-01-24T13:05:17.426 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-24T13:05:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a20000640 1 Processor -- start 2024-01-24T13:05:17.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a20000640 1 -- start start 2024-01-24T13:05:17.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a20000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a180d0150 0x7f1a180ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a20000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a180ce5c0 0x7f1a1806b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a20000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a180d05e0 con 0x7f1a180cd460 2024-01-24T13:05:17.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a20000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a180ce9e0 con 0x7f1a180d0150 2024-01-24T13:05:17.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a20000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180d0830 con 0x7f1a180ce5c0 2024-01-24T13:05:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a1d600640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1a180cd460 0x7f1a1815d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51548/0 (socket says 172.21.15.29:51548) 2024-01-24T13:05:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a1cc00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a180d0150 0x7f1a180ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a1d600640 1 -- 172.21.15.29:0/3179760689 learned_addr learned my addr 172.21.15.29:0/3179760689 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a1e000640 1 --2- 172.21.15.29:0/3179760689 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a180ce5c0 0x7f1a1806b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a1cc00640 1 -- 172.21.15.29:0/3179760689 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a180ce5c0 msgr2=0x7f1a1806b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a1cc00640 1 --2- 172.21.15.29:0/3179760689 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a180ce5c0 0x7f1a1806b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a1cc00640 1 -- 172.21.15.29:0/3179760689 >> v1:172.21.15.29:6789/0 conn(0x7f1a180cd460 legacy=0x7f1a1815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a17e00640 1 -- 172.21.15.29:0/3179760689 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510172858 0 0) 0x7f1a180d05e0 con 0x7f1a180cd460 2024-01-24T13:05:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.566+0000 7f1a1cc00640 1 -- 172.21.15.29:0/3179760689 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a180d0b10 con 0x7f1a180d0150 2024-01-24T13:05:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.570+0000 7f1a1cc00640 1 --2- 172.21.15.29:0/3179760689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a180d0150 0x7f1a180ce080 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1a000097c0 tx=0x7f1a0001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e283bc676380e541 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.570+0000 7f1a17e00640 1 -- 172.21.15.29:0/3179760689 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a000ac620 con 0x7f1a180d0150 2024-01-24T13:05:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.570+0000 7f1a17e00640 1 -- 172.21.15.29:0/3179760689 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a000ac780 con 0x7f1a180d0150 2024-01-24T13:05:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.570+0000 7f1a17e00640 1 -- 172.21.15.29:0/3179760689 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a000acb10 con 0x7f1a180d0150 2024-01-24T13:05:17.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.570+0000 7f1a20000640 1 -- 172.21.15.29:0/3179760689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a180d0150 msgr2=0x7f1a180ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.570+0000 7f1a20000640 1 --2- 172.21.15.29:0/3179760689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a180d0150 0x7f1a180ce080 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1a000097c0 tx=0x7f1a0001c3c0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.570+0000 7f1a20000640 1 -- 172.21.15.29:0/3179760689 shutdown_connections 2024-01-24T13:05:17.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.570+0000 7f1a20000640 1 --2- 172.21.15.29:0/3179760689 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a180ce5c0 0x7f1a1806b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.570+0000 7f1a20000640 1 --2- 172.21.15.29:0/3179760689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a180d0150 0x7f1a180ce080 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.570+0000 7f1a20000640 1 -- 172.21.15.29:0/3179760689 >> 172.21.15.29:0/3179760689 conn(0x7f1a18069cd0 msgr2=0x7f1a1806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:17.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.570+0000 7f1a20000640 1 -- 172.21.15.29:0/3179760689 shutdown_connections 2024-01-24T13:05:17.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.570+0000 7f1a20000640 1 -- 172.21.15.29:0/3179760689 wait complete. 2024-01-24T13:05:17.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a20000640 1 Processor -- start 2024-01-24T13:05:17.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a20000640 1 -- start start 2024-01-24T13:05:17.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a20000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a180cd460 0x7f1a18156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a20000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a180ce5c0 0x7f1a1814ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a20000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a180d0150 0x7f1a1814d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a20000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a18157f10 con 0x7f1a180d0150 2024-01-24T13:05:17.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a20000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1814b350 con 0x7f1a180cd460 2024-01-24T13:05:17.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a20000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1814de70 con 0x7f1a180ce5c0 2024-01-24T13:05:17.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a1e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a180d0150 0x7f1a1814d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a1e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a180d0150 0x7f1a1814d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49098/0 (socket says 172.21.15.29:49098) 2024-01-24T13:05:17.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a1e000640 1 -- 172.21.15.29:0/1343698982 learned_addr learned my addr 172.21.15.29:0/1343698982 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:17.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a1d600640 1 --2- 172.21.15.29:0/1343698982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a180cd460 0x7f1a18156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a1cc00640 1 --2- 172.21.15.29:0/1343698982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a180ce5c0 0x7f1a1814ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a1e000640 1 -- 172.21.15.29:0/1343698982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a180ce5c0 msgr2=0x7f1a1814ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a1e000640 1 --2- 172.21.15.29:0/1343698982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a180ce5c0 0x7f1a1814ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a1e000640 1 -- 172.21.15.29:0/1343698982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a180cd460 msgr2=0x7f1a18156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a1e000640 1 --2- 172.21.15.29:0/1343698982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a180cd460 0x7f1a18156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a1e000640 1 -- 172.21.15.29:0/1343698982 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a00009420 con 0x7f1a180d0150 2024-01-24T13:05:17.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a1e000640 1 --2- 172.21.15.29:0/1343698982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a180d0150 0x7f1a1814d590 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000efc0 tx=0x7f1a1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:17.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a15600640 1 -- 172.21.15.29:0/1343698982 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10014480 con 0x7f1a180d0150 2024-01-24T13:05:17.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a15600640 1 -- 172.21.15.29:0/1343698982 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1000f040 con 0x7f1a180d0150 2024-01-24T13:05:17.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a15600640 1 -- 172.21.15.29:0/1343698982 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10014820 con 0x7f1a180d0150 2024-01-24T13:05:17.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a20000640 1 -- 172.21.15.29:0/1343698982 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1814e150 con 0x7f1a180d0150 2024-01-24T13:05:17.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.574+0000 7f1a20000640 1 -- 172.21.15.29:0/1343698982 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1814e710 con 0x7f1a180d0150 2024-01-24T13:05:17.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.578+0000 7f1a20000640 1 -- 172.21.15.29:0/1343698982 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a181580e0 con 0x7f1a180d0150 2024-01-24T13:05:17.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.578+0000 7f1a15600640 1 -- 172.21.15.29:0/1343698982 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1a10014980 con 0x7f1a180d0150 2024-01-24T13:05:17.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.578+0000 7f1a15600640 1 --2- 172.21.15.29:0/1343698982 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f19f0065a60 0x7f19f0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.578+0000 7f1a15600640 1 -- 172.21.15.29:0/1343698982 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1a10083990 con 0x7f1a180d0150 2024-01-24T13:05:17.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.578+0000 7f1a1d600640 1 --2- 172.21.15.29:0/1343698982 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f19f0065a60 0x7f19f0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.578+0000 7f1a1d600640 1 --2- 172.21.15.29:0/1343698982 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f19f0065a60 0x7f19f0067f20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a08007fd0 tx=0x7f1a08007d60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:17.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.582+0000 7f1a15600640 1 -- 172.21.15.29:0/1343698982 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1a181580e0 con 0x7f1a180d0150 2024-01-24T13:05:17.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.790+0000 7f1a20000640 1 -- 172.21.15.29:0/1343698982 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f1a1804e850 con 0x7f1a180d0150 2024-01-24T13:05:17.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.794+0000 7f1a15600640 1 -- 172.21.15.29:0/1343698982 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1a100180a0 con 0x7f1a180d0150 2024-01-24T13:05:17.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.798+0000 7f1a20000640 1 -- 172.21.15.29:0/1343698982 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f19f0065a60 msgr2=0x7f19f0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.798+0000 7f1a20000640 1 --2- 172.21.15.29:0/1343698982 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f19f0065a60 0x7f19f0067f20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a08007fd0 tx=0x7f1a08007d60 comp rx=0 tx=0).stop 2024-01-24T13:05:17.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.798+0000 7f1a20000640 1 -- 172.21.15.29:0/1343698982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a180d0150 msgr2=0x7f1a1814d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.798+0000 7f1a20000640 1 --2- 172.21.15.29:0/1343698982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a180d0150 0x7f1a1814d590 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000efc0 tx=0x7f1a1000c490 comp rx=0 tx=0).stop 2024-01-24T13:05:17.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.798+0000 7f1a20000640 1 -- 172.21.15.29:0/1343698982 shutdown_connections 2024-01-24T13:05:17.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.798+0000 7f1a20000640 1 --2- 172.21.15.29:0/1343698982 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f19f0065a60 0x7f19f0067f20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.798+0000 7f1a20000640 1 --2- 172.21.15.29:0/1343698982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a180d0150 0x7f1a1814d590 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.798+0000 7f1a20000640 1 --2- 172.21.15.29:0/1343698982 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a180ce5c0 0x7f1a1814ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.798+0000 7f1a20000640 1 --2- 172.21.15.29:0/1343698982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a180cd460 0x7f1a18156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.798+0000 7f1a20000640 1 -- 172.21.15.29:0/1343698982 >> 172.21.15.29:0/1343698982 conn(0x7f1a18069cd0 msgr2=0x7f1a180caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:17.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.798+0000 7f1a20000640 1 -- 172.21.15.29:0/1343698982 shutdown_connections 2024-01-24T13:05:17.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.798+0000 7f1a20000640 1 -- 172.21.15.29:0/1343698982 wait complete. 2024-01-24T13:05:17.822 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-24T13:05:17.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.958+0000 7fef29600640 1 Processor -- start 2024-01-24T13:05:17.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.962+0000 7fef29600640 1 -- start start 2024-01-24T13:05:17.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.962+0000 7fef29600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fef240cd540 0x7fef2415b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.962+0000 7fef29600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2415e920 con 0x7fef240cd160 2024-01-24T13:05:17.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.962+0000 7fef29600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2415ec00 con 0x7fef2415b8b0 2024-01-24T13:05:17.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.962+0000 7fef29600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2415eee0 con 0x7fef240cd540 2024-01-24T13:05:17.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.962+0000 7fef22a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fef240cd160 0x7fef2415e0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51564/0 (socket says 172.21.15.29:51564) 2024-01-24T13:05:17.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.962+0000 7fef22000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fef240cd540 0x7fef2415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.962+0000 7fef22a00640 1 -- 172.21.15.29:0/3284988960 learned_addr learned my addr 172.21.15.29:0/3284988960 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:17.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.962+0000 7fef22000640 1 -- 172.21.15.29:0/3284988960 >> v1:172.21.15.163:6789/0 conn(0x7fef2415b8b0 legacy=0x7fef240cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:17.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.962+0000 7fef22000640 1 -- 172.21.15.29:0/3284988960 >> v1:172.21.15.29:6789/0 conn(0x7fef240cd160 legacy=0x7fef2415e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.962+0000 7fef22000640 1 -- 172.21.15.29:0/3284988960 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2415ae50 con 0x7fef240cd540 2024-01-24T13:05:17.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.962+0000 7fef21600640 1 -- 172.21.15.29:0/3284988960 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414630231 0 0) 0x7fef2415e920 con 0x7fef240cd160 2024-01-24T13:05:17.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.966+0000 7fef22000640 1 --2- 172.21.15.29:0/3284988960 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef240cd540 0x7fef2415b370 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0097c0 tx=0x7fef0c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aaa24d9860ab2d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:17.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.966+0000 7fef21600640 1 -- 172.21.15.29:0/3284988960 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0ad680 con 0x7fef240cd540 2024-01-24T13:05:17.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.966+0000 7fef21600640 1 -- 172.21.15.29:0/3284988960 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0c0ad7e0 con 0x7fef240cd540 2024-01-24T13:05:17.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.966+0000 7fef21600640 1 -- 172.21.15.29:0/3284988960 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0adb70 con 0x7fef240cd540 2024-01-24T13:05:17.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.966+0000 7fef29600640 1 -- 172.21.15.29:0/3284988960 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef240cd540 msgr2=0x7fef2415b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.966+0000 7fef29600640 1 --2- 172.21.15.29:0/3284988960 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef240cd540 0x7fef2415b370 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0097c0 tx=0x7fef0c01c440 comp rx=0 tx=0).stop 2024-01-24T13:05:17.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.966+0000 7fef29600640 1 -- 172.21.15.29:0/3284988960 shutdown_connections 2024-01-24T13:05:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.966+0000 7fef29600640 1 --2- 172.21.15.29:0/3284988960 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef240cd540 0x7fef2415b370 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.966+0000 7fef29600640 1 -- 172.21.15.29:0/3284988960 >> 172.21.15.29:0/3284988960 conn(0x7fef24069cd0 msgr2=0x7fef2406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.966+0000 7fef29600640 1 -- 172.21.15.29:0/3284988960 shutdown_connections 2024-01-24T13:05:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.966+0000 7fef29600640 1 -- 172.21.15.29:0/3284988960 wait complete. 2024-01-24T13:05:17.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.966+0000 7fef29600640 1 Processor -- start 2024-01-24T13:05:17.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.966+0000 7fef29600640 1 -- start start 2024-01-24T13:05:17.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef29600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef240cd160 0x7fef2414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef29600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef240cd540 0x7fef2414d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef29600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fef240b30d0 0x7fef240b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef29600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef24151910 con 0x7fef240cd160 2024-01-24T13:05:17.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef29600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240b3580 con 0x7fef240cd540 2024-01-24T13:05:17.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef29600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef241541c0 con 0x7fef240b30d0 2024-01-24T13:05:17.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef22a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef240cd160 0x7fef2414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef22a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef240cd160 0x7fef2414aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49114/0 (socket says 172.21.15.29:49114) 2024-01-24T13:05:17.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef22a00640 1 -- 172.21.15.29:0/560731930 learned_addr learned my addr 172.21.15.29:0/560731930 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:17.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef22000640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef240cd540 0x7fef2414d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef23400640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fef240b30d0 0x7fef240b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef22a00640 1 -- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fef240b30d0 msgr2=0x7fef240b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef22a00640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fef240b30d0 0x7fef240b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef22a00640 1 -- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef240cd540 msgr2=0x7fef2414d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:17.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef22a00640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef240cd540 0x7fef2414d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:17.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef22a00640 1 -- 172.21.15.29:0/560731930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c009420 con 0x7fef240cd160 2024-01-24T13:05:17.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef22000640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef240cd540 0x7fef2414d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:17.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef22a00640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef240cd160 0x7fef2414aea0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fef140011f0 tx=0x7fef1400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:17.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef1aa00640 1 -- 172.21.15.29:0/560731930 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef140074e0 con 0x7fef240cd160 2024-01-24T13:05:17.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef1aa00640 1 -- 172.21.15.29:0/560731930 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef14007640 con 0x7fef240cd160 2024-01-24T13:05:17.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef1aa00640 1 -- 172.21.15.29:0/560731930 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14004a10 con 0x7fef240cd160 2024-01-24T13:05:17.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef29600640 1 -- 172.21.15.29:0/560731930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef240c60c0 con 0x7fef240cd160 2024-01-24T13:05:17.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef29600640 1 -- 172.21.15.29:0/560731930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef241544a0 con 0x7fef240cd160 2024-01-24T13:05:17.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.970+0000 7fef29600640 1 -- 172.21.15.29:0/560731930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2404e850 con 0x7fef240cd160 2024-01-24T13:05:17.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.974+0000 7fef1aa00640 1 -- 172.21.15.29:0/560731930 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fef14004b70 con 0x7fef240cd160 2024-01-24T13:05:17.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.974+0000 7fef1aa00640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feefc065a60 0x7feefc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:17.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.974+0000 7fef1aa00640 1 -- 172.21.15.29:0/560731930 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fef140821e0 con 0x7fef240cd160 2024-01-24T13:05:17.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.974+0000 7fef22000640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feefc065a60 0x7feefc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:17.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.974+0000 7fef22000640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feefc065a60 0x7feefc067f20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0af000 tx=0x7fef0c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:17.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:17.978+0000 7fef1aa00640 1 -- 172.21.15.29:0/560731930 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fef1404fd10 con 0x7fef240cd160 2024-01-24T13:05:18.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.190+0000 7fef29600640 1 -- 172.21.15.29:0/560731930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fef240b60c0 con 0x7fef240cd160 2024-01-24T13:05:18.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.194+0000 7fef1aa00640 1 -- 172.21.15.29:0/560731930 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fef14053330 con 0x7fef240cd160 2024-01-24T13:05:18.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.198+0000 7fef29600640 1 -- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feefc065a60 msgr2=0x7feefc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:18.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.198+0000 7fef29600640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feefc065a60 0x7feefc067f20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0af000 tx=0x7fef0c008040 comp rx=0 tx=0).stop 2024-01-24T13:05:18.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.198+0000 7fef29600640 1 -- 172.21.15.29:0/560731930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef240cd160 msgr2=0x7fef2414aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:18.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.198+0000 7fef29600640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef240cd160 0x7fef2414aea0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fef140011f0 tx=0x7fef1400c9b0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.198+0000 7fef29600640 1 -- 172.21.15.29:0/560731930 shutdown_connections 2024-01-24T13:05:18.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.198+0000 7fef29600640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7feefc065a60 0x7feefc067f20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.198+0000 7fef29600640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fef240b30d0 0x7fef240b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.198+0000 7fef29600640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef240cd540 0x7fef2414d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.198+0000 7fef29600640 1 --2- 172.21.15.29:0/560731930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef240cd160 0x7fef2414aea0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.198+0000 7fef29600640 1 -- 172.21.15.29:0/560731930 >> 172.21.15.29:0/560731930 conn(0x7fef24069cd0 msgr2=0x7fef2406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:18.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.198+0000 7fef29600640 1 -- 172.21.15.29:0/560731930 shutdown_connections 2024-01-24T13:05:18.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.198+0000 7fef29600640 1 -- 172.21.15.29:0/560731930 wait complete. 2024-01-24T13:05:18.222 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-24T13:05:18.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b7e00640 1 Processor -- start 2024-01-24T13:05:18.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b7e00640 1 -- start start 2024-01-24T13:05:18.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b7e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa5b00cd160 0x7fa5b00cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:18.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b7e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa5b00cab00 0x7fa5b00caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:18.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b7e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b00cb470 con 0x7fa5b015e0f0 2024-01-24T13:05:18.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b7e00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b015ba80 con 0x7fa5b00cab00 2024-01-24T13:05:18.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b7e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b015e920 con 0x7fa5b00cd160 2024-01-24T13:05:18.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b5e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa5b00cab00 0x7fa5b00caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:18.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b4a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa5b015e0f0 0x7fa5b015b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51570/0 (socket says 172.21.15.29:51570) 2024-01-24T13:05:18.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b4a00640 1 -- 172.21.15.29:0/958547252 learned_addr learned my addr 172.21.15.29:0/958547252 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:18.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b5400640 1 --2- 172.21.15.29:0/958547252 >> v2:172.21.15.163:3300/0 conn(0x7fa5b00cd160 0x7fa5b00cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:18.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b5e00640 1 -- 172.21.15.29:0/958547252 >> v2:172.21.15.163:3300/0 conn(0x7fa5b00cd160 msgr2=0x7fa5b00cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:18.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b5e00640 1 --2- 172.21.15.29:0/958547252 >> v2:172.21.15.163:3300/0 conn(0x7fa5b00cd160 0x7fa5b00cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b5e00640 1 -- 172.21.15.29:0/958547252 >> v1:172.21.15.29:6789/0 conn(0x7fa5b015e0f0 legacy=0x7fa5b015b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:18.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5afe00640 1 -- 172.21.15.29:0/958547252 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815586003 0 0) 0x7fa5b00cb470 con 0x7fa5b015e0f0 2024-01-24T13:05:18.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.362+0000 7fa5b5e00640 1 -- 172.21.15.29:0/958547252 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b015ec00 con 0x7fa5b00cab00 2024-01-24T13:05:18.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.366+0000 7fa5b5e00640 1 --2- 172.21.15.29:0/958547252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b00cab00 0x7fa5b00caf30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00b6620 tx=0x7fa5a801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c9b5a7ec474ceb server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:18.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.366+0000 7fa5afe00640 1 -- 172.21.15.29:0/958547252 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80a59a0 con 0x7fa5b00cab00 2024-01-24T13:05:18.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.366+0000 7fa5afe00640 1 -- 172.21.15.29:0/958547252 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a80a5b00 con 0x7fa5b00cab00 2024-01-24T13:05:18.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.366+0000 7fa5afe00640 1 -- 172.21.15.29:0/958547252 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80a5e90 con 0x7fa5b00cab00 2024-01-24T13:05:18.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.366+0000 7fa5b7e00640 1 -- 172.21.15.29:0/958547252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b00cab00 msgr2=0x7fa5b00caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:18.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.366+0000 7fa5b7e00640 1 --2- 172.21.15.29:0/958547252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b00cab00 0x7fa5b00caf30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00b6620 tx=0x7fa5a801c8e0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.366+0000 7fa5b7e00640 1 -- 172.21.15.29:0/958547252 shutdown_connections 2024-01-24T13:05:18.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.366+0000 7fa5b7e00640 1 --2- 172.21.15.29:0/958547252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b00cab00 0x7fa5b00caf30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.366+0000 7fa5b7e00640 1 --2- 172.21.15.29:0/958547252 >> v2:172.21.15.163:3300/0 conn(0x7fa5b00cd160 0x7fa5b00cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.366+0000 7fa5b7e00640 1 -- 172.21.15.29:0/958547252 >> 172.21.15.29:0/958547252 conn(0x7fa5b0069cd0 msgr2=0x7fa5b006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:18.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.366+0000 7fa5b7e00640 1 -- 172.21.15.29:0/958547252 shutdown_connections 2024-01-24T13:05:18.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.366+0000 7fa5b7e00640 1 -- 172.21.15.29:0/958547252 wait complete. 2024-01-24T13:05:18.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b7e00640 1 Processor -- start 2024-01-24T13:05:18.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b7e00640 1 -- start start 2024-01-24T13:05:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b7e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b00cab00 0x7fa5b00c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b7e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5b00cd160 0x7fa5b014fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b7e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5b015e0f0 0x7fa5b01595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b7e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b00c6940 con 0x7fa5b00cab00 2024-01-24T13:05:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b7e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b00c6c20 con 0x7fa5b00cd160 2024-01-24T13:05:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b7e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b00c50d0 con 0x7fa5b015e0f0 2024-01-24T13:05:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b5400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b00cab00 0x7fa5b00c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b5400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b00cab00 0x7fa5b00c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49122/0 (socket says 172.21.15.29:49122) 2024-01-24T13:05:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b5400640 1 -- 172.21.15.29:0/3597922166 learned_addr learned my addr 172.21.15.29:0/3597922166 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b4a00640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5b00cd160 0x7fa5b014fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b5e00640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5b015e0f0 0x7fa5b01595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b5400640 1 -- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5b015e0f0 msgr2=0x7fa5b01595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b5400640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5b015e0f0 0x7fa5b01595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b5400640 1 -- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5b00cd160 msgr2=0x7fa5b014fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b5400640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5b00cd160 0x7fa5b014fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b5400640 1 -- 172.21.15.29:0/3597922166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a8009a70 con 0x7fa5b00cab00 2024-01-24T13:05:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b4a00640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5b00cd160 0x7fa5b014fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b5e00640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5b015e0f0 0x7fa5b01595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b5400640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b00cab00 0x7fa5b00c5bb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000d800 tx=0x7fa5a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5ad600640 1 -- 172.21.15.29:0/3597922166 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000b6c0 con 0x7fa5b00cab00 2024-01-24T13:05:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5ad600640 1 -- 172.21.15.29:0/3597922166 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a000b820 con 0x7fa5b00cab00 2024-01-24T13:05:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b7e00640 1 -- 172.21.15.29:0/3597922166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b00c53b0 con 0x7fa5b00cab00 2024-01-24T13:05:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5ad600640 1 -- 172.21.15.29:0/3597922166 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000bb90 con 0x7fa5b00cab00 2024-01-24T13:05:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.370+0000 7fa5b7e00640 1 -- 172.21.15.29:0/3597922166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b00c6f00 con 0x7fa5b00cab00 2024-01-24T13:05:18.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.374+0000 7fa5b7e00640 1 -- 172.21.15.29:0/3597922166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b015e500 con 0x7fa5b00cab00 2024-01-24T13:05:18.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.374+0000 7fa5ad600640 1 -- 172.21.15.29:0/3597922166 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa5a000bcf0 con 0x7fa5b00cab00 2024-01-24T13:05:18.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.374+0000 7fa5ad600640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa588065a90 0x7fa588067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:18.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.374+0000 7fa5ad600640 1 -- 172.21.15.29:0/3597922166 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa5a0083570 con 0x7fa5b00cab00 2024-01-24T13:05:18.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.374+0000 7fa5b4a00640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa588065a90 0x7fa588067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:18.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.374+0000 7fa5b4a00640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa588065a90 0x7fa588067f50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0151d80 tx=0x7fa598007cb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:18.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.378+0000 7fa5ad600640 1 -- 172.21.15.29:0/3597922166 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa5a00510a0 con 0x7fa5b00cab00 2024-01-24T13:05:18.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.590+0000 7fa5b7e00640 1 -- 172.21.15.29:0/3597922166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fa5b004e850 con 0x7fa5b00cab00 2024-01-24T13:05:18.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.594+0000 7fa5ad600640 1 -- 172.21.15.29:0/3597922166 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa5a00546c0 con 0x7fa5b00cab00 2024-01-24T13:05:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.594+0000 7fa5b7e00640 1 -- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa588065a90 msgr2=0x7fa588067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.594+0000 7fa5b7e00640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa588065a90 0x7fa588067f50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0151d80 tx=0x7fa598007cb0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.594+0000 7fa5b7e00640 1 -- 172.21.15.29:0/3597922166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b00cab00 msgr2=0x7fa5b00c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.594+0000 7fa5b7e00640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b00cab00 0x7fa5b00c5bb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000d800 tx=0x7fa5a000dcc0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.594+0000 7fa5b7e00640 1 -- 172.21.15.29:0/3597922166 shutdown_connections 2024-01-24T13:05:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.594+0000 7fa5b7e00640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa588065a90 0x7fa588067f50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.594+0000 7fa5b7e00640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5b015e0f0 0x7fa5b01595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.594+0000 7fa5b7e00640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5b00cd160 0x7fa5b014fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.594+0000 7fa5b7e00640 1 --2- 172.21.15.29:0/3597922166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b00cab00 0x7fa5b00c5bb0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.594+0000 7fa5b7e00640 1 -- 172.21.15.29:0/3597922166 >> 172.21.15.29:0/3597922166 conn(0x7fa5b0069cd0 msgr2=0x7fa5b01514c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.594+0000 7fa5b7e00640 1 -- 172.21.15.29:0/3597922166 shutdown_connections 2024-01-24T13:05:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.594+0000 7fa5b7e00640 1 -- 172.21.15.29:0/3597922166 wait complete. 2024-01-24T13:05:18.621 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-24T13:05:18.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.758+0000 7f202b400640 1 Processor -- start 2024-01-24T13:05:18.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.758+0000 7f202b400640 1 -- start start 2024-01-24T13:05:18.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.762+0000 7f202b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f20240cbd60 0x7f20240cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:18.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.762+0000 7f202b400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20240cb4d0 0x7f20240c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:18.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.762+0000 7f202b400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20240cc680 con 0x7f20240cb040 2024-01-24T13:05:18.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.762+0000 7f202b400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20240ca630 con 0x7f20240cbd60 2024-01-24T13:05:18.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.762+0000 7f202b400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202415d7e0 con 0x7f20240cb4d0 2024-01-24T13:05:18.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.762+0000 7f2023e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f20240cb040 0x7f202415ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51578/0 (socket says 172.21.15.29:51578) 2024-01-24T13:05:18.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.762+0000 7f2028a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f20240cbd60 0x7f20240cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:18.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.762+0000 7f2023e00640 1 -- 172.21.15.29:0/3417395446 learned_addr learned my addr 172.21.15.29:0/3417395446 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:18.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.762+0000 7f2029400640 1 --2- 172.21.15.29:0/3417395446 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20240cb4d0 0x7f20240c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:18.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.762+0000 7f2028a00640 1 -- 172.21.15.29:0/3417395446 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20240cb4d0 msgr2=0x7f20240c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:18.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.762+0000 7f2028a00640 1 --2- 172.21.15.29:0/3417395446 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20240cb4d0 0x7f20240c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.762+0000 7f2028a00640 1 -- 172.21.15.29:0/3417395446 >> v1:172.21.15.29:6789/0 conn(0x7f20240cb040 legacy=0x7f202415ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:18.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.762+0000 7f2028a00640 1 -- 172.21.15.29:0/3417395446 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202415dac0 con 0x7f20240cbd60 2024-01-24T13:05:18.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.762+0000 7f2028a00640 1 --2- 172.21.15.29:0/3417395446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20240cbd60 0x7f20240cc140 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f20140097a0 tx=0x7f201401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaae090864f27dd server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:18.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f2023400640 1 -- 172.21.15.29:0/3417395446 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20140a7070 con 0x7f20240cbd60 2024-01-24T13:05:18.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f2023400640 1 -- 172.21.15.29:0/3417395446 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20140ab430 con 0x7f20240cbd60 2024-01-24T13:05:18.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f2023400640 1 -- 172.21.15.29:0/3417395446 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20140ab7c0 con 0x7f20240cbd60 2024-01-24T13:05:18.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 -- 172.21.15.29:0/3417395446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20240cbd60 msgr2=0x7f20240cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:18.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 --2- 172.21.15.29:0/3417395446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20240cbd60 0x7f20240cc140 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f20140097a0 tx=0x7f201401c430 comp rx=0 tx=0).stop 2024-01-24T13:05:18.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 -- 172.21.15.29:0/3417395446 shutdown_connections 2024-01-24T13:05:18.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 --2- 172.21.15.29:0/3417395446 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20240cb4d0 0x7f20240c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 --2- 172.21.15.29:0/3417395446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20240cbd60 0x7f20240cc140 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 -- 172.21.15.29:0/3417395446 >> 172.21.15.29:0/3417395446 conn(0x7f202406a2d0 msgr2=0x7f20240afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:18.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 -- 172.21.15.29:0/3417395446 shutdown_connections 2024-01-24T13:05:18.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 -- 172.21.15.29:0/3417395446 wait complete. 2024-01-24T13:05:18.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 Processor -- start 2024-01-24T13:05:18.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 -- start start 2024-01-24T13:05:18.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20240cb040 0x7f20241568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240cb4d0 0x7f2024153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20240cbd60 0x7f202414d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2024155070 con 0x7f20240cbd60 2024-01-24T13:05:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2024155c50 con 0x7f20240cb4d0 2024-01-24T13:05:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.766+0000 7f202b400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2024154460 con 0x7f20240cb040 2024-01-24T13:05:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2029400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20240cbd60 0x7f202414d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2029400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20240cbd60 0x7f202414d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49148/0 (socket says 172.21.15.29:49148) 2024-01-24T13:05:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2029400640 1 -- 172.21.15.29:0/2817597788 learned_addr learned my addr 172.21.15.29:0/2817597788 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2028a00640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20240cb040 0x7f20241568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2023e00640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240cb4d0 0x7f2024153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2029400640 1 -- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20240cb040 msgr2=0x7f20241568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2029400640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20240cb040 0x7f20241568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2029400640 1 -- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240cb4d0 msgr2=0x7f2024153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:18.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2029400640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240cb4d0 0x7f2024153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:18.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2029400640 1 -- 172.21.15.29:0/2817597788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20140093b0 con 0x7f20240cbd60 2024-01-24T13:05:18.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2023e00640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240cb4d0 0x7f2024153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:18.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2029400640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20240cbd60 0x7f202414d8c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f201c007e40 tx=0x7f201c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:18.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2020c00640 1 -- 172.21.15.29:0/2817597788 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c014620 con 0x7f20240cbd60 2024-01-24T13:05:18.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2020c00640 1 -- 172.21.15.29:0/2817597788 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c00ee90 con 0x7f20240cbd60 2024-01-24T13:05:18.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2020c00640 1 -- 172.21.15.29:0/2817597788 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0149e0 con 0x7f20240cbd60 2024-01-24T13:05:18.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f202b400640 1 -- 172.21.15.29:0/2817597788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2024154740 con 0x7f20240cbd60 2024-01-24T13:05:18.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f202b400640 1 -- 172.21.15.29:0/2817597788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2024154d00 con 0x7f20240cbd60 2024-01-24T13:05:18.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f202b400640 1 -- 172.21.15.29:0/2817597788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2024155220 con 0x7f20240cbd60 2024-01-24T13:05:18.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.770+0000 7f2020c00640 1 -- 172.21.15.29:0/2817597788 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f201c014b40 con 0x7f20240cbd60 2024-01-24T13:05:18.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.774+0000 7f2020c00640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1ffc065a60 0x7f1ffc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:18.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.774+0000 7f2020c00640 1 -- 172.21.15.29:0/2817597788 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f201c0838c0 con 0x7f20240cbd60 2024-01-24T13:05:18.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.774+0000 7f2028a00640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1ffc065a60 0x7f1ffc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:18.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.774+0000 7f2028a00640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1ffc065a60 0x7f1ffc067f20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f20140af000 tx=0x7f2014008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:18.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.778+0000 7f2020c00640 1 -- 172.21.15.29:0/2817597788 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2024155220 con 0x7f20240cbd60 2024-01-24T13:05:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.994+0000 7f202b400640 1 -- 172.21.15.29:0/2817597788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f202414de00 con 0x7f20240cbd60 2024-01-24T13:05:19.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.998+0000 7f2020c00640 1 -- 172.21.15.29:0/2817597788 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f201c051480 con 0x7f20240cbd60 2024-01-24T13:05:19.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.998+0000 7f202b400640 1 -- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1ffc065a60 msgr2=0x7f1ffc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.998+0000 7f202b400640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1ffc065a60 0x7f1ffc067f20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f20140af000 tx=0x7f2014008040 comp rx=0 tx=0).stop 2024-01-24T13:05:19.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.998+0000 7f202b400640 1 -- 172.21.15.29:0/2817597788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20240cbd60 msgr2=0x7f202414d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.998+0000 7f202b400640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20240cbd60 0x7f202414d8c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f201c007e40 tx=0x7f201c00e4b0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.998+0000 7f202b400640 1 -- 172.21.15.29:0/2817597788 shutdown_connections 2024-01-24T13:05:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.998+0000 7f202b400640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1ffc065a60 0x7f1ffc067f20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.998+0000 7f202b400640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20240cbd60 0x7f202414d8c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.998+0000 7f202b400640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20240cb4d0 0x7f2024153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.998+0000 7f202b400640 1 --2- 172.21.15.29:0/2817597788 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20240cb040 0x7f20241568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:18.998+0000 7f202b400640 1 -- 172.21.15.29:0/2817597788 >> 172.21.15.29:0/2817597788 conn(0x7f202406a2d0 msgr2=0x7f20240ce190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.002+0000 7f202b400640 1 -- 172.21.15.29:0/2817597788 shutdown_connections 2024-01-24T13:05:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.002+0000 7f202b400640 1 -- 172.21.15.29:0/2817597788 wait complete. 2024-01-24T13:05:19.024 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-24T13:05:19.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.162+0000 7fde6c800640 1 Processor -- start 2024-01-24T13:05:19.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.162+0000 7fde6c800640 1 -- start start 2024-01-24T13:05:19.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde6c800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fde64158c10 0x7fde640cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde6c800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde640cb880 con 0x7fde640cb110 2024-01-24T13:05:19.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde6c800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde640ccd40 con 0x7fde6415c790 2024-01-24T13:05:19.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde6c800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde640701c0 con 0x7fde64158c10 2024-01-24T13:05:19.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde6a800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fde640cb110 0x7fde640c8a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51582/0 (socket says 172.21.15.29:51582) 2024-01-24T13:05:19.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde6a800640 1 -- 172.21.15.29:0/3793994684 learned_addr learned my addr 172.21.15.29:0/3793994684 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:19.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde69e00640 1 --2- 172.21.15.29:0/3793994684 >> v2:172.21.15.163:3300/0 conn(0x7fde64158c10 0x7fde640cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 -- 172.21.15.29:0/3793994684 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113314067 0 0) 0x7fde640cb880 con 0x7fde640cb110 2024-01-24T13:05:19.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 -- 172.21.15.29:0/3793994684 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde44003450 con 0x7fde640cb110 2024-01-24T13:05:19.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 -- 172.21.15.29:0/3793994684 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1101373183 0 0) 0x7fde44003450 con 0x7fde640cb110 2024-01-24T13:05:19.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 -- 172.21.15.29:0/3793994684 >> v2:172.21.15.163:3300/0 conn(0x7fde64158c10 msgr2=0x7fde640cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:19.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 --2- 172.21.15.29:0/3793994684 >> v2:172.21.15.163:3300/0 conn(0x7fde64158c10 0x7fde640cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 -- 172.21.15.29:0/3793994684 >> v1:172.21.15.163:6789/0 conn(0x7fde6415c790 legacy=0x7fde640caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 -- 172.21.15.29:0/3793994684 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde640cd020 con 0x7fde640cb110 2024-01-24T13:05:19.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 -- 172.21.15.29:0/3793994684 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7fde5c001a00 con 0x7fde640cb110 2024-01-24T13:05:19.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 -- 172.21.15.29:0/3793994684 >> v1:172.21.15.29:6789/0 conn(0x7fde640cb110 legacy=0x7fde640c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 --2- 172.21.15.29:0/3793994684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde44003ac0 0x7fde44003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 --2- 172.21.15.29:0/3793994684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde44008860 0x7fde4400acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 --2- 172.21.15.29:0/3793994684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde4400b540 0x7fde4400da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 -- 172.21.15.29:0/3793994684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde640701c0 con 0x7fde4400b540 2024-01-24T13:05:19.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 -- 172.21.15.29:0/3793994684 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4400e2e0 con 0x7fde44008860 2024-01-24T13:05:19.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde68a00640 1 -- 172.21.15.29:0/3793994684 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4400e4a0 con 0x7fde44003ac0 2024-01-24T13:05:19.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde6a800640 1 --2- 172.21.15.29:0/3793994684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde4400b540 0x7fde4400da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde69e00640 1 --2- 172.21.15.29:0/3793994684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde44003ac0 0x7fde44003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde69400640 1 --2- 172.21.15.29:0/3793994684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde44008860 0x7fde4400acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde6a800640 1 -- 172.21.15.29:0/3793994684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde44003ac0 msgr2=0x7fde44003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:19.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde6a800640 1 --2- 172.21.15.29:0/3793994684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde44003ac0 0x7fde44003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde6a800640 1 -- 172.21.15.29:0/3793994684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde44008860 msgr2=0x7fde4400acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:19.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde6a800640 1 --2- 172.21.15.29:0/3793994684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde44008860 0x7fde4400acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde6a800640 1 -- 172.21.15.29:0/3793994684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde44003450 con 0x7fde4400b540 2024-01-24T13:05:19.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.166+0000 7fde69400640 1 --2- 172.21.15.29:0/3793994684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde44008860 0x7fde4400acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.170+0000 7fde6a800640 1 -- 172.21.15.29:0/3793994684 reap_dead start 2024-01-24T13:05:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.170+0000 7fde6a800640 1 --2- 172.21.15.29:0/3793994684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde4400b540 0x7fde4400da00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00a760 tx=0x7fde5c01d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb51e2870c995d5b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.170+0000 7fde68a00640 1 -- 172.21.15.29:0/3793994684 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c0ad630 con 0x7fde4400b540 2024-01-24T13:05:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.170+0000 7fde68a00640 1 -- 172.21.15.29:0/3793994684 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c0a8070 con 0x7fde4400b540 2024-01-24T13:05:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.170+0000 7fde68a00640 1 -- 172.21.15.29:0/3793994684 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c0ada10 con 0x7fde4400b540 2024-01-24T13:05:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.170+0000 7fde6c800640 1 -- 172.21.15.29:0/3793994684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde4400b540 msgr2=0x7fde4400da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.170+0000 7fde6c800640 1 --2- 172.21.15.29:0/3793994684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde4400b540 0x7fde4400da00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00a760 tx=0x7fde5c01d260 comp rx=0 tx=0).stop 2024-01-24T13:05:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.170+0000 7fde6c800640 1 -- 172.21.15.29:0/3793994684 shutdown_connections 2024-01-24T13:05:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.170+0000 7fde6c800640 1 --2- 172.21.15.29:0/3793994684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde4400b540 0x7fde4400da00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.170+0000 7fde6c800640 1 -- 172.21.15.29:0/3793994684 >> 172.21.15.29:0/3793994684 conn(0x7fde6406a2d0 msgr2=0x7fde640afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.170+0000 7fde6c800640 1 -- 172.21.15.29:0/3793994684 shutdown_connections 2024-01-24T13:05:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.170+0000 7fde6c800640 1 -- 172.21.15.29:0/3793994684 wait complete. 2024-01-24T13:05:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6c800640 1 Processor -- start 2024-01-24T13:05:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6c800640 1 -- start start 2024-01-24T13:05:19.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6c800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde4400b540 0x7fde64150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6c800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde64151210 0x7fde640c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6c800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde64151760 0x7fde640c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6c800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde64159f50 con 0x7fde64151760 2024-01-24T13:05:19.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6c800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde64158ff0 con 0x7fde4400b540 2024-01-24T13:05:19.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6c800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde641592d0 con 0x7fde64151210 2024-01-24T13:05:19.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6a800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde64151760 0x7fde640c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6a800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde64151760 0x7fde640c6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49172/0 (socket says 172.21.15.29:49172) 2024-01-24T13:05:19.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6a800640 1 -- 172.21.15.29:0/1173197954 learned_addr learned my addr 172.21.15.29:0/1173197954 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:19.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde69e00640 1 --2- 172.21.15.29:0/1173197954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde4400b540 0x7fde64150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde69400640 1 --2- 172.21.15.29:0/1173197954 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde64151210 0x7fde640c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6a800640 1 -- 172.21.15.29:0/1173197954 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde64151210 msgr2=0x7fde640c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6a800640 1 --2- 172.21.15.29:0/1173197954 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde64151210 0x7fde640c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6a800640 1 -- 172.21.15.29:0/1173197954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde4400b540 msgr2=0x7fde64150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6a800640 1 --2- 172.21.15.29:0/1173197954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde4400b540 0x7fde64150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6a800640 1 -- 172.21.15.29:0/1173197954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde641595b0 con 0x7fde64151760 2024-01-24T13:05:19.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6a800640 1 --2- 172.21.15.29:0/1173197954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde64151760 0x7fde640c6350 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fde5c01db00 tx=0x7fde44003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:19.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde62000640 1 -- 172.21.15.29:0/1173197954 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c001940 con 0x7fde64151760 2024-01-24T13:05:19.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde62000640 1 -- 172.21.15.29:0/1173197954 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c0ad640 con 0x7fde64151760 2024-01-24T13:05:19.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6c800640 1 -- 172.21.15.29:0/1173197954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde64159890 con 0x7fde64151760 2024-01-24T13:05:19.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde62000640 1 -- 172.21.15.29:0/1173197954 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c0ad9b0 con 0x7fde64151760 2024-01-24T13:05:19.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.174+0000 7fde6c800640 1 -- 172.21.15.29:0/1173197954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde641e2590 con 0x7fde64151760 2024-01-24T13:05:19.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.178+0000 7fde6c800640 1 -- 172.21.15.29:0/1173197954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde640c8330 con 0x7fde64151760 2024-01-24T13:05:19.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.178+0000 7fde62000640 1 -- 172.21.15.29:0/1173197954 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fde5c0aa030 con 0x7fde64151760 2024-01-24T13:05:19.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.178+0000 7fde62000640 1 --2- 172.21.15.29:0/1173197954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fde3c065a60 0x7fde3c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.178+0000 7fde62000640 1 -- 172.21.15.29:0/1173197954 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fde5c0a5e40 con 0x7fde64151760 2024-01-24T13:05:19.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.178+0000 7fde69e00640 1 --2- 172.21.15.29:0/1173197954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fde3c065a60 0x7fde3c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.178+0000 7fde69e00640 1 --2- 172.21.15.29:0/1173197954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fde3c065a60 0x7fde3c067f20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fde54009b40 tx=0x7fde54006f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:19.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.182+0000 7fde62000640 1 -- 172.21.15.29:0/1173197954 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fde5c0eab90 con 0x7fde64151760 2024-01-24T13:05:19.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.394+0000 7fde6c800640 1 -- 172.21.15.29:0/1173197954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fde6404e850 con 0x7fde64151760 2024-01-24T13:05:19.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.398+0000 7fde62000640 1 -- 172.21.15.29:0/1173197954 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fde5c0ee1b0 con 0x7fde64151760 2024-01-24T13:05:19.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.402+0000 7fde6c800640 1 -- 172.21.15.29:0/1173197954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fde3c065a60 msgr2=0x7fde3c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.402+0000 7fde6c800640 1 --2- 172.21.15.29:0/1173197954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fde3c065a60 0x7fde3c067f20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fde54009b40 tx=0x7fde54006f90 comp rx=0 tx=0).stop 2024-01-24T13:05:19.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.402+0000 7fde6c800640 1 -- 172.21.15.29:0/1173197954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde64151760 msgr2=0x7fde640c6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.402+0000 7fde6c800640 1 --2- 172.21.15.29:0/1173197954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde64151760 0x7fde640c6350 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fde5c01db00 tx=0x7fde44003700 comp rx=0 tx=0).stop 2024-01-24T13:05:19.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.402+0000 7fde6c800640 1 -- 172.21.15.29:0/1173197954 shutdown_connections 2024-01-24T13:05:19.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.402+0000 7fde6c800640 1 --2- 172.21.15.29:0/1173197954 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fde3c065a60 0x7fde3c067f20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.402+0000 7fde6c800640 1 --2- 172.21.15.29:0/1173197954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde64151760 0x7fde640c6350 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.402+0000 7fde6c800640 1 --2- 172.21.15.29:0/1173197954 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde64151210 0x7fde640c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.402+0000 7fde6c800640 1 --2- 172.21.15.29:0/1173197954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde4400b540 0x7fde64150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.402+0000 7fde6c800640 1 -- 172.21.15.29:0/1173197954 >> 172.21.15.29:0/1173197954 conn(0x7fde6406a2d0 msgr2=0x7fde64071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:19.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.402+0000 7fde6c800640 1 -- 172.21.15.29:0/1173197954 shutdown_connections 2024-01-24T13:05:19.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.402+0000 7fde6c800640 1 -- 172.21.15.29:0/1173197954 wait complete. 2024-01-24T13:05:19.426 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-24T13:05:19.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.562+0000 7f5120c00640 1 Processor -- start 2024-01-24T13:05:19.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.566+0000 7f5120c00640 1 -- start start 2024-01-24T13:05:19.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.566+0000 7f5120c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f511c0cd160 0x7f511c0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.566+0000 7f5120c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c15ba80 con 0x7f511c0cab00 2024-01-24T13:05:19.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.566+0000 7f5120c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c15e920 con 0x7f511c15e0f0 2024-01-24T13:05:19.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.566+0000 7f5120c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c15ec00 con 0x7f511c0cd160 2024-01-24T13:05:19.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.566+0000 7f5119e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f511c0cd160 0x7f511c0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.566+0000 7f511a800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f511c0cab00 0x7f511c0ce080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51588/0 (socket says 172.21.15.29:51588) 2024-01-24T13:05:19.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.566+0000 7f511a800640 1 -- 172.21.15.29:0/2819535452 learned_addr learned my addr 172.21.15.29:0/2819535452 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:19.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.566+0000 7f5119e00640 1 -- 172.21.15.29:0/2819535452 >> v1:172.21.15.163:6789/0 conn(0x7f511c15e0f0 legacy=0x7f511c15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.566+0000 7f5119e00640 1 -- 172.21.15.29:0/2819535452 >> v1:172.21.15.29:6789/0 conn(0x7f511c0cab00 legacy=0x7f511c0ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.566+0000 7f5118a00640 1 -- 172.21.15.29:0/2819535452 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497034319 0 0) 0x7f511c15ba80 con 0x7f511c0cab00 2024-01-24T13:05:19.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.566+0000 7f5119e00640 1 -- 172.21.15.29:0/2819535452 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c15eee0 con 0x7f511c0cd160 2024-01-24T13:05:19.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.570+0000 7f5119e00640 1 --2- 172.21.15.29:0/2819535452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0cd160 0x7f511c0cd540 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f510c0097c0 tx=0x7f510c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93301a96a9851586 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:19.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.570+0000 7f5118a00640 1 -- 172.21.15.29:0/2819535452 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0ad680 con 0x7f511c0cd160 2024-01-24T13:05:19.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.570+0000 7f5118a00640 1 -- 172.21.15.29:0/2819535452 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c0ad7e0 con 0x7f511c0cd160 2024-01-24T13:05:19.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.570+0000 7f5118a00640 1 -- 172.21.15.29:0/2819535452 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0adb70 con 0x7f511c0cd160 2024-01-24T13:05:19.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.570+0000 7f5120c00640 1 -- 172.21.15.29:0/2819535452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0cd160 msgr2=0x7f511c0cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.570+0000 7f5120c00640 1 --2- 172.21.15.29:0/2819535452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0cd160 0x7f511c0cd540 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f510c0097c0 tx=0x7f510c01c450 comp rx=0 tx=0).stop 2024-01-24T13:05:19.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.570+0000 7f5120c00640 1 -- 172.21.15.29:0/2819535452 shutdown_connections 2024-01-24T13:05:19.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.570+0000 7f5120c00640 1 --2- 172.21.15.29:0/2819535452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0cd160 0x7f511c0cd540 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.570+0000 7f5120c00640 1 -- 172.21.15.29:0/2819535452 >> 172.21.15.29:0/2819535452 conn(0x7f511c069cd0 msgr2=0x7f511c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:19.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.570+0000 7f5120c00640 1 -- 172.21.15.29:0/2819535452 shutdown_connections 2024-01-24T13:05:19.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.570+0000 7f5120c00640 1 -- 172.21.15.29:0/2819535452 wait complete. 2024-01-24T13:05:19.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.570+0000 7f5120c00640 1 Processor -- start 2024-01-24T13:05:19.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.570+0000 7f5120c00640 1 -- start start 2024-01-24T13:05:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5120c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0cab00 0x7f511c0ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5120c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f511c0cd160 0x7f511c15d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5120c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f511c15e0f0 0x7f511c06c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5120c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c15d030 con 0x7f511c0cab00 2024-01-24T13:05:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5120c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c15db00 con 0x7f511c15e0f0 2024-01-24T13:05:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5120c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c0c9b80 con 0x7f511c0cd160 2024-01-24T13:05:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5119e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0cab00 0x7f511c0ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5119e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0cab00 0x7f511c0ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49186/0 (socket says 172.21.15.29:49186) 2024-01-24T13:05:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5119e00640 1 -- 172.21.15.29:0/2871443556 learned_addr learned my addr 172.21.15.29:0/2871443556 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f511a800640 1 --2- 172.21.15.29:0/2871443556 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f511c15e0f0 0x7f511c06c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5119400640 1 --2- 172.21.15.29:0/2871443556 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f511c0cd160 0x7f511c15d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5119e00640 1 -- 172.21.15.29:0/2871443556 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f511c0cd160 msgr2=0x7f511c15d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5119e00640 1 --2- 172.21.15.29:0/2871443556 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f511c0cd160 0x7f511c15d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5119e00640 1 -- 172.21.15.29:0/2871443556 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f511c15e0f0 msgr2=0x7f511c06c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5119e00640 1 --2- 172.21.15.29:0/2871443556 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f511c15e0f0 0x7f511c06c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5119e00640 1 -- 172.21.15.29:0/2871443556 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c009420 con 0x7f511c0cab00 2024-01-24T13:05:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5119e00640 1 --2- 172.21.15.29:0/2871443556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0cab00 0x7f511c0ca010 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f510c01a080 tx=0x7f510c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5112000640 1 -- 172.21.15.29:0/2871443556 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0ade60 con 0x7f511c0cab00 2024-01-24T13:05:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5112000640 1 -- 172.21.15.29:0/2871443556 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c0b8420 con 0x7f511c0cab00 2024-01-24T13:05:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5112000640 1 -- 172.21.15.29:0/2871443556 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0b87b0 con 0x7f511c0cab00 2024-01-24T13:05:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5120c00640 1 -- 172.21.15.29:0/2871443556 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c0cb4a0 con 0x7f511c0cab00 2024-01-24T13:05:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5120c00640 1 -- 172.21.15.29:0/2871443556 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c0c9530 con 0x7f511c0cab00 2024-01-24T13:05:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.574+0000 7f5120c00640 1 -- 172.21.15.29:0/2871443556 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511c04e850 con 0x7f511c0cab00 2024-01-24T13:05:19.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.578+0000 7f5112000640 1 -- 172.21.15.29:0/2871443556 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f510c0b4040 con 0x7f511c0cab00 2024-01-24T13:05:19.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.578+0000 7f5112000640 1 --2- 172.21.15.29:0/2871443556 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f50f4065a60 0x7f50f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.578+0000 7f5112000640 1 -- 172.21.15.29:0/2871443556 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f510c11d4e0 con 0x7f511c0cab00 2024-01-24T13:05:19.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.578+0000 7f5119400640 1 --2- 172.21.15.29:0/2871443556 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f50f4065a60 0x7f50f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.578+0000 7f5119400640 1 --2- 172.21.15.29:0/2871443556 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f50f4065a60 0x7f50f4067f20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f511c1f8830 tx=0x7f5104009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:19.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.582+0000 7f5112000640 1 -- 172.21.15.29:0/2871443556 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f510c0eb1f0 con 0x7f511c0cab00 2024-01-24T13:05:19.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.798+0000 7f5120c00640 1 -- 172.21.15.29:0/2871443556 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f511c0b2a90 con 0x7f511c0cab00 2024-01-24T13:05:19.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.802+0000 7f5112000640 1 -- 172.21.15.29:0/2871443556 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f510c0ee810 con 0x7f511c0cab00 2024-01-24T13:05:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.806+0000 7f5120c00640 1 -- 172.21.15.29:0/2871443556 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f50f4065a60 msgr2=0x7f50f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.806+0000 7f5120c00640 1 --2- 172.21.15.29:0/2871443556 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f50f4065a60 0x7f50f4067f20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f511c1f8830 tx=0x7f5104009040 comp rx=0 tx=0).stop 2024-01-24T13:05:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.806+0000 7f5120c00640 1 -- 172.21.15.29:0/2871443556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0cab00 msgr2=0x7f511c0ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.806+0000 7f5120c00640 1 --2- 172.21.15.29:0/2871443556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0cab00 0x7f511c0ca010 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f510c01a080 tx=0x7f510c01ac90 comp rx=0 tx=0).stop 2024-01-24T13:05:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.806+0000 7f5120c00640 1 -- 172.21.15.29:0/2871443556 shutdown_connections 2024-01-24T13:05:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.806+0000 7f5120c00640 1 --2- 172.21.15.29:0/2871443556 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f50f4065a60 0x7f50f4067f20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.806+0000 7f5120c00640 1 --2- 172.21.15.29:0/2871443556 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f511c15e0f0 0x7f511c06c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.806+0000 7f5120c00640 1 --2- 172.21.15.29:0/2871443556 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f511c0cd160 0x7f511c15d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.806+0000 7f5120c00640 1 --2- 172.21.15.29:0/2871443556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0cab00 0x7f511c0ca010 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.806+0000 7f5120c00640 1 -- 172.21.15.29:0/2871443556 >> 172.21.15.29:0/2871443556 conn(0x7f511c069cd0 msgr2=0x7f511c0afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.806+0000 7f5120c00640 1 -- 172.21.15.29:0/2871443556 shutdown_connections 2024-01-24T13:05:19.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.806+0000 7f5120c00640 1 -- 172.21.15.29:0/2871443556 wait complete. 2024-01-24T13:05:19.828 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:19.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.966+0000 7f75a9c00640 1 Processor -- start 2024-01-24T13:05:19.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.966+0000 7f75a9c00640 1 -- start start 2024-01-24T13:05:19.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.966+0000 7f75a9c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f75a415c770 0x7f75a406d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.966+0000 7f75a9c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a415cb50 con 0x7f75a40cedc0 2024-01-24T13:05:19.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.966+0000 7f75a9c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a4070f20 con 0x7f75a40cfe80 2024-01-24T13:05:19.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.966+0000 7f75a9c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a4070d10 con 0x7f75a415c770 2024-01-24T13:05:19.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.966+0000 7f75a2a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f75a415c770 0x7f75a406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.966+0000 7f75a2000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f75a40cedc0 0x7f75a40cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51590/0 (socket says 172.21.15.29:51590) 2024-01-24T13:05:19.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.966+0000 7f75a2000640 1 -- 172.21.15.29:0/2774490419 learned_addr learned my addr 172.21.15.29:0/2774490419 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:19.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.966+0000 7f75a2a00640 1 -- 172.21.15.29:0/2774490419 >> v1:172.21.15.163:6789/0 conn(0x7f75a40cfe80 legacy=0x7f75a40cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:19.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.966+0000 7f75a2a00640 1 -- 172.21.15.29:0/2774490419 >> v1:172.21.15.29:6789/0 conn(0x7f75a40cedc0 legacy=0x7f75a40cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.966+0000 7f75a2a00640 1 -- 172.21.15.29:0/2774490419 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4071200 con 0x7f75a415c770 2024-01-24T13:05:19.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.970+0000 7f75a2a00640 1 --2- 172.21.15.29:0/2774490419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75a415c770 0x7f75a406d100 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f75940097c0 tx=0x7f75a40cdda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b212066b32815fc6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:19.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.970+0000 7f75a1600640 1 -- 172.21.15.29:0/2774490419 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75940ad680 con 0x7f75a415c770 2024-01-24T13:05:19.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.970+0000 7f75a1600640 1 -- 172.21.15.29:0/2774490419 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75940ad7e0 con 0x7f75a415c770 2024-01-24T13:05:19.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.970+0000 7f75a1600640 1 -- 172.21.15.29:0/2774490419 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75940adb70 con 0x7f75a415c770 2024-01-24T13:05:19.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.970+0000 7f75a9c00640 1 -- 172.21.15.29:0/2774490419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75a415c770 msgr2=0x7f75a406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.970+0000 7f75a9c00640 1 --2- 172.21.15.29:0/2774490419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75a415c770 0x7f75a406d100 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f75940097c0 tx=0x7f75a40cdda0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.970+0000 7f75a9c00640 1 -- 172.21.15.29:0/2774490419 shutdown_connections 2024-01-24T13:05:19.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.970+0000 7f75a9c00640 1 --2- 172.21.15.29:0/2774490419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75a415c770 0x7f75a406d100 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.970+0000 7f75a9c00640 1 -- 172.21.15.29:0/2774490419 >> 172.21.15.29:0/2774490419 conn(0x7f75a406b1e0 msgr2=0x7f75a406b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:19.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.970+0000 7f75a9c00640 1 -- 172.21.15.29:0/2774490419 shutdown_connections 2024-01-24T13:05:19.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.970+0000 7f75a9c00640 1 -- 172.21.15.29:0/2774490419 wait complete. 2024-01-24T13:05:19.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a9c00640 1 Processor -- start 2024-01-24T13:05:19.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a9c00640 1 -- start start 2024-01-24T13:05:19.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a9c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75a40cedc0 0x7f75a40b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a9c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75a40cfe80 0x7f75a40b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a9c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75a415c770 0x7f75a40acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a9c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40b4da0 con 0x7f75a40cfe80 2024-01-24T13:05:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a9c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40abe70 con 0x7f75a415c770 2024-01-24T13:05:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a9c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40ac150 con 0x7f75a40cedc0 2024-01-24T13:05:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a2000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75a40cfe80 0x7f75a40b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a2000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75a40cfe80 0x7f75a40b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49204/0 (socket says 172.21.15.29:49204) 2024-01-24T13:05:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a2000640 1 -- 172.21.15.29:0/3000148975 learned_addr learned my addr 172.21.15.29:0/3000148975 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a3400640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75a415c770 0x7f75a40acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a2a00640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75a40cedc0 0x7f75a40b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a2000640 1 -- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75a40cedc0 msgr2=0x7f75a40b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a2000640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75a40cedc0 0x7f75a40b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a2000640 1 -- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75a415c770 msgr2=0x7f75a40acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a2000640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75a415c770 0x7f75a40acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a2000640 1 -- 172.21.15.29:0/3000148975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7594009420 con 0x7f75a40cfe80 2024-01-24T13:05:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a3400640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75a415c770 0x7f75a40acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a2000640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75a40cfe80 0x7f75a40b05c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f758c00c500 tx=0x7f758c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:19.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f759aa00640 1 -- 172.21.15.29:0/3000148975 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c005cf0 con 0x7f75a40cfe80 2024-01-24T13:05:19.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f759aa00640 1 -- 172.21.15.29:0/3000148975 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c005e50 con 0x7f75a40cfe80 2024-01-24T13:05:19.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a9c00640 1 -- 172.21.15.29:0/3000148975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a40ac430 con 0x7f75a40cfe80 2024-01-24T13:05:19.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f759aa00640 1 -- 172.21.15.29:0/3000148975 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0072f0 con 0x7f75a40cfe80 2024-01-24T13:05:19.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a9c00640 1 -- 172.21.15.29:0/3000148975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a40ac9f0 con 0x7f75a40cfe80 2024-01-24T13:05:19.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.974+0000 7f75a9c00640 1 -- 172.21.15.29:0/3000148975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a40acbe0 con 0x7f75a40cfe80 2024-01-24T13:05:19.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.978+0000 7f759aa00640 1 -- 172.21.15.29:0/3000148975 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f758c007450 con 0x7f75a40cfe80 2024-01-24T13:05:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.978+0000 7f759aa00640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f757c065a60 0x7f757c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.978+0000 7f759aa00640 1 -- 172.21.15.29:0/3000148975 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f758c0824f0 con 0x7f75a40cfe80 2024-01-24T13:05:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.978+0000 7f75a2a00640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f757c065a60 0x7f757c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:19.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.978+0000 7f75a2a00640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f757c065a60 0x7f757c067f20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f75940af000 tx=0x7f7594004740 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:19.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:19.982+0000 7f759aa00640 1 -- 172.21.15.29:0/3000148975 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f758c0500e0 con 0x7f75a40cfe80 2024-01-24T13:05:20.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.138+0000 7f75a9c00640 1 -- 172.21.15.29:0/3000148975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75a404e850 con 0x7f75a40cfe80 2024-01-24T13:05:20.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.138+0000 7f759aa00640 1 -- 172.21.15.29:0/3000148975 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12594 (secure 0 0 0) 0x7f758c053700 con 0x7f75a40cfe80 2024-01-24T13:05:20.144 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:20.144 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":39,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:05:16.994247+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:20.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.142+0000 7f75a9c00640 1 -- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f757c065a60 msgr2=0x7f757c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.142+0000 7f75a9c00640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f757c065a60 0x7f757c067f20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f75940af000 tx=0x7f7594004740 comp rx=0 tx=0).stop 2024-01-24T13:05:20.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.142+0000 7f75a9c00640 1 -- 172.21.15.29:0/3000148975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75a40cfe80 msgr2=0x7f75a40b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.142+0000 7f75a9c00640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75a40cfe80 0x7f75a40b05c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f758c00c500 tx=0x7f758c00c9c0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.142+0000 7f75a9c00640 1 -- 172.21.15.29:0/3000148975 shutdown_connections 2024-01-24T13:05:20.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.142+0000 7f75a9c00640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f757c065a60 0x7f757c067f20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.142+0000 7f75a9c00640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75a415c770 0x7f75a40acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.142+0000 7f75a9c00640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75a40cfe80 0x7f75a40b05c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.142+0000 7f75a9c00640 1 --2- 172.21.15.29:0/3000148975 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75a40cedc0 0x7f75a40b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.142+0000 7f75a9c00640 1 -- 172.21.15.29:0/3000148975 >> 172.21.15.29:0/3000148975 conn(0x7f75a406b1e0 msgr2=0x7f75a40c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:20.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.142+0000 7f75a9c00640 1 -- 172.21.15.29:0/3000148975 shutdown_connections 2024-01-24T13:05:20.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.142+0000 7f75a9c00640 1 -- 172.21.15.29:0/3000148975 wait complete. 2024-01-24T13:05:20.167 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:05:20.167 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:05:20.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.306+0000 7f9678a00640 1 Processor -- start 2024-01-24T13:05:20.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.306+0000 7f9678a00640 1 -- start start 2024-01-24T13:05:20.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.306+0000 7f9678a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96700cd300 0x7f967015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:20.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.306+0000 7f9678a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96700ce4e0 0x7f96700d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:20.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.306+0000 7f9678a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9670161130 con 0x7f96700ce050 2024-01-24T13:05:20.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.306+0000 7f9678a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967015dbe0 con 0x7f96700cd300 2024-01-24T13:05:20.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.306+0000 7f9678a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96701605b0 con 0x7f96700ce4e0 2024-01-24T13:05:20.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.310+0000 7f9676000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96700cd300 0x7f967015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:20.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.310+0000 7f9676000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96700cd300 0x7f967015d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49206/0 (socket says 172.21.15.29:49206) 2024-01-24T13:05:20.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.310+0000 7f9676a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96700ce4e0 0x7f96700d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:20.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.310+0000 7f9675600640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f96700ce050 0x7f96700d0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:34244/0 (socket says 172.21.15.29:34244) 2024-01-24T13:05:20.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.310+0000 7f9676000640 1 -- 172.21.15.29:0/1171283165 learned_addr learned my addr 172.21.15.29:0/1171283165 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:20.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.310+0000 7f9676000640 1 -- 172.21.15.29:0/1171283165 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96700ce4e0 msgr2=0x7f96700d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:20.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.310+0000 7f9676000640 1 --2- 172.21.15.29:0/1171283165 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96700ce4e0 0x7f96700d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.310+0000 7f9676000640 1 -- 172.21.15.29:0/1171283165 >> v1:172.21.15.163:6789/0 conn(0x7f96700ce050 legacy=0x7f96700d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.310+0000 7f9676000640 1 -- 172.21.15.29:0/1171283165 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9670160890 con 0x7f96700cd300 2024-01-24T13:05:20.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.310+0000 7f9674c00640 1 -- 172.21.15.29:0/1171283165 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550428404 0 0) 0x7f9670161130 con 0x7f96700ce050 2024-01-24T13:05:20.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.310+0000 7f9676000640 1 --2- 172.21.15.29:0/1171283165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96700cd300 0x7f967015d6a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9660009870 tx=0x7f966001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc17446d86dbac3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:20.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.310+0000 7f9674c00640 1 -- 172.21.15.29:0/1171283165 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96600a9400 con 0x7f96700cd300 2024-01-24T13:05:20.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.310+0000 7f9674c00640 1 -- 172.21.15.29:0/1171283165 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96600a9560 con 0x7f96700cd300 2024-01-24T13:05:20.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.310+0000 7f9674c00640 1 -- 172.21.15.29:0/1171283165 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96600a98f0 con 0x7f96700cd300 2024-01-24T13:05:20.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 -- 172.21.15.29:0/1171283165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96700cd300 msgr2=0x7f967015d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 --2- 172.21.15.29:0/1171283165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96700cd300 0x7f967015d6a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9660009870 tx=0x7f966001c540 comp rx=0 tx=0).stop 2024-01-24T13:05:20.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 -- 172.21.15.29:0/1171283165 shutdown_connections 2024-01-24T13:05:20.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 --2- 172.21.15.29:0/1171283165 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96700ce4e0 0x7f96700d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 --2- 172.21.15.29:0/1171283165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96700cd300 0x7f967015d6a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 -- 172.21.15.29:0/1171283165 >> 172.21.15.29:0/1171283165 conn(0x7f9670069cd0 msgr2=0x7f967006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:20.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 -- 172.21.15.29:0/1171283165 shutdown_connections 2024-01-24T13:05:20.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 -- 172.21.15.29:0/1171283165 wait complete. 2024-01-24T13:05:20.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 Processor -- start 2024-01-24T13:05:20.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 -- start start 2024-01-24T13:05:20.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96700cd300 0x7f96700ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:20.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96700ce050 0x7f96700aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:20.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96700ce4e0 0x7f9670156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:20.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96700af020 con 0x7f96700ce4e0 2024-01-24T13:05:20.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96700af2c0 con 0x7f96700ce050 2024-01-24T13:05:20.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.314+0000 7f9678a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96700af5a0 con 0x7f96700cd300 2024-01-24T13:05:20.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9676a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96700ce4e0 0x7f9670156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:20.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9676000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96700cd300 0x7f96700ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:20.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9675600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96700ce050 0x7f96700aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:20.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9676a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96700ce4e0 0x7f9670156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49210/0 (socket says 172.21.15.29:49210) 2024-01-24T13:05:20.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9676a00640 1 -- 172.21.15.29:0/3683772078 learned_addr learned my addr 172.21.15.29:0/3683772078 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:20.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9676000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96700cd300 0x7f96700ac750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:54382/0 (socket says 172.21.15.29:54382) 2024-01-24T13:05:20.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9676000640 1 -- 172.21.15.29:0/3683772078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96700ce050 msgr2=0x7f96700aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9676000640 1 --2- 172.21.15.29:0/3683772078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96700ce050 0x7f96700aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9676000640 1 -- 172.21.15.29:0/3683772078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96700ce4e0 msgr2=0x7f9670156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9676000640 1 --2- 172.21.15.29:0/3683772078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96700ce4e0 0x7f9670156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9676000640 1 -- 172.21.15.29:0/3683772078 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96600094d0 con 0x7f96700cd300 2024-01-24T13:05:20.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9676a00640 1 --2- 172.21.15.29:0/3683772078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96700ce4e0 0x7f9670156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:20.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9676000640 1 --2- 172.21.15.29:0/3683772078 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96700cd300 0x7f96700ac750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f96600aa000 tx=0x7f96600192e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:20.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f966e000640 1 -- 172.21.15.29:0/3683772078 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96600a9400 con 0x7f96700cd300 2024-01-24T13:05:20.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f966e000640 1 -- 172.21.15.29:0/3683772078 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96600b5070 con 0x7f96700cd300 2024-01-24T13:05:20.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f966e000640 1 -- 172.21.15.29:0/3683772078 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96600b1a60 con 0x7f96700cd300 2024-01-24T13:05:20.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9678a00640 1 -- 172.21.15.29:0/3683772078 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96700b44f0 con 0x7f96700cd300 2024-01-24T13:05:20.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9678a00640 1 -- 172.21.15.29:0/3683772078 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9670156990 con 0x7f96700cd300 2024-01-24T13:05:20.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f9678a00640 1 -- 172.21.15.29:0/3683772078 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96700b4350 con 0x7f96700cd300 2024-01-24T13:05:20.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.318+0000 7f966e000640 1 -- 172.21.15.29:0/3683772078 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f96600b1bc0 con 0x7f96700cd300 2024-01-24T13:05:20.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.322+0000 7f966e000640 1 --2- 172.21.15.29:0/3683772078 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9648065a60 0x7f9648067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:20.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.322+0000 7f966e000640 1 -- 172.21.15.29:0/3683772078 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f96600b7070 con 0x7f96700cd300 2024-01-24T13:05:20.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.322+0000 7f9675600640 1 --2- 172.21.15.29:0/3683772078 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9648065a60 0x7f9648067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:20.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.322+0000 7f9675600640 1 --2- 172.21.15.29:0/3683772078 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9648065a60 0x7f9648067f20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f96700abbd0 tx=0x7f9658007df0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:20.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.326+0000 7f966e000640 1 -- 172.21.15.29:0/3683772078 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f96700b4350 con 0x7f96700cd300 2024-01-24T13:05:20.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.486+0000 7f9678a00640 1 -- 172.21.15.29:0/3683772078 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96700b4350 con 0x7f96700cd300 2024-01-24T13:05:20.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.486+0000 7f966e000640 1 -- 172.21.15.29:0/3683772078 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96700b4350 con 0x7f96700cd300 2024-01-24T13:05:20.491 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:05:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.490+0000 7f9678a00640 1 -- 172.21.15.29:0/3683772078 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9648065a60 msgr2=0x7f9648067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.490+0000 7f9678a00640 1 --2- 172.21.15.29:0/3683772078 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9648065a60 0x7f9648067f20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f96700abbd0 tx=0x7f9658007df0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.490+0000 7f9678a00640 1 -- 172.21.15.29:0/3683772078 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96700cd300 msgr2=0x7f96700ac750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.490+0000 7f9678a00640 1 --2- 172.21.15.29:0/3683772078 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96700cd300 0x7f96700ac750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f96600aa000 tx=0x7f96600192e0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.490+0000 7f9678a00640 1 -- 172.21.15.29:0/3683772078 shutdown_connections 2024-01-24T13:05:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.490+0000 7f9678a00640 1 --2- 172.21.15.29:0/3683772078 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9648065a60 0x7f9648067f20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.490+0000 7f9678a00640 1 --2- 172.21.15.29:0/3683772078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96700ce4e0 0x7f9670156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.490+0000 7f9678a00640 1 --2- 172.21.15.29:0/3683772078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96700ce050 0x7f96700aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.490+0000 7f9678a00640 1 --2- 172.21.15.29:0/3683772078 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96700cd300 0x7f96700ac750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.490+0000 7f9678a00640 1 -- 172.21.15.29:0/3683772078 >> 172.21.15.29:0/3683772078 conn(0x7f9670069cd0 msgr2=0x7f967015f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.490+0000 7f9678a00640 1 -- 172.21.15.29:0/3683772078 shutdown_connections 2024-01-24T13:05:20.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.490+0000 7f9678a00640 1 -- 172.21.15.29:0/3683772078 wait complete. 2024-01-24T13:05:20.514 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-24T13:05:20.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.650+0000 7ff4c8200640 1 Processor -- start 2024-01-24T13:05:20.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.650+0000 7ff4c8200640 1 -- start start 2024-01-24T13:05:20.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4c8200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff4c00ce8a0 0x7ff4c0165380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:20.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4c8200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c015aa30 con 0x7ff4c0143d30 2024-01-24T13:05:20.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4c8200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c00712a0 con 0x7ff4c0143910 2024-01-24T13:05:20.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4c8200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c0071580 con 0x7ff4c00ce8a0 2024-01-24T13:05:20.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4c4e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff4c0143d30 0x7ff4c006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51600/0 (socket says 172.21.15.29:51600) 2024-01-24T13:05:20.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4c4e00640 1 -- 172.21.15.29:0/996711420 learned_addr learned my addr 172.21.15.29:0/996711420 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:20.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4c6200640 1 --2- 172.21.15.29:0/996711420 >> v2:172.21.15.163:3300/0 conn(0x7ff4c00ce8a0 0x7ff4c0165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:20.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4bfe00640 1 -- 172.21.15.29:0/996711420 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188079803 0 0) 0x7ff4a8001120 con 0x7ff4c0143d30 2024-01-24T13:05:20.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4bfe00640 1 -- 172.21.15.29:0/996711420 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a0003530 con 0x7ff4c0143d30 2024-01-24T13:05:20.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4bfe00640 1 -- 172.21.15.29:0/996711420 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192325048 0 0) 0x7ff4c00712a0 con 0x7ff4c0143910 2024-01-24T13:05:20.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4bfe00640 1 -- 172.21.15.29:0/996711420 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a8001120 con 0x7ff4c0143910 2024-01-24T13:05:20.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4c6200640 1 -- 172.21.15.29:0/996711420 >> v1:172.21.15.163:6789/0 conn(0x7ff4c0143910 legacy=0x7ff4c0070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4bfe00640 1 -- 172.21.15.29:0/996711420 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 605308903 0 0) 0x7ff4a0003530 con 0x7ff4c0143d30 2024-01-24T13:05:20.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4c6200640 1 -- 172.21.15.29:0/996711420 >> v1:172.21.15.29:6789/0 conn(0x7ff4c0143d30 legacy=0x7ff4c006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.654+0000 7ff4c6200640 1 -- 172.21.15.29:0/996711420 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c00cd090 con 0x7ff4c00ce8a0 2024-01-24T13:05:20.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.658+0000 7ff4c6200640 1 --2- 172.21.15.29:0/996711420 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff4c00ce8a0 0x7ff4c0165380 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009d90 tx=0x7ff4b801c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3fdca0b45c3c42d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:20.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.658+0000 7ff4bfe00640 1 -- 172.21.15.29:0/996711420 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8001810 con 0x7ff4c00ce8a0 2024-01-24T13:05:20.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.658+0000 7ff4bfe00640 1 -- 172.21.15.29:0/996711420 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b80a5580 con 0x7ff4c00ce8a0 2024-01-24T13:05:20.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.658+0000 7ff4bfe00640 1 -- 172.21.15.29:0/996711420 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b80a5910 con 0x7ff4c00ce8a0 2024-01-24T13:05:20.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.658+0000 7ff4c8200640 1 -- 172.21.15.29:0/996711420 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff4c00ce8a0 msgr2=0x7ff4c0165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.658+0000 7ff4c8200640 1 --2- 172.21.15.29:0/996711420 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff4c00ce8a0 0x7ff4c0165380 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009d90 tx=0x7ff4b801c870 comp rx=0 tx=0).stop 2024-01-24T13:05:20.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.658+0000 7ff4c8200640 1 -- 172.21.15.29:0/996711420 shutdown_connections 2024-01-24T13:05:20.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.658+0000 7ff4c8200640 1 --2- 172.21.15.29:0/996711420 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff4c00ce8a0 0x7ff4c0165380 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.658+0000 7ff4c8200640 1 -- 172.21.15.29:0/996711420 >> 172.21.15.29:0/996711420 conn(0x7ff4c00b3950 msgr2=0x7ff4c0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:20.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.658+0000 7ff4c8200640 1 -- 172.21.15.29:0/996711420 shutdown_connections 2024-01-24T13:05:20.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.658+0000 7ff4c8200640 1 -- 172.21.15.29:0/996711420 wait complete. 2024-01-24T13:05:20.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c8200640 1 Processor -- start 2024-01-24T13:05:20.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c8200640 1 -- start start 2024-01-24T13:05:20.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c8200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff4c00ce8a0 0x7ff4c0138780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:20.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c8200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff4c0143910 0x7ff4c00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:20.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c8200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c0143d30 0x7ff4c01537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:20.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c8200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c00b2000 con 0x7ff4c0143d30 2024-01-24T13:05:20.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c8200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c00b1130 con 0x7ff4c00ce8a0 2024-01-24T13:05:20.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c8200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c013bf50 con 0x7ff4c0143910 2024-01-24T13:05:20.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c6200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c0143d30 0x7ff4c01537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:20.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c6200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c0143d30 0x7ff4c01537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49218/0 (socket says 172.21.15.29:49218) 2024-01-24T13:05:20.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c6200640 1 -- 172.21.15.29:0/763069296 learned_addr learned my addr 172.21.15.29:0/763069296 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:20.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c4e00640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff4c0143910 0x7ff4c00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:20.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c5800640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff4c00ce8a0 0x7ff4c0138780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:20.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c6200640 1 -- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff4c0143910 msgr2=0x7ff4c00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c6200640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff4c0143910 0x7ff4c00b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c6200640 1 -- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff4c00ce8a0 msgr2=0x7ff4c0138780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c6200640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff4c00ce8a0 0x7ff4c0138780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c6200640 1 -- 172.21.15.29:0/763069296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b8009a70 con 0x7ff4c0143d30 2024-01-24T13:05:20.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c5800640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff4c00ce8a0 0x7ff4c0138780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:20.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c6200640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c0143d30 0x7ff4c01537c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff4b801cd50 tx=0x7ff4b8019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:20.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4bd600640 1 -- 172.21.15.29:0/763069296 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8003ba0 con 0x7ff4c0143d30 2024-01-24T13:05:20.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4bd600640 1 -- 172.21.15.29:0/763069296 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b8003d00 con 0x7ff4c0143d30 2024-01-24T13:05:20.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4bd600640 1 -- 172.21.15.29:0/763069296 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8004230 con 0x7ff4c0143d30 2024-01-24T13:05:20.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c8200640 1 -- 172.21.15.29:0/763069296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c00b1380 con 0x7ff4c0143d30 2024-01-24T13:05:20.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c8200640 1 -- 172.21.15.29:0/763069296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c00b1940 con 0x7ff4c0143d30 2024-01-24T13:05:20.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.662+0000 7ff4c8200640 1 -- 172.21.15.29:0/763069296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c00b2140 con 0x7ff4c0143d30 2024-01-24T13:05:20.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.666+0000 7ff4bd600640 1 -- 172.21.15.29:0/763069296 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff4b8004390 con 0x7ff4c0143d30 2024-01-24T13:05:20.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.666+0000 7ff4bd600640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff498065a60 0x7ff498067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:20.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.666+0000 7ff4bd600640 1 -- 172.21.15.29:0/763069296 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff4b811d3c0 con 0x7ff4c0143d30 2024-01-24T13:05:20.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.666+0000 7ff4c5800640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff498065a60 0x7ff498067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:20.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.666+0000 7ff4c5800640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff498065a60 0x7ff498067f20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00011f0 tx=0x7ff4b0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:20.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.670+0000 7ff4bd600640 1 -- 172.21.15.29:0/763069296 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff4c00b2140 con 0x7ff4c0143d30 2024-01-24T13:05:20.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.830+0000 7ff4c8200640 1 -- 172.21.15.29:0/763069296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff4c00b2140 con 0x7ff4c0143d30 2024-01-24T13:05:20.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.830+0000 7ff4bd600640 1 -- 172.21.15.29:0/763069296 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v39) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff4c00b2140 con 0x7ff4c0143d30 2024-01-24T13:05:20.836 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:20.836 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2024-01-24T13:05:20.836 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:05:20.836 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2024-01-24T13:05:20.836 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2024-01-24T13:05:20.836 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:20.837 INFO:teuthology.orchestra.run.smithi029.stdout:] 2024-01-24T13:05:20.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.834+0000 7ff4c8200640 1 -- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff498065a60 msgr2=0x7ff498067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.834+0000 7ff4c8200640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff498065a60 0x7ff498067f20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00011f0 tx=0x7ff4b0009040 comp rx=0 tx=0).stop 2024-01-24T13:05:20.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.834+0000 7ff4c8200640 1 -- 172.21.15.29:0/763069296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c0143d30 msgr2=0x7ff4c01537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:20.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.834+0000 7ff4c8200640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c0143d30 0x7ff4c01537c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff4b801cd50 tx=0x7ff4b8019610 comp rx=0 tx=0).stop 2024-01-24T13:05:20.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.834+0000 7ff4c8200640 1 -- 172.21.15.29:0/763069296 shutdown_connections 2024-01-24T13:05:20.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.834+0000 7ff4c8200640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff498065a60 0x7ff498067f20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.834+0000 7ff4c8200640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c0143d30 0x7ff4c01537c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.834+0000 7ff4c8200640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff4c0143910 0x7ff4c00b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.834+0000 7ff4c8200640 1 --2- 172.21.15.29:0/763069296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff4c00ce8a0 0x7ff4c0138780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:20.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.834+0000 7ff4c8200640 1 -- 172.21.15.29:0/763069296 >> 172.21.15.29:0/763069296 conn(0x7ff4c00b3950 msgr2=0x7ff4c0155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:20.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.834+0000 7ff4c8200640 1 -- 172.21.15.29:0/763069296 shutdown_connections 2024-01-24T13:05:20.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.834+0000 7ff4c8200640 1 -- 172.21.15.29:0/763069296 wait complete. 2024-01-24T13:05:20.858 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-24T13:05:20.858 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-24T13:05:21.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.998+0000 7f96edc00640 1 Processor -- start 2024-01-24T13:05:21.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.998+0000 7f96edc00640 1 -- start start 2024-01-24T13:05:21.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.998+0000 7f96edc00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96e815c6d0 0x7f96e806bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:21.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.998+0000 7f96edc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e815cab0 0x7f96e80ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:21.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:20.998+0000 7f96edc00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e80ce5c0 con 0x7f96e80d0ca0 2024-01-24T13:05:21.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.002+0000 7f96edc00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e80ce7f0 con 0x7f96e815c6d0 2024-01-24T13:05:21.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.002+0000 7f96edc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80cead0 con 0x7f96e815cab0 2024-01-24T13:05:21.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.002+0000 7f96e6a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96e815c6d0 0x7f96e806bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:21.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.002+0000 7f96e6a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96e815c6d0 0x7f96e806bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47874/0 (socket says 172.21.15.29:47874) 2024-01-24T13:05:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.002+0000 7f96e6a00640 1 -- 172.21.15.29:0/3323684671 learned_addr learned my addr 172.21.15.29:0/3323684671 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.002+0000 7f96e6000640 1 --2- 172.21.15.29:0/3323684671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e815cab0 0x7f96e80ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.002+0000 7f96e6a00640 1 -- 172.21.15.29:0/3323684671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e815cab0 msgr2=0x7f96e80ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.002+0000 7f96e6a00640 1 --2- 172.21.15.29:0/3323684671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e815cab0 0x7f96e80ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.002+0000 7f96e6a00640 1 -- 172.21.15.29:0/3323684671 >> v1:172.21.15.163:6789/0 conn(0x7f96e80d0ca0 legacy=0x7f96e80ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.002+0000 7f96e6a00640 1 -- 172.21.15.29:0/3323684671 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80d04a0 con 0x7f96e815c6d0 2024-01-24T13:05:21.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.002+0000 7f96e6a00640 1 --2- 172.21.15.29:0/3323684671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e815c6d0 0x7f96e806bcc0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f96d80098a0 tx=0x7f96d801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fbfdb257ab6f64 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:21.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.002+0000 7f96e5600640 1 -- 172.21.15.29:0/3323684671 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d80aa620 con 0x7f96e815c6d0 2024-01-24T13:05:21.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.002+0000 7f96e5600640 1 -- 172.21.15.29:0/3323684671 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d80aa780 con 0x7f96e815c6d0 2024-01-24T13:05:21.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.002+0000 7f96e5600640 1 -- 172.21.15.29:0/3323684671 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d80aab10 con 0x7f96e815c6d0 2024-01-24T13:05:21.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 -- 172.21.15.29:0/3323684671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e815c6d0 msgr2=0x7f96e806bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:21.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 --2- 172.21.15.29:0/3323684671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e815c6d0 0x7f96e806bcc0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f96d80098a0 tx=0x7f96d801c4e0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 -- 172.21.15.29:0/3323684671 shutdown_connections 2024-01-24T13:05:21.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 --2- 172.21.15.29:0/3323684671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e815cab0 0x7f96e80ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 --2- 172.21.15.29:0/3323684671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e815c6d0 0x7f96e806bcc0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 -- 172.21.15.29:0/3323684671 >> 172.21.15.29:0/3323684671 conn(0x7f96e8069cd0 msgr2=0x7f96e806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:21.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 -- 172.21.15.29:0/3323684671 shutdown_connections 2024-01-24T13:05:21.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 -- 172.21.15.29:0/3323684671 wait complete. 2024-01-24T13:05:21.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 Processor -- start 2024-01-24T13:05:21.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 -- start start 2024-01-24T13:05:21.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e80d0ca0 0x7f96e80b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:21.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e815c6d0 0x7f96e8153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:21.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e815e8a0 0x7f96e815ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:21.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8154160 con 0x7f96e80d0ca0 2024-01-24T13:05:21.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e815f410 con 0x7f96e815e8a0 2024-01-24T13:05:21.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96edc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80b30c0 con 0x7f96e815c6d0 2024-01-24T13:05:21.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.006+0000 7f96e6a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e80d0ca0 0x7f96e80b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:21.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96e6a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e80d0ca0 0x7f96e80b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47878/0 (socket says 172.21.15.29:47878) 2024-01-24T13:05:21.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96e6a00640 1 -- 172.21.15.29:0/1446477876 learned_addr learned my addr 172.21.15.29:0/1446477876 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:21.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96e6000640 1 --2- 172.21.15.29:0/1446477876 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e815c6d0 0x7f96e8153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:21.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96e7400640 1 --2- 172.21.15.29:0/1446477876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e815e8a0 0x7f96e815ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:21.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96e6a00640 1 -- 172.21.15.29:0/1446477876 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e815c6d0 msgr2=0x7f96e8153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:21.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96e6a00640 1 --2- 172.21.15.29:0/1446477876 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e815c6d0 0x7f96e8153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96e6a00640 1 -- 172.21.15.29:0/1446477876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e815e8a0 msgr2=0x7f96e815ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:21.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96e6a00640 1 --2- 172.21.15.29:0/1446477876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e815e8a0 0x7f96e815ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96e6a00640 1 -- 172.21.15.29:0/1446477876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d80094d0 con 0x7f96e80d0ca0 2024-01-24T13:05:21.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96e6a00640 1 --2- 172.21.15.29:0/1446477876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e80d0ca0 0x7f96e80b3ba0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f96d80ac040 tx=0x7f96d801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:21.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96dea00640 1 -- 172.21.15.29:0/1446477876 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d80bd3f0 con 0x7f96e80d0ca0 2024-01-24T13:05:21.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96dea00640 1 -- 172.21.15.29:0/1446477876 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d80bd570 con 0x7f96e80d0ca0 2024-01-24T13:05:21.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96edc00640 1 -- 172.21.15.29:0/1446477876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e80b33a0 con 0x7f96e80d0ca0 2024-01-24T13:05:21.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96dea00640 1 -- 172.21.15.29:0/1446477876 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d80bd920 con 0x7f96e80d0ca0 2024-01-24T13:05:21.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96edc00640 1 -- 172.21.15.29:0/1446477876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e8155b80 con 0x7f96e80d0ca0 2024-01-24T13:05:21.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96edc00640 1 -- 172.21.15.29:0/1446477876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e80b38c0 con 0x7f96e80d0ca0 2024-01-24T13:05:21.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96dea00640 1 -- 172.21.15.29:0/1446477876 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f96d80b33f0 con 0x7f96e80d0ca0 2024-01-24T13:05:21.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.010+0000 7f96dea00640 1 --2- 172.21.15.29:0/1446477876 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f96c0065a90 0x7f96c0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:21.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.014+0000 7f96dea00640 1 -- 172.21.15.29:0/1446477876 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f96d811d180 con 0x7f96e80d0ca0 2024-01-24T13:05:21.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.014+0000 7f96e6000640 1 --2- 172.21.15.29:0/1446477876 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f96c0065a90 0x7f96c0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:21.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.014+0000 7f96e6000640 1 --2- 172.21.15.29:0/1446477876 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f96c0065a90 0x7f96c0067f50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f96e815c1b0 tx=0x7f96d0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:21.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.014+0000 7f96dea00640 1 -- 172.21.15.29:0/1446477876 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f96e80b38c0 con 0x7f96e80d0ca0 2024-01-24T13:05:21.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.174+0000 7f96edc00640 1 -- 172.21.15.29:0/1446477876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f96e80b38c0 con 0x7f96e80d0ca0 2024-01-24T13:05:21.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.786+0000 7f96dea00640 1 -- 172.21.15.29:0/1446477876 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v40) v1 ==== 138+0+0 (secure 0 0 0) 0x7f96e80b38c0 con 0x7f96e80d0ca0 2024-01-24T13:05:21.790 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2024-01-24T13:05:21.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.786+0000 7f96edc00640 1 -- 172.21.15.29:0/1446477876 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f96c0065a90 msgr2=0x7f96c0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:21.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.786+0000 7f96edc00640 1 --2- 172.21.15.29:0/1446477876 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f96c0065a90 0x7f96c0067f50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f96e815c1b0 tx=0x7f96d0008040 comp rx=0 tx=0).stop 2024-01-24T13:05:21.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.786+0000 7f96edc00640 1 -- 172.21.15.29:0/1446477876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e80d0ca0 msgr2=0x7f96e80b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:21.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.786+0000 7f96edc00640 1 --2- 172.21.15.29:0/1446477876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e80d0ca0 0x7f96e80b3ba0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f96d80ac040 tx=0x7f96d801ad20 comp rx=0 tx=0).stop 2024-01-24T13:05:21.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.790+0000 7f96edc00640 1 -- 172.21.15.29:0/1446477876 shutdown_connections 2024-01-24T13:05:21.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.790+0000 7f96edc00640 1 --2- 172.21.15.29:0/1446477876 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f96c0065a90 0x7f96c0067f50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.790+0000 7f96edc00640 1 --2- 172.21.15.29:0/1446477876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e815e8a0 0x7f96e815ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.790+0000 7f96edc00640 1 --2- 172.21.15.29:0/1446477876 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e815c6d0 0x7f96e8153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.790+0000 7f96edc00640 1 --2- 172.21.15.29:0/1446477876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96e80d0ca0 0x7f96e80b3ba0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.790+0000 7f96edc00640 1 -- 172.21.15.29:0/1446477876 >> 172.21.15.29:0/1446477876 conn(0x7f96e8069cd0 msgr2=0x7f96e81603b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:21.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.790+0000 7f96edc00640 1 -- 172.21.15.29:0/1446477876 shutdown_connections 2024-01-24T13:05:21.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.790+0000 7f96edc00640 1 -- 172.21.15.29:0/1446477876 wait complete. 2024-01-24T13:05:21.819 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-24T13:05:21.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f5ea00640 1 Processor -- start 2024-01-24T13:05:21.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f5ea00640 1 -- start start 2024-01-24T13:05:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f5ea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f5806c200 0x7f7f5813cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f5ea00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f5813d2e0 0x7f7f580cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f5ea00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5813d720 con 0x7f7f5806be20 2024-01-24T13:05:21.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f5ea00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5815b4f0 con 0x7f7f5806c200 2024-01-24T13:05:21.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f5ea00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5815b7d0 con 0x7f7f5813d2e0 2024-01-24T13:05:21.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f57400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f5806c200 0x7f7f5813cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:21.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f57e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7f5806be20 0x7f7f5815a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59036/0 (socket says 172.21.15.29:59036) 2024-01-24T13:05:21.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f57e00640 1 -- 172.21.15.29:0/1064695166 learned_addr learned my addr 172.21.15.29:0/1064695166 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:21.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f5ca00640 1 --2- 172.21.15.29:0/1064695166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f5813d2e0 0x7f7f580cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:21.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f57400640 1 -- 172.21.15.29:0/1064695166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f5813d2e0 msgr2=0x7f7f580cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:21.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f57400640 1 --2- 172.21.15.29:0/1064695166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f5813d2e0 0x7f7f580cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f56a00640 1 -- 172.21.15.29:0/1064695166 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117553519 0 0) 0x7f7f5813d720 con 0x7f7f5806be20 2024-01-24T13:05:21.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f57400640 1 -- 172.21.15.29:0/1064695166 >> v1:172.21.15.29:6789/0 conn(0x7f7f5806be20 legacy=0x7f7f5815a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:21.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f57400640 1 -- 172.21.15.29:0/1064695166 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f580cd0c0 con 0x7f7f5806c200 2024-01-24T13:05:21.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.966+0000 7f7f5ca00640 1 --2- 172.21.15.29:0/1064695166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f5813d2e0 0x7f7f580cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:21.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.970+0000 7f7f57400640 1 --2- 172.21.15.29:0/1064695166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f5806c200 0x7f7f5813cda0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7f400097c0 tx=0x7f7f4001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df900d82d69166ad server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:21.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.970+0000 7f7f56a00640 1 -- 172.21.15.29:0/1064695166 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400a7070 con 0x7f7f5806c200 2024-01-24T13:05:21.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.970+0000 7f7f56a00640 1 -- 172.21.15.29:0/1064695166 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f400ab430 con 0x7f7f5806c200 2024-01-24T13:05:21.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.970+0000 7f7f56a00640 1 -- 172.21.15.29:0/1064695166 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400ab7c0 con 0x7f7f5806c200 2024-01-24T13:05:21.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.970+0000 7f7f5ea00640 1 -- 172.21.15.29:0/1064695166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f5806c200 msgr2=0x7f7f5813cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:21.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.970+0000 7f7f5ea00640 1 --2- 172.21.15.29:0/1064695166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f5806c200 0x7f7f5813cda0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7f400097c0 tx=0x7f7f4001c450 comp rx=0 tx=0).stop 2024-01-24T13:05:21.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.970+0000 7f7f5ea00640 1 -- 172.21.15.29:0/1064695166 shutdown_connections 2024-01-24T13:05:21.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.970+0000 7f7f5ea00640 1 --2- 172.21.15.29:0/1064695166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f5813d2e0 0x7f7f580cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.970+0000 7f7f5ea00640 1 --2- 172.21.15.29:0/1064695166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f5806c200 0x7f7f5813cda0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.970+0000 7f7f5ea00640 1 -- 172.21.15.29:0/1064695166 >> 172.21.15.29:0/1064695166 conn(0x7f7f5806d700 msgr2=0x7f7f58069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:21.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.970+0000 7f7f5ea00640 1 -- 172.21.15.29:0/1064695166 shutdown_connections 2024-01-24T13:05:21.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.970+0000 7f7f5ea00640 1 -- 172.21.15.29:0/1064695166 wait complete. 2024-01-24T13:05:21.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f5ea00640 1 Processor -- start 2024-01-24T13:05:21.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f5ea00640 1 -- start start 2024-01-24T13:05:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f5ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f5806be20 0x7f7f58159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f5ea00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f5806c200 0x7f7f580710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f5ea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f5813d2e0 0x7f7f5814ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f5ea00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5814f170 con 0x7f7f5806be20 2024-01-24T13:05:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f5ea00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f58159490 con 0x7f7f5813d2e0 2024-01-24T13:05:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f5ea00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f580717d0 con 0x7f7f5806c200 2024-01-24T13:05:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f57e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f5806be20 0x7f7f58159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:21.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f57e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f5806be20 0x7f7f58159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47898/0 (socket says 172.21.15.29:47898) 2024-01-24T13:05:21.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f57e00640 1 -- 172.21.15.29:0/3461904136 learned_addr learned my addr 172.21.15.29:0/3461904136 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:21.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f57400640 1 --2- 172.21.15.29:0/3461904136 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f5806c200 0x7f7f580710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:21.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f5ca00640 1 --2- 172.21.15.29:0/3461904136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f5813d2e0 0x7f7f5814ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:21.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f57e00640 1 -- 172.21.15.29:0/3461904136 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f5806c200 msgr2=0x7f7f580710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:21.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f57e00640 1 --2- 172.21.15.29:0/3461904136 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f5806c200 0x7f7f580710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f57e00640 1 -- 172.21.15.29:0/3461904136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f5813d2e0 msgr2=0x7f7f5814ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:21.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f57e00640 1 --2- 172.21.15.29:0/3461904136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f5813d2e0 0x7f7f5814ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:21.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f57e00640 1 -- 172.21.15.29:0/3461904136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40009420 con 0x7f7f5806be20 2024-01-24T13:05:21.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f57e00640 1 --2- 172.21.15.29:0/3461904136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f5806be20 0x7f7f58159ee0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7f480011f0 tx=0x7f7f4800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:21.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f4fe00640 1 -- 172.21.15.29:0/3461904136 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f480074e0 con 0x7f7f5806be20 2024-01-24T13:05:21.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f4fe00640 1 -- 172.21.15.29:0/3461904136 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f48007640 con 0x7f7f5806be20 2024-01-24T13:05:21.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f4fe00640 1 -- 172.21.15.29:0/3461904136 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48004a10 con 0x7f7f5806be20 2024-01-24T13:05:21.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f5ea00640 1 -- 172.21.15.29:0/3461904136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f58071ab0 con 0x7f7f5806be20 2024-01-24T13:05:21.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f5ea00640 1 -- 172.21.15.29:0/3461904136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f581599c0 con 0x7f7f5806be20 2024-01-24T13:05:21.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.974+0000 7f7f5ea00640 1 -- 172.21.15.29:0/3461904136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5804e850 con 0x7f7f5806be20 2024-01-24T13:05:21.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.978+0000 7f7f4fe00640 1 -- 172.21.15.29:0/3461904136 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7f4801b360 con 0x7f7f5806be20 2024-01-24T13:05:21.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.978+0000 7f7f4fe00640 1 --2- 172.21.15.29:0/3461904136 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f30065a60 0x7f7f30067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:21.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.978+0000 7f7f4fe00640 1 -- 172.21.15.29:0/3461904136 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f7f480825b0 con 0x7f7f5806be20 2024-01-24T13:05:21.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.978+0000 7f7f57400640 1 --2- 172.21.15.29:0/3461904136 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f30065a60 0x7f7f30067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:21.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.978+0000 7f7f57400640 1 --2- 172.21.15.29:0/3461904136 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f30065a60 0x7f7f30067f20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7f400af000 tx=0x7f7f40008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:21.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:21.982+0000 7f7f4fe00640 1 -- 172.21.15.29:0/3461904136 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7f480500a0 con 0x7f7f5806be20 2024-01-24T13:05:22.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.138+0000 7f7f5ea00640 1 -- 172.21.15.29:0/3461904136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7f5806a190 con 0x7f7f5806be20 2024-01-24T13:05:22.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.790+0000 7f7f4fe00640 1 -- 172.21.15.29:0/3461904136 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v41) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7f480180d0 con 0x7f7f5806be20 2024-01-24T13:05:22.796 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2024-01-24T13:05:22.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.798+0000 7f7f5ea00640 1 -- 172.21.15.29:0/3461904136 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f30065a60 msgr2=0x7f7f30067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:22.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.798+0000 7f7f5ea00640 1 --2- 172.21.15.29:0/3461904136 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f30065a60 0x7f7f30067f20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7f400af000 tx=0x7f7f40008040 comp rx=0 tx=0).stop 2024-01-24T13:05:22.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.798+0000 7f7f5ea00640 1 -- 172.21.15.29:0/3461904136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f5806be20 msgr2=0x7f7f58159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:22.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.798+0000 7f7f5ea00640 1 --2- 172.21.15.29:0/3461904136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f5806be20 0x7f7f58159ee0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7f480011f0 tx=0x7f7f4800c9b0 comp rx=0 tx=0).stop 2024-01-24T13:05:22.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.798+0000 7f7f5ea00640 1 -- 172.21.15.29:0/3461904136 shutdown_connections 2024-01-24T13:05:22.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.798+0000 7f7f5ea00640 1 --2- 172.21.15.29:0/3461904136 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f30065a60 0x7f7f30067f20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:22.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.798+0000 7f7f5ea00640 1 --2- 172.21.15.29:0/3461904136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f5813d2e0 0x7f7f5814ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:22.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.798+0000 7f7f5ea00640 1 --2- 172.21.15.29:0/3461904136 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f5806c200 0x7f7f580710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:22.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.798+0000 7f7f5ea00640 1 --2- 172.21.15.29:0/3461904136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f5806be20 0x7f7f58159ee0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:22.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.798+0000 7f7f5ea00640 1 -- 172.21.15.29:0/3461904136 >> 172.21.15.29:0/3461904136 conn(0x7f7f5806d700 msgr2=0x7f7f5815bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:22.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.798+0000 7f7f5ea00640 1 -- 172.21.15.29:0/3461904136 shutdown_connections 2024-01-24T13:05:22.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.798+0000 7f7f5ea00640 1 -- 172.21.15.29:0/3461904136 wait complete. 2024-01-24T13:05:22.843 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-24T13:05:22.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.986+0000 7f059ba00640 1 Processor -- start 2024-01-24T13:05:22.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.986+0000 7f059ba00640 1 -- start start 2024-01-24T13:05:22.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.990+0000 7f059ba00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0594158ca0 0x7f05940b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:22.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.990+0000 7f059ba00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0594070970 con 0x7f059406bbc0 2024-01-24T13:05:22.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.990+0000 7f059ba00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0594070ba0 con 0x7f0594070560 2024-01-24T13:05:22.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.990+0000 7f059ba00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0594159080 con 0x7f0594158ca0 2024-01-24T13:05:22.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.990+0000 7f0593e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f059406bbc0 0x7f059406fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59038/0 (socket says 172.21.15.29:59038) 2024-01-24T13:05:22.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.990+0000 7f0593e00640 1 -- 172.21.15.29:0/1230055119 learned_addr learned my addr 172.21.15.29:0/1230055119 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.990+0000 7f0599000640 1 --2- 172.21.15.29:0/1230055119 >> v2:172.21.15.29:3300/0 conn(0x7f0594158ca0 0x7f05940b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.990+0000 7f0593400640 1 -- 172.21.15.29:0/1230055119 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885936893 0 0) 0x7f0594070970 con 0x7f059406bbc0 2024-01-24T13:05:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.990+0000 7f0593400640 1 -- 172.21.15.29:0/1230055119 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0574003530 con 0x7f059406bbc0 2024-01-24T13:05:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.990+0000 7f0593400640 1 -- 172.21.15.29:0/1230055119 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761200599 0 0) 0x7f0594070ba0 con 0x7f0594070560 2024-01-24T13:05:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.990+0000 7f0599000640 1 -- 172.21.15.29:0/1230055119 >> v1:172.21.15.163:6789/0 conn(0x7f0594070560 legacy=0x7f05940cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.990+0000 7f0599000640 1 -- 172.21.15.29:0/1230055119 >> v1:172.21.15.29:6789/0 conn(0x7f059406bbc0 legacy=0x7f059406fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.990+0000 7f0599000640 1 -- 172.21.15.29:0/1230055119 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05940b18c0 con 0x7f0594158ca0 2024-01-24T13:05:22.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.990+0000 7f0599000640 1 --2- 172.21.15.29:0/1230055119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0594158ca0 0x7f05940b2680 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f05840097c0 tx=0x7f058401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc733e6d727974a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:22.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f0593400640 1 -- 172.21.15.29:0/1230055119 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840ab650 con 0x7f0594158ca0 2024-01-24T13:05:22.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f0593400640 1 -- 172.21.15.29:0/1230055119 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05840ab7b0 con 0x7f0594158ca0 2024-01-24T13:05:22.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f0593400640 1 -- 172.21.15.29:0/1230055119 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840abb20 con 0x7f0594158ca0 2024-01-24T13:05:22.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 -- 172.21.15.29:0/1230055119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0594158ca0 msgr2=0x7f05940b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:22.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 --2- 172.21.15.29:0/1230055119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0594158ca0 0x7f05940b2680 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f05840097c0 tx=0x7f058401c450 comp rx=0 tx=0).stop 2024-01-24T13:05:22.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 -- 172.21.15.29:0/1230055119 shutdown_connections 2024-01-24T13:05:22.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 --2- 172.21.15.29:0/1230055119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0594158ca0 0x7f05940b2680 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:22.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 -- 172.21.15.29:0/1230055119 >> 172.21.15.29:0/1230055119 conn(0x7f059406d700 msgr2=0x7f0594069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:22.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 -- 172.21.15.29:0/1230055119 shutdown_connections 2024-01-24T13:05:22.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 -- 172.21.15.29:0/1230055119 wait complete. 2024-01-24T13:05:22.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 Processor -- start 2024-01-24T13:05:22.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 -- start start 2024-01-24T13:05:23.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f059406bbc0 0x7f05941448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0594070560 0x7f0594149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0594158ca0 0x7f059415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059414b2c0 con 0x7f0594070560 2024-01-24T13:05:23.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059414a480 con 0x7f059406bbc0 2024-01-24T13:05:23.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.994+0000 7f059ba00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059415b0c0 con 0x7f0594158ca0 2024-01-24T13:05:23.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f0599000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f059406bbc0 0x7f05941448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f0599a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0594158ca0 0x7f059415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f0599000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f059406bbc0 0x7f05941448a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:48044/0 (socket says 172.21.15.29:48044) 2024-01-24T13:05:23.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f0599000640 1 -- 172.21.15.29:0/377023201 learned_addr learned my addr 172.21.15.29:0/377023201 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:23.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f0593e00640 1 --2- 172.21.15.29:0/377023201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0594070560 0x7f0594149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f0599000640 1 -- 172.21.15.29:0/377023201 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0594158ca0 msgr2=0x7f059415ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f0599000640 1 --2- 172.21.15.29:0/377023201 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0594158ca0 0x7f059415ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f0599000640 1 -- 172.21.15.29:0/377023201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0594070560 msgr2=0x7f0594149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f0599000640 1 --2- 172.21.15.29:0/377023201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0594070560 0x7f0594149f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f0599000640 1 -- 172.21.15.29:0/377023201 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0584009420 con 0x7f059406bbc0 2024-01-24T13:05:23.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f0599000640 1 --2- 172.21.15.29:0/377023201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f059406bbc0 0x7f05941448a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0584019060 tx=0x7f058401ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:23.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f0590c00640 1 -- 172.21.15.29:0/377023201 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840bf610 con 0x7f059406bbc0 2024-01-24T13:05:23.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f0590c00640 1 -- 172.21.15.29:0/377023201 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05840bf770 con 0x7f059406bbc0 2024-01-24T13:05:23.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f059ba00640 1 -- 172.21.15.29:0/377023201 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059414a6b0 con 0x7f059406bbc0 2024-01-24T13:05:23.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f0590c00640 1 -- 172.21.15.29:0/377023201 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840bfae0 con 0x7f059406bbc0 2024-01-24T13:05:23.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f059ba00640 1 -- 172.21.15.29:0/377023201 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059414ac70 con 0x7f059406bbc0 2024-01-24T13:05:23.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:22.998+0000 7f059ba00640 1 -- 172.21.15.29:0/377023201 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05940b2db0 con 0x7f059406bbc0 2024-01-24T13:05:23.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.002+0000 7f0590c00640 1 -- 172.21.15.29:0/377023201 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f05840c9430 con 0x7f059406bbc0 2024-01-24T13:05:23.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.002+0000 7f0590c00640 1 --2- 172.21.15.29:0/377023201 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f056c065a90 0x7f056c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.002+0000 7f0590c00640 1 -- 172.21.15.29:0/377023201 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f058411e530 con 0x7f059406bbc0 2024-01-24T13:05:23.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.002+0000 7f0593e00640 1 --2- 172.21.15.29:0/377023201 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f056c065a90 0x7f056c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.002+0000 7f0593e00640 1 --2- 172.21.15.29:0/377023201 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f056c065a90 0x7f056c067f50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0594071fd0 tx=0x7f057c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:23.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.006+0000 7f0590c00640 1 -- 172.21.15.29:0/377023201 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f05840ebea0 con 0x7f059406bbc0 2024-01-24T13:05:23.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.198+0000 7f059ba00640 1 -- 172.21.15.29:0/377023201 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f059404e850 con 0x7f059406bbc0 2024-01-24T13:05:23.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.214+0000 7f0590c00640 1 -- 172.21.15.29:0/377023201 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f05840ef4c0 con 0x7f059406bbc0 2024-01-24T13:05:23.220 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 5 and data pool 6 2024-01-24T13:05:23.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.222+0000 7f059ba00640 1 -- 172.21.15.29:0/377023201 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f056c065a90 msgr2=0x7f056c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.222+0000 7f059ba00640 1 --2- 172.21.15.29:0/377023201 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f056c065a90 0x7f056c067f50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0594071fd0 tx=0x7f057c009040 comp rx=0 tx=0).stop 2024-01-24T13:05:23.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.222+0000 7f059ba00640 1 -- 172.21.15.29:0/377023201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f059406bbc0 msgr2=0x7f05941448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.222+0000 7f059ba00640 1 --2- 172.21.15.29:0/377023201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f059406bbc0 0x7f05941448a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0584019060 tx=0x7f058401ac90 comp rx=0 tx=0).stop 2024-01-24T13:05:23.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.230+0000 7f059ba00640 1 -- 172.21.15.29:0/377023201 shutdown_connections 2024-01-24T13:05:23.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.230+0000 7f059ba00640 1 --2- 172.21.15.29:0/377023201 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f056c065a90 0x7f056c067f50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.230+0000 7f059ba00640 1 --2- 172.21.15.29:0/377023201 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0594158ca0 0x7f059415ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.230+0000 7f059ba00640 1 --2- 172.21.15.29:0/377023201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0594070560 0x7f0594149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.230+0000 7f059ba00640 1 --2- 172.21.15.29:0/377023201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f059406bbc0 0x7f05941448a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.230+0000 7f059ba00640 1 -- 172.21.15.29:0/377023201 >> 172.21.15.29:0/377023201 conn(0x7f059406d700 msgr2=0x7f059406fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:23.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.230+0000 7f059ba00640 1 -- 172.21.15.29:0/377023201 shutdown_connections 2024-01-24T13:05:23.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.234+0000 7f059ba00640 1 -- 172.21.15.29:0/377023201 wait complete. 2024-01-24T13:05:23.264 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:23.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc818400640 1 Processor -- start 2024-01-24T13:05:23.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc818400640 1 -- start start 2024-01-24T13:05:23.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc818400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc8100c3ef0 0x7fc8100ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc818400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc8100caf30 0x7fc8100d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc818400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8100cfe50 con 0x7fc81015a630 2024-01-24T13:05:23.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc818400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8100cf380 con 0x7fc8100c3ef0 2024-01-24T13:05:23.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc818400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8100cb3c0 con 0x7fc8100caf30 2024-01-24T13:05:23.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc815000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc8100c3ef0 0x7fc8100ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc815a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc81015a630 0x7fc8100cdf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59054/0 (socket says 172.21.15.29:59054) 2024-01-24T13:05:23.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc815a00640 1 -- 172.21.15.29:0/578688510 learned_addr learned my addr 172.21.15.29:0/578688510 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:23.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc816400640 1 --2- 172.21.15.29:0/578688510 >> v2:172.21.15.163:3300/0 conn(0x7fc8100caf30 0x7fc8100d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc815000640 1 -- 172.21.15.29:0/578688510 >> v2:172.21.15.163:3300/0 conn(0x7fc8100caf30 msgr2=0x7fc8100d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:23.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc815000640 1 --2- 172.21.15.29:0/578688510 >> v2:172.21.15.163:3300/0 conn(0x7fc8100caf30 0x7fc8100d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc815000640 1 -- 172.21.15.29:0/578688510 >> v1:172.21.15.29:6789/0 conn(0x7fc81015a630 legacy=0x7fc8100cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc80fe00640 1 -- 172.21.15.29:0/578688510 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020963328 0 0) 0x7fc8100cfe50 con 0x7fc81015a630 2024-01-24T13:05:23.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc815000640 1 -- 172.21.15.29:0/578688510 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81015aa10 con 0x7fc8100c3ef0 2024-01-24T13:05:23.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.402+0000 7fc816400640 1 --2- 172.21.15.29:0/578688510 >> v2:172.21.15.163:3300/0 conn(0x7fc8100caf30 0x7fc8100d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:23.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.406+0000 7fc815000640 1 --2- 172.21.15.29:0/578688510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8100c3ef0 0x7fc8100ca9f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc8100cdc90 tx=0x7fc7f801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7f8771f52e43e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:23.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.406+0000 7fc80fe00640 1 -- 172.21.15.29:0/578688510 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80ab640 con 0x7fc8100c3ef0 2024-01-24T13:05:23.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.406+0000 7fc80fe00640 1 -- 172.21.15.29:0/578688510 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f80a7070 con 0x7fc8100c3ef0 2024-01-24T13:05:23.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.406+0000 7fc80fe00640 1 -- 172.21.15.29:0/578688510 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80ab9c0 con 0x7fc8100c3ef0 2024-01-24T13:05:23.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.406+0000 7fc818400640 1 -- 172.21.15.29:0/578688510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8100c3ef0 msgr2=0x7fc8100ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.406+0000 7fc818400640 1 --2- 172.21.15.29:0/578688510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8100c3ef0 0x7fc8100ca9f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc8100cdc90 tx=0x7fc7f801c440 comp rx=0 tx=0).stop 2024-01-24T13:05:23.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.406+0000 7fc818400640 1 -- 172.21.15.29:0/578688510 shutdown_connections 2024-01-24T13:05:23.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.406+0000 7fc818400640 1 --2- 172.21.15.29:0/578688510 >> v2:172.21.15.163:3300/0 conn(0x7fc8100caf30 0x7fc8100d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.406+0000 7fc818400640 1 --2- 172.21.15.29:0/578688510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8100c3ef0 0x7fc8100ca9f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.406+0000 7fc818400640 1 -- 172.21.15.29:0/578688510 >> 172.21.15.29:0/578688510 conn(0x7fc810070570 msgr2=0x7fc810069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:23.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.406+0000 7fc818400640 1 -- 172.21.15.29:0/578688510 shutdown_connections 2024-01-24T13:05:23.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.406+0000 7fc818400640 1 -- 172.21.15.29:0/578688510 wait complete. 2024-01-24T13:05:23.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc818400640 1 Processor -- start 2024-01-24T13:05:23.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc818400640 1 -- start start 2024-01-24T13:05:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc818400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8100c3ef0 0x7fc81006af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc818400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8100caf30 0x7fc81014f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc818400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc81015a630 0x7fc810151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc818400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81006b8c0 con 0x7fc8100caf30 2024-01-24T13:05:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc818400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81006bb10 con 0x7fc8100c3ef0 2024-01-24T13:05:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc818400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81006bdf0 con 0x7fc81015a630 2024-01-24T13:05:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc815000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8100caf30 0x7fc81014f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc815000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8100caf30 0x7fc81014f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47942/0 (socket says 172.21.15.29:47942) 2024-01-24T13:05:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc815000640 1 -- 172.21.15.29:0/534944204 learned_addr learned my addr 172.21.15.29:0/534944204 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc816400640 1 --2- 172.21.15.29:0/534944204 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc81015a630 0x7fc810151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc815a00640 1 --2- 172.21.15.29:0/534944204 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8100c3ef0 0x7fc81006af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc815000640 1 -- 172.21.15.29:0/534944204 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc81015a630 msgr2=0x7fc810151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc815000640 1 --2- 172.21.15.29:0/534944204 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc81015a630 0x7fc810151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc815000640 1 -- 172.21.15.29:0/534944204 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8100c3ef0 msgr2=0x7fc81006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc815000640 1 --2- 172.21.15.29:0/534944204 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8100c3ef0 0x7fc81006af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc815000640 1 -- 172.21.15.29:0/534944204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8009420 con 0x7fc8100caf30 2024-01-24T13:05:23.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc815000640 1 --2- 172.21.15.29:0/534944204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8100caf30 0x7fc81014f770 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80ad040 tx=0x7fc7f801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:23.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc80d600640 1 -- 172.21.15.29:0/534944204 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80bf410 con 0x7fc8100caf30 2024-01-24T13:05:23.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc80d600640 1 -- 172.21.15.29:0/534944204 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f80bf590 con 0x7fc8100caf30 2024-01-24T13:05:23.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc80d600640 1 -- 172.21.15.29:0/534944204 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80bf940 con 0x7fc8100caf30 2024-01-24T13:05:23.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc818400640 1 -- 172.21.15.29:0/534944204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81006c0d0 con 0x7fc8100caf30 2024-01-24T13:05:23.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc818400640 1 -- 172.21.15.29:0/534944204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81006c690 con 0x7fc8100caf30 2024-01-24T13:05:23.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.410+0000 7fc818400640 1 -- 172.21.15.29:0/534944204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81006c880 con 0x7fc8100caf30 2024-01-24T13:05:23.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.414+0000 7fc80d600640 1 -- 172.21.15.29:0/534944204 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc7f80b5400 con 0x7fc8100caf30 2024-01-24T13:05:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.414+0000 7fc80d600640 1 --2- 172.21.15.29:0/534944204 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc7e8065a60 0x7fc7e8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.414+0000 7fc80d600640 1 -- 172.21.15.29:0/534944204 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc7f811dbe0 con 0x7fc8100caf30 2024-01-24T13:05:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.414+0000 7fc815a00640 1 --2- 172.21.15.29:0/534944204 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc7e8065a60 0x7fc7e8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.414+0000 7fc815a00640 1 --2- 172.21.15.29:0/534944204 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc7e8065a60 0x7fc7e8067f20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc800007fd0 tx=0x7fc800007d60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:23.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.418+0000 7fc80d600640 1 -- 172.21.15.29:0/534944204 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc7f80eb620 con 0x7fc8100caf30 2024-01-24T13:05:23.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.578+0000 7fc818400640 1 -- 172.21.15.29:0/534944204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc81006bf30 con 0x7fc8100caf30 2024-01-24T13:05:23.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.578+0000 7fc80d600640 1 -- 172.21.15.29:0/534944204 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16319 (secure 0 0 0) 0x7fc81006bf30 con 0x7fc8100caf30 2024-01-24T13:05:23.583 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:23.583 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":42,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:05:23.205926+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:05:21.225564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-24T13:05:22.188525+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.582+0000 7fc818400640 1 -- 172.21.15.29:0/534944204 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc7e8065a60 msgr2=0x7fc7e8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.582+0000 7fc818400640 1 --2- 172.21.15.29:0/534944204 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc7e8065a60 0x7fc7e8067f20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc800007fd0 tx=0x7fc800007d60 comp rx=0 tx=0).stop 2024-01-24T13:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.582+0000 7fc818400640 1 -- 172.21.15.29:0/534944204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8100caf30 msgr2=0x7fc81014f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.582+0000 7fc818400640 1 --2- 172.21.15.29:0/534944204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8100caf30 0x7fc81014f770 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80ad040 tx=0x7fc7f801ac80 comp rx=0 tx=0).stop 2024-01-24T13:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.582+0000 7fc818400640 1 -- 172.21.15.29:0/534944204 shutdown_connections 2024-01-24T13:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.582+0000 7fc818400640 1 --2- 172.21.15.29:0/534944204 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc7e8065a60 0x7fc7e8067f20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.582+0000 7fc818400640 1 --2- 172.21.15.29:0/534944204 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc81015a630 0x7fc810151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.582+0000 7fc818400640 1 --2- 172.21.15.29:0/534944204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8100caf30 0x7fc81014f770 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.582+0000 7fc818400640 1 --2- 172.21.15.29:0/534944204 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8100c3ef0 0x7fc81006af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.582+0000 7fc818400640 1 -- 172.21.15.29:0/534944204 >> 172.21.15.29:0/534944204 conn(0x7fc810070570 msgr2=0x7fc810153830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:23.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.582+0000 7fc818400640 1 -- 172.21.15.29:0/534944204 shutdown_connections 2024-01-24T13:05:23.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.582+0000 7fc818400640 1 -- 172.21.15.29:0/534944204 wait complete. 2024-01-24T13:05:23.606 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:23.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.742+0000 7ff6a1c00640 1 Processor -- start 2024-01-24T13:05:23.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.742+0000 7ff6a1c00640 1 -- start start 2024-01-24T13:05:23.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.742+0000 7ff6a1c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff69c143910 0x7ff69c143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.742+0000 7ff6a1c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff69c06c320 0x7ff69c0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.742+0000 7ff6a1c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c15aa30 con 0x7ff69c070ac0 2024-01-24T13:05:23.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.742+0000 7ff6a1c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c0712a0 con 0x7ff69c143910 2024-01-24T13:05:23.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.742+0000 7ff6a1c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c071580 con 0x7ff69c06c320 2024-01-24T13:05:23.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.746+0000 7ff69a000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff69c070ac0 0x7ff69c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59068/0 (socket says 172.21.15.29:59068) 2024-01-24T13:05:23.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.746+0000 7ff69aa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff69c143910 0x7ff69c143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.746+0000 7ff69a000640 1 -- 172.21.15.29:0/2121844564 learned_addr learned my addr 172.21.15.29:0/2121844564 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:23.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.746+0000 7ff69b400640 1 --2- 172.21.15.29:0/2121844564 >> v2:172.21.15.163:3300/0 conn(0x7ff69c06c320 0x7ff69c0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.746+0000 7ff69aa00640 1 -- 172.21.15.29:0/2121844564 >> v2:172.21.15.163:3300/0 conn(0x7ff69c06c320 msgr2=0x7ff69c0cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:23.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.746+0000 7ff69aa00640 1 --2- 172.21.15.29:0/2121844564 >> v2:172.21.15.163:3300/0 conn(0x7ff69c06c320 0x7ff69c0cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.746+0000 7ff69aa00640 1 -- 172.21.15.29:0/2121844564 >> v1:172.21.15.29:6789/0 conn(0x7ff69c070ac0 legacy=0x7ff69c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.746+0000 7ff69aa00640 1 -- 172.21.15.29:0/2121844564 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c0cd090 con 0x7ff69c143910 2024-01-24T13:05:23.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.746+0000 7ff69aa00640 1 --2- 172.21.15.29:0/2121844564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff69c143910 0x7ff69c143d30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0afcc0 tx=0x7ff68c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc1799af1292f9b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:23.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.746+0000 7ff699600640 1 -- 172.21.15.29:0/2121844564 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0ab610 con 0x7ff69c143910 2024-01-24T13:05:23.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.746+0000 7ff699600640 1 -- 172.21.15.29:0/2121844564 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c0ab770 con 0x7ff69c143910 2024-01-24T13:05:23.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.746+0000 7ff699600640 1 -- 172.21.15.29:0/2121844564 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0abb00 con 0x7ff69c143910 2024-01-24T13:05:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 -- 172.21.15.29:0/2121844564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff69c143910 msgr2=0x7ff69c143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 --2- 172.21.15.29:0/2121844564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff69c143910 0x7ff69c143d30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0afcc0 tx=0x7ff68c01c430 comp rx=0 tx=0).stop 2024-01-24T13:05:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 -- 172.21.15.29:0/2121844564 shutdown_connections 2024-01-24T13:05:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 --2- 172.21.15.29:0/2121844564 >> v2:172.21.15.163:3300/0 conn(0x7ff69c06c320 0x7ff69c0cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 --2- 172.21.15.29:0/2121844564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff69c143910 0x7ff69c143d30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 -- 172.21.15.29:0/2121844564 >> 172.21.15.29:0/2121844564 conn(0x7ff69c0b3950 msgr2=0x7ff69c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 -- 172.21.15.29:0/2121844564 shutdown_connections 2024-01-24T13:05:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 -- 172.21.15.29:0/2121844564 wait complete. 2024-01-24T13:05:23.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 Processor -- start 2024-01-24T13:05:23.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 -- start start 2024-01-24T13:05:23.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff69c06c320 0x7ff69c0a7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff69c070ac0 0x7ff69c0a7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff69c143910 0x7ff69c163510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0b1130 con 0x7ff69c070ac0 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0b19d0 con 0x7ff69c06c320 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff6a1c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c1f4b20 con 0x7ff69c143910 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff69a000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff69c070ac0 0x7ff69c0a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff69a000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff69c070ac0 0x7ff69c0a7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47964/0 (socket says 172.21.15.29:47964) 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff69a000640 1 -- 172.21.15.29:0/4070271516 learned_addr learned my addr 172.21.15.29:0/4070271516 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff69b400640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff69c143910 0x7ff69c163510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.750+0000 7ff69aa00640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff69c06c320 0x7ff69c0a7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff69a000640 1 -- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff69c143910 msgr2=0x7ff69c163510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff69a000640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff69c143910 0x7ff69c163510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff69a000640 1 -- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff69c06c320 msgr2=0x7ff69c0a7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff69a000640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff69c06c320 0x7ff69c0a7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff69a000640 1 -- 172.21.15.29:0/4070271516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c009420 con 0x7ff69c070ac0 2024-01-24T13:05:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff69b400640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff69c143910 0x7ff69c163510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:23.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff69a000640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff69c070ac0 0x7ff69c0a7610 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c530 tx=0x7ff68400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:23.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff692a00640 1 -- 172.21.15.29:0/4070271516 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684005cf0 con 0x7ff69c070ac0 2024-01-24T13:05:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff692a00640 1 -- 172.21.15.29:0/4070271516 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff684005e50 con 0x7ff69c070ac0 2024-01-24T13:05:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff6a1c00640 1 -- 172.21.15.29:0/4070271516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69c0a84b0 con 0x7ff69c070ac0 2024-01-24T13:05:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff692a00640 1 -- 172.21.15.29:0/4070271516 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684007270 con 0x7ff69c070ac0 2024-01-24T13:05:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff6a1c00640 1 -- 172.21.15.29:0/4070271516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c0b1660 con 0x7ff69c070ac0 2024-01-24T13:05:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff6a1c00640 1 -- 172.21.15.29:0/4070271516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69c04e850 con 0x7ff69c070ac0 2024-01-24T13:05:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff692a00640 1 -- 172.21.15.29:0/4070271516 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff6840073d0 con 0x7ff69c070ac0 2024-01-24T13:05:23.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff692a00640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff674065a90 0x7ff674067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:23.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff692a00640 1 -- 172.21.15.29:0/4070271516 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff684082600 con 0x7ff69c070ac0 2024-01-24T13:05:23.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.754+0000 7ff69aa00640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff674065a90 0x7ff674067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:23.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.758+0000 7ff69aa00640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff674065a90 0x7ff674067f50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0af000 tx=0x7ff68c0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:23.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.758+0000 7ff692a00640 1 -- 172.21.15.29:0/4070271516 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff68404fe90 con 0x7ff69c070ac0 2024-01-24T13:05:23.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.918+0000 7ff6a1c00640 1 -- 172.21.15.29:0/4070271516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff69c15aa30 con 0x7ff69c070ac0 2024-01-24T13:05:23.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.918+0000 7ff692a00640 1 -- 172.21.15.29:0/4070271516 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16319 (secure 0 0 0) 0x7ff69c15aa30 con 0x7ff69c070ac0 2024-01-24T13:05:23.923 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:23.923 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":42,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:05:23.205926+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:05:21.225564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-24T13:05:22.188525+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.922+0000 7ff6a1c00640 1 -- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff674065a90 msgr2=0x7ff674067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.922+0000 7ff6a1c00640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff674065a90 0x7ff674067f50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0af000 tx=0x7ff68c0a7000 comp rx=0 tx=0).stop 2024-01-24T13:05:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.922+0000 7ff6a1c00640 1 -- 172.21.15.29:0/4070271516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff69c070ac0 msgr2=0x7ff69c0a7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.922+0000 7ff6a1c00640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff69c070ac0 0x7ff69c0a7610 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c530 tx=0x7ff68400c9f0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.922+0000 7ff6a1c00640 1 -- 172.21.15.29:0/4070271516 shutdown_connections 2024-01-24T13:05:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.922+0000 7ff6a1c00640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff674065a90 0x7ff674067f50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.922+0000 7ff6a1c00640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff69c143910 0x7ff69c163510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.922+0000 7ff6a1c00640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff69c070ac0 0x7ff69c0a7610 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.922+0000 7ff6a1c00640 1 --2- 172.21.15.29:0/4070271516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff69c06c320 0x7ff69c0a7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.922+0000 7ff6a1c00640 1 -- 172.21.15.29:0/4070271516 >> 172.21.15.29:0/4070271516 conn(0x7ff69c0b3950 msgr2=0x7ff69c0ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.922+0000 7ff6a1c00640 1 -- 172.21.15.29:0/4070271516 shutdown_connections 2024-01-24T13:05:23.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:23.922+0000 7ff6a1c00640 1 -- 172.21.15.29:0/4070271516 wait complete. 2024-01-24T13:05:23.946 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-24T13:05:24.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.086+0000 7f3a6a000640 1 Processor -- start 2024-01-24T13:05:24.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.086+0000 7f3a6a000640 1 -- start start 2024-01-24T13:05:24.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.086+0000 7f3a6a000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3a6406c200 0x7f3a6413cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:24.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.086+0000 7f3a6a000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a6413d2e0 0x7f3a640cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:24.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.086+0000 7f3a6a000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6413d750 con 0x7f3a6406be20 2024-01-24T13:05:24.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.086+0000 7f3a6a000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6415b4f0 con 0x7f3a6413d2e0 2024-01-24T13:05:24.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.086+0000 7f3a6a000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6415b7d0 con 0x7f3a6406c200 2024-01-24T13:05:24.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.086+0000 7f3a63e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a6413d2e0 0x7f3a640cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:24.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.086+0000 7f3a63e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a6413d2e0 0x7f3a640cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47978/0 (socket says 172.21.15.29:47978) 2024-01-24T13:05:24.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.086+0000 7f3a63e00640 1 -- 172.21.15.29:0/392853500 learned_addr learned my addr 172.21.15.29:0/392853500 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:24.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.090+0000 7f3a62a00640 1 --2- 172.21.15.29:0/392853500 >> v2:172.21.15.163:3300/0 conn(0x7f3a6406c200 0x7f3a6413cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:24.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.090+0000 7f3a63e00640 1 -- 172.21.15.29:0/392853500 >> v2:172.21.15.163:3300/0 conn(0x7f3a6406c200 msgr2=0x7f3a6413cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:24.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.090+0000 7f3a63e00640 1 --2- 172.21.15.29:0/392853500 >> v2:172.21.15.163:3300/0 conn(0x7f3a6406c200 0x7f3a6413cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:24.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.090+0000 7f3a63e00640 1 -- 172.21.15.29:0/392853500 >> v1:172.21.15.163:6789/0 conn(0x7f3a6406be20 legacy=0x7f3a6415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:24.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.090+0000 7f3a63e00640 1 -- 172.21.15.29:0/392853500 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a640cd0c0 con 0x7f3a6413d2e0 2024-01-24T13:05:24.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.090+0000 7f3a63e00640 1 --2- 172.21.15.29:0/392853500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a6413d2e0 0x7f3a640cd8c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3a640cf2b0 tx=0x7f3a5c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce5f55987071e42 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:24.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.090+0000 7f3a62000640 1 -- 172.21.15.29:0/392853500 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0a5840 con 0x7f3a6413d2e0 2024-01-24T13:05:24.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.090+0000 7f3a62000640 1 -- 172.21.15.29:0/392853500 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0a59a0 con 0x7f3a6413d2e0 2024-01-24T13:05:24.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.090+0000 7f3a62000640 1 -- 172.21.15.29:0/392853500 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0a5d30 con 0x7f3a6413d2e0 2024-01-24T13:05:24.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 -- 172.21.15.29:0/392853500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a6413d2e0 msgr2=0x7f3a640cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:24.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 --2- 172.21.15.29:0/392853500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a6413d2e0 0x7f3a640cd8c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3a640cf2b0 tx=0x7f3a5c01c9a0 comp rx=0 tx=0).stop 2024-01-24T13:05:24.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 -- 172.21.15.29:0/392853500 shutdown_connections 2024-01-24T13:05:24.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 --2- 172.21.15.29:0/392853500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a6413d2e0 0x7f3a640cd8c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:24.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 --2- 172.21.15.29:0/392853500 >> v2:172.21.15.163:3300/0 conn(0x7f3a6406c200 0x7f3a6413cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:24.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 -- 172.21.15.29:0/392853500 >> 172.21.15.29:0/392853500 conn(0x7f3a6406d700 msgr2=0x7f3a64069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:24.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 -- 172.21.15.29:0/392853500 shutdown_connections 2024-01-24T13:05:24.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 -- 172.21.15.29:0/392853500 wait complete. 2024-01-24T13:05:24.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 Processor -- start 2024-01-24T13:05:24.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 -- start start 2024-01-24T13:05:24.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a6406be20 0x7f3a64071720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:24.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a6406c200 0x7f3a64150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:24.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a6413d2e0 0x7f3a6414c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:24.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a64148470 con 0x7f3a6406c200 2024-01-24T13:05:24.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6414a190 con 0x7f3a6406be20 2024-01-24T13:05:24.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a6a000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a64071c60 con 0x7f3a6413d2e0 2024-01-24T13:05:24.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a62a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a6406c200 0x7f3a64150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a62a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a6406c200 0x7f3a64150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47982/0 (socket says 172.21.15.29:47982) 2024-01-24T13:05:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.094+0000 7f3a62a00640 1 -- 172.21.15.29:0/1856439444 learned_addr learned my addr 172.21.15.29:0/1856439444 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a63e00640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a6413d2e0 0x7f3a6414c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a62a00640 1 -- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a6413d2e0 msgr2=0x7f3a6414c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a62a00640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a6413d2e0 0x7f3a6414c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a63400640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a6406be20 0x7f3a64071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a62a00640 1 -- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a6406be20 msgr2=0x7f3a64071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a62a00640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a6406be20 0x7f3a64071720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a62a00640 1 -- 172.21.15.29:0/1856439444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c009b30 con 0x7f3a6406c200 2024-01-24T13:05:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a63e00640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a6413d2e0 0x7f3a6414c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a63400640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a6406be20 0x7f3a64071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a62a00640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a6406c200 0x7f3a64150620 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00e930 tx=0x7f3a4c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a5b400640 1 -- 172.21.15.29:0/1856439444 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c009690 con 0x7f3a6406c200 2024-01-24T13:05:24.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a5b400640 1 -- 172.21.15.29:0/1856439444 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4c00c9a0 con 0x7f3a6406c200 2024-01-24T13:05:24.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a5b400640 1 -- 172.21.15.29:0/1856439444 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c00cd10 con 0x7f3a6406c200 2024-01-24T13:05:24.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a6a000640 1 -- 172.21.15.29:0/1856439444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a64150b60 con 0x7f3a6406c200 2024-01-24T13:05:24.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a6a000640 1 -- 172.21.15.29:0/1856439444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a64149eb0 con 0x7f3a6406c200 2024-01-24T13:05:24.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a6a000640 1 -- 172.21.15.29:0/1856439444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6404e850 con 0x7f3a6406c200 2024-01-24T13:05:24.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a5b400640 1 -- 172.21.15.29:0/1856439444 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3a4c013470 con 0x7f3a6406c200 2024-01-24T13:05:24.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a5b400640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a3c065a60 0x7f3a3c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:24.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a5b400640 1 -- 172.21.15.29:0/1856439444 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3a4c083990 con 0x7f3a6406c200 2024-01-24T13:05:24.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.098+0000 7f3a63400640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a3c065a60 0x7f3a3c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:24.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.102+0000 7f3a63400640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a3c065a60 0x7f3a3c067f20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3a54000f70 tx=0x7f3a54009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:24.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.102+0000 7f3a5b400640 1 -- 172.21.15.29:0/1856439444 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3a4c0511b0 con 0x7f3a6406c200 2024-01-24T13:05:24.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:24.298+0000 7f3a6a000640 1 -- 172.21.15.29:0/1856439444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3a6415ea10 con 0x7f3a6406c200 2024-01-24T13:05:25.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.226+0000 7f3a5b400640 1 -- 172.21.15.29:0/1856439444 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3a4c0547d0 con 0x7f3a6406c200 2024-01-24T13:05:25.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.230+0000 7f3a6a000640 1 -- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a3c065a60 msgr2=0x7f3a3c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:25.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.230+0000 7f3a6a000640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a3c065a60 0x7f3a3c067f20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3a54000f70 tx=0x7f3a54009040 comp rx=0 tx=0).stop 2024-01-24T13:05:25.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.230+0000 7f3a6a000640 1 -- 172.21.15.29:0/1856439444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a6406c200 msgr2=0x7f3a64150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:25.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.230+0000 7f3a6a000640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a6406c200 0x7f3a64150620 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00e930 tx=0x7f3a4c00edf0 comp rx=0 tx=0).stop 2024-01-24T13:05:25.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.230+0000 7f3a6a000640 1 -- 172.21.15.29:0/1856439444 shutdown_connections 2024-01-24T13:05:25.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.230+0000 7f3a6a000640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3a3c065a60 0x7f3a3c067f20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:25.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.230+0000 7f3a6a000640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3a6413d2e0 0x7f3a6414c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:25.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.230+0000 7f3a6a000640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a6406c200 0x7f3a64150620 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:25.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.230+0000 7f3a6a000640 1 --2- 172.21.15.29:0/1856439444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a6406be20 0x7f3a64071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:25.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.230+0000 7f3a6a000640 1 -- 172.21.15.29:0/1856439444 >> 172.21.15.29:0/1856439444 conn(0x7f3a6406d700 msgr2=0x7f3a64150f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:25.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.230+0000 7f3a6a000640 1 -- 172.21.15.29:0/1856439444 shutdown_connections 2024-01-24T13:05:25.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.230+0000 7f3a6a000640 1 -- 172.21.15.29:0/1856439444 wait complete. 2024-01-24T13:05:25.258 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-24T13:05:25.258 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-24T13:05:25.377 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:05:25.381 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:05:25.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.402+0000 7fb0fbe00640 1 Processor -- start 2024-01-24T13:05:25.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.402+0000 7fb0fbe00640 1 -- start start 2024-01-24T13:05:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0fbe00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb0f415dd00 0x7fb0f4070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0fbe00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb0f406a3e0 0x7fb0f4071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0fbe00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f415e220 con 0x7fb0f415d920 2024-01-24T13:05:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0fbe00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f415e500 con 0x7fb0f415dd00 2024-01-24T13:05:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0fbe00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f415e7e0 con 0x7fb0f406a3e0 2024-01-24T13:05:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0f9400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb0f415d920 0x7fb0f4069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59076/0 (socket says 172.21.15.29:59076) 2024-01-24T13:05:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0f9400640 1 -- 172.21.15.29:0/1706323205 learned_addr learned my addr 172.21.15.29:0/1706323205 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0f9e00640 1 --2- 172.21.15.29:0/1706323205 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb0f406a3e0 0x7fb0f4071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0f8a00640 1 --2- 172.21.15.29:0/1706323205 >> v2:172.21.15.163:3300/0 conn(0x7fb0f415dd00 0x7fb0f4070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0f3e00640 1 -- 172.21.15.29:0/1706323205 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967021483 0 0) 0x7fb0f415e220 con 0x7fb0f415d920 2024-01-24T13:05:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0f3e00640 1 -- 172.21.15.29:0/1706323205 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d4003530 con 0x7fb0f415d920 2024-01-24T13:05:25.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0f9e00640 1 -- 172.21.15.29:0/1706323205 >> v2:172.21.15.163:3300/0 conn(0x7fb0f415dd00 msgr2=0x7fb0f4070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:25.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0f9e00640 1 --2- 172.21.15.29:0/1706323205 >> v2:172.21.15.163:3300/0 conn(0x7fb0f415dd00 0x7fb0f4070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:25.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0f9e00640 1 -- 172.21.15.29:0/1706323205 >> v1:172.21.15.29:6789/0 conn(0x7fb0f415d920 legacy=0x7fb0f4069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:25.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.406+0000 7fb0f9e00640 1 -- 172.21.15.29:0/1706323205 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f415eac0 con 0x7fb0f406a3e0 2024-01-24T13:05:25.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.410+0000 7fb0f9e00640 1 --2- 172.21.15.29:0/1706323205 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb0f406a3e0 0x7fb0f4071230 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009d90 tx=0x7fb0ec01c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f6f5eab73a47827 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:25.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.410+0000 7fb0f3e00640 1 -- 172.21.15.29:0/1706323205 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0a5800 con 0x7fb0f406a3e0 2024-01-24T13:05:25.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.410+0000 7fb0f3e00640 1 -- 172.21.15.29:0/1706323205 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec0a5960 con 0x7fb0f406a3e0 2024-01-24T13:05:25.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.410+0000 7fb0f3e00640 1 -- 172.21.15.29:0/1706323205 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0a5cd0 con 0x7fb0f406a3e0 2024-01-24T13:05:25.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.410+0000 7fb0fbe00640 1 -- 172.21.15.29:0/1706323205 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb0f406a3e0 msgr2=0x7fb0f4071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:25.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.410+0000 7fb0fbe00640 1 --2- 172.21.15.29:0/1706323205 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb0f406a3e0 0x7fb0f4071230 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009d90 tx=0x7fb0ec01c830 comp rx=0 tx=0).stop 2024-01-24T13:05:25.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.410+0000 7fb0fbe00640 1 -- 172.21.15.29:0/1706323205 shutdown_connections 2024-01-24T13:05:25.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.410+0000 7fb0fbe00640 1 --2- 172.21.15.29:0/1706323205 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb0f406a3e0 0x7fb0f4071230 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:25.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.410+0000 7fb0fbe00640 1 --2- 172.21.15.29:0/1706323205 >> v2:172.21.15.163:3300/0 conn(0x7fb0f415dd00 0x7fb0f4070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:25.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.410+0000 7fb0fbe00640 1 -- 172.21.15.29:0/1706323205 >> 172.21.15.29:0/1706323205 conn(0x7fb0f40cbd50 msgr2=0x7fb0f40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:25.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.410+0000 7fb0fbe00640 1 -- 172.21.15.29:0/1706323205 shutdown_connections 2024-01-24T13:05:25.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.410+0000 7fb0fbe00640 1 -- 172.21.15.29:0/1706323205 wait complete. 2024-01-24T13:05:25.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.410+0000 7fb0fbe00640 1 Processor -- start 2024-01-24T13:05:25.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.410+0000 7fb0fbe00640 1 -- start start 2024-01-24T13:05:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0fbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0f406a3e0 0x7fb0f41579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0fbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f415d920 0x7fb0f4150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0fbe00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb0f415dd00 0x7fb0f4159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0fbe00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4151a80 con 0x7fb0f415d920 2024-01-24T13:05:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0fbe00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4158080 con 0x7fb0f406a3e0 2024-01-24T13:05:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0fbe00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4158360 con 0x7fb0f415dd00 2024-01-24T13:05:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f8a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f415d920 0x7fb0f4150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f8a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f415d920 0x7fb0f4150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47996/0 (socket says 172.21.15.29:47996) 2024-01-24T13:05:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f8a00640 1 -- 172.21.15.29:0/3438952767 learned_addr learned my addr 172.21.15.29:0/3438952767 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f9400640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0f406a3e0 0x7fb0f41579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f9e00640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb0f415dd00 0x7fb0f4159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:25.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f8a00640 1 -- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb0f415dd00 msgr2=0x7fb0f4159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:25.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f8a00640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb0f415dd00 0x7fb0f4159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:25.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f8a00640 1 -- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0f406a3e0 msgr2=0x7fb0f41579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:25.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f8a00640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0f406a3e0 0x7fb0f41579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:25.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f8a00640 1 -- 172.21.15.29:0/3438952767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec009a70 con 0x7fb0f415d920 2024-01-24T13:05:25.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f9400640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0f406a3e0 0x7fb0f41579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:25.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f8a00640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f415d920 0x7fb0f4150990 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00e840 tx=0x7fb0dc00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:25.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f1600640 1 -- 172.21.15.29:0/3438952767 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc009510 con 0x7fb0f415d920 2024-01-24T13:05:25.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f1600640 1 -- 172.21.15.29:0/3438952767 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0dc00ee90 con 0x7fb0f415d920 2024-01-24T13:05:25.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0f1600640 1 -- 172.21.15.29:0/3438952767 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc00cb80 con 0x7fb0f415d920 2024-01-24T13:05:25.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0fbe00640 1 -- 172.21.15.29:0/3438952767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f4158640 con 0x7fb0f415d920 2024-01-24T13:05:25.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0fbe00640 1 -- 172.21.15.29:0/3438952767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f4158c00 con 0x7fb0f415d920 2024-01-24T13:05:25.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.414+0000 7fb0fbe00640 1 -- 172.21.15.29:0/3438952767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f406f0d0 con 0x7fb0f415d920 2024-01-24T13:05:25.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.418+0000 7fb0f1600640 1 -- 172.21.15.29:0/3438952767 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb0dc00cce0 con 0x7fb0f415d920 2024-01-24T13:05:25.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.418+0000 7fb0f1600640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb0cc065a60 0x7fb0cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:25.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.418+0000 7fb0f1600640 1 -- 172.21.15.29:0/3438952767 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb0dc0833c0 con 0x7fb0f415d920 2024-01-24T13:05:25.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.418+0000 7fb0f9400640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb0cc065a60 0x7fb0cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:25.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.418+0000 7fb0f9400640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb0cc065a60 0x7fb0cc067f20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4005890 tx=0x7fb0e4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:25.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.422+0000 7fb0f1600640 1 -- 172.21.15.29:0/3438952767 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb0dc050c20 con 0x7fb0f415d920 2024-01-24T13:05:25.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:25.614+0000 7fb0fbe00640 1 -- 172.21.15.29:0/3438952767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb0f404e850 con 0x7fb0f415d920 2024-01-24T13:05:26.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.330+0000 7fb0f1600640 1 -- 172.21.15.29:0/3438952767 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb0dc054240 con 0x7fb0f415d920 2024-01-24T13:05:26.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.330+0000 7fb0fbe00640 1 -- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb0cc065a60 msgr2=0x7fb0cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:26.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.330+0000 7fb0fbe00640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb0cc065a60 0x7fb0cc067f20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4005890 tx=0x7fb0e4009040 comp rx=0 tx=0).stop 2024-01-24T13:05:26.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.330+0000 7fb0fbe00640 1 -- 172.21.15.29:0/3438952767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f415d920 msgr2=0x7fb0f4150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:26.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.330+0000 7fb0fbe00640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f415d920 0x7fb0f4150990 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00e840 tx=0x7fb0dc00ec40 comp rx=0 tx=0).stop 2024-01-24T13:05:26.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.330+0000 7fb0fbe00640 1 -- 172.21.15.29:0/3438952767 shutdown_connections 2024-01-24T13:05:26.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.330+0000 7fb0fbe00640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb0cc065a60 0x7fb0cc067f20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.330+0000 7fb0fbe00640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb0f415dd00 0x7fb0f4159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.330+0000 7fb0fbe00640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f415d920 0x7fb0f4150990 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.330+0000 7fb0fbe00640 1 --2- 172.21.15.29:0/3438952767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0f406a3e0 0x7fb0f41579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.330+0000 7fb0fbe00640 1 -- 172.21.15.29:0/3438952767 >> 172.21.15.29:0/3438952767 conn(0x7fb0f40cbd50 msgr2=0x7fb0f40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:26.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.330+0000 7fb0fbe00640 1 -- 172.21.15.29:0/3438952767 shutdown_connections 2024-01-24T13:05:26.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.330+0000 7fb0fbe00640 1 -- 172.21.15.29:0/3438952767 wait complete. 2024-01-24T13:05:26.359 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-24T13:05:26.360 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:05:26.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a04800640 1 Processor -- start 2024-01-24T13:05:26.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a04800640 1 -- start start 2024-01-24T13:05:26.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a04800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f09fc15d130 0x7f09fc15d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:26.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a04800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09fc06ade0 0x7f09fc06b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:26.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a04800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc0d0bf0 con 0x7f09fc0ccdb0 2024-01-24T13:05:26.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a04800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc0cec60 con 0x7f09fc15d130 2024-01-24T13:05:26.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a04800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc15de60 con 0x7f09fc06ade0 2024-01-24T13:05:26.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a01400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f09fc15d130 0x7f09fc15d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:26.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a01400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f09fc15d130 0x7f09fc15d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47998/0 (socket says 172.21.15.29:47998) 2024-01-24T13:05:26.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a01400640 1 -- 172.21.15.29:0/3903872581 learned_addr learned my addr 172.21.15.29:0/3903872581 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:26.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a02800640 1 --2- 172.21.15.29:0/3903872581 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09fc06ade0 0x7f09fc06b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:26.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a01400640 1 -- 172.21.15.29:0/3903872581 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09fc06ade0 msgr2=0x7f09fc06b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:26.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a01400640 1 --2- 172.21.15.29:0/3903872581 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09fc06ade0 0x7f09fc06b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a01400640 1 -- 172.21.15.29:0/3903872581 >> v1:172.21.15.163:6789/0 conn(0x7f09fc0ccdb0 legacy=0x7f09fc0cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:26.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.502+0000 7f0a01400640 1 -- 172.21.15.29:0/3903872581 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc0d0040 con 0x7f09fc15d130 2024-01-24T13:05:26.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.506+0000 7f0a01400640 1 --2- 172.21.15.29:0/3903872581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09fc15d130 0x7f09fc15d5e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009870 tx=0x7f09e401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246547c8d9030216 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:26.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.506+0000 7f0a00a00640 1 -- 172.21.15.29:0/3903872581 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40ab5f0 con 0x7f09fc15d130 2024-01-24T13:05:26.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.506+0000 7f0a00a00640 1 -- 172.21.15.29:0/3903872581 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e40ab750 con 0x7f09fc15d130 2024-01-24T13:05:26.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.506+0000 7f0a00a00640 1 -- 172.21.15.29:0/3903872581 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40abae0 con 0x7f09fc15d130 2024-01-24T13:05:26.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.506+0000 7f0a04800640 1 -- 172.21.15.29:0/3903872581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09fc15d130 msgr2=0x7f09fc15d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:26.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.506+0000 7f0a04800640 1 --2- 172.21.15.29:0/3903872581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09fc15d130 0x7f09fc15d5e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009870 tx=0x7f09e401c3f0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.506+0000 7f0a04800640 1 -- 172.21.15.29:0/3903872581 shutdown_connections 2024-01-24T13:05:26.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.506+0000 7f0a04800640 1 --2- 172.21.15.29:0/3903872581 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09fc06ade0 0x7f09fc06b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.506+0000 7f0a04800640 1 --2- 172.21.15.29:0/3903872581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09fc15d130 0x7f09fc15d5e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.506+0000 7f0a04800640 1 -- 172.21.15.29:0/3903872581 >> 172.21.15.29:0/3903872581 conn(0x7f09fc070570 msgr2=0x7f09fc069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:26.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.506+0000 7f0a04800640 1 -- 172.21.15.29:0/3903872581 shutdown_connections 2024-01-24T13:05:26.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.506+0000 7f0a04800640 1 -- 172.21.15.29:0/3903872581 wait complete. 2024-01-24T13:05:26.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a04800640 1 Processor -- start 2024-01-24T13:05:26.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a04800640 1 -- start start 2024-01-24T13:05:26.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a04800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09fc06ade0 0x7f09fc151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:26.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a04800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09fc0ccdb0 0x7f09fc0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:26.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a04800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09fc15d130 0x7f09fc0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:26.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a04800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0c9260 con 0x7f09fc0ccdb0 2024-01-24T13:05:26.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a04800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc151e80 con 0x7f09fc06ade0 2024-01-24T13:05:26.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a04800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0c8620 con 0x7f09fc15d130 2024-01-24T13:05:26.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a01400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09fc0ccdb0 0x7f09fc0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:26.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a01400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09fc0ccdb0 0x7f09fc0cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48002/0 (socket says 172.21.15.29:48002) 2024-01-24T13:05:26.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a01400640 1 -- 172.21.15.29:0/2235060444 learned_addr learned my addr 172.21.15.29:0/2235060444 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:26.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a02800640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09fc15d130 0x7f09fc0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:26.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a01e00640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09fc06ade0 0x7f09fc151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:26.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a01400640 1 -- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09fc15d130 msgr2=0x7f09fc0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:26.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a01400640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09fc15d130 0x7f09fc0cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a01400640 1 -- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09fc06ade0 msgr2=0x7f09fc151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:26.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a01400640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09fc06ade0 0x7f09fc151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a01400640 1 -- 172.21.15.29:0/2235060444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40094d0 con 0x7f09fc0ccdb0 2024-01-24T13:05:26.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a02800640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09fc15d130 0x7f09fc0cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:26.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a01e00640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09fc06ade0 0x7f09fc151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:26.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a01400640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09fc0ccdb0 0x7f09fc0cbdb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f09e40ad040 tx=0x7f09e4019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:26.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f09fa000640 1 -- 172.21.15.29:0/2235060444 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40b5810 con 0x7f09fc0ccdb0 2024-01-24T13:05:26.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f09fa000640 1 -- 172.21.15.29:0/2235060444 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e40b59b0 con 0x7f09fc0ccdb0 2024-01-24T13:05:26.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f09fa000640 1 -- 172.21.15.29:0/2235060444 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40b5d60 con 0x7f09fc0ccdb0 2024-01-24T13:05:26.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.510+0000 7f0a04800640 1 -- 172.21.15.29:0/2235060444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc0c88c0 con 0x7f09fc0ccdb0 2024-01-24T13:05:26.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.514+0000 7f0a04800640 1 -- 172.21.15.29:0/2235060444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc0c8e80 con 0x7f09fc0ccdb0 2024-01-24T13:05:26.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.514+0000 7f0a04800640 1 -- 172.21.15.29:0/2235060444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09fc04e850 con 0x7f09fc0ccdb0 2024-01-24T13:05:26.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.514+0000 7f09fa000640 1 -- 172.21.15.29:0/2235060444 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f09e40c93f0 con 0x7f09fc0ccdb0 2024-01-24T13:05:26.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.514+0000 7f09fa000640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f09d4065a60 0x7f09d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.514+0000 7f09fa000640 1 -- 172.21.15.29:0/2235060444 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f09e40a8050 con 0x7f09fc0ccdb0 2024-01-24T13:05:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.514+0000 7f0a01e00640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f09d4065a60 0x7f09d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.514+0000 7f0a01e00640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f09d4065a60 0x7f09d4067f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f09ec000f70 tx=0x7f09ec009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:26.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.518+0000 7f09fa000640 1 -- 172.21.15.29:0/2235060444 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f09e40eb690 con 0x7f09fc0ccdb0 2024-01-24T13:05:26.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.706+0000 7f0a04800640 1 -- 172.21.15.29:0/2235060444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09fc0b2960 con 0x7f09fc0ccdb0 2024-01-24T13:05:26.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.706+0000 7f09fa000640 1 -- 172.21.15.29:0/2235060444 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4737 (secure 0 0 0) 0x7f09e40c4090 con 0x7f09fc0ccdb0 2024-01-24T13:05:26.711 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:26.711 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3468790539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3468790539},{"type":"v1","addr":"172.21.15.29:6834","nonce":3468790539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3278958688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3278958688},{"type":"v1","addr":"172.21.15.29:6835","nonce":3278958688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/1296970243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1296970243},{"type":"v1","addr":"172.21.15.163:6836","nonce":1296970243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:05:23.206301+0000","modified":"2024-01-24T13:05:26.327228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5463":{"gid":5463,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/140413977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":140413977},{"type":"v1","addr":"172.21.15.163:6837","nonce":140413977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-24T13:05:26.711 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2024-01-24T13:05:26.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.710+0000 7f0a04800640 1 -- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f09d4065a60 msgr2=0x7f09d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:26.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.710+0000 7f0a04800640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f09d4065a60 0x7f09d4067f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f09ec000f70 tx=0x7f09ec009040 comp rx=0 tx=0).stop 2024-01-24T13:05:26.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.710+0000 7f0a04800640 1 -- 172.21.15.29:0/2235060444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09fc0ccdb0 msgr2=0x7f09fc0cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:26.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.710+0000 7f0a04800640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09fc0ccdb0 0x7f09fc0cbdb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f09e40ad040 tx=0x7f09e4019190 comp rx=0 tx=0).stop 2024-01-24T13:05:26.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.710+0000 7f0a04800640 1 -- 172.21.15.29:0/2235060444 shutdown_connections 2024-01-24T13:05:26.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.710+0000 7f0a04800640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f09d4065a60 0x7f09d4067f20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.710+0000 7f0a04800640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09fc15d130 0x7f09fc0cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.710+0000 7f0a04800640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09fc0ccdb0 0x7f09fc0cbdb0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.710+0000 7f0a04800640 1 --2- 172.21.15.29:0/2235060444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09fc06ade0 0x7f09fc151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.710+0000 7f0a04800640 1 -- 172.21.15.29:0/2235060444 >> 172.21.15.29:0/2235060444 conn(0x7f09fc070570 msgr2=0x7f09fc069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.710+0000 7f0a04800640 1 -- 172.21.15.29:0/2235060444 shutdown_connections 2024-01-24T13:05:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.710+0000 7f0a04800640 1 -- 172.21.15.29:0/2235060444 wait complete. 2024-01-24T13:05:26.733 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:26.776 INFO:tasks.ceph.mds.b.smithi163.stderr:2024-01-24T13:05:26.773+0000 7fa1f5000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-24T13:05:26.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa99fc00640 1 Processor -- start 2024-01-24T13:05:26.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa99fc00640 1 -- start start 2024-01-24T13:05:26.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa99fc00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa9980cb100 0x7fa998165280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:26.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa99fc00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9980cfe50 con 0x7fa9980c3ef0 2024-01-24T13:05:26.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa99fc00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99815aa10 con 0x7fa99815a630 2024-01-24T13:05:26.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa99fc00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9980cf380 con 0x7fa9980cb100 2024-01-24T13:05:26.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa997e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa9980c3ef0 0x7fa9980ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59092/0 (socket says 172.21.15.29:59092) 2024-01-24T13:05:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa997e00640 1 -- 172.21.15.29:0/1471496438 learned_addr learned my addr 172.21.15.29:0/1471496438 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa99dc00640 1 --2- 172.21.15.29:0/1471496438 >> v2:172.21.15.163:3300/0 conn(0x7fa9980cb100 0x7fa998165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa997400640 1 -- 172.21.15.29:0/1471496438 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546491497 0 0) 0x7fa9980cfe50 con 0x7fa9980c3ef0 2024-01-24T13:05:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa997400640 1 -- 172.21.15.29:0/1471496438 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa978003530 con 0x7fa9980c3ef0 2024-01-24T13:05:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa99dc00640 1 -- 172.21.15.29:0/1471496438 >> v1:172.21.15.163:6789/0 conn(0x7fa99815a630 legacy=0x7fa9980cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa997400640 1 -- 172.21.15.29:0/1471496438 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2713135751 0 0) 0x7fa978003530 con 0x7fa9980c3ef0 2024-01-24T13:05:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa99dc00640 1 -- 172.21.15.29:0/1471496438 >> v1:172.21.15.29:6789/0 conn(0x7fa9980c3ef0 legacy=0x7fa9980ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.870+0000 7fa99dc00640 1 -- 172.21.15.29:0/1471496438 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9980b2b70 con 0x7fa9980cb100 2024-01-24T13:05:26.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.874+0000 7fa99dc00640 1 --2- 172.21.15.29:0/1471496438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa9980cb100 0x7fa998165280 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa990009d90 tx=0x7fa99001c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3be7757ac257b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:26.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.874+0000 7fa997400640 1 -- 172.21.15.29:0/1471496438 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980001680 con 0x7fa9980cb100 2024-01-24T13:05:26.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.874+0000 7fa997400640 1 -- 172.21.15.29:0/1471496438 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9900a5680 con 0x7fa9980cb100 2024-01-24T13:05:26.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.874+0000 7fa997400640 1 -- 172.21.15.29:0/1471496438 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9900a5a10 con 0x7fa9980cb100 2024-01-24T13:05:26.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.874+0000 7fa99fc00640 1 -- 172.21.15.29:0/1471496438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa9980cb100 msgr2=0x7fa998165280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:26.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.874+0000 7fa99fc00640 1 --2- 172.21.15.29:0/1471496438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa9980cb100 0x7fa998165280 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa990009d90 tx=0x7fa99001c840 comp rx=0 tx=0).stop 2024-01-24T13:05:26.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.874+0000 7fa99fc00640 1 -- 172.21.15.29:0/1471496438 shutdown_connections 2024-01-24T13:05:26.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.874+0000 7fa99fc00640 1 --2- 172.21.15.29:0/1471496438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa9980cb100 0x7fa998165280 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.874+0000 7fa99fc00640 1 -- 172.21.15.29:0/1471496438 >> 172.21.15.29:0/1471496438 conn(0x7fa998070570 msgr2=0x7fa998069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:26.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99fc00640 1 -- 172.21.15.29:0/1471496438 shutdown_connections 2024-01-24T13:05:26.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99fc00640 1 -- 172.21.15.29:0/1471496438 wait complete. 2024-01-24T13:05:26.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99fc00640 1 Processor -- start 2024-01-24T13:05:26.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99fc00640 1 -- start start 2024-01-24T13:05:26.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99fc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa9980c3ef0 0x7fa9981535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:26.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99fc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa9980cb100 0x7fa9981498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:26.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99fc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa99815a630 0x7fa9980c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:26.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99fc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa998153b20 con 0x7fa99815a630 2024-01-24T13:05:26.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99fc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980c5330 con 0x7fa9980cb100 2024-01-24T13:05:26.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99fc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa998152a00 con 0x7fa9980c3ef0 2024-01-24T13:05:26.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99dc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa99815a630 0x7fa9980c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:26.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99dc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa99815a630 0x7fa9980c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48018/0 (socket says 172.21.15.29:48018) 2024-01-24T13:05:26.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99dc00640 1 -- 172.21.15.29:0/3409732703 learned_addr learned my addr 172.21.15.29:0/3409732703 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:26.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa997e00640 1 --2- 172.21.15.29:0/3409732703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa9980cb100 0x7fa9981498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:26.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99d200640 1 --2- 172.21.15.29:0/3409732703 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa9980c3ef0 0x7fa9981535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:26.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99dc00640 1 -- 172.21.15.29:0/3409732703 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa9980c3ef0 msgr2=0x7fa9981535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:26.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99dc00640 1 --2- 172.21.15.29:0/3409732703 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa9980c3ef0 0x7fa9981535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99dc00640 1 -- 172.21.15.29:0/3409732703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa9980cb100 msgr2=0x7fa9981498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:26.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99dc00640 1 --2- 172.21.15.29:0/3409732703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa9980cb100 0x7fa9981498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:26.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99dc00640 1 -- 172.21.15.29:0/3409732703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa990009a70 con 0x7fa99815a630 2024-01-24T13:05:26.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.878+0000 7fa99dc00640 1 --2- 172.21.15.29:0/3409732703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa99815a630 0x7fa9980c7fd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa9900b0040 tx=0x7fa9900195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:26.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.882+0000 7fa994c00640 1 -- 172.21.15.29:0/3409732703 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990003ba0 con 0x7fa99815a630 2024-01-24T13:05:26.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.882+0000 7fa994c00640 1 -- 172.21.15.29:0/3409732703 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa990003d00 con 0x7fa99815a630 2024-01-24T13:05:26.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.882+0000 7fa994c00640 1 -- 172.21.15.29:0/3409732703 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9900b98a0 con 0x7fa99815a630 2024-01-24T13:05:26.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.882+0000 7fa99fc00640 1 -- 172.21.15.29:0/3409732703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa998152ce0 con 0x7fa99815a630 2024-01-24T13:05:26.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.882+0000 7fa99fc00640 1 -- 172.21.15.29:0/3409732703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9980c4fc0 con 0x7fa99815a630 2024-01-24T13:05:26.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.882+0000 7fa99fc00640 1 -- 172.21.15.29:0/3409732703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9980c54a0 con 0x7fa99815a630 2024-01-24T13:05:26.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.882+0000 7fa994c00640 1 -- 172.21.15.29:0/3409732703 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa9900b9a00 con 0x7fa99815a630 2024-01-24T13:05:26.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.882+0000 7fa994c00640 1 --2- 172.21.15.29:0/3409732703 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa970065a60 0x7fa970067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:26.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.882+0000 7fa994c00640 1 -- 172.21.15.29:0/3409732703 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa99011db10 con 0x7fa99815a630 2024-01-24T13:05:26.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.882+0000 7fa99d200640 1 --2- 172.21.15.29:0/3409732703 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa970065a60 0x7fa970067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:26.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.886+0000 7fa99d200640 1 --2- 172.21.15.29:0/3409732703 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa970065a60 0x7fa970067f20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa988000f70 tx=0x7fa988009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:26.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:26.886+0000 7fa994c00640 1 -- 172.21.15.29:0/3409732703 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa9900eb2f0 con 0x7fa99815a630 2024-01-24T13:05:27.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.046+0000 7fa99fc00640 1 -- 172.21.15.29:0/3409732703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa99804e850 con 0x7fa99815a630 2024-01-24T13:05:27.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.046+0000 7fa994c00640 1 -- 172.21.15.29:0/3409732703 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16306 (secure 0 0 0) 0x7fa990009450 con 0x7fa99815a630 2024-01-24T13:05:27.050 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:27.051 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":43,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:05:24.209444+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:05:21.225564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-24T13:05:22.188525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:27.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.046+0000 7fa99fc00640 1 -- 172.21.15.29:0/3409732703 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa970065a60 msgr2=0x7fa970067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.046+0000 7fa99fc00640 1 --2- 172.21.15.29:0/3409732703 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa970065a60 0x7fa970067f20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa988000f70 tx=0x7fa988009040 comp rx=0 tx=0).stop 2024-01-24T13:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.046+0000 7fa99fc00640 1 -- 172.21.15.29:0/3409732703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa99815a630 msgr2=0x7fa9980c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.046+0000 7fa99fc00640 1 --2- 172.21.15.29:0/3409732703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa99815a630 0x7fa9980c7fd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa9900b0040 tx=0x7fa9900195e0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.050+0000 7fa99fc00640 1 -- 172.21.15.29:0/3409732703 shutdown_connections 2024-01-24T13:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.050+0000 7fa99fc00640 1 --2- 172.21.15.29:0/3409732703 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa970065a60 0x7fa970067f20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.050+0000 7fa99fc00640 1 --2- 172.21.15.29:0/3409732703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa99815a630 0x7fa9980c7fd0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.050+0000 7fa99fc00640 1 --2- 172.21.15.29:0/3409732703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa9980cb100 0x7fa9981498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.050+0000 7fa99fc00640 1 --2- 172.21.15.29:0/3409732703 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa9980c3ef0 0x7fa9981535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.050+0000 7fa99fc00640 1 -- 172.21.15.29:0/3409732703 >> 172.21.15.29:0/3409732703 conn(0x7fa998070570 msgr2=0x7fa998157b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.050+0000 7fa99fc00640 1 -- 172.21.15.29:0/3409732703 shutdown_connections 2024-01-24T13:05:27.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.050+0000 7fa99fc00640 1 -- 172.21.15.29:0/3409732703 wait complete. 2024-01-24T13:05:27.072 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-24T13:05:27.073 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:05:27.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fd1400640 1 Processor -- start 2024-01-24T13:05:27.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fd1400640 1 -- start start 2024-01-24T13:05:27.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fd1400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2fcc0cf6b0 0x7f2fcc0cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:27.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fd1400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fcc0ce4e0 0x7f2fcc0ce960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:27.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fd1400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fcc0ceea0 con 0x7f2fcc069cd0 2024-01-24T13:05:27.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fd1400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fcc15cc50 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fd1400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc06d550 con 0x7f2fcc0ce4e0 2024-01-24T13:05:27.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fcb200640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2fcc069cd0 0x7f2fcc06a140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59094/0 (socket says 172.21.15.29:59094) 2024-01-24T13:05:27.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fcb200640 1 -- 172.21.15.29:0/3140582290 learned_addr learned my addr 172.21.15.29:0/3140582290 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:27.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fca800640 1 --2- 172.21.15.29:0/3140582290 >> v2:172.21.15.29:3300/0 conn(0x7f2fcc0cf6b0 0x7f2fcc0cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:27.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fc9e00640 1 --2- 172.21.15.29:0/3140582290 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fcc0ce4e0 0x7f2fcc0ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:27.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fca800640 1 -- 172.21.15.29:0/3140582290 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fcc0ce4e0 msgr2=0x7f2fcc0ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:27.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fca800640 1 --2- 172.21.15.29:0/3140582290 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fcc0ce4e0 0x7f2fcc0ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fca800640 1 -- 172.21.15.29:0/3140582290 >> v1:172.21.15.29:6789/0 conn(0x7f2fcc069cd0 legacy=0x7f2fcc06a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.210+0000 7f2fca800640 1 -- 172.21.15.29:0/3140582290 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc15ce60 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.214+0000 7f2fca800640 1 --2- 172.21.15.29:0/3140582290 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fcc0cf6b0 0x7f2fcc0cfa90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc0097c0 tx=0x7f2fbc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce764e29b83538c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.214+0000 7f2fc9400640 1 -- 172.21.15.29:0/3140582290 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0ab600 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.214+0000 7f2fc9400640 1 -- 172.21.15.29:0/3140582290 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc0a7050 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.214+0000 7f2fc9400640 1 -- 172.21.15.29:0/3140582290 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0ab980 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.214+0000 7f2fd1400640 1 -- 172.21.15.29:0/3140582290 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fcc0cf6b0 msgr2=0x7f2fcc0cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.214+0000 7f2fd1400640 1 --2- 172.21.15.29:0/3140582290 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fcc0cf6b0 0x7f2fcc0cfa90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc0097c0 tx=0x7f2fbc01c480 comp rx=0 tx=0).stop 2024-01-24T13:05:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.214+0000 7f2fd1400640 1 -- 172.21.15.29:0/3140582290 shutdown_connections 2024-01-24T13:05:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.214+0000 7f2fd1400640 1 --2- 172.21.15.29:0/3140582290 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fcc0ce4e0 0x7f2fcc0ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.214+0000 7f2fd1400640 1 --2- 172.21.15.29:0/3140582290 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fcc0cf6b0 0x7f2fcc0cfa90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.214+0000 7f2fd1400640 1 -- 172.21.15.29:0/3140582290 >> 172.21.15.29:0/3140582290 conn(0x7f2fcc06b1e0 msgr2=0x7f2fcc06b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.214+0000 7f2fd1400640 1 -- 172.21.15.29:0/3140582290 shutdown_connections 2024-01-24T13:05:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.214+0000 7f2fd1400640 1 -- 172.21.15.29:0/3140582290 wait complete. 2024-01-24T13:05:27.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fd1400640 1 Processor -- start 2024-01-24T13:05:27.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fd1400640 1 -- start start 2024-01-24T13:05:27.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fd1400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2fcc069cd0 0x7f2fcc14eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:27.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fd1400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fcc0ce4e0 0x7f2fcc0ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:27.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fd1400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fcc0cf6b0 0x7f2fcc154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:27.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fd1400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0c6380 con 0x7f2fcc0ce4e0 2024-01-24T13:05:27.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fd1400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0c6660 con 0x7f2fcc069cd0 2024-01-24T13:05:27.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fd1400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0c6940 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fc9e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fcc0ce4e0 0x7f2fcc0ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:27.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fc9e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fcc0ce4e0 0x7f2fcc0ca3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48030/0 (socket says 172.21.15.29:48030) 2024-01-24T13:05:27.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fcb200640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fcc0cf6b0 0x7f2fcc154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:27.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fc9e00640 1 -- 172.21.15.29:0/1856365061 learned_addr learned my addr 172.21.15.29:0/1856365061 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:27.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fca800640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2fcc069cd0 0x7f2fcc14eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fcb200640 1 -- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2fcc069cd0 msgr2=0x7f2fcc14eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fcb200640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2fcc069cd0 0x7f2fcc14eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fcb200640 1 -- 172.21.15.29:0/1856365061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fcc0ce4e0 msgr2=0x7f2fcc0ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fcb200640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fcc0ce4e0 0x7f2fcc0ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fcb200640 1 -- 172.21.15.29:0/1856365061 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc009420 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fca800640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2fcc069cd0 0x7f2fcc14eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:27.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fc9e00640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fcc0ce4e0 0x7f2fcc0ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:27.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.218+0000 7f2fcb200640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fcc0cf6b0 0x7f2fcc154fe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2fc400caa0 tx=0x7f2fc400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:27.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.222+0000 7f2fc2a00640 1 -- 172.21.15.29:0/1856365061 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc400ab40 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.222+0000 7f2fc2a00640 1 -- 172.21.15.29:0/1856365061 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc400aca0 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.222+0000 7f2fc2a00640 1 -- 172.21.15.29:0/1856365061 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4012600 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.222+0000 7f2fd1400640 1 -- 172.21.15.29:0/1856365061 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fcc0c6c20 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.222+0000 7f2fd1400640 1 -- 172.21.15.29:0/1856365061 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fcc0b21f0 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.222+0000 7f2fd1400640 1 -- 172.21.15.29:0/1856365061 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fcc04e850 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.222+0000 7f2fc2a00640 1 -- 172.21.15.29:0/1856365061 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2fc4012760 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.222+0000 7f2fc2a00640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2fa4065a60 0x7f2fa4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:27.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.222+0000 7f2fc2a00640 1 -- 172.21.15.29:0/1856365061 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2fc4082ff0 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.222+0000 7f2fca800640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2fa4065a60 0x7f2fa4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:27.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.226+0000 7f2fca800640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2fa4065a60 0x7f2fa4067f20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc0ad000 tx=0x7f2fbc0a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:27.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.230+0000 7f2fc2a00640 1 -- 172.21.15.29:0/1856365061 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2fc40508e0 con 0x7f2fcc0cf6b0 2024-01-24T13:05:27.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.382+0000 7f2fd1400640 1 -- 172.21.15.29:0/1856365061 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fcc15d6c0 con 0x7f2fa4065a60 2024-01-24T13:05:27.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.394+0000 7f2fc2a00640 1 -- 172.21.15.29:0/1856365061 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278378 (secure 0 0 0) 0x7f2fbc0abaf0 con 0x7f2fa4065a60 2024-01-24T13:05:27.400 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:27.402 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:05:27.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.394+0000 7f2fd1400640 1 -- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2fa4065a60 msgr2=0x7f2fa4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.394+0000 7f2fd1400640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2fa4065a60 0x7f2fa4067f20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc0ad000 tx=0x7f2fbc0a6000 comp rx=0 tx=0).stop 2024-01-24T13:05:27.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.394+0000 7f2fd1400640 1 -- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fcc0cf6b0 msgr2=0x7f2fcc154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.394+0000 7f2fd1400640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fcc0cf6b0 0x7f2fcc154fe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2fc400caa0 tx=0x7f2fc400cf60 comp rx=0 tx=0).stop 2024-01-24T13:05:27.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.398+0000 7f2fd1400640 1 -- 172.21.15.29:0/1856365061 shutdown_connections 2024-01-24T13:05:27.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.398+0000 7f2fd1400640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2fa4065a60 0x7f2fa4067f20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.398+0000 7f2fd1400640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fcc0cf6b0 0x7f2fcc154fe0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.398+0000 7f2fd1400640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fcc0ce4e0 0x7f2fcc0ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.398+0000 7f2fd1400640 1 --2- 172.21.15.29:0/1856365061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2fcc069cd0 0x7f2fcc14eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.398+0000 7f2fd1400640 1 -- 172.21.15.29:0/1856365061 >> 172.21.15.29:0/1856365061 conn(0x7f2fcc06b1e0 msgr2=0x7f2fcc06a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:27.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.398+0000 7f2fd1400640 1 -- 172.21.15.29:0/1856365061 shutdown_connections 2024-01-24T13:05:27.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.398+0000 7f2fd1400640 1 -- 172.21.15.29:0/1856365061 wait complete. 2024-01-24T13:05:27.421 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-01-24T13:05:25.559620+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":62,"acting":62,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224976,"kb_used_data":4700,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754749744,"statfs":{"total":773094113280,"available":772863737856,"internally_reserved":0,"allocated":4812800,"data_stored":2696319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000920"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794322+0000","last_change":"2024-01-24T13:05:21.794322+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794322+0000","last_undegraded":"2024-01-24T13:05:21.794322+0000","last_fullsized":"2024-01-24T13:05:21.794322+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:01:16.142279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797664+0000","last_change":"2024-01-24T13:05:21.797664+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797664+0000","last_undegraded":"2024-01-24T13:05:21.797664+0000","last_fullsized":"2024-01-24T13:05:21.797664+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:52:11.442955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792346+0000","last_change":"2024-01-24T13:05:21.792346+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792346+0000","last_undegraded":"2024-01-24T13:05:21.792346+0000","last_fullsized":"2024-01-24T13:05:21.792346+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:44:22.763339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794413+0000","last_change":"2024-01-24T13:05:21.794413+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794413+0000","last_undegraded":"2024-01-24T13:05:21.794413+0000","last_fullsized":"2024-01-24T13:05:21.794413+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:05.407056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794869+0000","last_change":"2024-01-24T13:05:21.794869+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794869+0000","last_undegraded":"2024-01-24T13:05:21.794869+0000","last_fullsized":"2024-01-24T13:05:21.794869+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:33:35.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795189+0000","last_change":"2024-01-24T13:05:21.795189+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795189+0000","last_undegraded":"2024-01-24T13:05:21.795189+0000","last_fullsized":"2024-01-24T13:05:21.795189+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:53:05.828860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792074+0000","last_change":"2024-01-24T13:05:21.792074+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792074+0000","last_undegraded":"2024-01-24T13:05:21.792074+0000","last_fullsized":"2024-01-24T13:05:21.792074+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:33:35.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795199+0000","last_change":"2024-01-24T13:05:21.795199+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795199+0000","last_undegraded":"2024-01-24T13:05:21.795199+0000","last_fullsized":"2024-01-24T13:05:21.795199+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:46:09.885466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792900+0000","last_change":"2024-01-24T13:05:21.792900+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792900+0000","last_undegraded":"2024-01-24T13:05:21.792900+0000","last_fullsized":"2024-01-24T13:05:21.792900+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:01:16.142279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791686+0000","last_change":"2024-01-24T13:05:21.791686+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791686+0000","last_undegraded":"2024-01-24T13:05:21.791686+0000","last_fullsized":"2024-01-24T13:05:21.791686+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:56:22.964132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791668+0000","last_change":"2024-01-24T13:05:21.791668+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791668+0000","last_undegraded":"2024-01-24T13:05:21.791668+0000","last_fullsized":"2024-01-24T13:05:21.791668+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:43:57.475660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792369+0000","last_change":"2024-01-24T13:05:21.792369+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792369+0000","last_undegraded":"2024-01-24T13:05:21.792369+0000","last_fullsized":"2024-01-24T13:05:21.792369+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:38:51.635054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794367+0000","last_change":"2024-01-24T13:05:21.794367+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794367+0000","last_undegraded":"2024-01-24T13:05:21.794367+0000","last_fullsized":"2024-01-24T13:05:21.794367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:52.859781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.798175+0000","last_change":"2024-01-24T13:05:21.798175+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.798175+0000","last_undegraded":"2024-01-24T13:05:21.798175+0000","last_fullsized":"2024-01-24T13:05:21.798175+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:08:11.324387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791571+0000","last_change":"2024-01-24T13:05:21.791571+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791571+0000","last_undegraded":"2024-01-24T13:05:21.791571+0000","last_fullsized":"2024-01-24T13:05:21.791571+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:37:28.187706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794399+0000","last_change":"2024-01-24T13:05:21.794399+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794399+0000","last_undegraded":"2024-01-24T13:05:21.794399+0000","last_fullsized":"2024-01-24T13:05:21.794399+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:44:22.763339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795497+0000","last_change":"2024-01-24T13:05:21.795497+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795497+0000","last_undegraded":"2024-01-24T13:05:21.795497+0000","last_fullsized":"2024-01-24T13:05:21.795497+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:32.634926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791046+0000","last_change":"2024-01-24T13:05:21.791046+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791046+0000","last_undegraded":"2024-01-24T13:05:21.791046+0000","last_fullsized":"2024-01-24T13:05:21.791046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:52:37.909722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797764+0000","last_change":"2024-01-24T13:05:21.797764+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797764+0000","last_undegraded":"2024-01-24T13:05:21.797764+0000","last_fullsized":"2024-01-24T13:05:21.797764+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:38:10.129854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:21.781410+0000","last_change":"2024-01-24T13:05:21.781410+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.781410+0000","last_undegraded":"2024-01-24T13:05:21.781410+0000","last_fullsized":"2024-01-24T13:05:21.781410+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:21.781410+0000","last_change":"2024-01-24T13:05:21.781410+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.781410+0000","last_undegraded":"2024-01-24T13:05:21.781410+0000","last_fullsized":"2024-01-24T13:05:21.781410+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797668+0000","last_change":"2024-01-24T13:05:21.797668+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797668+0000","last_undegraded":"2024-01-24T13:05:21.797668+0000","last_fullsized":"2024-01-24T13:05:21.797668+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:26.695067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795529+0000","last_change":"2024-01-24T13:05:21.795529+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795529+0000","last_undegraded":"2024-01-24T13:05:21.795529+0000","last_fullsized":"2024-01-24T13:05:21.795529+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:55:28.106943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797595+0000","last_change":"2024-01-24T13:05:21.797595+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797595+0000","last_undegraded":"2024-01-24T13:05:21.797595+0000","last_fullsized":"2024-01-24T13:05:21.797595+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:38:40.777988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791025+0000","last_change":"2024-01-24T13:05:21.791025+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791025+0000","last_undegraded":"2024-01-24T13:05:21.791025+0000","last_fullsized":"2024-01-24T13:05:21.791025+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:58:04.657760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.796985+0000","last_change":"2024-01-24T13:05:21.796985+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.796985+0000","last_undegraded":"2024-01-24T13:05:21.796985+0000","last_fullsized":"2024-01-24T13:05:21.796985+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:05:34.960781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797038+0000","last_change":"2024-01-24T13:05:21.797038+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797038+0000","last_undegraded":"2024-01-24T13:05:21.797038+0000","last_fullsized":"2024-01-24T13:05:21.797038+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:29:53.106048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.793777+0000","last_change":"2024-01-24T13:05:21.793777+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.793777+0000","last_undegraded":"2024-01-24T13:05:21.793777+0000","last_fullsized":"2024-01-24T13:05:21.793777+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:05.407056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.799163+0000","last_change":"2024-01-24T13:05:21.799163+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.799163+0000","last_undegraded":"2024-01-24T13:05:21.799163+0000","last_fullsized":"2024-01-24T13:05:21.799163+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:03:23.863326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791050+0000","last_change":"2024-01-24T13:05:21.791050+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791050+0000","last_undegraded":"2024-01-24T13:05:21.791050+0000","last_fullsized":"2024-01-24T13:05:21.791050+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:35:30.269642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.793380+0000","last_change":"2024-01-24T13:05:21.793380+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.793380+0000","last_undegraded":"2024-01-24T13:05:21.793380+0000","last_fullsized":"2024-01-24T13:05:21.793380+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:15.098387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.798470+0000","last_change":"2024-01-24T13:05:21.798470+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.798470+0000","last_undegraded":"2024-01-24T13:05:21.798470+0000","last_fullsized":"2024-01-24T13:05:21.798470+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:37:14.667657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":177,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-24T13:05:18.230458+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:05:18.230458+0000","last_peered":"2024-01-24T13:05:18.230458+0000","last_clean":"2024-01-24T13:05:18.230458+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:05:18.230458+0000","last_undegraded":"2024-01-24T13:05:18.230458+0000","last_fullsized":"2024-01-24T13:05:18.230458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.74199999999999999}]},{"osd":1,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.79200000000000004}]},{"osd":2,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.77800000000000002}]},{"osd":4,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.48899999999999999}]},{"osd":5,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55900000000000005}]},{"osd":6,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.58599999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":5.5579999999999998,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.61199999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":4.3289999999999997,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":4.9009999999999998,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.66800000000000004}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.6059999999999999,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.48099999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.274,"5min":4.274,"15min":4.274},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.645,"5min":2.645,"15min":2.645},"last":0.63}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":5.6449999999999996,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.5140000000000002,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.68899999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57399999999999995}]},{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.71299999999999997}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.503},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.73899999999999999}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.85299999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.44700000000000001}]},{"osd":1,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.437},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.36599999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.375},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.41199999999999998}]},{"osd":4,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.71199999999999997}]},{"osd":6,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.76500000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.35599999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.374},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.78900000000000003}]},{"osd":6,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.755},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.68799999999999994}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":780583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":0.371}]},{"osd":3,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.35599999999999998}]},{"osd":4,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.83299999999999996}]},{"osd":7,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.78800000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":5.556,"5min":5.556,"15min":5.556},"last":0.35099999999999998}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":5.3929999999999998,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.42799999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.45400000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.67500000000000004}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.81299999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1036288,"data_stored":774446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.68600000000000005}]},{"osd":1,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.72199999999999998}]},{"osd":2,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.877},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.77300000000000002}]},{"osd":3,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.86399999999999999}]},{"osd":4,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.95899999999999996}]},{"osd":6,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.91000000000000003}]},{"osd":7,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":1.018},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.82399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:05:27.427 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:05:27.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f593ca00640 1 Processor -- start 2024-01-24T13:05:27.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f593ca00640 1 -- start start 2024-01-24T13:05:27.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f593ca00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f59340ce950 0x7f59340ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:27.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f593ca00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f59340cd2f0 0x7f593415d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:27.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f593ca00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59340d0b80 con 0x7f593415d5d0 2024-01-24T13:05:27.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f593ca00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59340cd7a0 con 0x7f59340ce950 2024-01-24T13:05:27.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f593ca00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59340d0040 con 0x7f59340cd2f0 2024-01-24T13:05:27.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f593a000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f59340ce950 0x7f59340ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:27.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f593aa00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f593415d5d0 0x7f5934152f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59102/0 (socket says 172.21.15.29:59102) 2024-01-24T13:05:27.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f593aa00640 1 -- 172.21.15.29:0/2642808778 learned_addr learned my addr 172.21.15.29:0/2642808778 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:27.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f5939600640 1 --2- 172.21.15.29:0/2642808778 >> v2:172.21.15.163:3300/0 conn(0x7f59340cd2f0 0x7f593415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:27.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f593a000640 1 -- 172.21.15.29:0/2642808778 >> v2:172.21.15.163:3300/0 conn(0x7f59340cd2f0 msgr2=0x7f593415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:27.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f593a000640 1 --2- 172.21.15.29:0/2642808778 >> v2:172.21.15.163:3300/0 conn(0x7f59340cd2f0 0x7f593415d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f593a000640 1 -- 172.21.15.29:0/2642808778 >> v1:172.21.15.29:6789/0 conn(0x7f593415d5d0 legacy=0x7f5934152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f593a000640 1 -- 172.21.15.29:0/2642808778 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593406bdf0 con 0x7f59340ce950 2024-01-24T13:05:27.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.602+0000 7f5938c00640 1 -- 172.21.15.29:0/2642808778 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302415695 0 0) 0x7f59340d0b80 con 0x7f593415d5d0 2024-01-24T13:05:27.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.606+0000 7f593a000640 1 --2- 172.21.15.29:0/2642808778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59340ce950 0x7f59340ccdb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f59340b2990 tx=0x7f592401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32671c49554b52f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:27.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.606+0000 7f5938c00640 1 -- 172.21.15.29:0/2642808778 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59240ab600 con 0x7f59340ce950 2024-01-24T13:05:27.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.606+0000 7f5938c00640 1 -- 172.21.15.29:0/2642808778 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59240a7050 con 0x7f59340ce950 2024-01-24T13:05:27.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.606+0000 7f5938c00640 1 -- 172.21.15.29:0/2642808778 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59240ab980 con 0x7f59340ce950 2024-01-24T13:05:27.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.606+0000 7f593ca00640 1 -- 172.21.15.29:0/2642808778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59340ce950 msgr2=0x7f59340ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.606+0000 7f593ca00640 1 --2- 172.21.15.29:0/2642808778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59340ce950 0x7f59340ccdb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f59340b2990 tx=0x7f592401c340 comp rx=0 tx=0).stop 2024-01-24T13:05:27.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.606+0000 7f593ca00640 1 -- 172.21.15.29:0/2642808778 shutdown_connections 2024-01-24T13:05:27.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.606+0000 7f593ca00640 1 --2- 172.21.15.29:0/2642808778 >> v2:172.21.15.163:3300/0 conn(0x7f59340cd2f0 0x7f593415d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.606+0000 7f593ca00640 1 --2- 172.21.15.29:0/2642808778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59340ce950 0x7f59340ccdb0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.606+0000 7f593ca00640 1 -- 172.21.15.29:0/2642808778 >> 172.21.15.29:0/2642808778 conn(0x7f5934070570 msgr2=0x7f5934069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:27.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.606+0000 7f593ca00640 1 -- 172.21.15.29:0/2642808778 shutdown_connections 2024-01-24T13:05:27.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.606+0000 7f593ca00640 1 -- 172.21.15.29:0/2642808778 wait complete. 2024-01-24T13:05:27.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593ca00640 1 Processor -- start 2024-01-24T13:05:27.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593ca00640 1 -- start start 2024-01-24T13:05:27.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593ca00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59340cd2f0 0x7f59340c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:27.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593ca00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59340ce950 0x7f5934156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:27.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593ca00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f593415d5d0 0x7f593415f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:27.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593ca00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5934154fd0 con 0x7f59340ce950 2024-01-24T13:05:27.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593ca00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59341f8640 con 0x7f59340cd2f0 2024-01-24T13:05:27.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593ca00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59341f8920 con 0x7f593415d5d0 2024-01-24T13:05:27.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f5939600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59340ce950 0x7f5934156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:27.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f5939600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59340ce950 0x7f5934156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48046/0 (socket says 172.21.15.29:48046) 2024-01-24T13:05:27.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f5939600640 1 -- 172.21.15.29:0/1860734899 learned_addr learned my addr 172.21.15.29:0/1860734899 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:27.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593a000640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59340cd2f0 0x7f59340c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:27.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593aa00640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f593415d5d0 0x7f593415f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:27.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593a000640 1 -- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f593415d5d0 msgr2=0x7f593415f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593a000640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f593415d5d0 0x7f593415f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593a000640 1 -- 172.21.15.29:0/1860734899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59340ce950 msgr2=0x7f5934156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593a000640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59340ce950 0x7f5934156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593a000640 1 -- 172.21.15.29:0/1860734899 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5924009420 con 0x7f59340cd2f0 2024-01-24T13:05:27.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f5939600640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59340ce950 0x7f5934156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:27.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593a000640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59340cd2f0 0x7f59340c6e40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59240ab000 tx=0x7f5934153ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:27.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f5932000640 1 -- 172.21.15.29:0/1860734899 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59240b4610 con 0x7f59340cd2f0 2024-01-24T13:05:27.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f5932000640 1 -- 172.21.15.29:0/1860734899 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59240b4790 con 0x7f59340cd2f0 2024-01-24T13:05:27.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f5932000640 1 -- 172.21.15.29:0/1860734899 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59240b4b40 con 0x7f59340cd2f0 2024-01-24T13:05:27.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593ca00640 1 -- 172.21.15.29:0/1860734899 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59340d1190 con 0x7f59340cd2f0 2024-01-24T13:05:27.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.610+0000 7f593ca00640 1 -- 172.21.15.29:0/1860734899 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59341f8ee0 con 0x7f59340cd2f0 2024-01-24T13:05:27.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.614+0000 7f593ca00640 1 -- 172.21.15.29:0/1860734899 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59341f8a60 con 0x7f59340cd2f0 2024-01-24T13:05:27.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.614+0000 7f5932000640 1 -- 172.21.15.29:0/1860734899 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f59240b2040 con 0x7f59340cd2f0 2024-01-24T13:05:27.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.614+0000 7f5932000640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f590c065a60 0x7f590c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:27.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.614+0000 7f5932000640 1 -- 172.21.15.29:0/1860734899 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f592411d550 con 0x7f59340cd2f0 2024-01-24T13:05:27.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.614+0000 7f5939600640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f590c065a60 0x7f590c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:27.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.614+0000 7f5939600640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f590c065a60 0x7f590c067f20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f59340c4270 tx=0x7f591c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:27.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.618+0000 7f5932000640 1 -- 172.21.15.29:0/1860734899 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f59240eaef0 con 0x7f59340cd2f0 2024-01-24T13:05:27.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.770+0000 7f593ca00640 1 -- 172.21.15.29:0/1860734899 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f59340d1010 con 0x7f590c065a60 2024-01-24T13:05:27.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.778+0000 7f5932000640 1 -- 172.21.15.29:0/1860734899 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279408 (secure 0 0 0) 0x7f591c011e70 con 0x7f590c065a60 2024-01-24T13:05:27.787 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:27.789 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:05:27.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.782+0000 7f593ca00640 1 -- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f590c065a60 msgr2=0x7f590c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.782+0000 7f593ca00640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f590c065a60 0x7f590c067f20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f59340c4270 tx=0x7f591c009190 comp rx=0 tx=0).stop 2024-01-24T13:05:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.782+0000 7f593ca00640 1 -- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59340cd2f0 msgr2=0x7f59340c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.782+0000 7f593ca00640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59340cd2f0 0x7f59340c6e40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59240ab000 tx=0x7f5934153ea0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.782+0000 7f593ca00640 1 -- 172.21.15.29:0/1860734899 shutdown_connections 2024-01-24T13:05:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.782+0000 7f593ca00640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f590c065a60 0x7f590c067f20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.782+0000 7f593ca00640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f593415d5d0 0x7f593415f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.782+0000 7f593ca00640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59340ce950 0x7f5934156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.782+0000 7f593ca00640 1 --2- 172.21.15.29:0/1860734899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59340cd2f0 0x7f59340c6e40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.782+0000 7f593ca00640 1 -- 172.21.15.29:0/1860734899 >> 172.21.15.29:0/1860734899 conn(0x7f5934070570 msgr2=0x7f593406e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.786+0000 7f593ca00640 1 -- 172.21.15.29:0/1860734899 shutdown_connections 2024-01-24T13:05:27.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.786+0000 7f593ca00640 1 -- 172.21.15.29:0/1860734899 wait complete. 2024-01-24T13:05:27.808 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-01-24T13:05:27.560128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":72,"acting":72,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225008,"kb_used_data":4752,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754749712,"statfs":{"total":773094113280,"available":772863705088,"internally_reserved":0,"allocated":4866048,"data_stored":2723348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.770599"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224078+0000","last_change":"2024-01-24T13:05:23.236305+0000","last_active":"2024-01-24T13:05:24.224078+0000","last_peered":"2024-01-24T13:05:24.224078+0000","last_clean":"2024-01-24T13:05:24.224078+0000","last_became_active":"2024-01-24T13:05:23.234966+0000","last_became_peered":"2024-01-24T13:05:23.234966+0000","last_unstale":"2024-01-24T13:05:24.224078+0000","last_undegraded":"2024-01-24T13:05:24.224078+0000","last_fullsized":"2024-01-24T13:05:24.224078+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:34:04.521864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794322+0000","last_change":"2024-01-24T13:05:21.794322+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794322+0000","last_undegraded":"2024-01-24T13:05:21.794322+0000","last_fullsized":"2024-01-24T13:05:21.794322+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:01:16.142279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797664+0000","last_change":"2024-01-24T13:05:21.797664+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797664+0000","last_undegraded":"2024-01-24T13:05:21.797664+0000","last_fullsized":"2024-01-24T13:05:21.797664+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:52:11.442955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792346+0000","last_change":"2024-01-24T13:05:21.792346+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792346+0000","last_undegraded":"2024-01-24T13:05:21.792346+0000","last_fullsized":"2024-01-24T13:05:21.792346+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:44:22.763339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794413+0000","last_change":"2024-01-24T13:05:21.794413+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794413+0000","last_undegraded":"2024-01-24T13:05:21.794413+0000","last_fullsized":"2024-01-24T13:05:21.794413+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:05.407056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794869+0000","last_change":"2024-01-24T13:05:21.794869+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794869+0000","last_undegraded":"2024-01-24T13:05:21.794869+0000","last_fullsized":"2024-01-24T13:05:21.794869+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:33:35.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795189+0000","last_change":"2024-01-24T13:05:21.795189+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795189+0000","last_undegraded":"2024-01-24T13:05:21.795189+0000","last_fullsized":"2024-01-24T13:05:21.795189+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:53:05.828860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792074+0000","last_change":"2024-01-24T13:05:21.792074+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792074+0000","last_undegraded":"2024-01-24T13:05:21.792074+0000","last_fullsized":"2024-01-24T13:05:21.792074+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:33:35.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795199+0000","last_change":"2024-01-24T13:05:21.795199+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795199+0000","last_undegraded":"2024-01-24T13:05:21.795199+0000","last_fullsized":"2024-01-24T13:05:21.795199+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:46:09.885466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792900+0000","last_change":"2024-01-24T13:05:21.792900+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792900+0000","last_undegraded":"2024-01-24T13:05:21.792900+0000","last_fullsized":"2024-01-24T13:05:21.792900+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:01:16.142279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791686+0000","last_change":"2024-01-24T13:05:21.791686+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791686+0000","last_undegraded":"2024-01-24T13:05:21.791686+0000","last_fullsized":"2024-01-24T13:05:21.791686+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:56:22.964132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791668+0000","last_change":"2024-01-24T13:05:21.791668+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791668+0000","last_undegraded":"2024-01-24T13:05:21.791668+0000","last_fullsized":"2024-01-24T13:05:21.791668+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:43:57.475660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792369+0000","last_change":"2024-01-24T13:05:21.792369+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792369+0000","last_undegraded":"2024-01-24T13:05:21.792369+0000","last_fullsized":"2024-01-24T13:05:21.792369+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:38:51.635054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794367+0000","last_change":"2024-01-24T13:05:21.794367+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794367+0000","last_undegraded":"2024-01-24T13:05:21.794367+0000","last_fullsized":"2024-01-24T13:05:21.794367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:52.859781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.798175+0000","last_change":"2024-01-24T13:05:21.798175+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.798175+0000","last_undegraded":"2024-01-24T13:05:21.798175+0000","last_fullsized":"2024-01-24T13:05:21.798175+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:08:11.324387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791571+0000","last_change":"2024-01-24T13:05:21.791571+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791571+0000","last_undegraded":"2024-01-24T13:05:21.791571+0000","last_fullsized":"2024-01-24T13:05:21.791571+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:37:28.187706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794399+0000","last_change":"2024-01-24T13:05:21.794399+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794399+0000","last_undegraded":"2024-01-24T13:05:21.794399+0000","last_fullsized":"2024-01-24T13:05:21.794399+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:44:22.763339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795497+0000","last_change":"2024-01-24T13:05:21.795497+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795497+0000","last_undegraded":"2024-01-24T13:05:21.795497+0000","last_fullsized":"2024-01-24T13:05:21.795497+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:32.634926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791046+0000","last_change":"2024-01-24T13:05:21.791046+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791046+0000","last_undegraded":"2024-01-24T13:05:21.791046+0000","last_fullsized":"2024-01-24T13:05:21.791046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:52:37.909722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797764+0000","last_change":"2024-01-24T13:05:21.797764+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797764+0000","last_undegraded":"2024-01-24T13:05:21.797764+0000","last_fullsized":"2024-01-24T13:05:21.797764+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:38:10.129854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224224+0000","last_change":"2024-01-24T13:05:23.236304+0000","last_active":"2024-01-24T13:05:24.224224+0000","last_peered":"2024-01-24T13:05:24.224224+0000","last_clean":"2024-01-24T13:05:24.224224+0000","last_became_active":"2024-01-24T13:05:23.235114+0000","last_became_peered":"2024-01-24T13:05:23.235114+0000","last_unstale":"2024-01-24T13:05:24.224224+0000","last_undegraded":"2024-01-24T13:05:24.224224+0000","last_fullsized":"2024-01-24T13:05:24.224224+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:36:46.585321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224224+0000","last_change":"2024-01-24T13:05:22.816414+0000","last_active":"2024-01-24T13:05:24.224224+0000","last_peered":"2024-01-24T13:05:24.224224+0000","last_clean":"2024-01-24T13:05:24.224224+0000","last_became_active":"2024-01-24T13:05:22.816149+0000","last_became_peered":"2024-01-24T13:05:22.816149+0000","last_unstale":"2024-01-24T13:05:24.224224+0000","last_undegraded":"2024-01-24T13:05:24.224224+0000","last_fullsized":"2024-01-24T13:05:24.224224+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:34:54.259224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224075+0000","last_change":"2024-01-24T13:05:22.811435+0000","last_active":"2024-01-24T13:05:24.224075+0000","last_peered":"2024-01-24T13:05:24.224075+0000","last_clean":"2024-01-24T13:05:24.224075+0000","last_became_active":"2024-01-24T13:05:22.811126+0000","last_became_peered":"2024-01-24T13:05:22.811126+0000","last_unstale":"2024-01-24T13:05:24.224075+0000","last_undegraded":"2024-01-24T13:05:24.224075+0000","last_fullsized":"2024-01-24T13:05:24.224075+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:45:33.745161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797668+0000","last_change":"2024-01-24T13:05:21.797668+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797668+0000","last_undegraded":"2024-01-24T13:05:21.797668+0000","last_fullsized":"2024-01-24T13:05:21.797668+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:26.695067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795529+0000","last_change":"2024-01-24T13:05:21.795529+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795529+0000","last_undegraded":"2024-01-24T13:05:21.795529+0000","last_fullsized":"2024-01-24T13:05:21.795529+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:55:28.106943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797595+0000","last_change":"2024-01-24T13:05:21.797595+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797595+0000","last_undegraded":"2024-01-24T13:05:21.797595+0000","last_fullsized":"2024-01-24T13:05:21.797595+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:38:40.777988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791025+0000","last_change":"2024-01-24T13:05:21.791025+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791025+0000","last_undegraded":"2024-01-24T13:05:21.791025+0000","last_fullsized":"2024-01-24T13:05:21.791025+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:58:04.657760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.796985+0000","last_change":"2024-01-24T13:05:21.796985+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.796985+0000","last_undegraded":"2024-01-24T13:05:21.796985+0000","last_fullsized":"2024-01-24T13:05:21.796985+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:05:34.960781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224235+0000","last_change":"2024-01-24T13:05:23.241430+0000","last_active":"2024-01-24T13:05:24.224235+0000","last_peered":"2024-01-24T13:05:24.224235+0000","last_clean":"2024-01-24T13:05:24.224235+0000","last_became_active":"2024-01-24T13:05:23.241157+0000","last_became_peered":"2024-01-24T13:05:23.241157+0000","last_unstale":"2024-01-24T13:05:24.224235+0000","last_undegraded":"2024-01-24T13:05:24.224235+0000","last_fullsized":"2024-01-24T13:05:24.224235+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:48:21.345424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797038+0000","last_change":"2024-01-24T13:05:21.797038+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797038+0000","last_undegraded":"2024-01-24T13:05:21.797038+0000","last_fullsized":"2024-01-24T13:05:21.797038+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:29:53.106048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.793777+0000","last_change":"2024-01-24T13:05:21.793777+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.793777+0000","last_undegraded":"2024-01-24T13:05:21.793777+0000","last_fullsized":"2024-01-24T13:05:21.793777+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:05.407056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.799163+0000","last_change":"2024-01-24T13:05:21.799163+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.799163+0000","last_undegraded":"2024-01-24T13:05:21.799163+0000","last_fullsized":"2024-01-24T13:05:21.799163+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:03:23.863326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791050+0000","last_change":"2024-01-24T13:05:21.791050+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791050+0000","last_undegraded":"2024-01-24T13:05:21.791050+0000","last_fullsized":"2024-01-24T13:05:21.791050+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:35:30.269642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.793380+0000","last_change":"2024-01-24T13:05:21.793380+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.793380+0000","last_undegraded":"2024-01-24T13:05:21.793380+0000","last_fullsized":"2024-01-24T13:05:21.793380+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:15.098387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.798470+0000","last_change":"2024-01-24T13:05:21.798470+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.798470+0000","last_undegraded":"2024-01-24T13:05:21.798470+0000","last_fullsized":"2024-01-24T13:05:21.798470+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:37:14.667657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":177,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-24T13:05:18.230458+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:05:18.230458+0000","last_peered":"2024-01-24T13:05:18.230458+0000","last_clean":"2024-01-24T13:05:18.230458+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:05:18.230458+0000","last_undegraded":"2024-01-24T13:05:18.230458+0000","last_fullsized":"2024-01-24T13:05:18.230458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":6,"acting":6,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.74199999999999999}]},{"osd":1,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.79200000000000004}]},{"osd":2,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.77800000000000002}]},{"osd":4,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.48899999999999999}]},{"osd":5,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55900000000000005}]},{"osd":6,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.58599999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":5.5579999999999998,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.61199999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":4.3289999999999997,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":4.9009999999999998,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.66800000000000004}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.6059999999999999,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.48099999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.274,"5min":4.274,"15min":4.274},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.645,"5min":2.645,"15min":2.645},"last":0.63}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":5.6449999999999996,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.5140000000000002,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.68899999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57399999999999995}]},{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.71299999999999997}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.503},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.73899999999999999}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.85299999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.44700000000000001}]},{"osd":1,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.437},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.36599999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.375},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.41199999999999998}]},{"osd":4,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.71199999999999997}]},{"osd":6,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.76500000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.35599999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.374},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.78900000000000003}]},{"osd":6,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.755},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.68799999999999994}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":780583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":0.371}]},{"osd":3,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.35599999999999998}]},{"osd":4,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.83299999999999996}]},{"osd":7,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.78800000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":5.556,"5min":5.556,"15min":5.556},"last":0.35099999999999998}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":5.3929999999999998,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.42799999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.45400000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.67500000000000004}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.81299999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1089536,"data_stored":801475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56000000000000005}]},{"osd":1,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.42699999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.498}]},{"osd":4,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.40699999999999997}]},{"osd":6,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.54400000000000004}]},{"osd":7,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.627},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:05:27.813 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:05:27.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.986+0000 7fdde4800640 1 Processor -- start 2024-01-24T13:05:27.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.986+0000 7fdde4800640 1 -- start start 2024-01-24T13:05:27.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde4800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdddc0c3ef0 0x7fdddc0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:27.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde4800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdddc0caf30 0x7fdddc0d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:27.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde4800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc0cfe50 con 0x7fdddc15a630 2024-01-24T13:05:27.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde4800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdddc0cf380 con 0x7fdddc0c3ef0 2024-01-24T13:05:27.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde4800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0cb3c0 con 0x7fdddc0caf30 2024-01-24T13:05:27.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde2800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdddc0caf30 0x7fdddc0d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:27.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde1400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdddc0c3ef0 0x7fdddc0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:27.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde2800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdddc0caf30 0x7fdddc0d02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:34630/0 (socket says 172.21.15.29:34630) 2024-01-24T13:05:27.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde1400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdddc0c3ef0 0x7fdddc0ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:48178/0 (socket says 172.21.15.29:48178) 2024-01-24T13:05:27.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde2800640 1 -- 172.21.15.29:0/3335954427 learned_addr learned my addr 172.21.15.29:0/3335954427 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:27.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde2800640 1 -- 172.21.15.29:0/3335954427 >> v2:172.21.15.163:3300/0 conn(0x7fdddc0c3ef0 msgr2=0x7fdddc0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:27.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde2800640 1 --2- 172.21.15.29:0/3335954427 >> v2:172.21.15.163:3300/0 conn(0x7fdddc0c3ef0 0x7fdddc0ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde2800640 1 -- 172.21.15.29:0/3335954427 >> v1:172.21.15.163:6789/0 conn(0x7fdddc15a630 legacy=0x7fdddc0cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde2800640 1 -- 172.21.15.29:0/3335954427 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc15aa10 con 0x7fdddc0caf30 2024-01-24T13:05:27.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.990+0000 7fdde1400640 1 --2- 172.21.15.29:0/3335954427 >> v2:172.21.15.163:3300/0 conn(0x7fdddc0c3ef0 0x7fdddc0ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.994+0000 7fdde2800640 1 --2- 172.21.15.29:0/3335954427 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdddc0caf30 0x7fdddc0d02e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009e50 tx=0x7fddd401c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed319424ef5362 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:27.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.994+0000 7fdde0a00640 1 -- 172.21.15.29:0/3335954427 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd40a58b0 con 0x7fdddc0caf30 2024-01-24T13:05:27.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.994+0000 7fdde0a00640 1 -- 172.21.15.29:0/3335954427 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd40a5a10 con 0x7fdddc0caf30 2024-01-24T13:05:27.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.994+0000 7fdde0a00640 1 -- 172.21.15.29:0/3335954427 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd40a5da0 con 0x7fdddc0caf30 2024-01-24T13:05:27.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.994+0000 7fdde4800640 1 -- 172.21.15.29:0/3335954427 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdddc0caf30 msgr2=0x7fdddc0d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:27.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.994+0000 7fdde4800640 1 --2- 172.21.15.29:0/3335954427 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdddc0caf30 0x7fdddc0d02e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009e50 tx=0x7fddd401c9f0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.994+0000 7fdde4800640 1 -- 172.21.15.29:0/3335954427 shutdown_connections 2024-01-24T13:05:27.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.994+0000 7fdde4800640 1 --2- 172.21.15.29:0/3335954427 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdddc0caf30 0x7fdddc0d02e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.994+0000 7fdde4800640 1 --2- 172.21.15.29:0/3335954427 >> v2:172.21.15.163:3300/0 conn(0x7fdddc0c3ef0 0x7fdddc0ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:27.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.994+0000 7fdde4800640 1 -- 172.21.15.29:0/3335954427 >> 172.21.15.29:0/3335954427 conn(0x7fdddc070570 msgr2=0x7fdddc069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:27.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.994+0000 7fdde4800640 1 -- 172.21.15.29:0/3335954427 shutdown_connections 2024-01-24T13:05:27.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.994+0000 7fdde4800640 1 -- 172.21.15.29:0/3335954427 wait complete. 2024-01-24T13:05:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde4800640 1 Processor -- start 2024-01-24T13:05:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde4800640 1 -- start start 2024-01-24T13:05:28.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde4800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdddc0c3ef0 0x7fdddc1f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde4800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdddc0caf30 0x7fdddc149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde4800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdddc15a630 0x7fdddc0c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde4800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc1498b0 con 0x7fdddc0caf30 2024-01-24T13:05:28.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde4800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0c79b0 con 0x7fdddc15a630 2024-01-24T13:05:28.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde4800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0c7c50 con 0x7fdddc0c3ef0 2024-01-24T13:05:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde1400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdddc0caf30 0x7fdddc149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde1400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdddc0caf30 0x7fdddc149370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48052/0 (socket says 172.21.15.29:48052) 2024-01-24T13:05:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde1400640 1 -- 172.21.15.29:0/2951644315 learned_addr learned my addr 172.21.15.29:0/2951644315 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde1e00640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdddc0c3ef0 0x7fdddc1f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde2800640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdddc15a630 0x7fdddc0c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde1400640 1 -- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdddc0c3ef0 msgr2=0x7fdddc1f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde1400640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdddc0c3ef0 0x7fdddc1f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde1400640 1 -- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdddc15a630 msgr2=0x7fdddc0c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde1400640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdddc15a630 0x7fdddc0c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde1400640 1 -- 172.21.15.29:0/2951644315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4009420 con 0x7fdddc0caf30 2024-01-24T13:05:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde2800640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdddc15a630 0x7fdddc0c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde1400640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdddc0caf30 0x7fdddc149370 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fddc400ebe0 tx=0x7fddc400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:28.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fddda000640 1 -- 172.21.15.29:0/2951644315 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400eee0 con 0x7fdddc0caf30 2024-01-24T13:05:28.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fddda000640 1 -- 172.21.15.29:0/2951644315 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc400cc30 con 0x7fdddc0caf30 2024-01-24T13:05:28.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde4800640 1 -- 172.21.15.29:0/2951644315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd4009b30 con 0x7fdddc0caf30 2024-01-24T13:05:28.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fddda000640 1 -- 172.21.15.29:0/2951644315 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4013470 con 0x7fdddc0caf30 2024-01-24T13:05:28.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde4800640 1 -- 172.21.15.29:0/2951644315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc1f81d0 con 0x7fdddc0caf30 2024-01-24T13:05:28.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:27.998+0000 7fdde4800640 1 -- 172.21.15.29:0/2951644315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc04e850 con 0x7fdddc0caf30 2024-01-24T13:05:28.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.002+0000 7fddda000640 1 -- 172.21.15.29:0/2951644315 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fddc40135d0 con 0x7fdddc0caf30 2024-01-24T13:05:28.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.002+0000 7fddda000640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fddb4065a60 0x7fddb4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.002+0000 7fddda000640 1 -- 172.21.15.29:0/2951644315 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fddc4083650 con 0x7fdddc0caf30 2024-01-24T13:05:28.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.002+0000 7fdde1e00640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fddb4065a60 0x7fddb4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.002+0000 7fdde1e00640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fddb4065a60 0x7fddb4067f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fddcc000f70 tx=0x7fddcc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:28.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.006+0000 7fddda000640 1 -- 172.21.15.29:0/2951644315 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fddc4050ec0 con 0x7fdddc0caf30 2024-01-24T13:05:28.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.158+0000 7fdde4800640 1 -- 172.21.15.29:0/2951644315 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdddc0cf0a0 con 0x7fddb4065a60 2024-01-24T13:05:28.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.166+0000 7fddda000640 1 -- 172.21.15.29:0/2951644315 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279408 (secure 0 0 0) 0x7fddcc001380 con 0x7fddb4065a60 2024-01-24T13:05:28.172 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:05:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.170+0000 7fdde4800640 1 -- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fddb4065a60 msgr2=0x7fddb4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.170+0000 7fdde4800640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fddb4065a60 0x7fddb4067f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fddcc000f70 tx=0x7fddcc009040 comp rx=0 tx=0).stop 2024-01-24T13:05:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.170+0000 7fdde4800640 1 -- 172.21.15.29:0/2951644315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdddc0caf30 msgr2=0x7fdddc149370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.170+0000 7fdde4800640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdddc0caf30 0x7fdddc149370 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fddc400ebe0 tx=0x7fddc400c520 comp rx=0 tx=0).stop 2024-01-24T13:05:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.170+0000 7fdde4800640 1 -- 172.21.15.29:0/2951644315 shutdown_connections 2024-01-24T13:05:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.170+0000 7fdde4800640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fddb4065a60 0x7fddb4067f20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.170+0000 7fdde4800640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdddc15a630 0x7fdddc0c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.170+0000 7fdde4800640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdddc0caf30 0x7fdddc149370 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.170+0000 7fdde4800640 1 --2- 172.21.15.29:0/2951644315 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdddc0c3ef0 0x7fdddc1f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.170+0000 7fdde4800640 1 -- 172.21.15.29:0/2951644315 >> 172.21.15.29:0/2951644315 conn(0x7fdddc070570 msgr2=0x7fdddc0c5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.170+0000 7fdde4800640 1 -- 172.21.15.29:0/2951644315 shutdown_connections 2024-01-24T13:05:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.170+0000 7fdde4800640 1 -- 172.21.15.29:0/2951644315 wait complete. 2024-01-24T13:05:28.193 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-01-24T13:05:27.560128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":72,"acting":72,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225008,"kb_used_data":4752,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754749712,"statfs":{"total":773094113280,"available":772863705088,"internally_reserved":0,"allocated":4866048,"data_stored":2723348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.770599"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224078+0000","last_change":"2024-01-24T13:05:23.236305+0000","last_active":"2024-01-24T13:05:24.224078+0000","last_peered":"2024-01-24T13:05:24.224078+0000","last_clean":"2024-01-24T13:05:24.224078+0000","last_became_active":"2024-01-24T13:05:23.234966+0000","last_became_peered":"2024-01-24T13:05:23.234966+0000","last_unstale":"2024-01-24T13:05:24.224078+0000","last_undegraded":"2024-01-24T13:05:24.224078+0000","last_fullsized":"2024-01-24T13:05:24.224078+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:34:04.521864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794322+0000","last_change":"2024-01-24T13:05:21.794322+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794322+0000","last_undegraded":"2024-01-24T13:05:21.794322+0000","last_fullsized":"2024-01-24T13:05:21.794322+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:01:16.142279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797664+0000","last_change":"2024-01-24T13:05:21.797664+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797664+0000","last_undegraded":"2024-01-24T13:05:21.797664+0000","last_fullsized":"2024-01-24T13:05:21.797664+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:52:11.442955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792346+0000","last_change":"2024-01-24T13:05:21.792346+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792346+0000","last_undegraded":"2024-01-24T13:05:21.792346+0000","last_fullsized":"2024-01-24T13:05:21.792346+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:44:22.763339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794413+0000","last_change":"2024-01-24T13:05:21.794413+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794413+0000","last_undegraded":"2024-01-24T13:05:21.794413+0000","last_fullsized":"2024-01-24T13:05:21.794413+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:05.407056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794869+0000","last_change":"2024-01-24T13:05:21.794869+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794869+0000","last_undegraded":"2024-01-24T13:05:21.794869+0000","last_fullsized":"2024-01-24T13:05:21.794869+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:33:35.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795189+0000","last_change":"2024-01-24T13:05:21.795189+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795189+0000","last_undegraded":"2024-01-24T13:05:21.795189+0000","last_fullsized":"2024-01-24T13:05:21.795189+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:53:05.828860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792074+0000","last_change":"2024-01-24T13:05:21.792074+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792074+0000","last_undegraded":"2024-01-24T13:05:21.792074+0000","last_fullsized":"2024-01-24T13:05:21.792074+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:33:35.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795199+0000","last_change":"2024-01-24T13:05:21.795199+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795199+0000","last_undegraded":"2024-01-24T13:05:21.795199+0000","last_fullsized":"2024-01-24T13:05:21.795199+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:46:09.885466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792900+0000","last_change":"2024-01-24T13:05:21.792900+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792900+0000","last_undegraded":"2024-01-24T13:05:21.792900+0000","last_fullsized":"2024-01-24T13:05:21.792900+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:01:16.142279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791686+0000","last_change":"2024-01-24T13:05:21.791686+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791686+0000","last_undegraded":"2024-01-24T13:05:21.791686+0000","last_fullsized":"2024-01-24T13:05:21.791686+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:56:22.964132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791668+0000","last_change":"2024-01-24T13:05:21.791668+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791668+0000","last_undegraded":"2024-01-24T13:05:21.791668+0000","last_fullsized":"2024-01-24T13:05:21.791668+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:43:57.475660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792369+0000","last_change":"2024-01-24T13:05:21.792369+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792369+0000","last_undegraded":"2024-01-24T13:05:21.792369+0000","last_fullsized":"2024-01-24T13:05:21.792369+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:38:51.635054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794367+0000","last_change":"2024-01-24T13:05:21.794367+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794367+0000","last_undegraded":"2024-01-24T13:05:21.794367+0000","last_fullsized":"2024-01-24T13:05:21.794367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:52.859781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.798175+0000","last_change":"2024-01-24T13:05:21.798175+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.798175+0000","last_undegraded":"2024-01-24T13:05:21.798175+0000","last_fullsized":"2024-01-24T13:05:21.798175+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:08:11.324387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791571+0000","last_change":"2024-01-24T13:05:21.791571+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791571+0000","last_undegraded":"2024-01-24T13:05:21.791571+0000","last_fullsized":"2024-01-24T13:05:21.791571+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:37:28.187706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794399+0000","last_change":"2024-01-24T13:05:21.794399+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794399+0000","last_undegraded":"2024-01-24T13:05:21.794399+0000","last_fullsized":"2024-01-24T13:05:21.794399+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:44:22.763339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795497+0000","last_change":"2024-01-24T13:05:21.795497+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795497+0000","last_undegraded":"2024-01-24T13:05:21.795497+0000","last_fullsized":"2024-01-24T13:05:21.795497+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:32.634926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791046+0000","last_change":"2024-01-24T13:05:21.791046+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791046+0000","last_undegraded":"2024-01-24T13:05:21.791046+0000","last_fullsized":"2024-01-24T13:05:21.791046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:52:37.909722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797764+0000","last_change":"2024-01-24T13:05:21.797764+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797764+0000","last_undegraded":"2024-01-24T13:05:21.797764+0000","last_fullsized":"2024-01-24T13:05:21.797764+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:38:10.129854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224224+0000","last_change":"2024-01-24T13:05:23.236304+0000","last_active":"2024-01-24T13:05:24.224224+0000","last_peered":"2024-01-24T13:05:24.224224+0000","last_clean":"2024-01-24T13:05:24.224224+0000","last_became_active":"2024-01-24T13:05:23.235114+0000","last_became_peered":"2024-01-24T13:05:23.235114+0000","last_unstale":"2024-01-24T13:05:24.224224+0000","last_undegraded":"2024-01-24T13:05:24.224224+0000","last_fullsized":"2024-01-24T13:05:24.224224+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:36:46.585321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224224+0000","last_change":"2024-01-24T13:05:22.816414+0000","last_active":"2024-01-24T13:05:24.224224+0000","last_peered":"2024-01-24T13:05:24.224224+0000","last_clean":"2024-01-24T13:05:24.224224+0000","last_became_active":"2024-01-24T13:05:22.816149+0000","last_became_peered":"2024-01-24T13:05:22.816149+0000","last_unstale":"2024-01-24T13:05:24.224224+0000","last_undegraded":"2024-01-24T13:05:24.224224+0000","last_fullsized":"2024-01-24T13:05:24.224224+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:34:54.259224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224075+0000","last_change":"2024-01-24T13:05:22.811435+0000","last_active":"2024-01-24T13:05:24.224075+0000","last_peered":"2024-01-24T13:05:24.224075+0000","last_clean":"2024-01-24T13:05:24.224075+0000","last_became_active":"2024-01-24T13:05:22.811126+0000","last_became_peered":"2024-01-24T13:05:22.811126+0000","last_unstale":"2024-01-24T13:05:24.224075+0000","last_undegraded":"2024-01-24T13:05:24.224075+0000","last_fullsized":"2024-01-24T13:05:24.224075+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:45:33.745161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797668+0000","last_change":"2024-01-24T13:05:21.797668+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797668+0000","last_undegraded":"2024-01-24T13:05:21.797668+0000","last_fullsized":"2024-01-24T13:05:21.797668+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:26.695067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795529+0000","last_change":"2024-01-24T13:05:21.795529+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795529+0000","last_undegraded":"2024-01-24T13:05:21.795529+0000","last_fullsized":"2024-01-24T13:05:21.795529+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:55:28.106943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797595+0000","last_change":"2024-01-24T13:05:21.797595+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797595+0000","last_undegraded":"2024-01-24T13:05:21.797595+0000","last_fullsized":"2024-01-24T13:05:21.797595+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:38:40.777988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791025+0000","last_change":"2024-01-24T13:05:21.791025+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791025+0000","last_undegraded":"2024-01-24T13:05:21.791025+0000","last_fullsized":"2024-01-24T13:05:21.791025+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:58:04.657760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.796985+0000","last_change":"2024-01-24T13:05:21.796985+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.796985+0000","last_undegraded":"2024-01-24T13:05:21.796985+0000","last_fullsized":"2024-01-24T13:05:21.796985+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:05:34.960781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224235+0000","last_change":"2024-01-24T13:05:23.241430+0000","last_active":"2024-01-24T13:05:24.224235+0000","last_peered":"2024-01-24T13:05:24.224235+0000","last_clean":"2024-01-24T13:05:24.224235+0000","last_became_active":"2024-01-24T13:05:23.241157+0000","last_became_peered":"2024-01-24T13:05:23.241157+0000","last_unstale":"2024-01-24T13:05:24.224235+0000","last_undegraded":"2024-01-24T13:05:24.224235+0000","last_fullsized":"2024-01-24T13:05:24.224235+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:48:21.345424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797038+0000","last_change":"2024-01-24T13:05:21.797038+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797038+0000","last_undegraded":"2024-01-24T13:05:21.797038+0000","last_fullsized":"2024-01-24T13:05:21.797038+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:29:53.106048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.793777+0000","last_change":"2024-01-24T13:05:21.793777+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.793777+0000","last_undegraded":"2024-01-24T13:05:21.793777+0000","last_fullsized":"2024-01-24T13:05:21.793777+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:05.407056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.799163+0000","last_change":"2024-01-24T13:05:21.799163+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.799163+0000","last_undegraded":"2024-01-24T13:05:21.799163+0000","last_fullsized":"2024-01-24T13:05:21.799163+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:03:23.863326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791050+0000","last_change":"2024-01-24T13:05:21.791050+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791050+0000","last_undegraded":"2024-01-24T13:05:21.791050+0000","last_fullsized":"2024-01-24T13:05:21.791050+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:35:30.269642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.793380+0000","last_change":"2024-01-24T13:05:21.793380+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.793380+0000","last_undegraded":"2024-01-24T13:05:21.793380+0000","last_fullsized":"2024-01-24T13:05:21.793380+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:15.098387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.798470+0000","last_change":"2024-01-24T13:05:21.798470+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.798470+0000","last_undegraded":"2024-01-24T13:05:21.798470+0000","last_fullsized":"2024-01-24T13:05:21.798470+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:37:14.667657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":177,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-24T13:05:18.230458+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:05:18.230458+0000","last_peered":"2024-01-24T13:05:18.230458+0000","last_clean":"2024-01-24T13:05:18.230458+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:05:18.230458+0000","last_undegraded":"2024-01-24T13:05:18.230458+0000","last_fullsized":"2024-01-24T13:05:18.230458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":6,"acting":6,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.74199999999999999}]},{"osd":1,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.79200000000000004}]},{"osd":2,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.77800000000000002}]},{"osd":4,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.48899999999999999}]},{"osd":5,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55900000000000005}]},{"osd":6,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.58599999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":5.5579999999999998,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.61199999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":4.3289999999999997,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":4.9009999999999998,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.66800000000000004}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.6059999999999999,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.48099999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.274,"5min":4.274,"15min":4.274},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.645,"5min":2.645,"15min":2.645},"last":0.63}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":5.6449999999999996,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.5140000000000002,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.68899999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57399999999999995}]},{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.71299999999999997}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.503},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.73899999999999999}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.85299999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.44700000000000001}]},{"osd":1,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.437},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.36599999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.375},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.41199999999999998}]},{"osd":4,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.71199999999999997}]},{"osd":6,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.76500000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.35599999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.374},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.78900000000000003}]},{"osd":6,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.755},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.68799999999999994}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":780583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":0.371}]},{"osd":3,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.35599999999999998}]},{"osd":4,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.83299999999999996}]},{"osd":7,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.78800000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":5.556,"5min":5.556,"15min":5.556},"last":0.35099999999999998}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":5.3929999999999998,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.42799999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.45400000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.67500000000000004}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.81299999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1089536,"data_stored":801475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56000000000000005}]},{"osd":1,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.42699999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.498}]},{"osd":4,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.40699999999999997}]},{"osd":6,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.54400000000000004}]},{"osd":7,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.627},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:05:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-01-24T13:05:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-01-24T13:05:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-01-24T13:05:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-01-24T13:05:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2024-01-24T13:05:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-01-24T13:05:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2024-01-24T13:05:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-01-24T13:05:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-01-24T13:05:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2024-01-24T13:05:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2024-01-24T13:05:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-01-24T13:05:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2024-01-24T13:05:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2024-01-24T13:05:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2024-01-24T13:05:28.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2024-01-24T13:05:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2024-01-24T13:05:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2024-01-24T13:05:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2024-01-24T13:05:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2024-01-24T13:05:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2024-01-24T13:05:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2024-01-24T13:05:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2024-01-24T13:05:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2024-01-24T13:05:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-01-24T13:05:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2024-01-24T13:05:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-01-24T13:05:28.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2024-01-24T13:05:28.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2024-01-24T13:05:28.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2024-01-24T13:05:28.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-01-24T13:05:28.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-01-24T13:05:28.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-01-24T13:05:28.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.794322+0000', 'last_change': '2024-01-24T13:05:21.794322+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.794322+0000', 'last_undegraded': '2024-01-24T13:05:21.794322+0000', 'last_fullsized': '2024-01-24T13:05:21.794322+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-26T00:01:16.142279+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-24T13:05:28.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-01-24T13:05:28.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-01-24T13:05:28.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.797664+0000', 'last_change': '2024-01-24T13:05:21.797664+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.797664+0000', 'last_undegraded': '2024-01-24T13:05:21.797664+0000', 'last_fullsized': '2024-01-24T13:05:21.797664+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T20:52:11.442955+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-24T13:05:28.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-01-24T13:05:28.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-01-24T13:05:28.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.792346+0000', 'last_change': '2024-01-24T13:05:21.792346+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.792346+0000', 'last_undegraded': '2024-01-24T13:05:21.792346+0000', 'last_fullsized': '2024-01-24T13:05:21.792346+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T15:44:22.763339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-24T13:05:28.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-01-24T13:05:28.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-01-24T13:05:28.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.794413+0000', 'last_change': '2024-01-24T13:05:21.794413+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.794413+0000', 'last_undegraded': '2024-01-24T13:05:21.794413+0000', 'last_fullsized': '2024-01-24T13:05:21.794413+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T18:20:05.407056+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-24T13:05:28.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-01-24T13:05:28.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-01-24T13:05:28.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.794869+0000', 'last_change': '2024-01-24T13:05:21.794869+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.794869+0000', 'last_undegraded': '2024-01-24T13:05:21.794869+0000', 'last_fullsized': '2024-01-24T13:05:21.794869+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T19:33:35.468533+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-24T13:05:28.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-01-24T13:05:28.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-01-24T13:05:28.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.795189+0000', 'last_change': '2024-01-24T13:05:21.795189+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.795189+0000', 'last_undegraded': '2024-01-24T13:05:21.795189+0000', 'last_fullsized': '2024-01-24T13:05:21.795189+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T20:53:05.828860+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-24T13:05:28.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-01-24T13:05:28.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-01-24T13:05:28.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.792074+0000', 'last_change': '2024-01-24T13:05:21.792074+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.792074+0000', 'last_undegraded': '2024-01-24T13:05:21.792074+0000', 'last_fullsized': '2024-01-24T13:05:21.792074+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T19:33:35.468533+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-24T13:05:28.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-01-24T13:05:28.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-01-24T13:05:28.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.795199+0000', 'last_change': '2024-01-24T13:05:21.795199+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.795199+0000', 'last_undegraded': '2024-01-24T13:05:21.795199+0000', 'last_fullsized': '2024-01-24T13:05:21.795199+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T17:46:09.885466+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-24T13:05:28.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-01-24T13:05:28.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-01-24T13:05:28.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.792900+0000', 'last_change': '2024-01-24T13:05:21.792900+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.792900+0000', 'last_undegraded': '2024-01-24T13:05:21.792900+0000', 'last_fullsized': '2024-01-24T13:05:21.792900+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-26T00:01:16.142279+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-24T13:05:28.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-01-24T13:05:28.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-01-24T13:05:28.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.791686+0000', 'last_change': '2024-01-24T13:05:21.791686+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.791686+0000', 'last_undegraded': '2024-01-24T13:05:21.791686+0000', 'last_fullsized': '2024-01-24T13:05:21.791686+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T14:56:22.964132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-24T13:05:28.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-01-24T13:05:28.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-01-24T13:05:28.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.791668+0000', 'last_change': '2024-01-24T13:05:21.791668+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.791668+0000', 'last_undegraded': '2024-01-24T13:05:21.791668+0000', 'last_fullsized': '2024-01-24T13:05:21.791668+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T19:43:57.475660+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-24T13:05:28.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-01-24T13:05:28.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-01-24T13:05:28.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.792369+0000', 'last_change': '2024-01-24T13:05:21.792369+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.792369+0000', 'last_undegraded': '2024-01-24T13:05:21.792369+0000', 'last_fullsized': '2024-01-24T13:05:21.792369+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T19:38:51.635054+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-24T13:05:28.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-01-24T13:05:28.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-01-24T13:05:28.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.794367+0000', 'last_change': '2024-01-24T13:05:21.794367+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.794367+0000', 'last_undegraded': '2024-01-24T13:05:21.794367+0000', 'last_fullsized': '2024-01-24T13:05:21.794367+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T18:44:52.859781+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-24T13:05:28.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-01-24T13:05:28.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-01-24T13:05:28.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.798175+0000', 'last_change': '2024-01-24T13:05:21.798175+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.798175+0000', 'last_undegraded': '2024-01-24T13:05:21.798175+0000', 'last_fullsized': '2024-01-24T13:05:21.798175+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T18:08:11.324387+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-24T13:05:28.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-01-24T13:05:28.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-01-24T13:05:28.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.791571+0000', 'last_change': '2024-01-24T13:05:21.791571+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.791571+0000', 'last_undegraded': '2024-01-24T13:05:21.791571+0000', 'last_fullsized': '2024-01-24T13:05:21.791571+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T21:37:28.187706+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-24T13:05:28.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-01-24T13:05:28.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-01-24T13:05:28.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.794399+0000', 'last_change': '2024-01-24T13:05:21.794399+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.794399+0000', 'last_undegraded': '2024-01-24T13:05:21.794399+0000', 'last_fullsized': '2024-01-24T13:05:21.794399+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T15:44:22.763339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-24T13:05:28.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-01-24T13:05:28.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-01-24T13:05:28.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.795497+0000', 'last_change': '2024-01-24T13:05:21.795497+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.795497+0000', 'last_undegraded': '2024-01-24T13:05:21.795497+0000', 'last_fullsized': '2024-01-24T13:05:21.795497+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T18:44:32.634926+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-24T13:05:28.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-01-24T13:05:28.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-01-24T13:05:28.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.791046+0000', 'last_change': '2024-01-24T13:05:21.791046+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.791046+0000', 'last_undegraded': '2024-01-24T13:05:21.791046+0000', 'last_fullsized': '2024-01-24T13:05:21.791046+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T13:52:37.909722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-24T13:05:28.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-01-24T13:05:28.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-01-24T13:05:28.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.797764+0000', 'last_change': '2024-01-24T13:05:21.797764+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.797764+0000', 'last_undegraded': '2024-01-24T13:05:21.797764+0000', 'last_fullsized': '2024-01-24T13:05:21.797764+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T15:38:10.129854+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-24T13:05:28.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-01-24T13:05:28.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-01-24T13:05:28.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-01-24T13:05:28.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.797668+0000', 'last_change': '2024-01-24T13:05:21.797668+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.797668+0000', 'last_undegraded': '2024-01-24T13:05:21.797668+0000', 'last_fullsized': '2024-01-24T13:05:21.797668+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T18:44:26.695067+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-24T13:05:28.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-01-24T13:05:28.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-01-24T13:05:28.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.795529+0000', 'last_change': '2024-01-24T13:05:21.795529+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.795529+0000', 'last_undegraded': '2024-01-24T13:05:21.795529+0000', 'last_fullsized': '2024-01-24T13:05:21.795529+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T22:55:28.106943+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-24T13:05:28.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-01-24T13:05:28.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-01-24T13:05:28.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.797595+0000', 'last_change': '2024-01-24T13:05:21.797595+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.797595+0000', 'last_undegraded': '2024-01-24T13:05:21.797595+0000', 'last_fullsized': '2024-01-24T13:05:21.797595+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T15:38:40.777988+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-24T13:05:28.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-01-24T13:05:28.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-01-24T13:05:28.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.791025+0000', 'last_change': '2024-01-24T13:05:21.791025+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.791025+0000', 'last_undegraded': '2024-01-24T13:05:21.791025+0000', 'last_fullsized': '2024-01-24T13:05:21.791025+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T18:58:04.657760+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-24T13:05:28.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-01-24T13:05:28.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-01-24T13:05:28.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.796985+0000', 'last_change': '2024-01-24T13:05:21.796985+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.796985+0000', 'last_undegraded': '2024-01-24T13:05:21.796985+0000', 'last_fullsized': '2024-01-24T13:05:21.796985+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T18:05:34.960781+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-24T13:05:28.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-01-24T13:05:28.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.797038+0000', 'last_change': '2024-01-24T13:05:21.797038+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.797038+0000', 'last_undegraded': '2024-01-24T13:05:21.797038+0000', 'last_fullsized': '2024-01-24T13:05:21.797038+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T14:29:53.106048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-24T13:05:28.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-01-24T13:05:28.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-01-24T13:05:28.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.793777+0000', 'last_change': '2024-01-24T13:05:21.793777+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.793777+0000', 'last_undegraded': '2024-01-24T13:05:21.793777+0000', 'last_fullsized': '2024-01-24T13:05:21.793777+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T18:20:05.407056+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-24T13:05:28.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-01-24T13:05:28.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-01-24T13:05:28.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.799163+0000', 'last_change': '2024-01-24T13:05:21.799163+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.799163+0000', 'last_undegraded': '2024-01-24T13:05:21.799163+0000', 'last_fullsized': '2024-01-24T13:05:21.799163+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T16:03:23.863326+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-24T13:05:28.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-01-24T13:05:28.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-01-24T13:05:28.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.791050+0000', 'last_change': '2024-01-24T13:05:21.791050+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.791050+0000', 'last_undegraded': '2024-01-24T13:05:21.791050+0000', 'last_fullsized': '2024-01-24T13:05:21.791050+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-26T00:35:30.269642+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-24T13:05:28.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-01-24T13:05:28.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-01-24T13:05:28.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.793380+0000', 'last_change': '2024-01-24T13:05:21.793380+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.793380+0000', 'last_undegraded': '2024-01-24T13:05:21.793380+0000', 'last_fullsized': '2024-01-24T13:05:21.793380+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T16:17:15.098387+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-24T13:05:28.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-01-24T13:05:28.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:05:22.787401+0000', 'last_change': '2024-01-24T13:05:22.787401+0000', 'last_active': '2024-01-24T13:05:22.787401+0000', 'last_peered': '2024-01-24T13:05:22.787401+0000', 'last_clean': '2024-01-24T13:05:22.787401+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:22.787401+0000', 'last_undegraded': '2024-01-24T13:05:22.787401+0000', 'last_fullsized': '2024-01-24T13:05:22.787401+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:22.787401+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:05:28.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-01-24T13:05:28.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:05:21.798470+0000', 'last_change': '2024-01-24T13:05:21.798470+0000', 'last_active': '2024-01-24T13:05:21.781410+0000', 'last_peered': '2024-01-24T13:05:21.781410+0000', 'last_clean': '2024-01-24T13:05:21.781410+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:05:21.798470+0000', 'last_undegraded': '2024-01-24T13:05:21.798470+0000', 'last_fullsized': '2024-01-24T13:05:21.798470+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'last_clean_scrub_stamp': '2024-01-24T13:05:21.781410+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T18:37:14.667657+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-24T13:05:28.215 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-24T13:05:28.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.378+0000 7fdc56000640 1 Processor -- start 2024-01-24T13:05:28.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.378+0000 7fdc56000640 1 -- start start 2024-01-24T13:05:28.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.378+0000 7fdc56000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdc500cd4c0 0x7fdc5006b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.378+0000 7fdc56000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5006cc10 con 0x7fdc500b2700 2024-01-24T13:05:28.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.378+0000 7fdc56000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5006b7a0 con 0x7fdc5015c730 2024-01-24T13:05:28.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.378+0000 7fdc56000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5006ba80 con 0x7fdc500cd4c0 2024-01-24T13:05:28.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.378+0000 7fdc4ea00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdc500b2700 0x7fdc500ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59104/0 (socket says 172.21.15.29:59104) 2024-01-24T13:05:28.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.378+0000 7fdc4fe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdc500cd4c0 0x7fdc5006b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.378+0000 7fdc4ea00640 1 -- 172.21.15.29:0/2005433161 learned_addr learned my addr 172.21.15.29:0/2005433161 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:28.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.382+0000 7fdc4fe00640 1 -- 172.21.15.29:0/2005433161 >> v1:172.21.15.163:6789/0 conn(0x7fdc5015c730 legacy=0x7fdc500ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.382+0000 7fdc4fe00640 1 -- 172.21.15.29:0/2005433161 >> v1:172.21.15.29:6789/0 conn(0x7fdc500b2700 legacy=0x7fdc500ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.382+0000 7fdc4fe00640 1 -- 172.21.15.29:0/2005433161 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5006bd60 con 0x7fdc500cd4c0 2024-01-24T13:05:28.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.382+0000 7fdc4e000640 1 -- 172.21.15.29:0/2005433161 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831947105 0 0) 0x7fdc5006cc10 con 0x7fdc500b2700 2024-01-24T13:05:28.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.382+0000 7fdc4fe00640 1 --2- 172.21.15.29:0/2005433161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc500cd4c0 0x7fdc5006b110 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009d90 tx=0x7fdc4801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb4f7885cfe3b48 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:28.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.382+0000 7fdc4e000640 1 -- 172.21.15.29:0/2005433161 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc480a5900 con 0x7fdc500cd4c0 2024-01-24T13:05:28.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.382+0000 7fdc4e000640 1 -- 172.21.15.29:0/2005433161 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc480a5a60 con 0x7fdc500cd4c0 2024-01-24T13:05:28.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.382+0000 7fdc4e000640 1 -- 172.21.15.29:0/2005433161 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc480a5df0 con 0x7fdc500cd4c0 2024-01-24T13:05:28.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 -- 172.21.15.29:0/2005433161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc500cd4c0 msgr2=0x7fdc5006b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 --2- 172.21.15.29:0/2005433161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc500cd4c0 0x7fdc5006b110 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009d90 tx=0x7fdc4801c950 comp rx=0 tx=0).stop 2024-01-24T13:05:28.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 -- 172.21.15.29:0/2005433161 shutdown_connections 2024-01-24T13:05:28.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 --2- 172.21.15.29:0/2005433161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc500cd4c0 0x7fdc5006b110 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 -- 172.21.15.29:0/2005433161 >> 172.21.15.29:0/2005433161 conn(0x7fdc50070570 msgr2=0x7fdc50069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:28.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 -- 172.21.15.29:0/2005433161 shutdown_connections 2024-01-24T13:05:28.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 -- 172.21.15.29:0/2005433161 wait complete. 2024-01-24T13:05:28.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 Processor -- start 2024-01-24T13:05:28.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 -- start start 2024-01-24T13:05:28.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc500b2700 0x7fdc5014f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc500cd4c0 0x7fdc5015a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdc5015c730 0x7fdc500b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5015a990 con 0x7fdc500b2700 2024-01-24T13:05:28.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5015ac70 con 0x7fdc500cd4c0 2024-01-24T13:05:28.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc56000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5015af50 con 0x7fdc5015c730 2024-01-24T13:05:28.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc4f400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc500b2700 0x7fdc5014f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc4f400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc500b2700 0x7fdc5014f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48076/0 (socket says 172.21.15.29:48076) 2024-01-24T13:05:28.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.386+0000 7fdc4f400640 1 -- 172.21.15.29:0/3202312547 learned_addr learned my addr 172.21.15.29:0/3202312547 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:28.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc4ea00640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc500cd4c0 0x7fdc5015a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc4fe00640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdc5015c730 0x7fdc500b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc4f400640 1 -- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdc5015c730 msgr2=0x7fdc500b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc4f400640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdc5015c730 0x7fdc500b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc4f400640 1 -- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc500cd4c0 msgr2=0x7fdc5015a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc4f400640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc500cd4c0 0x7fdc5015a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc4f400640 1 -- 172.21.15.29:0/3202312547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc48009a70 con 0x7fdc500b2700 2024-01-24T13:05:28.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc4ea00640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc500cd4c0 0x7fdc5015a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:28.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc4f400640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc500b2700 0x7fdc5014f340 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c3c0 tx=0x7fdc4000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:28.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc47400640 1 -- 172.21.15.29:0/3202312547 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc400052d0 con 0x7fdc500b2700 2024-01-24T13:05:28.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc47400640 1 -- 172.21.15.29:0/3202312547 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc40005430 con 0x7fdc500b2700 2024-01-24T13:05:28.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc56000640 1 -- 172.21.15.29:0/3202312547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5015b230 con 0x7fdc500b2700 2024-01-24T13:05:28.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc47400640 1 -- 172.21.15.29:0/3202312547 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40003840 con 0x7fdc500b2700 2024-01-24T13:05:28.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc56000640 1 -- 172.21.15.29:0/3202312547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5015a580 con 0x7fdc500b2700 2024-01-24T13:05:28.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc56000640 1 -- 172.21.15.29:0/3202312547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc500cf430 con 0x7fdc500b2700 2024-01-24T13:05:28.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc47400640 1 -- 172.21.15.29:0/3202312547 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdc400039a0 con 0x7fdc500b2700 2024-01-24T13:05:28.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.390+0000 7fdc47400640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdc28065ab0 0x7fdc28067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.394+0000 7fdc47400640 1 -- 172.21.15.29:0/3202312547 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdc400827d0 con 0x7fdc500b2700 2024-01-24T13:05:28.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.394+0000 7fdc4ea00640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdc28065ab0 0x7fdc28067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.394+0000 7fdc4ea00640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdc28065ab0 0x7fdc28067f70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdc500b5a00 tx=0x7fdc38007c80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.394+0000 7fdc47400640 1 -- 172.21.15.29:0/3202312547 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fdc400500c0 con 0x7fdc500b2700 2024-01-24T13:05:28.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.622+0000 7fdc56000640 1 -- 172.21.15.29:0/3202312547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdc5015b750 con 0x7fdc500b2700 2024-01-24T13:05:28.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.622+0000 7fdc47400640 1 -- 172.21.15.29:0/3202312547 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1169 (secure 0 0 0) 0x7fdc400536e0 con 0x7fdc500b2700 2024-01-24T13:05:28.626 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:28.626 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":118,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":43,"num_osds":8,"num_up_osds":8,"osd_up_since":1706101422,"num_in_osds":8,"osd_in_since":1706101413,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":61},{"state_name":"creating+peering","count":30},{"state_name":"active+clean","count":6}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590368,"bytes_used":230408192,"bytes_avail":772863705088,"bytes_total":773094113280,"unknown_pgs_ratio":0.62886595726013184,"inactive_pgs_ratio":0.30927833914756775,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5463}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-01-24T13:05:01.553542+0000","services":{}},"progress_events":{}} 2024-01-24T13:05:28.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.622+0000 7fdc56000640 1 -- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdc28065ab0 msgr2=0x7fdc28067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.622+0000 7fdc56000640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdc28065ab0 0x7fdc28067f70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdc500b5a00 tx=0x7fdc38007c80 comp rx=0 tx=0).stop 2024-01-24T13:05:28.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.622+0000 7fdc56000640 1 -- 172.21.15.29:0/3202312547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc500b2700 msgr2=0x7fdc5014f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.622+0000 7fdc56000640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc500b2700 0x7fdc5014f340 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c3c0 tx=0x7fdc4000c880 comp rx=0 tx=0).stop 2024-01-24T13:05:28.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.622+0000 7fdc56000640 1 -- 172.21.15.29:0/3202312547 shutdown_connections 2024-01-24T13:05:28.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.622+0000 7fdc56000640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdc28065ab0 0x7fdc28067f70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.622+0000 7fdc56000640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdc5015c730 0x7fdc500b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.622+0000 7fdc56000640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc500cd4c0 0x7fdc5015a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.622+0000 7fdc56000640 1 --2- 172.21.15.29:0/3202312547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc500b2700 0x7fdc5014f340 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.622+0000 7fdc56000640 1 -- 172.21.15.29:0/3202312547 >> 172.21.15.29:0/3202312547 conn(0x7fdc50070570 msgr2=0x7fdc500cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:28.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.622+0000 7fdc56000640 1 -- 172.21.15.29:0/3202312547 shutdown_connections 2024-01-24T13:05:28.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.622+0000 7fdc56000640 1 -- 172.21.15.29:0/3202312547 wait complete. 2024-01-24T13:05:28.648 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-24T13:05:28.648 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.786+0000 7f3527800640 1 Processor -- start 2024-01-24T13:05:28.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.786+0000 7f3527800640 1 -- start start 2024-01-24T13:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.790+0000 7f3527800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3520070240 0x7f3520070680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.790+0000 7f3527800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3520070bc0 0x7f35200b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.790+0000 7f3527800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3520071050 con 0x7f35201588d0 2024-01-24T13:05:28.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.790+0000 7f3527800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35201593c0 con 0x7f3520070240 2024-01-24T13:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.790+0000 7f3527800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352015c830 con 0x7f3520070bc0 2024-01-24T13:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.790+0000 7f351fe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3520070240 0x7f3520070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.790+0000 7f351fe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3520070240 0x7f3520070680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48088/0 (socket says 172.21.15.29:48088) 2024-01-24T13:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.790+0000 7f351fe00640 1 -- 172.21.15.29:0/1670457042 learned_addr learned my addr 172.21.15.29:0/1670457042 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.790+0000 7f3525800640 1 --2- 172.21.15.29:0/1670457042 >> v2:172.21.15.163:3300/0 conn(0x7f3520070bc0 0x7f35200b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.790+0000 7f351fe00640 1 -- 172.21.15.29:0/1670457042 >> v2:172.21.15.163:3300/0 conn(0x7f3520070bc0 msgr2=0x7f35200b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:28.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.790+0000 7f351fe00640 1 --2- 172.21.15.29:0/1670457042 >> v2:172.21.15.163:3300/0 conn(0x7f3520070bc0 0x7f35200b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.790+0000 7f351fe00640 1 -- 172.21.15.29:0/1670457042 >> v1:172.21.15.163:6789/0 conn(0x7f35201588d0 legacy=0x7f3520158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:28.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.790+0000 7f351fe00640 1 -- 172.21.15.29:0/1670457042 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352015cb10 con 0x7f3520070240 2024-01-24T13:05:28.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.794+0000 7f351fe00640 1 --2- 172.21.15.29:0/1670457042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3520070240 0x7f3520070680 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3520071f00 tx=0x7f350801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ee8b53a841c1d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:28.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.794+0000 7f351f400640 1 -- 172.21.15.29:0/1670457042 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35080ab600 con 0x7f3520070240 2024-01-24T13:05:28.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.794+0000 7f351f400640 1 -- 172.21.15.29:0/1670457042 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35080a7050 con 0x7f3520070240 2024-01-24T13:05:28.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.794+0000 7f351f400640 1 -- 172.21.15.29:0/1670457042 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35080ab980 con 0x7f3520070240 2024-01-24T13:05:28.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.794+0000 7f3527800640 1 -- 172.21.15.29:0/1670457042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3520070240 msgr2=0x7f3520070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.794+0000 7f3527800640 1 --2- 172.21.15.29:0/1670457042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3520070240 0x7f3520070680 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3520071f00 tx=0x7f350801c370 comp rx=0 tx=0).stop 2024-01-24T13:05:28.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.794+0000 7f3527800640 1 -- 172.21.15.29:0/1670457042 shutdown_connections 2024-01-24T13:05:28.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.794+0000 7f3527800640 1 --2- 172.21.15.29:0/1670457042 >> v2:172.21.15.163:3300/0 conn(0x7f3520070bc0 0x7f35200b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.794+0000 7f3527800640 1 --2- 172.21.15.29:0/1670457042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3520070240 0x7f3520070680 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.794+0000 7f3527800640 1 -- 172.21.15.29:0/1670457042 >> 172.21.15.29:0/1670457042 conn(0x7f35200b3950 msgr2=0x7f3520069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:28.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.794+0000 7f3527800640 1 -- 172.21.15.29:0/1670457042 shutdown_connections 2024-01-24T13:05:28.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.794+0000 7f3527800640 1 -- 172.21.15.29:0/1670457042 wait complete. 2024-01-24T13:05:28.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.794+0000 7f3527800640 1 Processor -- start 2024-01-24T13:05:28.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.794+0000 7f3527800640 1 -- start start 2024-01-24T13:05:28.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f3527800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3520070240 0x7f35200ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f3527800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3520070bc0 0x7f35200b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f3527800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35201588d0 0x7f3520151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f3527800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35201408a0 con 0x7f3520070bc0 2024-01-24T13:05:28.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f3527800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35200cd270 con 0x7f3520070240 2024-01-24T13:05:28.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f3527800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352013fc20 con 0x7f35201588d0 2024-01-24T13:05:28.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f351fe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3520070bc0 0x7f35200b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f351fe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3520070bc0 0x7f35200b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48100/0 (socket says 172.21.15.29:48100) 2024-01-24T13:05:28.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f351fe00640 1 -- 172.21.15.29:0/1334885114 learned_addr learned my addr 172.21.15.29:0/1334885114 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:28.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f3524e00640 1 --2- 172.21.15.29:0/1334885114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3520070240 0x7f35200ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f3525800640 1 --2- 172.21.15.29:0/1334885114 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35201588d0 0x7f3520151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f351fe00640 1 -- 172.21.15.29:0/1334885114 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35201588d0 msgr2=0x7f3520151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f351fe00640 1 --2- 172.21.15.29:0/1334885114 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35201588d0 0x7f3520151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f351fe00640 1 -- 172.21.15.29:0/1334885114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3520070240 msgr2=0x7f35200ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f351fe00640 1 --2- 172.21.15.29:0/1334885114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3520070240 0x7f35200ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f351fe00640 1 -- 172.21.15.29:0/1334885114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35080094d0 con 0x7f3520070bc0 2024-01-24T13:05:28.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f351fe00640 1 --2- 172.21.15.29:0/1334885114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3520070bc0 0x7f35200b2c50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f350801aa20 tx=0x7f3508019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:28.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f351cc00640 1 -- 172.21.15.29:0/1334885114 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35080b4420 con 0x7f3520070bc0 2024-01-24T13:05:28.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f351cc00640 1 -- 172.21.15.29:0/1334885114 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35080b4580 con 0x7f3520070bc0 2024-01-24T13:05:28.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f351cc00640 1 -- 172.21.15.29:0/1334885114 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35080b4930 con 0x7f3520070bc0 2024-01-24T13:05:28.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f3527800640 1 -- 172.21.15.29:0/1334885114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3520071540 con 0x7f3520070bc0 2024-01-24T13:05:28.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f3527800640 1 -- 172.21.15.29:0/1334885114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35201401e0 con 0x7f3520070bc0 2024-01-24T13:05:28.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.798+0000 7f3527800640 1 -- 172.21.15.29:0/1334885114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352013d8b0 con 0x7f3520070bc0 2024-01-24T13:05:28.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.802+0000 7f351cc00640 1 -- 172.21.15.29:0/1334885114 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f35080b2070 con 0x7f3520070bc0 2024-01-24T13:05:28.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.802+0000 7f351cc00640 1 --2- 172.21.15.29:0/1334885114 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f34f8065a60 0x7f34f8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:28.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.802+0000 7f351cc00640 1 -- 172.21.15.29:0/1334885114 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f350811cdf0 con 0x7f3520070bc0 2024-01-24T13:05:28.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.802+0000 7f3524e00640 1 --2- 172.21.15.29:0/1334885114 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f34f8065a60 0x7f34f8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:28.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.802+0000 7f3524e00640 1 --2- 172.21.15.29:0/1334885114 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f34f8065a60 0x7f34f8067f20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f35100098e0 tx=0x7f3510009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:28.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.806+0000 7f351cc00640 1 -- 172.21.15.29:0/1334885114 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f352013d8b0 con 0x7f3520070bc0 2024-01-24T13:05:28.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.958+0000 7f3527800640 1 -- 172.21.15.29:0/1334885114 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35200713c0 con 0x7f34f8065a60 2024-01-24T13:05:28.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.966+0000 7f351cc00640 1 -- 172.21.15.29:0/1334885114 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279408 (secure 0 0 0) 0x7f3510009530 con 0x7f34f8065a60 2024-01-24T13:05:28.974 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:28.975 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:05:28.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.970+0000 7f3527800640 1 -- 172.21.15.29:0/1334885114 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f34f8065a60 msgr2=0x7f34f8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.970+0000 7f3527800640 1 --2- 172.21.15.29:0/1334885114 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f34f8065a60 0x7f34f8067f20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f35100098e0 tx=0x7f3510009060 comp rx=0 tx=0).stop 2024-01-24T13:05:28.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.970+0000 7f3527800640 1 -- 172.21.15.29:0/1334885114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3520070bc0 msgr2=0x7f35200b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.970+0000 7f3527800640 1 --2- 172.21.15.29:0/1334885114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3520070bc0 0x7f35200b2c50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f350801aa20 tx=0x7f3508019110 comp rx=0 tx=0).stop 2024-01-24T13:05:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.970+0000 7f3527800640 1 -- 172.21.15.29:0/1334885114 shutdown_connections 2024-01-24T13:05:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.970+0000 7f3527800640 1 --2- 172.21.15.29:0/1334885114 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f34f8065a60 0x7f34f8067f20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.970+0000 7f3527800640 1 --2- 172.21.15.29:0/1334885114 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f35201588d0 0x7f3520151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.970+0000 7f3527800640 1 --2- 172.21.15.29:0/1334885114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3520070bc0 0x7f35200b2c50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.970+0000 7f3527800640 1 --2- 172.21.15.29:0/1334885114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3520070240 0x7f35200ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.970+0000 7f3527800640 1 -- 172.21.15.29:0/1334885114 >> 172.21.15.29:0/1334885114 conn(0x7f35200b3950 msgr2=0x7f35200af400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.970+0000 7f3527800640 1 -- 172.21.15.29:0/1334885114 shutdown_connections 2024-01-24T13:05:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:28.970+0000 7f3527800640 1 -- 172.21.15.29:0/1334885114 wait complete. 2024-01-24T13:05:28.995 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-01-24T13:05:27.560128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":72,"acting":72,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225008,"kb_used_data":4752,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754749712,"statfs":{"total":773094113280,"available":772863705088,"internally_reserved":0,"allocated":4866048,"data_stored":2723348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.770599"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224078+0000","last_change":"2024-01-24T13:05:23.236305+0000","last_active":"2024-01-24T13:05:24.224078+0000","last_peered":"2024-01-24T13:05:24.224078+0000","last_clean":"2024-01-24T13:05:24.224078+0000","last_became_active":"2024-01-24T13:05:23.234966+0000","last_became_peered":"2024-01-24T13:05:23.234966+0000","last_unstale":"2024-01-24T13:05:24.224078+0000","last_undegraded":"2024-01-24T13:05:24.224078+0000","last_fullsized":"2024-01-24T13:05:24.224078+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:34:04.521864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794322+0000","last_change":"2024-01-24T13:05:21.794322+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794322+0000","last_undegraded":"2024-01-24T13:05:21.794322+0000","last_fullsized":"2024-01-24T13:05:21.794322+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:01:16.142279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797664+0000","last_change":"2024-01-24T13:05:21.797664+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797664+0000","last_undegraded":"2024-01-24T13:05:21.797664+0000","last_fullsized":"2024-01-24T13:05:21.797664+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:52:11.442955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792346+0000","last_change":"2024-01-24T13:05:21.792346+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792346+0000","last_undegraded":"2024-01-24T13:05:21.792346+0000","last_fullsized":"2024-01-24T13:05:21.792346+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:44:22.763339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794413+0000","last_change":"2024-01-24T13:05:21.794413+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794413+0000","last_undegraded":"2024-01-24T13:05:21.794413+0000","last_fullsized":"2024-01-24T13:05:21.794413+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:05.407056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794869+0000","last_change":"2024-01-24T13:05:21.794869+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794869+0000","last_undegraded":"2024-01-24T13:05:21.794869+0000","last_fullsized":"2024-01-24T13:05:21.794869+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:33:35.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795189+0000","last_change":"2024-01-24T13:05:21.795189+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795189+0000","last_undegraded":"2024-01-24T13:05:21.795189+0000","last_fullsized":"2024-01-24T13:05:21.795189+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:53:05.828860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792074+0000","last_change":"2024-01-24T13:05:21.792074+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792074+0000","last_undegraded":"2024-01-24T13:05:21.792074+0000","last_fullsized":"2024-01-24T13:05:21.792074+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:33:35.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795199+0000","last_change":"2024-01-24T13:05:21.795199+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795199+0000","last_undegraded":"2024-01-24T13:05:21.795199+0000","last_fullsized":"2024-01-24T13:05:21.795199+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:46:09.885466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792900+0000","last_change":"2024-01-24T13:05:21.792900+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792900+0000","last_undegraded":"2024-01-24T13:05:21.792900+0000","last_fullsized":"2024-01-24T13:05:21.792900+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:01:16.142279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791686+0000","last_change":"2024-01-24T13:05:21.791686+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791686+0000","last_undegraded":"2024-01-24T13:05:21.791686+0000","last_fullsized":"2024-01-24T13:05:21.791686+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:56:22.964132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791668+0000","last_change":"2024-01-24T13:05:21.791668+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791668+0000","last_undegraded":"2024-01-24T13:05:21.791668+0000","last_fullsized":"2024-01-24T13:05:21.791668+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:43:57.475660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.792369+0000","last_change":"2024-01-24T13:05:21.792369+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.792369+0000","last_undegraded":"2024-01-24T13:05:21.792369+0000","last_fullsized":"2024-01-24T13:05:21.792369+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:38:51.635054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794367+0000","last_change":"2024-01-24T13:05:21.794367+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794367+0000","last_undegraded":"2024-01-24T13:05:21.794367+0000","last_fullsized":"2024-01-24T13:05:21.794367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:52.859781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.798175+0000","last_change":"2024-01-24T13:05:21.798175+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.798175+0000","last_undegraded":"2024-01-24T13:05:21.798175+0000","last_fullsized":"2024-01-24T13:05:21.798175+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:08:11.324387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791571+0000","last_change":"2024-01-24T13:05:21.791571+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791571+0000","last_undegraded":"2024-01-24T13:05:21.791571+0000","last_fullsized":"2024-01-24T13:05:21.791571+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:37:28.187706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.794399+0000","last_change":"2024-01-24T13:05:21.794399+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.794399+0000","last_undegraded":"2024-01-24T13:05:21.794399+0000","last_fullsized":"2024-01-24T13:05:21.794399+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:44:22.763339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795497+0000","last_change":"2024-01-24T13:05:21.795497+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795497+0000","last_undegraded":"2024-01-24T13:05:21.795497+0000","last_fullsized":"2024-01-24T13:05:21.795497+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:32.634926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791046+0000","last_change":"2024-01-24T13:05:21.791046+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791046+0000","last_undegraded":"2024-01-24T13:05:21.791046+0000","last_fullsized":"2024-01-24T13:05:21.791046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:52:37.909722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797764+0000","last_change":"2024-01-24T13:05:21.797764+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797764+0000","last_undegraded":"2024-01-24T13:05:21.797764+0000","last_fullsized":"2024-01-24T13:05:21.797764+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:38:10.129854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224224+0000","last_change":"2024-01-24T13:05:23.236304+0000","last_active":"2024-01-24T13:05:24.224224+0000","last_peered":"2024-01-24T13:05:24.224224+0000","last_clean":"2024-01-24T13:05:24.224224+0000","last_became_active":"2024-01-24T13:05:23.235114+0000","last_became_peered":"2024-01-24T13:05:23.235114+0000","last_unstale":"2024-01-24T13:05:24.224224+0000","last_undegraded":"2024-01-24T13:05:24.224224+0000","last_fullsized":"2024-01-24T13:05:24.224224+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:36:46.585321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224224+0000","last_change":"2024-01-24T13:05:22.816414+0000","last_active":"2024-01-24T13:05:24.224224+0000","last_peered":"2024-01-24T13:05:24.224224+0000","last_clean":"2024-01-24T13:05:24.224224+0000","last_became_active":"2024-01-24T13:05:22.816149+0000","last_became_peered":"2024-01-24T13:05:22.816149+0000","last_unstale":"2024-01-24T13:05:24.224224+0000","last_undegraded":"2024-01-24T13:05:24.224224+0000","last_fullsized":"2024-01-24T13:05:24.224224+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:34:54.259224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224075+0000","last_change":"2024-01-24T13:05:22.811435+0000","last_active":"2024-01-24T13:05:24.224075+0000","last_peered":"2024-01-24T13:05:24.224075+0000","last_clean":"2024-01-24T13:05:24.224075+0000","last_became_active":"2024-01-24T13:05:22.811126+0000","last_became_peered":"2024-01-24T13:05:22.811126+0000","last_unstale":"2024-01-24T13:05:24.224075+0000","last_undegraded":"2024-01-24T13:05:24.224075+0000","last_fullsized":"2024-01-24T13:05:24.224075+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:45:33.745161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797668+0000","last_change":"2024-01-24T13:05:21.797668+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797668+0000","last_undegraded":"2024-01-24T13:05:21.797668+0000","last_fullsized":"2024-01-24T13:05:21.797668+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:26.695067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.795529+0000","last_change":"2024-01-24T13:05:21.795529+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.795529+0000","last_undegraded":"2024-01-24T13:05:21.795529+0000","last_fullsized":"2024-01-24T13:05:21.795529+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:55:28.106943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797595+0000","last_change":"2024-01-24T13:05:21.797595+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797595+0000","last_undegraded":"2024-01-24T13:05:21.797595+0000","last_fullsized":"2024-01-24T13:05:21.797595+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:38:40.777988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791025+0000","last_change":"2024-01-24T13:05:21.791025+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791025+0000","last_undegraded":"2024-01-24T13:05:21.791025+0000","last_fullsized":"2024-01-24T13:05:21.791025+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:58:04.657760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.796985+0000","last_change":"2024-01-24T13:05:21.796985+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.796985+0000","last_undegraded":"2024-01-24T13:05:21.796985+0000","last_fullsized":"2024-01-24T13:05:21.796985+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:05:34.960781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224235+0000","last_change":"2024-01-24T13:05:23.241430+0000","last_active":"2024-01-24T13:05:24.224235+0000","last_peered":"2024-01-24T13:05:24.224235+0000","last_clean":"2024-01-24T13:05:24.224235+0000","last_became_active":"2024-01-24T13:05:23.241157+0000","last_became_peered":"2024-01-24T13:05:23.241157+0000","last_unstale":"2024-01-24T13:05:24.224235+0000","last_undegraded":"2024-01-24T13:05:24.224235+0000","last_fullsized":"2024-01-24T13:05:24.224235+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:48:21.345424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.797038+0000","last_change":"2024-01-24T13:05:21.797038+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.797038+0000","last_undegraded":"2024-01-24T13:05:21.797038+0000","last_fullsized":"2024-01-24T13:05:21.797038+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:29:53.106048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.793777+0000","last_change":"2024-01-24T13:05:21.793777+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.793777+0000","last_undegraded":"2024-01-24T13:05:21.793777+0000","last_fullsized":"2024-01-24T13:05:21.793777+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:05.407056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.799163+0000","last_change":"2024-01-24T13:05:21.799163+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.799163+0000","last_undegraded":"2024-01-24T13:05:21.799163+0000","last_fullsized":"2024-01-24T13:05:21.799163+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:03:23.863326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.791050+0000","last_change":"2024-01-24T13:05:21.791050+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.791050+0000","last_undegraded":"2024-01-24T13:05:21.791050+0000","last_fullsized":"2024-01-24T13:05:21.791050+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:35:30.269642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.793380+0000","last_change":"2024-01-24T13:05:21.793380+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.793380+0000","last_undegraded":"2024-01-24T13:05:21.793380+0000","last_fullsized":"2024-01-24T13:05:21.793380+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:15.098387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:05:22.787401+0000","last_change":"2024-01-24T13:05:22.787401+0000","last_active":"2024-01-24T13:05:22.787401+0000","last_peered":"2024-01-24T13:05:22.787401+0000","last_clean":"2024-01-24T13:05:22.787401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:22.787401+0000","last_undegraded":"2024-01-24T13:05:22.787401+0000","last_fullsized":"2024-01-24T13:05:22.787401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2024-01-24T13:05:21.798470+0000","last_change":"2024-01-24T13:05:21.798470+0000","last_active":"2024-01-24T13:05:21.781410+0000","last_peered":"2024-01-24T13:05:21.781410+0000","last_clean":"2024-01-24T13:05:21.781410+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:05:21.798470+0000","last_undegraded":"2024-01-24T13:05:21.798470+0000","last_fullsized":"2024-01-24T13:05:21.798470+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:37:14.667657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":177,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-24T13:05:18.230458+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:05:18.230458+0000","last_peered":"2024-01-24T13:05:18.230458+0000","last_clean":"2024-01-24T13:05:18.230458+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:05:18.230458+0000","last_undegraded":"2024-01-24T13:05:18.230458+0000","last_fullsized":"2024-01-24T13:05:18.230458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":6,"acting":6,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.74199999999999999}]},{"osd":1,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.79200000000000004}]},{"osd":2,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.77800000000000002}]},{"osd":4,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.48899999999999999}]},{"osd":5,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55900000000000005}]},{"osd":6,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.58599999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":5.5579999999999998,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.61199999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":4.3289999999999997,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":4.9009999999999998,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.66800000000000004}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.6059999999999999,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.48099999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.274,"5min":4.274,"15min":4.274},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.645,"5min":2.645,"15min":2.645},"last":0.63}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":5.6449999999999996,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.5140000000000002,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.68899999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57399999999999995}]},{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.71299999999999997}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.503},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.73899999999999999}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.85299999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.44700000000000001}]},{"osd":1,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.437},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.36599999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.375},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.41199999999999998}]},{"osd":4,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.71199999999999997}]},{"osd":6,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.76500000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.35599999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.374},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.78900000000000003}]},{"osd":6,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.755},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.68799999999999994}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":780583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":0.371}]},{"osd":3,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.35599999999999998}]},{"osd":4,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.83299999999999996}]},{"osd":7,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.78800000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":454656,"data_stored":190215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":5.556,"5min":5.556,"15min":5.556},"last":0.35099999999999998}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":5.3929999999999998,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.42799999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.45400000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.67500000000000004}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.81299999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1089536,"data_stored":801475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56000000000000005}]},{"osd":1,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.42699999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.498}]},{"osd":4,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.40699999999999997}]},{"osd":6,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.54400000000000004}]},{"osd":7,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.627},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:05:32.000 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:05:32.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9bbc00640 1 Processor -- start 2024-01-24T13:05:32.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9bbc00640 1 -- start start 2024-01-24T13:05:32.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9bbc00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb9b415af60 0x7fb9b40c4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9bbc00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb9b40c4690 0x7fb9b40cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9bbc00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b41655d0 con 0x7fb9b40cfbf0 2024-01-24T13:05:32.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9bbc00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b40cfff0 con 0x7fb9b415af60 2024-01-24T13:05:32.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9bbc00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b4164850 con 0x7fb9b40c4690 2024-01-24T13:05:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9b9c00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb9b40cfbf0 0x7fb9b4069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37970/0 (socket says 172.21.15.29:37970) 2024-01-24T13:05:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9b9200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb9b415af60 0x7fb9b40c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9b9c00640 1 -- 172.21.15.29:0/4194255304 learned_addr learned my addr 172.21.15.29:0/4194255304 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9b3e00640 1 --2- 172.21.15.29:0/4194255304 >> v2:172.21.15.163:3300/0 conn(0x7fb9b40c4690 0x7fb9b40cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9b9200640 1 -- 172.21.15.29:0/4194255304 >> v2:172.21.15.163:3300/0 conn(0x7fb9b40c4690 msgr2=0x7fb9b40cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9b9200640 1 --2- 172.21.15.29:0/4194255304 >> v2:172.21.15.163:3300/0 conn(0x7fb9b40c4690 0x7fb9b40cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9b9200640 1 -- 172.21.15.29:0/4194255304 >> v1:172.21.15.29:6789/0 conn(0x7fb9b40cfbf0 legacy=0x7fb9b4069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9b3400640 1 -- 172.21.15.29:0/4194255304 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686593874 0 0) 0x7fb9ac0014a0 con 0x7fb9b40cfbf0 2024-01-24T13:05:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.150+0000 7fb9b9200640 1 -- 172.21.15.29:0/4194255304 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b40c4ca0 con 0x7fb9b415af60 2024-01-24T13:05:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.154+0000 7fb9b9200640 1 --2- 172.21.15.29:0/4194255304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b415af60 0x7fb9b40c4150 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40cc660 tx=0x7fb9a401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b7cc22f4989bb3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.154+0000 7fb9b3400640 1 -- 172.21.15.29:0/4194255304 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40ab600 con 0x7fb9b415af60 2024-01-24T13:05:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.154+0000 7fb9b3400640 1 -- 172.21.15.29:0/4194255304 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a40a7050 con 0x7fb9b415af60 2024-01-24T13:05:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.154+0000 7fb9b3400640 1 -- 172.21.15.29:0/4194255304 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40ab980 con 0x7fb9b415af60 2024-01-24T13:05:32.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.154+0000 7fb9bbc00640 1 -- 172.21.15.29:0/4194255304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b415af60 msgr2=0x7fb9b40c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.154+0000 7fb9bbc00640 1 --2- 172.21.15.29:0/4194255304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b415af60 0x7fb9b40c4150 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40cc660 tx=0x7fb9a401c430 comp rx=0 tx=0).stop 2024-01-24T13:05:32.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.154+0000 7fb9bbc00640 1 -- 172.21.15.29:0/4194255304 shutdown_connections 2024-01-24T13:05:32.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.154+0000 7fb9bbc00640 1 --2- 172.21.15.29:0/4194255304 >> v2:172.21.15.163:3300/0 conn(0x7fb9b40c4690 0x7fb9b40cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.154+0000 7fb9bbc00640 1 --2- 172.21.15.29:0/4194255304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b415af60 0x7fb9b40c4150 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.154+0000 7fb9bbc00640 1 -- 172.21.15.29:0/4194255304 >> 172.21.15.29:0/4194255304 conn(0x7fb9b406b1e0 msgr2=0x7fb9b406b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:32.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.154+0000 7fb9bbc00640 1 -- 172.21.15.29:0/4194255304 shutdown_connections 2024-01-24T13:05:32.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.154+0000 7fb9bbc00640 1 -- 172.21.15.29:0/4194255304 wait complete. 2024-01-24T13:05:32.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9bbc00640 1 Processor -- start 2024-01-24T13:05:32.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9bbc00640 1 -- start start 2024-01-24T13:05:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9bbc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb9b40c4690 0x7fb9b40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9bbc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b40cfbf0 0x7fb9b4156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9bbc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb9b415af60 0x7fb9b40c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9bbc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b40c8990 con 0x7fb9b40cfbf0 2024-01-24T13:05:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9bbc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b40c8c70 con 0x7fb9b415af60 2024-01-24T13:05:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9bbc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b40c8f50 con 0x7fb9b40c4690 2024-01-24T13:05:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b3e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b40cfbf0 0x7fb9b4156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b3e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b40cfbf0 0x7fb9b4156f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55014/0 (socket says 172.21.15.29:55014) 2024-01-24T13:05:32.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b3e00640 1 -- 172.21.15.29:0/601044535 learned_addr learned my addr 172.21.15.29:0/601044535 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:32.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b9c00640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb9b415af60 0x7fb9b40c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b9200640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb9b40c4690 0x7fb9b40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b3e00640 1 -- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb9b40c4690 msgr2=0x7fb9b40b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b3e00640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb9b40c4690 0x7fb9b40b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b3e00640 1 -- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb9b415af60 msgr2=0x7fb9b40c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b3e00640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb9b415af60 0x7fb9b40c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b3e00640 1 -- 172.21.15.29:0/601044535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a4009420 con 0x7fb9b40cfbf0 2024-01-24T13:05:32.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b9200640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb9b40c4690 0x7fb9b40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:32.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b9c00640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb9b415af60 0x7fb9b40c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:32.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b3e00640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b40cfbf0 0x7fb9b4156f80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00d5f0 tx=0x7fb99c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:32.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b0c00640 1 -- 172.21.15.29:0/601044535 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c0125f0 con 0x7fb9b40cfbf0 2024-01-24T13:05:32.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b0c00640 1 -- 172.21.15.29:0/601044535 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99c012750 con 0x7fb9b40cfbf0 2024-01-24T13:05:32.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9b0c00640 1 -- 172.21.15.29:0/601044535 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c012ae0 con 0x7fb9b40cfbf0 2024-01-24T13:05:32.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9bbc00640 1 -- 172.21.15.29:0/601044535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b40c9230 con 0x7fb9b40cfbf0 2024-01-24T13:05:32.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.158+0000 7fb9bbc00640 1 -- 172.21.15.29:0/601044535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b4157c80 con 0x7fb9b40cfbf0 2024-01-24T13:05:32.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.162+0000 7fb9bbc00640 1 -- 172.21.15.29:0/601044535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b404e850 con 0x7fb9b40cfbf0 2024-01-24T13:05:32.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.162+0000 7fb9b0c00640 1 -- 172.21.15.29:0/601044535 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb99c012c40 con 0x7fb9b40cfbf0 2024-01-24T13:05:32.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.162+0000 7fb9b0c00640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb98c065a60 0x7fb98c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.162+0000 7fb9b0c00640 1 -- 172.21.15.29:0/601044535 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb99c083870 con 0x7fb9b40cfbf0 2024-01-24T13:05:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.162+0000 7fb9b9200640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb98c065a60 0x7fb98c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.166+0000 7fb9b9200640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb98c065a60 0x7fb98c067f20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40ad000 tx=0x7fb9a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:32.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.166+0000 7fb9b0c00640 1 -- 172.21.15.29:0/601044535 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb99c051050 con 0x7fb9b40cfbf0 2024-01-24T13:05:32.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.322+0000 7fb9bbc00640 1 -- 172.21.15.29:0/601044535 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9b41650b0 con 0x7fb98c065a60 2024-01-24T13:05:32.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.330+0000 7fb9b0c00640 1 -- 172.21.15.29:0/601044535 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289393 (secure 0 0 0) 0x7fb9a40bb090 con 0x7fb98c065a60 2024-01-24T13:05:32.337 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:32.339 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:05:32.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.334+0000 7fb9bbc00640 1 -- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb98c065a60 msgr2=0x7fb98c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.334+0000 7fb9bbc00640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb98c065a60 0x7fb98c067f20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40ad000 tx=0x7fb9a4008040 comp rx=0 tx=0).stop 2024-01-24T13:05:32.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.334+0000 7fb9bbc00640 1 -- 172.21.15.29:0/601044535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b40cfbf0 msgr2=0x7fb9b4156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.334+0000 7fb9bbc00640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b40cfbf0 0x7fb9b4156f80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00d5f0 tx=0x7fb99c00dab0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.334+0000 7fb9bbc00640 1 -- 172.21.15.29:0/601044535 shutdown_connections 2024-01-24T13:05:32.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.334+0000 7fb9bbc00640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb98c065a60 0x7fb98c067f20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.334+0000 7fb9bbc00640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb9b415af60 0x7fb9b40c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.334+0000 7fb9bbc00640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b40cfbf0 0x7fb9b4156f80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.334+0000 7fb9bbc00640 1 --2- 172.21.15.29:0/601044535 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb9b40c4690 0x7fb9b40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.334+0000 7fb9bbc00640 1 -- 172.21.15.29:0/601044535 >> 172.21.15.29:0/601044535 conn(0x7fb9b406b1e0 msgr2=0x7fb9b40afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:32.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.334+0000 7fb9bbc00640 1 -- 172.21.15.29:0/601044535 shutdown_connections 2024-01-24T13:05:32.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.334+0000 7fb9bbc00640 1 -- 172.21.15.29:0/601044535 wait complete. 2024-01-24T13:05:32.358 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-01-24T13:05:31.561024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229440,"kb_used_data":5064,"kb_used_omap":13,"kb_used_meta":224242,"kb_avail":754745280,"statfs":{"total":773094113280,"available":772859166720,"internally_reserved":0,"allocated":5185536,"data_stored":2869660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":229623896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.346431"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225108+0000","last_change":"2024-01-24T13:05:23.242395+0000","last_active":"2024-01-24T13:05:24.225108+0000","last_peered":"2024-01-24T13:05:24.225108+0000","last_clean":"2024-01-24T13:05:24.225108+0000","last_became_active":"2024-01-24T13:05:23.242095+0000","last_became_peered":"2024-01-24T13:05:23.242095+0000","last_unstale":"2024-01-24T13:05:24.225108+0000","last_undegraded":"2024-01-24T13:05:24.225108+0000","last_fullsized":"2024-01-24T13:05:24.225108+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:43:58.481651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227851+0000","last_change":"2024-01-24T13:05:23.245366+0000","last_active":"2024-01-24T13:05:24.227851+0000","last_peered":"2024-01-24T13:05:24.227851+0000","last_clean":"2024-01-24T13:05:24.227851+0000","last_became_active":"2024-01-24T13:05:23.245095+0000","last_became_peered":"2024-01-24T13:05:23.245095+0000","last_unstale":"2024-01-24T13:05:24.227851+0000","last_undegraded":"2024-01-24T13:05:24.227851+0000","last_fullsized":"2024-01-24T13:05:24.227851+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:16.104378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224168+0000","last_change":"2024-01-24T13:05:23.231177+0000","last_active":"2024-01-24T13:05:24.224168+0000","last_peered":"2024-01-24T13:05:24.224168+0000","last_clean":"2024-01-24T13:05:24.224168+0000","last_became_active":"2024-01-24T13:05:23.230893+0000","last_became_peered":"2024-01-24T13:05:23.230893+0000","last_unstale":"2024-01-24T13:05:24.224168+0000","last_undegraded":"2024-01-24T13:05:24.224168+0000","last_fullsized":"2024-01-24T13:05:24.224168+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:00:24.120232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224943+0000","last_change":"2024-01-24T13:05:23.239610+0000","last_active":"2024-01-24T13:05:24.224943+0000","last_peered":"2024-01-24T13:05:24.224943+0000","last_clean":"2024-01-24T13:05:24.224943+0000","last_became_active":"2024-01-24T13:05:23.239167+0000","last_became_peered":"2024-01-24T13:05:23.239167+0000","last_unstale":"2024-01-24T13:05:24.224943+0000","last_undegraded":"2024-01-24T13:05:24.224943+0000","last_fullsized":"2024-01-24T13:05:24.224943+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:31:24.660349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.226565+0000","last_change":"2024-01-24T13:05:23.249921+0000","last_active":"2024-01-24T13:05:24.226565+0000","last_peered":"2024-01-24T13:05:24.226565+0000","last_clean":"2024-01-24T13:05:24.226565+0000","last_became_active":"2024-01-24T13:05:23.249701+0000","last_became_peered":"2024-01-24T13:05:23.249701+0000","last_unstale":"2024-01-24T13:05:24.226565+0000","last_undegraded":"2024-01-24T13:05:24.226565+0000","last_fullsized":"2024-01-24T13:05:24.226565+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:27.701058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227479+0000","last_change":"2024-01-24T13:05:23.244210+0000","last_active":"2024-01-24T13:05:24.227479+0000","last_peered":"2024-01-24T13:05:24.227479+0000","last_clean":"2024-01-24T13:05:24.227479+0000","last_became_active":"2024-01-24T13:05:23.243932+0000","last_became_peered":"2024-01-24T13:05:23.243932+0000","last_unstale":"2024-01-24T13:05:24.227479+0000","last_undegraded":"2024-01-24T13:05:24.227479+0000","last_fullsized":"2024-01-24T13:05:24.227479+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:06.413047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225562+0000","last_change":"2024-01-24T13:05:23.243902+0000","last_active":"2024-01-24T13:05:24.225562+0000","last_peered":"2024-01-24T13:05:24.225562+0000","last_clean":"2024-01-24T13:05:24.225562+0000","last_became_active":"2024-01-24T13:05:23.243639+0000","last_became_peered":"2024-01-24T13:05:23.243639+0000","last_unstale":"2024-01-24T13:05:24.225562+0000","last_undegraded":"2024-01-24T13:05:24.225562+0000","last_fullsized":"2024-01-24T13:05:24.225562+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:49:08.693045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225523+0000","last_change":"2024-01-24T13:05:23.241501+0000","last_active":"2024-01-24T13:05:24.225523+0000","last_peered":"2024-01-24T13:05:24.225523+0000","last_clean":"2024-01-24T13:05:24.225523+0000","last_became_active":"2024-01-24T13:05:23.241225+0000","last_became_peered":"2024-01-24T13:05:23.241225+0000","last_unstale":"2024-01-24T13:05:24.225523+0000","last_undegraded":"2024-01-24T13:05:24.225523+0000","last_fullsized":"2024-01-24T13:05:24.225523+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:52:02.970343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.226943+0000","last_change":"2024-01-24T13:05:23.247497+0000","last_active":"2024-01-24T13:05:24.226943+0000","last_peered":"2024-01-24T13:05:24.226943+0000","last_clean":"2024-01-24T13:05:24.226943+0000","last_became_active":"2024-01-24T13:05:23.247134+0000","last_became_peered":"2024-01-24T13:05:23.247134+0000","last_unstale":"2024-01-24T13:05:24.226943+0000","last_undegraded":"2024-01-24T13:05:24.226943+0000","last_fullsized":"2024-01-24T13:05:24.226943+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:17:48.275893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.226318+0000","last_change":"2024-01-24T13:05:23.244027+0000","last_active":"2024-01-24T13:05:24.226318+0000","last_peered":"2024-01-24T13:05:24.226318+0000","last_clean":"2024-01-24T13:05:24.226318+0000","last_became_active":"2024-01-24T13:05:23.243576+0000","last_became_peered":"2024-01-24T13:05:23.243576+0000","last_unstale":"2024-01-24T13:05:24.226318+0000","last_undegraded":"2024-01-24T13:05:24.226318+0000","last_fullsized":"2024-01-24T13:05:24.226318+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:04:29.119741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225951+0000","last_change":"2024-01-24T13:05:23.233541+0000","last_active":"2024-01-24T13:05:24.225951+0000","last_peered":"2024-01-24T13:05:24.225951+0000","last_clean":"2024-01-24T13:05:24.225951+0000","last_became_active":"2024-01-24T13:05:23.231815+0000","last_became_peered":"2024-01-24T13:05:23.231815+0000","last_unstale":"2024-01-24T13:05:24.225951+0000","last_undegraded":"2024-01-24T13:05:24.225951+0000","last_fullsized":"2024-01-24T13:05:24.225951+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:16.104378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.226623+0000","last_change":"2024-01-24T13:05:23.245746+0000","last_active":"2024-01-24T13:05:24.226623+0000","last_peered":"2024-01-24T13:05:24.226623+0000","last_clean":"2024-01-24T13:05:24.226623+0000","last_became_active":"2024-01-24T13:05:23.245455+0000","last_became_peered":"2024-01-24T13:05:23.245455+0000","last_unstale":"2024-01-24T13:05:24.226623+0000","last_undegraded":"2024-01-24T13:05:24.226623+0000","last_fullsized":"2024-01-24T13:05:24.226623+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:38:41.783979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225987+0000","last_change":"2024-01-24T13:05:23.236613+0000","last_active":"2024-01-24T13:05:24.225987+0000","last_peered":"2024-01-24T13:05:24.225987+0000","last_clean":"2024-01-24T13:05:24.225987+0000","last_became_active":"2024-01-24T13:05:23.236237+0000","last_became_peered":"2024-01-24T13:05:23.236237+0000","last_unstale":"2024-01-24T13:05:24.225987+0000","last_undegraded":"2024-01-24T13:05:24.225987+0000","last_fullsized":"2024-01-24T13:05:24.225987+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:27:59.567092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.221410+0000","last_change":"2024-01-24T13:05:23.238536+0000","last_active":"2024-01-24T13:05:24.221410+0000","last_peered":"2024-01-24T13:05:24.221410+0000","last_clean":"2024-01-24T13:05:24.221410+0000","last_became_active":"2024-01-24T13:05:23.238248+0000","last_became_peered":"2024-01-24T13:05:23.238248+0000","last_unstale":"2024-01-24T13:05:24.221410+0000","last_undegraded":"2024-01-24T13:05:24.221410+0000","last_fullsized":"2024-01-24T13:05:24.221410+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:41:47.429016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227081+0000","last_change":"2024-01-24T13:05:23.244110+0000","last_active":"2024-01-24T13:05:24.227081+0000","last_peered":"2024-01-24T13:05:24.227081+0000","last_clean":"2024-01-24T13:05:24.227081+0000","last_became_active":"2024-01-24T13:05:23.243768+0000","last_became_peered":"2024-01-24T13:05:23.243768+0000","last_unstale":"2024-01-24T13:05:24.227081+0000","last_undegraded":"2024-01-24T13:05:24.227081+0000","last_fullsized":"2024-01-24T13:05:24.227081+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:24:03.454000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225476+0000","last_change":"2024-01-24T13:05:23.232945+0000","last_active":"2024-01-24T13:05:24.225476+0000","last_peered":"2024-01-24T13:05:24.225476+0000","last_clean":"2024-01-24T13:05:24.225476+0000","last_became_active":"2024-01-24T13:05:23.232702+0000","last_became_peered":"2024-01-24T13:05:23.232702+0000","last_unstale":"2024-01-24T13:05:24.225476+0000","last_undegraded":"2024-01-24T13:05:24.225476+0000","last_fullsized":"2024-01-24T13:05:24.225476+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:17:48.275893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227680+0000","last_change":"2024-01-24T13:05:23.230569+0000","last_active":"2024-01-24T13:05:24.227680+0000","last_peered":"2024-01-24T13:05:24.227680+0000","last_clean":"2024-01-24T13:05:24.227680+0000","last_became_active":"2024-01-24T13:05:23.230304+0000","last_became_peered":"2024-01-24T13:05:23.230304+0000","last_unstale":"2024-01-24T13:05:24.227680+0000","last_undegraded":"2024-01-24T13:05:24.227680+0000","last_fullsized":"2024-01-24T13:05:24.227680+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:46:47.176988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227535+0000","last_change":"2024-01-24T13:05:23.238377+0000","last_active":"2024-01-24T13:05:24.227535+0000","last_peered":"2024-01-24T13:05:24.227535+0000","last_clean":"2024-01-24T13:05:24.227535+0000","last_became_active":"2024-01-24T13:05:23.232622+0000","last_became_peered":"2024-01-24T13:05:23.232622+0000","last_unstale":"2024-01-24T13:05:24.227535+0000","last_undegraded":"2024-01-24T13:05:24.227535+0000","last_fullsized":"2024-01-24T13:05:24.227535+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:40:20.928955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224078+0000","last_change":"2024-01-24T13:05:23.236305+0000","last_active":"2024-01-24T13:05:24.224078+0000","last_peered":"2024-01-24T13:05:24.224078+0000","last_clean":"2024-01-24T13:05:24.224078+0000","last_became_active":"2024-01-24T13:05:23.234966+0000","last_became_peered":"2024-01-24T13:05:23.234966+0000","last_unstale":"2024-01-24T13:05:24.224078+0000","last_undegraded":"2024-01-24T13:05:24.224078+0000","last_fullsized":"2024-01-24T13:05:24.224078+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:34:04.521864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225111+0000","last_change":"2024-01-24T13:05:23.238723+0000","last_active":"2024-01-24T13:05:24.225111+0000","last_peered":"2024-01-24T13:05:24.225111+0000","last_clean":"2024-01-24T13:05:24.225111+0000","last_became_active":"2024-01-24T13:05:23.238326+0000","last_became_peered":"2024-01-24T13:05:23.238326+0000","last_unstale":"2024-01-24T13:05:24.225111+0000","last_undegraded":"2024-01-24T13:05:24.225111+0000","last_fullsized":"2024-01-24T13:05:24.225111+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:38:52.641045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225337+0000","last_change":"2024-01-24T13:05:23.236244+0000","last_active":"2024-01-24T13:05:24.225337+0000","last_peered":"2024-01-24T13:05:24.225337+0000","last_clean":"2024-01-24T13:05:24.225337+0000","last_became_active":"2024-01-24T13:05:23.235769+0000","last_became_peered":"2024-01-24T13:05:23.235769+0000","last_unstale":"2024-01-24T13:05:24.225337+0000","last_undegraded":"2024-01-24T13:05:24.225337+0000","last_fullsized":"2024-01-24T13:05:24.225337+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:55:09.825786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224954+0000","last_change":"2024-01-24T13:05:23.249068+0000","last_active":"2024-01-24T13:05:24.224954+0000","last_peered":"2024-01-24T13:05:24.224954+0000","last_clean":"2024-01-24T13:05:24.224954+0000","last_became_active":"2024-01-24T13:05:23.248795+0000","last_became_peered":"2024-01-24T13:05:23.248795+0000","last_unstale":"2024-01-24T13:05:24.224954+0000","last_undegraded":"2024-01-24T13:05:24.224954+0000","last_fullsized":"2024-01-24T13:05:24.224954+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:01:17.148270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227152+0000","last_change":"2024-01-24T13:05:23.235423+0000","last_active":"2024-01-24T13:05:24.227152+0000","last_peered":"2024-01-24T13:05:24.227152+0000","last_clean":"2024-01-24T13:05:24.227152+0000","last_became_active":"2024-01-24T13:05:23.235213+0000","last_became_peered":"2024-01-24T13:05:23.235213+0000","last_unstale":"2024-01-24T13:05:24.227152+0000","last_undegraded":"2024-01-24T13:05:24.227152+0000","last_fullsized":"2024-01-24T13:05:24.227152+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:09:44.079347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225577+0000","last_change":"2024-01-24T13:05:23.231936+0000","last_active":"2024-01-24T13:05:24.225577+0000","last_peered":"2024-01-24T13:05:24.225577+0000","last_clean":"2024-01-24T13:05:24.225577+0000","last_became_active":"2024-01-24T13:05:23.231444+0000","last_became_peered":"2024-01-24T13:05:23.231444+0000","last_unstale":"2024-01-24T13:05:24.225577+0000","last_undegraded":"2024-01-24T13:05:24.225577+0000","last_fullsized":"2024-01-24T13:05:24.225577+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:29:48.749983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.221772+0000","last_change":"2024-01-24T13:05:23.244263+0000","last_active":"2024-01-24T13:05:24.221772+0000","last_peered":"2024-01-24T13:05:24.221772+0000","last_clean":"2024-01-24T13:05:24.221772+0000","last_became_active":"2024-01-24T13:05:23.243993+0000","last_became_peered":"2024-01-24T13:05:23.243993+0000","last_unstale":"2024-01-24T13:05:24.221772+0000","last_undegraded":"2024-01-24T13:05:24.221772+0000","last_fullsized":"2024-01-24T13:05:24.221772+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:28:06.510389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224395+0000","last_change":"2024-01-24T13:05:23.228536+0000","last_active":"2024-01-24T13:05:24.224395+0000","last_peered":"2024-01-24T13:05:24.224395+0000","last_clean":"2024-01-24T13:05:24.224395+0000","last_became_active":"2024-01-24T13:05:23.228262+0000","last_became_peered":"2024-01-24T13:05:23.228262+0000","last_unstale":"2024-01-24T13:05:24.224395+0000","last_undegraded":"2024-01-24T13:05:24.224395+0000","last_fullsized":"2024-01-24T13:05:24.224395+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:17:07.627565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.226035+0000","last_change":"2024-01-24T13:05:23.234835+0000","last_active":"2024-01-24T13:05:24.226035+0000","last_peered":"2024-01-24T13:05:24.226035+0000","last_clean":"2024-01-24T13:05:24.226035+0000","last_became_active":"2024-01-24T13:05:23.234421+0000","last_became_peered":"2024-01-24T13:05:23.234421+0000","last_unstale":"2024-01-24T13:05:24.226035+0000","last_undegraded":"2024-01-24T13:05:24.226035+0000","last_fullsized":"2024-01-24T13:05:24.226035+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:33:36.474524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.226348+0000","last_change":"2024-01-24T13:05:23.234488+0000","last_active":"2024-01-24T13:05:24.226348+0000","last_peered":"2024-01-24T13:05:24.226348+0000","last_clean":"2024-01-24T13:05:24.226348+0000","last_became_active":"2024-01-24T13:05:23.233640+0000","last_became_peered":"2024-01-24T13:05:23.233640+0000","last_unstale":"2024-01-24T13:05:24.226348+0000","last_undegraded":"2024-01-24T13:05:24.226348+0000","last_fullsized":"2024-01-24T13:05:24.226348+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:30:57.196564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227379+0000","last_change":"2024-01-24T13:05:23.233255+0000","last_active":"2024-01-24T13:05:24.227379+0000","last_peered":"2024-01-24T13:05:24.227379+0000","last_clean":"2024-01-24T13:05:24.227379+0000","last_became_active":"2024-01-24T13:05:23.232992+0000","last_became_peered":"2024-01-24T13:05:23.232992+0000","last_unstale":"2024-01-24T13:05:24.227379+0000","last_undegraded":"2024-01-24T13:05:24.227379+0000","last_fullsized":"2024-01-24T13:05:24.227379+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:49:50.555540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227198+0000","last_change":"2024-01-24T13:05:23.231561+0000","last_active":"2024-01-24T13:05:24.227198+0000","last_peered":"2024-01-24T13:05:24.227198+0000","last_clean":"2024-01-24T13:05:24.227198+0000","last_became_active":"2024-01-24T13:05:23.231304+0000","last_became_peered":"2024-01-24T13:05:23.231304+0000","last_unstale":"2024-01-24T13:05:24.227198+0000","last_undegraded":"2024-01-24T13:05:24.227198+0000","last_fullsized":"2024-01-24T13:05:24.227198+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:06:15.071849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225650+0000","last_change":"2024-01-24T13:05:23.245696+0000","last_active":"2024-01-24T13:05:24.225650+0000","last_peered":"2024-01-24T13:05:24.225650+0000","last_clean":"2024-01-24T13:05:24.225650+0000","last_became_active":"2024-01-24T13:05:23.245430+0000","last_became_peered":"2024-01-24T13:05:23.245430+0000","last_unstale":"2024-01-24T13:05:24.225650+0000","last_undegraded":"2024-01-24T13:05:24.225650+0000","last_fullsized":"2024-01-24T13:05:24.225650+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:03:24.869317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225628+0000","last_change":"2024-01-24T13:05:23.234361+0000","last_active":"2024-01-24T13:05:24.225628+0000","last_peered":"2024-01-24T13:05:24.225628+0000","last_clean":"2024-01-24T13:05:24.225628+0000","last_became_active":"2024-01-24T13:05:23.233607+0000","last_became_peered":"2024-01-24T13:05:23.233607+0000","last_unstale":"2024-01-24T13:05:24.225628+0000","last_undegraded":"2024-01-24T13:05:24.225628+0000","last_fullsized":"2024-01-24T13:05:24.225628+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:44:32.375608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227564+0000","last_change":"2024-01-24T13:05:23.230507+0000","last_active":"2024-01-24T13:05:24.227564+0000","last_peered":"2024-01-24T13:05:24.227564+0000","last_clean":"2024-01-24T13:05:24.227564+0000","last_became_active":"2024-01-24T13:05:23.230239+0000","last_became_peered":"2024-01-24T13:05:23.230239+0000","last_unstale":"2024-01-24T13:05:24.227564+0000","last_undegraded":"2024-01-24T13:05:24.227564+0000","last_fullsized":"2024-01-24T13:05:24.227564+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:27:56.790998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"42'4","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.237596+0000","last_change":"2024-01-24T13:05:22.819762+0000","last_active":"2024-01-24T13:05:23.237596+0000","last_peered":"2024-01-24T13:05:23.237596+0000","last_clean":"2024-01-24T13:05:23.237596+0000","last_became_active":"2024-01-24T13:05:22.819501+0000","last_became_peered":"2024-01-24T13:05:22.819501+0000","last_unstale":"2024-01-24T13:05:23.237596+0000","last_undegraded":"2024-01-24T13:05:23.237596+0000","last_fullsized":"2024-01-24T13:05:23.237596+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:01:16.142279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227699+0000","last_change":"2024-01-24T13:05:23.250652+0000","last_active":"2024-01-24T13:05:24.227699+0000","last_peered":"2024-01-24T13:05:24.227699+0000","last_clean":"2024-01-24T13:05:24.227699+0000","last_became_active":"2024-01-24T13:05:23.250347+0000","last_became_peered":"2024-01-24T13:05:23.250347+0000","last_unstale":"2024-01-24T13:05:24.227699+0000","last_undegraded":"2024-01-24T13:05:24.227699+0000","last_fullsized":"2024-01-24T13:05:24.227699+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:55:09.825786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.244911+0000","last_change":"2024-01-24T13:05:22.810089+0000","last_active":"2024-01-24T13:05:23.244911+0000","last_peered":"2024-01-24T13:05:23.244911+0000","last_clean":"2024-01-24T13:05:23.244911+0000","last_became_active":"2024-01-24T13:05:22.809830+0000","last_became_peered":"2024-01-24T13:05:22.809830+0000","last_unstale":"2024-01-24T13:05:23.244911+0000","last_undegraded":"2024-01-24T13:05:23.244911+0000","last_fullsized":"2024-01-24T13:05:23.244911+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:52:11.442955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227629+0000","last_change":"2024-01-24T13:05:23.232644+0000","last_active":"2024-01-24T13:05:24.227629+0000","last_peered":"2024-01-24T13:05:24.227629+0000","last_clean":"2024-01-24T13:05:24.227629+0000","last_became_active":"2024-01-24T13:05:23.232390+0000","last_became_peered":"2024-01-24T13:05:23.232390+0000","last_unstale":"2024-01-24T13:05:24.227629+0000","last_undegraded":"2024-01-24T13:05:24.227629+0000","last_fullsized":"2024-01-24T13:05:24.227629+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:16:26.887330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.248537+0000","last_change":"2024-01-24T13:05:22.814255+0000","last_active":"2024-01-24T13:05:23.248537+0000","last_peered":"2024-01-24T13:05:23.248537+0000","last_clean":"2024-01-24T13:05:23.248537+0000","last_became_active":"2024-01-24T13:05:22.813172+0000","last_became_peered":"2024-01-24T13:05:22.813172+0000","last_unstale":"2024-01-24T13:05:23.248537+0000","last_undegraded":"2024-01-24T13:05:23.248537+0000","last_fullsized":"2024-01-24T13:05:23.248537+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:44:22.763339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227858+0000","last_change":"2024-01-24T13:05:23.245069+0000","last_active":"2024-01-24T13:05:24.227858+0000","last_peered":"2024-01-24T13:05:24.227858+0000","last_clean":"2024-01-24T13:05:24.227858+0000","last_became_active":"2024-01-24T13:05:23.244771+0000","last_became_peered":"2024-01-24T13:05:23.244771+0000","last_unstale":"2024-01-24T13:05:24.227858+0000","last_undegraded":"2024-01-24T13:05:24.227858+0000","last_fullsized":"2024-01-24T13:05:24.227858+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:38:52.641045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.238050+0000","last_change":"2024-01-24T13:05:22.823960+0000","last_active":"2024-01-24T13:05:23.238050+0000","last_peered":"2024-01-24T13:05:23.238050+0000","last_clean":"2024-01-24T13:05:23.238050+0000","last_became_active":"2024-01-24T13:05:22.823735+0000","last_became_peered":"2024-01-24T13:05:22.823735+0000","last_unstale":"2024-01-24T13:05:23.238050+0000","last_undegraded":"2024-01-24T13:05:23.238050+0000","last_fullsized":"2024-01-24T13:05:23.238050+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:05.407056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225680+0000","last_change":"2024-01-24T13:05:23.229651+0000","last_active":"2024-01-24T13:05:24.225680+0000","last_peered":"2024-01-24T13:05:24.225680+0000","last_clean":"2024-01-24T13:05:24.225680+0000","last_became_active":"2024-01-24T13:05:23.229354+0000","last_became_peered":"2024-01-24T13:05:23.229354+0000","last_unstale":"2024-01-24T13:05:24.225680+0000","last_undegraded":"2024-01-24T13:05:24.225680+0000","last_fullsized":"2024-01-24T13:05:24.225680+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:25:13.248371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.229653+0000","last_change":"2024-01-24T13:05:22.820178+0000","last_active":"2024-01-24T13:05:23.229653+0000","last_peered":"2024-01-24T13:05:23.229653+0000","last_clean":"2024-01-24T13:05:23.229653+0000","last_became_active":"2024-01-24T13:05:22.819904+0000","last_became_peered":"2024-01-24T13:05:22.819904+0000","last_unstale":"2024-01-24T13:05:23.229653+0000","last_undegraded":"2024-01-24T13:05:23.229653+0000","last_fullsized":"2024-01-24T13:05:23.229653+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:33:35.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224867+0000","last_change":"2024-01-24T13:05:23.235181+0000","last_active":"2024-01-24T13:05:24.224867+0000","last_peered":"2024-01-24T13:05:24.224867+0000","last_clean":"2024-01-24T13:05:24.224867+0000","last_became_active":"2024-01-24T13:05:23.234834+0000","last_became_peered":"2024-01-24T13:05:23.234834+0000","last_unstale":"2024-01-24T13:05:24.224867+0000","last_undegraded":"2024-01-24T13:05:24.224867+0000","last_fullsized":"2024-01-24T13:05:24.224867+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:44:23.769330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.233802+0000","last_change":"2024-01-24T13:05:22.816712+0000","last_active":"2024-01-24T13:05:23.233802+0000","last_peered":"2024-01-24T13:05:23.233802+0000","last_clean":"2024-01-24T13:05:23.233802+0000","last_became_active":"2024-01-24T13:05:22.816430+0000","last_became_peered":"2024-01-24T13:05:22.816430+0000","last_unstale":"2024-01-24T13:05:23.233802+0000","last_undegraded":"2024-01-24T13:05:23.233802+0000","last_fullsized":"2024-01-24T13:05:23.233802+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:53:05.828860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227245+0000","last_change":"2024-01-24T13:05:23.231370+0000","last_active":"2024-01-24T13:05:24.227245+0000","last_peered":"2024-01-24T13:05:24.227245+0000","last_clean":"2024-01-24T13:05:24.227245+0000","last_became_active":"2024-01-24T13:05:23.231137+0000","last_became_peered":"2024-01-24T13:05:23.231137+0000","last_unstale":"2024-01-24T13:05:24.227245+0000","last_undegraded":"2024-01-24T13:05:24.227245+0000","last_fullsized":"2024-01-24T13:05:24.227245+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:43:39.685041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.220834+0000","last_change":"2024-01-24T13:05:22.817126+0000","last_active":"2024-01-24T13:05:23.220834+0000","last_peered":"2024-01-24T13:05:23.220834+0000","last_clean":"2024-01-24T13:05:23.220834+0000","last_became_active":"2024-01-24T13:05:22.816762+0000","last_became_peered":"2024-01-24T13:05:22.816762+0000","last_unstale":"2024-01-24T13:05:23.220834+0000","last_undegraded":"2024-01-24T13:05:23.220834+0000","last_fullsized":"2024-01-24T13:05:23.220834+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:33:35.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227683+0000","last_change":"2024-01-24T13:05:23.244643+0000","last_active":"2024-01-24T13:05:24.227683+0000","last_peered":"2024-01-24T13:05:24.227683+0000","last_clean":"2024-01-24T13:05:24.227683+0000","last_became_active":"2024-01-24T13:05:23.244321+0000","last_became_peered":"2024-01-24T13:05:23.244321+0000","last_unstale":"2024-01-24T13:05:24.227683+0000","last_undegraded":"2024-01-24T13:05:24.227683+0000","last_fullsized":"2024-01-24T13:05:24.227683+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:27:58.174230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.211596+0000","last_change":"2024-01-24T13:05:22.824613+0000","last_active":"2024-01-24T13:05:23.211596+0000","last_peered":"2024-01-24T13:05:23.211596+0000","last_clean":"2024-01-24T13:05:23.211596+0000","last_became_active":"2024-01-24T13:05:22.824319+0000","last_became_peered":"2024-01-24T13:05:22.824319+0000","last_unstale":"2024-01-24T13:05:23.211596+0000","last_undegraded":"2024-01-24T13:05:23.211596+0000","last_fullsized":"2024-01-24T13:05:23.211596+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:46:09.885466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225052+0000","last_change":"2024-01-24T13:05:23.239432+0000","last_active":"2024-01-24T13:05:24.225052+0000","last_peered":"2024-01-24T13:05:24.225052+0000","last_clean":"2024-01-24T13:05:24.225052+0000","last_became_active":"2024-01-24T13:05:23.238847+0000","last_became_peered":"2024-01-24T13:05:23.238847+0000","last_unstale":"2024-01-24T13:05:24.225052+0000","last_undegraded":"2024-01-24T13:05:24.225052+0000","last_fullsized":"2024-01-24T13:05:24.225052+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:22:20.937158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.221080+0000","last_change":"2024-01-24T13:05:22.813485+0000","last_active":"2024-01-24T13:05:23.221080+0000","last_peered":"2024-01-24T13:05:23.221080+0000","last_clean":"2024-01-24T13:05:23.221080+0000","last_became_active":"2024-01-24T13:05:22.813197+0000","last_became_peered":"2024-01-24T13:05:22.813197+0000","last_unstale":"2024-01-24T13:05:23.221080+0000","last_undegraded":"2024-01-24T13:05:23.221080+0000","last_fullsized":"2024-01-24T13:05:23.221080+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:01:16.142279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.221605+0000","last_change":"2024-01-24T13:05:23.228801+0000","last_active":"2024-01-24T13:05:24.221605+0000","last_peered":"2024-01-24T13:05:24.221605+0000","last_clean":"2024-01-24T13:05:24.221605+0000","last_became_active":"2024-01-24T13:05:23.228507+0000","last_became_peered":"2024-01-24T13:05:23.228507+0000","last_unstale":"2024-01-24T13:05:24.221605+0000","last_undegraded":"2024-01-24T13:05:24.221605+0000","last_fullsized":"2024-01-24T13:05:24.221605+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:27:58.174230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.218013+0000","last_change":"2024-01-24T13:05:22.814845+0000","last_active":"2024-01-24T13:05:23.218013+0000","last_peered":"2024-01-24T13:05:23.218013+0000","last_clean":"2024-01-24T13:05:23.218013+0000","last_became_active":"2024-01-24T13:05:22.814243+0000","last_became_peered":"2024-01-24T13:05:22.814243+0000","last_unstale":"2024-01-24T13:05:23.218013+0000","last_undegraded":"2024-01-24T13:05:23.218013+0000","last_fullsized":"2024-01-24T13:05:23.218013+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:56:22.964132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224493+0000","last_change":"2024-01-24T13:05:23.233158+0000","last_active":"2024-01-24T13:05:24.224493+0000","last_peered":"2024-01-24T13:05:24.224493+0000","last_clean":"2024-01-24T13:05:24.224493+0000","last_became_active":"2024-01-24T13:05:23.232847+0000","last_became_peered":"2024-01-24T13:05:23.232847+0000","last_unstale":"2024-01-24T13:05:24.224493+0000","last_undegraded":"2024-01-24T13:05:24.224493+0000","last_fullsized":"2024-01-24T13:05:24.224493+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:59:13.513100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"42'3","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.235458+0000","last_change":"2024-01-24T13:05:22.815456+0000","last_active":"2024-01-24T13:05:23.235458+0000","last_peered":"2024-01-24T13:05:23.235458+0000","last_clean":"2024-01-24T13:05:23.235458+0000","last_became_active":"2024-01-24T13:05:22.815188+0000","last_became_peered":"2024-01-24T13:05:22.815188+0000","last_unstale":"2024-01-24T13:05:23.235458+0000","last_undegraded":"2024-01-24T13:05:23.235458+0000","last_fullsized":"2024-01-24T13:05:23.235458+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:43:57.475660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.226338+0000","last_change":"2024-01-24T13:05:23.243608+0000","last_active":"2024-01-24T13:05:24.226338+0000","last_peered":"2024-01-24T13:05:24.226338+0000","last_clean":"2024-01-24T13:05:24.226338+0000","last_became_active":"2024-01-24T13:05:23.243336+0000","last_became_peered":"2024-01-24T13:05:23.243336+0000","last_unstale":"2024-01-24T13:05:24.226338+0000","last_undegraded":"2024-01-24T13:05:24.226338+0000","last_fullsized":"2024-01-24T13:05:24.226338+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:38:27.772391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"42'6","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.251669+0000","last_change":"2024-01-24T13:05:22.820695+0000","last_active":"2024-01-24T13:05:23.251669+0000","last_peered":"2024-01-24T13:05:23.251669+0000","last_clean":"2024-01-24T13:05:23.251669+0000","last_became_active":"2024-01-24T13:05:22.820302+0000","last_became_peered":"2024-01-24T13:05:22.820302+0000","last_unstale":"2024-01-24T13:05:23.251669+0000","last_undegraded":"2024-01-24T13:05:23.251669+0000","last_fullsized":"2024-01-24T13:05:23.251669+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:38:51.635054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225727+0000","last_change":"2024-01-24T13:05:23.227399+0000","last_active":"2024-01-24T13:05:24.225727+0000","last_peered":"2024-01-24T13:05:24.225727+0000","last_clean":"2024-01-24T13:05:24.225727+0000","last_became_active":"2024-01-24T13:05:23.226544+0000","last_became_peered":"2024-01-24T13:05:23.226544+0000","last_unstale":"2024-01-24T13:05:24.225727+0000","last_undegraded":"2024-01-24T13:05:24.225727+0000","last_fullsized":"2024-01-24T13:05:24.225727+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:52:09.105890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.248074+0000","last_change":"2024-01-24T13:05:22.821209+0000","last_active":"2024-01-24T13:05:23.248074+0000","last_peered":"2024-01-24T13:05:23.248074+0000","last_clean":"2024-01-24T13:05:23.248074+0000","last_became_active":"2024-01-24T13:05:22.820899+0000","last_became_peered":"2024-01-24T13:05:22.820899+0000","last_unstale":"2024-01-24T13:05:23.248074+0000","last_undegraded":"2024-01-24T13:05:23.248074+0000","last_fullsized":"2024-01-24T13:05:23.248074+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:52.859781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227302+0000","last_change":"2024-01-24T13:05:23.247469+0000","last_active":"2024-01-24T13:05:24.227302+0000","last_peered":"2024-01-24T13:05:24.227302+0000","last_clean":"2024-01-24T13:05:24.227302+0000","last_became_active":"2024-01-24T13:05:23.247186+0000","last_became_peered":"2024-01-24T13:05:23.247186+0000","last_unstale":"2024-01-24T13:05:24.227302+0000","last_undegraded":"2024-01-24T13:05:24.227302+0000","last_fullsized":"2024-01-24T13:05:24.227302+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:41:47.429016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.236091+0000","last_change":"2024-01-24T13:05:22.814948+0000","last_active":"2024-01-24T13:05:23.236091+0000","last_peered":"2024-01-24T13:05:23.236091+0000","last_clean":"2024-01-24T13:05:23.236091+0000","last_became_active":"2024-01-24T13:05:22.814648+0000","last_became_peered":"2024-01-24T13:05:22.814648+0000","last_unstale":"2024-01-24T13:05:23.236091+0000","last_undegraded":"2024-01-24T13:05:23.236091+0000","last_fullsized":"2024-01-24T13:05:23.236091+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:08:11.324387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225208+0000","last_change":"2024-01-24T13:05:23.241894+0000","last_active":"2024-01-24T13:05:24.225208+0000","last_peered":"2024-01-24T13:05:24.225208+0000","last_clean":"2024-01-24T13:05:24.225208+0000","last_became_active":"2024-01-24T13:05:23.241606+0000","last_became_peered":"2024-01-24T13:05:23.241606+0000","last_unstale":"2024-01-24T13:05:24.225208+0000","last_undegraded":"2024-01-24T13:05:24.225208+0000","last_fullsized":"2024-01-24T13:05:24.225208+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:09:58.288993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.217750+0000","last_change":"2024-01-24T13:05:22.820292+0000","last_active":"2024-01-24T13:05:23.217750+0000","last_peered":"2024-01-24T13:05:23.217750+0000","last_clean":"2024-01-24T13:05:23.217750+0000","last_became_active":"2024-01-24T13:05:22.819936+0000","last_became_peered":"2024-01-24T13:05:22.819936+0000","last_unstale":"2024-01-24T13:05:23.217750+0000","last_undegraded":"2024-01-24T13:05:23.217750+0000","last_fullsized":"2024-01-24T13:05:23.217750+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:37:28.187706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.226553+0000","last_change":"2024-01-24T13:05:23.245943+0000","last_active":"2024-01-24T13:05:24.226553+0000","last_peered":"2024-01-24T13:05:24.226553+0000","last_clean":"2024-01-24T13:05:24.226553+0000","last_became_active":"2024-01-24T13:05:23.245503+0000","last_became_peered":"2024-01-24T13:05:23.245503+0000","last_unstale":"2024-01-24T13:05:24.226553+0000","last_undegraded":"2024-01-24T13:05:24.226553+0000","last_fullsized":"2024-01-24T13:05:24.226553+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:52:12.448946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"42'8","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.242817+0000","last_change":"2024-01-24T13:05:22.820821+0000","last_active":"2024-01-24T13:05:23.242817+0000","last_peered":"2024-01-24T13:05:23.242817+0000","last_clean":"2024-01-24T13:05:23.242817+0000","last_became_active":"2024-01-24T13:05:22.820470+0000","last_became_peered":"2024-01-24T13:05:22.820470+0000","last_unstale":"2024-01-24T13:05:23.242817+0000","last_undegraded":"2024-01-24T13:05:23.242817+0000","last_fullsized":"2024-01-24T13:05:23.242817+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:44:22.763339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227575+0000","last_change":"2024-01-24T13:05:23.246612+0000","last_active":"2024-01-24T13:05:24.227575+0000","last_peered":"2024-01-24T13:05:24.227575+0000","last_clean":"2024-01-24T13:05:24.227575+0000","last_became_active":"2024-01-24T13:05:23.246295+0000","last_became_peered":"2024-01-24T13:05:23.246295+0000","last_unstale":"2024-01-24T13:05:24.227575+0000","last_undegraded":"2024-01-24T13:05:24.227575+0000","last_fullsized":"2024-01-24T13:05:24.227575+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:28:06.510389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.235106+0000","last_change":"2024-01-24T13:05:22.825412+0000","last_active":"2024-01-24T13:05:23.235106+0000","last_peered":"2024-01-24T13:05:23.235106+0000","last_clean":"2024-01-24T13:05:23.235106+0000","last_became_active":"2024-01-24T13:05:22.825132+0000","last_became_peered":"2024-01-24T13:05:22.825132+0000","last_unstale":"2024-01-24T13:05:23.235106+0000","last_undegraded":"2024-01-24T13:05:23.235106+0000","last_fullsized":"2024-01-24T13:05:23.235106+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:32.634926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.226164+0000","last_change":"2024-01-24T13:05:23.231023+0000","last_active":"2024-01-24T13:05:24.226164+0000","last_peered":"2024-01-24T13:05:24.226164+0000","last_clean":"2024-01-24T13:05:24.226164+0000","last_became_active":"2024-01-24T13:05:23.230776+0000","last_became_peered":"2024-01-24T13:05:23.230776+0000","last_unstale":"2024-01-24T13:05:24.226164+0000","last_undegraded":"2024-01-24T13:05:24.226164+0000","last_fullsized":"2024-01-24T13:05:24.226164+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:37:15.673648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.242061+0000","last_change":"2024-01-24T13:05:22.814995+0000","last_active":"2024-01-24T13:05:23.242061+0000","last_peered":"2024-01-24T13:05:23.242061+0000","last_clean":"2024-01-24T13:05:23.242061+0000","last_became_active":"2024-01-24T13:05:22.814603+0000","last_became_peered":"2024-01-24T13:05:22.814603+0000","last_unstale":"2024-01-24T13:05:23.242061+0000","last_undegraded":"2024-01-24T13:05:23.242061+0000","last_fullsized":"2024-01-24T13:05:23.242061+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:52:37.909722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.226416+0000","last_change":"2024-01-24T13:05:23.243825+0000","last_active":"2024-01-24T13:05:24.226416+0000","last_peered":"2024-01-24T13:05:24.226416+0000","last_clean":"2024-01-24T13:05:24.226416+0000","last_became_active":"2024-01-24T13:05:23.243199+0000","last_became_peered":"2024-01-24T13:05:23.243199+0000","last_unstale":"2024-01-24T13:05:24.226416+0000","last_undegraded":"2024-01-24T13:05:24.226416+0000","last_fullsized":"2024-01-24T13:05:24.226416+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:10:49.535439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"42'1","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.249402+0000","last_change":"2024-01-24T13:05:22.817887+0000","last_active":"2024-01-24T13:05:23.249402+0000","last_peered":"2024-01-24T13:05:23.249402+0000","last_clean":"2024-01-24T13:05:23.249402+0000","last_became_active":"2024-01-24T13:05:22.817630+0000","last_became_peered":"2024-01-24T13:05:22.817630+0000","last_unstale":"2024-01-24T13:05:23.249402+0000","last_undegraded":"2024-01-24T13:05:23.249402+0000","last_fullsized":"2024-01-24T13:05:23.249402+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:38:10.129854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224224+0000","last_change":"2024-01-24T13:05:23.236304+0000","last_active":"2024-01-24T13:05:24.224224+0000","last_peered":"2024-01-24T13:05:24.224224+0000","last_clean":"2024-01-24T13:05:24.224224+0000","last_became_active":"2024-01-24T13:05:23.235114+0000","last_became_peered":"2024-01-24T13:05:23.235114+0000","last_unstale":"2024-01-24T13:05:24.224224+0000","last_undegraded":"2024-01-24T13:05:24.224224+0000","last_fullsized":"2024-01-24T13:05:24.224224+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:36:46.585321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224224+0000","last_change":"2024-01-24T13:05:22.816414+0000","last_active":"2024-01-24T13:05:24.224224+0000","last_peered":"2024-01-24T13:05:24.224224+0000","last_clean":"2024-01-24T13:05:24.224224+0000","last_became_active":"2024-01-24T13:05:22.816149+0000","last_became_peered":"2024-01-24T13:05:22.816149+0000","last_unstale":"2024-01-24T13:05:24.224224+0000","last_undegraded":"2024-01-24T13:05:24.224224+0000","last_fullsized":"2024-01-24T13:05:24.224224+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:34:54.259224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227080+0000","last_change":"2024-01-24T13:05:23.236939+0000","last_active":"2024-01-24T13:05:24.227080+0000","last_peered":"2024-01-24T13:05:24.227080+0000","last_clean":"2024-01-24T13:05:24.227080+0000","last_became_active":"2024-01-24T13:05:23.236685+0000","last_became_peered":"2024-01-24T13:05:23.236685+0000","last_unstale":"2024-01-24T13:05:24.227080+0000","last_undegraded":"2024-01-24T13:05:24.227080+0000","last_fullsized":"2024-01-24T13:05:24.227080+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:53:52.646656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224075+0000","last_change":"2024-01-24T13:05:22.811435+0000","last_active":"2024-01-24T13:05:24.224075+0000","last_peered":"2024-01-24T13:05:24.224075+0000","last_clean":"2024-01-24T13:05:24.224075+0000","last_became_active":"2024-01-24T13:05:22.811126+0000","last_became_peered":"2024-01-24T13:05:22.811126+0000","last_unstale":"2024-01-24T13:05:24.224075+0000","last_undegraded":"2024-01-24T13:05:24.224075+0000","last_fullsized":"2024-01-24T13:05:24.224075+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:45:33.745161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224097+0000","last_change":"2024-01-24T13:05:23.234000+0000","last_active":"2024-01-24T13:05:24.224097+0000","last_peered":"2024-01-24T13:05:24.224097+0000","last_clean":"2024-01-24T13:05:24.224097+0000","last_became_active":"2024-01-24T13:05:23.233444+0000","last_became_peered":"2024-01-24T13:05:23.233444+0000","last_unstale":"2024-01-24T13:05:24.224097+0000","last_undegraded":"2024-01-24T13:05:24.224097+0000","last_fullsized":"2024-01-24T13:05:24.224097+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:20:22.793012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.236203+0000","last_change":"2024-01-24T13:05:22.823648+0000","last_active":"2024-01-24T13:05:23.236203+0000","last_peered":"2024-01-24T13:05:23.236203+0000","last_clean":"2024-01-24T13:05:23.236203+0000","last_became_active":"2024-01-24T13:05:22.823445+0000","last_became_peered":"2024-01-24T13:05:22.823445+0000","last_unstale":"2024-01-24T13:05:23.236203+0000","last_undegraded":"2024-01-24T13:05:23.236203+0000","last_fullsized":"2024-01-24T13:05:23.236203+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:26.695067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225111+0000","last_change":"2024-01-24T13:05:23.240939+0000","last_active":"2024-01-24T13:05:24.225111+0000","last_peered":"2024-01-24T13:05:24.225111+0000","last_clean":"2024-01-24T13:05:24.225111+0000","last_became_active":"2024-01-24T13:05:23.240543+0000","last_became_peered":"2024-01-24T13:05:23.240543+0000","last_unstale":"2024-01-24T13:05:24.225111+0000","last_undegraded":"2024-01-24T13:05:24.225111+0000","last_fullsized":"2024-01-24T13:05:24.225111+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:06.413047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.211916+0000","last_change":"2024-01-24T13:05:22.824250+0000","last_active":"2024-01-24T13:05:23.211916+0000","last_peered":"2024-01-24T13:05:23.211916+0000","last_clean":"2024-01-24T13:05:23.211916+0000","last_became_active":"2024-01-24T13:05:22.823935+0000","last_became_peered":"2024-01-24T13:05:22.823935+0000","last_unstale":"2024-01-24T13:05:23.211916+0000","last_undegraded":"2024-01-24T13:05:23.211916+0000","last_fullsized":"2024-01-24T13:05:23.211916+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:55:28.106943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224395+0000","last_change":"2024-01-24T13:05:23.236647+0000","last_active":"2024-01-24T13:05:24.224395+0000","last_peered":"2024-01-24T13:05:24.224395+0000","last_clean":"2024-01-24T13:05:24.224395+0000","last_became_active":"2024-01-24T13:05:23.235864+0000","last_became_peered":"2024-01-24T13:05:23.235864+0000","last_unstale":"2024-01-24T13:05:24.224395+0000","last_undegraded":"2024-01-24T13:05:24.224395+0000","last_fullsized":"2024-01-24T13:05:24.224395+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:13:01.988414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.226969+0000","last_change":"2024-01-24T13:05:22.822889+0000","last_active":"2024-01-24T13:05:23.226969+0000","last_peered":"2024-01-24T13:05:23.226969+0000","last_clean":"2024-01-24T13:05:23.226969+0000","last_became_active":"2024-01-24T13:05:22.822551+0000","last_became_peered":"2024-01-24T13:05:22.822551+0000","last_unstale":"2024-01-24T13:05:23.226969+0000","last_undegraded":"2024-01-24T13:05:23.226969+0000","last_fullsized":"2024-01-24T13:05:23.226969+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:38:40.777988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.226719+0000","last_change":"2024-01-24T13:05:23.250910+0000","last_active":"2024-01-24T13:05:24.226719+0000","last_peered":"2024-01-24T13:05:24.226719+0000","last_clean":"2024-01-24T13:05:24.226719+0000","last_became_active":"2024-01-24T13:05:23.250605+0000","last_became_peered":"2024-01-24T13:05:23.250605+0000","last_unstale":"2024-01-24T13:05:24.226719+0000","last_undegraded":"2024-01-24T13:05:24.226719+0000","last_fullsized":"2024-01-24T13:05:24.226719+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:08:12.330378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"42'2","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.238423+0000","last_change":"2024-01-24T13:05:22.808403+0000","last_active":"2024-01-24T13:05:23.238423+0000","last_peered":"2024-01-24T13:05:23.238423+0000","last_clean":"2024-01-24T13:05:23.238423+0000","last_became_active":"2024-01-24T13:05:22.807167+0000","last_became_peered":"2024-01-24T13:05:22.807167+0000","last_unstale":"2024-01-24T13:05:23.238423+0000","last_undegraded":"2024-01-24T13:05:23.238423+0000","last_fullsized":"2024-01-24T13:05:23.238423+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:58:04.657760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.226119+0000","last_change":"2024-01-24T13:05:23.230525+0000","last_active":"2024-01-24T13:05:24.226119+0000","last_peered":"2024-01-24T13:05:24.226119+0000","last_clean":"2024-01-24T13:05:24.226119+0000","last_became_active":"2024-01-24T13:05:23.230256+0000","last_became_peered":"2024-01-24T13:05:23.230256+0000","last_unstale":"2024-01-24T13:05:24.226119+0000","last_undegraded":"2024-01-24T13:05:24.226119+0000","last_fullsized":"2024-01-24T13:05:24.226119+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:53.865772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.226737+0000","last_change":"2024-01-24T13:05:22.820219+0000","last_active":"2024-01-24T13:05:24.226737+0000","last_peered":"2024-01-24T13:05:24.226737+0000","last_clean":"2024-01-24T13:05:24.226737+0000","last_became_active":"2024-01-24T13:05:22.819925+0000","last_became_peered":"2024-01-24T13:05:22.819925+0000","last_unstale":"2024-01-24T13:05:24.226737+0000","last_undegraded":"2024-01-24T13:05:24.226737+0000","last_fullsized":"2024-01-24T13:05:24.226737+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:05:34.960781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.224235+0000","last_change":"2024-01-24T13:05:23.241430+0000","last_active":"2024-01-24T13:05:24.224235+0000","last_peered":"2024-01-24T13:05:24.224235+0000","last_clean":"2024-01-24T13:05:24.224235+0000","last_became_active":"2024-01-24T13:05:23.241157+0000","last_became_peered":"2024-01-24T13:05:23.241157+0000","last_unstale":"2024-01-24T13:05:24.224235+0000","last_undegraded":"2024-01-24T13:05:24.224235+0000","last_fullsized":"2024-01-24T13:05:24.224235+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:48:21.345424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.234418+0000","last_change":"2024-01-24T13:05:22.815075+0000","last_active":"2024-01-24T13:05:23.234418+0000","last_peered":"2024-01-24T13:05:23.234418+0000","last_clean":"2024-01-24T13:05:23.234418+0000","last_became_active":"2024-01-24T13:05:22.814847+0000","last_became_peered":"2024-01-24T13:05:22.814847+0000","last_unstale":"2024-01-24T13:05:23.234418+0000","last_undegraded":"2024-01-24T13:05:23.234418+0000","last_fullsized":"2024-01-24T13:05:23.234418+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:29:53.106048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.226410+0000","last_change":"2024-01-24T13:05:23.243998+0000","last_active":"2024-01-24T13:05:24.226410+0000","last_peered":"2024-01-24T13:05:24.226410+0000","last_clean":"2024-01-24T13:05:24.226410+0000","last_became_active":"2024-01-24T13:05:23.243683+0000","last_became_peered":"2024-01-24T13:05:23.243683+0000","last_unstale":"2024-01-24T13:05:24.226410+0000","last_undegraded":"2024-01-24T13:05:24.226410+0000","last_fullsized":"2024-01-24T13:05:24.226410+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:34:22.247304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.221832+0000","last_change":"2024-01-24T13:05:22.818757+0000","last_active":"2024-01-24T13:05:23.221832+0000","last_peered":"2024-01-24T13:05:23.221832+0000","last_clean":"2024-01-24T13:05:23.221832+0000","last_became_active":"2024-01-24T13:05:22.818278+0000","last_became_peered":"2024-01-24T13:05:22.818278+0000","last_unstale":"2024-01-24T13:05:23.221832+0000","last_undegraded":"2024-01-24T13:05:23.221832+0000","last_fullsized":"2024-01-24T13:05:23.221832+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:05.407056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227343+0000","last_change":"2024-01-24T13:05:23.243383+0000","last_active":"2024-01-24T13:05:24.227343+0000","last_peered":"2024-01-24T13:05:24.227343+0000","last_clean":"2024-01-24T13:05:24.227343+0000","last_became_active":"2024-01-24T13:05:23.243045+0000","last_became_peered":"2024-01-24T13:05:23.243045+0000","last_unstale":"2024-01-24T13:05:24.227343+0000","last_undegraded":"2024-01-24T13:05:24.227343+0000","last_fullsized":"2024-01-24T13:05:24.227343+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:44:53.865772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.222007+0000","last_change":"2024-01-24T13:05:22.818636+0000","last_active":"2024-01-24T13:05:23.222007+0000","last_peered":"2024-01-24T13:05:23.222007+0000","last_clean":"2024-01-24T13:05:23.222007+0000","last_became_active":"2024-01-24T13:05:22.818375+0000","last_became_peered":"2024-01-24T13:05:22.818375+0000","last_unstale":"2024-01-24T13:05:23.222007+0000","last_undegraded":"2024-01-24T13:05:23.222007+0000","last_fullsized":"2024-01-24T13:05:23.222007+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:03:23.863326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227285+0000","last_change":"2024-01-24T13:05:23.231118+0000","last_active":"2024-01-24T13:05:24.227285+0000","last_peered":"2024-01-24T13:05:24.227285+0000","last_clean":"2024-01-24T13:05:24.227285+0000","last_became_active":"2024-01-24T13:05:23.230861+0000","last_became_peered":"2024-01-24T13:05:23.230861+0000","last_unstale":"2024-01-24T13:05:24.227285+0000","last_undegraded":"2024-01-24T13:05:24.227285+0000","last_fullsized":"2024-01-24T13:05:24.227285+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:03:56.287320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.217832+0000","last_change":"2024-01-24T13:05:22.807481+0000","last_active":"2024-01-24T13:05:23.217832+0000","last_peered":"2024-01-24T13:05:23.217832+0000","last_clean":"2024-01-24T13:05:23.217832+0000","last_became_active":"2024-01-24T13:05:22.807197+0000","last_became_peered":"2024-01-24T13:05:22.807197+0000","last_unstale":"2024-01-24T13:05:23.217832+0000","last_undegraded":"2024-01-24T13:05:23.217832+0000","last_fullsized":"2024-01-24T13:05:23.217832+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:35:30.269642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.225422+0000","last_change":"2024-01-24T13:05:23.236081+0000","last_active":"2024-01-24T13:05:24.225422+0000","last_peered":"2024-01-24T13:05:24.225422+0000","last_clean":"2024-01-24T13:05:24.225422+0000","last_became_active":"2024-01-24T13:05:23.235452+0000","last_became_peered":"2024-01-24T13:05:23.235452+0000","last_unstale":"2024-01-24T13:05:24.225422+0000","last_undegraded":"2024-01-24T13:05:24.225422+0000","last_fullsized":"2024-01-24T13:05:24.225422+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:28:06.510389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.219969+0000","last_change":"2024-01-24T13:05:22.821307+0000","last_active":"2024-01-24T13:05:23.219969+0000","last_peered":"2024-01-24T13:05:23.219969+0000","last_clean":"2024-01-24T13:05:23.219969+0000","last_became_active":"2024-01-24T13:05:22.820937+0000","last_became_peered":"2024-01-24T13:05:22.820937+0000","last_unstale":"2024-01-24T13:05:23.219969+0000","last_undegraded":"2024-01-24T13:05:23.219969+0000","last_fullsized":"2024-01-24T13:05:23.219969+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:15.098387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-24T13:05:24.227597+0000","last_change":"2024-01-24T13:05:23.238923+0000","last_active":"2024-01-24T13:05:24.227597+0000","last_peered":"2024-01-24T13:05:24.227597+0000","last_clean":"2024-01-24T13:05:24.227597+0000","last_became_active":"2024-01-24T13:05:23.238670+0000","last_became_peered":"2024-01-24T13:05:23.238670+0000","last_unstale":"2024-01-24T13:05:24.227597+0000","last_undegraded":"2024-01-24T13:05:24.227597+0000","last_fullsized":"2024-01-24T13:05:24.227597+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:22.787401+0000","last_clean_scrub_stamp":"2024-01-24T13:05:22.787401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:20:22.793012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.221586+0000","last_change":"2024-01-24T13:05:22.819976+0000","last_active":"2024-01-24T13:05:23.221586+0000","last_peered":"2024-01-24T13:05:23.221586+0000","last_clean":"2024-01-24T13:05:23.221586+0000","last_became_active":"2024-01-24T13:05:22.819759+0000","last_became_peered":"2024-01-24T13:05:22.819759+0000","last_unstale":"2024-01-24T13:05:23.221586+0000","last_undegraded":"2024-01-24T13:05:23.221586+0000","last_fullsized":"2024-01-24T13:05:23.221586+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:05:21.781410+0000","last_clean_scrub_stamp":"2024-01-24T13:05:21.781410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:37:14.667657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":180,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-01-24T13:05:23.211758+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:05:23.211758+0000","last_peered":"2024-01-24T13:05:23.211758+0000","last_clean":"2024-01-24T13:05:23.211758+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:05:23.211758+0000","last_undegraded":"2024-01-24T13:05:23.211758+0000","last_fullsized":"2024-01-24T13:05:23.211758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":210595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.82499999999999996}]},{"osd":1,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.67500000000000004}]},{"osd":2,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.628},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.80700000000000005}]},{"osd":3,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.86399999999999999}]},{"osd":4,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.64300000000000002}]},{"osd":5,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.84699999999999998}]},{"osd":6,"last update":"Wed Jan 24 13:04:45 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.91200000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":210559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.72799999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":5.5579999999999998,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.66700000000000004}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":4.3289999999999997,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":4.9009999999999998,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.69699999999999995}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.6059999999999999,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.745}]},{"osd":4,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.623},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.274,"5min":4.274,"15min":4.274},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.645,"5min":2.645,"15min":2.645},"last":0.88800000000000001}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":5.6449999999999996,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.5140000000000002,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.875}]}]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":512000,"data_stored":212213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56000000000000005}]},{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.71199999999999997}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.68200000000000005}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72699999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.46000000000000002}]},{"osd":6,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.745}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75900000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":210615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.317},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.502}]},{"osd":2,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.68000000000000005}]},{"osd":5,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.73499999999999999}]},{"osd":6,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.747},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed Jan 24 13:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.79100000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":507904,"data_stored":212671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.45900000000000002}]},{"osd":1,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.78000000000000003}]},{"osd":5,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.76200000000000001}]},{"osd":6,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.75}]},{"osd":7,"last update":"Wed Jan 24 13:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.70399999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1089536,"data_stored":800915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.38}]},{"osd":2,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":0.41599999999999998}]},{"osd":3,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.745}]},{"osd":4,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.57399999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.70099999999999996}]},{"osd":6,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.72699999999999998}]},{"osd":7,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.59499999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":499712,"data_stored":210617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":5.556,"5min":5.556,"15min":5.556},"last":0.39800000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":5.3929999999999998,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.97599999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.80400000000000005}]},{"osd":6,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.96199999999999997}]},{"osd":7,"last update":"Wed Jan 24 13:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.0389999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1089536,"data_stored":801475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.77900000000000003}]},{"osd":1,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.76200000000000001}]},{"osd":2,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73399999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.80100000000000005}]},{"osd":4,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64400000000000002}]},{"osd":6,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:04:42 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.83899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:05:32.363 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-24T13:05:32.364 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-24T13:05:32.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.546+0000 7f9902400640 1 Processor -- start 2024-01-24T13:05:32.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.546+0000 7f9902400640 1 -- start start 2024-01-24T13:05:32.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f9902400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f98fc15c830 0x7f98fc0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f9902400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98fc1603a0 0x7f98fc0ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f9902400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98fc069cd0 0x7f98fc0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f9902400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98fc070cf0 con 0x7f98fc069cd0 2024-01-24T13:05:32.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f9902400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98fc15cc10 con 0x7f98fc15c830 2024-01-24T13:05:32.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f9902400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc160910 con 0x7f98fc1603a0 2024-01-24T13:05:32.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f98fbe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98fc069cd0 0x7f98fc0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f98fbe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98fc069cd0 0x7f98fc0cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55016/0 (socket says 172.21.15.29:55016) 2024-01-24T13:05:32.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f98fbe00640 1 -- 172.21.15.29:0/1370439121 learned_addr learned my addr 172.21.15.29:0/1370439121 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:32.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f98fb400640 1 --2- 172.21.15.29:0/1370439121 >> v2:172.21.15.163:3300/0 conn(0x7f98fc15c830 0x7f98fc0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f98faa00640 1 --2- 172.21.15.29:0/1370439121 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98fc1603a0 0x7f98fc0ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f98fbe00640 1 -- 172.21.15.29:0/1370439121 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98fc1603a0 msgr2=0x7f98fc0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:32.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f98fbe00640 1 --2- 172.21.15.29:0/1370439121 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98fc1603a0 0x7f98fc0ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f98fbe00640 1 -- 172.21.15.29:0/1370439121 >> v2:172.21.15.163:3300/0 conn(0x7f98fc15c830 msgr2=0x7f98fc0c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:32.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f98fbe00640 1 --2- 172.21.15.29:0/1370439121 >> v2:172.21.15.163:3300/0 conn(0x7f98fc15c830 0x7f98fc0c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f98fbe00640 1 -- 172.21.15.29:0/1370439121 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc160bf0 con 0x7f98fc069cd0 2024-01-24T13:05:32.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f98fb400640 1 --2- 172.21.15.29:0/1370439121 >> v2:172.21.15.163:3300/0 conn(0x7f98fc15c830 0x7f98fc0c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:32.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f98faa00640 1 --2- 172.21.15.29:0/1370439121 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98fc1603a0 0x7f98fc0ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:32.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.550+0000 7f98fbe00640 1 --2- 172.21.15.29:0/1370439121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98fc069cd0 0x7f98fc0cd3e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0709a0 tx=0x7f98f401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8171c1b021015d32 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:32.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f98fa000640 1 -- 172.21.15.29:0/1370439121 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f40af400 con 0x7f98fc069cd0 2024-01-24T13:05:32.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f98fa000640 1 -- 172.21.15.29:0/1370439121 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f40ab050 con 0x7f98fc069cd0 2024-01-24T13:05:32.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f98fa000640 1 -- 172.21.15.29:0/1370439121 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f40af780 con 0x7f98fc069cd0 2024-01-24T13:05:32.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f9902400640 1 -- 172.21.15.29:0/1370439121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98fc069cd0 msgr2=0x7f98fc0cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f9902400640 1 --2- 172.21.15.29:0/1370439121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98fc069cd0 0x7f98fc0cd3e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0709a0 tx=0x7f98f401f1c0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f9902400640 1 -- 172.21.15.29:0/1370439121 shutdown_connections 2024-01-24T13:05:32.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f9902400640 1 --2- 172.21.15.29:0/1370439121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98fc069cd0 0x7f98fc0cd3e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f9902400640 1 --2- 172.21.15.29:0/1370439121 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98fc1603a0 0x7f98fc0ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f9902400640 1 --2- 172.21.15.29:0/1370439121 >> v2:172.21.15.163:3300/0 conn(0x7f98fc15c830 0x7f98fc0c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f9902400640 1 -- 172.21.15.29:0/1370439121 >> 172.21.15.29:0/1370439121 conn(0x7f98fc0cbd50 msgr2=0x7f98fc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:32.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f9902400640 1 -- 172.21.15.29:0/1370439121 shutdown_connections 2024-01-24T13:05:32.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f9902400640 1 -- 172.21.15.29:0/1370439121 wait complete. 2024-01-24T13:05:32.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f9902400640 1 Processor -- start 2024-01-24T13:05:32.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f9902400640 1 -- start start 2024-01-24T13:05:32.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f9902400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98fc069cd0 0x7f98fc1ef890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.554+0000 7f9902400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98fc15c830 0x7f98fc15f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f9902400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98fc1603a0 0x7f98fc1f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f9902400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0c3100 con 0x7f98fc15c830 2024-01-24T13:05:32.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f9902400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0c52b0 con 0x7f98fc1603a0 2024-01-24T13:05:32.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f9902400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0c5590 con 0x7f98fc069cd0 2024-01-24T13:05:32.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98faa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98fc15c830 0x7f98fc15f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98faa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98fc15c830 0x7f98fc15f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55028/0 (socket says 172.21.15.29:55028) 2024-01-24T13:05:32.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98faa00640 1 -- 172.21.15.29:0/4162746284 learned_addr learned my addr 172.21.15.29:0/4162746284 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:32.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98fb400640 1 --2- 172.21.15.29:0/4162746284 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98fc069cd0 0x7f98fc1ef890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98fbe00640 1 --2- 172.21.15.29:0/4162746284 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98fc1603a0 0x7f98fc1f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98faa00640 1 -- 172.21.15.29:0/4162746284 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98fc069cd0 msgr2=0x7f98fc1ef890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98faa00640 1 --2- 172.21.15.29:0/4162746284 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98fc069cd0 0x7f98fc1ef890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98faa00640 1 -- 172.21.15.29:0/4162746284 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98fc1603a0 msgr2=0x7f98fc1f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98faa00640 1 --2- 172.21.15.29:0/4162746284 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98fc1603a0 0x7f98fc1f5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98faa00640 1 -- 172.21.15.29:0/4162746284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f4009b30 con 0x7f98fc15c830 2024-01-24T13:05:32.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98faa00640 1 --2- 172.21.15.29:0/4162746284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98fc15c830 0x7f98fc15f5e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f98e400c7f0 tx=0x7f98e400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:32.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98f3400640 1 -- 172.21.15.29:0/4162746284 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4007820 con 0x7f98fc15c830 2024-01-24T13:05:32.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98f3400640 1 -- 172.21.15.29:0/4162746284 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e4007980 con 0x7f98fc15c830 2024-01-24T13:05:32.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98f3400640 1 -- 172.21.15.29:0/4162746284 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4007d30 con 0x7f98fc15c830 2024-01-24T13:05:32.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f9902400640 1 -- 172.21.15.29:0/4162746284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc0c5870 con 0x7f98fc15c830 2024-01-24T13:05:32.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f9902400640 1 -- 172.21.15.29:0/4162746284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc0c4fa0 con 0x7f98fc15c830 2024-01-24T13:05:32.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f9902400640 1 -- 172.21.15.29:0/4162746284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98fc04e850 con 0x7f98fc15c830 2024-01-24T13:05:32.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.558+0000 7f98f3400640 1 -- 172.21.15.29:0/4162746284 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f98e40113f0 con 0x7f98fc15c830 2024-01-24T13:05:32.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.562+0000 7f98f3400640 1 --2- 172.21.15.29:0/4162746284 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f98d4065a60 0x7f98d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.562+0000 7f98f3400640 1 -- 172.21.15.29:0/4162746284 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f98e4083640 con 0x7f98fc15c830 2024-01-24T13:05:32.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.562+0000 7f98fb400640 1 --2- 172.21.15.29:0/4162746284 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f98d4065a60 0x7f98d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.562+0000 7f98fb400640 1 --2- 172.21.15.29:0/4162746284 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f98d4065a60 0x7f98d4067f20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f98ec006b20 tx=0x7f98ec008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:32.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.562+0000 7f98f3400640 1 -- 172.21.15.29:0/4162746284 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f98e4050eb0 con 0x7f98fc15c830 2024-01-24T13:05:32.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.774+0000 7f9902400640 1 -- 172.21.15.29:0/4162746284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f98fc0661a0 con 0x7f98fc15c830 2024-01-24T13:05:32.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.778+0000 7f98f3400640 1 -- 172.21.15.29:0/4162746284 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f98e40544d0 con 0x7f98fc15c830 2024-01-24T13:05:32.784 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2024-01-24T13:05:32.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.782+0000 7f9902400640 1 -- 172.21.15.29:0/4162746284 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f98d4065a60 msgr2=0x7f98d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.782+0000 7f9902400640 1 --2- 172.21.15.29:0/4162746284 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f98d4065a60 0x7f98d4067f20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f98ec006b20 tx=0x7f98ec008040 comp rx=0 tx=0).stop 2024-01-24T13:05:32.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.782+0000 7f9902400640 1 -- 172.21.15.29:0/4162746284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98fc15c830 msgr2=0x7f98fc15f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.782+0000 7f9902400640 1 --2- 172.21.15.29:0/4162746284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98fc15c830 0x7f98fc15f5e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f98e400c7f0 tx=0x7f98e400ccb0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.782+0000 7f9902400640 1 -- 172.21.15.29:0/4162746284 shutdown_connections 2024-01-24T13:05:32.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.782+0000 7f9902400640 1 --2- 172.21.15.29:0/4162746284 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f98d4065a60 0x7f98d4067f20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.782+0000 7f9902400640 1 --2- 172.21.15.29:0/4162746284 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98fc1603a0 0x7f98fc1f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.782+0000 7f9902400640 1 --2- 172.21.15.29:0/4162746284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98fc15c830 0x7f98fc15f5e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.782+0000 7f9902400640 1 --2- 172.21.15.29:0/4162746284 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98fc069cd0 0x7f98fc1ef890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.782+0000 7f9902400640 1 -- 172.21.15.29:0/4162746284 >> 172.21.15.29:0/4162746284 conn(0x7f98fc0cbd50 msgr2=0x7f98fc0ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:32.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.782+0000 7f9902400640 1 -- 172.21.15.29:0/4162746284 shutdown_connections 2024-01-24T13:05:32.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.782+0000 7f9902400640 1 -- 172.21.15.29:0/4162746284 wait complete. 2024-01-24T13:05:32.807 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:05:32.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.942+0000 7fc32b400640 1 Processor -- start 2024-01-24T13:05:32.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.942+0000 7fc32b400640 1 -- start start 2024-01-24T13:05:32.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc32b400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc3240ce950 0x7fc3240ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc32b400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc32415d7a0 0x7fc324152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc32b400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3240d0b80 con 0x7fc3240cd2f0 2024-01-24T13:05:32.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc32b400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3240cd7a0 con 0x7fc3240ce950 2024-01-24T13:05:32.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc32b400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3240d0040 con 0x7fc32415d7a0 2024-01-24T13:05:32.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc3240cd2f0 0x7fc32415d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37972/0 (socket says 172.21.15.29:37972) 2024-01-24T13:05:32.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323e00640 1 -- 172.21.15.29:0/177034891 learned_addr learned my addr 172.21.15.29:0/177034891 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:32.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 -- 172.21.15.29:0/177034891 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229283590 0 0) 0x7fc3240d0b80 con 0x7fc3240cd2f0 2024-01-24T13:05:32.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc329400640 1 --2- 172.21.15.29:0/177034891 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc32415d7a0 0x7fc324152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 -- 172.21.15.29:0/177034891 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc304003530 con 0x7fc3240cd2f0 2024-01-24T13:05:32.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc328a00640 1 --2- 172.21.15.29:0/177034891 >> v2:172.21.15.163:3300/0 conn(0x7fc3240ce950 0x7fc3240ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 -- 172.21.15.29:0/177034891 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1230600682 0 0) 0x7fc304003530 con 0x7fc3240cd2f0 2024-01-24T13:05:32.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 -- 172.21.15.29:0/177034891 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc32415d7a0 msgr2=0x7fc324152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:32.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 --2- 172.21.15.29:0/177034891 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc32415d7a0 0x7fc324152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 -- 172.21.15.29:0/177034891 >> v2:172.21.15.163:3300/0 conn(0x7fc3240ce950 msgr2=0x7fc3240ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:32.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 --2- 172.21.15.29:0/177034891 >> v2:172.21.15.163:3300/0 conn(0x7fc3240ce950 0x7fc3240ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 -- 172.21.15.29:0/177034891 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32406bdf0 con 0x7fc3240cd2f0 2024-01-24T13:05:32.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 -- 172.21.15.29:0/177034891 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7fc30c001680 con 0x7fc3240cd2f0 2024-01-24T13:05:32.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 -- 172.21.15.29:0/177034891 >> v1:172.21.15.29:6789/0 conn(0x7fc3240cd2f0 legacy=0x7fc32415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 --2- 172.21.15.29:0/177034891 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc304003980 0x7fc304003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 --2- 172.21.15.29:0/177034891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3040047d0 0x7fc304004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 --2- 172.21.15.29:0/177034891 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc32415d7a0 0x7fc304005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 -- 172.21.15.29:0/177034891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3240cd7a0 con 0x7fc3040047d0 2024-01-24T13:05:32.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 -- 172.21.15.29:0/177034891 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3240d0040 con 0x7fc304003980 2024-01-24T13:05:32.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323400640 1 -- 172.21.15.29:0/177034891 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30400ba10 con 0x7fc32415d7a0 2024-01-24T13:05:32.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323e00640 1 --2- 172.21.15.29:0/177034891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3040047d0 0x7fc304004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc328a00640 1 --2- 172.21.15.29:0/177034891 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc304003980 0x7fc304003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc329400640 1 --2- 172.21.15.29:0/177034891 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc32415d7a0 0x7fc304005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323e00640 1 -- 172.21.15.29:0/177034891 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc32415d7a0 msgr2=0x7fc304005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:32.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323e00640 1 --2- 172.21.15.29:0/177034891 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc32415d7a0 0x7fc304005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323e00640 1 -- 172.21.15.29:0/177034891 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc304003980 msgr2=0x7fc304003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:32.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323e00640 1 --2- 172.21.15.29:0/177034891 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc304003980 0x7fc304003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.946+0000 7fc323e00640 1 -- 172.21.15.29:0/177034891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304003530 con 0x7fc3040047d0 2024-01-24T13:05:32.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.950+0000 7fc323e00640 1 --2- 172.21.15.29:0/177034891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3040047d0 0x7fc304004c50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00c290 tx=0x7fc30c01cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910e7965d650a9d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:32.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.950+0000 7fc323400640 1 -- 172.21.15.29:0/177034891 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0058e0 con 0x7fc3040047d0 2024-01-24T13:05:32.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.950+0000 7fc323400640 1 -- 172.21.15.29:0/177034891 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c005a40 con 0x7fc3040047d0 2024-01-24T13:05:32.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.950+0000 7fc323400640 1 -- 172.21.15.29:0/177034891 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c005df0 con 0x7fc3040047d0 2024-01-24T13:05:32.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.950+0000 7fc32b400640 1 -- 172.21.15.29:0/177034891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3040047d0 msgr2=0x7fc304004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.950+0000 7fc32b400640 1 --2- 172.21.15.29:0/177034891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3040047d0 0x7fc304004c50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00c290 tx=0x7fc30c01cce0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.950+0000 7fc329400640 1 -- 172.21.15.29:0/177034891 reap_dead start 2024-01-24T13:05:32.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.950+0000 7fc32b400640 1 -- 172.21.15.29:0/177034891 shutdown_connections 2024-01-24T13:05:32.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.950+0000 7fc32b400640 1 -- 172.21.15.29:0/177034891 >> 172.21.15.29:0/177034891 conn(0x7fc324070570 msgr2=0x7fc324069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:32.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.950+0000 7fc32b400640 1 -- 172.21.15.29:0/177034891 shutdown_connections 2024-01-24T13:05:32.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.950+0000 7fc32b400640 1 -- 172.21.15.29:0/177034891 wait complete. 2024-01-24T13:05:32.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc32b400640 1 Processor -- start 2024-01-24T13:05:32.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc32b400640 1 -- start start 2024-01-24T13:05:32.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc32b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3040047d0 0x7fc3241560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc32b400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc324151770 0x7fc324151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc32b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32415bf00 0x7fc32415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc32b400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3241566c0 con 0x7fc32415bf00 2024-01-24T13:05:32.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc32b400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32415c8c0 con 0x7fc3040047d0 2024-01-24T13:05:32.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc32b400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3241f8100 con 0x7fc324151770 2024-01-24T13:05:32.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc329400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32415bf00 0x7fc32415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc329400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32415bf00 0x7fc32415c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55048/0 (socket says 172.21.15.29:55048) 2024-01-24T13:05:32.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc329400640 1 -- 172.21.15.29:0/3962201303 learned_addr learned my addr 172.21.15.29:0/3962201303 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:32.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc328a00640 1 --2- 172.21.15.29:0/3962201303 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3040047d0 0x7fc3241560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc323e00640 1 --2- 172.21.15.29:0/3962201303 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc324151770 0x7fc324151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc329400640 1 -- 172.21.15.29:0/3962201303 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc324151770 msgr2=0x7fc324151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc329400640 1 --2- 172.21.15.29:0/3962201303 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc324151770 0x7fc324151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc329400640 1 -- 172.21.15.29:0/3962201303 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3040047d0 msgr2=0x7fc3241560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:32.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc329400640 1 --2- 172.21.15.29:0/3962201303 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3040047d0 0x7fc3241560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:32.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc329400640 1 -- 172.21.15.29:0/3962201303 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3241f77d0 con 0x7fc32415bf00 2024-01-24T13:05:32.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc329400640 1 --2- 172.21.15.29:0/3962201303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32415bf00 0x7fc32415c380 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc32406c6c0 tx=0x7fc31c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:32.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc320c00640 1 -- 172.21.15.29:0/3962201303 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c00e070 con 0x7fc32415bf00 2024-01-24T13:05:32.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc320c00640 1 -- 172.21.15.29:0/3962201303 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c011ea0 con 0x7fc32415bf00 2024-01-24T13:05:32.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc320c00640 1 -- 172.21.15.29:0/3962201303 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0039a0 con 0x7fc32415bf00 2024-01-24T13:05:32.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc32b400640 1 -- 172.21.15.29:0/3962201303 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3241f7ab0 con 0x7fc32415bf00 2024-01-24T13:05:32.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.954+0000 7fc32b400640 1 -- 172.21.15.29:0/3962201303 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc324152430 con 0x7fc32415bf00 2024-01-24T13:05:32.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.958+0000 7fc32b400640 1 -- 172.21.15.29:0/3962201303 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32404e850 con 0x7fc32415bf00 2024-01-24T13:05:32.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.958+0000 7fc320c00640 1 -- 172.21.15.29:0/3962201303 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc31c003b00 con 0x7fc32415bf00 2024-01-24T13:05:32.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.958+0000 7fc320c00640 1 --2- 172.21.15.29:0/3962201303 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc2fc065a60 0x7fc2fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:32.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.958+0000 7fc320c00640 1 -- 172.21.15.29:0/3962201303 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc31c083950 con 0x7fc32415bf00 2024-01-24T13:05:32.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.958+0000 7fc328a00640 1 --2- 172.21.15.29:0/3962201303 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc2fc065a60 0x7fc2fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:32.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.958+0000 7fc328a00640 1 --2- 172.21.15.29:0/3962201303 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc2fc065a60 0x7fc2fc067f20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc3240b4340 tx=0x7fc314008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:32.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:32.962+0000 7fc320c00640 1 -- 172.21.15.29:0/3962201303 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc31c0511e0 con 0x7fc32415bf00 2024-01-24T13:05:33.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.154+0000 7fc32b400640 1 -- 172.21.15.29:0/3962201303 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3240cdd40 con 0x7fc32415bf00 2024-01-24T13:05:33.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.154+0000 7fc320c00640 1 -- 172.21.15.29:0/3962201303 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4737 (secure 0 0 0) 0x7fc31c054800 con 0x7fc32415bf00 2024-01-24T13:05:33.157 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:33.157 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3468790539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3468790539},{"type":"v1","addr":"172.21.15.29:6834","nonce":3468790539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3278958688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3278958688},{"type":"v1","addr":"172.21.15.29:6835","nonce":3278958688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/1296970243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1296970243},{"type":"v1","addr":"172.21.15.163:6836","nonce":1296970243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:05:23.206301+0000","modified":"2024-01-24T13:05:26.327228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5463":{"gid":5463,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/140413977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":140413977},{"type":"v1","addr":"172.21.15.163:6837","nonce":140413977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-24T13:05:33.158 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2024-01-24T13:05:33.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.154+0000 7fc32b400640 1 -- 172.21.15.29:0/3962201303 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc2fc065a60 msgr2=0x7fc2fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.154+0000 7fc32b400640 1 --2- 172.21.15.29:0/3962201303 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc2fc065a60 0x7fc2fc067f20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc3240b4340 tx=0x7fc314008040 comp rx=0 tx=0).stop 2024-01-24T13:05:33.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.154+0000 7fc32b400640 1 -- 172.21.15.29:0/3962201303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32415bf00 msgr2=0x7fc32415c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.154+0000 7fc32b400640 1 --2- 172.21.15.29:0/3962201303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32415bf00 0x7fc32415c380 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc32406c6c0 tx=0x7fc31c0115a0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.154+0000 7fc32b400640 1 -- 172.21.15.29:0/3962201303 shutdown_connections 2024-01-24T13:05:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.154+0000 7fc32b400640 1 --2- 172.21.15.29:0/3962201303 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc2fc065a60 0x7fc2fc067f20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.154+0000 7fc32b400640 1 --2- 172.21.15.29:0/3962201303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32415bf00 0x7fc32415c380 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.154+0000 7fc32b400640 1 --2- 172.21.15.29:0/3962201303 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc324151770 0x7fc324151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.154+0000 7fc32b400640 1 --2- 172.21.15.29:0/3962201303 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3040047d0 0x7fc3241560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.154+0000 7fc32b400640 1 -- 172.21.15.29:0/3962201303 >> 172.21.15.29:0/3962201303 conn(0x7fc324070570 msgr2=0x7fc324069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.154+0000 7fc32b400640 1 -- 172.21.15.29:0/3962201303 shutdown_connections 2024-01-24T13:05:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.154+0000 7fc32b400640 1 -- 172.21.15.29:0/3962201303 wait complete. 2024-01-24T13:05:33.582 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-24T13:05:23.206301+0000', 'modified': '2024-01-24T13:05:26.327228+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5463}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5463': {'gid': 5463, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.163:6837/140413977', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6834', 'nonce': 140413977}, {'type': 'v1', 'addr': '172.21.15.163:6837', 'nonce': 140413977}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-24T13:05:33.582 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-24T13:05:33.582 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-24T13:05:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.726+0000 7f1920600640 1 Processor -- start 2024-01-24T13:05:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.726+0000 7f1920600640 1 -- start start 2024-01-24T13:05:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.726+0000 7f1920600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19180d0150 0x7f19180ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.726+0000 7f1920600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19180d05e0 con 0x7f19180cd460 2024-01-24T13:05:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.726+0000 7f1920600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19180ce9e0 con 0x7f19180ce5c0 2024-01-24T13:05:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.726+0000 7f1920600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19180d0830 con 0x7f19180d0150 2024-01-24T13:05:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.726+0000 7f191d200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19180d0150 0x7f19180ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.726+0000 7f191dc00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f19180cd460 0x7f191815d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37980/0 (socket says 172.21.15.29:37980) 2024-01-24T13:05:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.726+0000 7f191dc00640 1 -- 172.21.15.29:0/1044694211 learned_addr learned my addr 172.21.15.29:0/1044694211 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.726+0000 7f191d200640 1 -- 172.21.15.29:0/1044694211 >> v1:172.21.15.163:6789/0 conn(0x7f19180ce5c0 legacy=0x7f191806b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.726+0000 7f191d200640 1 -- 172.21.15.29:0/1044694211 >> v1:172.21.15.29:6789/0 conn(0x7f19180cd460 legacy=0x7f191815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.726+0000 7f191d200640 1 -- 172.21.15.29:0/1044694211 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19180d0b10 con 0x7f19180d0150 2024-01-24T13:05:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.726+0000 7f1917e00640 1 -- 172.21.15.29:0/1044694211 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396145915 0 0) 0x7f19180d05e0 con 0x7f19180cd460 2024-01-24T13:05:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.730+0000 7f191d200640 1 --2- 172.21.15.29:0/1044694211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180d0150 0x7f19180ce080 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f19000097c0 tx=0x7f190001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788f09a58b4a3e3f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.730+0000 7f1917e00640 1 -- 172.21.15.29:0/1044694211 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000ad680 con 0x7f19180d0150 2024-01-24T13:05:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.730+0000 7f1917e00640 1 -- 172.21.15.29:0/1044694211 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19000ad7e0 con 0x7f19180d0150 2024-01-24T13:05:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.730+0000 7f1917e00640 1 -- 172.21.15.29:0/1044694211 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000adb70 con 0x7f19180d0150 2024-01-24T13:05:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 -- 172.21.15.29:0/1044694211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180d0150 msgr2=0x7f19180ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 --2- 172.21.15.29:0/1044694211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180d0150 0x7f19180ce080 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f19000097c0 tx=0x7f190001c380 comp rx=0 tx=0).stop 2024-01-24T13:05:33.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 -- 172.21.15.29:0/1044694211 shutdown_connections 2024-01-24T13:05:33.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 --2- 172.21.15.29:0/1044694211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180d0150 0x7f19180ce080 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 -- 172.21.15.29:0/1044694211 >> 172.21.15.29:0/1044694211 conn(0x7f1918069cd0 msgr2=0x7f191806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:33.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 -- 172.21.15.29:0/1044694211 shutdown_connections 2024-01-24T13:05:33.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 -- 172.21.15.29:0/1044694211 wait complete. 2024-01-24T13:05:33.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 Processor -- start 2024-01-24T13:05:33.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 -- start start 2024-01-24T13:05:33.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180cd460 0x7f19181604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19180ce5c0 0x7f191814e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19180d0150 0x7f191815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191814f330 con 0x7f19180cd460 2024-01-24T13:05:33.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918160cd0 con 0x7f19180d0150 2024-01-24T13:05:33.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f1920600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1918160fb0 con 0x7f19180ce5c0 2024-01-24T13:05:33.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f191dc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180cd460 0x7f19181604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f191dc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180cd460 0x7f19181604a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55076/0 (socket says 172.21.15.29:55076) 2024-01-24T13:05:33.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f191dc00640 1 -- 172.21.15.29:0/2356848551 learned_addr learned my addr 172.21.15.29:0/2356848551 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:33.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f191e600640 1 --2- 172.21.15.29:0/2356848551 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19180d0150 0x7f191815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f191d200640 1 --2- 172.21.15.29:0/2356848551 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19180ce5c0 0x7f191814e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f191dc00640 1 -- 172.21.15.29:0/2356848551 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19180ce5c0 msgr2=0x7f191814e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f191dc00640 1 --2- 172.21.15.29:0/2356848551 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19180ce5c0 0x7f191814e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f191dc00640 1 -- 172.21.15.29:0/2356848551 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19180d0150 msgr2=0x7f191815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f191dc00640 1 --2- 172.21.15.29:0/2356848551 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19180d0150 0x7f191815ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.734+0000 7f191dc00640 1 -- 172.21.15.29:0/2356848551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1900009420 con 0x7f19180cd460 2024-01-24T13:05:33.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.738+0000 7f191dc00640 1 --2- 172.21.15.29:0/2356848551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180cd460 0x7f19181604a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f190800c4a0 tx=0x7f190800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:33.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.738+0000 7f1915600640 1 -- 172.21.15.29:0/2356848551 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080074e0 con 0x7f19180cd460 2024-01-24T13:05:33.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.738+0000 7f1915600640 1 -- 172.21.15.29:0/2356848551 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1908007640 con 0x7f19180cd460 2024-01-24T13:05:33.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.738+0000 7f1915600640 1 -- 172.21.15.29:0/2356848551 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1908004a30 con 0x7f19180cd460 2024-01-24T13:05:33.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.738+0000 7f1920600640 1 -- 172.21.15.29:0/2356848551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1918161290 con 0x7f19180cd460 2024-01-24T13:05:33.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.738+0000 7f1920600640 1 -- 172.21.15.29:0/2356848551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19181609e0 con 0x7f19180cd460 2024-01-24T13:05:33.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.738+0000 7f1915600640 1 -- 172.21.15.29:0/2356848551 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1908004b90 con 0x7f19180cd460 2024-01-24T13:05:33.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.738+0000 7f1915600640 1 --2- 172.21.15.29:0/2356848551 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f18f0065a60 0x7f18f0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.738+0000 7f1915600640 1 -- 172.21.15.29:0/2356848551 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1908082570 con 0x7f19180cd460 2024-01-24T13:05:33.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.738+0000 7f191d200640 1 --2- 172.21.15.29:0/2356848551 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f18f0065a60 0x7f18f0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.738+0000 7f1923b37000 1 Processor -- start 2024-01-24T13:05:33.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 -- start start 2024-01-24T13:05:33.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f191d200640 1 --2- 172.21.15.29:0/2356848551 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f18f0065a60 0x7f18f0067f20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f19000af000 tx=0x7f19000a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:33.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741f6980 0x5652741f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 0x5652741aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x5652741ab110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x565274002350 con 0x5652741aad30 2024-01-24T13:05:33.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x565273fff920 con 0x5652741f6980 2024-01-24T13:05:33.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x565273ffb210 con 0x5652741f72a0 2024-01-24T13:05:33.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f191e600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x5652741ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f191e600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x5652741ab110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55078/0 (socket says 172.21.15.29:55078) 2024-01-24T13:05:33.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f191e600640 1 -- 172.21.15.29:0/3123371131 learned_addr learned my addr 172.21.15.29:0/3123371131 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:33.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f191d200640 1 --2- 172.21.15.29:0/3123371131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 0x5652741aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f191dc00640 1 --2- 172.21.15.29:0/3123371131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741f6980 0x5652741f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f191e600640 1 -- 172.21.15.29:0/3123371131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 msgr2=0x5652741aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f191e600640 1 --2- 172.21.15.29:0/3123371131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 0x5652741aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f191e600640 1 -- 172.21.15.29:0/3123371131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741f6980 msgr2=0x5652741f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f191e600640 1 --2- 172.21.15.29:0/3123371131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741f6980 0x5652741f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f191e600640 1 -- 172.21.15.29:0/3123371131 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565273f9bff0 con 0x5652741aad30 2024-01-24T13:05:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f191e600640 1 --2- 172.21.15.29:0/3123371131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x5652741ab110 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1910001ce0 tx=0x7f19100021a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f359fb5b63a646b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f190e000640 1 -- 172.21.15.29:0/3123371131 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910003b90 con 0x5652741aad30 2024-01-24T13:05:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f190e000640 1 -- 172.21.15.29:0/3123371131 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1910003cf0 con 0x5652741aad30 2024-01-24T13:05:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f190e000640 1 -- 172.21.15.29:0/3123371131 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191000eb00 con 0x5652741aad30 2024-01-24T13:05:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 -- 172.21.15.29:0/3123371131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 msgr2=0x5652741ab110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 --2- 172.21.15.29:0/3123371131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x5652741ab110 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1910001ce0 tx=0x7f19100021a0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 -- 172.21.15.29:0/3123371131 shutdown_connections 2024-01-24T13:05:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 --2- 172.21.15.29:0/3123371131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x5652741ab110 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 --2- 172.21.15.29:0/3123371131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 0x5652741aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 --2- 172.21.15.29:0/3123371131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741f6980 0x5652741f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 -- 172.21.15.29:0/3123371131 >> 172.21.15.29:0/3123371131 conn(0x5652740b0430 msgr2=0x5652741d9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 -- 172.21.15.29:0/3123371131 shutdown_connections 2024-01-24T13:05:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 -- 172.21.15.29:0/3123371131 wait complete. 2024-01-24T13:05:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.742+0000 7f1923b37000 1 -- start start 2024-01-24T13:05:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 1 Processor -- start 2024-01-24T13:05:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x5652741fd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741f6980 0x5652741fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 0x5652741b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x565273f9a420 con 0x5652741aad30 2024-01-24T13:05:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x565273fb8890 con 0x5652741f6980 2024-01-24T13:05:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x565273cb8940 con 0x5652741f72a0 2024-01-24T13:05:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 10 client.0 _ll_register_callbacks cb 0x565273feff40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-24T13:05:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f191dc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x5652741fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f191dc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x5652741fd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55082/0 (socket says 172.21.15.29:55082) 2024-01-24T13:05:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f191dc00640 1 -- 172.21.15.29:0/3188332641 learned_addr learned my addr 172.21.15.29:0/3188332641 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f191d200640 1 --2- 172.21.15.29:0/3188332641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741f6980 0x5652741fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f191e600640 1 --2- 172.21.15.29:0/3188332641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 0x5652741b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f191dc00640 1 -- 172.21.15.29:0/3188332641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 msgr2=0x5652741b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f191dc00640 1 --2- 172.21.15.29:0/3188332641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 0x5652741b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f191dc00640 1 -- 172.21.15.29:0/3188332641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741f6980 msgr2=0x5652741fd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f191dc00640 1 --2- 172.21.15.29:0/3188332641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741f6980 0x5652741fd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f191dc00640 1 -- 172.21.15.29:0/3188332641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191000f040 con 0x5652741aad30 2024-01-24T13:05:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f191dc00640 1 --2- 172.21.15.29:0/3188332641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x5652741fd280 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f190800ce60 tx=0x7f19080541a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1855709ec2f917 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1906a00640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-01-24T13:05:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1906a00640 1 -- 172.21.15.29:0/3188332641 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190805b7f0 con 0x5652741aad30 2024-01-24T13:05:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 1 -- 172.21.15.29:0/3188332641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565273fc0cc0 con 0x5652741aad30 2024-01-24T13:05:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1906a00640 1 -- 172.21.15.29:0/3188332641 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f190805ba80 con 0x5652741aad30 2024-01-24T13:05:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1906a00640 1 -- 172.21.15.29:0/3188332641 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19080820c0 con 0x5652741aad30 2024-01-24T13:05:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 10 client.5688 fetch_fsmap learned FSMap version 17 2024-01-24T13:05:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 1 -- 172.21.15.29:0/3188332641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x565273cf7890 con 0x5652741aad30 2024-01-24T13:05:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1906a00640 1 -- 172.21.15.29:0/3188332641 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565273fc0cc0 con 0x5652741aad30 2024-01-24T13:05:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1906a00640 1 -- 172.21.15.29:0/3188332641 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1908080d20 con 0x5652741aad30 2024-01-24T13:05:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 10 client.5688 fetch_fsmap finished waiting for FSMap version 17 2024-01-24T13:05:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 10 client.5688 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-24T13:05:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 20 client.5688 populate_metadata read hostname 'smithi029' 2024-01-24T13:05:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 1 --2- 172.21.15.29:0/3188332641 >> [v2:172.21.15.163:6834/140413977,v1:172.21.15.163:6837/140413977] conn(0x5652741b2900 0x5652741b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 4 client.5688 mds_command: new command op to 5463 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-24T13:05:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f1923b37000 1 -- 172.21.15.29:0/3188332641 --> [v2:172.21.15.163:6834/140413977,v1:172.21.15.163:6837/140413977] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565273ff9b60 con 0x5652741b2900 2024-01-24T13:05:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.746+0000 7f191d200640 1 --2- 172.21.15.29:0/3188332641 >> [v2:172.21.15.163:6834/140413977,v1:172.21.15.163:6837/140413977] conn(0x5652741b2900 0x5652741b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f191d200640 1 --2- 172.21.15.29:0/3188332641 >> [v2:172.21.15.163:6834/140413977,v1:172.21.15.163:6837/140413977] conn(0x5652741b2900 0x5652741b2ce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c928583fcade596 server_cookie=d6e2e90fbaddfb89 in_seq=0 out_seq=0 2024-01-24T13:05:33.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1906a00640 10 client.5688 ms_handle_connect on v2:172.21.15.163:6834/140413977 2024-01-24T13:05:33.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1906a00640 1 -- 172.21.15.29:0/3188332641 <== mds.0 v2:172.21.15.163:6834/140413977 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x565273ff9b60 con 0x5652741b2900 2024-01-24T13:05:33.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1906a00640 10 client.5688 handle_command_reply: tid=0 2024-01-24T13:05:33.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1923b37000 1 client.5688 shutdown 2024-01-24T13:05:33.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1923b37000 1 -- 172.21.15.29:0/3188332641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 msgr2=0x5652741fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1923b37000 1 --2- 172.21.15.29:0/3188332641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x5652741fd280 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f190800ce60 tx=0x7f19080541a0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1923b37000 1 -- 172.21.15.29:0/3188332641 shutdown_connections 2024-01-24T13:05:33.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1923b37000 1 --2- 172.21.15.29:0/3188332641 >> [v2:172.21.15.163:6834/140413977,v1:172.21.15.163:6837/140413977] conn(0x5652741b2900 0x5652741b2ce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1923b37000 1 --2- 172.21.15.29:0/3188332641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 0x5652741b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1923b37000 1 --2- 172.21.15.29:0/3188332641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741f6980 0x5652741fd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1923b37000 1 --2- 172.21.15.29:0/3188332641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x5652741fd280 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1923b37000 1 -- 172.21.15.29:0/3188332641 >> 172.21.15.29:0/3188332641 conn(0x5652740b0430 msgr2=0x5652741a9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:33.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1906a00640 0 client.5688 ms_handle_reset on v2:172.21.15.163:6834/140413977 2024-01-24T13:05:33.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1923b37000 1 -- 172.21.15.29:0/3188332641 shutdown_connections 2024-01-24T13:05:33.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1923b37000 1 -- 172.21.15.29:0/3188332641 wait complete. 2024-01-24T13:05:33.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.750+0000 7f1923b37000 20 client.5688 trim_cache size 0 max 16384 2024-01-24T13:05:33.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f1923b37000 1 Processor -- start 2024-01-24T13:05:33.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f1923b37000 1 -- start start 2024-01-24T13:05:33.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f1923b37000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741aad30 0x5652741aa170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f1923b37000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741f6980 0x5652741aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f1923b37000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 0x5652741a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f1923b37000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x565273ff7de0 con 0x5652741f6980 2024-01-24T13:05:33.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f1923b37000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x565273ff6b80 con 0x5652741aad30 2024-01-24T13:05:33.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f1923b37000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x56527420c6b0 con 0x5652741f72a0 2024-01-24T13:05:33.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f191d200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741f6980 0x5652741aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f191d200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741f6980 0x5652741aa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55094/0 (socket says 172.21.15.29:55094) 2024-01-24T13:05:33.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f191d200640 1 -- 172.21.15.29:0/4272456967 learned_addr learned my addr 172.21.15.29:0/4272456967 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:33.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f191d200640 1 -- 172.21.15.29:0/4272456967 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 msgr2=0x5652741a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:33.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f191d200640 1 --2- 172.21.15.29:0/4272456967 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 0x5652741a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f191d200640 1 -- 172.21.15.29:0/4272456967 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741aad30 msgr2=0x5652741aa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:33.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f191d200640 1 --2- 172.21.15.29:0/4272456967 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741aad30 0x5652741aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f191d200640 1 -- 172.21.15.29:0/4272456967 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565273fc02d0 con 0x5652741f6980 2024-01-24T13:05:33.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f191d200640 1 --2- 172.21.15.29:0/4272456967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741f6980 0x5652741aa6b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1900000c10 tx=0x7f1900004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128cdd82f212658c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:33.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.766+0000 7f190ea00640 1 -- 172.21.15.29:0/4272456967 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000c9160 con 0x5652741f6980 2024-01-24T13:05:33.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f190ea00640 1 -- 172.21.15.29:0/4272456967 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19000be040 con 0x5652741f6980 2024-01-24T13:05:33.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f190ea00640 1 -- 172.21.15.29:0/4272456967 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000c9970 con 0x5652741f6980 2024-01-24T13:05:33.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 -- 172.21.15.29:0/4272456967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741f6980 msgr2=0x5652741aa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 --2- 172.21.15.29:0/4272456967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741f6980 0x5652741aa6b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1900000c10 tx=0x7f1900004740 comp rx=0 tx=0).stop 2024-01-24T13:05:33.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 -- 172.21.15.29:0/4272456967 shutdown_connections 2024-01-24T13:05:33.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 --2- 172.21.15.29:0/4272456967 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 0x5652741a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 --2- 172.21.15.29:0/4272456967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741f6980 0x5652741aa6b0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 --2- 172.21.15.29:0/4272456967 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741aad30 0x5652741aa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 -- 172.21.15.29:0/4272456967 >> 172.21.15.29:0/4272456967 conn(0x5652740b0430 msgr2=0x5652741b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:33.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 -- 172.21.15.29:0/4272456967 shutdown_connections 2024-01-24T13:05:33.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 -- 172.21.15.29:0/4272456967 wait complete. 2024-01-24T13:05:33.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 -- start start 2024-01-24T13:05:33.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 Processor -- start 2024-01-24T13:05:33.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x565274253020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741f6980 0x565274253560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 0x56527424f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x565273ffdd70 con 0x5652741aad30 2024-01-24T13:05:33.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x565273fb47a0 con 0x5652741f6980 2024-01-24T13:05:33.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652740035e0 con 0x5652741f72a0 2024-01-24T13:05:33.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1923b37000 10 client.0 _ll_register_callbacks cb 0x565274179700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-24T13:05:33.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f191dc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x565274253020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f191dc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x565274253020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55100/0 (socket says 172.21.15.29:55100) 2024-01-24T13:05:33.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f191dc00640 1 -- 172.21.15.29:0/197628972 learned_addr learned my addr 172.21.15.29:0/197628972 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:33.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f191dc00640 1 -- 172.21.15.29:0/197628972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 msgr2=0x56527424f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:33.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f191dc00640 1 --2- 172.21.15.29:0/197628972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 0x56527424f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f191dc00640 1 -- 172.21.15.29:0/197628972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741f6980 msgr2=0x565274253560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:33.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f191dc00640 1 --2- 172.21.15.29:0/197628972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741f6980 0x565274253560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f191dc00640 1 -- 172.21.15.29:0/197628972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19180d0b10 con 0x5652741aad30 2024-01-24T13:05:33.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f191dc00640 1 --2- 172.21.15.29:0/197628972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x565274253020 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f19080537a0 tx=0x7f190800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b3b1002d8680bd server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:33.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1906a00640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-01-24T13:05:33.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1906a00640 1 -- 172.21.15.29:0/197628972 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080820c0 con 0x5652741aad30 2024-01-24T13:05:33.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.770+0000 7f1906a00640 1 -- 172.21.15.29:0/197628972 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f190805ba80 con 0x5652741aad30 2024-01-24T13:05:33.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 -- 172.21.15.29:0/197628972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565273fb4a00 con 0x5652741aad30 2024-01-24T13:05:33.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1906a00640 1 -- 172.21.15.29:0/197628972 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f190800e040 con 0x5652741aad30 2024-01-24T13:05:33.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 10 client.5694 fetch_fsmap learned FSMap version 17 2024-01-24T13:05:33.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 -- 172.21.15.29:0/197628972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x565273fa6420 con 0x5652741aad30 2024-01-24T13:05:33.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1906a00640 1 -- 172.21.15.29:0/197628972 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565273fb4a00 con 0x5652741aad30 2024-01-24T13:05:33.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1906a00640 1 -- 172.21.15.29:0/197628972 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f190804f890 con 0x5652741aad30 2024-01-24T13:05:33.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 10 client.5694 fetch_fsmap finished waiting for FSMap version 17 2024-01-24T13:05:33.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 10 client.5694 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-24T13:05:33.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 20 client.5694 populate_metadata read hostname 'smithi029' 2024-01-24T13:05:33.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 --2- 172.21.15.29:0/197628972 >> [v2:172.21.15.163:6834/140413977,v1:172.21.15.163:6837/140413977] conn(0x56527424fb20 0x56527424ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 4 client.5694 mds_command: new command op to 5463 tid=0[{"prefix": "status"}] 2024-01-24T13:05:33.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 -- 172.21.15.29:0/197628972 --> [v2:172.21.15.163:6834/140413977,v1:172.21.15.163:6837/140413977] -- command(tid 0: {"prefix": "status"}) v1 -- 0x565273ff4290 con 0x56527424fb20 2024-01-24T13:05:33.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f191d200640 1 --2- 172.21.15.29:0/197628972 >> [v2:172.21.15.163:6834/140413977,v1:172.21.15.163:6837/140413977] conn(0x56527424fb20 0x56527424ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f191d200640 1 --2- 172.21.15.29:0/197628972 >> [v2:172.21.15.163:6834/140413977,v1:172.21.15.163:6837/140413977] conn(0x56527424fb20 0x56527424ff00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1540e30ad8f099a2 server_cookie=7759626a3d34b4f4 in_seq=0 out_seq=0 2024-01-24T13:05:33.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1906a00640 10 client.5694 ms_handle_connect on v2:172.21.15.163:6834/140413977 2024-01-24T13:05:33.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1906a00640 1 -- 172.21.15.29:0/197628972 <== mds.0 v2:172.21.15.163:6834/140413977 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x565273ff4290 con 0x56527424fb20 2024-01-24T13:05:33.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1906a00640 10 client.5694 handle_command_reply: tid=0 2024-01-24T13:05:33.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 client.5694 shutdown 2024-01-24T13:05:33.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 -- 172.21.15.29:0/197628972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 msgr2=0x565274253020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 --2- 172.21.15.29:0/197628972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x565274253020 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f19080537a0 tx=0x7f190800f000 comp rx=0 tx=0).stop 2024-01-24T13:05:33.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 -- 172.21.15.29:0/197628972 shutdown_connections 2024-01-24T13:05:33.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 --2- 172.21.15.29:0/197628972 >> [v2:172.21.15.163:6834/140413977,v1:172.21.15.163:6837/140413977] conn(0x56527424fb20 0x56527424ff00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 --2- 172.21.15.29:0/197628972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5652741f72a0 0x56527424f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 --2- 172.21.15.29:0/197628972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5652741f6980 0x565274253560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 --2- 172.21.15.29:0/197628972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5652741aad30 0x565274253020 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1906a00640 0 client.5694 ms_handle_reset on v2:172.21.15.163:6834/140413977 2024-01-24T13:05:33.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 -- 172.21.15.29:0/197628972 >> 172.21.15.29:0/197628972 conn(0x5652740b0430 msgr2=0x5652741a8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:33.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 -- 172.21.15.29:0/197628972 shutdown_connections 2024-01-24T13:05:33.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 1 -- 172.21.15.29:0/197628972 wait complete. 2024-01-24T13:05:33.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1923b37000 20 client.5694 trim_cache size 0 max 16384 2024-01-24T13:05:33.784 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:05:33.784 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "065451ff-9152-4ec9-a888-63a66559ccfb", 2024-01-24T13:05:33.784 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-01-24T13:05:33.784 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 5463, 2024-01-24T13:05:33.784 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-01-24T13:05:33.784 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-01-24T13:05:33.784 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-01-24T13:05:33.784 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 10.569520776999999, 2024-01-24T13:05:33.784 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 17, 2024-01-24T13:05:33.784 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 43, 2024-01-24T13:05:33.785 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 43, 2024-01-24T13:05:33.785 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 17.823704007 2024-01-24T13:05:33.785 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:05:33.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1920600640 1 -- 172.21.15.29:0/2356848551 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f18f0065a60 msgr2=0x7f18f0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1920600640 1 --2- 172.21.15.29:0/2356848551 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f18f0065a60 0x7f18f0067f20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f19000af000 tx=0x7f19000a7000 comp rx=0 tx=0).stop 2024-01-24T13:05:33.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1920600640 1 -- 172.21.15.29:0/2356848551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180cd460 msgr2=0x7f19181604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1920600640 1 --2- 172.21.15.29:0/2356848551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180cd460 0x7f19181604a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f190800c4a0 tx=0x7f190800c960 comp rx=0 tx=0).stop 2024-01-24T13:05:33.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1920600640 1 -- 172.21.15.29:0/2356848551 shutdown_connections 2024-01-24T13:05:33.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1920600640 1 --2- 172.21.15.29:0/2356848551 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f18f0065a60 0x7f18f0067f20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1920600640 1 --2- 172.21.15.29:0/2356848551 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19180d0150 0x7f191815ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1920600640 1 --2- 172.21.15.29:0/2356848551 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19180ce5c0 0x7f191814e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1920600640 1 --2- 172.21.15.29:0/2356848551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180cd460 0x7f19181604a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.774+0000 7f1920600640 1 -- 172.21.15.29:0/2356848551 >> 172.21.15.29:0/2356848551 conn(0x7f1918069cd0 msgr2=0x7f191806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:33.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.778+0000 7f1920600640 1 -- 172.21.15.29:0/2356848551 shutdown_connections 2024-01-24T13:05:33.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.778+0000 7f1920600640 1 -- 172.21.15.29:0/2356848551 wait complete. 2024-01-24T13:05:33.800 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-24T13:05:33.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9b2a00640 1 Processor -- start 2024-01-24T13:05:33.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9b2a00640 1 -- start start 2024-01-24T13:05:33.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9b2a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc9ac15c770 0x7fc9ac06d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9b2a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc9ac0cedc0 0x7fc9ac0cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ac071ce0 0x7fc9ac0cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9b2a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ac070d10 con 0x7fc9ac15c770 2024-01-24T13:05:33.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9b2a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ac15cb50 con 0x7fc9ac0cedc0 2024-01-24T13:05:33.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9b2a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac070f20 con 0x7fc9ac071ce0 2024-01-24T13:05:33.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9abe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc9ac15c770 0x7fc9ac06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9abe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc9ac15c770 0x7fc9ac06d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55114/0 (socket says 172.21.15.29:55114) 2024-01-24T13:05:33.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9abe00640 1 -- 172.21.15.29:0/3102068353 learned_addr learned my addr 172.21.15.29:0/3102068353 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:33.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9b0a00640 1 --2- 172.21.15.29:0/3102068353 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ac071ce0 0x7fc9ac0cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9ab400640 1 --2- 172.21.15.29:0/3102068353 >> v2:172.21.15.163:3300/0 conn(0x7fc9ac0cedc0 0x7fc9ac0cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9abe00640 1 -- 172.21.15.29:0/3102068353 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ac071ce0 msgr2=0x7fc9ac0cfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:33.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9abe00640 1 --2- 172.21.15.29:0/3102068353 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ac071ce0 0x7fc9ac0cfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9abe00640 1 -- 172.21.15.29:0/3102068353 >> v2:172.21.15.163:3300/0 conn(0x7fc9ac0cedc0 msgr2=0x7fc9ac0cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:33.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9abe00640 1 --2- 172.21.15.29:0/3102068353 >> v2:172.21.15.163:3300/0 conn(0x7fc9ac0cedc0 0x7fc9ac0cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.938+0000 7fc9abe00640 1 -- 172.21.15.29:0/3102068353 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac071200 con 0x7fc9ac15c770 2024-01-24T13:05:33.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.942+0000 7fc9abe00640 1 --2- 172.21.15.29:0/3102068353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac15c770 0x7fc9ac06d100 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0c9890 tx=0x7fc99c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17bd830cd6d92b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:33.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.942+0000 7fc9aaa00640 1 -- 172.21.15.29:0/3102068353 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c0ab620 con 0x7fc9ac15c770 2024-01-24T13:05:33.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.942+0000 7fc9aaa00640 1 -- 172.21.15.29:0/3102068353 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c0ab780 con 0x7fc9ac15c770 2024-01-24T13:05:33.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.942+0000 7fc9aaa00640 1 -- 172.21.15.29:0/3102068353 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c0abb10 con 0x7fc9ac15c770 2024-01-24T13:05:33.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.942+0000 7fc9b2a00640 1 -- 172.21.15.29:0/3102068353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac15c770 msgr2=0x7fc9ac06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.942+0000 7fc9b2a00640 1 --2- 172.21.15.29:0/3102068353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac15c770 0x7fc9ac06d100 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0c9890 tx=0x7fc99c01c440 comp rx=0 tx=0).stop 2024-01-24T13:05:33.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.942+0000 7fc9b2a00640 1 -- 172.21.15.29:0/3102068353 shutdown_connections 2024-01-24T13:05:33.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.942+0000 7fc9b2a00640 1 --2- 172.21.15.29:0/3102068353 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ac071ce0 0x7fc9ac0cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.942+0000 7fc9b2a00640 1 --2- 172.21.15.29:0/3102068353 >> v2:172.21.15.163:3300/0 conn(0x7fc9ac0cedc0 0x7fc9ac0cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.942+0000 7fc9b2a00640 1 --2- 172.21.15.29:0/3102068353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac15c770 0x7fc9ac06d100 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.942+0000 7fc9b2a00640 1 -- 172.21.15.29:0/3102068353 >> 172.21.15.29:0/3102068353 conn(0x7fc9ac06b1e0 msgr2=0x7fc9ac06b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:33.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.942+0000 7fc9b2a00640 1 -- 172.21.15.29:0/3102068353 shutdown_connections 2024-01-24T13:05:33.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.942+0000 7fc9b2a00640 1 -- 172.21.15.29:0/3102068353 wait complete. 2024-01-24T13:05:33.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9b2a00640 1 Processor -- start 2024-01-24T13:05:33.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9b2a00640 1 -- start start 2024-01-24T13:05:33.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ac071ce0 0x7fc9ac147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0cedc0 0x7fc9ac0af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ac15c770 0x7fc9ac0afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9b2a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac148d00 con 0x7fc9ac0cedc0 2024-01-24T13:05:33.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9b2a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac150b10 con 0x7fc9ac15c770 2024-01-24T13:05:33.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9b2a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac148f50 con 0x7fc9ac071ce0 2024-01-24T13:05:33.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9ab400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0cedc0 0x7fc9ac0af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9ab400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0cedc0 0x7fc9ac0af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55118/0 (socket says 172.21.15.29:55118) 2024-01-24T13:05:33.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9ab400640 1 -- 172.21.15.29:0/2684131044 learned_addr learned my addr 172.21.15.29:0/2684131044 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:33.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9b0a00640 1 --2- 172.21.15.29:0/2684131044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ac15c770 0x7fc9ac0afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9abe00640 1 --2- 172.21.15.29:0/2684131044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ac071ce0 0x7fc9ac147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9ab400640 1 -- 172.21.15.29:0/2684131044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ac071ce0 msgr2=0x7fc9ac147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9ab400640 1 --2- 172.21.15.29:0/2684131044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ac071ce0 0x7fc9ac147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9ab400640 1 -- 172.21.15.29:0/2684131044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ac15c770 msgr2=0x7fc9ac0afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:33.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9ab400640 1 --2- 172.21.15.29:0/2684131044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ac15c770 0x7fc9ac0afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:33.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9ab400640 1 -- 172.21.15.29:0/2684131044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c0094d0 con 0x7fc9ac0cedc0 2024-01-24T13:05:33.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9ab400640 1 --2- 172.21.15.29:0/2684131044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0cedc0 0x7fc9ac0af520 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc99400d800 tx=0x7fc99400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:33.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9a3e00640 1 -- 172.21.15.29:0/2684131044 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99400b6c0 con 0x7fc9ac0cedc0 2024-01-24T13:05:33.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9a3e00640 1 -- 172.21.15.29:0/2684131044 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99400b820 con 0x7fc9ac0cedc0 2024-01-24T13:05:33.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9a3e00640 1 -- 172.21.15.29:0/2684131044 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99400bb90 con 0x7fc9ac0cedc0 2024-01-24T13:05:33.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9b2a00640 1 -- 172.21.15.29:0/2684131044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac149230 con 0x7fc9ac0cedc0 2024-01-24T13:05:33.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9b2a00640 1 -- 172.21.15.29:0/2684131044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ac150db0 con 0x7fc9ac0cedc0 2024-01-24T13:05:33.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.946+0000 7fc9b2a00640 1 -- 172.21.15.29:0/2684131044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ac150f70 con 0x7fc9ac0cedc0 2024-01-24T13:05:33.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.950+0000 7fc9a3e00640 1 -- 172.21.15.29:0/2684131044 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc99400bcf0 con 0x7fc9ac0cedc0 2024-01-24T13:05:33.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.950+0000 7fc9a3e00640 1 --2- 172.21.15.29:0/2684131044 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc984065a60 0x7fc984067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:33.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.950+0000 7fc9a3e00640 1 -- 172.21.15.29:0/2684131044 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc9940837c0 con 0x7fc9ac0cedc0 2024-01-24T13:05:33.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.950+0000 7fc9abe00640 1 --2- 172.21.15.29:0/2684131044 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc984065a60 0x7fc984067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:33.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.950+0000 7fc9abe00640 1 --2- 172.21.15.29:0/2684131044 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc984065a60 0x7fc984067f20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0af000 tx=0x7fc99c0b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:33.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:33.954+0000 7fc9a3e00640 1 -- 172.21.15.29:0/2684131044 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc994051050 con 0x7fc9ac0cedc0 2024-01-24T13:05:34.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:34.146+0000 7fc9b2a00640 1 -- 172.21.15.29:0/2684131044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc9ac04e850 con 0x7fc9ac0cedc0 2024-01-24T13:05:34.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:34.146+0000 7fc9a3e00640 1 -- 172.21.15.29:0/2684131044 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc994054670 con 0x7fc9ac0cedc0 2024-01-24T13:05:34.151 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-24T13:05:34.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:34.150+0000 7fc9b2a00640 1 -- 172.21.15.29:0/2684131044 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc984065a60 msgr2=0x7fc984067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:34.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:34.150+0000 7fc9b2a00640 1 --2- 172.21.15.29:0/2684131044 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc984065a60 0x7fc984067f20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0af000 tx=0x7fc99c0b6040 comp rx=0 tx=0).stop 2024-01-24T13:05:34.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:34.150+0000 7fc9b2a00640 1 -- 172.21.15.29:0/2684131044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0cedc0 msgr2=0x7fc9ac0af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:34.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:34.150+0000 7fc9b2a00640 1 --2- 172.21.15.29:0/2684131044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0cedc0 0x7fc9ac0af520 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc99400d800 tx=0x7fc99400dcc0 comp rx=0 tx=0).stop 2024-01-24T13:05:34.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:34.150+0000 7fc9b2a00640 1 -- 172.21.15.29:0/2684131044 shutdown_connections 2024-01-24T13:05:34.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:34.150+0000 7fc9b2a00640 1 --2- 172.21.15.29:0/2684131044 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc984065a60 0x7fc984067f20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:34.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:34.150+0000 7fc9b2a00640 1 --2- 172.21.15.29:0/2684131044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ac15c770 0x7fc9ac0afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:34.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:34.150+0000 7fc9b2a00640 1 --2- 172.21.15.29:0/2684131044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9ac0cedc0 0x7fc9ac0af520 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:34.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:34.150+0000 7fc9b2a00640 1 --2- 172.21.15.29:0/2684131044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ac071ce0 0x7fc9ac147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:34.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:34.150+0000 7fc9b2a00640 1 -- 172.21.15.29:0/2684131044 >> 172.21.15.29:0/2684131044 conn(0x7fc9ac06b1e0 msgr2=0x7fc9ac0cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:34.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:34.150+0000 7fc9b2a00640 1 -- 172.21.15.29:0/2684131044 shutdown_connections 2024-01-24T13:05:34.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:34.150+0000 7fc9b2a00640 1 -- 172.21.15.29:0/2684131044 wait complete. 2024-01-24T13:05:34.173 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-24T13:05:34.173 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-24T13:05:34.173 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-01-24T13:05:34.173 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-24T13:05:34.173 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-24T13:05:34.173 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-24T13:05:34.173 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-24T13:05:34.173 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-24T13:05:34.173 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:05:34.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:34.174 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-01-24T13:05:34.183 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:05:34.183 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:05:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:05:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-24T13:05:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:34.184 INFO:teuthology.orchestra.run.smithi029.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-24T13:05:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-01-24T13:05:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-01-24T13:05:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-24T13:05:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42364sec preferred_lft 42364sec 2024-01-24T13:05:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-01-24T13:05:34.184 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:34.184 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:05:34.185 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:05:34.185 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-01-24T13:05:34.185 INFO:teuthology.orchestra.run.smithi029.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:05:34.185 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:05:34.185 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-01-24T13:05:34.185 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:05:34.185 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-01-24T13:05:34.185 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-01-24T13:05:34.185 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-24T13:05:34.185 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:b4:3c:c7:07 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:05:34.185 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-24T13:05:34.185 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:34.185 INFO:teuthology.orchestra.run.smithi029.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-24T13:05:34.185 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-24T13:05:34.186 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-24T13:05:34.186 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:34.186 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-24T13:05:34.186 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:34.186 INFO:teuthology.orchestra.run.smithi029.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T13:05:34.186 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-24T13:05:34.186 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-24T13:05:34.186 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:34.186 INFO:teuthology.orchestra.run.smithi029.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T13:05:34.186 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-24T13:05:34.186 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-01-24T13:05:34.186 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:34.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:34.187 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-24T13:05:34.242 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-01-24T13:05:34.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:34.244 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-01-24T13:05:34.297 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-01-24T13:05:34.298 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-24T13:05:34.298 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-24T13:05:34.298 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-24T13:05:34.298 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-24T13:05:34.298 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-24T13:05:34.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:34.298 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:05:34.298 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:05:34.298 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-24T13:05:34.299 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-24T13:05:34.299 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-24T13:05:34.299 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:05:34.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:34.390 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-24T13:05:34.399 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-24T13:05:34.400 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-24T13:05:34.400 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:05:34.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:34.400 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-01-24T13:05:34.460 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-24T13:05:34.460 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:05:34.460 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-24T13:05:34.508 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:05:34.508 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:05:34.508 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-24T13:05:34.559 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:05:34.620 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:05:34.620 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:05:34.682 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:05:34.683 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:05:34.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:34.684 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:05:34.740 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-24T13:05:34.740 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-24T13:05:34.787 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:05:34.807 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:05:34.808 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:05:34.866 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:05:34.868 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:05:34.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:34.869 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:05:34.882 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2024-01-24T13:05:34.878+0000 7fdffb63a580 -1 init, newargv = 0x55979618cc60 newargc=15 2024-01-24T13:05:34.882 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[37111]: starting ceph client 2024-01-24T13:05:34.889 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[37111]: starting fuse 2024-01-24T13:05:34.890 INFO:teuthology.orchestra.run.smithi029.stdout:43 2024-01-24T13:05:34.890 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-24T13:05:34.890 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-24T13:05:34.890 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:05:34.891 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-01-24T13:05:34.892 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-24T13:05:34.892 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-24T13:05:34.892 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-24T13:05:34.892 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-01-24T13:05:34.892 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-01-24T13:05:34.892 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-01-24T13:05:34.892 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-24T13:05:34.892 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:05:34.892 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2024-01-24T13:05:34.892 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-01-24T13:05:35.012 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.37111.asok 2024-01-24T13:05:35.196 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37111.asok 2024-01-24T13:05:35.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:35.196 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37111.asok status 2024-01-24T13:05:35.374 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:05:35.374 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-01-24T13:05:35.374 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "4e3182a65800aed6d4aa2f6b86da3cfd72188134", 2024-01-24T13:05:35.374 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable)", 2024-01-24T13:05:35.374 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2024-01-24T13:05:35.374 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-01-24T13:05:35.374 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-24T13:05:35.374 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "37111", 2024-01-24T13:05:35.374 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-01-24T13:05:35.374 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:35.375 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-01-24T13:05:35.375 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-01-24T13:05:35.375 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 5709, 2024-01-24T13:05:35.375 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-01-24T13:05:35.375 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-01-24T13:05:35.375 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-01-24T13:05:35.375 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 5709 2024-01-24T13:05:35.375 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:35.375 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:05:35.375 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:05:35.375 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:05:35.375 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3984699086 2024-01-24T13:05:35.375 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:35.376 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:35.376 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:05:35.376 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:05:35.376 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:05:35.376 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3984699086 2024-01-24T13:05:35.376 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:35.376 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.5709 192.168.0.1:0/3984699086", 2024-01-24T13:05:35.376 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/3984699086", 2024-01-24T13:05:35.376 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-01-24T13:05:35.376 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 17, 2024-01-24T13:05:35.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 43, 2024-01-24T13:05:35.376 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-01-24T13:05:35.376 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-01-24T13:05:35.377 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-01-24T13:05:35.377 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:05:35.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:35.389 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-01-24T13:05:35.389 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-24T13:05:35.398 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-01-24T13:05:35.398 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-24T13:05:35.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:35.399 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-24T13:05:35.465 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2024-01-24T13:05:35.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.646+0000 7f214fc00640 1 Processor -- start 2024-01-24T13:05:35.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.646+0000 7f214fc00640 1 -- start start 2024-01-24T13:05:35.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.650+0000 7f214fc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21480cd420 0x7f21480d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:35.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.650+0000 7f214fc00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f214815ac10 0x7f214815b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:35.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.650+0000 7f214fc00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21480d0400 con 0x7f21480cab00 2024-01-24T13:05:35.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.650+0000 7f214fc00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21480d09c0 con 0x7f214815ac10 2024-01-24T13:05:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.650+0000 7f214fc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214815b6d0 con 0x7f21480cd420 2024-01-24T13:05:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.650+0000 7f2147e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f214815ac10 0x7f214815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.650+0000 7f214dc00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f21480cab00 0x7f21480ce080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37986/0 (socket says 172.21.15.29:37986) 2024-01-24T13:05:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.650+0000 7f214dc00640 1 -- 172.21.15.29:0/1399594234 learned_addr learned my addr 172.21.15.29:0/1399594234 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.650+0000 7f214d200640 1 --2- 172.21.15.29:0/1399594234 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21480cd420 0x7f21480d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.650+0000 7f2147e00640 1 -- 172.21.15.29:0/1399594234 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21480cd420 msgr2=0x7f21480d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.650+0000 7f2147e00640 1 --2- 172.21.15.29:0/1399594234 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21480cd420 0x7f21480d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.650+0000 7f2147e00640 1 -- 172.21.15.29:0/1399594234 >> v1:172.21.15.29:6789/0 conn(0x7f21480cab00 legacy=0x7f21480ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:35.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.650+0000 7f2147e00640 1 -- 172.21.15.29:0/1399594234 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214815b9b0 con 0x7f214815ac10 2024-01-24T13:05:35.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.650+0000 7f2147400640 1 -- 172.21.15.29:0/1399594234 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013211942 0 0) 0x7f21480d0400 con 0x7f21480cab00 2024-01-24T13:05:35.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.654+0000 7f2147e00640 1 --2- 172.21.15.29:0/1399594234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f214815ac10 0x7f214815b070 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f21300097c0 tx=0x7f213001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa32bc332900dfd server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:35.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.654+0000 7f2147400640 1 -- 172.21.15.29:0/1399594234 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21300ab670 con 0x7f214815ac10 2024-01-24T13:05:35.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.654+0000 7f2147400640 1 -- 172.21.15.29:0/1399594234 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21300ab7d0 con 0x7f214815ac10 2024-01-24T13:05:35.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.654+0000 7f2147400640 1 -- 172.21.15.29:0/1399594234 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21300abb60 con 0x7f214815ac10 2024-01-24T13:05:35.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.654+0000 7f214fc00640 1 -- 172.21.15.29:0/1399594234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f214815ac10 msgr2=0x7f214815b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:35.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.654+0000 7f214fc00640 1 --2- 172.21.15.29:0/1399594234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f214815ac10 0x7f214815b070 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f21300097c0 tx=0x7f213001c450 comp rx=0 tx=0).stop 2024-01-24T13:05:35.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.654+0000 7f214fc00640 1 -- 172.21.15.29:0/1399594234 shutdown_connections 2024-01-24T13:05:35.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.654+0000 7f214fc00640 1 --2- 172.21.15.29:0/1399594234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f214815ac10 0x7f214815b070 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:35.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.654+0000 7f214fc00640 1 --2- 172.21.15.29:0/1399594234 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21480cd420 0x7f21480d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:35.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.654+0000 7f214fc00640 1 -- 172.21.15.29:0/1399594234 >> 172.21.15.29:0/1399594234 conn(0x7f2148069cd0 msgr2=0x7f214806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:35.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.654+0000 7f214fc00640 1 -- 172.21.15.29:0/1399594234 shutdown_connections 2024-01-24T13:05:35.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.654+0000 7f214fc00640 1 -- 172.21.15.29:0/1399594234 wait complete. 2024-01-24T13:05:35.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.654+0000 7f214fc00640 1 Processor -- start 2024-01-24T13:05:35.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.654+0000 7f214fc00640 1 -- start start 2024-01-24T13:05:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214fc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21480cab00 0x7f21480c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214fc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21480cd420 0x7f214813f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214fc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f214815ac10 0x7f214815c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214fc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21480b4410 con 0x7f21480cab00 2024-01-24T13:05:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214fc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21480c8b40 con 0x7f21480cd420 2024-01-24T13:05:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214fc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21480b3ae0 con 0x7f214815ac10 2024-01-24T13:05:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214d200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21480cab00 0x7f21480c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214d200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21480cab00 0x7f21480c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55140/0 (socket says 172.21.15.29:55140) 2024-01-24T13:05:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214d200640 1 -- 172.21.15.29:0/3318734592 learned_addr learned my addr 172.21.15.29:0/3318734592 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f2147e00640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21480cd420 0x7f214813f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214dc00640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f214815ac10 0x7f214815c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214d200640 1 -- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f214815ac10 msgr2=0x7f214815c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214d200640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f214815ac10 0x7f214815c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214d200640 1 -- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21480cd420 msgr2=0x7f214813f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214d200640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21480cd420 0x7f214813f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214d200640 1 -- 172.21.15.29:0/3318734592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2130009420 con 0x7f21480cab00 2024-01-24T13:05:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214dc00640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f214815ac10 0x7f214815c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214d200640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21480cab00 0x7f21480c8560 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f213800d800 tx=0x7f213800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f2144c00640 1 -- 172.21.15.29:0/3318734592 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213800b6c0 con 0x7f21480cab00 2024-01-24T13:05:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f2144c00640 1 -- 172.21.15.29:0/3318734592 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213800b820 con 0x7f21480cab00 2024-01-24T13:05:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f2144c00640 1 -- 172.21.15.29:0/3318734592 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213800bb90 con 0x7f21480cab00 2024-01-24T13:05:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214fc00640 1 -- 172.21.15.29:0/3318734592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21480b3dc0 con 0x7f21480cab00 2024-01-24T13:05:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214fc00640 1 -- 172.21.15.29:0/3318734592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21480b48a0 con 0x7f21480cab00 2024-01-24T13:05:35.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.658+0000 7f214fc00640 1 -- 172.21.15.29:0/3318734592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214804e000 con 0x7f21480cab00 2024-01-24T13:05:35.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.662+0000 7f2144c00640 1 -- 172.21.15.29:0/3318734592 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f213800bcf0 con 0x7f21480cab00 2024-01-24T13:05:35.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.662+0000 7f2144c00640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2120065a60 0x7f2120067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:35.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.662+0000 7f2144c00640 1 -- 172.21.15.29:0/3318734592 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2138083900 con 0x7f21480cab00 2024-01-24T13:05:35.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.662+0000 7f2147e00640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2120065a60 0x7f2120067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:35.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.662+0000 7f2147e00640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2120065a60 0x7f2120067f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f21300af000 tx=0x7f2130008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:35.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.666+0000 7f2144c00640 1 -- 172.21.15.29:0/3318734592 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f21380510e0 con 0x7f21480cab00 2024-01-24T13:05:35.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:35.822+0000 7f214fc00640 1 -- 172.21.15.29:0/3318734592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) v1 -- 0x7f21480b2a60 con 0x7f21480cab00 2024-01-24T13:05:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.334+0000 7f2144c00640 1 -- 172.21.15.29:0/3318734592 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v44) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2138011340 con 0x7f21480cab00 2024-01-24T13:05:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'data_new' created 2024-01-24T13:05:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.338+0000 7f214fc00640 1 -- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2120065a60 msgr2=0x7f2120067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.338+0000 7f214fc00640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2120065a60 0x7f2120067f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f21300af000 tx=0x7f2130008040 comp rx=0 tx=0).stop 2024-01-24T13:05:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.338+0000 7f214fc00640 1 -- 172.21.15.29:0/3318734592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21480cab00 msgr2=0x7f21480c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.338+0000 7f214fc00640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21480cab00 0x7f21480c8560 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f213800d800 tx=0x7f213800dcc0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.338+0000 7f214fc00640 1 -- 172.21.15.29:0/3318734592 shutdown_connections 2024-01-24T13:05:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.338+0000 7f214fc00640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2120065a60 0x7f2120067f20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.338+0000 7f214fc00640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f214815ac10 0x7f214815c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.338+0000 7f214fc00640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21480cd420 0x7f214813f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.338+0000 7f214fc00640 1 --2- 172.21.15.29:0/3318734592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21480cab00 0x7f21480c8560 secure :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f213800d800 tx=0x7f213800dcc0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.338+0000 7f214fc00640 1 -- 172.21.15.29:0/3318734592 >> 172.21.15.29:0/3318734592 conn(0x7f2148069cd0 msgr2=0x7f21480afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.342+0000 7f214fc00640 1 -- 172.21.15.29:0/3318734592 shutdown_connections 2024-01-24T13:05:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.342+0000 7f214fc00640 1 -- 172.21.15.29:0/3318734592 wait complete. 2024-01-24T13:05:36.375 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2024-01-24T13:05:36.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f732f400640 1 Processor -- start 2024-01-24T13:05:36.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f732f400640 1 -- start start 2024-01-24T13:05:36.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f732f400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f732806c220 0x7f73280b1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:36.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f732f400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f73280b1ed0 0x7f7328070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:36.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f732f400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732815a1e0 con 0x7f7328159e00 2024-01-24T13:05:36.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f732f400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73280b2c80 con 0x7f732806c220 2024-01-24T13:05:36.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f732f400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732806fc00 con 0x7f73280b1ed0 2024-01-24T13:05:36.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f7327e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f732806c220 0x7f73280b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:36.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f7327e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f732806c220 0x7f73280b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55152/0 (socket says 172.21.15.29:55152) 2024-01-24T13:05:36.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f7327e00640 1 -- 172.21.15.29:0/1215076069 learned_addr learned my addr 172.21.15.29:0/1215076069 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:36.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f732d400640 1 --2- 172.21.15.29:0/1215076069 >> v2:172.21.15.163:3300/0 conn(0x7f73280b1ed0 0x7f7328070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:36.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f7327e00640 1 -- 172.21.15.29:0/1215076069 >> v2:172.21.15.163:3300/0 conn(0x7f73280b1ed0 msgr2=0x7f7328070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:36.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f7327e00640 1 --2- 172.21.15.29:0/1215076069 >> v2:172.21.15.163:3300/0 conn(0x7f73280b1ed0 0x7f7328070610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f7327e00640 1 -- 172.21.15.29:0/1215076069 >> v1:172.21.15.163:6789/0 conn(0x7f7328159e00 legacy=0x7f732806bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:36.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.518+0000 7f7327e00640 1 -- 172.21.15.29:0/1215076069 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7328070180 con 0x7f732806c220 2024-01-24T13:05:36.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.522+0000 7f7327e00640 1 --2- 172.21.15.29:0/1215076069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f732806c220 0x7f73280b1990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7328156da0 tx=0x7f731001ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226788386ca2aec6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:36.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.522+0000 7f7327400640 1 -- 172.21.15.29:0/1215076069 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73100a7ad0 con 0x7f732806c220 2024-01-24T13:05:36.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.522+0000 7f7327400640 1 -- 172.21.15.29:0/1215076069 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73100a7c30 con 0x7f732806c220 2024-01-24T13:05:36.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.522+0000 7f7327400640 1 -- 172.21.15.29:0/1215076069 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73100af440 con 0x7f732806c220 2024-01-24T13:05:36.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.522+0000 7f732f400640 1 -- 172.21.15.29:0/1215076069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f732806c220 msgr2=0x7f73280b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:36.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.522+0000 7f732f400640 1 --2- 172.21.15.29:0/1215076069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f732806c220 0x7f73280b1990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7328156da0 tx=0x7f731001ea80 comp rx=0 tx=0).stop 2024-01-24T13:05:36.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.522+0000 7f732f400640 1 -- 172.21.15.29:0/1215076069 shutdown_connections 2024-01-24T13:05:36.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.522+0000 7f732f400640 1 --2- 172.21.15.29:0/1215076069 >> v2:172.21.15.163:3300/0 conn(0x7f73280b1ed0 0x7f7328070610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.522+0000 7f732f400640 1 --2- 172.21.15.29:0/1215076069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f732806c220 0x7f73280b1990 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.522+0000 7f732f400640 1 -- 172.21.15.29:0/1215076069 >> 172.21.15.29:0/1215076069 conn(0x7f732806d790 msgr2=0x7f7328069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:36.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.522+0000 7f732f400640 1 -- 172.21.15.29:0/1215076069 shutdown_connections 2024-01-24T13:05:36.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.522+0000 7f732f400640 1 -- 172.21.15.29:0/1215076069 wait complete. 2024-01-24T13:05:36.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732f400640 1 Processor -- start 2024-01-24T13:05:36.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732f400640 1 -- start start 2024-01-24T13:05:36.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f732806c220 0x7f732814c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:36.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732f400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f73280b1ed0 0x7f7328145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:36.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732f400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7328159e00 0x7f732814fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:36.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732f400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732814dd80 con 0x7f7328159e00 2024-01-24T13:05:36.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732f400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732814d170 con 0x7f732806c220 2024-01-24T13:05:36.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732f400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732814d450 con 0x7f73280b1ed0 2024-01-24T13:05:36.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732d400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7328159e00 0x7f732814fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:36.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732d400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7328159e00 0x7f732814fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55156/0 (socket says 172.21.15.29:55156) 2024-01-24T13:05:36.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732d400640 1 -- 172.21.15.29:0/63876727 learned_addr learned my addr 172.21.15.29:0/63876727 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:36.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732ca00640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f732806c220 0x7f732814c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:36.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f7327e00640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f73280b1ed0 0x7f7328145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:36.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732d400640 1 -- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f73280b1ed0 msgr2=0x7f7328145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:36.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732d400640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f73280b1ed0 0x7f7328145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732d400640 1 -- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f732806c220 msgr2=0x7f732814c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:36.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732d400640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f732806c220 0x7f732814c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732d400640 1 -- 172.21.15.29:0/63876727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731000b770 con 0x7f7328159e00 2024-01-24T13:05:36.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732ca00640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f732806c220 0x7f732814c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:36.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f732d400640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7328159e00 0x7f732814fea0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7320007e40 tx=0x7f732000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:36.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.526+0000 7f7324c00640 1 -- 172.21.15.29:0/63876727 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320014620 con 0x7f7328159e00 2024-01-24T13:05:36.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.530+0000 7f7324c00640 1 -- 172.21.15.29:0/63876727 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732000ee90 con 0x7f7328159e00 2024-01-24T13:05:36.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.530+0000 7f732f400640 1 -- 172.21.15.29:0/63876727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732814d730 con 0x7f7328159e00 2024-01-24T13:05:36.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.530+0000 7f7324c00640 1 -- 172.21.15.29:0/63876727 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73200149e0 con 0x7f7328159e00 2024-01-24T13:05:36.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.530+0000 7f732f400640 1 -- 172.21.15.29:0/63876727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732814ce60 con 0x7f7328159e00 2024-01-24T13:05:36.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.530+0000 7f732f400640 1 -- 172.21.15.29:0/63876727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f732814def0 con 0x7f7328159e00 2024-01-24T13:05:36.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.530+0000 7f7324c00640 1 -- 172.21.15.29:0/63876727 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7320014b40 con 0x7f7328159e00 2024-01-24T13:05:36.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.530+0000 7f7324c00640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7300065a60 0x7f7300067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:36.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.530+0000 7f7324c00640 1 -- 172.21.15.29:0/63876727 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6392+0+0 (secure 0 0 0) 0x7f7320083e60 con 0x7f7328159e00 2024-01-24T13:05:36.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.530+0000 7f732ca00640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7300065a60 0x7f7300067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:36.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.534+0000 7f732ca00640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7300065a60 0x7f7300067f20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7318000f70 tx=0x7f7318009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:36.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.534+0000 7f7324c00640 1 -- 172.21.15.29:0/63876727 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7320051450 con 0x7f7328159e00 2024-01-24T13:05:36.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.726+0000 7f732f400640 1 -- 172.21.15.29:0/63876727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) v1 -- 0x7f732804e850 con 0x7f7328159e00 2024-01-24T13:05:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.734+0000 7f7324c00640 1 -- 172.21.15.29:0/63876727 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 7 to fsmap v18) v1 ==== 131+0+0 (secure 0 0 0) 0x7f7320054a70 con 0x7f7328159e00 2024-01-24T13:05:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:added data pool 7 to fsmap 2024-01-24T13:05:36.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.738+0000 7f732f400640 1 -- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7300065a60 msgr2=0x7f7300067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:36.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.738+0000 7f732f400640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7300065a60 0x7f7300067f20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7318000f70 tx=0x7f7318009040 comp rx=0 tx=0).stop 2024-01-24T13:05:36.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.738+0000 7f732f400640 1 -- 172.21.15.29:0/63876727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7328159e00 msgr2=0x7f732814fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:36.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.738+0000 7f732f400640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7328159e00 0x7f732814fea0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7320007e40 tx=0x7f732000e4b0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.738+0000 7f732f400640 1 -- 172.21.15.29:0/63876727 shutdown_connections 2024-01-24T13:05:36.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.738+0000 7f732f400640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7300065a60 0x7f7300067f20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.738+0000 7f732f400640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7328159e00 0x7f732814fea0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.738+0000 7f732f400640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f73280b1ed0 0x7f7328145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.738+0000 7f732f400640 1 --2- 172.21.15.29:0/63876727 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f732806c220 0x7f732814c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.738+0000 7f732f400640 1 -- 172.21.15.29:0/63876727 >> 172.21.15.29:0/63876727 conn(0x7f732806d790 msgr2=0x7f73280cb560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:36.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.742+0000 7f732f400640 1 -- 172.21.15.29:0/63876727 shutdown_connections 2024-01-24T13:05:36.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.742+0000 7f732f400640 1 -- 172.21.15.29:0/63876727 wait complete. 2024-01-24T13:05:36.773 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:05:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.910+0000 7f1138800640 1 Processor -- start 2024-01-24T13:05:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.910+0000 7f1138800640 1 -- start start 2024-01-24T13:05:36.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.910+0000 7f1138800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1130143910 0x7f1130143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:36.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.910+0000 7f1138800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1130070ac0 0x7f113006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:36.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.910+0000 7f1138800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113015aa30 con 0x7f113006c150 2024-01-24T13:05:36.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.910+0000 7f1138800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113006c5a0 con 0x7f1130070ac0 2024-01-24T13:05:36.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.910+0000 7f1138800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11300712a0 con 0x7f1130143910 2024-01-24T13:05:36.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.910+0000 7f1135400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1130070ac0 0x7f113006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:36.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.910+0000 7f1135400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1130070ac0 0x7f113006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55160/0 (socket says 172.21.15.29:55160) 2024-01-24T13:05:36.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.910+0000 7f1135400640 1 -- 172.21.15.29:0/2642605748 learned_addr learned my addr 172.21.15.29:0/2642605748 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:36.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.910+0000 7f1135e00640 1 --2- 172.21.15.29:0/2642605748 >> v2:172.21.15.163:3300/0 conn(0x7f1130143910 0x7f1130143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:36.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.914+0000 7f1135400640 1 -- 172.21.15.29:0/2642605748 >> v2:172.21.15.163:3300/0 conn(0x7f1130143910 msgr2=0x7f1130143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:36.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.914+0000 7f1135400640 1 --2- 172.21.15.29:0/2642605748 >> v2:172.21.15.163:3300/0 conn(0x7f1130143910 0x7f1130143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.914+0000 7f1135400640 1 -- 172.21.15.29:0/2642605748 >> v1:172.21.15.163:6789/0 conn(0x7f113006c150 legacy=0x7f113015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:36.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.914+0000 7f1135400640 1 -- 172.21.15.29:0/2642605748 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1130071580 con 0x7f1130070ac0 2024-01-24T13:05:36.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.914+0000 7f1135e00640 1 --2- 172.21.15.29:0/2642605748 >> v2:172.21.15.163:3300/0 conn(0x7f1130143910 0x7f1130143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.914+0000 7f1135400640 1 --2- 172.21.15.29:0/2642605748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1130070ac0 0x7f113006bc10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f113006dd90 tx=0x7f111801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2238902ad64a623 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.914+0000 7f1134a00640 1 -- 172.21.15.29:0/2642605748 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11180ab5f0 con 0x7f1130070ac0 2024-01-24T13:05:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.914+0000 7f1134a00640 1 -- 172.21.15.29:0/2642605748 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11180ab750 con 0x7f1130070ac0 2024-01-24T13:05:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.914+0000 7f1134a00640 1 -- 172.21.15.29:0/2642605748 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11180abae0 con 0x7f1130070ac0 2024-01-24T13:05:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 -- 172.21.15.29:0/2642605748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1130070ac0 msgr2=0x7f113006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 --2- 172.21.15.29:0/2642605748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1130070ac0 0x7f113006bc10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f113006dd90 tx=0x7f111801c4d0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 -- 172.21.15.29:0/2642605748 shutdown_connections 2024-01-24T13:05:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 --2- 172.21.15.29:0/2642605748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1130070ac0 0x7f113006bc10 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 --2- 172.21.15.29:0/2642605748 >> v2:172.21.15.163:3300/0 conn(0x7f1130143910 0x7f1130143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 -- 172.21.15.29:0/2642605748 >> 172.21.15.29:0/2642605748 conn(0x7f11300b3950 msgr2=0x7f1130069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 -- 172.21.15.29:0/2642605748 shutdown_connections 2024-01-24T13:05:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 -- 172.21.15.29:0/2642605748 wait complete. 2024-01-24T13:05:36.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 Processor -- start 2024-01-24T13:05:36.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 -- start start 2024-01-24T13:05:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f113006c150 0x7f113013b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1130070ac0 0x7f113015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1130143910 0x7f1130159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113015d200 con 0x7f1130070ac0 2024-01-24T13:05:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113015c5f0 con 0x7f1130143910 2024-01-24T13:05:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1138800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113015c8d0 con 0x7f113006c150 2024-01-24T13:05:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1135400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1130070ac0 0x7f113015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1135400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1130070ac0 0x7f113015bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55166/0 (socket says 172.21.15.29:55166) 2024-01-24T13:05:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1135400640 1 -- 172.21.15.29:0/1255682909 learned_addr learned my addr 172.21.15.29:0/1255682909 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1135e00640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f113006c150 0x7f113013b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1136800640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1130143910 0x7f1130159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1135400640 1 -- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f113006c150 msgr2=0x7f113013b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1135400640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f113006c150 0x7f113013b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1135400640 1 -- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1130143910 msgr2=0x7f1130159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1135400640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1130143910 0x7f1130159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1135400640 1 -- 172.21.15.29:0/1255682909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11180094d0 con 0x7f1130070ac0 2024-01-24T13:05:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.918+0000 7f1136800640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1130143910 0x7f1130159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.922+0000 7f1135400640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1130070ac0 0x7f113015bdc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f11180190e0 tx=0x7f111801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:36.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.922+0000 7f112e000640 1 -- 172.21.15.29:0/1255682909 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11180be5f0 con 0x7f1130070ac0 2024-01-24T13:05:36.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.922+0000 7f112e000640 1 -- 172.21.15.29:0/1255682909 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11180be750 con 0x7f1130070ac0 2024-01-24T13:05:36.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.922+0000 7f1138800640 1 -- 172.21.15.29:0/1255682909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113015cbb0 con 0x7f1130070ac0 2024-01-24T13:05:36.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.922+0000 7f112e000640 1 -- 172.21.15.29:0/1255682909 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11180beb00 con 0x7f1130070ac0 2024-01-24T13:05:36.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.922+0000 7f1138800640 1 -- 172.21.15.29:0/1255682909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113015c300 con 0x7f1130070ac0 2024-01-24T13:05:36.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.922+0000 7f1138800640 1 -- 172.21.15.29:0/1255682909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113015d370 con 0x7f1130070ac0 2024-01-24T13:05:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.922+0000 7f112e000640 1 -- 172.21.15.29:0/1255682909 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f11180b43f0 con 0x7f1130070ac0 2024-01-24T13:05:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.922+0000 7f112e000640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1108065a60 0x7f1108067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.922+0000 7f112e000640 1 -- 172.21.15.29:0/1255682909 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f11180a8050 con 0x7f1130070ac0 2024-01-24T13:05:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.922+0000 7f1135e00640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1108065a60 0x7f1108067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.926+0000 7f1135e00640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1108065a60 0x7f1108067f20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f11200045f0 tx=0x7f1120008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:36.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:36.926+0000 7f112e000640 1 -- 172.21.15.29:0/1255682909 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f11180eb730 con 0x7f1130070ac0 2024-01-24T13:05:37.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.118+0000 7f1138800640 1 -- 172.21.15.29:0/1255682909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f113004e850 con 0x7f1130070ac0 2024-01-24T13:05:37.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.118+0000 7f112e000640 1 -- 172.21.15.29:0/1255682909 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f11180c4090 con 0x7f1130070ac0 2024-01-24T13:05:37.121 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:37.121 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3468790539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3468790539},{"type":"v1","addr":"172.21.15.29:6834","nonce":3468790539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3278958688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3278958688},{"type":"v1","addr":"172.21.15.29:6835","nonce":3278958688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/1296970243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1296970243},{"type":"v1","addr":"172.21.15.163:6836","nonce":1296970243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:05:23.206301+0000","modified":"2024-01-24T13:05:36.732142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5463":{"gid":5463,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/140413977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":140413977},{"type":"v1","addr":"172.21.15.163:6837","nonce":140413977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-24T13:05:37.122 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-01-24T13:05:37.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.118+0000 7f1138800640 1 -- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1108065a60 msgr2=0x7f1108067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.118+0000 7f1138800640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1108065a60 0x7f1108067f20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f11200045f0 tx=0x7f1120008040 comp rx=0 tx=0).stop 2024-01-24T13:05:37.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.118+0000 7f1138800640 1 -- 172.21.15.29:0/1255682909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1130070ac0 msgr2=0x7f113015bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.118+0000 7f1138800640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1130070ac0 0x7f113015bdc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f11180190e0 tx=0x7f111801ad10 comp rx=0 tx=0).stop 2024-01-24T13:05:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.118+0000 7f1138800640 1 -- 172.21.15.29:0/1255682909 shutdown_connections 2024-01-24T13:05:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.118+0000 7f1138800640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1108065a60 0x7f1108067f20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.118+0000 7f1138800640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1130143910 0x7f1130159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.118+0000 7f1138800640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1130070ac0 0x7f113015bdc0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.118+0000 7f1138800640 1 --2- 172.21.15.29:0/1255682909 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f113006c150 0x7f113013b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.118+0000 7f1138800640 1 -- 172.21.15.29:0/1255682909 >> 172.21.15.29:0/1255682909 conn(0x7f11300b3950 msgr2=0x7f11300af100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.118+0000 7f1138800640 1 -- 172.21.15.29:0/1255682909 shutdown_connections 2024-01-24T13:05:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.118+0000 7f1138800640 1 -- 172.21.15.29:0/1255682909 wait complete. 2024-01-24T13:05:37.143 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:37.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.278+0000 7f0cdfc00640 1 Processor -- start 2024-01-24T13:05:37.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.278+0000 7f0cdfc00640 1 -- start start 2024-01-24T13:05:37.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cdfc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0cd80ce5e0 0x7f0cd80abd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:37.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cdfc00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd8070230 con 0x7f0cd815c450 2024-01-24T13:05:37.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cdfc00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd8070510 con 0x7f0cd80b1f50 2024-01-24T13:05:37.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cdfc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80712d0 con 0x7f0cd80ce5e0 2024-01-24T13:05:37.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cdd200640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0cd815c450 0x7f0cd80cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37998/0 (socket says 172.21.15.29:37998) 2024-01-24T13:05:37.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cdd200640 1 -- 172.21.15.29:0/2970893032 learned_addr learned my addr 172.21.15.29:0/2970893032 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:37.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 -- 172.21.15.29:0/2970893032 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744853242 0 0) 0x7f0cd8070230 con 0x7f0cd815c450 2024-01-24T13:05:37.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 -- 172.21.15.29:0/2970893032 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cb8003530 con 0x7f0cd815c450 2024-01-24T13:05:37.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7e00640 1 --2- 172.21.15.29:0/2970893032 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0cd80ce5e0 0x7f0cd80abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:37.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 -- 172.21.15.29:0/2970893032 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2584547874 0 0) 0x7f0cb8003530 con 0x7f0cd815c450 2024-01-24T13:05:37.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 -- 172.21.15.29:0/2970893032 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0cd80ce5e0 msgr2=0x7f0cd80abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 --2- 172.21.15.29:0/2970893032 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0cd80ce5e0 0x7f0cd80abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 -- 172.21.15.29:0/2970893032 >> v1:172.21.15.163:6789/0 conn(0x7f0cd80b1f50 legacy=0x7f0cd80ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 -- 172.21.15.29:0/2970893032 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80707f0 con 0x7f0cd815c450 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 -- 172.21.15.29:0/2970893032 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f0cc8001680 con 0x7f0cd815c450 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 -- 172.21.15.29:0/2970893032 >> v1:172.21.15.29:6789/0 conn(0x7f0cd815c450 legacy=0x7f0cd80cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 --2- 172.21.15.29:0/2970893032 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0cd80ce5e0 0x7f0cb80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 --2- 172.21.15.29:0/2970893032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb8003f30 0x7f0cb80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 --2- 172.21.15.29:0/2970893032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cb8004d10 0x7f0cb8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 -- 172.21.15.29:0/2970893032 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb800ba40 con 0x7f0cb8003f30 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 -- 172.21.15.29:0/2970893032 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb800bbb0 con 0x7f0cb8004d10 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7400640 1 -- 172.21.15.29:0/2970893032 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb800bd70 con 0x7f0cd80ce5e0 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7e00640 1 --2- 172.21.15.29:0/2970893032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb8003f30 0x7f0cb80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cdd200640 1 --2- 172.21.15.29:0/2970893032 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0cd80ce5e0 0x7f0cb80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cddc00640 1 --2- 172.21.15.29:0/2970893032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cb8004d10 0x7f0cb8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7e00640 1 -- 172.21.15.29:0/2970893032 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0cd80ce5e0 msgr2=0x7f0cb80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:37.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7e00640 1 --2- 172.21.15.29:0/2970893032 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0cd80ce5e0 0x7f0cb80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7e00640 1 -- 172.21.15.29:0/2970893032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cb8004d10 msgr2=0x7f0cb8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:37.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7e00640 1 --2- 172.21.15.29:0/2970893032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cb8004d10 0x7f0cb8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cd7e00640 1 -- 172.21.15.29:0/2970893032 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8003530 con 0x7f0cb8003f30 2024-01-24T13:05:37.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.282+0000 7f0cddc00640 1 --2- 172.21.15.29:0/2970893032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cb8004d10 0x7f0cb8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:37.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.286+0000 7f0cd7e00640 1 --2- 172.21.15.29:0/2970893032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb8003f30 0x7f0cb80047d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009ae0 tx=0x7f0cc001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fef2921bd43409 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:37.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.286+0000 7f0cd7400640 1 -- 172.21.15.29:0/2970893032 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00a5540 con 0x7f0cb8003f30 2024-01-24T13:05:37.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.286+0000 7f0cd7400640 1 -- 172.21.15.29:0/2970893032 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc00a56a0 con 0x7f0cb8003f30 2024-01-24T13:05:37.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.286+0000 7f0cd7400640 1 -- 172.21.15.29:0/2970893032 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00a5a50 con 0x7f0cb8003f30 2024-01-24T13:05:37.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.286+0000 7f0cdfc00640 1 -- 172.21.15.29:0/2970893032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb8003f30 msgr2=0x7f0cb80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.286+0000 7f0cdfc00640 1 --2- 172.21.15.29:0/2970893032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb8003f30 0x7f0cb80047d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009ae0 tx=0x7f0cc001ca50 comp rx=0 tx=0).stop 2024-01-24T13:05:37.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.286+0000 7f0cddc00640 1 -- 172.21.15.29:0/2970893032 reap_dead start 2024-01-24T13:05:37.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.286+0000 7f0cdfc00640 1 -- 172.21.15.29:0/2970893032 shutdown_connections 2024-01-24T13:05:37.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.286+0000 7f0cdfc00640 1 -- 172.21.15.29:0/2970893032 >> 172.21.15.29:0/2970893032 conn(0x7f0cd80b3950 msgr2=0x7f0cd8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:37.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.286+0000 7f0cdfc00640 1 -- 172.21.15.29:0/2970893032 shutdown_connections 2024-01-24T13:05:37.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.286+0000 7f0cdfc00640 1 -- 172.21.15.29:0/2970893032 wait complete. 2024-01-24T13:05:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cdfc00640 1 Processor -- start 2024-01-24T13:05:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cdfc00640 1 -- start start 2024-01-24T13:05:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cdfc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0cb8003f30 0x7f0cd80cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cdfc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cd8144c90 0x7f0cd80cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cdfc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cd8154b00 0x7f0cd8154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cdfc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd81554c0 con 0x7f0cd8154b00 2024-01-24T13:05:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cdfc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80cb5e0 con 0x7f0cd8144c90 2024-01-24T13:05:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cdfc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80ca9d0 con 0x7f0cb8003f30 2024-01-24T13:05:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cddc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cd8154b00 0x7f0cd8154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cddc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cd8154b00 0x7f0cd8154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55188/0 (socket says 172.21.15.29:55188) 2024-01-24T13:05:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cddc00640 1 -- 172.21.15.29:0/777607927 learned_addr learned my addr 172.21.15.29:0/777607927 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cdd200640 1 --2- 172.21.15.29:0/777607927 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0cb8003f30 0x7f0cd80cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cd7e00640 1 --2- 172.21.15.29:0/777607927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cd8144c90 0x7f0cd80cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cddc00640 1 -- 172.21.15.29:0/777607927 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0cb8003f30 msgr2=0x7f0cd80cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cddc00640 1 --2- 172.21.15.29:0/777607927 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0cb8003f30 0x7f0cd80cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cddc00640 1 -- 172.21.15.29:0/777607927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cd8144c90 msgr2=0x7f0cd80cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cddc00640 1 --2- 172.21.15.29:0/777607927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cd8144c90 0x7f0cd80cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cddc00640 1 -- 172.21.15.29:0/777607927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80cacb0 con 0x7f0cd8154b00 2024-01-24T13:05:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cddc00640 1 --2- 172.21.15.29:0/777607927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cd8154b00 0x7f0cd8154f80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0cd806ccb0 tx=0x7f0cd000ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cd4c00640 1 -- 172.21.15.29:0/777607927 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0017070 con 0x7f0cd8154b00 2024-01-24T13:05:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cd4c00640 1 -- 172.21.15.29:0/777607927 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd0003b90 con 0x7f0cd8154b00 2024-01-24T13:05:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cdfc00640 1 -- 172.21.15.29:0/777607927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd80caf90 con 0x7f0cd8154b00 2024-01-24T13:05:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cd4c00640 1 -- 172.21.15.29:0/777607927 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0003d40 con 0x7f0cd8154b00 2024-01-24T13:05:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.290+0000 7f0cdfc00640 1 -- 172.21.15.29:0/777607927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd80cbfb0 con 0x7f0cd8154b00 2024-01-24T13:05:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.294+0000 7f0cdfc00640 1 -- 172.21.15.29:0/777607927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd804e850 con 0x7f0cd8154b00 2024-01-24T13:05:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.294+0000 7f0cd4c00640 1 -- 172.21.15.29:0/777607927 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0cd00050d0 con 0x7f0cd8154b00 2024-01-24T13:05:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.294+0000 7f0cd4c00640 1 --2- 172.21.15.29:0/777607927 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0cb0065a60 0x7f0cb0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.294+0000 7f0cd4c00640 1 -- 172.21.15.29:0/777607927 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f0cd0082880 con 0x7f0cd8154b00 2024-01-24T13:05:37.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.294+0000 7f0cdd200640 1 --2- 172.21.15.29:0/777607927 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0cb0065a60 0x7f0cb0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:37.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.294+0000 7f0cdd200640 1 --2- 172.21.15.29:0/777607927 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0cb0065a60 0x7f0cb0067f20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80011f0 tx=0x7f0cc8001160 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:37.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.298+0000 7f0cd4c00640 1 -- 172.21.15.29:0/777607927 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f0cd004ff20 con 0x7f0cd8154b00 2024-01-24T13:05:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.458+0000 7f0cdfc00640 1 -- 172.21.15.29:0/777607927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cd815a170 con 0x7f0cd8154b00 2024-01-24T13:05:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.462+0000 7f0cd4c00640 1 -- 172.21.15.29:0/777607927 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+18176 (secure 0 0 0) 0x7f0cd0053540 con 0x7f0cd8154b00 2024-01-24T13:05:37.465 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:37.465 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":45,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:05:36.731753+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:05:21.225564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-24T13:05:22.188525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-01-24T13:05:35.873766+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.6","mappings":[{"from":3,"to":2}]},{"pgid":"6.14","mappings":[{"from":4,"to":2}]},{"pgid":"6.24","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.462+0000 7f0cdfc00640 1 -- 172.21.15.29:0/777607927 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0cb0065a60 msgr2=0x7f0cb0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.462+0000 7f0cdfc00640 1 --2- 172.21.15.29:0/777607927 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0cb0065a60 0x7f0cb0067f20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80011f0 tx=0x7f0cc8001160 comp rx=0 tx=0).stop 2024-01-24T13:05:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.462+0000 7f0cdfc00640 1 -- 172.21.15.29:0/777607927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cd8154b00 msgr2=0x7f0cd8154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.462+0000 7f0cdfc00640 1 --2- 172.21.15.29:0/777607927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cd8154b00 0x7f0cd8154f80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0cd806ccb0 tx=0x7f0cd000ead0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.462+0000 7f0cdfc00640 1 -- 172.21.15.29:0/777607927 shutdown_connections 2024-01-24T13:05:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.462+0000 7f0cdfc00640 1 --2- 172.21.15.29:0/777607927 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0cb0065a60 0x7f0cb0067f20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.462+0000 7f0cdfc00640 1 --2- 172.21.15.29:0/777607927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cd8154b00 0x7f0cd8154f80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.462+0000 7f0cdfc00640 1 --2- 172.21.15.29:0/777607927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cd8144c90 0x7f0cd80cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.462+0000 7f0cdfc00640 1 --2- 172.21.15.29:0/777607927 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0cb8003f30 0x7f0cd80cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.462+0000 7f0cdfc00640 1 -- 172.21.15.29:0/777607927 >> 172.21.15.29:0/777607927 conn(0x7f0cd80b3950 msgr2=0x7f0cd81596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.462+0000 7f0cdfc00640 1 -- 172.21.15.29:0/777607927 shutdown_connections 2024-01-24T13:05:37.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.462+0000 7f0cdfc00640 1 -- 172.21.15.29:0/777607927 wait complete. 2024-01-24T13:05:37.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:37.487 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2024-01-24T13:05:37.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:37.502 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2024-01-24T13:05:37.562 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-01-24T13:05:37.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.750+0000 7f02ee200640 1 Processor -- start 2024-01-24T13:05:37.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.750+0000 7f02ee200640 1 -- start start 2024-01-24T13:05:37.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.754+0000 7f02ee200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f02e80b2c10 0x7f02e815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:37.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.754+0000 7f02ee200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e8153de0 con 0x7f02e8153a00 2024-01-24T13:05:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.754+0000 7f02ee200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e8071d10 con 0x7f02e80b2760 2024-01-24T13:05:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.754+0000 7f02ee200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e8159900 con 0x7f02e80b2c10 2024-01-24T13:05:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.754+0000 7f02e7400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f02e8153a00 0x7f02e8071600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38006/0 (socket says 172.21.15.29:38006) 2024-01-24T13:05:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.754+0000 7f02e7400640 1 -- 172.21.15.29:0/419658928 learned_addr learned my addr 172.21.15.29:0/419658928 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.754+0000 7f02e7e00640 1 --2- 172.21.15.29:0/419658928 >> v2:172.21.15.29:3300/0 conn(0x7f02e80b2c10 0x7f02e815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.754+0000 7f02e7e00640 1 -- 172.21.15.29:0/419658928 >> v1:172.21.15.163:6789/0 conn(0x7f02e80b2760 legacy=0x7f02e815cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.754+0000 7f02e7e00640 1 -- 172.21.15.29:0/419658928 >> v1:172.21.15.29:6789/0 conn(0x7f02e8153a00 legacy=0x7f02e8071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.754+0000 7f02e7e00640 1 -- 172.21.15.29:0/419658928 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80b3060 con 0x7f02e80b2c10 2024-01-24T13:05:37.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.754+0000 7f02e7e00640 1 --2- 172.21.15.29:0/419658928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02e80b2c10 0x7f02e815d600 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009d90 tx=0x7f02e001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17279cfdf706fed server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.754+0000 7f02e6000640 1 -- 172.21.15.29:0/419658928 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00a5950 con 0x7f02e80b2c10 2024-01-24T13:05:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.754+0000 7f02e6000640 1 -- 172.21.15.29:0/419658928 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e00a5ab0 con 0x7f02e80b2c10 2024-01-24T13:05:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.754+0000 7f02e6000640 1 -- 172.21.15.29:0/419658928 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00a5e40 con 0x7f02e80b2c10 2024-01-24T13:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 -- 172.21.15.29:0/419658928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02e80b2c10 msgr2=0x7f02e815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 --2- 172.21.15.29:0/419658928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02e80b2c10 0x7f02e815d600 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009d90 tx=0x7f02e001c890 comp rx=0 tx=0).stop 2024-01-24T13:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 -- 172.21.15.29:0/419658928 shutdown_connections 2024-01-24T13:05:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 --2- 172.21.15.29:0/419658928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02e80b2c10 0x7f02e815d600 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 -- 172.21.15.29:0/419658928 >> 172.21.15.29:0/419658928 conn(0x7f02e806d700 msgr2=0x7f02e8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 -- 172.21.15.29:0/419658928 shutdown_connections 2024-01-24T13:05:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 -- 172.21.15.29:0/419658928 wait complete. 2024-01-24T13:05:37.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 Processor -- start 2024-01-24T13:05:37.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 -- start start 2024-01-24T13:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02e80b2760 0x7f02e8143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e80b2c10 0x7f02e81583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02e8153a00 0x7f02e8158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80adaf0 con 0x7f02e8153a00 2024-01-24T13:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80afbc0 con 0x7f02e80b2c10 2024-01-24T13:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.758+0000 7f02ee200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e8151130 con 0x7f02e80b2760 2024-01-24T13:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02e7e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02e8153a00 0x7f02e8158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02e7e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02e8153a00 0x7f02e8158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55210/0 (socket says 172.21.15.29:55210) 2024-01-24T13:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02e7e00640 1 -- 172.21.15.29:0/2511229635 learned_addr learned my addr 172.21.15.29:0/2511229635 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02e7400640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02e80b2760 0x7f02e8143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02e6a00640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e80b2c10 0x7f02e81583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02e7e00640 1 -- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02e80b2760 msgr2=0x7f02e8143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02e7e00640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02e80b2760 0x7f02e8143be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02e7e00640 1 -- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e80b2c10 msgr2=0x7f02e81583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02e7e00640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e80b2c10 0x7f02e81583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02e7e00640 1 -- 172.21.15.29:0/2511229635 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e0009a70 con 0x7f02e8153a00 2024-01-24T13:05:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02e6a00640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e80b2c10 0x7f02e81583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02e7e00640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02e8153a00 0x7f02e8158910 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f02e001a4c0 tx=0x7f02e0019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02df400640 1 -- 172.21.15.29:0/2511229635 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00ade40 con 0x7f02e8153a00 2024-01-24T13:05:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02df400640 1 -- 172.21.15.29:0/2511229635 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e00b9450 con 0x7f02e8153a00 2024-01-24T13:05:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02ee200640 1 -- 172.21.15.29:0/2511229635 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e8151410 con 0x7f02e8153a00 2024-01-24T13:05:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02df400640 1 -- 172.21.15.29:0/2511229635 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00b97e0 con 0x7f02e8153a00 2024-01-24T13:05:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02ee200640 1 -- 172.21.15.29:0/2511229635 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e81519d0 con 0x7f02e8153a00 2024-01-24T13:05:37.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02ee200640 1 -- 172.21.15.29:0/2511229635 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e8151bc0 con 0x7f02e8153a00 2024-01-24T13:05:37.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02df400640 1 -- 172.21.15.29:0/2511229635 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f02e00b9940 con 0x7f02e8153a00 2024-01-24T13:05:37.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.762+0000 7f02df400640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f02c0065a60 0x7f02c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:37.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.766+0000 7f02df400640 1 -- 172.21.15.29:0/2511229635 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f02e011ed60 con 0x7f02e8153a00 2024-01-24T13:05:37.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.766+0000 7f02e7400640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f02c0065a60 0x7f02c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:37.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.766+0000 7f02e7400640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f02c0065a60 0x7f02c0067f20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f02d8005890 tx=0x7f02d8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:37.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.766+0000 7f02df400640 1 -- 172.21.15.29:0/2511229635 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f02e00ec5d0 con 0x7f02e8153a00 2024-01-24T13:05:37.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.982+0000 7f02ee200640 1 -- 172.21.15.29:0/2511229635 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f02e804e850 con 0x7f02e8153a00 2024-01-24T13:05:37.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.986+0000 7f02df400640 1 -- 172.21.15.29:0/2511229635 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v14) v1 ==== 210+0+0 (secure 0 0 0) 0x7f02e00efbf0 con 0x7f02e8153a00 2024-01-24T13:05:37.992 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2024-01-24T13:05:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.990+0000 7f02ee200640 1 -- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f02c0065a60 msgr2=0x7f02c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.990+0000 7f02ee200640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f02c0065a60 0x7f02c0067f20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f02d8005890 tx=0x7f02d8009040 comp rx=0 tx=0).stop 2024-01-24T13:05:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.990+0000 7f02ee200640 1 -- 172.21.15.29:0/2511229635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02e8153a00 msgr2=0x7f02e8158910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.990+0000 7f02ee200640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02e8153a00 0x7f02e8158910 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f02e001a4c0 tx=0x7f02e0019630 comp rx=0 tx=0).stop 2024-01-24T13:05:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.990+0000 7f02ee200640 1 -- 172.21.15.29:0/2511229635 shutdown_connections 2024-01-24T13:05:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.990+0000 7f02ee200640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f02c0065a60 0x7f02c0067f20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.990+0000 7f02ee200640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02e8153a00 0x7f02e8158910 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.990+0000 7f02ee200640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e80b2c10 0x7f02e81583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.990+0000 7f02ee200640 1 --2- 172.21.15.29:0/2511229635 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02e80b2760 0x7f02e8143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.990+0000 7f02ee200640 1 -- 172.21.15.29:0/2511229635 >> 172.21.15.29:0/2511229635 conn(0x7f02e806d700 msgr2=0x7f02e80b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.990+0000 7f02ee200640 1 -- 172.21.15.29:0/2511229635 shutdown_connections 2024-01-24T13:05:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:37.990+0000 7f02ee200640 1 -- 172.21.15.29:0/2511229635 wait complete. 2024-01-24T13:05:38.015 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:05:38.015 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:05:38.024 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:38.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.198+0000 7f1f69200640 1 Processor -- start 2024-01-24T13:05:38.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.198+0000 7f1f69200640 1 -- start start 2024-01-24T13:05:38.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f69200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1f64159300 0x7f1f640b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f69200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f6415d660 0x7f1f6406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f69200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6415de10 con 0x7f1f6406bc10 2024-01-24T13:05:38.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f69200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f64071140 con 0x7f1f64159300 2024-01-24T13:05:38.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f69200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6406c5e0 con 0x7f1f6415d660 2024-01-24T13:05:38.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f61400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1f6406bc10 0x7f1f6415cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38008/0 (socket says 172.21.15.29:38008) 2024-01-24T13:05:38.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f61400640 1 -- 172.21.15.29:0/2431140431 learned_addr learned my addr 172.21.15.29:0/2431140431 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:38.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 -- 172.21.15.29:0/2431140431 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948858923 0 0) 0x7f1f6415de10 con 0x7f1f6406bc10 2024-01-24T13:05:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f62800640 1 --2- 172.21.15.29:0/2431140431 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f6415d660 0x7f1f6406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 -- 172.21.15.29:0/2431140431 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f44003530 con 0x7f1f6406bc10 2024-01-24T13:05:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f61e00640 1 --2- 172.21.15.29:0/2431140431 >> v2:172.21.15.163:3300/0 conn(0x7f1f64159300 0x7f1f640b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 -- 172.21.15.29:0/2431140431 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3154354595 0 0) 0x7f1f44003530 con 0x7f1f6406bc10 2024-01-24T13:05:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 -- 172.21.15.29:0/2431140431 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f6415d660 msgr2=0x7f1f6406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 --2- 172.21.15.29:0/2431140431 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f6415d660 0x7f1f6406c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 -- 172.21.15.29:0/2431140431 >> v2:172.21.15.163:3300/0 conn(0x7f1f64159300 msgr2=0x7f1f640b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 --2- 172.21.15.29:0/2431140431 >> v2:172.21.15.163:3300/0 conn(0x7f1f64159300 0x7f1f640b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 -- 172.21.15.29:0/2431140431 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6415db30 con 0x7f1f6406bc10 2024-01-24T13:05:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 -- 172.21.15.29:0/2431140431 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f1f4c001680 con 0x7f1f6406bc10 2024-01-24T13:05:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 -- 172.21.15.29:0/2431140431 >> v1:172.21.15.29:6789/0 conn(0x7f1f6406bc10 legacy=0x7f1f6415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 --2- 172.21.15.29:0/2431140431 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f6415d660 0x7f1f44003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 --2- 172.21.15.29:0/2431140431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f44003f00 0x7f1f440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 --2- 172.21.15.29:0/2431140431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f44004d10 0x7f1f44005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 -- 172.21.15.29:0/2431140431 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6406c5e0 con 0x7f1f44004d10 2024-01-24T13:05:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 -- 172.21.15.29:0/2431140431 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4400b990 con 0x7f1f44003f00 2024-01-24T13:05:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f60a00640 1 -- 172.21.15.29:0/2431140431 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4400bb20 con 0x7f1f6415d660 2024-01-24T13:05:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f62800640 1 --2- 172.21.15.29:0/2431140431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f44004d10 0x7f1f44005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f61e00640 1 --2- 172.21.15.29:0/2431140431 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f6415d660 0x7f1f44003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f61400640 1 --2- 172.21.15.29:0/2431140431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f44003f00 0x7f1f440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f62800640 1 -- 172.21.15.29:0/2431140431 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f6415d660 msgr2=0x7f1f44003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f62800640 1 --2- 172.21.15.29:0/2431140431 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f6415d660 0x7f1f44003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f62800640 1 -- 172.21.15.29:0/2431140431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f44003f00 msgr2=0x7f1f440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f62800640 1 --2- 172.21.15.29:0/2431140431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f44003f00 0x7f1f440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f62800640 1 -- 172.21.15.29:0/2431140431 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f44003530 con 0x7f1f44004d10 2024-01-24T13:05:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.202+0000 7f1f61400640 1 --2- 172.21.15.29:0/2431140431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f44003f00 0x7f1f440047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.206+0000 7f1f62800640 1 --2- 172.21.15.29:0/2431140431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f44004d10 0x7f1f44005190 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009fc0 tx=0x7f1f5c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efe3b5deddf9acc server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.206+0000 7f1f60a00640 1 -- 172.21.15.29:0/2431140431 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0a5c30 con 0x7f1f44004d10 2024-01-24T13:05:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.206+0000 7f1f60a00640 1 -- 172.21.15.29:0/2431140431 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c00f040 con 0x7f1f44004d10 2024-01-24T13:05:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.206+0000 7f1f60a00640 1 -- 172.21.15.29:0/2431140431 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0ad440 con 0x7f1f44004d10 2024-01-24T13:05:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.206+0000 7f1f69200640 1 -- 172.21.15.29:0/2431140431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f44004d10 msgr2=0x7f1f44005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.206+0000 7f1f69200640 1 --2- 172.21.15.29:0/2431140431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f44004d10 0x7f1f44005190 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009fc0 tx=0x7f1f5c01cc20 comp rx=0 tx=0).stop 2024-01-24T13:05:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.206+0000 7f1f62800640 1 -- 172.21.15.29:0/2431140431 reap_dead start 2024-01-24T13:05:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.206+0000 7f1f69200640 1 -- 172.21.15.29:0/2431140431 shutdown_connections 2024-01-24T13:05:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.206+0000 7f1f69200640 1 -- 172.21.15.29:0/2431140431 >> 172.21.15.29:0/2431140431 conn(0x7f1f640b3950 msgr2=0x7f1f64069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.206+0000 7f1f69200640 1 -- 172.21.15.29:0/2431140431 shutdown_connections 2024-01-24T13:05:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.206+0000 7f1f69200640 1 -- 172.21.15.29:0/2431140431 wait complete. 2024-01-24T13:05:38.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f69200640 1 Processor -- start 2024-01-24T13:05:38.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f69200640 1 -- start start 2024-01-24T13:05:38.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f69200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f44004d10 0x7f1f641f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f69200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f64146d20 0x7f1f64153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f69200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f640affe0 0x7f1f640b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f69200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f640b09a0 con 0x7f1f64146d20 2024-01-24T13:05:38.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f69200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f64153bc0 con 0x7f1f640affe0 2024-01-24T13:05:38.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f69200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f64153ea0 con 0x7f1f44004d10 2024-01-24T13:05:38.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f61400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f64146d20 0x7f1f64153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f61400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f64146d20 0x7f1f64153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55220/0 (socket says 172.21.15.29:55220) 2024-01-24T13:05:38.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f61400640 1 -- 172.21.15.29:0/696774247 learned_addr learned my addr 172.21.15.29:0/696774247 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:38.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f61e00640 1 --2- 172.21.15.29:0/696774247 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f44004d10 0x7f1f641f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f62800640 1 --2- 172.21.15.29:0/696774247 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f640affe0 0x7f1f640b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f61400640 1 -- 172.21.15.29:0/696774247 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f44004d10 msgr2=0x7f1f641f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f61400640 1 --2- 172.21.15.29:0/696774247 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f44004d10 0x7f1f641f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f61400640 1 -- 172.21.15.29:0/696774247 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f640affe0 msgr2=0x7f1f640b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f61400640 1 --2- 172.21.15.29:0/696774247 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f640affe0 0x7f1f640b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f61400640 1 -- 172.21.15.29:0/696774247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f64154180 con 0x7f1f64146d20 2024-01-24T13:05:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f61400640 1 --2- 172.21.15.29:0/696774247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f64146d20 0x7f1f64153370 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0017b0 tx=0x7f1f4c011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f5a000640 1 -- 172.21.15.29:0/696774247 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00fb60 con 0x7f1f64146d20 2024-01-24T13:05:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f5a000640 1 -- 172.21.15.29:0/696774247 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c00fcc0 con 0x7f1f64146d20 2024-01-24T13:05:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f5a000640 1 -- 172.21.15.29:0/696774247 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c015610 con 0x7f1f64146d20 2024-01-24T13:05:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f69200640 1 -- 172.21.15.29:0/696774247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f64155860 con 0x7f1f64146d20 2024-01-24T13:05:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f69200640 1 -- 172.21.15.29:0/696774247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f641471a0 con 0x7f1f64146d20 2024-01-24T13:05:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.210+0000 7f1f69200640 1 -- 172.21.15.29:0/696774247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f64155a50 con 0x7f1f64146d20 2024-01-24T13:05:38.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.214+0000 7f1f5a000640 1 -- 172.21.15.29:0/696774247 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1f4c015770 con 0x7f1f64146d20 2024-01-24T13:05:38.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.214+0000 7f1f5a000640 1 --2- 172.21.15.29:0/696774247 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f3c065a60 0x7f1f3c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.214+0000 7f1f5a000640 1 -- 172.21.15.29:0/696774247 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f1f4c0868b0 con 0x7f1f64146d20 2024-01-24T13:05:38.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.214+0000 7f1f61e00640 1 --2- 172.21.15.29:0/696774247 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f3c065a60 0x7f1f3c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.214+0000 7f1f61e00640 1 --2- 172.21.15.29:0/696774247 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f3c065a60 0x7f1f3c067f20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009ba0 tx=0x7f1f54008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:38.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.218+0000 7f1f5a000640 1 -- 172.21.15.29:0/696774247 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1f4c053eb0 con 0x7f1f64146d20 2024-01-24T13:05:38.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.378+0000 7f1f69200640 1 -- 172.21.15.29:0/696774247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f6404e850 con 0x7f1f64146d20 2024-01-24T13:05:38.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.382+0000 7f1f5a000640 1 -- 172.21.15.29:0/696774247 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18163 (secure 0 0 0) 0x7f1f4c0574d0 con 0x7f1f64146d20 2024-01-24T13:05:38.385 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:38.386 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":46,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:05:37.734611+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:05:21.225564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-24T13:05:22.188525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-01-24T13:05:35.873766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.6","mappings":[{"from":3,"to":2}]},{"pgid":"6.14","mappings":[{"from":4,"to":2}]},{"pgid":"6.24","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.382+0000 7f1f69200640 1 -- 172.21.15.29:0/696774247 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f3c065a60 msgr2=0x7f1f3c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.382+0000 7f1f69200640 1 --2- 172.21.15.29:0/696774247 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f3c065a60 0x7f1f3c067f20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009ba0 tx=0x7f1f54008040 comp rx=0 tx=0).stop 2024-01-24T13:05:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.382+0000 7f1f69200640 1 -- 172.21.15.29:0/696774247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f64146d20 msgr2=0x7f1f64153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.382+0000 7f1f69200640 1 --2- 172.21.15.29:0/696774247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f64146d20 0x7f1f64153370 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0017b0 tx=0x7f1f4c011ca0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.382+0000 7f1f69200640 1 -- 172.21.15.29:0/696774247 shutdown_connections 2024-01-24T13:05:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.382+0000 7f1f69200640 1 --2- 172.21.15.29:0/696774247 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f3c065a60 0x7f1f3c067f20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.382+0000 7f1f69200640 1 --2- 172.21.15.29:0/696774247 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f640affe0 0x7f1f640b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.382+0000 7f1f69200640 1 --2- 172.21.15.29:0/696774247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f64146d20 0x7f1f64153370 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.382+0000 7f1f69200640 1 --2- 172.21.15.29:0/696774247 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f44004d10 0x7f1f641f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.382+0000 7f1f69200640 1 -- 172.21.15.29:0/696774247 >> 172.21.15.29:0/696774247 conn(0x7f1f640b3950 msgr2=0x7f1f64154c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:38.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.382+0000 7f1f69200640 1 -- 172.21.15.29:0/696774247 shutdown_connections 2024-01-24T13:05:38.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.382+0000 7f1f69200640 1 -- 172.21.15.29:0/696774247 wait complete. 2024-01-24T13:05:38.408 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:05:21.225564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:05:22.188525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2024-01-24T13:05:35.873766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:05:38.408 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:05:38.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.546+0000 7fdb74200640 1 Processor -- start 2024-01-24T13:05:38.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.546+0000 7fdb74200640 1 -- start start 2024-01-24T13:05:38.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb74200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb6c15c830 0x7fdb6c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb74200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb6c1603a0 0x7fdb6c0ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb74200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6c070cf0 con 0x7fdb6c069cd0 2024-01-24T13:05:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb74200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6c15cc10 con 0x7fdb6c15c830 2024-01-24T13:05:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb74200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c160910 con 0x7fdb6c1603a0 2024-01-24T13:05:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb71800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb6c15c830 0x7fdb6c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb71800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb6c15c830 0x7fdb6c0c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55224/0 (socket says 172.21.15.29:55224) 2024-01-24T13:05:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb72200640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdb6c069cd0 0x7fdb6c0711d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38022/0 (socket says 172.21.15.29:38022) 2024-01-24T13:05:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb71800640 1 -- 172.21.15.29:0/1542216520 learned_addr learned my addr 172.21.15.29:0/1542216520 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:38.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb70e00640 1 --2- 172.21.15.29:0/1542216520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb6c1603a0 0x7fdb6c0ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb71800640 1 -- 172.21.15.29:0/1542216520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb6c1603a0 msgr2=0x7fdb6c0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:38.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb71800640 1 --2- 172.21.15.29:0/1542216520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb6c1603a0 0x7fdb6c0ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb71800640 1 -- 172.21.15.29:0/1542216520 >> v1:172.21.15.29:6789/0 conn(0x7fdb6c069cd0 legacy=0x7fdb6c0711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb6be00640 1 -- 172.21.15.29:0/1542216520 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106626194 0 0) 0x7fdb6c070cf0 con 0x7fdb6c069cd0 2024-01-24T13:05:38.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.550+0000 7fdb71800640 1 -- 172.21.15.29:0/1542216520 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c160bf0 con 0x7fdb6c15c830 2024-01-24T13:05:38.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.554+0000 7fdb71800640 1 --2- 172.21.15.29:0/1542216520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb6c15c830 0x7fdb6c0c9920 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009870 tx=0x7fdb5c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c2a437704d4b78 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:38.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.554+0000 7fdb6be00640 1 -- 172.21.15.29:0/1542216520 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0a8a30 con 0x7fdb6c15c830 2024-01-24T13:05:38.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.554+0000 7fdb6be00640 1 -- 172.21.15.29:0/1542216520 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c0a8b90 con 0x7fdb6c15c830 2024-01-24T13:05:38.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.554+0000 7fdb6be00640 1 -- 172.21.15.29:0/1542216520 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0b0440 con 0x7fdb6c15c830 2024-01-24T13:05:38.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.554+0000 7fdb74200640 1 -- 172.21.15.29:0/1542216520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb6c15c830 msgr2=0x7fdb6c0c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.554+0000 7fdb74200640 1 --2- 172.21.15.29:0/1542216520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb6c15c830 0x7fdb6c0c9920 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009870 tx=0x7fdb5c01ed30 comp rx=0 tx=0).stop 2024-01-24T13:05:38.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.554+0000 7fdb74200640 1 -- 172.21.15.29:0/1542216520 shutdown_connections 2024-01-24T13:05:38.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.554+0000 7fdb74200640 1 --2- 172.21.15.29:0/1542216520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb6c1603a0 0x7fdb6c0ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.554+0000 7fdb74200640 1 --2- 172.21.15.29:0/1542216520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb6c15c830 0x7fdb6c0c9920 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.554+0000 7fdb74200640 1 -- 172.21.15.29:0/1542216520 >> 172.21.15.29:0/1542216520 conn(0x7fdb6c0cbd50 msgr2=0x7fdb6c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:38.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.554+0000 7fdb74200640 1 -- 172.21.15.29:0/1542216520 shutdown_connections 2024-01-24T13:05:38.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.554+0000 7fdb74200640 1 -- 172.21.15.29:0/1542216520 wait complete. 2024-01-24T13:05:38.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.554+0000 7fdb74200640 1 Processor -- start 2024-01-24T13:05:38.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.554+0000 7fdb74200640 1 -- start start 2024-01-24T13:05:38.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb74200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb6c069cd0 0x7fdb6c0c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb74200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb6c15c830 0x7fdb6c150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb74200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb6c1603a0 0x7fdb6c0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb74200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0b4240 con 0x7fdb6c1603a0 2024-01-24T13:05:38.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb74200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0b3870 con 0x7fdb6c15c830 2024-01-24T13:05:38.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb74200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0b4e00 con 0x7fdb6c069cd0 2024-01-24T13:05:38.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb72200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb6c1603a0 0x7fdb6c0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb72200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb6c1603a0 0x7fdb6c0b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55230/0 (socket says 172.21.15.29:55230) 2024-01-24T13:05:38.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb72200640 1 -- 172.21.15.29:0/2528542513 learned_addr learned my addr 172.21.15.29:0/2528542513 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:38.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb71800640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb6c069cd0 0x7fdb6c0c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb70e00640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb6c15c830 0x7fdb6c150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb72200640 1 -- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb6c069cd0 msgr2=0x7fdb6c0c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb72200640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb6c069cd0 0x7fdb6c0c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb72200640 1 -- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb6c15c830 msgr2=0x7fdb6c150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb72200640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb6c15c830 0x7fdb6c150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb72200640 1 -- 172.21.15.29:0/2528542513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c0094d0 con 0x7fdb6c1603a0 2024-01-24T13:05:38.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb70e00640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb6c15c830 0x7fdb6c150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:38.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb72200640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb6c1603a0 0x7fdb6c0b3d00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdb64001570 tx=0x7fdb6400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:38.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb69600640 1 -- 172.21.15.29:0/2528542513 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6400a640 con 0x7fdb6c1603a0 2024-01-24T13:05:38.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb69600640 1 -- 172.21.15.29:0/2528542513 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6400a7c0 con 0x7fdb6c1603a0 2024-01-24T13:05:38.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb69600640 1 -- 172.21.15.29:0/2528542513 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6400ab70 con 0x7fdb6c1603a0 2024-01-24T13:05:38.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb74200640 1 -- 172.21.15.29:0/2528542513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c0b3220 con 0x7fdb6c1603a0 2024-01-24T13:05:38.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb74200640 1 -- 172.21.15.29:0/2528542513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c0b2e40 con 0x7fdb6c1603a0 2024-01-24T13:05:38.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.558+0000 7fdb74200640 1 -- 172.21.15.29:0/2528542513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c0b3a20 con 0x7fdb6c1603a0 2024-01-24T13:05:38.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.562+0000 7fdb69600640 1 -- 172.21.15.29:0/2528542513 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdb6400acd0 con 0x7fdb6c1603a0 2024-01-24T13:05:38.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.562+0000 7fdb69600640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb44065a60 0x7fdb44067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.562+0000 7fdb69600640 1 -- 172.21.15.29:0/2528542513 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fdb64082920 con 0x7fdb6c1603a0 2024-01-24T13:05:38.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.562+0000 7fdb71800640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb44065a60 0x7fdb44067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.562+0000 7fdb71800640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb44065a60 0x7fdb44067f20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0b2000 tx=0x7fdb5c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:38.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.566+0000 7fdb69600640 1 -- 172.21.15.29:0/2528542513 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fdb6c0b3a20 con 0x7fdb6c1603a0 2024-01-24T13:05:38.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.722+0000 7fdb74200640 1 -- 172.21.15.29:0/2528542513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb6c0b39e0 con 0x7fdb6c1603a0 2024-01-24T13:05:38.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.722+0000 7fdb69600640 1 -- 172.21.15.29:0/2528542513 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb640180a0 con 0x7fdb6c1603a0 2024-01-24T13:05:38.726 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:05:38.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.722+0000 7fdb74200640 1 -- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb44065a60 msgr2=0x7fdb44067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.722+0000 7fdb74200640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb44065a60 0x7fdb44067f20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0b2000 tx=0x7fdb5c008040 comp rx=0 tx=0).stop 2024-01-24T13:05:38.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.722+0000 7fdb74200640 1 -- 172.21.15.29:0/2528542513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb6c1603a0 msgr2=0x7fdb6c0b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.722+0000 7fdb74200640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb6c1603a0 0x7fdb6c0b3d00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdb64001570 tx=0x7fdb6400cca0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.722+0000 7fdb74200640 1 -- 172.21.15.29:0/2528542513 shutdown_connections 2024-01-24T13:05:38.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.722+0000 7fdb74200640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb44065a60 0x7fdb44067f20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.722+0000 7fdb74200640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb6c1603a0 0x7fdb6c0b3d00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.722+0000 7fdb74200640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb6c15c830 0x7fdb6c150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.722+0000 7fdb74200640 1 --2- 172.21.15.29:0/2528542513 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb6c069cd0 0x7fdb6c0c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.722+0000 7fdb74200640 1 -- 172.21.15.29:0/2528542513 >> 172.21.15.29:0/2528542513 conn(0x7fdb6c0cbd50 msgr2=0x7fdb6c0aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:38.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.722+0000 7fdb74200640 1 -- 172.21.15.29:0/2528542513 shutdown_connections 2024-01-24T13:05:38.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.722+0000 7fdb74200640 1 -- 172.21.15.29:0/2528542513 wait complete. 2024-01-24T13:05:38.748 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:05:38.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.890+0000 7fc6f5200640 1 Processor -- start 2024-01-24T13:05:38.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.890+0000 7fc6f5200640 1 -- start start 2024-01-24T13:05:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.890+0000 7fc6f5200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6f00b2760 0x7fc6f00b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.890+0000 7fc6f5200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f0153de0 con 0x7fc6f015cef0 2024-01-24T13:05:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.890+0000 7fc6f5200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f0071d10 con 0x7fc6f0153a00 2024-01-24T13:05:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.890+0000 7fc6f5200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f00b3120 con 0x7fc6f00b2760 2024-01-24T13:05:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.890+0000 7fc6ee800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc6f015cef0 0x7fc6f015d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38032/0 (socket says 172.21.15.29:38032) 2024-01-24T13:05:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.890+0000 7fc6ee800640 1 -- 172.21.15.29:0/2649203034 learned_addr learned my addr 172.21.15.29:0/2649203034 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.894+0000 7fc6ed400640 1 --2- 172.21.15.29:0/2649203034 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6f00b2760 0x7fc6f00b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.894+0000 7fc6eca00640 1 -- 172.21.15.29:0/2649203034 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081687085 0 0) 0x7fc6f0153de0 con 0x7fc6f015cef0 2024-01-24T13:05:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.894+0000 7fc6eca00640 1 -- 172.21.15.29:0/2649203034 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d0003530 con 0x7fc6f015cef0 2024-01-24T13:05:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.894+0000 7fc6eca00640 1 -- 172.21.15.29:0/2649203034 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284709615 0 0) 0x7fc6f0071d10 con 0x7fc6f0153a00 2024-01-24T13:05:38.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.894+0000 7fc6ed400640 1 -- 172.21.15.29:0/2649203034 >> v1:172.21.15.163:6789/0 conn(0x7fc6f0153a00 legacy=0x7fc6f0071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.894+0000 7fc6ed400640 1 -- 172.21.15.29:0/2649203034 >> v1:172.21.15.29:6789/0 conn(0x7fc6f015cef0 legacy=0x7fc6f015d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.894+0000 7fc6ed400640 1 -- 172.21.15.29:0/2649203034 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f0159900 con 0x7fc6f00b2760 2024-01-24T13:05:38.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.898+0000 7fc6ed400640 1 --2- 172.21.15.29:0/2649203034 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6f00b2760 0x7fc6f00b2be0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80097f0 tx=0x7fc6d801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=741fa8064423a4bd server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:38.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.898+0000 7fc6eca00640 1 -- 172.21.15.29:0/2649203034 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d80ac640 con 0x7fc6f00b2760 2024-01-24T13:05:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.898+0000 7fc6eca00640 1 -- 172.21.15.29:0/2649203034 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d80ac7a0 con 0x7fc6f00b2760 2024-01-24T13:05:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.898+0000 7fc6eca00640 1 -- 172.21.15.29:0/2649203034 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d80acb30 con 0x7fc6f00b2760 2024-01-24T13:05:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.898+0000 7fc6f5200640 1 -- 172.21.15.29:0/2649203034 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6f00b2760 msgr2=0x7fc6f00b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.898+0000 7fc6f5200640 1 --2- 172.21.15.29:0/2649203034 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6f00b2760 0x7fc6f00b2be0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80097f0 tx=0x7fc6d801c400 comp rx=0 tx=0).stop 2024-01-24T13:05:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.898+0000 7fc6f5200640 1 -- 172.21.15.29:0/2649203034 shutdown_connections 2024-01-24T13:05:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.898+0000 7fc6f5200640 1 --2- 172.21.15.29:0/2649203034 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6f00b2760 0x7fc6f00b2be0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.898+0000 7fc6f5200640 1 -- 172.21.15.29:0/2649203034 >> 172.21.15.29:0/2649203034 conn(0x7fc6f006d700 msgr2=0x7fc6f0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.898+0000 7fc6f5200640 1 -- 172.21.15.29:0/2649203034 shutdown_connections 2024-01-24T13:05:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.898+0000 7fc6f5200640 1 -- 172.21.15.29:0/2649203034 wait complete. 2024-01-24T13:05:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.898+0000 7fc6f5200640 1 Processor -- start 2024-01-24T13:05:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.898+0000 7fc6f5200640 1 -- start start 2024-01-24T13:05:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6f5200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6f00b2760 0x7fc6f00cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6f5200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6f0153a00 0x7fc6f01f9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6f5200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6f015cef0 0x7fc6f014b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6f5200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0152a30 con 0x7fc6f015cef0 2024-01-24T13:05:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6f5200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f01f99d0 con 0x7fc6f00b2760 2024-01-24T13:05:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6f5200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0151090 con 0x7fc6f0153a00 2024-01-24T13:05:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6ee800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6f015cef0 0x7fc6f014b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6ee800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6f015cef0 0x7fc6f014b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55240/0 (socket says 172.21.15.29:55240) 2024-01-24T13:05:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6ee800640 1 -- 172.21.15.29:0/1094306866 learned_addr learned my addr 172.21.15.29:0/1094306866 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6ed400640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6f0153a00 0x7fc6f01f9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6ede00640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6f00b2760 0x7fc6f00cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6ee800640 1 -- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6f0153a00 msgr2=0x7fc6f01f9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6ee800640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6f0153a00 0x7fc6f01f9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6ee800640 1 -- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6f00b2760 msgr2=0x7fc6f00cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6ee800640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6f00b2760 0x7fc6f00cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6ee800640 1 -- 172.21.15.29:0/1094306866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d8009420 con 0x7fc6f015cef0 2024-01-24T13:05:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6ede00640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6f00b2760 0x7fc6f00cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6ee800640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6f015cef0 0x7fc6f014b1c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800cb40 tx=0x7fc6e800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6e6000640 1 -- 172.21.15.29:0/1094306866 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e800ac40 con 0x7fc6f015cef0 2024-01-24T13:05:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6e6000640 1 -- 172.21.15.29:0/1094306866 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e800ada0 con 0x7fc6f015cef0 2024-01-24T13:05:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6f5200640 1 -- 172.21.15.29:0/1094306866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f00cdb80 con 0x7fc6f015cef0 2024-01-24T13:05:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6e6000640 1 -- 172.21.15.29:0/1094306866 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8012620 con 0x7fc6f015cef0 2024-01-24T13:05:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6f5200640 1 -- 172.21.15.29:0/1094306866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f00ce140 con 0x7fc6f015cef0 2024-01-24T13:05:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6f5200640 1 -- 172.21.15.29:0/1094306866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f0153280 con 0x7fc6f015cef0 2024-01-24T13:05:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.902+0000 7fc6e6000640 1 -- 172.21.15.29:0/1094306866 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc6e8007070 con 0x7fc6f015cef0 2024-01-24T13:05:38.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.906+0000 7fc6e6000640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc6c8065a90 0x7fc6c8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:38.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.906+0000 7fc6e6000640 1 -- 172.21.15.29:0/1094306866 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fc6e8083460 con 0x7fc6f015cef0 2024-01-24T13:05:38.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.906+0000 7fc6ede00640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc6c8065a90 0x7fc6c8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:38.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.906+0000 7fc6ede00640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc6c8065a90 0x7fc6c8067f50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0000f70 tx=0x7fc6e0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:38.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:38.910+0000 7fc6e6000640 1 -- 172.21.15.29:0/1094306866 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc6e8050b10 con 0x7fc6f015cef0 2024-01-24T13:05:39.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.066+0000 7fc6f5200640 1 -- 172.21.15.29:0/1094306866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6f0151200 con 0x7fc6f015cef0 2024-01-24T13:05:39.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.066+0000 7fc6e6000640 1 -- 172.21.15.29:0/1094306866 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6e8054130 con 0x7fc6f015cef0 2024-01-24T13:05:39.071 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.070+0000 7fc6f5200640 1 -- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc6c8065a90 msgr2=0x7fc6c8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.070+0000 7fc6f5200640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc6c8065a90 0x7fc6c8067f50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0000f70 tx=0x7fc6e0009040 comp rx=0 tx=0).stop 2024-01-24T13:05:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.070+0000 7fc6f5200640 1 -- 172.21.15.29:0/1094306866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6f015cef0 msgr2=0x7fc6f014b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.070+0000 7fc6f5200640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6f015cef0 0x7fc6f014b1c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800cb40 tx=0x7fc6e800a060 comp rx=0 tx=0).stop 2024-01-24T13:05:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.070+0000 7fc6f5200640 1 -- 172.21.15.29:0/1094306866 shutdown_connections 2024-01-24T13:05:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.070+0000 7fc6f5200640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc6c8065a90 0x7fc6c8067f50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.070+0000 7fc6f5200640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6f015cef0 0x7fc6f014b1c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.070+0000 7fc6f5200640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc6f0153a00 0x7fc6f01f9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.070+0000 7fc6f5200640 1 --2- 172.21.15.29:0/1094306866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6f00b2760 0x7fc6f00cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.070+0000 7fc6f5200640 1 -- 172.21.15.29:0/1094306866 >> 172.21.15.29:0/1094306866 conn(0x7fc6f006d700 msgr2=0x7fc6f0149d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.070+0000 7fc6f5200640 1 -- 172.21.15.29:0/1094306866 shutdown_connections 2024-01-24T13:05:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.070+0000 7fc6f5200640 1 -- 172.21.15.29:0/1094306866 wait complete. 2024-01-24T13:05:39.093 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:05:39.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.234+0000 7f55e5e00640 1 Processor -- start 2024-01-24T13:05:39.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.234+0000 7f55e5e00640 1 -- start start 2024-01-24T13:05:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.234+0000 7f55e5e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55e006a3e0 0x7f55e0071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.234+0000 7f55e5e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e015e220 con 0x7f55e015d920 2024-01-24T13:05:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.234+0000 7f55e5e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e015e500 con 0x7f55e015dd00 2024-01-24T13:05:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.234+0000 7f55e5e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e015e7e0 con 0x7f55e006a3e0 2024-01-24T13:05:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.238+0000 7f55dea00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f55e015d920 0x7f55e0069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38044/0 (socket says 172.21.15.29:38044) 2024-01-24T13:05:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.238+0000 7f55dea00640 1 -- 172.21.15.29:0/2018787766 learned_addr learned my addr 172.21.15.29:0/2018787766 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.238+0000 7f55df400640 1 --2- 172.21.15.29:0/2018787766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55e006a3e0 0x7f55e0071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.238+0000 7f55dd600640 1 -- 172.21.15.29:0/2018787766 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204969341 0 0) 0x7f55e015e220 con 0x7f55e015d920 2024-01-24T13:05:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.238+0000 7f55dd600640 1 -- 172.21.15.29:0/2018787766 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c0003530 con 0x7f55e015d920 2024-01-24T13:05:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.238+0000 7f55dd600640 1 -- 172.21.15.29:0/2018787766 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484761315 0 0) 0x7f55e015e500 con 0x7f55e015dd00 2024-01-24T13:05:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.238+0000 7f55dd600640 1 -- 172.21.15.29:0/2018787766 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e015e220 con 0x7f55e015dd00 2024-01-24T13:05:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.238+0000 7f55df400640 1 -- 172.21.15.29:0/2018787766 >> v1:172.21.15.163:6789/0 conn(0x7f55e015dd00 legacy=0x7f55e0070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.238+0000 7f55df400640 1 -- 172.21.15.29:0/2018787766 >> v1:172.21.15.29:6789/0 conn(0x7f55e015d920 legacy=0x7f55e0069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.238+0000 7f55df400640 1 -- 172.21.15.29:0/2018787766 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e015eac0 con 0x7f55e006a3e0 2024-01-24T13:05:39.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.242+0000 7f55df400640 1 --2- 172.21.15.29:0/2018787766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55e006a3e0 0x7f55e0071400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009dc0 tx=0x7f55d801c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e1cac1b605d3995 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:39.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.242+0000 7f55dd600640 1 -- 172.21.15.29:0/2018787766 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80a5820 con 0x7f55e006a3e0 2024-01-24T13:05:39.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.242+0000 7f55dd600640 1 -- 172.21.15.29:0/2018787766 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d80a5980 con 0x7f55e006a3e0 2024-01-24T13:05:39.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.242+0000 7f55dd600640 1 -- 172.21.15.29:0/2018787766 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80a5d10 con 0x7f55e006a3e0 2024-01-24T13:05:39.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.242+0000 7f55e5e00640 1 -- 172.21.15.29:0/2018787766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55e006a3e0 msgr2=0x7f55e0071400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.242+0000 7f55e5e00640 1 --2- 172.21.15.29:0/2018787766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55e006a3e0 0x7f55e0071400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009dc0 tx=0x7f55d801c850 comp rx=0 tx=0).stop 2024-01-24T13:05:39.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.242+0000 7f55e5e00640 1 -- 172.21.15.29:0/2018787766 shutdown_connections 2024-01-24T13:05:39.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.242+0000 7f55e5e00640 1 --2- 172.21.15.29:0/2018787766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55e006a3e0 0x7f55e0071400 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.242+0000 7f55e5e00640 1 -- 172.21.15.29:0/2018787766 >> 172.21.15.29:0/2018787766 conn(0x7f55e00cbd50 msgr2=0x7f55e00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:39.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.242+0000 7f55e5e00640 1 -- 172.21.15.29:0/2018787766 shutdown_connections 2024-01-24T13:05:39.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.242+0000 7f55e5e00640 1 -- 172.21.15.29:0/2018787766 wait complete. 2024-01-24T13:05:39.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.242+0000 7f55e5e00640 1 Processor -- start 2024-01-24T13:05:39.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.242+0000 7f55e5e00640 1 -- start start 2024-01-24T13:05:39.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55e5e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55e006a3e0 0x7f55e0151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55e5e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55e015d920 0x7f55e00c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55e5e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55e015dd00 0x7f55e006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55e5e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e00b4470 con 0x7f55e015d920 2024-01-24T13:05:39.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55e5e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e00c2da0 con 0x7f55e006a3e0 2024-01-24T13:05:39.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55e5e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e00b3bd0 con 0x7f55e015dd00 2024-01-24T13:05:39.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55de000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55e015d920 0x7f55e00c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55de000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55e015d920 0x7f55e00c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55248/0 (socket says 172.21.15.29:55248) 2024-01-24T13:05:39.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55de000640 1 -- 172.21.15.29:0/46806908 learned_addr learned my addr 172.21.15.29:0/46806908 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:39.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55df400640 1 --2- 172.21.15.29:0/46806908 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55e015dd00 0x7f55e006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55dea00640 1 --2- 172.21.15.29:0/46806908 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55e006a3e0 0x7f55e0151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55de000640 1 -- 172.21.15.29:0/46806908 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55e015dd00 msgr2=0x7f55e006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55de000640 1 --2- 172.21.15.29:0/46806908 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55e015dd00 0x7f55e006e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55de000640 1 -- 172.21.15.29:0/46806908 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55e006a3e0 msgr2=0x7f55e0151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55de000640 1 --2- 172.21.15.29:0/46806908 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55e006a3e0 0x7f55e0151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55de000640 1 -- 172.21.15.29:0/46806908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d8009a70 con 0x7f55e015d920 2024-01-24T13:05:39.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55de000640 1 --2- 172.21.15.29:0/46806908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55e015d920 0x7f55e00c34d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f55c800c430 tx=0x7f55c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:39.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55d7400640 1 -- 172.21.15.29:0/46806908 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c80052d0 con 0x7f55e015d920 2024-01-24T13:05:39.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55d7400640 1 -- 172.21.15.29:0/46806908 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c8005450 con 0x7f55e015d920 2024-01-24T13:05:39.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55e5e00640 1 -- 172.21.15.29:0/46806908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e00b3eb0 con 0x7f55e015d920 2024-01-24T13:05:39.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55d7400640 1 -- 172.21.15.29:0/46806908 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c8003840 con 0x7f55e015d920 2024-01-24T13:05:39.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55e5e00640 1 -- 172.21.15.29:0/46806908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e00c2fb0 con 0x7f55e015d920 2024-01-24T13:05:39.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55e5e00640 1 -- 172.21.15.29:0/46806908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e004e850 con 0x7f55e015d920 2024-01-24T13:05:39.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.246+0000 7f55d7400640 1 -- 172.21.15.29:0/46806908 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f55c80039a0 con 0x7f55e015d920 2024-01-24T13:05:39.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.250+0000 7f55d7400640 1 --2- 172.21.15.29:0/46806908 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f55b8065a60 0x7f55b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.250+0000 7f55d7400640 1 -- 172.21.15.29:0/46806908 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f55c8082aa0 con 0x7f55e015d920 2024-01-24T13:05:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.250+0000 7f55dea00640 1 --2- 172.21.15.29:0/46806908 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f55b8065a60 0x7f55b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.250+0000 7f55dea00640 1 --2- 172.21.15.29:0/46806908 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f55b8065a60 0x7f55b8067f20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f55d0000f70 tx=0x7f55d0007d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:39.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.254+0000 7f55d7400640 1 -- 172.21.15.29:0/46806908 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f55c8050150 con 0x7f55e015d920 2024-01-24T13:05:39.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.410+0000 7f55e5e00640 1 -- 172.21.15.29:0/46806908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f55e01660f0 con 0x7f55e015d920 2024-01-24T13:05:39.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.410+0000 7f55d7400640 1 -- 172.21.15.29:0/46806908 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7f55c80170a0 con 0x7f55e015d920 2024-01-24T13:05:39.416 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:05:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.414+0000 7f55e5e00640 1 -- 172.21.15.29:0/46806908 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f55b8065a60 msgr2=0x7f55b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.414+0000 7f55e5e00640 1 --2- 172.21.15.29:0/46806908 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f55b8065a60 0x7f55b8067f20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f55d0000f70 tx=0x7f55d0007d40 comp rx=0 tx=0).stop 2024-01-24T13:05:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.414+0000 7f55e5e00640 1 -- 172.21.15.29:0/46806908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55e015d920 msgr2=0x7f55e00c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.414+0000 7f55e5e00640 1 --2- 172.21.15.29:0/46806908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55e015d920 0x7f55e00c34d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f55c800c430 tx=0x7f55c800c8f0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.414+0000 7f55e5e00640 1 -- 172.21.15.29:0/46806908 shutdown_connections 2024-01-24T13:05:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.414+0000 7f55e5e00640 1 --2- 172.21.15.29:0/46806908 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f55b8065a60 0x7f55b8067f20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.414+0000 7f55e5e00640 1 --2- 172.21.15.29:0/46806908 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f55e015dd00 0x7f55e006e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.414+0000 7f55e5e00640 1 --2- 172.21.15.29:0/46806908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55e015d920 0x7f55e00c34d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.414+0000 7f55e5e00640 1 --2- 172.21.15.29:0/46806908 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55e006a3e0 0x7f55e0151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.414+0000 7f55e5e00640 1 -- 172.21.15.29:0/46806908 >> 172.21.15.29:0/46806908 conn(0x7f55e00cbd50 msgr2=0x7f55e00af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:39.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.414+0000 7f55e5e00640 1 -- 172.21.15.29:0/46806908 shutdown_connections 2024-01-24T13:05:39.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.414+0000 7f55e5e00640 1 -- 172.21.15.29:0/46806908 wait complete. 2024-01-24T13:05:39.438 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-01-24T13:05:39.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.578+0000 7f2271600640 1 Processor -- start 2024-01-24T13:05:39.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.578+0000 7f2271600640 1 -- start start 2024-01-24T13:05:39.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.578+0000 7f2271600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f226c06c860 0x7f226c06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.578+0000 7f2271600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226c06b320 con 0x7f226c142980 2024-01-24T13:05:39.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.578+0000 7f2271600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226c1611b0 con 0x7f226c0cd520 2024-01-24T13:05:39.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.578+0000 7f2271600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226c160630 con 0x7f226c06c860 2024-01-24T13:05:39.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.578+0000 7f226aa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f226c06c860 0x7f226c06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.578+0000 7f226aa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f226c06c860 0x7f226c06ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55256/0 (socket says 172.21.15.29:55256) 2024-01-24T13:05:39.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.578+0000 7f226aa00640 1 -- 172.21.15.29:0/3759909927 learned_addr learned my addr 172.21.15.29:0/3759909927 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:39.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.578+0000 7f226aa00640 1 -- 172.21.15.29:0/3759909927 >> v1:172.21.15.163:6789/0 conn(0x7f226c0cd520 legacy=0x7f226c15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.578+0000 7f226aa00640 1 -- 172.21.15.29:0/3759909927 >> v1:172.21.15.29:6789/0 conn(0x7f226c142980 legacy=0x7f226c0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.578+0000 7f2269600640 1 -- 172.21.15.29:0/3759909927 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593247170 0 0) 0x7f226c06b320 con 0x7f226c142980 2024-01-24T13:05:39.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.578+0000 7f226aa00640 1 -- 172.21.15.29:0/3759909927 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c160910 con 0x7f226c06c860 2024-01-24T13:05:39.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.582+0000 7f226aa00640 1 --2- 172.21.15.29:0/3759909927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226c06c860 0x7f226c06ade0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f225c009870 tx=0x7f225c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e03f0c5515a62af server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:39.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.582+0000 7f2269600640 1 -- 172.21.15.29:0/3759909927 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c0aa670 con 0x7f226c06c860 2024-01-24T13:05:39.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.582+0000 7f2269600640 1 -- 172.21.15.29:0/3759909927 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c0aa7d0 con 0x7f226c06c860 2024-01-24T13:05:39.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.582+0000 7f2269600640 1 -- 172.21.15.29:0/3759909927 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c0aab60 con 0x7f226c06c860 2024-01-24T13:05:39.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.582+0000 7f2271600640 1 -- 172.21.15.29:0/3759909927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226c06c860 msgr2=0x7f226c06ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.582+0000 7f2271600640 1 --2- 172.21.15.29:0/3759909927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226c06c860 0x7f226c06ade0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f225c009870 tx=0x7f225c01c510 comp rx=0 tx=0).stop 2024-01-24T13:05:39.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.582+0000 7f2271600640 1 -- 172.21.15.29:0/3759909927 shutdown_connections 2024-01-24T13:05:39.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.582+0000 7f2271600640 1 --2- 172.21.15.29:0/3759909927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226c06c860 0x7f226c06ade0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.582+0000 7f2271600640 1 -- 172.21.15.29:0/3759909927 >> 172.21.15.29:0/3759909927 conn(0x7f226c069cd0 msgr2=0x7f226c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:39.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.582+0000 7f2271600640 1 -- 172.21.15.29:0/3759909927 shutdown_connections 2024-01-24T13:05:39.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.582+0000 7f2271600640 1 -- 172.21.15.29:0/3759909927 wait complete. 2024-01-24T13:05:39.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f2271600640 1 Processor -- start 2024-01-24T13:05:39.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f2271600640 1 -- start start 2024-01-24T13:05:39.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f2271600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f226c06c860 0x7f226c158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f2271600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f226c0cd520 0x7f226c151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f2271600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226c142980 0x7f226c15afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f2271600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c157390 con 0x7f226c142980 2024-01-24T13:05:39.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f2271600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c158b80 con 0x7f226c06c860 2024-01-24T13:05:39.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f2271600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c1575a0 con 0x7f226c0cd520 2024-01-24T13:05:39.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f226b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226c142980 0x7f226c15afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f226b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226c142980 0x7f226c15afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55258/0 (socket says 172.21.15.29:55258) 2024-01-24T13:05:39.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f226b400640 1 -- 172.21.15.29:0/3705383625 learned_addr learned my addr 172.21.15.29:0/3705383625 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:39.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f226aa00640 1 --2- 172.21.15.29:0/3705383625 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f226c06c860 0x7f226c158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f226a000640 1 --2- 172.21.15.29:0/3705383625 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f226c0cd520 0x7f226c151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f226b400640 1 -- 172.21.15.29:0/3705383625 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f226c0cd520 msgr2=0x7f226c151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f226b400640 1 --2- 172.21.15.29:0/3705383625 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f226c0cd520 0x7f226c151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f226b400640 1 -- 172.21.15.29:0/3705383625 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f226c06c860 msgr2=0x7f226c158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f226b400640 1 --2- 172.21.15.29:0/3705383625 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f226c06c860 0x7f226c158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f226b400640 1 -- 172.21.15.29:0/3705383625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0094d0 con 0x7f226c142980 2024-01-24T13:05:39.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f226b400640 1 --2- 172.21.15.29:0/3705383625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226c142980 0x7f226c15afe0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f226400c7a0 tx=0x7f226400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:39.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f2262a00640 1 -- 172.21.15.29:0/3705383625 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264003b80 con 0x7f226c142980 2024-01-24T13:05:39.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f2262a00640 1 -- 172.21.15.29:0/3705383625 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2264003ce0 con 0x7f226c142980 2024-01-24T13:05:39.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f2271600640 1 -- 172.21.15.29:0/3705383625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226c157880 con 0x7f226c142980 2024-01-24T13:05:39.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f2262a00640 1 -- 172.21.15.29:0/3705383625 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226400aa30 con 0x7f226c142980 2024-01-24T13:05:39.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.586+0000 7f2271600640 1 -- 172.21.15.29:0/3705383625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c157e40 con 0x7f226c142980 2024-01-24T13:05:39.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.590+0000 7f2271600640 1 -- 172.21.15.29:0/3705383625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226c142da0 con 0x7f226c142980 2024-01-24T13:05:39.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.590+0000 7f2262a00640 1 -- 172.21.15.29:0/3705383625 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f226400ab90 con 0x7f226c142980 2024-01-24T13:05:39.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.590+0000 7f2262a00640 1 --2- 172.21.15.29:0/3705383625 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2244065a90 0x7f2244067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.590+0000 7f2262a00640 1 -- 172.21.15.29:0/3705383625 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f2264083130 con 0x7f226c142980 2024-01-24T13:05:39.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.590+0000 7f226aa00640 1 --2- 172.21.15.29:0/3705383625 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2244065a90 0x7f2244067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.590+0000 7f226aa00640 1 --2- 172.21.15.29:0/3705383625 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2244065a90 0x7f2244067f50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f225c0ae000 tx=0x7f225c0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:39.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.594+0000 7f2262a00640 1 -- 172.21.15.29:0/3705383625 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f226c142da0 con 0x7f226c142980 2024-01-24T13:05:39.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.754+0000 7f2271600640 1 -- 172.21.15.29:0/3705383625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f226c142da0 con 0x7f226c142980 2024-01-24T13:05:39.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.754+0000 7f2262a00640 1 -- 172.21.15.29:0/3705383625 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v46) v1 ==== 97+0+11 (secure 0 0 0) 0x7f226c142da0 con 0x7f226c142980 2024-01-24T13:05:39.757 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:39.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.754+0000 7f2271600640 1 -- 172.21.15.29:0/3705383625 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2244065a90 msgr2=0x7f2244067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.754+0000 7f2271600640 1 --2- 172.21.15.29:0/3705383625 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2244065a90 0x7f2244067f50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f225c0ae000 tx=0x7f225c0a7000 comp rx=0 tx=0).stop 2024-01-24T13:05:39.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.754+0000 7f2271600640 1 -- 172.21.15.29:0/3705383625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226c142980 msgr2=0x7f226c15afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.754+0000 7f2271600640 1 --2- 172.21.15.29:0/3705383625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226c142980 0x7f226c15afe0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f226400c7a0 tx=0x7f226400cc60 comp rx=0 tx=0).stop 2024-01-24T13:05:39.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.754+0000 7f2271600640 1 -- 172.21.15.29:0/3705383625 shutdown_connections 2024-01-24T13:05:39.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.754+0000 7f2271600640 1 --2- 172.21.15.29:0/3705383625 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2244065a90 0x7f2244067f50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.754+0000 7f2271600640 1 --2- 172.21.15.29:0/3705383625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226c142980 0x7f226c15afe0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.754+0000 7f2271600640 1 --2- 172.21.15.29:0/3705383625 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f226c0cd520 0x7f226c151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.754+0000 7f2271600640 1 --2- 172.21.15.29:0/3705383625 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f226c06c860 0x7f226c158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.754+0000 7f2271600640 1 -- 172.21.15.29:0/3705383625 >> 172.21.15.29:0/3705383625 conn(0x7f226c069cd0 msgr2=0x7f226c15eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:39.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.754+0000 7f2271600640 1 -- 172.21.15.29:0/3705383625 shutdown_connections 2024-01-24T13:05:39.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.754+0000 7f2271600640 1 -- 172.21.15.29:0/3705383625 wait complete. 2024-01-24T13:05:39.780 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:05:39.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97d6600640 1 Processor -- start 2024-01-24T13:05:39.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97d6600640 1 -- start start 2024-01-24T13:05:39.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97d6600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f97d013ecc0 0x7f97d015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97d6600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f97d015a0d0 0x7f97d015a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97d6600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d0159980 con 0x7f97d00ca110 2024-01-24T13:05:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97d6600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d013fc60 con 0x7f97d013ecc0 2024-01-24T13:05:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97d6600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d015dee0 con 0x7f97d015a0d0 2024-01-24T13:05:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97cea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f97d013ecc0 0x7f97d015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97cea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f97d013ecc0 0x7f97d015d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55264/0 (socket says 172.21.15.29:55264) 2024-01-24T13:05:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97cea00640 1 -- 172.21.15.29:0/3844854473 learned_addr learned my addr 172.21.15.29:0/3844854473 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97cfe00640 1 --2- 172.21.15.29:0/3844854473 >> v2:172.21.15.163:3300/0 conn(0x7f97d015a0d0 0x7f97d015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97cea00640 1 -- 172.21.15.29:0/3844854473 >> v2:172.21.15.163:3300/0 conn(0x7f97d015a0d0 msgr2=0x7f97d015a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97cea00640 1 --2- 172.21.15.29:0/3844854473 >> v2:172.21.15.163:3300/0 conn(0x7f97d015a0d0 0x7f97d015a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97cea00640 1 -- 172.21.15.29:0/3844854473 >> v1:172.21.15.163:6789/0 conn(0x7f97d00ca110 legacy=0x7f97d0070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.918+0000 7f97cea00640 1 -- 172.21.15.29:0/3844854473 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d00711a0 con 0x7f97d013ecc0 2024-01-24T13:05:39.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.922+0000 7f97cea00640 1 --2- 172.21.15.29:0/3844854473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d013ecc0 0x7f97d015d9a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f97d006ab40 tx=0x7f97b801ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fe262a61024016 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.922+0000 7f97ce000640 1 -- 172.21.15.29:0/3844854473 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b80a7cc0 con 0x7f97d013ecc0 2024-01-24T13:05:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.922+0000 7f97ce000640 1 -- 172.21.15.29:0/3844854473 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b80a7e20 con 0x7f97d013ecc0 2024-01-24T13:05:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.922+0000 7f97ce000640 1 -- 172.21.15.29:0/3844854473 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b80af660 con 0x7f97d013ecc0 2024-01-24T13:05:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.922+0000 7f97d6600640 1 -- 172.21.15.29:0/3844854473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d013ecc0 msgr2=0x7f97d015d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.922+0000 7f97d6600640 1 --2- 172.21.15.29:0/3844854473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d013ecc0 0x7f97d015d9a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f97d006ab40 tx=0x7f97b801ebd0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.922+0000 7f97d6600640 1 -- 172.21.15.29:0/3844854473 shutdown_connections 2024-01-24T13:05:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.922+0000 7f97d6600640 1 --2- 172.21.15.29:0/3844854473 >> v2:172.21.15.163:3300/0 conn(0x7f97d015a0d0 0x7f97d015a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.922+0000 7f97d6600640 1 --2- 172.21.15.29:0/3844854473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d013ecc0 0x7f97d015d9a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.922+0000 7f97d6600640 1 -- 172.21.15.29:0/3844854473 >> 172.21.15.29:0/3844854473 conn(0x7f97d006a2d0 msgr2=0x7f97d00afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:39.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97d6600640 1 -- 172.21.15.29:0/3844854473 shutdown_connections 2024-01-24T13:05:39.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97d6600640 1 -- 172.21.15.29:0/3844854473 wait complete. 2024-01-24T13:05:39.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97d6600640 1 Processor -- start 2024-01-24T13:05:39.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97d6600640 1 -- start start 2024-01-24T13:05:39.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97d6600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f97d00ca110 0x7f97d014c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97d6600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d013ecc0 0x7f97d0154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97d6600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97d015a0d0 0x7f97d0154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97d6600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00b0430 con 0x7f97d013ecc0 2024-01-24T13:05:39.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97d6600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d014c8d0 con 0x7f97d015a0d0 2024-01-24T13:05:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97d6600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d01571a0 con 0x7f97d00ca110 2024-01-24T13:05:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97cea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d013ecc0 0x7f97d0154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97cea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d013ecc0 0x7f97d0154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55276/0 (socket says 172.21.15.29:55276) 2024-01-24T13:05:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97cea00640 1 -- 172.21.15.29:0/3285864411 learned_addr learned my addr 172.21.15.29:0/3285864411 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97cfe00640 1 --2- 172.21.15.29:0/3285864411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97d015a0d0 0x7f97d0154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97cf400640 1 --2- 172.21.15.29:0/3285864411 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f97d00ca110 0x7f97d014c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97cea00640 1 -- 172.21.15.29:0/3285864411 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f97d00ca110 msgr2=0x7f97d014c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97cea00640 1 --2- 172.21.15.29:0/3285864411 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f97d00ca110 0x7f97d014c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97cea00640 1 -- 172.21.15.29:0/3285864411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97d015a0d0 msgr2=0x7f97d0154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97cea00640 1 --2- 172.21.15.29:0/3285864411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97d015a0d0 0x7f97d0154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97cea00640 1 -- 172.21.15.29:0/3285864411 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b800b770 con 0x7f97d013ecc0 2024-01-24T13:05:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.926+0000 7f97cea00640 1 --2- 172.21.15.29:0/3285864411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d013ecc0 0x7f97d0154a60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f97b800b2c0 tx=0x7f97b801d410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.930+0000 7f97c7400640 1 -- 172.21.15.29:0/3285864411 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b80c0070 con 0x7f97d013ecc0 2024-01-24T13:05:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.930+0000 7f97c7400640 1 -- 172.21.15.29:0/3285864411 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b80ba420 con 0x7f97d013ecc0 2024-01-24T13:05:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.930+0000 7f97d6600640 1 -- 172.21.15.29:0/3285864411 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d00c2f50 con 0x7f97d013ecc0 2024-01-24T13:05:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.930+0000 7f97c7400640 1 -- 172.21.15.29:0/3285864411 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b80ba7d0 con 0x7f97d013ecc0 2024-01-24T13:05:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.930+0000 7f97d6600640 1 -- 172.21.15.29:0/3285864411 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d00c3510 con 0x7f97d013ecc0 2024-01-24T13:05:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.930+0000 7f97d6600640 1 -- 172.21.15.29:0/3285864411 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d00c3700 con 0x7f97d013ecc0 2024-01-24T13:05:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.930+0000 7f97c7400640 1 -- 172.21.15.29:0/3285864411 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f97b80b6040 con 0x7f97d013ecc0 2024-01-24T13:05:39.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.930+0000 7f97c7400640 1 --2- 172.21.15.29:0/3285864411 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f97a8065a60 0x7f97a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:39.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.930+0000 7f97c7400640 1 -- 172.21.15.29:0/3285864411 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f97b8120070 con 0x7f97d013ecc0 2024-01-24T13:05:39.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.930+0000 7f97cf400640 1 --2- 172.21.15.29:0/3285864411 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f97a8065a60 0x7f97a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:39.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.934+0000 7f97cf400640 1 --2- 172.21.15.29:0/3285864411 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f97a8065a60 0x7f97a8067f20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f97c0000fc0 tx=0x7f97c0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:39.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:39.934+0000 7f97c7400640 1 -- 172.21.15.29:0/3285864411 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f97b80ed720 con 0x7f97d013ecc0 2024-01-24T13:05:40.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.106+0000 7f97d6600640 1 -- 172.21.15.29:0/3285864411 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f97d00711a0 con 0x7f97d013ecc0 2024-01-24T13:05:40.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.106+0000 7f97c7400640 1 -- 172.21.15.29:0/3285864411 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7f97d00711a0 con 0x7f97d013ecc0 2024-01-24T13:05:40.110 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:05:40.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.106+0000 7f97d6600640 1 -- 172.21.15.29:0/3285864411 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f97a8065a60 msgr2=0x7f97a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.106+0000 7f97d6600640 1 --2- 172.21.15.29:0/3285864411 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f97a8065a60 0x7f97a8067f20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f97c0000fc0 tx=0x7f97c0009040 comp rx=0 tx=0).stop 2024-01-24T13:05:40.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.106+0000 7f97d6600640 1 -- 172.21.15.29:0/3285864411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d013ecc0 msgr2=0x7f97d0154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.106+0000 7f97d6600640 1 --2- 172.21.15.29:0/3285864411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d013ecc0 0x7f97d0154a60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f97b800b2c0 tx=0x7f97b801d410 comp rx=0 tx=0).stop 2024-01-24T13:05:40.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.106+0000 7f97d6600640 1 -- 172.21.15.29:0/3285864411 shutdown_connections 2024-01-24T13:05:40.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.106+0000 7f97d6600640 1 --2- 172.21.15.29:0/3285864411 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f97a8065a60 0x7f97a8067f20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.106+0000 7f97d6600640 1 --2- 172.21.15.29:0/3285864411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97d015a0d0 0x7f97d0154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.106+0000 7f97d6600640 1 --2- 172.21.15.29:0/3285864411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d013ecc0 0x7f97d0154a60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.106+0000 7f97d6600640 1 --2- 172.21.15.29:0/3285864411 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f97d00ca110 0x7f97d014c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.106+0000 7f97d6600640 1 -- 172.21.15.29:0/3285864411 >> 172.21.15.29:0/3285864411 conn(0x7f97d006a2d0 msgr2=0x7f97d00ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:40.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.106+0000 7f97d6600640 1 -- 172.21.15.29:0/3285864411 shutdown_connections 2024-01-24T13:05:40.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.106+0000 7f97d6600640 1 -- 172.21.15.29:0/3285864411 wait complete. 2024-01-24T13:05:40.131 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:05:40.131 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:05:40.141 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:40.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.322+0000 7f9d50800640 1 Processor -- start 2024-01-24T13:05:40.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.322+0000 7f9d50800640 1 -- start start 2024-01-24T13:05:40.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.326+0000 7f9d50800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9d480cedc0 0x7f9d480cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:40.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.326+0000 7f9d50800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d48071ce0 0x7f9d480cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:40.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.326+0000 7f9d50800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4815cb50 con 0x7f9d4815c770 2024-01-24T13:05:40.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.326+0000 7f9d50800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d48070d10 con 0x7f9d480cedc0 2024-01-24T13:05:40.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.326+0000 7f9d50800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d48070f20 con 0x7f9d48071ce0 2024-01-24T13:05:40.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.326+0000 7f9d4d400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9d480cedc0 0x7f9d480cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:40.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.326+0000 7f9d4de00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9d4815c770 0x7f9d4806d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38056/0 (socket says 172.21.15.29:38056) 2024-01-24T13:05:40.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.326+0000 7f9d4de00640 1 -- 172.21.15.29:0/3761355951 learned_addr learned my addr 172.21.15.29:0/3761355951 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:40.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.326+0000 7f9d4d400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9d480cedc0 0x7f9d480cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55286/0 (socket says 172.21.15.29:55286) 2024-01-24T13:05:40.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.326+0000 7f9d4e800640 1 --2- 172.21.15.29:0/3761355951 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d48071ce0 0x7f9d480cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:40.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.326+0000 7f9d4d400640 1 -- 172.21.15.29:0/3761355951 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d48071ce0 msgr2=0x7f9d480cfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:40.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.326+0000 7f9d4d400640 1 --2- 172.21.15.29:0/3761355951 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d48071ce0 0x7f9d480cfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.326+0000 7f9d4d400640 1 -- 172.21.15.29:0/3761355951 >> v1:172.21.15.29:6789/0 conn(0x7f9d4815c770 legacy=0x7f9d4806d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.326+0000 7f9d4d400640 1 -- 172.21.15.29:0/3761355951 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48071200 con 0x7f9d480cedc0 2024-01-24T13:05:40.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.330+0000 7f9d4d400640 1 --2- 172.21.15.29:0/3761355951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d480cedc0 0x7f9d480cf770 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9d300097c0 tx=0x7f9d3001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c48c7c94b7bc39 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:40.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.330+0000 7f9d4ca00640 1 -- 172.21.15.29:0/3761355951 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d300ac640 con 0x7f9d480cedc0 2024-01-24T13:05:40.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.330+0000 7f9d4ca00640 1 -- 172.21.15.29:0/3761355951 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d300ac7a0 con 0x7f9d480cedc0 2024-01-24T13:05:40.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.330+0000 7f9d4ca00640 1 -- 172.21.15.29:0/3761355951 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d300acb30 con 0x7f9d480cedc0 2024-01-24T13:05:40.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.330+0000 7f9d50800640 1 -- 172.21.15.29:0/3761355951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d480cedc0 msgr2=0x7f9d480cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.330+0000 7f9d50800640 1 --2- 172.21.15.29:0/3761355951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d480cedc0 0x7f9d480cf770 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9d300097c0 tx=0x7f9d3001c3c0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.330+0000 7f9d50800640 1 -- 172.21.15.29:0/3761355951 shutdown_connections 2024-01-24T13:05:40.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.330+0000 7f9d50800640 1 --2- 172.21.15.29:0/3761355951 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d48071ce0 0x7f9d480cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.330+0000 7f9d50800640 1 --2- 172.21.15.29:0/3761355951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d480cedc0 0x7f9d480cf770 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.330+0000 7f9d50800640 1 -- 172.21.15.29:0/3761355951 >> 172.21.15.29:0/3761355951 conn(0x7f9d4806b1e0 msgr2=0x7f9d4806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:40.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.330+0000 7f9d50800640 1 -- 172.21.15.29:0/3761355951 shutdown_connections 2024-01-24T13:05:40.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.330+0000 7f9d50800640 1 -- 172.21.15.29:0/3761355951 wait complete. 2024-01-24T13:05:40.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d50800640 1 Processor -- start 2024-01-24T13:05:40.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d50800640 1 -- start start 2024-01-24T13:05:40.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d50800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d48071ce0 0x7f9d480b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:40.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d50800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d480cedc0 0x7f9d4814f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:40.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d50800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d4815c770 0x7f9d481562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:40.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d50800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480b2a50 con 0x7f9d48071ce0 2024-01-24T13:05:40.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d50800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480b2cf0 con 0x7f9d480cedc0 2024-01-24T13:05:40.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d50800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480b2fd0 con 0x7f9d4815c770 2024-01-24T13:05:40.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d4de00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d48071ce0 0x7f9d480b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:40.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d4de00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d48071ce0 0x7f9d480b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55294/0 (socket says 172.21.15.29:55294) 2024-01-24T13:05:40.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d4de00640 1 -- 172.21.15.29:0/479188048 learned_addr learned my addr 172.21.15.29:0/479188048 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:40.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d4e800640 1 --2- 172.21.15.29:0/479188048 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d4815c770 0x7f9d481562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:40.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d4d400640 1 --2- 172.21.15.29:0/479188048 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d480cedc0 0x7f9d4814f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:40.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d4de00640 1 -- 172.21.15.29:0/479188048 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d4815c770 msgr2=0x7f9d481562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d4de00640 1 --2- 172.21.15.29:0/479188048 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d4815c770 0x7f9d481562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d4de00640 1 -- 172.21.15.29:0/479188048 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d480cedc0 msgr2=0x7f9d4814f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d4de00640 1 --2- 172.21.15.29:0/479188048 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d480cedc0 0x7f9d4814f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d4de00640 1 -- 172.21.15.29:0/479188048 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d30009420 con 0x7f9d48071ce0 2024-01-24T13:05:40.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d4de00640 1 --2- 172.21.15.29:0/479188048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d48071ce0 0x7f9d480b3ab0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800c400 tx=0x7f9d3800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:40.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d46000640 1 -- 172.21.15.29:0/479188048 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38005cf0 con 0x7f9d48071ce0 2024-01-24T13:05:40.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d46000640 1 -- 172.21.15.29:0/479188048 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d38005e50 con 0x7f9d48071ce0 2024-01-24T13:05:40.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d50800640 1 -- 172.21.15.29:0/479188048 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d480b32b0 con 0x7f9d48071ce0 2024-01-24T13:05:40.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d46000640 1 -- 172.21.15.29:0/479188048 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d380072d0 con 0x7f9d48071ce0 2024-01-24T13:05:40.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d50800640 1 -- 172.21.15.29:0/479188048 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4814fed0 con 0x7f9d48071ce0 2024-01-24T13:05:40.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.334+0000 7f9d50800640 1 -- 172.21.15.29:0/479188048 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d481500c0 con 0x7f9d48071ce0 2024-01-24T13:05:40.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.338+0000 7f9d46000640 1 -- 172.21.15.29:0/479188048 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9d38007430 con 0x7f9d48071ce0 2024-01-24T13:05:40.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.338+0000 7f9d46000640 1 --2- 172.21.15.29:0/479188048 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9d20065a90 0x7f9d20067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:40.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.338+0000 7f9d46000640 1 -- 172.21.15.29:0/479188048 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f9d380829d0 con 0x7f9d48071ce0 2024-01-24T13:05:40.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.338+0000 7f9d4d400640 1 --2- 172.21.15.29:0/479188048 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9d20065a90 0x7f9d20067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:40.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.338+0000 7f9d4d400640 1 --2- 172.21.15.29:0/479188048 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9d20065a90 0x7f9d20067f50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9d300ae000 tx=0x7f9d30008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:40.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.342+0000 7f9d46000640 1 -- 172.21.15.29:0/479188048 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9d38050080 con 0x7f9d48071ce0 2024-01-24T13:05:40.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.502+0000 7f9d50800640 1 -- 172.21.15.29:0/479188048 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d480b5250 con 0x7f9d48071ce0 2024-01-24T13:05:40.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.502+0000 7f9d46000640 1 -- 172.21.15.29:0/479188048 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18163 (secure 0 0 0) 0x7f9d380536a0 con 0x7f9d48071ce0 2024-01-24T13:05:40.531 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:40.531 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":46,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:05:37.734611+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:05:21.225564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-24T13:05:22.188525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-01-24T13:05:35.873766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.6","mappings":[{"from":3,"to":2}]},{"pgid":"6.14","mappings":[{"from":4,"to":2}]},{"pgid":"6.24","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:40.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.506+0000 7f9d50800640 1 -- 172.21.15.29:0/479188048 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9d20065a90 msgr2=0x7f9d20067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.506+0000 7f9d50800640 1 --2- 172.21.15.29:0/479188048 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9d20065a90 0x7f9d20067f50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9d300ae000 tx=0x7f9d30008040 comp rx=0 tx=0).stop 2024-01-24T13:05:40.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.506+0000 7f9d50800640 1 -- 172.21.15.29:0/479188048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d48071ce0 msgr2=0x7f9d480b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.506+0000 7f9d50800640 1 --2- 172.21.15.29:0/479188048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d48071ce0 0x7f9d480b3ab0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800c400 tx=0x7f9d3800c8c0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.506+0000 7f9d50800640 1 -- 172.21.15.29:0/479188048 shutdown_connections 2024-01-24T13:05:40.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.506+0000 7f9d50800640 1 --2- 172.21.15.29:0/479188048 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9d20065a90 0x7f9d20067f50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.506+0000 7f9d50800640 1 --2- 172.21.15.29:0/479188048 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d4815c770 0x7f9d481562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.506+0000 7f9d50800640 1 --2- 172.21.15.29:0/479188048 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d480cedc0 0x7f9d4814f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.506+0000 7f9d50800640 1 --2- 172.21.15.29:0/479188048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d48071ce0 0x7f9d480b3ab0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.506+0000 7f9d50800640 1 -- 172.21.15.29:0/479188048 >> 172.21.15.29:0/479188048 conn(0x7f9d4806b1e0 msgr2=0x7f9d481507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:40.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.506+0000 7f9d50800640 1 -- 172.21.15.29:0/479188048 shutdown_connections 2024-01-24T13:05:40.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.506+0000 7f9d50800640 1 -- 172.21.15.29:0/479188048 wait complete. 2024-01-24T13:05:40.534 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:05:21.225564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:05:22.188525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2024-01-24T13:05:35.873766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:05:40.535 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:05:40.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.674+0000 7fc057000640 1 Processor -- start 2024-01-24T13:05:40.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.674+0000 7fc057000640 1 -- start start 2024-01-24T13:05:40.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.674+0000 7fc057000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc0500b2c10 0x7fc05015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:40.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.674+0000 7fc057000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc050153de0 con 0x7fc050153a00 2024-01-24T13:05:40.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.674+0000 7fc057000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc050071d10 con 0x7fc0500b2760 2024-01-24T13:05:40.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.674+0000 7fc057000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc050159900 con 0x7fc0500b2c10 2024-01-24T13:05:40.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.674+0000 7fc04fe00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc050153a00 0x7fc050071600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:38062/0 (socket says 172.21.15.29:38062) 2024-01-24T13:05:40.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.674+0000 7fc04fe00640 1 -- 172.21.15.29:0/3566409893 learned_addr learned my addr 172.21.15.29:0/3566409893 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:40.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.674+0000 7fc055000640 1 --2- 172.21.15.29:0/3566409893 >> v2:172.21.15.163:3300/0 conn(0x7fc0500b2c10 0x7fc05015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:40.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620420828 0 0) 0x7fc050153de0 con 0x7fc050153a00 2024-01-24T13:05:40.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc030003530 con 0x7fc050153a00 2024-01-24T13:05:40.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316189451 0 0) 0x7fc050071d10 con 0x7fc0500b2760 2024-01-24T13:05:40.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc050153de0 con 0x7fc0500b2760 2024-01-24T13:05:40.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4068639468 0 0) 0x7fc030003530 con 0x7fc050153a00 2024-01-24T13:05:40.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 >> v2:172.21.15.163:3300/0 conn(0x7fc0500b2c10 msgr2=0x7fc05015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:40.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 --2- 172.21.15.29:0/3566409893 >> v2:172.21.15.163:3300/0 conn(0x7fc0500b2c10 0x7fc05015d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 >> v1:172.21.15.163:6789/0 conn(0x7fc0500b2760 legacy=0x7fc05015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0500b3060 con 0x7fc050153a00 2024-01-24T13:05:40.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7fc040001680 con 0x7fc050153a00 2024-01-24T13:05:40.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 >> v1:172.21.15.29:6789/0 conn(0x7fc050153a00 legacy=0x7fc050071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 --2- 172.21.15.29:0/3566409893 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc030003b10 0x7fc030003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:40.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 --2- 172.21.15.29:0/3566409893 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc0300047d0 0x7fc030004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:40.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 --2- 172.21.15.29:0/3566409893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc030005190 0x7fc03000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:40.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc050159900 con 0x7fc030005190 2024-01-24T13:05:40.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03000e2d0 con 0x7fc030003b10 2024-01-24T13:05:40.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03000e490 con 0x7fc0300047d0 2024-01-24T13:05:40.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc055000640 1 --2- 172.21.15.29:0/3566409893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc030005190 0x7fc03000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:40.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04fe00640 1 --2- 172.21.15.29:0/3566409893 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc030003b10 0x7fc030003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:40.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04f400640 1 --2- 172.21.15.29:0/3566409893 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc0300047d0 0x7fc030004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:40.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc055000640 1 -- 172.21.15.29:0/3566409893 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc0300047d0 msgr2=0x7fc030004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:40.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc055000640 1 --2- 172.21.15.29:0/3566409893 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc0300047d0 0x7fc030004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc055000640 1 -- 172.21.15.29:0/3566409893 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc030003b10 msgr2=0x7fc030003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:40.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc055000640 1 --2- 172.21.15.29:0/3566409893 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc030003b10 0x7fc030003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc055000640 1 -- 172.21.15.29:0/3566409893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc030003530 con 0x7fc030005190 2024-01-24T13:05:40.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc04f400640 1 --2- 172.21.15.29:0/3566409893 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc0300047d0 0x7fc030004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:40.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc055000640 1 -- 172.21.15.29:0/3566409893 reap_dead start 2024-01-24T13:05:40.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.678+0000 7fc055000640 1 --2- 172.21.15.29:0/3566409893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc030005190 0x7fc03000dba0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc048009fc0 tx=0x7fc04801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cbe52f0d38fe46 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:40.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0480a5cb0 con 0x7fc030005190 2024-01-24T13:05:40.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04800f040 con 0x7fc030005190 2024-01-24T13:05:40.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc04ea00640 1 -- 172.21.15.29:0/3566409893 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048003be0 con 0x7fc030005190 2024-01-24T13:05:40.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 -- 172.21.15.29:0/3566409893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc030005190 msgr2=0x7fc03000dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 --2- 172.21.15.29:0/3566409893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc030005190 0x7fc03000dba0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc048009fc0 tx=0x7fc04801cca0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 -- 172.21.15.29:0/3566409893 shutdown_connections 2024-01-24T13:05:40.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 --2- 172.21.15.29:0/3566409893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc030005190 0x7fc03000dba0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 -- 172.21.15.29:0/3566409893 >> 172.21.15.29:0/3566409893 conn(0x7fc05006d700 msgr2=0x7fc050069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:40.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 -- 172.21.15.29:0/3566409893 shutdown_connections 2024-01-24T13:05:40.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 -- 172.21.15.29:0/3566409893 wait complete. 2024-01-24T13:05:40.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 Processor -- start 2024-01-24T13:05:40.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 -- start start 2024-01-24T13:05:40.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc030005190 0x7fc05013a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:40.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc050140d20 0x7fc05013aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:40.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc05013d3c0 0x7fc05013d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:40.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc050155860 con 0x7fc050140d20 2024-01-24T13:05:40.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0501549d0 con 0x7fc030005190 2024-01-24T13:05:40.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.682+0000 7fc057000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc050154be0 con 0x7fc05013d3c0 2024-01-24T13:05:40.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc04f400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc050140d20 0x7fc05013aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:40.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc04f400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc050140d20 0x7fc05013aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55318/0 (socket says 172.21.15.29:55318) 2024-01-24T13:05:40.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc04f400640 1 -- 172.21.15.29:0/2175407410 learned_addr learned my addr 172.21.15.29:0/2175407410 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:40.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc04fe00640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc030005190 0x7fc05013a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:40.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc055000640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc05013d3c0 0x7fc05013d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:40.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc04f400640 1 -- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc05013d3c0 msgr2=0x7fc05013d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc04f400640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc05013d3c0 0x7fc05013d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc04f400640 1 -- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc030005190 msgr2=0x7fc05013a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc04f400640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc030005190 0x7fc05013a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc04f400640 1 -- 172.21.15.29:0/2175407410 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc050154ec0 con 0x7fc050140d20 2024-01-24T13:05:40.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc04fe00640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc030005190 0x7fc05013a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:40.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc055000640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc05013d3c0 0x7fc05013d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:40.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc04f400640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc050140d20 0x7fc05013aa50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc0380079b0 tx=0x7fc03800f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:40.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc047e00640 1 -- 172.21.15.29:0/2175407410 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038011ea0 con 0x7fc050140d20 2024-01-24T13:05:40.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc047e00640 1 -- 172.21.15.29:0/2175407410 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc038015410 con 0x7fc050140d20 2024-01-24T13:05:40.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc057000640 1 -- 172.21.15.29:0/2175407410 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0501551a0 con 0x7fc050140d20 2024-01-24T13:05:40.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc047e00640 1 -- 172.21.15.29:0/2175407410 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038015780 con 0x7fc050140d20 2024-01-24T13:05:40.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc057000640 1 -- 172.21.15.29:0/2175407410 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05013dd80 con 0x7fc050140d20 2024-01-24T13:05:40.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc057000640 1 -- 172.21.15.29:0/2175407410 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05015a160 con 0x7fc050140d20 2024-01-24T13:05:40.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.686+0000 7fc047e00640 1 -- 172.21.15.29:0/2175407410 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc0380158e0 con 0x7fc050140d20 2024-01-24T13:05:40.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.690+0000 7fc047e00640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc028065a90 0x7fc028067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:40.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.690+0000 7fc047e00640 1 -- 172.21.15.29:0/2175407410 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fc038086b40 con 0x7fc050140d20 2024-01-24T13:05:40.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.690+0000 7fc04fe00640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc028065a90 0x7fc028067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:40.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.690+0000 7fc04fe00640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc028065a90 0x7fc028067f50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc040000c10 tx=0x7fc040009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:40.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.694+0000 7fc047e00640 1 -- 172.21.15.29:0/2175407410 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc05015a160 con 0x7fc050140d20 2024-01-24T13:05:40.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.850+0000 7fc057000640 1 -- 172.21.15.29:0/2175407410 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc0501559a0 con 0x7fc050140d20 2024-01-24T13:05:40.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.850+0000 7fc047e00640 1 -- 172.21.15.29:0/2175407410 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc0501559a0 con 0x7fc050140d20 2024-01-24T13:05:40.854 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:05:40.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.850+0000 7fc057000640 1 -- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc028065a90 msgr2=0x7fc028067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.850+0000 7fc057000640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc028065a90 0x7fc028067f50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc040000c10 tx=0x7fc040009040 comp rx=0 tx=0).stop 2024-01-24T13:05:40.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.850+0000 7fc057000640 1 -- 172.21.15.29:0/2175407410 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc050140d20 msgr2=0x7fc05013aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:40.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.850+0000 7fc057000640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc050140d20 0x7fc05013aa50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc0380079b0 tx=0x7fc03800f540 comp rx=0 tx=0).stop 2024-01-24T13:05:40.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.850+0000 7fc057000640 1 -- 172.21.15.29:0/2175407410 shutdown_connections 2024-01-24T13:05:40.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.850+0000 7fc057000640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc028065a90 0x7fc028067f50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.850+0000 7fc057000640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc05013d3c0 0x7fc05013d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.850+0000 7fc057000640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc050140d20 0x7fc05013aa50 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.850+0000 7fc057000640 1 --2- 172.21.15.29:0/2175407410 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc030005190 0x7fc05013a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:40.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.850+0000 7fc057000640 1 -- 172.21.15.29:0/2175407410 >> 172.21.15.29:0/2175407410 conn(0x7fc05006d700 msgr2=0x7fc050072730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:40.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.850+0000 7fc057000640 1 -- 172.21.15.29:0/2175407410 shutdown_connections 2024-01-24T13:05:40.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:40.854+0000 7fc057000640 1 -- 172.21.15.29:0/2175407410 wait complete. 2024-01-24T13:05:40.877 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:05:41.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed8400640 1 Processor -- start 2024-01-24T13:05:41.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed8400640 1 -- start start 2024-01-24T13:05:41.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed8400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3ed00c3fd0 0x7f3ed00caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed8400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3ed00cb010 0x7f3ed00d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed8400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed00cd1e0 con 0x7f3ed015a6f0 2024-01-24T13:05:41.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed8400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed015aad0 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed8400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00cb480 con 0x7f3ed00cb010 2024-01-24T13:05:41.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed5000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3ed00c3fd0 0x7f3ed00caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed5000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3ed00c3fd0 0x7f3ed00caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54080/0 (socket says 172.21.15.29:54080) 2024-01-24T13:05:41.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed5000640 1 -- 172.21.15.29:0/504412120 learned_addr learned my addr 172.21.15.29:0/504412120 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:41.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed6400640 1 --2- 172.21.15.29:0/504412120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3ed00cb010 0x7f3ed00d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed5000640 1 -- 172.21.15.29:0/504412120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3ed00cb010 msgr2=0x7f3ed00d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:41.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed5000640 1 --2- 172.21.15.29:0/504412120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3ed00cb010 0x7f3ed00d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed5000640 1 -- 172.21.15.29:0/504412120 >> v1:172.21.15.163:6789/0 conn(0x7f3ed015a6f0 legacy=0x7f3ed00ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:41.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.018+0000 7f3ed5000640 1 -- 172.21.15.29:0/504412120 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed00cd4c0 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.022+0000 7f3ed5000640 1 --2- 172.21.15.29:0/504412120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed00c3fd0 0x7f3ed00caad0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3eb80098a0 tx=0x7f3eb801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c305dbe25f4975 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:41.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.022+0000 7f3ecfe00640 1 -- 172.21.15.29:0/504412120 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb80ab670 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.022+0000 7f3ecfe00640 1 -- 172.21.15.29:0/504412120 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb80ab7d0 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.022+0000 7f3ecfe00640 1 -- 172.21.15.29:0/504412120 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb80abb60 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.022+0000 7f3ed8400640 1 -- 172.21.15.29:0/504412120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed00c3fd0 msgr2=0x7f3ed00caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.022+0000 7f3ed8400640 1 --2- 172.21.15.29:0/504412120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed00c3fd0 0x7f3ed00caad0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3eb80098a0 tx=0x7f3eb801c4b0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.022+0000 7f3ed8400640 1 -- 172.21.15.29:0/504412120 shutdown_connections 2024-01-24T13:05:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.022+0000 7f3ed8400640 1 --2- 172.21.15.29:0/504412120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3ed00cb010 0x7f3ed00d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.022+0000 7f3ed8400640 1 --2- 172.21.15.29:0/504412120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed00c3fd0 0x7f3ed00caad0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.022+0000 7f3ed8400640 1 -- 172.21.15.29:0/504412120 >> 172.21.15.29:0/504412120 conn(0x7f3ed0069cd0 msgr2=0x7f3ed006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:41.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.022+0000 7f3ed8400640 1 -- 172.21.15.29:0/504412120 shutdown_connections 2024-01-24T13:05:41.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.022+0000 7f3ed8400640 1 -- 172.21.15.29:0/504412120 wait complete. 2024-01-24T13:05:41.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed8400640 1 Processor -- start 2024-01-24T13:05:41.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed8400640 1 -- start start 2024-01-24T13:05:41.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed8400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed00c3fd0 0x7f3ed015ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed8400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ed00cb010 0x7f3ed0150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed8400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3ed015a6f0 0x7f3ed0163ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed8400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed006af60 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed8400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed006b240 con 0x7f3ed00cb010 2024-01-24T13:05:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed8400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed006b520 con 0x7f3ed015a6f0 2024-01-24T13:05:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed5a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed00c3fd0 0x7f3ed015ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed5000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ed00cb010 0x7f3ed0150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed5a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed00c3fd0 0x7f3ed015ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54090/0 (socket says 172.21.15.29:54090) 2024-01-24T13:05:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed5a00640 1 -- 172.21.15.29:0/1446659140 learned_addr learned my addr 172.21.15.29:0/1446659140 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:41.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed6400640 1 --2- 172.21.15.29:0/1446659140 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3ed015a6f0 0x7f3ed0163ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed5a00640 1 -- 172.21.15.29:0/1446659140 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3ed015a6f0 msgr2=0x7f3ed0163ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed5a00640 1 --2- 172.21.15.29:0/1446659140 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3ed015a6f0 0x7f3ed0163ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed5a00640 1 -- 172.21.15.29:0/1446659140 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ed00cb010 msgr2=0x7f3ed0150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed5a00640 1 --2- 172.21.15.29:0/1446659140 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ed00cb010 0x7f3ed0150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed5a00640 1 -- 172.21.15.29:0/1446659140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb80094d0 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed5000640 1 --2- 172.21.15.29:0/1446659140 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ed00cb010 0x7f3ed0150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:41.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed5a00640 1 --2- 172.21.15.29:0/1446659140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed00c3fd0 0x7f3ed015ac10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000b410 tx=0x7f3ec000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:41.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ecd600640 1 -- 172.21.15.29:0/1446659140 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0004020 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ecd600640 1 -- 172.21.15.29:0/1446659140 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec0004180 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ecd600640 1 -- 172.21.15.29:0/1446659140 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0011630 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed8400640 1 -- 172.21.15.29:0/1446659140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed006b800 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.026+0000 7f3ed8400640 1 -- 172.21.15.29:0/1446659140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed0150570 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.030+0000 7f3ed8400640 1 -- 172.21.15.29:0/1446659140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed01507f0 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.030+0000 7f3ecd600640 1 -- 172.21.15.29:0/1446659140 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3ec0011790 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.030+0000 7f3ecd600640 1 --2- 172.21.15.29:0/1446659140 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3ea8065a60 0x7f3ea8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.030+0000 7f3ecd600640 1 -- 172.21.15.29:0/1446659140 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f3ec00830d0 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.030+0000 7f3ed5000640 1 --2- 172.21.15.29:0/1446659140 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3ea8065a60 0x7f3ea8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.030+0000 7f3ed5000640 1 --2- 172.21.15.29:0/1446659140 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3ea8065a60 0x7f3ea8067f20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3eb80af000 tx=0x7f3eb80b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:41.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.034+0000 7f3ecd600640 1 -- 172.21.15.29:0/1446659140 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3ed01507f0 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.194+0000 7f3ed8400640 1 -- 172.21.15.29:0/1446659140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ed01507f0 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.194+0000 7f3ecd600640 1 -- 172.21.15.29:0/1446659140 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ed01507f0 con 0x7f3ed00c3fd0 2024-01-24T13:05:41.197 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:41.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.194+0000 7f3ed8400640 1 -- 172.21.15.29:0/1446659140 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3ea8065a60 msgr2=0x7f3ea8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.194+0000 7f3ed8400640 1 --2- 172.21.15.29:0/1446659140 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3ea8065a60 0x7f3ea8067f20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3eb80af000 tx=0x7f3eb80b6040 comp rx=0 tx=0).stop 2024-01-24T13:05:41.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.194+0000 7f3ed8400640 1 -- 172.21.15.29:0/1446659140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed00c3fd0 msgr2=0x7f3ed015ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.194+0000 7f3ed8400640 1 --2- 172.21.15.29:0/1446659140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed00c3fd0 0x7f3ed015ac10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000b410 tx=0x7f3ec000b8d0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.194+0000 7f3ed8400640 1 -- 172.21.15.29:0/1446659140 shutdown_connections 2024-01-24T13:05:41.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.194+0000 7f3ed8400640 1 --2- 172.21.15.29:0/1446659140 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3ea8065a60 0x7f3ea8067f20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.194+0000 7f3ed8400640 1 --2- 172.21.15.29:0/1446659140 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3ed015a6f0 0x7f3ed0163ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.194+0000 7f3ed8400640 1 --2- 172.21.15.29:0/1446659140 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ed00cb010 0x7f3ed0150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.194+0000 7f3ed8400640 1 --2- 172.21.15.29:0/1446659140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed00c3fd0 0x7f3ed015ac10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.194+0000 7f3ed8400640 1 -- 172.21.15.29:0/1446659140 >> 172.21.15.29:0/1446659140 conn(0x7f3ed0069cd0 msgr2=0x7f3ed00b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:41.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.194+0000 7f3ed8400640 1 -- 172.21.15.29:0/1446659140 shutdown_connections 2024-01-24T13:05:41.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.194+0000 7f3ed8400640 1 -- 172.21.15.29:0/1446659140 wait complete. 2024-01-24T13:05:41.219 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:05:41.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6649400640 1 Processor -- start 2024-01-24T13:05:41.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6649400640 1 -- start start 2024-01-24T13:05:41.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6649400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f664406c200 0x7f664413cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6649400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f664413d2e0 0x7f66440cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6649400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664413d750 con 0x7f664406be20 2024-01-24T13:05:41.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6649400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664415b4f0 con 0x7f664406c200 2024-01-24T13:05:41.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6649400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664415b7d0 con 0x7f664413d2e0 2024-01-24T13:05:41.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6641e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f664406c200 0x7f664413cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6641e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f664406c200 0x7f664413cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54106/0 (socket says 172.21.15.29:54106) 2024-01-24T13:05:41.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6641e00640 1 -- 172.21.15.29:0/194389829 learned_addr learned my addr 172.21.15.29:0/194389829 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:41.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6643200640 1 --2- 172.21.15.29:0/194389829 >> v2:172.21.15.163:3300/0 conn(0x7f664413d2e0 0x7f66440cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6641e00640 1 -- 172.21.15.29:0/194389829 >> v2:172.21.15.163:3300/0 conn(0x7f664413d2e0 msgr2=0x7f66440cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:41.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6641e00640 1 --2- 172.21.15.29:0/194389829 >> v2:172.21.15.163:3300/0 conn(0x7f664413d2e0 0x7f66440cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6641e00640 1 -- 172.21.15.29:0/194389829 >> v1:172.21.15.163:6789/0 conn(0x7f664406be20 legacy=0x7f664415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.362+0000 7f6641e00640 1 -- 172.21.15.29:0/194389829 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66440cd0c0 con 0x7f664406c200 2024-01-24T13:05:41.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.366+0000 7f6641e00640 1 --2- 172.21.15.29:0/194389829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f664406c200 0x7f664413cda0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6644155010 tx=0x7f662c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65659ed04fa60860 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:41.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.366+0000 7f6641400640 1 -- 172.21.15.29:0/194389829 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0aa610 con 0x7f664406c200 2024-01-24T13:05:41.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.366+0000 7f6641400640 1 -- 172.21.15.29:0/194389829 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c0a6040 con 0x7f664406c200 2024-01-24T13:05:41.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.366+0000 7f6641400640 1 -- 172.21.15.29:0/194389829 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0aa990 con 0x7f664406c200 2024-01-24T13:05:41.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.366+0000 7f6649400640 1 -- 172.21.15.29:0/194389829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f664406c200 msgr2=0x7f664413cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.366+0000 7f6649400640 1 --2- 172.21.15.29:0/194389829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f664406c200 0x7f664413cda0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6644155010 tx=0x7f662c01c4d0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.366+0000 7f6649400640 1 -- 172.21.15.29:0/194389829 shutdown_connections 2024-01-24T13:05:41.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.366+0000 7f6649400640 1 --2- 172.21.15.29:0/194389829 >> v2:172.21.15.163:3300/0 conn(0x7f664413d2e0 0x7f66440cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.366+0000 7f6649400640 1 --2- 172.21.15.29:0/194389829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f664406c200 0x7f664413cda0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.366+0000 7f6649400640 1 -- 172.21.15.29:0/194389829 >> 172.21.15.29:0/194389829 conn(0x7f664406d700 msgr2=0x7f6644069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:41.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.366+0000 7f6649400640 1 -- 172.21.15.29:0/194389829 shutdown_connections 2024-01-24T13:05:41.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.366+0000 7f6649400640 1 -- 172.21.15.29:0/194389829 wait complete. 2024-01-24T13:05:41.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6649400640 1 Processor -- start 2024-01-24T13:05:41.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6649400640 1 -- start start 2024-01-24T13:05:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6649400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f664406be20 0x7f6644159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6649400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f664406c200 0x7f66441599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6649400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f664413d2e0 0x7f664414f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6649400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664413a960 con 0x7f664406c200 2024-01-24T13:05:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6649400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6644070150 con 0x7f664406be20 2024-01-24T13:05:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6649400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66441503c0 con 0x7f664413d2e0 2024-01-24T13:05:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6641e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f664406c200 0x7f66441599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6642800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f664406be20 0x7f6644159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6641e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f664406c200 0x7f66441599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54120/0 (socket says 172.21.15.29:54120) 2024-01-24T13:05:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6641e00640 1 -- 172.21.15.29:0/3998124436 learned_addr learned my addr 172.21.15.29:0/3998124436 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6643200640 1 --2- 172.21.15.29:0/3998124436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f664413d2e0 0x7f664414f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6641e00640 1 -- 172.21.15.29:0/3998124436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f664413d2e0 msgr2=0x7f664414f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6641e00640 1 --2- 172.21.15.29:0/3998124436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f664413d2e0 0x7f664414f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6641e00640 1 -- 172.21.15.29:0/3998124436 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f664406be20 msgr2=0x7f6644159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6641e00640 1 --2- 172.21.15.29:0/3998124436 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f664406be20 0x7f6644159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6641e00640 1 -- 172.21.15.29:0/3998124436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c0094d0 con 0x7f664406c200 2024-01-24T13:05:41.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6641e00640 1 --2- 172.21.15.29:0/3998124436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f664406c200 0x7f66441599d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f662c0190e0 tx=0x7f662c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:41.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f663aa00640 1 -- 172.21.15.29:0/3998124436 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0bd5f0 con 0x7f664406c200 2024-01-24T13:05:41.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f663aa00640 1 -- 172.21.15.29:0/3998124436 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c0bd750 con 0x7f664406c200 2024-01-24T13:05:41.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6649400640 1 -- 172.21.15.29:0/3998124436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66441506a0 con 0x7f664406c200 2024-01-24T13:05:41.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f663aa00640 1 -- 172.21.15.29:0/3998124436 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0bdb00 con 0x7f664406c200 2024-01-24T13:05:41.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.370+0000 7f6649400640 1 -- 172.21.15.29:0/3998124436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6644150c60 con 0x7f664406c200 2024-01-24T13:05:41.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.374+0000 7f6649400640 1 -- 172.21.15.29:0/3998124436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f664413aad0 con 0x7f664406c200 2024-01-24T13:05:41.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.374+0000 7f663aa00640 1 -- 172.21.15.29:0/3998124436 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f662c0b33f0 con 0x7f664406c200 2024-01-24T13:05:41.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.374+0000 7f663aa00640 1 --2- 172.21.15.29:0/3998124436 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f661c065a60 0x7f661c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.374+0000 7f663aa00640 1 -- 172.21.15.29:0/3998124436 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f662c11e390 con 0x7f664406c200 2024-01-24T13:05:41.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.374+0000 7f6642800640 1 --2- 172.21.15.29:0/3998124436 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f661c065a60 0x7f661c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.374+0000 7f6642800640 1 --2- 172.21.15.29:0/3998124436 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f661c065a60 0x7f661c067f20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6634007fd0 tx=0x7f6634009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:41.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.378+0000 7f663aa00640 1 -- 172.21.15.29:0/3998124436 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f662c0eba40 con 0x7f664406c200 2024-01-24T13:05:41.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.534+0000 7f6649400640 1 -- 172.21.15.29:0/3998124436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f664404e850 con 0x7f664406c200 2024-01-24T13:05:41.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.534+0000 7f663aa00640 1 -- 172.21.15.29:0/3998124436 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7f662c0ef060 con 0x7f664406c200 2024-01-24T13:05:41.538 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:05:41.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.538+0000 7f6649400640 1 -- 172.21.15.29:0/3998124436 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f661c065a60 msgr2=0x7f661c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.538+0000 7f6649400640 1 --2- 172.21.15.29:0/3998124436 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f661c065a60 0x7f661c067f20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6634007fd0 tx=0x7f6634009040 comp rx=0 tx=0).stop 2024-01-24T13:05:41.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.538+0000 7f6649400640 1 -- 172.21.15.29:0/3998124436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f664406c200 msgr2=0x7f66441599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.538+0000 7f6649400640 1 --2- 172.21.15.29:0/3998124436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f664406c200 0x7f66441599d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f662c0190e0 tx=0x7f662c01ad10 comp rx=0 tx=0).stop 2024-01-24T13:05:41.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.538+0000 7f6649400640 1 -- 172.21.15.29:0/3998124436 shutdown_connections 2024-01-24T13:05:41.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.538+0000 7f6649400640 1 --2- 172.21.15.29:0/3998124436 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f661c065a60 0x7f661c067f20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.538+0000 7f6649400640 1 --2- 172.21.15.29:0/3998124436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f664413d2e0 0x7f664414f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.538+0000 7f6649400640 1 --2- 172.21.15.29:0/3998124436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f664406c200 0x7f66441599d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.538+0000 7f6649400640 1 --2- 172.21.15.29:0/3998124436 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f664406be20 0x7f6644159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.538+0000 7f6649400640 1 -- 172.21.15.29:0/3998124436 >> 172.21.15.29:0/3998124436 conn(0x7f664406d700 msgr2=0x7f6644069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:41.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.538+0000 7f6649400640 1 -- 172.21.15.29:0/3998124436 shutdown_connections 2024-01-24T13:05:41.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.538+0000 7f6649400640 1 -- 172.21.15.29:0/3998124436 wait complete. 2024-01-24T13:05:41.561 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-01-24T13:05:41.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f28000640 1 Processor -- start 2024-01-24T13:05:41.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f28000640 1 -- start start 2024-01-24T13:05:41.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f28000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8f2015c830 0x7f8f200c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f28000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f200cd5b0 0x7f8f200711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f28000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f20070cf0 con 0x7f8f201603a0 2024-01-24T13:05:41.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f28000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2015cc10 con 0x7f8f2015c830 2024-01-24T13:05:41.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f28000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f20160910 con 0x7f8f200cd5b0 2024-01-24T13:05:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f25600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8f2015c830 0x7f8f200c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f26000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f200cd5b0 0x7f8f200711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f25600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8f2015c830 0x7f8f200c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:51134/0 (socket says 172.21.15.29:51134) 2024-01-24T13:05:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f25600640 1 -- 172.21.15.29:0/741168465 learned_addr learned my addr 172.21.15.29:0/741168465 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f26000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f200cd5b0 0x7f8f200711d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:51318/0 (socket says 172.21.15.29:51318) 2024-01-24T13:05:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f24c00640 1 --1- 172.21.15.29:0/741168465 >> v1:172.21.15.163:6789/0 conn(0x7f8f201603a0 0x7f8f200ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:51750/0 (socket says 172.21.15.29:51750) 2024-01-24T13:05:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f25600640 1 -- 172.21.15.29:0/741168465 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f200cd5b0 msgr2=0x7f8f200711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f25600640 1 --2- 172.21.15.29:0/741168465 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f200cd5b0 0x7f8f200711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f25600640 1 -- 172.21.15.29:0/741168465 >> v1:172.21.15.163:6789/0 conn(0x7f8f201603a0 legacy=0x7f8f200ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f25600640 1 -- 172.21.15.29:0/741168465 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20160bf0 con 0x7f8f2015c830 2024-01-24T13:05:41.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.702+0000 7f8f26000640 1 --2- 172.21.15.29:0/741168465 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f200cd5b0 0x7f8f200711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:41.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.706+0000 7f8f25600640 1 --2- 172.21.15.29:0/741168465 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f2015c830 0x7f8f200c9920 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009870 tx=0x7f8f1001ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22cd5517a1e6464a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:41.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.706+0000 7f8f1fe00640 1 -- 172.21.15.29:0/741168465 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f100a8a30 con 0x7f8f2015c830 2024-01-24T13:05:41.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.706+0000 7f8f1fe00640 1 -- 172.21.15.29:0/741168465 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f100a8b90 con 0x7f8f2015c830 2024-01-24T13:05:41.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.706+0000 7f8f1fe00640 1 -- 172.21.15.29:0/741168465 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f100b0440 con 0x7f8f2015c830 2024-01-24T13:05:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.706+0000 7f8f28000640 1 -- 172.21.15.29:0/741168465 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f2015c830 msgr2=0x7f8f200c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.706+0000 7f8f28000640 1 --2- 172.21.15.29:0/741168465 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f2015c830 0x7f8f200c9920 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009870 tx=0x7f8f1001ed30 comp rx=0 tx=0).stop 2024-01-24T13:05:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.706+0000 7f8f28000640 1 -- 172.21.15.29:0/741168465 shutdown_connections 2024-01-24T13:05:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.706+0000 7f8f28000640 1 --2- 172.21.15.29:0/741168465 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f200cd5b0 0x7f8f200711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.706+0000 7f8f28000640 1 --2- 172.21.15.29:0/741168465 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f2015c830 0x7f8f200c9920 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.706+0000 7f8f28000640 1 -- 172.21.15.29:0/741168465 >> 172.21.15.29:0/741168465 conn(0x7f8f200cbd50 msgr2=0x7f8f200cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:41.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.706+0000 7f8f28000640 1 -- 172.21.15.29:0/741168465 shutdown_connections 2024-01-24T13:05:41.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.706+0000 7f8f28000640 1 -- 172.21.15.29:0/741168465 wait complete. 2024-01-24T13:05:41.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f28000640 1 Processor -- start 2024-01-24T13:05:41.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f28000640 1 -- start start 2024-01-24T13:05:41.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f28000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200cd5b0 0x7f8f20153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f28000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f2015c830 0x7f8f200c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f28000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f201603a0 0x7f8f200c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f28000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2015d2c0 con 0x7f8f200cd5b0 2024-01-24T13:05:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f28000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2015d5a0 con 0x7f8f201603a0 2024-01-24T13:05:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f28000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2015d880 con 0x7f8f2015c830 2024-01-24T13:05:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f25600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200cd5b0 0x7f8f20153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f25600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200cd5b0 0x7f8f20153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54132/0 (socket says 172.21.15.29:54132) 2024-01-24T13:05:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f25600640 1 -- 172.21.15.29:0/1612720959 learned_addr learned my addr 172.21.15.29:0/1612720959 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f26000640 1 --2- 172.21.15.29:0/1612720959 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f201603a0 0x7f8f200c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f24c00640 1 --2- 172.21.15.29:0/1612720959 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f2015c830 0x7f8f200c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f25600640 1 -- 172.21.15.29:0/1612720959 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f2015c830 msgr2=0x7f8f200c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f25600640 1 --2- 172.21.15.29:0/1612720959 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f2015c830 0x7f8f200c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f25600640 1 -- 172.21.15.29:0/1612720959 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f201603a0 msgr2=0x7f8f200c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f25600640 1 --2- 172.21.15.29:0/1612720959 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f201603a0 0x7f8f200c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f25600640 1 -- 172.21.15.29:0/1612720959 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f18009a70 con 0x7f8f200cd5b0 2024-01-24T13:05:41.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f25600640 1 --2- 172.21.15.29:0/1612720959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200cd5b0 0x7f8f20153df0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8f100b3040 tx=0x7f8f1001bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:41.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.710+0000 7f8f1d600640 1 -- 172.21.15.29:0/1612720959 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f100b0dd0 con 0x7f8f200cd5b0 2024-01-24T13:05:41.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.714+0000 7f8f1d600640 1 -- 172.21.15.29:0/1612720959 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f100bb460 con 0x7f8f200cd5b0 2024-01-24T13:05:41.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.714+0000 7f8f28000640 1 -- 172.21.15.29:0/1612720959 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f100094d0 con 0x7f8f200cd5b0 2024-01-24T13:05:41.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.714+0000 7f8f1d600640 1 -- 172.21.15.29:0/1612720959 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f100bb810 con 0x7f8f200cd5b0 2024-01-24T13:05:41.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.714+0000 7f8f28000640 1 -- 172.21.15.29:0/1612720959 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2015de40 con 0x7f8f200cd5b0 2024-01-24T13:05:41.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.714+0000 7f8f28000640 1 -- 172.21.15.29:0/1612720959 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2015e030 con 0x7f8f200cd5b0 2024-01-24T13:05:41.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.714+0000 7f8f1d600640 1 -- 172.21.15.29:0/1612720959 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8f100bb970 con 0x7f8f200cd5b0 2024-01-24T13:05:41.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.714+0000 7f8f1d600640 1 --2- 172.21.15.29:0/1612720959 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8ef8065a90 0x7f8ef8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:41.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.714+0000 7f8f1d600640 1 -- 172.21.15.29:0/1612720959 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f8f10120be0 con 0x7f8f200cd5b0 2024-01-24T13:05:41.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.714+0000 7f8f24c00640 1 --2- 172.21.15.29:0/1612720959 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8ef8065a90 0x7f8ef8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:41.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.718+0000 7f8f24c00640 1 --2- 172.21.15.29:0/1612720959 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8ef8065a90 0x7f8ef8067f50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8f200ca640 tx=0x7f8f08007e50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:41.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.718+0000 7f8f1d600640 1 -- 172.21.15.29:0/1612720959 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f8f100ee2a0 con 0x7f8f200cd5b0 2024-01-24T13:05:41.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.874+0000 7f8f28000640 1 -- 172.21.15.29:0/1612720959 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f8f20160ea0 con 0x7f8f200cd5b0 2024-01-24T13:05:41.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.874+0000 7f8f1d600640 1 -- 172.21.15.29:0/1612720959 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v46) v1 ==== 97+0+11 (secure 0 0 0) 0x7f8f100c00a0 con 0x7f8f200cd5b0 2024-01-24T13:05:41.879 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:41.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.878+0000 7f8f28000640 1 -- 172.21.15.29:0/1612720959 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8ef8065a90 msgr2=0x7f8ef8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.878+0000 7f8f28000640 1 --2- 172.21.15.29:0/1612720959 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8ef8065a90 0x7f8ef8067f50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8f200ca640 tx=0x7f8f08007e50 comp rx=0 tx=0).stop 2024-01-24T13:05:41.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.878+0000 7f8f28000640 1 -- 172.21.15.29:0/1612720959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200cd5b0 msgr2=0x7f8f20153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:41.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.878+0000 7f8f28000640 1 --2- 172.21.15.29:0/1612720959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200cd5b0 0x7f8f20153df0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8f100b3040 tx=0x7f8f1001bad0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.878+0000 7f8f28000640 1 -- 172.21.15.29:0/1612720959 shutdown_connections 2024-01-24T13:05:41.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.878+0000 7f8f28000640 1 --2- 172.21.15.29:0/1612720959 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8ef8065a90 0x7f8ef8067f50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.878+0000 7f8f28000640 1 --2- 172.21.15.29:0/1612720959 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f201603a0 0x7f8f200c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.878+0000 7f8f28000640 1 --2- 172.21.15.29:0/1612720959 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f2015c830 0x7f8f200c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.878+0000 7f8f28000640 1 --2- 172.21.15.29:0/1612720959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200cd5b0 0x7f8f20153df0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:41.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.878+0000 7f8f28000640 1 -- 172.21.15.29:0/1612720959 >> 172.21.15.29:0/1612720959 conn(0x7f8f200cbd50 msgr2=0x7f8f200aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:41.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.878+0000 7f8f28000640 1 -- 172.21.15.29:0/1612720959 shutdown_connections 2024-01-24T13:05:41.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:41.878+0000 7f8f28000640 1 -- 172.21.15.29:0/1612720959 wait complete. 2024-01-24T13:05:41.901 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:05:42.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.038+0000 7f4698e00640 1 Processor -- start 2024-01-24T13:05:42.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.038+0000 7f4698e00640 1 -- start start 2024-01-24T13:05:42.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.038+0000 7f4698e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f469415c790 0x7f46940cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:42.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.038+0000 7f4698e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46940cb880 con 0x7f46940cb110 2024-01-24T13:05:42.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.038+0000 7f4698e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46940ccd40 con 0x7f4694158c10 2024-01-24T13:05:42.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.038+0000 7f4698e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46940701c0 con 0x7f469415c790 2024-01-24T13:05:42.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4691400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f46940cb110 0x7f46940c8a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60074/0 (socket says 172.21.15.29:60074) 2024-01-24T13:05:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4691400640 1 -- 172.21.15.29:0/4114952817 learned_addr learned my addr 172.21.15.29:0/4114952817 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4692800640 1 --2- 172.21.15.29:0/4114952817 >> v2:172.21.15.163:3300/0 conn(0x7f469415c790 0x7f46940cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 -- 172.21.15.29:0/4114952817 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281518888 0 0) 0x7f46940cb880 con 0x7f46940cb110 2024-01-24T13:05:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 -- 172.21.15.29:0/4114952817 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4674003450 con 0x7f46940cb110 2024-01-24T13:05:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 -- 172.21.15.29:0/4114952817 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3438517829 0 0) 0x7f4674003450 con 0x7f46940cb110 2024-01-24T13:05:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 -- 172.21.15.29:0/4114952817 >> v2:172.21.15.163:3300/0 conn(0x7f469415c790 msgr2=0x7f46940cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 --2- 172.21.15.29:0/4114952817 >> v2:172.21.15.163:3300/0 conn(0x7f469415c790 0x7f46940cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 -- 172.21.15.29:0/4114952817 >> v1:172.21.15.163:6789/0 conn(0x7f4694158c10 legacy=0x7f46940caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 -- 172.21.15.29:0/4114952817 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46940cd020 con 0x7f46940cb110 2024-01-24T13:05:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 -- 172.21.15.29:0/4114952817 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f467c001680 con 0x7f46940cb110 2024-01-24T13:05:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 -- 172.21.15.29:0/4114952817 >> v1:172.21.15.29:6789/0 conn(0x7f46940cb110 legacy=0x7f46940c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 --2- 172.21.15.29:0/4114952817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4674003a70 0x7f4674003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 --2- 172.21.15.29:0/4114952817 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4674008860 0x7f467400ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 --2- 172.21.15.29:0/4114952817 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f467400b4b0 0x7f467400d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:42.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 -- 172.21.15.29:0/4114952817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46940701c0 con 0x7f4674003a70 2024-01-24T13:05:42.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 -- 172.21.15.29:0/4114952817 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467400e250 con 0x7f467400b4b0 2024-01-24T13:05:42.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4690a00640 1 -- 172.21.15.29:0/4114952817 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467400e410 con 0x7f4674008860 2024-01-24T13:05:42.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4691e00640 1 --2- 172.21.15.29:0/4114952817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4674003a70 0x7f4674003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:42.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4691400640 1 --2- 172.21.15.29:0/4114952817 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4674008860 0x7f467400ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:42.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4692800640 1 --2- 172.21.15.29:0/4114952817 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f467400b4b0 0x7f467400d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:42.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4691e00640 1 -- 172.21.15.29:0/4114952817 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4674008860 msgr2=0x7f467400ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:42.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4691e00640 1 --2- 172.21.15.29:0/4114952817 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4674008860 0x7f467400ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:42.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4691e00640 1 -- 172.21.15.29:0/4114952817 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f467400b4b0 msgr2=0x7f467400d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:42.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4691e00640 1 --2- 172.21.15.29:0/4114952817 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f467400b4b0 0x7f467400d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:42.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4691e00640 1 -- 172.21.15.29:0/4114952817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4674003450 con 0x7f4674003a70 2024-01-24T13:05:42.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.042+0000 7f4692800640 1 -- 172.21.15.29:0/4114952817 reap_dead start 2024-01-24T13:05:42.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.046+0000 7f4691e00640 1 --2- 172.21.15.29:0/4114952817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4674003a70 0x7f4674003e50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4684001890 tx=0x7f468401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cb9195c2583065 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:42.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.046+0000 7f4690a00640 1 -- 172.21.15.29:0/4114952817 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840ab600 con 0x7f4674003a70 2024-01-24T13:05:42.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.046+0000 7f4690a00640 1 -- 172.21.15.29:0/4114952817 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46840a7050 con 0x7f4674003a70 2024-01-24T13:05:42.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.046+0000 7f4690a00640 1 -- 172.21.15.29:0/4114952817 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840aba00 con 0x7f4674003a70 2024-01-24T13:05:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.046+0000 7f4698e00640 1 -- 172.21.15.29:0/4114952817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4674003a70 msgr2=0x7f4674003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.046+0000 7f4698e00640 1 --2- 172.21.15.29:0/4114952817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4674003a70 0x7f4674003e50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4684001890 tx=0x7f468401c450 comp rx=0 tx=0).stop 2024-01-24T13:05:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.046+0000 7f4698e00640 1 -- 172.21.15.29:0/4114952817 shutdown_connections 2024-01-24T13:05:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.046+0000 7f4698e00640 1 --2- 172.21.15.29:0/4114952817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4674003a70 0x7f4674003e50 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.046+0000 7f4698e00640 1 -- 172.21.15.29:0/4114952817 >> 172.21.15.29:0/4114952817 conn(0x7f469406a2d0 msgr2=0x7f46940afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.046+0000 7f4698e00640 1 -- 172.21.15.29:0/4114952817 shutdown_connections 2024-01-24T13:05:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.046+0000 7f4698e00640 1 -- 172.21.15.29:0/4114952817 wait complete. 2024-01-24T13:05:42.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.046+0000 7f4698e00640 1 Processor -- start 2024-01-24T13:05:42.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.046+0000 7f4698e00640 1 -- start start 2024-01-24T13:05:42.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4698e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4674003a70 0x7f46940b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:42.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4698e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f469414e630 0x7f469414cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:42.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4698e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46940b1030 0x7f46940b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:42.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4698e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46941599c0 con 0x7f46940b1030 2024-01-24T13:05:42.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4698e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4694159400 con 0x7f4674003a70 2024-01-24T13:05:42.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4698e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46941596e0 con 0x7f469414e630 2024-01-24T13:05:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4692800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46940b1030 0x7f46940b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4692800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46940b1030 0x7f46940b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54158/0 (socket says 172.21.15.29:54158) 2024-01-24T13:05:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4692800640 1 -- 172.21.15.29:0/1803518273 learned_addr learned my addr 172.21.15.29:0/1803518273 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4691e00640 1 --2- 172.21.15.29:0/1803518273 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4674003a70 0x7f46940b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4691400640 1 --2- 172.21.15.29:0/1803518273 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f469414e630 0x7f469414cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4692800640 1 -- 172.21.15.29:0/1803518273 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f469414e630 msgr2=0x7f469414cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4692800640 1 --2- 172.21.15.29:0/1803518273 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f469414e630 0x7f469414cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4692800640 1 -- 172.21.15.29:0/1803518273 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4674003a70 msgr2=0x7f46940b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4692800640 1 --2- 172.21.15.29:0/1803518273 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4674003a70 0x7f46940b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4692800640 1 -- 172.21.15.29:0/1803518273 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469414edb0 con 0x7f46940b1030 2024-01-24T13:05:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4692800640 1 --2- 172.21.15.29:0/1803518273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46940b1030 0x7f46940b14b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f469406cb50 tx=0x7f468c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f468a000640 1 -- 172.21.15.29:0/1803518273 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c00e070 con 0x7f46940b1030 2024-01-24T13:05:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4698e00640 1 -- 172.21.15.29:0/1803518273 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469414de40 con 0x7f46940b1030 2024-01-24T13:05:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f468a000640 1 -- 172.21.15.29:0/1803518273 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c011e10 con 0x7f46940b1030 2024-01-24T13:05:42.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f468a000640 1 -- 172.21.15.29:0/1803518273 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0039a0 con 0x7f46940b1030 2024-01-24T13:05:42.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4698e00640 1 -- 172.21.15.29:0/1803518273 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46940b1bc0 con 0x7f46940b1030 2024-01-24T13:05:42.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.050+0000 7f4698e00640 1 -- 172.21.15.29:0/1803518273 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46940b1ea0 con 0x7f46940b1030 2024-01-24T13:05:42.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.054+0000 7f468a000640 1 -- 172.21.15.29:0/1803518273 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f468c003b00 con 0x7f46940b1030 2024-01-24T13:05:42.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.054+0000 7f468a000640 1 --2- 172.21.15.29:0/1803518273 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f466c065a90 0x7f466c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:42.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.054+0000 7f468a000640 1 -- 172.21.15.29:0/1803518273 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f468c083a50 con 0x7f46940b1030 2024-01-24T13:05:42.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.054+0000 7f4691e00640 1 --2- 172.21.15.29:0/1803518273 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f466c065a90 0x7f466c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:42.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.054+0000 7f4691e00640 1 --2- 172.21.15.29:0/1803518273 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f466c065a90 0x7f466c067f50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f46840ad000 tx=0x7f46840a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:42.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.058+0000 7f468a000640 1 -- 172.21.15.29:0/1803518273 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f468c051060 con 0x7f46940b1030 2024-01-24T13:05:42.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.226+0000 7f4698e00640 1 -- 172.21.15.29:0/1803518273 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f469404e850 con 0x7f46940b1030 2024-01-24T13:05:42.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.226+0000 7f468a000640 1 -- 172.21.15.29:0/1803518273 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7f468c054680 con 0x7f46940b1030 2024-01-24T13:05:42.231 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:05:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.230+0000 7f4698e00640 1 -- 172.21.15.29:0/1803518273 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f466c065a90 msgr2=0x7f466c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.230+0000 7f4698e00640 1 --2- 172.21.15.29:0/1803518273 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f466c065a90 0x7f466c067f50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f46840ad000 tx=0x7f46840a6000 comp rx=0 tx=0).stop 2024-01-24T13:05:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.230+0000 7f4698e00640 1 -- 172.21.15.29:0/1803518273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46940b1030 msgr2=0x7f46940b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.230+0000 7f4698e00640 1 --2- 172.21.15.29:0/1803518273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46940b1030 0x7f46940b14b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f469406cb50 tx=0x7f468c0115a0 comp rx=0 tx=0).stop 2024-01-24T13:05:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.230+0000 7f4698e00640 1 -- 172.21.15.29:0/1803518273 shutdown_connections 2024-01-24T13:05:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.230+0000 7f4698e00640 1 --2- 172.21.15.29:0/1803518273 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f466c065a90 0x7f466c067f50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.230+0000 7f4698e00640 1 --2- 172.21.15.29:0/1803518273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46940b1030 0x7f46940b14b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.230+0000 7f4698e00640 1 --2- 172.21.15.29:0/1803518273 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f469414e630 0x7f469414cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.230+0000 7f4698e00640 1 --2- 172.21.15.29:0/1803518273 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4674003a70 0x7f46940b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.230+0000 7f4698e00640 1 -- 172.21.15.29:0/1803518273 >> 172.21.15.29:0/1803518273 conn(0x7f469406a2d0 msgr2=0x7f469415cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.230+0000 7f4698e00640 1 -- 172.21.15.29:0/1803518273 shutdown_connections 2024-01-24T13:05:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:42.230+0000 7f4698e00640 1 -- 172.21.15.29:0/1803518273 wait complete. 2024-01-24T13:05:42.253 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-01-24T13:05:42.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:42.253 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-24T13:05:42.271 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[37111]: fuse finished with error 0 and tester_r 0 2024-01-24T13:05:42.273 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:05:48.375 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:05:48.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:48.375 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-24T13:05:48.387 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-24T13:05:48.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.582+0000 7f53d7200640 1 Processor -- start 2024-01-24T13:05:48.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.582+0000 7f53d7200640 1 -- start start 2024-01-24T13:05:48.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.582+0000 7f53d7200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f53d00ae150 0x7f53d0069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:48.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.582+0000 7f53d7200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d00caed0 con 0x7f53d01612c0 2024-01-24T13:05:48.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.582+0000 7f53d7200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d00caca0 con 0x7f53d006cfc0 2024-01-24T13:05:48.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.582+0000 7f53d7200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d00ca4c0 con 0x7f53d00ae150 2024-01-24T13:05:48.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.582+0000 7f53cf400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f53d00ae150 0x7f53d0069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:48.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.582+0000 7f53cfe00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f53d01612c0 0x7f53d006c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60088/0 (socket says 172.21.15.29:60088) 2024-01-24T13:05:48.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.582+0000 7f53cfe00640 1 -- 172.21.15.29:0/3610026294 learned_addr learned my addr 172.21.15.29:0/3610026294 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:48.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.582+0000 7f53cf400640 1 -- 172.21.15.29:0/3610026294 >> v1:172.21.15.163:6789/0 conn(0x7f53d006cfc0 legacy=0x7f53d006a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:48.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.582+0000 7f53cf400640 1 -- 172.21.15.29:0/3610026294 >> v1:172.21.15.29:6789/0 conn(0x7f53d01612c0 legacy=0x7f53d006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:48.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.582+0000 7f53cf400640 1 -- 172.21.15.29:0/3610026294 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d00cb170 con 0x7f53d00ae150 2024-01-24T13:05:48.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.582+0000 7f53cea00640 1 -- 172.21.15.29:0/3610026294 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085535806 0 0) 0x7f53d00caed0 con 0x7f53d01612c0 2024-01-24T13:05:48.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.586+0000 7f53cf400640 1 --2- 172.21.15.29:0/3610026294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ae150 0x7f53d0069cd0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f53b80097c0 tx=0x7f53b801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861589404777c194 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:48.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.586+0000 7f53cea00640 1 -- 172.21.15.29:0/3610026294 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b80ad680 con 0x7f53d00ae150 2024-01-24T13:05:48.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.586+0000 7f53cea00640 1 -- 172.21.15.29:0/3610026294 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b80ad7e0 con 0x7f53d00ae150 2024-01-24T13:05:48.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.586+0000 7f53cea00640 1 -- 172.21.15.29:0/3610026294 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b80adb70 con 0x7f53d00ae150 2024-01-24T13:05:48.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.586+0000 7f53d7200640 1 -- 172.21.15.29:0/3610026294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ae150 msgr2=0x7f53d0069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:48.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.586+0000 7f53d7200640 1 --2- 172.21.15.29:0/3610026294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ae150 0x7f53d0069cd0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f53b80097c0 tx=0x7f53b801c380 comp rx=0 tx=0).stop 2024-01-24T13:05:48.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.586+0000 7f53d7200640 1 -- 172.21.15.29:0/3610026294 shutdown_connections 2024-01-24T13:05:48.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.586+0000 7f53d7200640 1 --2- 172.21.15.29:0/3610026294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ae150 0x7f53d0069cd0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:48.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.586+0000 7f53d7200640 1 -- 172.21.15.29:0/3610026294 >> 172.21.15.29:0/3610026294 conn(0x7f53d00cb700 msgr2=0x7f53d00cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:48.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.586+0000 7f53d7200640 1 -- 172.21.15.29:0/3610026294 shutdown_connections 2024-01-24T13:05:48.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.586+0000 7f53d7200640 1 -- 172.21.15.29:0/3610026294 wait complete. 2024-01-24T13:05:48.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53d7200640 1 Processor -- start 2024-01-24T13:05:48.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53d7200640 1 -- start start 2024-01-24T13:05:48.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53d7200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53d006cfc0 0x7f53d01578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:48.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53d7200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ae150 0x7f53d00c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:48.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53d7200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53d01612c0 0x7f53d015cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:48.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53d7200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00c44e0 con 0x7f53d00ae150 2024-01-24T13:05:48.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53d7200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d015eb60 con 0x7f53d006cfc0 2024-01-24T13:05:48.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53d7200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d015b990 con 0x7f53d01612c0 2024-01-24T13:05:48.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53cf400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ae150 0x7f53d00c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:48.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53cf400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ae150 0x7f53d00c4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54170/0 (socket says 172.21.15.29:54170) 2024-01-24T13:05:48.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53cf400640 1 -- 172.21.15.29:0/1760430687 learned_addr learned my addr 172.21.15.29:0/1760430687 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:48.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53cfe00640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53d006cfc0 0x7f53d01578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:48.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53d5200640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53d01612c0 0x7f53d015cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:48.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53cf400640 1 -- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53d01612c0 msgr2=0x7f53d015cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:48.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53cf400640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53d01612c0 0x7f53d015cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:48.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53cf400640 1 -- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53d006cfc0 msgr2=0x7f53d01578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:48.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53cf400640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53d006cfc0 0x7f53d01578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:48.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53cf400640 1 -- 172.21.15.29:0/1760430687 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b8009420 con 0x7f53d00ae150 2024-01-24T13:05:48.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53d5200640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53d01612c0 0x7f53d015cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:48.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53cfe00640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53d006cfc0 0x7f53d01578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:48.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53cf400640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ae150 0x7f53d00c4ef0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f53b8019fb0 tx=0x7f53b8019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:48.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53c7e00640 1 -- 172.21.15.29:0/1760430687 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b80ade20 con 0x7f53d00ae150 2024-01-24T13:05:48.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53c7e00640 1 -- 172.21.15.29:0/1760430687 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b8004020 con 0x7f53d00ae150 2024-01-24T13:05:48.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53c7e00640 1 -- 172.21.15.29:0/1760430687 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8004390 con 0x7f53d00ae150 2024-01-24T13:05:48.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53d7200640 1 -- 172.21.15.29:0/1760430687 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d015d960 con 0x7f53d00ae150 2024-01-24T13:05:48.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53d7200640 1 -- 172.21.15.29:0/1760430687 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d00c46f0 con 0x7f53d00ae150 2024-01-24T13:05:48.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.590+0000 7f53d7200640 1 -- 172.21.15.29:0/1760430687 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d00b16d0 con 0x7f53d00ae150 2024-01-24T13:05:48.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.594+0000 7f53c7e00640 1 -- 172.21.15.29:0/1760430687 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f53b80b4040 con 0x7f53d00ae150 2024-01-24T13:05:48.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.594+0000 7f53c7e00640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f53a8065a90 0x7f53a8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:48.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.594+0000 7f53c7e00640 1 -- 172.21.15.29:0/1760430687 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f53b811cbb0 con 0x7f53d00ae150 2024-01-24T13:05:48.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.594+0000 7f53cfe00640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f53a8065a90 0x7f53a8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:48.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.594+0000 7f53cfe00640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f53a8065a90 0x7f53a8067f50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f53c0007fd0 tx=0x7f53c0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:48.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.598+0000 7f53c7e00640 1 -- 172.21.15.29:0/1760430687 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f53b80ea1b0 con 0x7f53d00ae150 2024-01-24T13:05:48.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.790+0000 7f53d7200640 1 -- 172.21.15.29:0/1760430687 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f53d004e850 con 0x7f53d00ae150 2024-01-24T13:05:48.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.790+0000 7f53c7e00640 1 -- 172.21.15.29:0/1760430687 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+82 (secure 0 0 0) 0x7f53b80b2070 con 0x7f53d00ae150 2024-01-24T13:05:48.794 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-01-24T13:05:48.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.790+0000 7f53d7200640 1 -- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f53a8065a90 msgr2=0x7f53a8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:48.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.790+0000 7f53d7200640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f53a8065a90 0x7f53a8067f50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f53c0007fd0 tx=0x7f53c0009040 comp rx=0 tx=0).stop 2024-01-24T13:05:48.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.790+0000 7f53d7200640 1 -- 172.21.15.29:0/1760430687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ae150 msgr2=0x7f53d00c4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:48.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.790+0000 7f53d7200640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ae150 0x7f53d00c4ef0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f53b8019fb0 tx=0x7f53b8019120 comp rx=0 tx=0).stop 2024-01-24T13:05:48.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.790+0000 7f53d7200640 1 -- 172.21.15.29:0/1760430687 shutdown_connections 2024-01-24T13:05:48.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.790+0000 7f53d7200640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f53a8065a90 0x7f53a8067f50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:48.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.790+0000 7f53d7200640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f53d01612c0 0x7f53d015cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:48.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.790+0000 7f53d7200640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ae150 0x7f53d00c4ef0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:48.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.790+0000 7f53d7200640 1 --2- 172.21.15.29:0/1760430687 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53d006cfc0 0x7f53d01578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:48.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.790+0000 7f53d7200640 1 -- 172.21.15.29:0/1760430687 >> 172.21.15.29:0/1760430687 conn(0x7f53d00cb700 msgr2=0x7f53d00cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:48.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.790+0000 7f53d7200640 1 -- 172.21.15.29:0/1760430687 shutdown_connections 2024-01-24T13:05:48.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:48.790+0000 7f53d7200640 1 -- 172.21.15.29:0/1760430687 wait complete. 2024-01-24T13:05:48.816 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-24T13:05:48.816 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-24T13:05:48.816 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-01-24T13:05:48.816 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-24T13:05:48.816 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-24T13:05:48.816 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-24T13:05:48.816 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-24T13:05:48.816 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-24T13:05:48.816 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:05:48.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:48.817 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-01-24T13:05:48.827 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:05:48.827 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:05:48.827 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:05:48.827 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:48.827 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-24T13:05:48.827 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:48.827 INFO:teuthology.orchestra.run.smithi029.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-24T13:05:48.827 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-01-24T13:05:48.827 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-01-24T13:05:48.827 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-24T13:05:48.827 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42350sec preferred_lft 42350sec 2024-01-24T13:05:48.828 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-01-24T13:05:48.828 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:48.828 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:05:48.828 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:05:48.828 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-01-24T13:05:48.828 INFO:teuthology.orchestra.run.smithi029.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:05:48.828 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:05:48.828 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-01-24T13:05:48.828 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:05:48.828 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-01-24T13:05:48.828 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-01-24T13:05:48.828 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-24T13:05:48.828 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:b4:3c:c7:07 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:05:48.828 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-24T13:05:48.829 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:48.829 INFO:teuthology.orchestra.run.smithi029.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-24T13:05:48.829 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-24T13:05:48.829 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-24T13:05:48.829 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:48.829 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-24T13:05:48.829 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:48.829 INFO:teuthology.orchestra.run.smithi029.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T13:05:48.829 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-24T13:05:48.829 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-24T13:05:48.829 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:48.829 INFO:teuthology.orchestra.run.smithi029.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T13:05:48.829 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-24T13:05:48.829 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-01-24T13:05:48.830 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:05:48.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:48.830 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-24T13:05:48.887 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-01-24T13:05:48.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:48.889 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-01-24T13:05:48.946 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-01-24T13:05:48.946 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-24T13:05:48.946 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-24T13:05:48.946 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-24T13:05:48.946 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-24T13:05:48.946 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-24T13:05:48.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:48.947 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:05:48.947 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:05:48.947 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-24T13:05:48.947 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-24T13:05:48.947 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-24T13:05:48.947 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:05:49.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:49.038 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-24T13:05:49.047 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-24T13:05:49.048 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-24T13:05:49.048 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:05:49.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:49.048 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-01-24T13:05:49.108 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-24T13:05:49.108 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:05:49.108 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-24T13:05:49.160 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:05:49.161 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:05:49.161 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-24T13:05:49.212 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:05:49.277 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:05:49.277 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:05:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:05:49.340 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:05:49.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:49.340 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:05:49.392 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-24T13:05:49.392 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-24T13:05:49.439 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:05:49.459 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:05:49.459 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:05:49.518 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:05:49.520 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:05:49.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:49.521 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:05:49.535 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2024-01-24T13:05:49.530+0000 7f9b7cb2b580 -1 init, newargv = 0x56495d274f10 newargc=15 2024-01-24T13:05:49.535 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[37670]: starting ceph client 2024-01-24T13:05:49.543 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[37670]: starting fuse 2024-01-24T13:05:50.645 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:05:50.669 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:05:50.669 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:05:50.735 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:05:50.737 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:05:50.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:50.738 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:05:50.792 INFO:teuthology.orchestra.run.smithi029.stdout:43 2024-01-24T13:05:50.792 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-24T13:05:50.792 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-01-24T13:05:50.793 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:05:50.794 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-01-24T13:05:50.794 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-24T13:05:50.794 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-24T13:05:50.794 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-24T13:05:50.794 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-01-24T13:05:50.794 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-01-24T13:05:50.794 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-01-24T13:05:50.794 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-24T13:05:50.794 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:05:50.794 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2024-01-24T13:05:50.794 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-01-24T13:05:50.920 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.37670.asok 2024-01-24T13:05:51.104 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37670.asok 2024-01-24T13:05:51.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:51.104 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37670.asok status 2024-01-24T13:05:51.286 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:05:51.286 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-01-24T13:05:51.286 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "4e3182a65800aed6d4aa2f6b86da3cfd72188134", 2024-01-24T13:05:51.286 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable)", 2024-01-24T13:05:51.286 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2024-01-24T13:05:51.286 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-01-24T13:05:51.286 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-24T13:05:51.286 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "37670", 2024-01-24T13:05:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-01-24T13:05:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-01-24T13:05:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-01-24T13:05:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 5838, 2024-01-24T13:05:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-01-24T13:05:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-01-24T13:05:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-01-24T13:05:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 5838 2024-01-24T13:05:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:05:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:05:51.288 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:05:51.288 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2128856487 2024-01-24T13:05:51.288 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:05:51.288 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:51.288 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:05:51.288 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:05:51.288 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:05:51.288 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2128856487 2024-01-24T13:05:51.288 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:05:51.288 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.5838 192.168.0.1:0/2128856487", 2024-01-24T13:05:51.289 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/2128856487", 2024-01-24T13:05:51.289 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-01-24T13:05:51.289 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 18, 2024-01-24T13:05:51.289 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 46, 2024-01-24T13:05:51.289 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-01-24T13:05:51.289 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-01-24T13:05:51.289 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-01-24T13:05:51.289 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:05:51.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:51.301 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-01-24T13:05:51.302 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-24T13:05:51.312 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-01-24T13:05:51.312 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-24T13:05:51.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:51.312 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-24T13:05:51.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:51.375 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-01-24T13:05:51.427 INFO:teuthology.orchestra.run.smithi029.stderr:setfattr: layoutfile: Permission denied 2024-01-24T13:05:51.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:05:51.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:51.429 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-01-24T13:05:51.483 INFO:teuthology.orchestra.run.smithi029.stderr:setfattr: layoutdir: Permission denied 2024-01-24T13:05:51.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:05:51.484 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:05:51.484 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:05:51.537 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:51.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.718+0000 7f3f9f600640 1 Processor -- start 2024-01-24T13:05:51.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.718+0000 7f3f9f600640 1 -- start start 2024-01-24T13:05:51.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.718+0000 7f3f9f600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3f98070240 0x7f3f98070680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:51.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.718+0000 7f3f9f600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f98070bc0 0x7f3f980b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:51.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.718+0000 7f3f9f600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f98071050 con 0x7f3f981588d0 2024-01-24T13:05:51.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.718+0000 7f3f9f600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f981593c0 con 0x7f3f98070240 2024-01-24T13:05:51.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.718+0000 7f3f9f600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9815c830 con 0x7f3f98070bc0 2024-01-24T13:05:51.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.722+0000 7f3f97e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3f98070240 0x7f3f98070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:51.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.722+0000 7f3f9d600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f98070bc0 0x7f3f980b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:51.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.722+0000 7f3f9d600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f98070bc0 0x7f3f980b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:38076/0 (socket says 172.21.15.29:38076) 2024-01-24T13:05:51.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.722+0000 7f3f9d600640 1 -- 172.21.15.29:0/3287684043 learned_addr learned my addr 172.21.15.29:0/3287684043 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:51.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.722+0000 7f3f9d600640 1 -- 172.21.15.29:0/3287684043 >> v2:172.21.15.163:3300/0 conn(0x7f3f98070240 msgr2=0x7f3f98070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:51.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.722+0000 7f3f9d600640 1 --2- 172.21.15.29:0/3287684043 >> v2:172.21.15.163:3300/0 conn(0x7f3f98070240 0x7f3f98070680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:51.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.722+0000 7f3f9d600640 1 -- 172.21.15.29:0/3287684043 >> v1:172.21.15.163:6789/0 conn(0x7f3f981588d0 legacy=0x7f3f98158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:51.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.722+0000 7f3f9d600640 1 -- 172.21.15.29:0/3287684043 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9815cb10 con 0x7f3f98070bc0 2024-01-24T13:05:51.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.722+0000 7f3f9d600640 1 --2- 172.21.15.29:0/3287684043 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f98070bc0 0x7f3f980b1fb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009e50 tx=0x7f3f9001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b14f12acb76c6e6d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:51.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f97400640 1 -- 172.21.15.29:0/3287684043 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900a5680 con 0x7f3f98070bc0 2024-01-24T13:05:51.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f97400640 1 -- 172.21.15.29:0/3287684043 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f900a57e0 con 0x7f3f98070bc0 2024-01-24T13:05:51.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f97400640 1 -- 172.21.15.29:0/3287684043 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900a5b70 con 0x7f3f98070bc0 2024-01-24T13:05:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 -- 172.21.15.29:0/3287684043 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f98070bc0 msgr2=0x7f3f980b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 --2- 172.21.15.29:0/3287684043 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f98070bc0 0x7f3f980b1fb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009e50 tx=0x7f3f9001c950 comp rx=0 tx=0).stop 2024-01-24T13:05:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 -- 172.21.15.29:0/3287684043 shutdown_connections 2024-01-24T13:05:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 --2- 172.21.15.29:0/3287684043 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f98070bc0 0x7f3f980b1fb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 --2- 172.21.15.29:0/3287684043 >> v2:172.21.15.163:3300/0 conn(0x7f3f98070240 0x7f3f98070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 -- 172.21.15.29:0/3287684043 >> 172.21.15.29:0/3287684043 conn(0x7f3f980b3950 msgr2=0x7f3f98069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:51.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 -- 172.21.15.29:0/3287684043 shutdown_connections 2024-01-24T13:05:51.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 -- 172.21.15.29:0/3287684043 wait complete. 2024-01-24T13:05:51.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 Processor -- start 2024-01-24T13:05:51.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 -- start start 2024-01-24T13:05:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f98070240 0x7f3f981548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f98070bc0 0x7f3f98140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f981588d0 0x7f3f98166b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98157f30 con 0x7f3f981588d0 2024-01-24T13:05:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98154e10 con 0x7f3f98070bc0 2024-01-24T13:05:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.726+0000 7f3f9f600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f981550d0 con 0x7f3f98070240 2024-01-24T13:05:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f9d600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f981588d0 0x7f3f98166b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f9d600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f981588d0 0x7f3f98166b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57306/0 (socket says 172.21.15.29:57306) 2024-01-24T13:05:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f9d600640 1 -- 172.21.15.29:0/2785817198 learned_addr learned my addr 172.21.15.29:0/2785817198 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f9cc00640 1 --2- 172.21.15.29:0/2785817198 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f98070240 0x7f3f981548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f97e00640 1 --2- 172.21.15.29:0/2785817198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f98070bc0 0x7f3f98140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f9d600640 1 -- 172.21.15.29:0/2785817198 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f98070240 msgr2=0x7f3f981548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f9d600640 1 --2- 172.21.15.29:0/2785817198 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f98070240 0x7f3f981548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f9d600640 1 -- 172.21.15.29:0/2785817198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f98070bc0 msgr2=0x7f3f98140bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f9d600640 1 --2- 172.21.15.29:0/2785817198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f98070bc0 0x7f3f98140bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f9d600640 1 -- 172.21.15.29:0/2785817198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90009b30 con 0x7f3f981588d0 2024-01-24T13:05:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f9d600640 1 --2- 172.21.15.29:0/2785817198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f981588d0 0x7f3f98166b90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3f9001a580 tx=0x7f3f900196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f94c00640 1 -- 172.21.15.29:0/2785817198 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900b8670 con 0x7f3f981588d0 2024-01-24T13:05:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f94c00640 1 -- 172.21.15.29:0/2785817198 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f900b87d0 con 0x7f3f981588d0 2024-01-24T13:05:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f94c00640 1 -- 172.21.15.29:0/2785817198 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900b8b80 con 0x7f3f981588d0 2024-01-24T13:05:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f9f600640 1 -- 172.21.15.29:0/2785817198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f98071540 con 0x7f3f981588d0 2024-01-24T13:05:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f9f600640 1 -- 172.21.15.29:0/2785817198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f98155690 con 0x7f3f981588d0 2024-01-24T13:05:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f9f600640 1 -- 172.21.15.29:0/2785817198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f98158180 con 0x7f3f981588d0 2024-01-24T13:05:51.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.730+0000 7f3f94c00640 1 -- 172.21.15.29:0/2785817198 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3f900b8ce0 con 0x7f3f981588d0 2024-01-24T13:05:51.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.734+0000 7f3f94c00640 1 --2- 172.21.15.29:0/2785817198 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f70065ab0 0x7f3f70067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:51.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.734+0000 7f3f94c00640 1 -- 172.21.15.29:0/2785817198 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f3f9011e780 con 0x7f3f981588d0 2024-01-24T13:05:51.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.734+0000 7f3f9cc00640 1 --2- 172.21.15.29:0/2785817198 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f70065ab0 0x7f3f70067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:51.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.734+0000 7f3f9cc00640 1 --2- 172.21.15.29:0/2785817198 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f70065ab0 0x7f3f70067f70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3f88007fd0 tx=0x7f3f88009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:51.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.738+0000 7f3f94c00640 1 -- 172.21.15.29:0/2785817198 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3f900ec090 con 0x7f3f981588d0 2024-01-24T13:05:51.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.894+0000 7f3f9f600640 1 -- 172.21.15.29:0/2785817198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f9804e850 con 0x7f3f981588d0 2024-01-24T13:05:51.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.898+0000 7f3f94c00640 1 -- 172.21.15.29:0/2785817198 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18163 (secure 0 0 0) 0x7f3f90009510 con 0x7f3f981588d0 2024-01-24T13:05:51.901 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:51.901 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":46,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:05:37.734611+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:05:21.225564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-24T13:05:22.188525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-01-24T13:05:35.873766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.6","mappings":[{"from":3,"to":2}]},{"pgid":"6.14","mappings":[{"from":4,"to":2}]},{"pgid":"6.24","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:51.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.898+0000 7f3f9f600640 1 -- 172.21.15.29:0/2785817198 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f70065ab0 msgr2=0x7f3f70067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:51.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.898+0000 7f3f9f600640 1 --2- 172.21.15.29:0/2785817198 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f70065ab0 0x7f3f70067f70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3f88007fd0 tx=0x7f3f88009040 comp rx=0 tx=0).stop 2024-01-24T13:05:51.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.898+0000 7f3f9f600640 1 -- 172.21.15.29:0/2785817198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f981588d0 msgr2=0x7f3f98166b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:51.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.898+0000 7f3f9f600640 1 --2- 172.21.15.29:0/2785817198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f981588d0 0x7f3f98166b90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3f9001a580 tx=0x7f3f900196f0 comp rx=0 tx=0).stop 2024-01-24T13:05:51.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.898+0000 7f3f9f600640 1 -- 172.21.15.29:0/2785817198 shutdown_connections 2024-01-24T13:05:51.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.898+0000 7f3f9f600640 1 --2- 172.21.15.29:0/2785817198 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f70065ab0 0x7f3f70067f70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:51.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.898+0000 7f3f9f600640 1 --2- 172.21.15.29:0/2785817198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f981588d0 0x7f3f98166b90 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:51.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.898+0000 7f3f9f600640 1 --2- 172.21.15.29:0/2785817198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f98070bc0 0x7f3f98140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:51.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.898+0000 7f3f9f600640 1 --2- 172.21.15.29:0/2785817198 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f98070240 0x7f3f981548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:51.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.898+0000 7f3f9f600640 1 -- 172.21.15.29:0/2785817198 >> 172.21.15.29:0/2785817198 conn(0x7f3f980b3950 msgr2=0x7f3f98069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:51.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.898+0000 7f3f9f600640 1 -- 172.21.15.29:0/2785817198 shutdown_connections 2024-01-24T13:05:51.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:51.898+0000 7f3f9f600640 1 -- 172.21.15.29:0/2785817198 wait complete. 2024-01-24T13:05:51.923 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:05:21.225564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:05:22.188525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2024-01-24T13:05:35.873766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:05:51.923 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:05:52.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.066+0000 7f243a200640 1 Processor -- start 2024-01-24T13:05:52.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.066+0000 7f243a200640 1 -- start start 2024-01-24T13:05:52.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.066+0000 7f243a200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f243406c860 0x7f243406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.066+0000 7f243a200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243406b320 con 0x7f24340cd520 2024-01-24T13:05:52.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.066+0000 7f243a200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24341611b0 con 0x7f2434142980 2024-01-24T13:05:52.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.066+0000 7f243a200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2434160630 con 0x7f243406c860 2024-01-24T13:05:52.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.066+0000 7f2433400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f243406c860 0x7f243406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.066+0000 7f2433400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f243406c860 0x7f243406ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57316/0 (socket says 172.21.15.29:57316) 2024-01-24T13:05:52.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.066+0000 7f2433e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f24340cd520 0x7f243415d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53444/0 (socket says 172.21.15.29:53444) 2024-01-24T13:05:52.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.066+0000 7f2433400640 1 -- 172.21.15.29:0/4164099769 learned_addr learned my addr 172.21.15.29:0/4164099769 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:52.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.066+0000 7f2433400640 1 -- 172.21.15.29:0/4164099769 >> v1:172.21.15.163:6789/0 conn(0x7f2434142980 legacy=0x7f24340cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.066+0000 7f2433400640 1 -- 172.21.15.29:0/4164099769 >> v1:172.21.15.29:6789/0 conn(0x7f24340cd520 legacy=0x7f243415d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.066+0000 7f2433400640 1 -- 172.21.15.29:0/4164099769 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2434160910 con 0x7f243406c860 2024-01-24T13:05:52.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.070+0000 7f2433400640 1 --2- 172.21.15.29:0/4164099769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f243406c860 0x7f243406ade0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2424009870 tx=0x7f242401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08df62d6e05d811 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:52.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.070+0000 7f2432000640 1 -- 172.21.15.29:0/4164099769 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24240aa670 con 0x7f243406c860 2024-01-24T13:05:52.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.070+0000 7f2432000640 1 -- 172.21.15.29:0/4164099769 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24240aa7d0 con 0x7f243406c860 2024-01-24T13:05:52.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.070+0000 7f2432000640 1 -- 172.21.15.29:0/4164099769 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24240aab60 con 0x7f243406c860 2024-01-24T13:05:52.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.070+0000 7f243a200640 1 -- 172.21.15.29:0/4164099769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f243406c860 msgr2=0x7f243406ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.070+0000 7f243a200640 1 --2- 172.21.15.29:0/4164099769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f243406c860 0x7f243406ade0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2424009870 tx=0x7f242401c510 comp rx=0 tx=0).stop 2024-01-24T13:05:52.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.070+0000 7f243a200640 1 -- 172.21.15.29:0/4164099769 shutdown_connections 2024-01-24T13:05:52.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.070+0000 7f243a200640 1 --2- 172.21.15.29:0/4164099769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f243406c860 0x7f243406ade0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.070+0000 7f243a200640 1 -- 172.21.15.29:0/4164099769 >> 172.21.15.29:0/4164099769 conn(0x7f2434069cd0 msgr2=0x7f243406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:52.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.070+0000 7f243a200640 1 -- 172.21.15.29:0/4164099769 shutdown_connections 2024-01-24T13:05:52.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.070+0000 7f243a200640 1 -- 172.21.15.29:0/4164099769 wait complete. 2024-01-24T13:05:52.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f243a200640 1 Processor -- start 2024-01-24T13:05:52.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f243a200640 1 -- start start 2024-01-24T13:05:52.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f243a200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f243406c860 0x7f2434152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f243a200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24340cd520 0x7f2434159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f243a200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2434142980 0x7f2434159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f243a200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243415ba40 con 0x7f24340cd520 2024-01-24T13:05:52.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f243a200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243415be60 con 0x7f243406c860 2024-01-24T13:05:52.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f243a200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243415adc0 con 0x7f2434142980 2024-01-24T13:05:52.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f2432a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24340cd520 0x7f2434159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f2432a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24340cd520 0x7f2434159340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57328/0 (socket says 172.21.15.29:57328) 2024-01-24T13:05:52.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f2432a00640 1 -- 172.21.15.29:0/2209833538 learned_addr learned my addr 172.21.15.29:0/2209833538 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:52.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f2433e00640 1 --2- 172.21.15.29:0/2209833538 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2434142980 0x7f2434159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f2433400640 1 --2- 172.21.15.29:0/2209833538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f243406c860 0x7f2434152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f2432a00640 1 -- 172.21.15.29:0/2209833538 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2434142980 msgr2=0x7f2434159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f2432a00640 1 --2- 172.21.15.29:0/2209833538 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2434142980 0x7f2434159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f2432a00640 1 -- 172.21.15.29:0/2209833538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f243406c860 msgr2=0x7f2434152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f2432a00640 1 --2- 172.21.15.29:0/2209833538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f243406c860 0x7f2434152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f2432a00640 1 -- 172.21.15.29:0/2209833538 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24240094d0 con 0x7f24340cd520 2024-01-24T13:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f2432a00640 1 --2- 172.21.15.29:0/2209833538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24340cd520 0x7f2434159340 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f241c00c420 tx=0x7f241c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f242b400640 1 -- 172.21.15.29:0/2209833538 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c0052d0 con 0x7f24340cd520 2024-01-24T13:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f242b400640 1 -- 172.21.15.29:0/2209833538 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c005430 con 0x7f24340cd520 2024-01-24T13:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f243a200640 1 -- 172.21.15.29:0/2209833538 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243415b0a0 con 0x7f24340cd520 2024-01-24T13:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f242b400640 1 -- 172.21.15.29:0/2209833538 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c007260 con 0x7f24340cd520 2024-01-24T13:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.074+0000 7f243a200640 1 -- 172.21.15.29:0/2209833538 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243415b660 con 0x7f24340cd520 2024-01-24T13:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.078+0000 7f243a200640 1 -- 172.21.15.29:0/2209833538 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243415bb80 con 0x7f24340cd520 2024-01-24T13:05:52.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.078+0000 7f242b400640 1 -- 172.21.15.29:0/2209833538 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f241c0073c0 con 0x7f24340cd520 2024-01-24T13:05:52.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.078+0000 7f242b400640 1 --2- 172.21.15.29:0/2209833538 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f240c065a60 0x7f240c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.078+0000 7f242b400640 1 -- 172.21.15.29:0/2209833538 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f241c082810 con 0x7f24340cd520 2024-01-24T13:05:52.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.078+0000 7f2433400640 1 --2- 172.21.15.29:0/2209833538 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f240c065a60 0x7f240c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.078+0000 7f2433400640 1 --2- 172.21.15.29:0/2209833538 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f240c065a60 0x7f240c067f20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f24240ae000 tx=0x7f24240b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:52.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.082+0000 7f242b400640 1 -- 172.21.15.29:0/2209833538 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f241c04ff50 con 0x7f24340cd520 2024-01-24T13:05:52.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.238+0000 7f243a200640 1 -- 172.21.15.29:0/2209833538 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24340ce220 con 0x7f24340cd520 2024-01-24T13:05:52.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.238+0000 7f242b400640 1 -- 172.21.15.29:0/2209833538 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f241c053570 con 0x7f24340cd520 2024-01-24T13:05:52.244 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:05:52.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.242+0000 7f243a200640 1 -- 172.21.15.29:0/2209833538 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f240c065a60 msgr2=0x7f240c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.242+0000 7f243a200640 1 --2- 172.21.15.29:0/2209833538 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f240c065a60 0x7f240c067f20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f24240ae000 tx=0x7f24240b5040 comp rx=0 tx=0).stop 2024-01-24T13:05:52.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.242+0000 7f243a200640 1 -- 172.21.15.29:0/2209833538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24340cd520 msgr2=0x7f2434159340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.242+0000 7f243a200640 1 --2- 172.21.15.29:0/2209833538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24340cd520 0x7f2434159340 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f241c00c420 tx=0x7f241c00c8e0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.242+0000 7f243a200640 1 -- 172.21.15.29:0/2209833538 shutdown_connections 2024-01-24T13:05:52.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.242+0000 7f243a200640 1 --2- 172.21.15.29:0/2209833538 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f240c065a60 0x7f240c067f20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.242+0000 7f243a200640 1 --2- 172.21.15.29:0/2209833538 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2434142980 0x7f2434159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.242+0000 7f243a200640 1 --2- 172.21.15.29:0/2209833538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24340cd520 0x7f2434159340 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.242+0000 7f243a200640 1 --2- 172.21.15.29:0/2209833538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f243406c860 0x7f2434152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.242+0000 7f243a200640 1 -- 172.21.15.29:0/2209833538 >> 172.21.15.29:0/2209833538 conn(0x7f2434069cd0 msgr2=0x7f24340d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:52.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.242+0000 7f243a200640 1 -- 172.21.15.29:0/2209833538 shutdown_connections 2024-01-24T13:05:52.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.242+0000 7f243a200640 1 -- 172.21.15.29:0/2209833538 wait complete. 2024-01-24T13:05:52.266 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:05:52.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f2562200640 1 Processor -- start 2024-01-24T13:05:52.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f2562200640 1 -- start start 2024-01-24T13:05:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f2562200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f255c06be20 0x7f255c15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f2562200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f255c06c200 0x7f255c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f2562200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c15b4f0 con 0x7f255c13cda0 2024-01-24T13:05:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f2562200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255c15b7d0 con 0x7f255c06be20 2024-01-24T13:05:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f2562200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0cd0c0 con 0x7f255c06c200 2024-01-24T13:05:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f255b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f255c06be20 0x7f255c15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f255b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f255c06be20 0x7f255c15a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57342/0 (socket says 172.21.15.29:57342) 2024-01-24T13:05:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f255b400640 1 -- 172.21.15.29:0/3909115794 learned_addr learned my addr 172.21.15.29:0/3909115794 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f255b400640 1 -- 172.21.15.29:0/3909115794 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f255c06c200 msgr2=0x7f255c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f255aa00640 1 --2- 172.21.15.29:0/3909115794 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f255c06c200 0x7f255c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f255b400640 1 --2- 172.21.15.29:0/3909115794 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f255c06c200 0x7f255c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f255b400640 1 -- 172.21.15.29:0/3909115794 >> v1:172.21.15.163:6789/0 conn(0x7f255c13cda0 legacy=0x7f255c13d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f255b400640 1 -- 172.21.15.29:0/3909115794 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c0cd3a0 con 0x7f255c06be20 2024-01-24T13:05:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.406+0000 7f255aa00640 1 --2- 172.21.15.29:0/3909115794 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f255c06c200 0x7f255c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:52.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.410+0000 7f255b400640 1 --2- 172.21.15.29:0/3909115794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f255c06be20 0x7f255c15a9c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f254c009870 tx=0x7f254c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ff4880dbe65a2d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:52.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.410+0000 7f255a000640 1 -- 172.21.15.29:0/3909115794 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c0aa640 con 0x7f255c06be20 2024-01-24T13:05:52.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.410+0000 7f255a000640 1 -- 172.21.15.29:0/3909115794 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c0aa7a0 con 0x7f255c06be20 2024-01-24T13:05:52.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.410+0000 7f255a000640 1 -- 172.21.15.29:0/3909115794 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c0aab30 con 0x7f255c06be20 2024-01-24T13:05:52.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.410+0000 7f2562200640 1 -- 172.21.15.29:0/3909115794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f255c06be20 msgr2=0x7f255c15a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.410+0000 7f2562200640 1 --2- 172.21.15.29:0/3909115794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f255c06be20 0x7f255c15a9c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f254c009870 tx=0x7f254c01c4c0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.410+0000 7f2562200640 1 -- 172.21.15.29:0/3909115794 shutdown_connections 2024-01-24T13:05:52.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.410+0000 7f2562200640 1 --2- 172.21.15.29:0/3909115794 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f255c06c200 0x7f255c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.410+0000 7f2562200640 1 --2- 172.21.15.29:0/3909115794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f255c06be20 0x7f255c15a9c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.410+0000 7f2562200640 1 -- 172.21.15.29:0/3909115794 >> 172.21.15.29:0/3909115794 conn(0x7f255c06d700 msgr2=0x7f255c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:52.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.410+0000 7f2562200640 1 -- 172.21.15.29:0/3909115794 shutdown_connections 2024-01-24T13:05:52.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.410+0000 7f2562200640 1 -- 172.21.15.29:0/3909115794 wait complete. 2024-01-24T13:05:52.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f2562200640 1 Processor -- start 2024-01-24T13:05:52.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f2562200640 1 -- start start 2024-01-24T13:05:52.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f2562200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f255c06be20 0x7f255c137e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f2562200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f255c06c200 0x7f255c151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f2562200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f255c13cda0 0x7f255c152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f2562200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c14a540 con 0x7f255c06be20 2024-01-24T13:05:52.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f2562200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0b2310 con 0x7f255c06c200 2024-01-24T13:05:52.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f2562200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0b25f0 con 0x7f255c13cda0 2024-01-24T13:05:52.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f255b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f255c06be20 0x7f255c137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f255b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f255c06be20 0x7f255c137e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57344/0 (socket says 172.21.15.29:57344) 2024-01-24T13:05:52.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f255b400640 1 -- 172.21.15.29:0/4221922827 learned_addr learned my addr 172.21.15.29:0/4221922827 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:52.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f255aa00640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f255c06c200 0x7f255c151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f255be00640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f255c13cda0 0x7f255c152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f255b400640 1 -- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f255c13cda0 msgr2=0x7f255c152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f255b400640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f255c13cda0 0x7f255c152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f255b400640 1 -- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f255c06c200 msgr2=0x7f255c151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f255b400640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f255c06c200 0x7f255c151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f255b400640 1 -- 172.21.15.29:0/4221922827 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c0094d0 con 0x7f255c06be20 2024-01-24T13:05:52.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f255be00640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f255c13cda0 0x7f255c152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:52.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f255b400640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f255c06be20 0x7f255c137e30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f254c0ac040 tx=0x7f254c01ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:52.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f2553400640 1 -- 172.21.15.29:0/4221922827 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c0bd5f0 con 0x7f255c06be20 2024-01-24T13:05:52.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f2553400640 1 -- 172.21.15.29:0/4221922827 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c0bd770 con 0x7f255c06be20 2024-01-24T13:05:52.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f2553400640 1 -- 172.21.15.29:0/4221922827 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c0bdb20 con 0x7f255c06be20 2024-01-24T13:05:52.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f2562200640 1 -- 172.21.15.29:0/4221922827 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255c0b28d0 con 0x7f255c06be20 2024-01-24T13:05:52.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.414+0000 7f2562200640 1 -- 172.21.15.29:0/4221922827 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c138370 con 0x7f255c06be20 2024-01-24T13:05:52.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.418+0000 7f2562200640 1 -- 172.21.15.29:0/4221922827 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c04e850 con 0x7f255c06be20 2024-01-24T13:05:52.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.418+0000 7f2553400640 1 -- 172.21.15.29:0/4221922827 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f254c0a8050 con 0x7f255c06be20 2024-01-24T13:05:52.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.418+0000 7f2553400640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2534065a60 0x7f2534067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.418+0000 7f2553400640 1 -- 172.21.15.29:0/4221922827 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f254c11ddc0 con 0x7f255c06be20 2024-01-24T13:05:52.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.418+0000 7f255aa00640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2534065a60 0x7f2534067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.418+0000 7f255aa00640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2534065a60 0x7f2534067f20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f255c153550 tx=0x7f2544008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:52.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.422+0000 7f2553400640 1 -- 172.21.15.29:0/4221922827 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f254c0eb470 con 0x7f255c06be20 2024-01-24T13:05:52.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.582+0000 7f2562200640 1 -- 172.21.15.29:0/4221922827 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f255c0b2730 con 0x7f255c06be20 2024-01-24T13:05:52.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.582+0000 7f2553400640 1 -- 172.21.15.29:0/4221922827 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f255c0b2730 con 0x7f255c06be20 2024-01-24T13:05:52.587 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:52.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.582+0000 7f2562200640 1 -- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2534065a60 msgr2=0x7f2534067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.582+0000 7f2562200640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2534065a60 0x7f2534067f20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f255c153550 tx=0x7f2544008040 comp rx=0 tx=0).stop 2024-01-24T13:05:52.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.582+0000 7f2562200640 1 -- 172.21.15.29:0/4221922827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f255c06be20 msgr2=0x7f255c137e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.582+0000 7f2562200640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f255c06be20 0x7f255c137e30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f254c0ac040 tx=0x7f254c01ad00 comp rx=0 tx=0).stop 2024-01-24T13:05:52.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.586+0000 7f2562200640 1 -- 172.21.15.29:0/4221922827 shutdown_connections 2024-01-24T13:05:52.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.586+0000 7f2562200640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2534065a60 0x7f2534067f20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.586+0000 7f2562200640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f255c13cda0 0x7f255c152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.586+0000 7f2562200640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f255c06c200 0x7f255c151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.586+0000 7f2562200640 1 --2- 172.21.15.29:0/4221922827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f255c06be20 0x7f255c137e30 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.586+0000 7f2562200640 1 -- 172.21.15.29:0/4221922827 >> 172.21.15.29:0/4221922827 conn(0x7f255c06d700 msgr2=0x7f255c15ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:52.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.586+0000 7f2562200640 1 -- 172.21.15.29:0/4221922827 shutdown_connections 2024-01-24T13:05:52.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.586+0000 7f2562200640 1 -- 172.21.15.29:0/4221922827 wait complete. 2024-01-24T13:05:52.609 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:05:52.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.750+0000 7f2f8ec00640 1 Processor -- start 2024-01-24T13:05:52.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.750+0000 7f2f8ec00640 1 -- start start 2024-01-24T13:05:52.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.754+0000 7f2f8ec00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f880cec60 0x7f2f880cad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.754+0000 7f2f8ec00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f88159950 con 0x7f2f880cb2c0 2024-01-24T13:05:52.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.754+0000 7f2f8ec00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f88069e00 con 0x7f2f88159570 2024-01-24T13:05:52.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.754+0000 7f2f8ec00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8806a0e0 con 0x7f2f880cec60 2024-01-24T13:05:52.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.754+0000 7f2f8d600640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2f880cb2c0 0x7f2f880b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53446/0 (socket says 172.21.15.29:53446) 2024-01-24T13:05:52.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.754+0000 7f2f8d600640 1 -- 172.21.15.29:0/4257719786 learned_addr learned my addr 172.21.15.29:0/4257719786 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:52.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.754+0000 7f2f87400640 1 --2- 172.21.15.29:0/4257719786 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f880cec60 0x7f2f880cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.754+0000 7f2f86a00640 1 -- 172.21.15.29:0/4257719786 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017462812 0 0) 0x7f2f88159950 con 0x7f2f880cb2c0 2024-01-24T13:05:52.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.754+0000 7f2f86a00640 1 -- 172.21.15.29:0/4257719786 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f68003530 con 0x7f2f880cb2c0 2024-01-24T13:05:52.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.754+0000 7f2f86a00640 1 -- 172.21.15.29:0/4257719786 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852117296 0 0) 0x7f2f88069e00 con 0x7f2f88159570 2024-01-24T13:05:52.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.754+0000 7f2f86a00640 1 -- 172.21.15.29:0/4257719786 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f88159950 con 0x7f2f88159570 2024-01-24T13:05:52.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.754+0000 7f2f87400640 1 -- 172.21.15.29:0/4257719786 >> v1:172.21.15.163:6789/0 conn(0x7f2f88159570 legacy=0x7f2f8806abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.754+0000 7f2f87400640 1 -- 172.21.15.29:0/4257719786 >> v1:172.21.15.29:6789/0 conn(0x7f2f880cb2c0 legacy=0x7f2f880b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.754+0000 7f2f87400640 1 -- 172.21.15.29:0/4257719786 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8806a3c0 con 0x7f2f880cec60 2024-01-24T13:05:52.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.758+0000 7f2f87400640 1 --2- 172.21.15.29:0/4257719786 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f880cec60 0x7f2f880cad80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2f700097f0 tx=0x7f2f7001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=371c571beec53dec server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:52.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.758+0000 7f2f86a00640 1 -- 172.21.15.29:0/4257719786 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880b2410 con 0x7f2f880cec60 2024-01-24T13:05:52.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.758+0000 7f2f86a00640 1 -- 172.21.15.29:0/4257719786 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f700a7050 con 0x7f2f880cec60 2024-01-24T13:05:52.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.758+0000 7f2f86a00640 1 -- 172.21.15.29:0/4257719786 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700ab820 con 0x7f2f880cec60 2024-01-24T13:05:52.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.758+0000 7f2f8ec00640 1 -- 172.21.15.29:0/4257719786 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f880cec60 msgr2=0x7f2f880cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.758+0000 7f2f8ec00640 1 --2- 172.21.15.29:0/4257719786 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f880cec60 0x7f2f880cad80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2f700097f0 tx=0x7f2f7001c430 comp rx=0 tx=0).stop 2024-01-24T13:05:52.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.758+0000 7f2f8ec00640 1 -- 172.21.15.29:0/4257719786 shutdown_connections 2024-01-24T13:05:52.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.758+0000 7f2f8ec00640 1 --2- 172.21.15.29:0/4257719786 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f880cec60 0x7f2f880cad80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.758+0000 7f2f8ec00640 1 -- 172.21.15.29:0/4257719786 >> 172.21.15.29:0/4257719786 conn(0x7f2f880714a0 msgr2=0x7f2f880718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:52.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.758+0000 7f2f8ec00640 1 -- 172.21.15.29:0/4257719786 shutdown_connections 2024-01-24T13:05:52.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.758+0000 7f2f8ec00640 1 -- 172.21.15.29:0/4257719786 wait complete. 2024-01-24T13:05:52.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f8ec00640 1 Processor -- start 2024-01-24T13:05:52.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f8ec00640 1 -- start start 2024-01-24T13:05:52.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f8ec00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f880cb2c0 0x7f2f880b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f8ec00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f880cec60 0x7f2f880c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f8ec00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f88159570 0x7f2f88152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f8ec00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880abaf0 con 0x7f2f880cec60 2024-01-24T13:05:52.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f8ec00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880c82e0 con 0x7f2f880cb2c0 2024-01-24T13:05:52.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f8ec00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f88153020 con 0x7f2f88159570 2024-01-24T13:05:52.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f87400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f880cec60 0x7f2f880c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f87400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f880cec60 0x7f2f880c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57348/0 (socket says 172.21.15.29:57348) 2024-01-24T13:05:52.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f87400640 1 -- 172.21.15.29:0/3113597802 learned_addr learned my addr 172.21.15.29:0/3113597802 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:52.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f8d600640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f88159570 0x7f2f88152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f87e00640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f880cb2c0 0x7f2f880b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f87400640 1 -- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f88159570 msgr2=0x7f2f88152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f87400640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f88159570 0x7f2f88152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f87400640 1 -- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f880cb2c0 msgr2=0x7f2f880b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f87400640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f880cb2c0 0x7f2f880b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f87400640 1 -- 172.21.15.29:0/3113597802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70009420 con 0x7f2f880cec60 2024-01-24T13:05:52.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f87e00640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f880cb2c0 0x7f2f880b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:05:52.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f87400640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f880cec60 0x7f2f880c7da0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2f700097f0 tx=0x7f2f7001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:52.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f7fe00640 1 -- 172.21.15.29:0/3113597802 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700b4420 con 0x7f2f880cec60 2024-01-24T13:05:52.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f7fe00640 1 -- 172.21.15.29:0/3113597802 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f700b45a0 con 0x7f2f880cec60 2024-01-24T13:05:52.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f7fe00640 1 -- 172.21.15.29:0/3113597802 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700b4950 con 0x7f2f880cec60 2024-01-24T13:05:52.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f8ec00640 1 -- 172.21.15.29:0/3113597802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f880ade40 con 0x7f2f880cec60 2024-01-24T13:05:52.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f8ec00640 1 -- 172.21.15.29:0/3113597802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f880ae400 con 0x7f2f880cec60 2024-01-24T13:05:52.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.762+0000 7f2f8ec00640 1 -- 172.21.15.29:0/3113597802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8804e000 con 0x7f2f880cec60 2024-01-24T13:05:52.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.766+0000 7f2f7fe00640 1 -- 172.21.15.29:0/3113597802 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2f700b2070 con 0x7f2f880cec60 2024-01-24T13:05:52.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.766+0000 7f2f7fe00640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2f60065a90 0x7f2f60067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:52.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.766+0000 7f2f7fe00640 1 -- 172.21.15.29:0/3113597802 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f2f7011c130 con 0x7f2f880cec60 2024-01-24T13:05:52.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.766+0000 7f2f87e00640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2f60065a90 0x7f2f60067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:52.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.766+0000 7f2f87e00640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2f60065a90 0x7f2f60067f50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f780011f0 tx=0x7f2f78009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:52.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.770+0000 7f2f7fe00640 1 -- 172.21.15.29:0/3113597802 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2f700e9910 con 0x7f2f880cec60 2024-01-24T13:05:52.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.926+0000 7f2f8ec00640 1 -- 172.21.15.29:0/3113597802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f880b59f0 con 0x7f2f880cec60 2024-01-24T13:05:52.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.926+0000 7f2f7fe00640 1 -- 172.21.15.29:0/3113597802 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f700ecf30 con 0x7f2f880cec60 2024-01-24T13:05:52.932 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:05:52.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.930+0000 7f2f8ec00640 1 -- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2f60065a90 msgr2=0x7f2f60067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.930+0000 7f2f8ec00640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2f60065a90 0x7f2f60067f50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f780011f0 tx=0x7f2f78009040 comp rx=0 tx=0).stop 2024-01-24T13:05:52.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.930+0000 7f2f8ec00640 1 -- 172.21.15.29:0/3113597802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f880cec60 msgr2=0x7f2f880c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:52.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.930+0000 7f2f8ec00640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f880cec60 0x7f2f880c7da0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2f700097f0 tx=0x7f2f7001ac70 comp rx=0 tx=0).stop 2024-01-24T13:05:52.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.930+0000 7f2f8ec00640 1 -- 172.21.15.29:0/3113597802 shutdown_connections 2024-01-24T13:05:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.930+0000 7f2f8ec00640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2f60065a90 0x7f2f60067f50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.930+0000 7f2f8ec00640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f88159570 0x7f2f88152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.930+0000 7f2f8ec00640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f880cec60 0x7f2f880c7da0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.930+0000 7f2f8ec00640 1 --2- 172.21.15.29:0/3113597802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f880cb2c0 0x7f2f880b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.930+0000 7f2f8ec00640 1 -- 172.21.15.29:0/3113597802 >> 172.21.15.29:0/3113597802 conn(0x7f2f880714a0 msgr2=0x7f2f880cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.930+0000 7f2f8ec00640 1 -- 172.21.15.29:0/3113597802 shutdown_connections 2024-01-24T13:05:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:52.930+0000 7f2f8ec00640 1 -- 172.21.15.29:0/3113597802 wait complete. 2024-01-24T13:05:52.954 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-01-24T13:05:53.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.094+0000 7f4a41400640 1 Processor -- start 2024-01-24T13:05:53.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.094+0000 7f4a41400640 1 -- start start 2024-01-24T13:05:53.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.094+0000 7f4a41400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a3c0cb1e0 0x7f4a3c0d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.094+0000 7f4a41400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3c0cd1e0 con 0x7f4a3c15a6f0 2024-01-24T13:05:53.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.094+0000 7f4a41400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3c0cd4c0 con 0x7f4a3c0c3fd0 2024-01-24T13:05:53.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.094+0000 7f4a41400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3c15aad0 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.094+0000 7f4a3b200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a3c0cb1e0 0x7f4a3c0d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.094+0000 7f4a3a800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4a3c15a6f0 0x7f4a3c0ceb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53462/0 (socket says 172.21.15.29:53462) 2024-01-24T13:05:53.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.094+0000 7f4a3b200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a3c0cb1e0 0x7f4a3c0d0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57362/0 (socket says 172.21.15.29:57362) 2024-01-24T13:05:53.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.094+0000 7f4a3a800640 1 -- 172.21.15.29:0/1221226292 learned_addr learned my addr 172.21.15.29:0/1221226292 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:53.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.094+0000 7f4a3b200640 1 -- 172.21.15.29:0/1221226292 >> v1:172.21.15.163:6789/0 conn(0x7f4a3c0c3fd0 legacy=0x7f4a3c0caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.094+0000 7f4a3b200640 1 -- 172.21.15.29:0/1221226292 >> v1:172.21.15.29:6789/0 conn(0x7f4a3c15a6f0 legacy=0x7f4a3c0ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.094+0000 7f4a3b200640 1 -- 172.21.15.29:0/1221226292 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c0cd7a0 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.098+0000 7f4a3b200640 1 --2- 172.21.15.29:0/1221226292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a3c0cb1e0 0x7f4a3c0d0520 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009d90 tx=0x7f4a3401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3382fe46ec33f1c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:53.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.098+0000 7f4a39400640 1 -- 172.21.15.29:0/1221226292 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a340a58f0 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.098+0000 7f4a39400640 1 -- 172.21.15.29:0/1221226292 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a340a5a50 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.098+0000 7f4a39400640 1 -- 172.21.15.29:0/1221226292 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a340a5de0 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.098+0000 7f4a41400640 1 -- 172.21.15.29:0/1221226292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a3c0cb1e0 msgr2=0x7f4a3c0d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.098+0000 7f4a41400640 1 --2- 172.21.15.29:0/1221226292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a3c0cb1e0 0x7f4a3c0d0520 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009d90 tx=0x7f4a3401c920 comp rx=0 tx=0).stop 2024-01-24T13:05:53.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.098+0000 7f4a41400640 1 -- 172.21.15.29:0/1221226292 shutdown_connections 2024-01-24T13:05:53.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.098+0000 7f4a41400640 1 --2- 172.21.15.29:0/1221226292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a3c0cb1e0 0x7f4a3c0d0520 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.098+0000 7f4a41400640 1 -- 172.21.15.29:0/1221226292 >> 172.21.15.29:0/1221226292 conn(0x7f4a3c069cd0 msgr2=0x7f4a3c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:53.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.098+0000 7f4a41400640 1 -- 172.21.15.29:0/1221226292 shutdown_connections 2024-01-24T13:05:53.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.098+0000 7f4a41400640 1 -- 172.21.15.29:0/1221226292 wait complete. 2024-01-24T13:05:53.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a41400640 1 Processor -- start 2024-01-24T13:05:53.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a41400640 1 -- start start 2024-01-24T13:05:53.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a41400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a3c0c3fd0 0x7f4a3c1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a41400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a3c0cb1e0 0x7f4a3c155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a41400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a3c15a6f0 0x7f4a3c1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a41400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c15c310 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a41400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c15b700 con 0x7f4a3c0c3fd0 2024-01-24T13:05:53.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a41400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c15b9e0 con 0x7f4a3c15a6f0 2024-01-24T13:05:53.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a39e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a3c0cb1e0 0x7f4a3c155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a39e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a3c0cb1e0 0x7f4a3c155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57378/0 (socket says 172.21.15.29:57378) 2024-01-24T13:05:53.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a39e00640 1 -- 172.21.15.29:0/2708473422 learned_addr learned my addr 172.21.15.29:0/2708473422 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:53.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a3b200640 1 --2- 172.21.15.29:0/2708473422 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a3c15a6f0 0x7f4a3c1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a3a800640 1 --2- 172.21.15.29:0/2708473422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a3c0c3fd0 0x7f4a3c1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a39e00640 1 -- 172.21.15.29:0/2708473422 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a3c15a6f0 msgr2=0x7f4a3c1562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a39e00640 1 --2- 172.21.15.29:0/2708473422 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a3c15a6f0 0x7f4a3c1562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a39e00640 1 -- 172.21.15.29:0/2708473422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a3c0c3fd0 msgr2=0x7f4a3c1523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a39e00640 1 --2- 172.21.15.29:0/2708473422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a3c0c3fd0 0x7f4a3c1523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a39e00640 1 -- 172.21.15.29:0/2708473422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a34009a70 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a39e00640 1 --2- 172.21.15.29:0/2708473422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a3c0cb1e0 0x7f4a3c155d70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c500 tx=0x7f4a2400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:53.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a32a00640 1 -- 172.21.15.29:0/2708473422 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24005220 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a32a00640 1 -- 172.21.15.29:0/2708473422 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a24005380 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a41400640 1 -- 172.21.15.29:0/2708473422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3c15bcc0 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a32a00640 1 -- 172.21.15.29:0/2708473422 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24007270 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.102+0000 7f4a41400640 1 -- 172.21.15.29:0/2708473422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3c152900 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.106+0000 7f4a41400640 1 -- 172.21.15.29:0/2708473422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3c15c480 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.106+0000 7f4a32a00640 1 -- 172.21.15.29:0/2708473422 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4a240073d0 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.106+0000 7f4a32a00640 1 --2- 172.21.15.29:0/2708473422 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4a14065a60 0x7f4a14067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.106+0000 7f4a32a00640 1 -- 172.21.15.29:0/2708473422 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f4a24082ce0 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.106+0000 7f4a3a800640 1 --2- 172.21.15.29:0/2708473422 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4a14065a60 0x7f4a14067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.106+0000 7f4a3a800640 1 --2- 172.21.15.29:0/2708473422 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4a14065a60 0x7f4a14067f20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c005890 tx=0x7f4a2c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:53.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.110+0000 7f4a32a00640 1 -- 172.21.15.29:0/2708473422 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4a240503a0 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.266+0000 7f4a41400640 1 -- 172.21.15.29:0/2708473422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f4a3c04e850 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.266+0000 7f4a32a00640 1 -- 172.21.15.29:0/2708473422 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v46) v1 ==== 97+0+11 (secure 0 0 0) 0x7f4a240539c0 con 0x7f4a3c0cb1e0 2024-01-24T13:05:53.272 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:53.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.270+0000 7f4a41400640 1 -- 172.21.15.29:0/2708473422 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4a14065a60 msgr2=0x7f4a14067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.270+0000 7f4a41400640 1 --2- 172.21.15.29:0/2708473422 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4a14065a60 0x7f4a14067f20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c005890 tx=0x7f4a2c009040 comp rx=0 tx=0).stop 2024-01-24T13:05:53.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.270+0000 7f4a41400640 1 -- 172.21.15.29:0/2708473422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a3c0cb1e0 msgr2=0x7f4a3c155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.270+0000 7f4a41400640 1 --2- 172.21.15.29:0/2708473422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a3c0cb1e0 0x7f4a3c155d70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c500 tx=0x7f4a2400c9c0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.270+0000 7f4a41400640 1 -- 172.21.15.29:0/2708473422 shutdown_connections 2024-01-24T13:05:53.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.270+0000 7f4a41400640 1 --2- 172.21.15.29:0/2708473422 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4a14065a60 0x7f4a14067f20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.270+0000 7f4a41400640 1 --2- 172.21.15.29:0/2708473422 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a3c15a6f0 0x7f4a3c1562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.270+0000 7f4a41400640 1 --2- 172.21.15.29:0/2708473422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a3c0cb1e0 0x7f4a3c155d70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.270+0000 7f4a41400640 1 --2- 172.21.15.29:0/2708473422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a3c0c3fd0 0x7f4a3c1523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.270+0000 7f4a41400640 1 -- 172.21.15.29:0/2708473422 >> 172.21.15.29:0/2708473422 conn(0x7f4a3c069cd0 msgr2=0x7f4a3c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:53.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.270+0000 7f4a41400640 1 -- 172.21.15.29:0/2708473422 shutdown_connections 2024-01-24T13:05:53.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.270+0000 7f4a41400640 1 -- 172.21.15.29:0/2708473422 wait complete. 2024-01-24T13:05:53.295 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:05:53.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.430+0000 7f3f86600640 1 Processor -- start 2024-01-24T13:05:53.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.430+0000 7f3f86600640 1 -- start start 2024-01-24T13:05:53.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.434+0000 7f3f86600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f800cd160 0x7f3f800cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.434+0000 7f3f86600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8015ba80 con 0x7f3f800cab00 2024-01-24T13:05:53.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.434+0000 7f3f86600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8015e920 con 0x7f3f8015e0f0 2024-01-24T13:05:53.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.434+0000 7f3f86600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f8015ec00 con 0x7f3f800cd160 2024-01-24T13:05:53.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.434+0000 7f3f7f400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f800cd160 0x7f3f800cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.434+0000 7f3f7fe00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3f800cab00 0x7f3f800ce080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53470/0 (socket says 172.21.15.29:53470) 2024-01-24T13:05:53.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.434+0000 7f3f7f400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f800cd160 0x7f3f800cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57394/0 (socket says 172.21.15.29:57394) 2024-01-24T13:05:53.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.434+0000 7f3f7fe00640 1 -- 172.21.15.29:0/4114383302 learned_addr learned my addr 172.21.15.29:0/4114383302 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:53.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.434+0000 7f3f7f400640 1 -- 172.21.15.29:0/4114383302 >> v1:172.21.15.163:6789/0 conn(0x7f3f8015e0f0 legacy=0x7f3f8015b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:53.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.434+0000 7f3f7f400640 1 -- 172.21.15.29:0/4114383302 >> v1:172.21.15.29:6789/0 conn(0x7f3f800cab00 legacy=0x7f3f800ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.434+0000 7f3f7f400640 1 -- 172.21.15.29:0/4114383302 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8015eee0 con 0x7f3f800cd160 2024-01-24T13:05:53.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.438+0000 7f3f7f400640 1 --2- 172.21.15.29:0/4114383302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f800cd160 0x7f3f800cd540 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3f700097c0 tx=0x7f3f7001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7782e1ae879342 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:53.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.438+0000 7f3f7e000640 1 -- 172.21.15.29:0/4114383302 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f700ab600 con 0x7f3f800cd160 2024-01-24T13:05:53.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.438+0000 7f3f7e000640 1 -- 172.21.15.29:0/4114383302 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f700a7050 con 0x7f3f800cd160 2024-01-24T13:05:53.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.438+0000 7f3f7e000640 1 -- 172.21.15.29:0/4114383302 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f700ab980 con 0x7f3f800cd160 2024-01-24T13:05:53.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.438+0000 7f3f86600640 1 -- 172.21.15.29:0/4114383302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f800cd160 msgr2=0x7f3f800cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.438+0000 7f3f86600640 1 --2- 172.21.15.29:0/4114383302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f800cd160 0x7f3f800cd540 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3f700097c0 tx=0x7f3f7001c410 comp rx=0 tx=0).stop 2024-01-24T13:05:53.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.438+0000 7f3f86600640 1 -- 172.21.15.29:0/4114383302 shutdown_connections 2024-01-24T13:05:53.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.438+0000 7f3f86600640 1 --2- 172.21.15.29:0/4114383302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f800cd160 0x7f3f800cd540 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.438+0000 7f3f86600640 1 -- 172.21.15.29:0/4114383302 >> 172.21.15.29:0/4114383302 conn(0x7f3f80069cd0 msgr2=0x7f3f8006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:53.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.438+0000 7f3f86600640 1 -- 172.21.15.29:0/4114383302 shutdown_connections 2024-01-24T13:05:53.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.438+0000 7f3f86600640 1 -- 172.21.15.29:0/4114383302 wait complete. 2024-01-24T13:05:53.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.438+0000 7f3f86600640 1 Processor -- start 2024-01-24T13:05:53.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.438+0000 7f3f86600640 1 -- start start 2024-01-24T13:05:53.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f86600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f800cab00 0x7f3f800b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f86600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f800cd160 0x7f3f8014b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f86600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f8015e0f0 0x7f3f800d0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f86600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f800c21b0 con 0x7f3f8015e0f0 2024-01-24T13:05:53.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f86600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f800b63f0 con 0x7f3f800cd160 2024-01-24T13:05:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f86600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f800b5070 con 0x7f3f800cab00 2024-01-24T13:05:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f7fe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f8015e0f0 0x7f3f800d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f7fe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f8015e0f0 0x7f3f800d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57406/0 (socket says 172.21.15.29:57406) 2024-01-24T13:05:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f7fe00640 1 -- 172.21.15.29:0/1018574763 learned_addr learned my addr 172.21.15.29:0/1018574763 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f7ea00640 1 --2- 172.21.15.29:0/1018574763 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f800cd160 0x7f3f8014b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f7f400640 1 --2- 172.21.15.29:0/1018574763 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f800cab00 0x7f3f800b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f7fe00640 1 -- 172.21.15.29:0/1018574763 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f800cab00 msgr2=0x7f3f800b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f7fe00640 1 --2- 172.21.15.29:0/1018574763 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f800cab00 0x7f3f800b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f7fe00640 1 -- 172.21.15.29:0/1018574763 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f800cd160 msgr2=0x7f3f8014b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f7fe00640 1 --2- 172.21.15.29:0/1018574763 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f800cd160 0x7f3f8014b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f7fe00640 1 -- 172.21.15.29:0/1018574763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f70009420 con 0x7f3f8015e0f0 2024-01-24T13:05:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f7fe00640 1 --2- 172.21.15.29:0/1018574763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f8015e0f0 0x7f3f800d0400 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800ca80 tx=0x7f3f7800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f77400640 1 -- 172.21.15.29:0/1018574763 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800ac30 con 0x7f3f8015e0f0 2024-01-24T13:05:53.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f77400640 1 -- 172.21.15.29:0/1018574763 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7800ad90 con 0x7f3f8015e0f0 2024-01-24T13:05:53.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f86600640 1 -- 172.21.15.29:0/1018574763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f800b6110 con 0x7f3f8015e0f0 2024-01-24T13:05:53.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f77400640 1 -- 172.21.15.29:0/1018574763 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f78012600 con 0x7f3f8015e0f0 2024-01-24T13:05:53.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f86600640 1 -- 172.21.15.29:0/1018574763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f800c1e40 con 0x7f3f8015e0f0 2024-01-24T13:05:53.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.442+0000 7f3f86600640 1 -- 172.21.15.29:0/1018574763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f800c2320 con 0x7f3f8015e0f0 2024-01-24T13:05:53.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.446+0000 7f3f77400640 1 -- 172.21.15.29:0/1018574763 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3f78007070 con 0x7f3f8015e0f0 2024-01-24T13:05:53.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.446+0000 7f3f77400640 1 --2- 172.21.15.29:0/1018574763 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f58065a60 0x7f3f58067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.446+0000 7f3f77400640 1 -- 172.21.15.29:0/1018574763 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f3f780832c0 con 0x7f3f8015e0f0 2024-01-24T13:05:53.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.446+0000 7f3f7f400640 1 --2- 172.21.15.29:0/1018574763 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f58065a60 0x7f3f58067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.446+0000 7f3f7f400640 1 --2- 172.21.15.29:0/1018574763 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f58065a60 0x7f3f58067f20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3f800b1fc0 tx=0x7f3f70008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:53.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.450+0000 7f3f77400640 1 -- 172.21.15.29:0/1018574763 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3f78050a00 con 0x7f3f8015e0f0 2024-01-24T13:05:53.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.618+0000 7f3f86600640 1 -- 172.21.15.29:0/1018574763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3f8004e850 con 0x7f3f8015e0f0 2024-01-24T13:05:53.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.618+0000 7f3f77400640 1 -- 172.21.15.29:0/1018574763 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3f78054020 con 0x7f3f8015e0f0 2024-01-24T13:05:53.624 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:05:53.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.622+0000 7f3f86600640 1 -- 172.21.15.29:0/1018574763 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f58065a60 msgr2=0x7f3f58067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.622+0000 7f3f86600640 1 --2- 172.21.15.29:0/1018574763 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f58065a60 0x7f3f58067f20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3f800b1fc0 tx=0x7f3f70008040 comp rx=0 tx=0).stop 2024-01-24T13:05:53.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.622+0000 7f3f86600640 1 -- 172.21.15.29:0/1018574763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f8015e0f0 msgr2=0x7f3f800d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.622+0000 7f3f86600640 1 --2- 172.21.15.29:0/1018574763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f8015e0f0 0x7f3f800d0400 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800ca80 tx=0x7f3f7800cf40 comp rx=0 tx=0).stop 2024-01-24T13:05:53.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.622+0000 7f3f86600640 1 -- 172.21.15.29:0/1018574763 shutdown_connections 2024-01-24T13:05:53.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.622+0000 7f3f86600640 1 --2- 172.21.15.29:0/1018574763 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f58065a60 0x7f3f58067f20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.622+0000 7f3f86600640 1 --2- 172.21.15.29:0/1018574763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f8015e0f0 0x7f3f800d0400 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.622+0000 7f3f86600640 1 --2- 172.21.15.29:0/1018574763 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f800cd160 0x7f3f8014b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.622+0000 7f3f86600640 1 --2- 172.21.15.29:0/1018574763 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f800cab00 0x7f3f800b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.622+0000 7f3f86600640 1 -- 172.21.15.29:0/1018574763 >> 172.21.15.29:0/1018574763 conn(0x7f3f80069cd0 msgr2=0x7f3f800cb750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:53.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.622+0000 7f3f86600640 1 -- 172.21.15.29:0/1018574763 shutdown_connections 2024-01-24T13:05:53.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.622+0000 7f3f86600640 1 -- 172.21.15.29:0/1018574763 wait complete. 2024-01-24T13:05:53.646 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:05:53.647 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:05:53.655 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:05:53.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b2be00640 1 Processor -- start 2024-01-24T13:05:53.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b2be00640 1 -- start start 2024-01-24T13:05:53.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b2be00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b240c3ef0 0x7f9b240ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b2be00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9b240caf30 0x7f9b240d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b2be00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b240cfe50 con 0x7f9b2415a630 2024-01-24T13:05:53.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b2be00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b240cf380 con 0x7f9b240caf30 2024-01-24T13:05:53.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b2be00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240cb3c0 con 0x7f9b240c3ef0 2024-01-24T13:05:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b29e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9b240caf30 0x7f9b240d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b28a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b240c3ef0 0x7f9b240ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b29400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f9b2415a630 0x7f9b240cdf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:54682/0 (socket says 172.21.15.29:54682) 2024-01-24T13:05:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b29400640 1 -- 172.21.15.29:0/2227203093 learned_addr learned my addr 172.21.15.29:0/2227203093 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b29e00640 1 -- 172.21.15.29:0/2227203093 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b240c3ef0 msgr2=0x7f9b240ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b29e00640 1 --2- 172.21.15.29:0/2227203093 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b240c3ef0 0x7f9b240ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b29e00640 1 -- 172.21.15.29:0/2227203093 >> v1:172.21.15.163:6789/0 conn(0x7f9b2415a630 legacy=0x7f9b240cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.838+0000 7f9b29e00640 1 -- 172.21.15.29:0/2227203093 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2415aa10 con 0x7f9b240caf30 2024-01-24T13:05:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.842+0000 7f9b29e00640 1 --2- 172.21.15.29:0/2227203093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b240caf30 0x7f9b240d02e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009d90 tx=0x7f9b1c01c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18f6782fd6bfa922 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.842+0000 7f9b23e00640 1 -- 172.21.15.29:0/2227203093 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c0a57c0 con 0x7f9b240caf30 2024-01-24T13:05:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.842+0000 7f9b23e00640 1 -- 172.21.15.29:0/2227203093 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c0a5920 con 0x7f9b240caf30 2024-01-24T13:05:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.842+0000 7f9b23e00640 1 -- 172.21.15.29:0/2227203093 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c0a5cb0 con 0x7f9b240caf30 2024-01-24T13:05:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.842+0000 7f9b2be00640 1 -- 172.21.15.29:0/2227203093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b240caf30 msgr2=0x7f9b240d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.842+0000 7f9b2be00640 1 --2- 172.21.15.29:0/2227203093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b240caf30 0x7f9b240d02e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009d90 tx=0x7f9b1c01c7c0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.842+0000 7f9b2be00640 1 -- 172.21.15.29:0/2227203093 shutdown_connections 2024-01-24T13:05:53.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.842+0000 7f9b2be00640 1 --2- 172.21.15.29:0/2227203093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b240caf30 0x7f9b240d02e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.842+0000 7f9b2be00640 1 --2- 172.21.15.29:0/2227203093 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b240c3ef0 0x7f9b240ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.842+0000 7f9b2be00640 1 -- 172.21.15.29:0/2227203093 >> 172.21.15.29:0/2227203093 conn(0x7f9b24070570 msgr2=0x7f9b24069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:53.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.842+0000 7f9b2be00640 1 -- 172.21.15.29:0/2227203093 shutdown_connections 2024-01-24T13:05:53.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.842+0000 7f9b2be00640 1 -- 172.21.15.29:0/2227203093 wait complete. 2024-01-24T13:05:53.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b2be00640 1 Processor -- start 2024-01-24T13:05:53.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b2be00640 1 -- start start 2024-01-24T13:05:53.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b2be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b240c3ef0 0x7f9b240c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b2be00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b240caf30 0x7f9b240c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b2be00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b2415a630 0x7f9b240c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b2be00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240c97d0 con 0x7f9b240caf30 2024-01-24T13:05:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b2be00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240c52e0 con 0x7f9b240c3ef0 2024-01-24T13:05:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b2be00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240c6b20 con 0x7f9b2415a630 2024-01-24T13:05:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b28a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b240caf30 0x7f9b240c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b28a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b240caf30 0x7f9b240c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57416/0 (socket says 172.21.15.29:57416) 2024-01-24T13:05:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b28a00640 1 -- 172.21.15.29:0/2510040973 learned_addr learned my addr 172.21.15.29:0/2510040973 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b29400640 1 --2- 172.21.15.29:0/2510040973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b240c3ef0 0x7f9b240c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b29e00640 1 --2- 172.21.15.29:0/2510040973 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b2415a630 0x7f9b240c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b28a00640 1 -- 172.21.15.29:0/2510040973 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b2415a630 msgr2=0x7f9b240c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b28a00640 1 --2- 172.21.15.29:0/2510040973 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b2415a630 0x7f9b240c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b28a00640 1 -- 172.21.15.29:0/2510040973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b240c3ef0 msgr2=0x7f9b240c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b28a00640 1 --2- 172.21.15.29:0/2510040973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b240c3ef0 0x7f9b240c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:53.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b28a00640 1 -- 172.21.15.29:0/2510040973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c009a70 con 0x7f9b240caf30 2024-01-24T13:05:53.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b28a00640 1 --2- 172.21.15.29:0/2510040973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b240caf30 0x7f9b240c4da0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00e930 tx=0x7f9b0c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:53.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b21600640 1 -- 172.21.15.29:0/2510040973 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c009690 con 0x7f9b240caf30 2024-01-24T13:05:53.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b21600640 1 -- 172.21.15.29:0/2510040973 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0c00ca00 con 0x7f9b240caf30 2024-01-24T13:05:53.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b21600640 1 -- 172.21.15.29:0/2510040973 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c00cd70 con 0x7f9b240caf30 2024-01-24T13:05:53.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b2be00640 1 -- 172.21.15.29:0/2510040973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b240c5540 con 0x7f9b240caf30 2024-01-24T13:05:53.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.846+0000 7f9b2be00640 1 -- 172.21.15.29:0/2510040973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b240c5b00 con 0x7f9b240caf30 2024-01-24T13:05:53.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.850+0000 7f9b2be00640 1 -- 172.21.15.29:0/2510040973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2404e850 con 0x7f9b240caf30 2024-01-24T13:05:53.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.850+0000 7f9b21600640 1 -- 172.21.15.29:0/2510040973 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9b0c013470 con 0x7f9b240caf30 2024-01-24T13:05:53.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.850+0000 7f9b21600640 1 --2- 172.21.15.29:0/2510040973 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9afc065a60 0x7f9afc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:53.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.850+0000 7f9b21600640 1 -- 172.21.15.29:0/2510040973 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f9b0c083840 con 0x7f9b240caf30 2024-01-24T13:05:53.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.850+0000 7f9b29400640 1 --2- 172.21.15.29:0/2510040973 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9afc065a60 0x7f9afc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:53.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.850+0000 7f9b29400640 1 --2- 172.21.15.29:0/2510040973 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9afc065a60 0x7f9afc067f20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9b14000f70 tx=0x7f9b14007c30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:53.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:53.854+0000 7f9b21600640 1 -- 172.21.15.29:0/2510040973 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9b0c050f00 con 0x7f9b240caf30 2024-01-24T13:05:54.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.014+0000 7f9b2be00640 1 -- 172.21.15.29:0/2510040973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b240cbc00 con 0x7f9b240caf30 2024-01-24T13:05:54.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.018+0000 7f9b21600640 1 -- 172.21.15.29:0/2510040973 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18163 (secure 0 0 0) 0x7f9b0c054520 con 0x7f9b240caf30 2024-01-24T13:05:54.021 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:05:54.021 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":46,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:05:37.734611+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:05:21.225564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-24T13:05:22.188525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-01-24T13:05:35.873766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.6","mappings":[{"from":3,"to":2}]},{"pgid":"6.14","mappings":[{"from":4,"to":2}]},{"pgid":"6.24","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:05:54.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.018+0000 7f9b2be00640 1 -- 172.21.15.29:0/2510040973 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9afc065a60 msgr2=0x7f9afc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.018+0000 7f9b2be00640 1 --2- 172.21.15.29:0/2510040973 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9afc065a60 0x7f9afc067f20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9b14000f70 tx=0x7f9b14007c30 comp rx=0 tx=0).stop 2024-01-24T13:05:54.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.018+0000 7f9b2be00640 1 -- 172.21.15.29:0/2510040973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b240caf30 msgr2=0x7f9b240c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.018+0000 7f9b2be00640 1 --2- 172.21.15.29:0/2510040973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b240caf30 0x7f9b240c4da0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00e930 tx=0x7f9b0c00edf0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.018+0000 7f9b2be00640 1 -- 172.21.15.29:0/2510040973 shutdown_connections 2024-01-24T13:05:54.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.018+0000 7f9b2be00640 1 --2- 172.21.15.29:0/2510040973 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9afc065a60 0x7f9afc067f20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.018+0000 7f9b2be00640 1 --2- 172.21.15.29:0/2510040973 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b2415a630 0x7f9b240c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.018+0000 7f9b2be00640 1 --2- 172.21.15.29:0/2510040973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b240caf30 0x7f9b240c4da0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.018+0000 7f9b2be00640 1 --2- 172.21.15.29:0/2510040973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b240c3ef0 0x7f9b240c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.018+0000 7f9b2be00640 1 -- 172.21.15.29:0/2510040973 >> 172.21.15.29:0/2510040973 conn(0x7f9b24070570 msgr2=0x7f9b24155410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:54.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.018+0000 7f9b2be00640 1 -- 172.21.15.29:0/2510040973 shutdown_connections 2024-01-24T13:05:54.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.018+0000 7f9b2be00640 1 -- 172.21.15.29:0/2510040973 wait complete. 2024-01-24T13:05:54.043 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:05:21.225564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:05:22.188525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2024-01-24T13:05:35.873766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:05:54.043 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:05:54.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.182+0000 7fa243e00640 1 Processor -- start 2024-01-24T13:05:54.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.182+0000 7fa243e00640 1 -- start start 2024-01-24T13:05:54.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa243e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa23c0cd300 0x7fa23c15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa243e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa23c0ce050 0x7fa23c0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa243e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa23c0d0410 0x7fa23c0d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa243e00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23c0cea20 con 0x7fa23c0cd300 2024-01-24T13:05:54.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa243e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23c161130 con 0x7fa23c0ce050 2024-01-24T13:05:54.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa243e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c15dbe0 con 0x7fa23c0d0410 2024-01-24T13:05:54.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa241400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa23c0cd300 0x7fa23c15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa241400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa23c0cd300 0x7fa23c15d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57432/0 (socket says 172.21.15.29:57432) 2024-01-24T13:05:54.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa241400640 1 -- 172.21.15.29:0/2551970986 learned_addr learned my addr 172.21.15.29:0/2551970986 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:54.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa241e00640 1 --2- 172.21.15.29:0/2551970986 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa23c0d0410 0x7fa23c0d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa240a00640 1 --2- 172.21.15.29:0/2551970986 >> v2:172.21.15.163:3300/0 conn(0x7fa23c0ce050 0x7fa23c0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa241400640 1 -- 172.21.15.29:0/2551970986 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa23c0d0410 msgr2=0x7fa23c0d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:54.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa241400640 1 --2- 172.21.15.29:0/2551970986 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa23c0d0410 0x7fa23c0d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa241400640 1 -- 172.21.15.29:0/2551970986 >> v2:172.21.15.163:3300/0 conn(0x7fa23c0ce050 msgr2=0x7fa23c0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:54.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa241400640 1 --2- 172.21.15.29:0/2551970986 >> v2:172.21.15.163:3300/0 conn(0x7fa23c0ce050 0x7fa23c0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa241400640 1 -- 172.21.15.29:0/2551970986 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c1605b0 con 0x7fa23c0cd300 2024-01-24T13:05:54.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.186+0000 7fa241400640 1 --2- 172.21.15.29:0/2551970986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa23c0cd300 0x7fa23c15d6a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0b26b0 tx=0x7fa22c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5313ee143698ab3e server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:54.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa23be00640 1 -- 172.21.15.29:0/2551970986 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0aa620 con 0x7fa23c0cd300 2024-01-24T13:05:54.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa23be00640 1 -- 172.21.15.29:0/2551970986 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c0aa780 con 0x7fa23c0cd300 2024-01-24T13:05:54.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa23be00640 1 -- 172.21.15.29:0/2551970986 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0aab10 con 0x7fa23c0cd300 2024-01-24T13:05:54.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 -- 172.21.15.29:0/2551970986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa23c0cd300 msgr2=0x7fa23c15d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 --2- 172.21.15.29:0/2551970986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa23c0cd300 0x7fa23c15d6a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0b26b0 tx=0x7fa22c01c500 comp rx=0 tx=0).stop 2024-01-24T13:05:54.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 -- 172.21.15.29:0/2551970986 shutdown_connections 2024-01-24T13:05:54.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 --2- 172.21.15.29:0/2551970986 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa23c0d0410 0x7fa23c0d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 --2- 172.21.15.29:0/2551970986 >> v2:172.21.15.163:3300/0 conn(0x7fa23c0ce050 0x7fa23c0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 --2- 172.21.15.29:0/2551970986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa23c0cd300 0x7fa23c15d6a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 -- 172.21.15.29:0/2551970986 >> 172.21.15.29:0/2551970986 conn(0x7fa23c069cd0 msgr2=0x7fa23c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:54.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 -- 172.21.15.29:0/2551970986 shutdown_connections 2024-01-24T13:05:54.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 -- 172.21.15.29:0/2551970986 wait complete. 2024-01-24T13:05:54.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 Processor -- start 2024-01-24T13:05:54.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 -- start start 2024-01-24T13:05:54.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa23c0cd300 0x7fa23c0b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa23c0ce050 0x7fa23c1f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa23c0d0410 0x7fa23c151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0b47c0 con 0x7fa23c0ce050 2024-01-24T13:05:54.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c1f8de0 con 0x7fa23c0d0410 2024-01-24T13:05:54.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.190+0000 7fa243e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c14fe80 con 0x7fa23c0cd300 2024-01-24T13:05:54.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa240a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa23c0ce050 0x7fa23c1f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa240a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa23c0ce050 0x7fa23c1f88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57438/0 (socket says 172.21.15.29:57438) 2024-01-24T13:05:54.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa240a00640 1 -- 172.21.15.29:0/2333209516 learned_addr learned my addr 172.21.15.29:0/2333209516 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:54.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa241400640 1 --2- 172.21.15.29:0/2333209516 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa23c0cd300 0x7fa23c0b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa241e00640 1 --2- 172.21.15.29:0/2333209516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa23c0d0410 0x7fa23c151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa240a00640 1 -- 172.21.15.29:0/2333209516 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa23c0cd300 msgr2=0x7fa23c0b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa240a00640 1 --2- 172.21.15.29:0/2333209516 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa23c0cd300 0x7fa23c0b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa240a00640 1 -- 172.21.15.29:0/2333209516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa23c0d0410 msgr2=0x7fa23c151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa240a00640 1 --2- 172.21.15.29:0/2333209516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa23c0d0410 0x7fa23c151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa240a00640 1 -- 172.21.15.29:0/2333209516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c0094d0 con 0x7fa23c0ce050 2024-01-24T13:05:54.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa240a00640 1 --2- 172.21.15.29:0/2333209516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa23c0ce050 0x7fa23c1f88a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa22400d5f0 tx=0x7fa22400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:54.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa239600640 1 -- 172.21.15.29:0/2333209516 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2240125f0 con 0x7fa23c0ce050 2024-01-24T13:05:54.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa239600640 1 -- 172.21.15.29:0/2333209516 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa224012750 con 0x7fa23c0ce050 2024-01-24T13:05:54.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa243e00640 1 -- 172.21.15.29:0/2333209516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c150160 con 0x7fa23c0ce050 2024-01-24T13:05:54.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa239600640 1 -- 172.21.15.29:0/2333209516 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224012ae0 con 0x7fa23c0ce050 2024-01-24T13:05:54.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa243e00640 1 -- 172.21.15.29:0/2333209516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c1f8ff0 con 0x7fa23c0ce050 2024-01-24T13:05:54.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa243e00640 1 -- 172.21.15.29:0/2333209516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23c04e850 con 0x7fa23c0ce050 2024-01-24T13:05:54.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.194+0000 7fa239600640 1 -- 172.21.15.29:0/2333209516 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa224012c40 con 0x7fa23c0ce050 2024-01-24T13:05:54.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.198+0000 7fa239600640 1 --2- 172.21.15.29:0/2333209516 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa214065a60 0x7fa214067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.198+0000 7fa239600640 1 -- 172.21.15.29:0/2333209516 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fa2240837a0 con 0x7fa23c0ce050 2024-01-24T13:05:54.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.198+0000 7fa241400640 1 --2- 172.21.15.29:0/2333209516 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa214065a60 0x7fa214067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.198+0000 7fa241400640 1 --2- 172.21.15.29:0/2333209516 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa214065a60 0x7fa214067f20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0ae000 tx=0x7fa22c0b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:54.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.202+0000 7fa239600640 1 -- 172.21.15.29:0/2333209516 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa224050f80 con 0x7fa23c0ce050 2024-01-24T13:05:54.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.358+0000 7fa243e00640 1 -- 172.21.15.29:0/2333209516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa23c0ce6f0 con 0x7fa23c0ce050 2024-01-24T13:05:54.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.358+0000 7fa239600640 1 -- 172.21.15.29:0/2333209516 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa224007380 con 0x7fa23c0ce050 2024-01-24T13:05:54.364 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:05:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.362+0000 7fa243e00640 1 -- 172.21.15.29:0/2333209516 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa214065a60 msgr2=0x7fa214067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.362+0000 7fa243e00640 1 --2- 172.21.15.29:0/2333209516 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa214065a60 0x7fa214067f20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0ae000 tx=0x7fa22c0b5040 comp rx=0 tx=0).stop 2024-01-24T13:05:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.362+0000 7fa243e00640 1 -- 172.21.15.29:0/2333209516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa23c0ce050 msgr2=0x7fa23c1f88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.362+0000 7fa243e00640 1 --2- 172.21.15.29:0/2333209516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa23c0ce050 0x7fa23c1f88a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa22400d5f0 tx=0x7fa22400dab0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.362+0000 7fa243e00640 1 -- 172.21.15.29:0/2333209516 shutdown_connections 2024-01-24T13:05:54.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.362+0000 7fa243e00640 1 --2- 172.21.15.29:0/2333209516 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa214065a60 0x7fa214067f20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.362+0000 7fa243e00640 1 --2- 172.21.15.29:0/2333209516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa23c0d0410 0x7fa23c151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.362+0000 7fa243e00640 1 --2- 172.21.15.29:0/2333209516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa23c0ce050 0x7fa23c1f88a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.362+0000 7fa243e00640 1 --2- 172.21.15.29:0/2333209516 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa23c0cd300 0x7fa23c0b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.362+0000 7fa243e00640 1 -- 172.21.15.29:0/2333209516 >> 172.21.15.29:0/2333209516 conn(0x7fa23c069cd0 msgr2=0x7fa23c156430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:54.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.362+0000 7fa243e00640 1 -- 172.21.15.29:0/2333209516 shutdown_connections 2024-01-24T13:05:54.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.362+0000 7fa243e00640 1 -- 172.21.15.29:0/2333209516 wait complete. 2024-01-24T13:05:54.385 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:05:54.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.526+0000 7fc607400640 1 Processor -- start 2024-01-24T13:05:54.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.526+0000 7fc607400640 1 -- start start 2024-01-24T13:05:54.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.526+0000 7fc607400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc60006c200 0x7fc60013cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.526+0000 7fc607400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60013d720 con 0x7fc60006be20 2024-01-24T13:05:54.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.526+0000 7fc607400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60015b4f0 con 0x7fc60013d2e0 2024-01-24T13:05:54.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.526+0000 7fc607400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60015b7d0 con 0x7fc60006c200 2024-01-24T13:05:54.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.526+0000 7fc604a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc60006be20 0x7fc60015a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53472/0 (socket says 172.21.15.29:53472) 2024-01-24T13:05:54.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.526+0000 7fc604a00640 1 -- 172.21.15.29:0/181636958 learned_addr learned my addr 172.21.15.29:0/181636958 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:54.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.526+0000 7fc5ffe00640 1 --2- 172.21.15.29:0/181636958 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc60006c200 0x7fc60013cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.526+0000 7fc5ff400640 1 -- 172.21.15.29:0/181636958 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785390905 0 0) 0x7fc60013d720 con 0x7fc60006be20 2024-01-24T13:05:54.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.530+0000 7fc5ff400640 1 -- 172.21.15.29:0/181636958 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5e0003530 con 0x7fc60006be20 2024-01-24T13:05:54.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.530+0000 7fc5ff400640 1 -- 172.21.15.29:0/181636958 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746363064 0 0) 0x7fc60015b4f0 con 0x7fc60013d2e0 2024-01-24T13:05:54.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.530+0000 7fc5ff400640 1 -- 172.21.15.29:0/181636958 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc60013d720 con 0x7fc60013d2e0 2024-01-24T13:05:54.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.530+0000 7fc5ffe00640 1 -- 172.21.15.29:0/181636958 >> v1:172.21.15.163:6789/0 conn(0x7fc60013d2e0 legacy=0x7fc6000cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.530+0000 7fc5ffe00640 1 -- 172.21.15.29:0/181636958 >> v1:172.21.15.29:6789/0 conn(0x7fc60006be20 legacy=0x7fc60015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.530+0000 7fc5ffe00640 1 -- 172.21.15.29:0/181636958 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6000cd0c0 con 0x7fc60006c200 2024-01-24T13:05:54.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.530+0000 7fc5ffe00640 1 --2- 172.21.15.29:0/181636958 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc60006c200 0x7fc60013cda0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80097f0 tx=0x7fc5e801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e38758c60790b6c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:54.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.530+0000 7fc5ff400640 1 -- 172.21.15.29:0/181636958 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e80ab670 con 0x7fc60006c200 2024-01-24T13:05:54.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.530+0000 7fc5ff400640 1 -- 172.21.15.29:0/181636958 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e80ab7d0 con 0x7fc60006c200 2024-01-24T13:05:54.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.530+0000 7fc5ff400640 1 -- 172.21.15.29:0/181636958 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e80abb60 con 0x7fc60006c200 2024-01-24T13:05:54.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 -- 172.21.15.29:0/181636958 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc60006c200 msgr2=0x7fc60013cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 --2- 172.21.15.29:0/181636958 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc60006c200 0x7fc60013cda0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80097f0 tx=0x7fc5e801c490 comp rx=0 tx=0).stop 2024-01-24T13:05:54.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 -- 172.21.15.29:0/181636958 shutdown_connections 2024-01-24T13:05:54.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 --2- 172.21.15.29:0/181636958 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc60006c200 0x7fc60013cda0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 -- 172.21.15.29:0/181636958 >> 172.21.15.29:0/181636958 conn(0x7fc60006d700 msgr2=0x7fc600069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:54.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 -- 172.21.15.29:0/181636958 shutdown_connections 2024-01-24T13:05:54.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 -- 172.21.15.29:0/181636958 wait complete. 2024-01-24T13:05:54.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 Processor -- start 2024-01-24T13:05:54.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 -- start start 2024-01-24T13:05:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc60006be20 0x7fc6001fc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc60006c200 0x7fc6001f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc60013d2e0 0x7fc6000ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc600153160 con 0x7fc60006c200 2024-01-24T13:05:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6001fd380 con 0x7fc60006be20 2024-01-24T13:05:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc607400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6001f9df0 con 0x7fc60013d2e0 2024-01-24T13:05:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc5ffe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc60006c200 0x7fc6001f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc5ffe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc60006c200 0x7fc6001f98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57446/0 (socket says 172.21.15.29:57446) 2024-01-24T13:05:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc5ffe00640 1 -- 172.21.15.29:0/1371133498 learned_addr learned my addr 172.21.15.29:0/1371133498 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc604a00640 1 --2- 172.21.15.29:0/1371133498 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc60006be20 0x7fc6001fc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.534+0000 7fc605400640 1 --2- 172.21.15.29:0/1371133498 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc60013d2e0 0x7fc6000ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc5ffe00640 1 -- 172.21.15.29:0/1371133498 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc60013d2e0 msgr2=0x7fc6000ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc5ffe00640 1 --2- 172.21.15.29:0/1371133498 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc60013d2e0 0x7fc6000ae660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc5ffe00640 1 -- 172.21.15.29:0/1371133498 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc60006be20 msgr2=0x7fc6001fc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc5ffe00640 1 --2- 172.21.15.29:0/1371133498 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc60006be20 0x7fc6001fc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc5ffe00640 1 -- 172.21.15.29:0/1371133498 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e8009420 con 0x7fc60006c200 2024-01-24T13:05:54.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc5ffe00640 1 --2- 172.21.15.29:0/1371133498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc60006c200 0x7fc6001f98b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80ad040 tx=0x7fc5e801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:54.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc5fcc00640 1 -- 172.21.15.29:0/1371133498 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e80bf610 con 0x7fc60006c200 2024-01-24T13:05:54.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc5fcc00640 1 -- 172.21.15.29:0/1371133498 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e80bf7b0 con 0x7fc60006c200 2024-01-24T13:05:54.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc607400640 1 -- 172.21.15.29:0/1371133498 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc600152e00 con 0x7fc60006c200 2024-01-24T13:05:54.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc5fcc00640 1 -- 172.21.15.29:0/1371133498 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e80bfb60 con 0x7fc60006c200 2024-01-24T13:05:54.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc607400640 1 -- 172.21.15.29:0/1371133498 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6001fcdc0 con 0x7fc60006c200 2024-01-24T13:05:54.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc607400640 1 -- 172.21.15.29:0/1371133498 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60006def0 con 0x7fc60006c200 2024-01-24T13:05:54.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc5fcc00640 1 -- 172.21.15.29:0/1371133498 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc5e80b5400 con 0x7fc60006c200 2024-01-24T13:05:54.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc5fcc00640 1 --2- 172.21.15.29:0/1371133498 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc5d8065a60 0x7fc5d8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc5fcc00640 1 -- 172.21.15.29:0/1371133498 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fc5e811e3c0 con 0x7fc60006c200 2024-01-24T13:05:54.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.538+0000 7fc604a00640 1 --2- 172.21.15.29:0/1371133498 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc5d8065a60 0x7fc5d8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.542+0000 7fc604a00640 1 --2- 172.21.15.29:0/1371133498 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc5d8065a60 0x7fc5d8067f20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0007fd0 tx=0x7fc5f0007d80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:54.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.542+0000 7fc5fcc00640 1 -- 172.21.15.29:0/1371133498 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc5e80ebb00 con 0x7fc60006c200 2024-01-24T13:05:54.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.702+0000 7fc607400640 1 -- 172.21.15.29:0/1371133498 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6001532a0 con 0x7fc60006c200 2024-01-24T13:05:54.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.702+0000 7fc5fcc00640 1 -- 172.21.15.29:0/1371133498 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6001532a0 con 0x7fc60006c200 2024-01-24T13:05:54.708 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:54.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.706+0000 7fc607400640 1 -- 172.21.15.29:0/1371133498 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc5d8065a60 msgr2=0x7fc5d8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.706+0000 7fc607400640 1 --2- 172.21.15.29:0/1371133498 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc5d8065a60 0x7fc5d8067f20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0007fd0 tx=0x7fc5f0007d80 comp rx=0 tx=0).stop 2024-01-24T13:05:54.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.706+0000 7fc607400640 1 -- 172.21.15.29:0/1371133498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc60006c200 msgr2=0x7fc6001f98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.706+0000 7fc607400640 1 --2- 172.21.15.29:0/1371133498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc60006c200 0x7fc6001f98b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80ad040 tx=0x7fc5e801acd0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.706+0000 7fc607400640 1 -- 172.21.15.29:0/1371133498 shutdown_connections 2024-01-24T13:05:54.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.706+0000 7fc607400640 1 --2- 172.21.15.29:0/1371133498 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc5d8065a60 0x7fc5d8067f20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.706+0000 7fc607400640 1 --2- 172.21.15.29:0/1371133498 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc60013d2e0 0x7fc6000ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.706+0000 7fc607400640 1 --2- 172.21.15.29:0/1371133498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc60006c200 0x7fc6001f98b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.706+0000 7fc607400640 1 --2- 172.21.15.29:0/1371133498 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc60006be20 0x7fc6001fc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.706+0000 7fc607400640 1 -- 172.21.15.29:0/1371133498 >> 172.21.15.29:0/1371133498 conn(0x7fc60006d700 msgr2=0x7fc60014f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:54.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.706+0000 7fc607400640 1 -- 172.21.15.29:0/1371133498 shutdown_connections 2024-01-24T13:05:54.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.706+0000 7fc607400640 1 -- 172.21.15.29:0/1371133498 wait complete. 2024-01-24T13:05:54.730 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:05:54.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.870+0000 7fd4ec600640 1 Processor -- start 2024-01-24T13:05:54.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.870+0000 7fd4ec600640 1 -- start start 2024-01-24T13:05:54.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.870+0000 7fd4ec600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd4e40b2760 0x7fd4e40b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.870+0000 7fd4ec600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e4153de0 con 0x7fd4e4153a00 2024-01-24T13:05:54.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.870+0000 7fd4ec600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e4071d10 con 0x7fd4e415cef0 2024-01-24T13:05:54.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.870+0000 7fd4ec600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e40b3150 con 0x7fd4e40b2760 2024-01-24T13:05:54.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.870+0000 7fd4e9c00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd4e4153a00 0x7fd4e4071600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53478/0 (socket says 172.21.15.29:53478) 2024-01-24T13:05:54.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.870+0000 7fd4e9c00640 1 -- 172.21.15.29:0/3762255449 learned_addr learned my addr 172.21.15.29:0/3762255449 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:54.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e9200640 1 --2- 172.21.15.29:0/3762255449 >> v2:172.21.15.163:3300/0 conn(0x7fd4e40b2760 0x7fd4e40b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 -- 172.21.15.29:0/3762255449 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927512169 0 0) 0x7fd4e4153de0 con 0x7fd4e4153a00 2024-01-24T13:05:54.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 -- 172.21.15.29:0/3762255449 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4c4003530 con 0x7fd4e4153a00 2024-01-24T13:05:54.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 -- 172.21.15.29:0/3762255449 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3024645944 0 0) 0x7fd4c4003530 con 0x7fd4e4153a00 2024-01-24T13:05:54.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 -- 172.21.15.29:0/3762255449 >> v2:172.21.15.163:3300/0 conn(0x7fd4e40b2760 msgr2=0x7fd4e40b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:54.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 --2- 172.21.15.29:0/3762255449 >> v2:172.21.15.163:3300/0 conn(0x7fd4e40b2760 0x7fd4e40b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 -- 172.21.15.29:0/3762255449 >> v1:172.21.15.163:6789/0 conn(0x7fd4e415cef0 legacy=0x7fd4e415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 -- 172.21.15.29:0/3762255449 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4159900 con 0x7fd4e4153a00 2024-01-24T13:05:54.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 -- 172.21.15.29:0/3762255449 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7fd4d4001680 con 0x7fd4e4153a00 2024-01-24T13:05:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 -- 172.21.15.29:0/3762255449 >> v1:172.21.15.29:6789/0 conn(0x7fd4e4153a00 legacy=0x7fd4e4071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 --2- 172.21.15.29:0/3762255449 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4c4003980 0x7fd4c4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 --2- 172.21.15.29:0/3762255449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4c40047d0 0x7fd4c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 --2- 172.21.15.29:0/3762255449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c40051e0 0x7fd4c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 -- 172.21.15.29:0/3762255449 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e40b3150 con 0x7fd4c40051e0 2024-01-24T13:05:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 -- 172.21.15.29:0/3762255449 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c400c110 con 0x7fd4c40047d0 2024-01-24T13:05:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e3e00640 1 -- 172.21.15.29:0/3762255449 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c400e4e0 con 0x7fd4c4003980 2024-01-24T13:05:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4ea600640 1 --2- 172.21.15.29:0/3762255449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c40051e0 0x7fd4c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e9c00640 1 --2- 172.21.15.29:0/3762255449 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4c4003980 0x7fd4c4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e9200640 1 --2- 172.21.15.29:0/3762255449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4c40047d0 0x7fd4c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4ea600640 1 -- 172.21.15.29:0/3762255449 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4c4003980 msgr2=0x7fd4c4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4ea600640 1 --2- 172.21.15.29:0/3762255449 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4c4003980 0x7fd4c4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4ea600640 1 -- 172.21.15.29:0/3762255449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4c40047d0 msgr2=0x7fd4c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:54.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4ea600640 1 --2- 172.21.15.29:0/3762255449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4c40047d0 0x7fd4c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4ea600640 1 -- 172.21.15.29:0/3762255449 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c4003530 con 0x7fd4c40051e0 2024-01-24T13:05:54.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e9200640 1 --2- 172.21.15.29:0/3762255449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4c40047d0 0x7fd4c4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:54.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.874+0000 7fd4e9c00640 1 --2- 172.21.15.29:0/3762255449 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4c4003980 0x7fd4c4003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:54.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.878+0000 7fd4ea600640 1 -- 172.21.15.29:0/3762255449 reap_dead start 2024-01-24T13:05:54.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.878+0000 7fd4ea600640 1 --2- 172.21.15.29:0/3762255449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c40051e0 0x7fd4c400b990 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc001e70 tx=0x7fd4dc01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85eab93752a303ce server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:54.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.878+0000 7fd4e3e00640 1 -- 172.21.15.29:0/3762255449 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc003b80 con 0x7fd4c40051e0 2024-01-24T13:05:54.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.878+0000 7fd4e3e00640 1 -- 172.21.15.29:0/3762255449 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc003d00 con 0x7fd4c40051e0 2024-01-24T13:05:54.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.878+0000 7fd4e3e00640 1 -- 172.21.15.29:0/3762255449 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc005310 con 0x7fd4c40051e0 2024-01-24T13:05:54.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.878+0000 7fd4ec600640 1 -- 172.21.15.29:0/3762255449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c40051e0 msgr2=0x7fd4c400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.878+0000 7fd4ec600640 1 --2- 172.21.15.29:0/3762255449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c40051e0 0x7fd4c400b990 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc001e70 tx=0x7fd4dc01c760 comp rx=0 tx=0).stop 2024-01-24T13:05:54.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.878+0000 7fd4ec600640 1 -- 172.21.15.29:0/3762255449 shutdown_connections 2024-01-24T13:05:54.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.878+0000 7fd4ec600640 1 --2- 172.21.15.29:0/3762255449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c40051e0 0x7fd4c400b990 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.878+0000 7fd4ec600640 1 -- 172.21.15.29:0/3762255449 >> 172.21.15.29:0/3762255449 conn(0x7fd4e406d700 msgr2=0x7fd4e4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:54.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.878+0000 7fd4ec600640 1 -- 172.21.15.29:0/3762255449 shutdown_connections 2024-01-24T13:05:54.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.878+0000 7fd4ec600640 1 -- 172.21.15.29:0/3762255449 wait complete. 2024-01-24T13:05:54.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.878+0000 7fd4ec600640 1 Processor -- start 2024-01-24T13:05:54.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.878+0000 7fd4ec600640 1 -- start start 2024-01-24T13:05:54.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ec600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4c40051e0 0x7fd4e40cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ec600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4e4143590 0x7fd4e4149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ec600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4e415bdc0 0x7fd4e415c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ec600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e415c790 con 0x7fd4e415bdc0 2024-01-24T13:05:54.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ec600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e4143a50 con 0x7fd4e4143590 2024-01-24T13:05:54.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ec600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e4143d30 con 0x7fd4c40051e0 2024-01-24T13:05:54.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ea600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4e415bdc0 0x7fd4e415c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ea600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4e415bdc0 0x7fd4e415c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57474/0 (socket says 172.21.15.29:57474) 2024-01-24T13:05:54.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ea600640 1 -- 172.21.15.29:0/976779582 learned_addr learned my addr 172.21.15.29:0/976779582 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:54.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4e9c00640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4c40051e0 0x7fd4e40cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4e9200640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4e4143590 0x7fd4e4149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ea600640 1 -- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4c40051e0 msgr2=0x7fd4e40cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ea600640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4c40051e0 0x7fd4e40cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ea600640 1 -- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4e4143590 msgr2=0x7fd4e4149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:54.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ea600640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4e4143590 0x7fd4e4149820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:54.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ea600640 1 -- 172.21.15.29:0/976779582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4144010 con 0x7fd4e415bdc0 2024-01-24T13:05:54.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4e9c00640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4c40051e0 0x7fd4e40cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:05:54.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ea600640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4e415bdc0 0x7fd4e415c250 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc01d000 tx=0x7fd4c4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:54.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4e1600640 1 -- 172.21.15.29:0/976779582 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc006d60 con 0x7fd4e415bdc0 2024-01-24T13:05:54.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4e1600640 1 -- 172.21.15.29:0/976779582 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc003b90 con 0x7fd4e415bdc0 2024-01-24T13:05:54.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ec600640 1 -- 172.21.15.29:0/976779582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e41442f0 con 0x7fd4e415bdc0 2024-01-24T13:05:54.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4e1600640 1 -- 172.21.15.29:0/976779582 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc007250 con 0x7fd4e415bdc0 2024-01-24T13:05:54.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ec600640 1 -- 172.21.15.29:0/976779582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e4149d60 con 0x7fd4e415bdc0 2024-01-24T13:05:54.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.882+0000 7fd4ec600640 1 -- 172.21.15.29:0/976779582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e4144810 con 0x7fd4e415bdc0 2024-01-24T13:05:54.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.886+0000 7fd4e1600640 1 -- 172.21.15.29:0/976779582 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd4dc0073b0 con 0x7fd4e415bdc0 2024-01-24T13:05:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.886+0000 7fd4e1600640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd4bc065a60 0x7fd4bc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.886+0000 7fd4e1600640 1 -- 172.21.15.29:0/976779582 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fd4dc11c9b0 con 0x7fd4e415bdc0 2024-01-24T13:05:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.886+0000 7fd4e9c00640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd4bc065a60 0x7fd4bc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.886+0000 7fd4e9c00640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd4bc065a60 0x7fd4bc067f20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4000c10 tx=0x7fd4d4007d80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:54.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:54.890+0000 7fd4e1600640 1 -- 172.21.15.29:0/976779582 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd4e4144810 con 0x7fd4e415bdc0 2024-01-24T13:05:55.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.042+0000 7fd4ec600640 1 -- 172.21.15.29:0/976779582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd4e4144810 con 0x7fd4e415bdc0 2024-01-24T13:05:55.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.046+0000 7fd4e1600640 1 -- 172.21.15.29:0/976779582 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd4e4144810 con 0x7fd4e415bdc0 2024-01-24T13:05:55.048 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:05:55.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.046+0000 7fd4ec600640 1 -- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd4bc065a60 msgr2=0x7fd4bc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:55.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.046+0000 7fd4ec600640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd4bc065a60 0x7fd4bc067f20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4000c10 tx=0x7fd4d4007d80 comp rx=0 tx=0).stop 2024-01-24T13:05:55.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.046+0000 7fd4ec600640 1 -- 172.21.15.29:0/976779582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4e415bdc0 msgr2=0x7fd4e415c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:55.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.046+0000 7fd4ec600640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4e415bdc0 0x7fd4e415c250 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc01d000 tx=0x7fd4c4005800 comp rx=0 tx=0).stop 2024-01-24T13:05:55.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.046+0000 7fd4ec600640 1 -- 172.21.15.29:0/976779582 shutdown_connections 2024-01-24T13:05:55.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.046+0000 7fd4ec600640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd4bc065a60 0x7fd4bc067f20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.046+0000 7fd4ec600640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4e415bdc0 0x7fd4e415c250 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.046+0000 7fd4ec600640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4e4143590 0x7fd4e4149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.046+0000 7fd4ec600640 1 --2- 172.21.15.29:0/976779582 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4c40051e0 0x7fd4e40cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.046+0000 7fd4ec600640 1 -- 172.21.15.29:0/976779582 >> 172.21.15.29:0/976779582 conn(0x7fd4e406d700 msgr2=0x7fd4e41585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:55.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.046+0000 7fd4ec600640 1 -- 172.21.15.29:0/976779582 shutdown_connections 2024-01-24T13:05:55.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.046+0000 7fd4ec600640 1 -- 172.21.15.29:0/976779582 wait complete. 2024-01-24T13:05:55.071 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-01-24T13:05:55.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.210+0000 7f879bc00640 1 Processor -- start 2024-01-24T13:05:55.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.210+0000 7f879bc00640 1 -- start start 2024-01-24T13:05:55.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.210+0000 7f879bc00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f87940b2760 0x7f87940b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:55.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.210+0000 7f879bc00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8794153de0 con 0x7f879415cef0 2024-01-24T13:05:55.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.210+0000 7f879bc00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8794071d10 con 0x7f8794153a00 2024-01-24T13:05:55.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.210+0000 7f879bc00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87940b3150 con 0x7f87940b2760 2024-01-24T13:05:55.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.210+0000 7f8793e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f87940b2760 0x7f87940b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:55.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.210+0000 7f8799c00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f879415cef0 0x7f879415d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53492/0 (socket says 172.21.15.29:53492) 2024-01-24T13:05:55.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.210+0000 7f8799c00640 1 -- 172.21.15.29:0/2174326012 learned_addr learned my addr 172.21.15.29:0/2174326012 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:55.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.214+0000 7f8793e00640 1 -- 172.21.15.29:0/2174326012 >> v1:172.21.15.163:6789/0 conn(0x7f8794153a00 legacy=0x7f8794071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:55.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.214+0000 7f8793400640 1 -- 172.21.15.29:0/2174326012 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2915909763 0 0) 0x7f8794153de0 con 0x7f879415cef0 2024-01-24T13:05:55.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.214+0000 7f8793e00640 1 -- 172.21.15.29:0/2174326012 >> v1:172.21.15.29:6789/0 conn(0x7f879415cef0 legacy=0x7f879415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:55.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.214+0000 7f8793e00640 1 -- 172.21.15.29:0/2174326012 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8794159900 con 0x7f87940b2760 2024-01-24T13:05:55.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.214+0000 7f8793e00640 1 --2- 172.21.15.29:0/2174326012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87940b2760 0x7f87940b2c10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8794159af0 tx=0x7f877c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b7ee90f041f187 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:55.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.214+0000 7f8793400640 1 -- 172.21.15.29:0/2174326012 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c0ab600 con 0x7f87940b2760 2024-01-24T13:05:55.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.214+0000 7f8793400640 1 -- 172.21.15.29:0/2174326012 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c0a7050 con 0x7f87940b2760 2024-01-24T13:05:55.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.214+0000 7f8793400640 1 -- 172.21.15.29:0/2174326012 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c0ab980 con 0x7f87940b2760 2024-01-24T13:05:55.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.214+0000 7f879bc00640 1 -- 172.21.15.29:0/2174326012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87940b2760 msgr2=0x7f87940b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:55.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.214+0000 7f879bc00640 1 --2- 172.21.15.29:0/2174326012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87940b2760 0x7f87940b2c10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8794159af0 tx=0x7f877c01c3c0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f879bc00640 1 -- 172.21.15.29:0/2174326012 shutdown_connections 2024-01-24T13:05:55.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f879bc00640 1 --2- 172.21.15.29:0/2174326012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87940b2760 0x7f87940b2c10 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f879bc00640 1 -- 172.21.15.29:0/2174326012 >> 172.21.15.29:0/2174326012 conn(0x7f879406d700 msgr2=0x7f8794069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:55.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f879bc00640 1 -- 172.21.15.29:0/2174326012 shutdown_connections 2024-01-24T13:05:55.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f879bc00640 1 -- 172.21.15.29:0/2174326012 wait complete. 2024-01-24T13:05:55.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f879bc00640 1 Processor -- start 2024-01-24T13:05:55.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f879bc00640 1 -- start start 2024-01-24T13:05:55.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f879bc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87940b2760 0x7f87940b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:55.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f879bc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8794153a00 0x7f87941583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:55.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f879bc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f879415cef0 0x7f8794158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:55.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f879bc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87940cec90 con 0x7f87940b2760 2024-01-24T13:05:55.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f879bc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879414cba0 con 0x7f879415cef0 2024-01-24T13:05:55.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f879bc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87940b1ea0 con 0x7f8794153a00 2024-01-24T13:05:55.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f8799200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87940b2760 0x7f87940b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:55.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f8799200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87940b2760 0x7f87940b1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57490/0 (socket says 172.21.15.29:57490) 2024-01-24T13:05:55.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f8799200640 1 -- 172.21.15.29:0/3264651566 learned_addr learned my addr 172.21.15.29:0/3264651566 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:55.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f8793e00640 1 --2- 172.21.15.29:0/3264651566 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8794153a00 0x7f87941583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:55.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f8799c00640 1 --2- 172.21.15.29:0/3264651566 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f879415cef0 0x7f8794158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:55.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f8799200640 1 -- 172.21.15.29:0/3264651566 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8794153a00 msgr2=0x7f87941583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:55.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f8799200640 1 --2- 172.21.15.29:0/3264651566 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8794153a00 0x7f87941583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f8799200640 1 -- 172.21.15.29:0/3264651566 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f879415cef0 msgr2=0x7f8794158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:55.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f8799200640 1 --2- 172.21.15.29:0/3264651566 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f879415cef0 0x7f8794158910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.218+0000 7f8799200640 1 -- 172.21.15.29:0/3264651566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c009420 con 0x7f87940b2760 2024-01-24T13:05:55.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.222+0000 7f8799200640 1 --2- 172.21.15.29:0/3264651566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87940b2760 0x7f87940b1960 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f878400c560 tx=0x7f878400ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:55.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.222+0000 7f8790c00640 1 -- 172.21.15.29:0/3264651566 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784005220 con 0x7f87940b2760 2024-01-24T13:05:55.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.222+0000 7f8790c00640 1 -- 172.21.15.29:0/3264651566 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8784005380 con 0x7f87940b2760 2024-01-24T13:05:55.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.222+0000 7f879bc00640 1 -- 172.21.15.29:0/3264651566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87940cdde0 con 0x7f87940b2760 2024-01-24T13:05:55.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.222+0000 7f8790c00640 1 -- 172.21.15.29:0/3264651566 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784007270 con 0x7f87940b2760 2024-01-24T13:05:55.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.222+0000 7f879bc00640 1 -- 172.21.15.29:0/3264651566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87940ce010 con 0x7f87940b2760 2024-01-24T13:05:55.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.222+0000 7f879bc00640 1 -- 172.21.15.29:0/3264651566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879415a160 con 0x7f87940b2760 2024-01-24T13:05:55.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.222+0000 7f8790c00640 1 -- 172.21.15.29:0/3264651566 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f87840073d0 con 0x7f87940b2760 2024-01-24T13:05:55.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.222+0000 7f8790c00640 1 --2- 172.21.15.29:0/3264651566 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f876c065a60 0x7f876c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:55.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.222+0000 7f8790c00640 1 -- 172.21.15.29:0/3264651566 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f8784082bf0 con 0x7f87940b2760 2024-01-24T13:05:55.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.226+0000 7f8793e00640 1 --2- 172.21.15.29:0/3264651566 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f876c065a60 0x7f876c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:55.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.226+0000 7f8793e00640 1 --2- 172.21.15.29:0/3264651566 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f876c065a60 0x7f876c067f20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f877c0ad000 tx=0x7f877c0a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:55.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.230+0000 7f8790c00640 1 -- 172.21.15.29:0/3264651566 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f879415a160 con 0x7f87940b2760 2024-01-24T13:05:55.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.386+0000 7f879bc00640 1 -- 172.21.15.29:0/3264651566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f879414a500 con 0x7f87940b2760 2024-01-24T13:05:55.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.390+0000 7f8790c00640 1 -- 172.21.15.29:0/3264651566 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v46) v1 ==== 97+0+11 (secure 0 0 0) 0x7f879414a500 con 0x7f87940b2760 2024-01-24T13:05:55.393 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:05:55.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.390+0000 7f879bc00640 1 -- 172.21.15.29:0/3264651566 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f876c065a60 msgr2=0x7f876c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:55.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.390+0000 7f879bc00640 1 --2- 172.21.15.29:0/3264651566 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f876c065a60 0x7f876c067f20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f877c0ad000 tx=0x7f877c0a6000 comp rx=0 tx=0).stop 2024-01-24T13:05:55.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.390+0000 7f879bc00640 1 -- 172.21.15.29:0/3264651566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87940b2760 msgr2=0x7f87940b1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:55.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.390+0000 7f879bc00640 1 --2- 172.21.15.29:0/3264651566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87940b2760 0x7f87940b1960 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f878400c560 tx=0x7f878400ca20 comp rx=0 tx=0).stop 2024-01-24T13:05:55.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.390+0000 7f879bc00640 1 -- 172.21.15.29:0/3264651566 shutdown_connections 2024-01-24T13:05:55.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.390+0000 7f879bc00640 1 --2- 172.21.15.29:0/3264651566 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f876c065a60 0x7f876c067f20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.390+0000 7f879bc00640 1 --2- 172.21.15.29:0/3264651566 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f879415cef0 0x7f8794158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.390+0000 7f879bc00640 1 --2- 172.21.15.29:0/3264651566 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8794153a00 0x7f87941583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.390+0000 7f879bc00640 1 --2- 172.21.15.29:0/3264651566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87940b2760 0x7f87940b1960 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.390+0000 7f879bc00640 1 -- 172.21.15.29:0/3264651566 >> 172.21.15.29:0/3264651566 conn(0x7f879406d700 msgr2=0x7f879406fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:55.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.390+0000 7f879bc00640 1 -- 172.21.15.29:0/3264651566 shutdown_connections 2024-01-24T13:05:55.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.390+0000 7f879bc00640 1 -- 172.21.15.29:0/3264651566 wait complete. 2024-01-24T13:05:55.416 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:05:55.550 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:05:55.554 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:05:55.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.554+0000 7fd2a2400640 1 Processor -- start 2024-01-24T13:05:55.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.554+0000 7fd2a2400640 1 -- start start 2024-01-24T13:05:55.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.554+0000 7fd2a2400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd29c0cb250 0x7fd29c15ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:55.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.554+0000 7fd2a2400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd29c0702d0 0x7fd29c15af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:55.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.554+0000 7fd2a2400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c15e220 con 0x7fd29c15aab0 2024-01-24T13:05:55.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.554+0000 7fd2a2400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29c0cb630 con 0x7fd29c0cb250 2024-01-24T13:05:55.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.554+0000 7fd2a2400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c15b570 con 0x7fd29c0702d0 2024-01-24T13:05:55.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.554+0000 7fd29aa00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd29c15aab0 0x7fd29c06fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53506/0 (socket says 172.21.15.29:53506) 2024-01-24T13:05:55.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.554+0000 7fd29aa00640 1 -- 172.21.15.29:0/1960997690 learned_addr learned my addr 172.21.15.29:0/1960997690 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:05:55.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.554+0000 7fd29be00640 1 --2- 172.21.15.29:0/1960997690 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd29c0702d0 0x7fd29c15af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:55.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.554+0000 7fd29b400640 1 --2- 172.21.15.29:0/1960997690 >> v2:172.21.15.163:3300/0 conn(0x7fd29c0cb250 0x7fd29c15ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:55.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.558+0000 7fd29a000640 1 -- 172.21.15.29:0/1960997690 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316581177 0 0) 0x7fd29c15e220 con 0x7fd29c15aab0 2024-01-24T13:05:55.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.558+0000 7fd29a000640 1 -- 172.21.15.29:0/1960997690 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd27c003530 con 0x7fd29c15aab0 2024-01-24T13:05:55.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.558+0000 7fd29b400640 1 -- 172.21.15.29:0/1960997690 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd29c0702d0 msgr2=0x7fd29c15af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:05:55.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.558+0000 7fd29b400640 1 --2- 172.21.15.29:0/1960997690 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd29c0702d0 0x7fd29c15af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.558+0000 7fd29b400640 1 -- 172.21.15.29:0/1960997690 >> v1:172.21.15.29:6789/0 conn(0x7fd29c15aab0 legacy=0x7fd29c06fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:55.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.558+0000 7fd29b400640 1 -- 172.21.15.29:0/1960997690 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c15b850 con 0x7fd29c0cb250 2024-01-24T13:05:55.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.558+0000 7fd29be00640 1 --2- 172.21.15.29:0/1960997690 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd29c0702d0 0x7fd29c15af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:05:55.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.562+0000 7fd29b400640 1 --2- 172.21.15.29:0/1960997690 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd29c0cb250 0x7fd29c15ea00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0097a0 tx=0x7fd28c01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1351f2cc84ef2a15 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:55.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.562+0000 7fd29a000640 1 -- 172.21.15.29:0/1960997690 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0ab680 con 0x7fd29c0cb250 2024-01-24T13:05:55.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.562+0000 7fd29a000640 1 -- 172.21.15.29:0/1960997690 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c0ab7e0 con 0x7fd29c0cb250 2024-01-24T13:05:55.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.562+0000 7fd29a000640 1 -- 172.21.15.29:0/1960997690 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0abb70 con 0x7fd29c0cb250 2024-01-24T13:05:55.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.562+0000 7fd2a2400640 1 -- 172.21.15.29:0/1960997690 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd29c0cb250 msgr2=0x7fd29c15ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:55.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.562+0000 7fd2a2400640 1 --2- 172.21.15.29:0/1960997690 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd29c0cb250 0x7fd29c15ea00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0097a0 tx=0x7fd28c01c460 comp rx=0 tx=0).stop 2024-01-24T13:05:55.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.562+0000 7fd2a2400640 1 -- 172.21.15.29:0/1960997690 shutdown_connections 2024-01-24T13:05:55.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.562+0000 7fd2a2400640 1 --2- 172.21.15.29:0/1960997690 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd29c0702d0 0x7fd29c15af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.562+0000 7fd2a2400640 1 --2- 172.21.15.29:0/1960997690 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd29c0cb250 0x7fd29c15ea00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.562+0000 7fd2a2400640 1 -- 172.21.15.29:0/1960997690 >> 172.21.15.29:0/1960997690 conn(0x7fd29c06a2d0 msgr2=0x7fd29c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:55.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.562+0000 7fd2a2400640 1 -- 172.21.15.29:0/1960997690 shutdown_connections 2024-01-24T13:05:55.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.562+0000 7fd2a2400640 1 -- 172.21.15.29:0/1960997690 wait complete. 2024-01-24T13:05:55.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd2a2400640 1 Processor -- start 2024-01-24T13:05:55.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd2a2400640 1 -- start start 2024-01-24T13:05:55.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd2a2400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd29c0702d0 0x7fd29c1f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:55.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd2a2400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd29c0cb250 0x7fd29c0adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:55.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd2a2400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd29c15aab0 0x7fd29c0ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:55.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd2a2400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c1f7ff0 con 0x7fd29c0cb250 2024-01-24T13:05:55.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd2a2400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c0ccda0 con 0x7fd29c15aab0 2024-01-24T13:05:55.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd2a2400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c0cd080 con 0x7fd29c0702d0 2024-01-24T13:05:55.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd29aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd29c0cb250 0x7fd29c0adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:55.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd29aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd29c0cb250 0x7fd29c0adc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57496/0 (socket says 172.21.15.29:57496) 2024-01-24T13:05:55.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd29aa00640 1 -- 172.21.15.29:0/1761178546 learned_addr learned my addr 172.21.15.29:0/1761178546 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:05:55.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd29be00640 1 --2- 172.21.15.29:0/1761178546 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd29c15aab0 0x7fd29c0ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:55.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd29b400640 1 --2- 172.21.15.29:0/1761178546 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd29c0702d0 0x7fd29c1f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:55.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd29aa00640 1 -- 172.21.15.29:0/1761178546 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd29c0702d0 msgr2=0x7fd29c1f7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:55.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd29aa00640 1 --2- 172.21.15.29:0/1761178546 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd29c0702d0 0x7fd29c1f7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd29aa00640 1 -- 172.21.15.29:0/1761178546 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd29c15aab0 msgr2=0x7fd29c0ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:55.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd29aa00640 1 --2- 172.21.15.29:0/1761178546 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd29c15aab0 0x7fd29c0ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd29aa00640 1 -- 172.21.15.29:0/1761178546 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd294009a70 con 0x7fd29c0cb250 2024-01-24T13:05:55.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd29aa00640 1 --2- 172.21.15.29:0/1761178546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd29c0cb250 0x7fd29c0adc30 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd28400c3c0 tx=0x7fd28400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd293400640 1 -- 172.21.15.29:0/1761178546 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284005cf0 con 0x7fd29c0cb250 2024-01-24T13:05:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd293400640 1 -- 172.21.15.29:0/1761178546 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd284005e50 con 0x7fd29c0cb250 2024-01-24T13:05:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd293400640 1 -- 172.21.15.29:0/1761178546 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2840072f0 con 0x7fd29c0cb250 2024-01-24T13:05:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd2a2400640 1 -- 172.21.15.29:0/1761178546 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28c0093b0 con 0x7fd29c0cb250 2024-01-24T13:05:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.566+0000 7fd2a2400640 1 -- 172.21.15.29:0/1761178546 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29c0cd640 con 0x7fd29c0cb250 2024-01-24T13:05:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.570+0000 7fd2a2400640 1 -- 172.21.15.29:0/1761178546 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29c071bc0 con 0x7fd29c0cb250 2024-01-24T13:05:55.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.570+0000 7fd293400640 1 -- 172.21.15.29:0/1761178546 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd284007450 con 0x7fd29c0cb250 2024-01-24T13:05:55.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.570+0000 7fd293400640 1 --2- 172.21.15.29:0/1761178546 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd274065a60 0x7fd274067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:05:55.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.570+0000 7fd293400640 1 -- 172.21.15.29:0/1761178546 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fd2840829e0 con 0x7fd29c0cb250 2024-01-24T13:05:55.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.570+0000 7fd29b400640 1 --2- 172.21.15.29:0/1761178546 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd274065a60 0x7fd274067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:05:55.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.570+0000 7fd29b400640 1 --2- 172.21.15.29:0/1761178546 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd274065a60 0x7fd274067f20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0af000 tx=0x7fd28c0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:05:55.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.574+0000 7fd293400640 1 -- 172.21.15.29:0/1761178546 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd284050120 con 0x7fd29c0cb250 2024-01-24T13:05:55.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.742+0000 7fd2a2400640 1 -- 172.21.15.29:0/1761178546 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd29c04e850 con 0x7fd29c0cb250 2024-01-24T13:05:55.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.746+0000 7fd293400640 1 -- 172.21.15.29:0/1761178546 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd284017020 con 0x7fd29c0cb250 2024-01-24T13:05:55.749 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:05:55.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.746+0000 7fd2a2400640 1 -- 172.21.15.29:0/1761178546 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd274065a60 msgr2=0x7fd274067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:55.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.746+0000 7fd2a2400640 1 --2- 172.21.15.29:0/1761178546 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd274065a60 0x7fd274067f20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0af000 tx=0x7fd28c0a7000 comp rx=0 tx=0).stop 2024-01-24T13:05:55.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.746+0000 7fd2a2400640 1 -- 172.21.15.29:0/1761178546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd29c0cb250 msgr2=0x7fd29c0adc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:05:55.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.746+0000 7fd2a2400640 1 --2- 172.21.15.29:0/1761178546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd29c0cb250 0x7fd29c0adc30 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd28400c3c0 tx=0x7fd28400c880 comp rx=0 tx=0).stop 2024-01-24T13:05:55.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.746+0000 7fd2a2400640 1 -- 172.21.15.29:0/1761178546 shutdown_connections 2024-01-24T13:05:55.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.746+0000 7fd2a2400640 1 --2- 172.21.15.29:0/1761178546 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd274065a60 0x7fd274067f20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.746+0000 7fd2a2400640 1 --2- 172.21.15.29:0/1761178546 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd29c15aab0 0x7fd29c0ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.746+0000 7fd2a2400640 1 --2- 172.21.15.29:0/1761178546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd29c0cb250 0x7fd29c0adc30 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.746+0000 7fd2a2400640 1 --2- 172.21.15.29:0/1761178546 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd29c0702d0 0x7fd29c1f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:05:55.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.746+0000 7fd2a2400640 1 -- 172.21.15.29:0/1761178546 >> 172.21.15.29:0/1761178546 conn(0x7fd29c06a2d0 msgr2=0x7fd29c0727e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:05:55.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.746+0000 7fd2a2400640 1 -- 172.21.15.29:0/1761178546 shutdown_connections 2024-01-24T13:05:55.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:05:55.746+0000 7fd2a2400640 1 -- 172.21.15.29:0/1761178546 wait complete. 2024-01-24T13:05:55.770 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-01-24T13:05:55.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:05:55.770 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-24T13:05:55.788 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[37670]: fuse finished with error 0 and tester_r 0 2024-01-24T13:05:55.791 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:06:01.894 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:06:01.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:01.894 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-24T13:06:01.905 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-01-24T13:06:02.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.102+0000 7f68b4400640 1 Processor -- start 2024-01-24T13:06:02.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.102+0000 7f68b4400640 1 -- start start 2024-01-24T13:06:02.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.102+0000 7f68b4400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f68ac15c690 0x7f68ac0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:02.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.102+0000 7f68b4400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68ac0b3360 0x7f68ac0ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:02.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.102+0000 7f68b4400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ac160fc0 con 0x7f68ac0abae0 2024-01-24T13:06:02.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.102+0000 7f68b4400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ac0b2ef0 con 0x7f68ac15c690 2024-01-24T13:06:02.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.102+0000 7f68b4400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac1603f0 con 0x7f68ac0b3360 2024-01-24T13:06:02.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.102+0000 7f68b1000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68ac0b3360 0x7f68ac0ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.102+0000 7f68b1a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f68ac15c690 0x7f68ac0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.102+0000 7f68b2400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f68ac0abae0 0x7f68ac06bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:35032/0 (socket says 172.21.15.29:35032) 2024-01-24T13:06:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.102+0000 7f68b2400640 1 -- 172.21.15.29:0/1489398274 learned_addr learned my addr 172.21.15.29:0/1489398274 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.106+0000 7f68b1000640 1 -- 172.21.15.29:0/1489398274 >> v2:172.21.15.163:3300/0 conn(0x7f68ac15c690 msgr2=0x7f68ac0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.106+0000 7f68b1000640 1 --2- 172.21.15.29:0/1489398274 >> v2:172.21.15.163:3300/0 conn(0x7f68ac15c690 0x7f68ac0cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.106+0000 7f68b1000640 1 -- 172.21.15.29:0/1489398274 >> v1:172.21.15.163:6789/0 conn(0x7f68ac0abae0 legacy=0x7f68ac06bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.106+0000 7f68abe00640 1 -- 172.21.15.29:0/1489398274 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505936511 0 0) 0x7f68ac160fc0 con 0x7f68ac0abae0 2024-01-24T13:06:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.106+0000 7f68b1000640 1 -- 172.21.15.29:0/1489398274 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac160690 con 0x7f68ac0b3360 2024-01-24T13:06:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.106+0000 7f68b1a00640 1 --2- 172.21.15.29:0/1489398274 >> v2:172.21.15.163:3300/0 conn(0x7f68ac15c690 0x7f68ac0cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:02.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.106+0000 7f68b1000640 1 --2- 172.21.15.29:0/1489398274 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68ac0b3360 0x7f68ac0ce3e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68940097c0 tx=0x7f689401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c57fd6f701f7e379 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:02.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68abe00640 1 -- 172.21.15.29:0/1489398274 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68940ac640 con 0x7f68ac0b3360 2024-01-24T13:06:02.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68abe00640 1 -- 172.21.15.29:0/1489398274 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68940ac7a0 con 0x7f68ac0b3360 2024-01-24T13:06:02.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68abe00640 1 -- 172.21.15.29:0/1489398274 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68940acb30 con 0x7f68ac0b3360 2024-01-24T13:06:02.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 -- 172.21.15.29:0/1489398274 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68ac0b3360 msgr2=0x7f68ac0ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:02.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 --2- 172.21.15.29:0/1489398274 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68ac0b3360 0x7f68ac0ce3e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68940097c0 tx=0x7f689401c3f0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 -- 172.21.15.29:0/1489398274 shutdown_connections 2024-01-24T13:06:02.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 --2- 172.21.15.29:0/1489398274 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68ac0b3360 0x7f68ac0ce3e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 --2- 172.21.15.29:0/1489398274 >> v2:172.21.15.163:3300/0 conn(0x7f68ac15c690 0x7f68ac0cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 -- 172.21.15.29:0/1489398274 >> 172.21.15.29:0/1489398274 conn(0x7f68ac06d700 msgr2=0x7f68ac069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:02.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 -- 172.21.15.29:0/1489398274 shutdown_connections 2024-01-24T13:06:02.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 -- 172.21.15.29:0/1489398274 wait complete. 2024-01-24T13:06:02.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 Processor -- start 2024-01-24T13:06:02.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 -- start start 2024-01-24T13:06:02.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68ac0abae0 0x7f68ac13f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68ac0b3360 0x7f68ac1470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68ac15c690 0x7f68ac147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac1426a0 con 0x7f68ac0b3360 2024-01-24T13:06:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac13f690 con 0x7f68ac15c690 2024-01-24T13:06:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.110+0000 7f68b4400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac13fb80 con 0x7f68ac0abae0 2024-01-24T13:06:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68b1000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68ac0b3360 0x7f68ac1470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68b1000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68ac0b3360 0x7f68ac1470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51780/0 (socket says 172.21.15.29:51780) 2024-01-24T13:06:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68b1000640 1 -- 172.21.15.29:0/3822303125 learned_addr learned my addr 172.21.15.29:0/3822303125 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68b1a00640 1 --2- 172.21.15.29:0/3822303125 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68ac0abae0 0x7f68ac13f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68b2400640 1 --2- 172.21.15.29:0/3822303125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68ac15c690 0x7f68ac147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68b1000640 1 -- 172.21.15.29:0/3822303125 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68ac0abae0 msgr2=0x7f68ac13f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68b1000640 1 --2- 172.21.15.29:0/3822303125 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68ac0abae0 0x7f68ac13f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68b1000640 1 -- 172.21.15.29:0/3822303125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68ac15c690 msgr2=0x7f68ac147610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68b1000640 1 --2- 172.21.15.29:0/3822303125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68ac15c690 0x7f68ac147610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68b1000640 1 -- 172.21.15.29:0/3822303125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c009420 con 0x7f68ac0b3360 2024-01-24T13:06:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68b1000640 1 --2- 172.21.15.29:0/3822303125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68ac0b3360 0x7f68ac1470d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f68940af040 tx=0x7f6894019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68a9600640 1 -- 172.21.15.29:0/3822303125 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68940b5610 con 0x7f68ac0b3360 2024-01-24T13:06:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68a9600640 1 -- 172.21.15.29:0/3822303125 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68940b5790 con 0x7f68ac0b3360 2024-01-24T13:06:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68a9600640 1 -- 172.21.15.29:0/3822303125 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68940b5b40 con 0x7f68ac0b3360 2024-01-24T13:06:02.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68b4400640 1 -- 172.21.15.29:0/3822303125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6894009420 con 0x7f68ac0b3360 2024-01-24T13:06:02.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68b4400640 1 -- 172.21.15.29:0/3822303125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ac1422c0 con 0x7f68ac0b3360 2024-01-24T13:06:02.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68b4400640 1 -- 172.21.15.29:0/3822303125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ac04e850 con 0x7f68ac0b3360 2024-01-24T13:06:02.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.114+0000 7f68a9600640 1 -- 172.21.15.29:0/3822303125 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f68940b3040 con 0x7f68ac0b3360 2024-01-24T13:06:02.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.118+0000 7f68a9600640 1 --2- 172.21.15.29:0/3822303125 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6884065a60 0x7f6884067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:02.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.118+0000 7f68a9600640 1 -- 172.21.15.29:0/3822303125 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f689411d510 con 0x7f68ac0b3360 2024-01-24T13:06:02.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.118+0000 7f68b1a00640 1 --2- 172.21.15.29:0/3822303125 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6884065a60 0x7f6884067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:02.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.118+0000 7f68b1a00640 1 --2- 172.21.15.29:0/3822303125 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6884065a60 0x7f6884067f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f689c009cf0 tx=0x7f689c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:02.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.122+0000 7f68a9600640 1 -- 172.21.15.29:0/3822303125 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f68940eac50 con 0x7f68ac0b3360 2024-01-24T13:06:02.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.334+0000 7f68b4400640 1 -- 172.21.15.29:0/3822303125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f68ac144e30 con 0x7f68ac0b3360 2024-01-24T13:06:02.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.338+0000 7f68a9600640 1 -- 172.21.15.29:0/3822303125 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v15) v1 ==== 211+0+0 (secure 0 0 0) 0x7f68940ee270 con 0x7f68ac0b3360 2024-01-24T13:06:02.342 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2024-01-24T13:06:02.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.342+0000 7f68b4400640 1 -- 172.21.15.29:0/3822303125 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6884065a60 msgr2=0x7f6884067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:02.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.342+0000 7f68b4400640 1 --2- 172.21.15.29:0/3822303125 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6884065a60 0x7f6884067f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f689c009cf0 tx=0x7f689c009190 comp rx=0 tx=0).stop 2024-01-24T13:06:02.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.342+0000 7f68b4400640 1 -- 172.21.15.29:0/3822303125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68ac0b3360 msgr2=0x7f68ac1470d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:02.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.342+0000 7f68b4400640 1 --2- 172.21.15.29:0/3822303125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68ac0b3360 0x7f68ac1470d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f68940af040 tx=0x7f6894019190 comp rx=0 tx=0).stop 2024-01-24T13:06:02.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.342+0000 7f68b4400640 1 -- 172.21.15.29:0/3822303125 shutdown_connections 2024-01-24T13:06:02.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.342+0000 7f68b4400640 1 --2- 172.21.15.29:0/3822303125 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6884065a60 0x7f6884067f20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.342+0000 7f68b4400640 1 --2- 172.21.15.29:0/3822303125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68ac15c690 0x7f68ac147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.342+0000 7f68b4400640 1 --2- 172.21.15.29:0/3822303125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68ac0b3360 0x7f68ac1470d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.342+0000 7f68b4400640 1 --2- 172.21.15.29:0/3822303125 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68ac0abae0 0x7f68ac13f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.342+0000 7f68b4400640 1 -- 172.21.15.29:0/3822303125 >> 172.21.15.29:0/3822303125 conn(0x7f68ac06d700 msgr2=0x7f68ac0afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:02.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.342+0000 7f68b4400640 1 -- 172.21.15.29:0/3822303125 shutdown_connections 2024-01-24T13:06:02.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.342+0000 7f68b4400640 1 -- 172.21.15.29:0/3822303125 wait complete. 2024-01-24T13:06:02.365 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-24T13:06:02.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff93ec00640 1 Processor -- start 2024-01-24T13:06:02.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff93ec00640 1 -- start start 2024-01-24T13:06:02.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff93ec00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff9380cfdc0 0x7ff93806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:02.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff93ec00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff9380ceb30 0x7ff938070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:02.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff93ec00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9380ce0a0 con 0x7ff93815c790 2024-01-24T13:06:02.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff93ec00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93815cb70 con 0x7ff9380cfdc0 2024-01-24T13:06:02.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff93ec00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9380cd000 con 0x7ff9380ceb30 2024-01-24T13:06:02.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff937400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff9380cfdc0 0x7ff93806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:02.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff937400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff9380cfdc0 0x7ff93806d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51794/0 (socket says 172.21.15.29:51794) 2024-01-24T13:06:02.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff937400640 1 -- 172.21.15.29:0/1531174987 learned_addr learned my addr 172.21.15.29:0/1531174987 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:02.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff93cc00640 1 --2- 172.21.15.29:0/1531174987 >> v2:172.21.15.163:3300/0 conn(0x7ff9380ceb30 0x7ff938070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:02.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff937400640 1 -- 172.21.15.29:0/1531174987 >> v2:172.21.15.163:3300/0 conn(0x7ff9380ceb30 msgr2=0x7ff938070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:02.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff937400640 1 --2- 172.21.15.29:0/1531174987 >> v2:172.21.15.163:3300/0 conn(0x7ff9380ceb30 0x7ff938070d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff937400640 1 -- 172.21.15.29:0/1531174987 >> v1:172.21.15.163:6789/0 conn(0x7ff93815c790 legacy=0x7ff9380cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:02.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.502+0000 7ff937400640 1 -- 172.21.15.29:0/1531174987 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9380cd2e0 con 0x7ff9380cfdc0 2024-01-24T13:06:02.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.506+0000 7ff937400640 1 --2- 172.21.15.29:0/1531174987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9380cfdc0 0x7ff93806d2a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff9380cbce0 tx=0x7ff92001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ab935085fe93e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:02.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.506+0000 7ff936a00640 1 -- 172.21.15.29:0/1531174987 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9200ab620 con 0x7ff9380cfdc0 2024-01-24T13:06:02.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.506+0000 7ff936a00640 1 -- 172.21.15.29:0/1531174987 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9200ab780 con 0x7ff9380cfdc0 2024-01-24T13:06:02.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.506+0000 7ff936a00640 1 -- 172.21.15.29:0/1531174987 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9200abb10 con 0x7ff9380cfdc0 2024-01-24T13:06:02.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.506+0000 7ff93ec00640 1 -- 172.21.15.29:0/1531174987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9380cfdc0 msgr2=0x7ff93806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:02.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.506+0000 7ff93ec00640 1 --2- 172.21.15.29:0/1531174987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9380cfdc0 0x7ff93806d2a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff9380cbce0 tx=0x7ff92001c400 comp rx=0 tx=0).stop 2024-01-24T13:06:02.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.506+0000 7ff93ec00640 1 -- 172.21.15.29:0/1531174987 shutdown_connections 2024-01-24T13:06:02.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.506+0000 7ff93ec00640 1 --2- 172.21.15.29:0/1531174987 >> v2:172.21.15.163:3300/0 conn(0x7ff9380ceb30 0x7ff938070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.506+0000 7ff93ec00640 1 --2- 172.21.15.29:0/1531174987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9380cfdc0 0x7ff93806d2a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.506+0000 7ff93ec00640 1 -- 172.21.15.29:0/1531174987 >> 172.21.15.29:0/1531174987 conn(0x7ff93806b1e0 msgr2=0x7ff93806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:02.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.506+0000 7ff93ec00640 1 -- 172.21.15.29:0/1531174987 shutdown_connections 2024-01-24T13:06:02.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.506+0000 7ff93ec00640 1 -- 172.21.15.29:0/1531174987 wait complete. 2024-01-24T13:06:02.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff93ec00640 1 Processor -- start 2024-01-24T13:06:02.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff93ec00640 1 -- start start 2024-01-24T13:06:02.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff93ec00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9380ceb30 0x7ff93813fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:02.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff93ec00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9380cfdc0 0x7ff938153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:02.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff93ec00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93815c790 0x7ff9381542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:02.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff93ec00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff938155be0 con 0x7ff9380cfdc0 2024-01-24T13:06:02.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff93ec00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff938155010 con 0x7ff9380ceb30 2024-01-24T13:06:02.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff93ec00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9381552b0 con 0x7ff93815c790 2024-01-24T13:06:02.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff937400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9380cfdc0 0x7ff938153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:02.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff937400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9380cfdc0 0x7ff938153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51800/0 (socket says 172.21.15.29:51800) 2024-01-24T13:06:02.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff937400640 1 -- 172.21.15.29:0/1360442683 learned_addr learned my addr 172.21.15.29:0/1360442683 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:02.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff937e00640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9380ceb30 0x7ff93813fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:02.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff93cc00640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93815c790 0x7ff9381542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:02.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff937400640 1 -- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93815c790 msgr2=0x7ff9381542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:02.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff937400640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93815c790 0x7ff9381542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff937400640 1 -- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9380ceb30 msgr2=0x7ff93813fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:02.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff937400640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9380ceb30 0x7ff93813fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff937400640 1 -- 172.21.15.29:0/1360442683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9200094d0 con 0x7ff9380cfdc0 2024-01-24T13:06:02.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff93cc00640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93815c790 0x7ff9381542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:02.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.510+0000 7ff937400640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9380cfdc0 0x7ff938153db0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff92001a030 tx=0x7ff92001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:02.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.514+0000 7ff92fe00640 1 -- 172.21.15.29:0/1360442683 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9200be3f0 con 0x7ff9380cfdc0 2024-01-24T13:06:02.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.514+0000 7ff92fe00640 1 -- 172.21.15.29:0/1360442683 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9200be550 con 0x7ff9380cfdc0 2024-01-24T13:06:02.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.514+0000 7ff92fe00640 1 -- 172.21.15.29:0/1360442683 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9200be8e0 con 0x7ff9380cfdc0 2024-01-24T13:06:02.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.514+0000 7ff93ec00640 1 -- 172.21.15.29:0/1360442683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff938155590 con 0x7ff9380cfdc0 2024-01-24T13:06:02.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.514+0000 7ff93ec00640 1 -- 172.21.15.29:0/1360442683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff938156970 con 0x7ff9380cfdc0 2024-01-24T13:06:02.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.514+0000 7ff93ec00640 1 -- 172.21.15.29:0/1360442683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93804e850 con 0x7ff9380cfdc0 2024-01-24T13:06:02.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.514+0000 7ff92fe00640 1 -- 172.21.15.29:0/1360442683 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff9200b43f0 con 0x7ff9380cfdc0 2024-01-24T13:06:02.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.514+0000 7ff92fe00640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff910065a60 0x7ff910067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:02.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.518+0000 7ff92fe00640 1 -- 172.21.15.29:0/1360442683 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7ff92011d670 con 0x7ff9380cfdc0 2024-01-24T13:06:02.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.518+0000 7ff937e00640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff910065a60 0x7ff910067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:02.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.518+0000 7ff937e00640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff910065a60 0x7ff910067f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff9280098e0 tx=0x7ff928009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:02.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.518+0000 7ff92fe00640 1 -- 172.21.15.29:0/1360442683 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff9200eae40 con 0x7ff9380cfdc0 2024-01-24T13:06:02.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.714+0000 7ff93ec00640 1 -- 172.21.15.29:0/1360442683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff9381553f0 con 0x7ff9380cfdc0 2024-01-24T13:06:02.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.714+0000 7ff92fe00640 1 -- 172.21.15.29:0/1360442683 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+82 (secure 0 0 0) 0x7ff9381553f0 con 0x7ff9380cfdc0 2024-01-24T13:06:02.720 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-01-24T13:06:02.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.718+0000 7ff93ec00640 1 -- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff910065a60 msgr2=0x7ff910067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:02.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.718+0000 7ff93ec00640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff910065a60 0x7ff910067f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff9280098e0 tx=0x7ff928009060 comp rx=0 tx=0).stop 2024-01-24T13:06:02.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.718+0000 7ff93ec00640 1 -- 172.21.15.29:0/1360442683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9380cfdc0 msgr2=0x7ff938153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:02.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.718+0000 7ff93ec00640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9380cfdc0 0x7ff938153db0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff92001a030 tx=0x7ff92001ac40 comp rx=0 tx=0).stop 2024-01-24T13:06:02.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.718+0000 7ff93ec00640 1 -- 172.21.15.29:0/1360442683 shutdown_connections 2024-01-24T13:06:02.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.718+0000 7ff93ec00640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff910065a60 0x7ff910067f20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.718+0000 7ff93ec00640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93815c790 0x7ff9381542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.718+0000 7ff93ec00640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9380cfdc0 0x7ff938153db0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.718+0000 7ff93ec00640 1 --2- 172.21.15.29:0/1360442683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9380ceb30 0x7ff93813fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:02.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.718+0000 7ff93ec00640 1 -- 172.21.15.29:0/1360442683 >> 172.21.15.29:0/1360442683 conn(0x7ff93806b1e0 msgr2=0x7ff93806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:02.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.718+0000 7ff93ec00640 1 -- 172.21.15.29:0/1360442683 shutdown_connections 2024-01-24T13:06:02.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:02.718+0000 7ff93ec00640 1 -- 172.21.15.29:0/1360442683 wait complete. 2024-01-24T13:06:02.741 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-24T13:06:02.742 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-24T13:06:02.742 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-01-24T13:06:02.742 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-24T13:06:02.742 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:02.742 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-24T13:06:02.742 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-24T13:06:02.742 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-24T13:06:02.742 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:06:02.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:02.742 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-01-24T13:06:02.752 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:06:02.752 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:06:02.752 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:06:02.752 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:02.752 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-24T13:06:02.752 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:02.752 INFO:teuthology.orchestra.run.smithi029.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42336sec preferred_lft 42336sec 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:02.753 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-01-24T13:06:02.754 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-24T13:06:02.754 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:b4:3c:c7:07 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:02.754 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-24T13:06:02.754 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:02.754 INFO:teuthology.orchestra.run.smithi029.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-24T13:06:02.754 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:02.754 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-24T13:06:02.754 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:02.754 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-24T13:06:02.754 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:02.754 INFO:teuthology.orchestra.run.smithi029.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T13:06:02.754 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-24T13:06:02.754 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-24T13:06:02.755 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:02.755 INFO:teuthology.orchestra.run.smithi029.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T13:06:02.755 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-24T13:06:02.755 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-01-24T13:06:02.755 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:02.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:02.755 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-24T13:06:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-01-24T13:06:02.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:02.821 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-01-24T13:06:02.873 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-01-24T13:06:02.874 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-24T13:06:02.874 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-24T13:06:02.874 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-24T13:06:02.874 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-24T13:06:02.874 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-24T13:06:02.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:02.874 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:06:02.874 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:06:02.874 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-24T13:06:02.874 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-24T13:06:02.874 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-24T13:06:02.874 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:06:02.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:02.966 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-24T13:06:02.975 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-24T13:06:02.975 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-24T13:06:02.975 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:06:02.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:02.976 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-01-24T13:06:03.036 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-24T13:06:03.036 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:06:03.036 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:03.088 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:06:03.089 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:06:03.089 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:03.140 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:06:03.204 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:06:03.204 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:06:03.270 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:06:03.272 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:06:03.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:03.272 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:06:03.328 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-24T13:06:03.328 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-24T13:06:03.375 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:06:03.396 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:06:03.396 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:06:03.458 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:06:03.460 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:06:03.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:03.460 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:06:03.470 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2024-01-24T13:06:03.466+0000 7feaa157e580 -1 init, newargv = 0x559db5d0ddf0 newargc=15 2024-01-24T13:06:03.471 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[38127]: starting ceph client 2024-01-24T13:06:03.478 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[38127]: starting fuse 2024-01-24T13:06:04.580 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:06:04.605 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:06:04.605 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:06:04.668 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:06:04.670 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:06:04.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:04.670 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:06:04.721 INFO:teuthology.orchestra.run.smithi029.stdout:43 2024-01-24T13:06:04.721 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-24T13:06:04.721 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-24T13:06:04.721 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-01-24T13:06:04.721 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-01-24T13:06:04.721 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-01-24T13:06:04.721 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-01-24T13:06:04.721 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:06:04.721 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-01-24T13:06:04.722 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-01-24T13:06:04.723 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-24T13:06:04.723 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:06:04.723 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2024-01-24T13:06:04.723 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-01-24T13:06:04.854 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.38127.asok 2024-01-24T13:06:05.037 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38127.asok 2024-01-24T13:06:05.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:05.037 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.38127.asok status 2024-01-24T13:06:05.220 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:06:05.220 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-01-24T13:06:05.220 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "4e3182a65800aed6d4aa2f6b86da3cfd72188134", 2024-01-24T13:06:05.220 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable)", 2024-01-24T13:06:05.220 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2024-01-24T13:06:05.220 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-01-24T13:06:05.220 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-24T13:06:05.220 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "38127", 2024-01-24T13:06:05.220 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-01-24T13:06:05.220 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:05.220 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-01-24T13:06:05.221 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-01-24T13:06:05.221 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 5931, 2024-01-24T13:06:05.221 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-01-24T13:06:05.221 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-01-24T13:06:05.221 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-01-24T13:06:05.221 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 5931 2024-01-24T13:06:05.221 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:05.221 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:06:05.221 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:06:05.221 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:06:05.221 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 853341233 2024-01-24T13:06:05.221 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:05.221 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:05.221 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:06:05.222 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:06:05.222 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:06:05.222 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 853341233 2024-01-24T13:06:05.222 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:05.222 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.5931 192.168.0.1:0/853341233", 2024-01-24T13:06:05.222 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/853341233", 2024-01-24T13:06:05.222 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-01-24T13:06:05.222 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 18, 2024-01-24T13:06:05.222 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 46, 2024-01-24T13:06:05.222 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-01-24T13:06:05.222 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-01-24T13:06:05.222 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-01-24T13:06:05.222 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:06:05.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:05.235 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-01-24T13:06:05.235 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:05.244 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-01-24T13:06:05.245 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:05.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:05.245 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:05.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:05.307 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-01-24T13:06:05.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:05.361 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-01-24T13:06:05.419 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:06:05.419 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:06:05.468 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:06:05.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f34a0000640 1 Processor -- start 2024-01-24T13:06:05.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f34a0000640 1 -- start start 2024-01-24T13:06:05.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f34a0000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34980ccdb0 0x7f34980cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:05.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f34a0000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f349806ade0 0x7f349806b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:05.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f34a0000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34980d0bf0 con 0x7f349815d130 2024-01-24T13:06:05.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f34a0000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34980cec60 con 0x7f349806ade0 2024-01-24T13:06:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f34a0000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349815de60 con 0x7f34980ccdb0 2024-01-24T13:06:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f349e000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f349806ade0 0x7f349806b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f349cc00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f349815d130 0x7f349815d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45168/0 (socket says 172.21.15.29:45168) 2024-01-24T13:06:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f349cc00640 1 -- 172.21.15.29:0/3841498167 learned_addr learned my addr 172.21.15.29:0/3841498167 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f349d600640 1 --2- 172.21.15.29:0/3841498167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34980ccdb0 0x7f34980cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f3497e00640 1 -- 172.21.15.29:0/3841498167 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3575020887 0 0) 0x7f34980d0bf0 con 0x7f349815d130 2024-01-24T13:06:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f349e000640 1 -- 172.21.15.29:0/3841498167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34980ccdb0 msgr2=0x7f34980cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f349e000640 1 --2- 172.21.15.29:0/3841498167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34980ccdb0 0x7f34980cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f349e000640 1 -- 172.21.15.29:0/3841498167 >> v1:172.21.15.29:6789/0 conn(0x7f349815d130 legacy=0x7f349815d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.650+0000 7f349e000640 1 -- 172.21.15.29:0/3841498167 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34980d0040 con 0x7f349806ade0 2024-01-24T13:06:05.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.654+0000 7f349e000640 1 --2- 172.21.15.29:0/3841498167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f349806ade0 0x7f349806b250 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3490009d90 tx=0x7f349001c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ef4d46e1bac45f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:05.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.654+0000 7f3497e00640 1 -- 172.21.15.29:0/3841498167 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900a58f0 con 0x7f349806ade0 2024-01-24T13:06:05.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.654+0000 7f3497e00640 1 -- 172.21.15.29:0/3841498167 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34900a5a50 con 0x7f349806ade0 2024-01-24T13:06:05.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.654+0000 7f3497e00640 1 -- 172.21.15.29:0/3841498167 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900a5de0 con 0x7f349806ade0 2024-01-24T13:06:05.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.654+0000 7f34a0000640 1 -- 172.21.15.29:0/3841498167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f349806ade0 msgr2=0x7f349806b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:05.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.654+0000 7f34a0000640 1 --2- 172.21.15.29:0/3841498167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f349806ade0 0x7f349806b250 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3490009d90 tx=0x7f349001c830 comp rx=0 tx=0).stop 2024-01-24T13:06:05.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.654+0000 7f34a0000640 1 -- 172.21.15.29:0/3841498167 shutdown_connections 2024-01-24T13:06:05.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.654+0000 7f34a0000640 1 --2- 172.21.15.29:0/3841498167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f349806ade0 0x7f349806b250 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:05.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.654+0000 7f34a0000640 1 --2- 172.21.15.29:0/3841498167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34980ccdb0 0x7f34980cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:05.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.654+0000 7f34a0000640 1 -- 172.21.15.29:0/3841498167 >> 172.21.15.29:0/3841498167 conn(0x7f3498070570 msgr2=0x7f3498069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:05.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.654+0000 7f34a0000640 1 -- 172.21.15.29:0/3841498167 shutdown_connections 2024-01-24T13:06:05.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.654+0000 7f34a0000640 1 -- 172.21.15.29:0/3841498167 wait complete. 2024-01-24T13:06:05.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f34a0000640 1 Processor -- start 2024-01-24T13:06:05.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f34a0000640 1 -- start start 2024-01-24T13:06:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f34a0000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f349806ade0 0x7f349815c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f34a0000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34980ccdb0 0x7f34981535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f34a0000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f349815d130 0x7f34980c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f34a0000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349815a740 con 0x7f349815d130 2024-01-24T13:06:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f34a0000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349815c930 con 0x7f34980ccdb0 2024-01-24T13:06:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f34a0000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3498159e10 con 0x7f349806ade0 2024-01-24T13:06:05.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f349e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f349815d130 0x7f34980c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:05.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f349e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f349815d130 0x7f34980c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51824/0 (socket says 172.21.15.29:51824) 2024-01-24T13:06:05.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f349e000640 1 -- 172.21.15.29:0/1452673733 learned_addr learned my addr 172.21.15.29:0/1452673733 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:05.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f349d600640 1 --2- 172.21.15.29:0/1452673733 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f349806ade0 0x7f349815c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:05.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f349cc00640 1 --2- 172.21.15.29:0/1452673733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34980ccdb0 0x7f34981535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:05.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f349e000640 1 -- 172.21.15.29:0/1452673733 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f349806ade0 msgr2=0x7f349815c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:05.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f349e000640 1 --2- 172.21.15.29:0/1452673733 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f349806ade0 0x7f349815c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:05.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f349e000640 1 -- 172.21.15.29:0/1452673733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34980ccdb0 msgr2=0x7f34981535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:05.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f349e000640 1 --2- 172.21.15.29:0/1452673733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34980ccdb0 0x7f34981535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:05.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f349e000640 1 -- 172.21.15.29:0/1452673733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490009a70 con 0x7f349815d130 2024-01-24T13:06:05.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f349e000640 1 --2- 172.21.15.29:0/1452673733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f349815d130 0x7f34980c84c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f34900b0040 tx=0x7f34900195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:05.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f3495600640 1 -- 172.21.15.29:0/1452673733 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900b9860 con 0x7f349815d130 2024-01-24T13:06:05.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f3495600640 1 -- 172.21.15.29:0/1452673733 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34900b99c0 con 0x7f349815d130 2024-01-24T13:06:05.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f3495600640 1 -- 172.21.15.29:0/1452673733 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900b9d70 con 0x7f349815d130 2024-01-24T13:06:05.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f34a0000640 1 -- 172.21.15.29:0/1452673733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349815a0f0 con 0x7f349815d130 2024-01-24T13:06:05.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f34a0000640 1 -- 172.21.15.29:0/1452673733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3498159ac0 con 0x7f349815d130 2024-01-24T13:06:05.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.658+0000 7f34a0000640 1 -- 172.21.15.29:0/1452673733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349815a8b0 con 0x7f349815d130 2024-01-24T13:06:05.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.662+0000 7f3495600640 1 -- 172.21.15.29:0/1452673733 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f34900ad440 con 0x7f349815d130 2024-01-24T13:06:05.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.662+0000 7f3495600640 1 --2- 172.21.15.29:0/1452673733 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3470065a60 0x7f3470067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:05.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.662+0000 7f3495600640 1 -- 172.21.15.29:0/1452673733 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f349011e8c0 con 0x7f349815d130 2024-01-24T13:06:05.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.662+0000 7f349d600640 1 --2- 172.21.15.29:0/1452673733 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3470065a60 0x7f3470067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:05.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.662+0000 7f349d600640 1 --2- 172.21.15.29:0/1452673733 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3470065a60 0x7f3470067f20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3488007a60 tx=0x7f3488008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:05.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.666+0000 7f3495600640 1 -- 172.21.15.29:0/1452673733 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f34900ebf70 con 0x7f349815d130 2024-01-24T13:06:05.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.822+0000 7f34a0000640 1 -- 172.21.15.29:0/1452673733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f349804e850 con 0x7f349815d130 2024-01-24T13:06:05.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.826+0000 7f3495600640 1 -- 172.21.15.29:0/1452673733 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18163 (secure 0 0 0) 0x7f34900ef590 con 0x7f349815d130 2024-01-24T13:06:05.829 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:05.829 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":46,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:05:37.734611+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:05:21.225564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-24T13:05:22.188525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-01-24T13:05:35.873766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.6","mappings":[{"from":3,"to":2}]},{"pgid":"6.14","mappings":[{"from":4,"to":2}]},{"pgid":"6.24","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:06:05.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.826+0000 7f34a0000640 1 -- 172.21.15.29:0/1452673733 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3470065a60 msgr2=0x7f3470067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.826+0000 7f34a0000640 1 --2- 172.21.15.29:0/1452673733 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3470065a60 0x7f3470067f20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3488007a60 tx=0x7f3488008040 comp rx=0 tx=0).stop 2024-01-24T13:06:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.826+0000 7f34a0000640 1 -- 172.21.15.29:0/1452673733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f349815d130 msgr2=0x7f34980c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.826+0000 7f34a0000640 1 --2- 172.21.15.29:0/1452673733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f349815d130 0x7f34980c84c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f34900b0040 tx=0x7f34900195d0 comp rx=0 tx=0).stop 2024-01-24T13:06:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.826+0000 7f34a0000640 1 -- 172.21.15.29:0/1452673733 shutdown_connections 2024-01-24T13:06:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.826+0000 7f34a0000640 1 --2- 172.21.15.29:0/1452673733 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3470065a60 0x7f3470067f20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.826+0000 7f34a0000640 1 --2- 172.21.15.29:0/1452673733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f349815d130 0x7f34980c84c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.826+0000 7f34a0000640 1 --2- 172.21.15.29:0/1452673733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34980ccdb0 0x7f34981535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.826+0000 7f34a0000640 1 --2- 172.21.15.29:0/1452673733 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f349806ade0 0x7f349815c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.826+0000 7f34a0000640 1 -- 172.21.15.29:0/1452673733 >> 172.21.15.29:0/1452673733 conn(0x7f3498070570 msgr2=0x7f34980b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.826+0000 7f34a0000640 1 -- 172.21.15.29:0/1452673733 shutdown_connections 2024-01-24T13:06:05.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.826+0000 7f34a0000640 1 -- 172.21.15.29:0/1452673733 wait complete. 2024-01-24T13:06:05.852 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:05:21.225564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:05:22.188525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2024-01-24T13:05:35.873766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:06:05.853 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:06:05.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fc0a00640 1 Processor -- start 2024-01-24T13:06:05.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fc0a00640 1 -- start start 2024-01-24T13:06:05.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fc0a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1fb80cd5b0 0x7f1fb80c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:05.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fc0a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1fb81603a0 0x7f1fb80711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:05.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fc0a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb8070cf0 con 0x7f1fb815c830 2024-01-24T13:06:05.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fc0a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb815cc10 con 0x7f1fb80cd5b0 2024-01-24T13:06:05.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fc0a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb8160910 con 0x7f1fb81603a0 2024-01-24T13:06:05.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fbd600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1fb80cd5b0 0x7f1fb80c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:05.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fbd600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1fb80cd5b0 0x7f1fb80c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51830/0 (socket says 172.21.15.29:51830) 2024-01-24T13:06:05.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fbd600640 1 -- 172.21.15.29:0/4047911160 learned_addr learned my addr 172.21.15.29:0/4047911160 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:05.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fbea00640 1 --2- 172.21.15.29:0/4047911160 >> v2:172.21.15.163:3300/0 conn(0x7f1fb81603a0 0x7f1fb80711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:05.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fbd600640 1 -- 172.21.15.29:0/4047911160 >> v2:172.21.15.163:3300/0 conn(0x7f1fb81603a0 msgr2=0x7f1fb80711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:05.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fbd600640 1 --2- 172.21.15.29:0/4047911160 >> v2:172.21.15.163:3300/0 conn(0x7f1fb81603a0 0x7f1fb80711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:05.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fbd600640 1 -- 172.21.15.29:0/4047911160 >> v1:172.21.15.163:6789/0 conn(0x7f1fb815c830 legacy=0x7f1fb80ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:05.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.994+0000 7f1fbd600640 1 -- 172.21.15.29:0/4047911160 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb8160bf0 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.998+0000 7f1fbd600640 1 --2- 172.21.15.29:0/4047911160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd5b0 0x7f1fb80c9920 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8070c80 tx=0x7f1fa001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e359fde6c4fd4ed server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:06.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.998+0000 7f1fbcc00640 1 -- 172.21.15.29:0/4047911160 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00a89f0 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.998+0000 7f1fbcc00640 1 -- 172.21.15.29:0/4047911160 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa00a8b50 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.998+0000 7f1fbcc00640 1 -- 172.21.15.29:0/4047911160 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00b0440 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.998+0000 7f1fc0a00640 1 -- 172.21.15.29:0/4047911160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd5b0 msgr2=0x7f1fb80c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.998+0000 7f1fc0a00640 1 --2- 172.21.15.29:0/4047911160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd5b0 0x7f1fb80c9920 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8070c80 tx=0x7f1fa001ecf0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.998+0000 7f1fc0a00640 1 -- 172.21.15.29:0/4047911160 shutdown_connections 2024-01-24T13:06:06.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.998+0000 7f1fc0a00640 1 --2- 172.21.15.29:0/4047911160 >> v2:172.21.15.163:3300/0 conn(0x7f1fb81603a0 0x7f1fb80711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.998+0000 7f1fc0a00640 1 --2- 172.21.15.29:0/4047911160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd5b0 0x7f1fb80c9920 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.998+0000 7f1fc0a00640 1 -- 172.21.15.29:0/4047911160 >> 172.21.15.29:0/4047911160 conn(0x7f1fb80cbd50 msgr2=0x7f1fb80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:06.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.998+0000 7f1fc0a00640 1 -- 172.21.15.29:0/4047911160 shutdown_connections 2024-01-24T13:06:06.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:05.998+0000 7f1fc0a00640 1 -- 172.21.15.29:0/4047911160 wait complete. 2024-01-24T13:06:06.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fc0a00640 1 Processor -- start 2024-01-24T13:06:06.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fc0a00640 1 -- start start 2024-01-24T13:06:06.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fc0a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd5b0 0x7f1fb80acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fc0a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb815c830 0x7f1fb806e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fc0a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fb81603a0 0x7f1fb81f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fc0a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb815fc00 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fc0a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb81f5700 con 0x7f1fb81603a0 2024-01-24T13:06:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fc0a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb815f360 con 0x7f1fb815c830 2024-01-24T13:06:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fbe000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd5b0 0x7f1fb80acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fbe000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd5b0 0x7f1fb80acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51840/0 (socket says 172.21.15.29:51840) 2024-01-24T13:06:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fbe000640 1 -- 172.21.15.29:0/3983004 learned_addr learned my addr 172.21.15.29:0/3983004 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fbea00640 1 --2- 172.21.15.29:0/3983004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fb81603a0 0x7f1fb81f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fbd600640 1 --2- 172.21.15.29:0/3983004 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb815c830 0x7f1fb806e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fbe000640 1 -- 172.21.15.29:0/3983004 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb815c830 msgr2=0x7f1fb806e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fbe000640 1 --2- 172.21.15.29:0/3983004 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb815c830 0x7f1fb806e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fbe000640 1 -- 172.21.15.29:0/3983004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fb81603a0 msgr2=0x7f1fb81f5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fbe000640 1 --2- 172.21.15.29:0/3983004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fb81603a0 0x7f1fb81f5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fbe000640 1 -- 172.21.15.29:0/3983004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa00094d0 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fbe000640 1 --2- 172.21.15.29:0/3983004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd5b0 0x7f1fb80acc90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800c500 tx=0x7f1fa800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:06.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fb6000640 1 -- 172.21.15.29:0/3983004 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8005220 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fb6000640 1 -- 172.21.15.29:0/3983004 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa8005380 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fb6000640 1 -- 172.21.15.29:0/3983004 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8007270 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fc0a00640 1 -- 172.21.15.29:0/3983004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb815f640 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.002+0000 7f1fc0a00640 1 -- 172.21.15.29:0/3983004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb80ad1d0 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.006+0000 7f1fc0a00640 1 -- 172.21.15.29:0/3983004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb81f5560 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.006+0000 7f1fb6000640 1 -- 172.21.15.29:0/3983004 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1fa80073d0 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.006+0000 7f1fb6000640 1 --2- 172.21.15.29:0/3983004 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f90065a60 0x7f1f90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.006+0000 7f1fb6000640 1 -- 172.21.15.29:0/3983004 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f1fa8082ce0 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.006+0000 7f1fbd600640 1 --2- 172.21.15.29:0/3983004 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f90065a60 0x7f1f90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.006+0000 7f1fbd600640 1 --2- 172.21.15.29:0/3983004 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f90065a60 0x7f1f90067f20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00b2000 tx=0x7f1fa0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:06.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.010+0000 7f1fb6000640 1 -- 172.21.15.29:0/3983004 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1fb81f5560 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.166+0000 7f1fc0a00640 1 -- 172.21.15.29:0/3983004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fb81f5560 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.166+0000 7f1fb6000640 1 -- 172.21.15.29:0/3983004 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1fb81f5560 con 0x7f1fb80cd5b0 2024-01-24T13:06:06.170 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:06:06.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.166+0000 7f1fc0a00640 1 -- 172.21.15.29:0/3983004 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f90065a60 msgr2=0x7f1f90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.166+0000 7f1fc0a00640 1 --2- 172.21.15.29:0/3983004 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f90065a60 0x7f1f90067f20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00b2000 tx=0x7f1fa0009040 comp rx=0 tx=0).stop 2024-01-24T13:06:06.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.166+0000 7f1fc0a00640 1 -- 172.21.15.29:0/3983004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd5b0 msgr2=0x7f1fb80acc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.166+0000 7f1fc0a00640 1 --2- 172.21.15.29:0/3983004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd5b0 0x7f1fb80acc90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800c500 tx=0x7f1fa800c9c0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.166+0000 7f1fc0a00640 1 -- 172.21.15.29:0/3983004 shutdown_connections 2024-01-24T13:06:06.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.166+0000 7f1fc0a00640 1 --2- 172.21.15.29:0/3983004 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1f90065a60 0x7f1f90067f20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.166+0000 7f1fc0a00640 1 --2- 172.21.15.29:0/3983004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fb81603a0 0x7f1fb81f5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.166+0000 7f1fc0a00640 1 --2- 172.21.15.29:0/3983004 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fb815c830 0x7f1fb806e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.166+0000 7f1fc0a00640 1 --2- 172.21.15.29:0/3983004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fb80cd5b0 0x7f1fb80acc90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.166+0000 7f1fc0a00640 1 -- 172.21.15.29:0/3983004 >> 172.21.15.29:0/3983004 conn(0x7f1fb80cbd50 msgr2=0x7f1fb815a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:06.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.170+0000 7f1fc0a00640 1 -- 172.21.15.29:0/3983004 shutdown_connections 2024-01-24T13:06:06.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.170+0000 7f1fc0a00640 1 -- 172.21.15.29:0/3983004 wait complete. 2024-01-24T13:06:06.192 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:06:06.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.330+0000 7fcce5400640 1 Processor -- start 2024-01-24T13:06:06.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.330+0000 7fcce5400640 1 -- start start 2024-01-24T13:06:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.334+0000 7fcce5400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcce00c3fd0 0x7fcce00caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.334+0000 7fcce5400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcce00cb010 0x7fcce00d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.334+0000 7fcce5400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce00cd1e0 con 0x7fcce015a6f0 2024-01-24T13:06:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.334+0000 7fcce5400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce015aad0 con 0x7fcce00c3fd0 2024-01-24T13:06:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.334+0000 7fcce5400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00cb480 con 0x7fcce00cb010 2024-01-24T13:06:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.334+0000 7fccdde00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcce00c3fd0 0x7fcce00caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.334+0000 7fccdde00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcce00c3fd0 0x7fcce00caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51848/0 (socket says 172.21.15.29:51848) 2024-01-24T13:06:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.334+0000 7fccdde00640 1 -- 172.21.15.29:0/2742555895 learned_addr learned my addr 172.21.15.29:0/2742555895 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.334+0000 7fccdf200640 1 --2- 172.21.15.29:0/2742555895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcce00cb010 0x7fcce00d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.334+0000 7fccdde00640 1 -- 172.21.15.29:0/2742555895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcce00cb010 msgr2=0x7fcce00d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:06.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.334+0000 7fccdde00640 1 --2- 172.21.15.29:0/2742555895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcce00cb010 0x7fcce00d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.334+0000 7fccdde00640 1 -- 172.21.15.29:0/2742555895 >> v1:172.21.15.163:6789/0 conn(0x7fcce015a6f0 legacy=0x7fcce00ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.334+0000 7fccdde00640 1 -- 172.21.15.29:0/2742555895 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce00cd4c0 con 0x7fcce00c3fd0 2024-01-24T13:06:06.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.338+0000 7fccdde00640 1 --2- 172.21.15.29:0/2742555895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce00c3fd0 0x7fcce00caad0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fccc80098a0 tx=0x7fccc801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b00306046e5b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:06.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.338+0000 7fccdd400640 1 -- 172.21.15.29:0/2742555895 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc80aa650 con 0x7fcce00c3fd0 2024-01-24T13:06:06.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.338+0000 7fccdd400640 1 -- 172.21.15.29:0/2742555895 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc80aa7b0 con 0x7fcce00c3fd0 2024-01-24T13:06:06.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.338+0000 7fccdd400640 1 -- 172.21.15.29:0/2742555895 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc80aab40 con 0x7fcce00c3fd0 2024-01-24T13:06:06.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.338+0000 7fcce5400640 1 -- 172.21.15.29:0/2742555895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce00c3fd0 msgr2=0x7fcce00caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.338+0000 7fcce5400640 1 --2- 172.21.15.29:0/2742555895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce00c3fd0 0x7fcce00caad0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fccc80098a0 tx=0x7fccc801c4f0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.338+0000 7fcce5400640 1 -- 172.21.15.29:0/2742555895 shutdown_connections 2024-01-24T13:06:06.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.338+0000 7fcce5400640 1 --2- 172.21.15.29:0/2742555895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcce00cb010 0x7fcce00d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.338+0000 7fcce5400640 1 --2- 172.21.15.29:0/2742555895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce00c3fd0 0x7fcce00caad0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.338+0000 7fcce5400640 1 -- 172.21.15.29:0/2742555895 >> 172.21.15.29:0/2742555895 conn(0x7fcce0069cd0 msgr2=0x7fcce006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:06.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.338+0000 7fcce5400640 1 -- 172.21.15.29:0/2742555895 shutdown_connections 2024-01-24T13:06:06.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.338+0000 7fcce5400640 1 -- 172.21.15.29:0/2742555895 wait complete. 2024-01-24T13:06:06.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fcce5400640 1 Processor -- start 2024-01-24T13:06:06.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fcce5400640 1 -- start start 2024-01-24T13:06:06.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fcce5400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce00c3fd0 0x7fcce014f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fcce5400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce00cb010 0x7fcce01f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fcce5400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcce015a6f0 0x7fcce0157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fcce5400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce014e670 con 0x7fcce00c3fd0 2024-01-24T13:06:06.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fcce5400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce014e950 con 0x7fcce00cb010 2024-01-24T13:06:06.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fcce5400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce014ec30 con 0x7fcce015a6f0 2024-01-24T13:06:06.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fccde800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce00c3fd0 0x7fcce014f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fccde800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce00c3fd0 0x7fcce014f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51860/0 (socket says 172.21.15.29:51860) 2024-01-24T13:06:06.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fccde800640 1 -- 172.21.15.29:0/264805137 learned_addr learned my addr 172.21.15.29:0/264805137 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:06.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fccdf200640 1 --2- 172.21.15.29:0/264805137 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcce015a6f0 0x7fcce0157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fccdde00640 1 --2- 172.21.15.29:0/264805137 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce00cb010 0x7fcce01f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fccde800640 1 -- 172.21.15.29:0/264805137 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcce015a6f0 msgr2=0x7fcce0157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fccde800640 1 --2- 172.21.15.29:0/264805137 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcce015a6f0 0x7fcce0157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fccde800640 1 -- 172.21.15.29:0/264805137 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce00cb010 msgr2=0x7fcce01f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fccde800640 1 --2- 172.21.15.29:0/264805137 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce00cb010 0x7fcce01f59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fccde800640 1 -- 172.21.15.29:0/264805137 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc80094d0 con 0x7fcce00c3fd0 2024-01-24T13:06:06.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fccde800640 1 --2- 172.21.15.29:0/264805137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce00c3fd0 0x7fcce014f710 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fccd000c3c0 tx=0x7fccd000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:06.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fccd6a00640 1 -- 172.21.15.29:0/264805137 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd00052d0 con 0x7fcce00c3fd0 2024-01-24T13:06:06.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fccd6a00640 1 -- 172.21.15.29:0/264805137 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd0005430 con 0x7fcce00c3fd0 2024-01-24T13:06:06.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fcce5400640 1 -- 172.21.15.29:0/264805137 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce014ef10 con 0x7fcce00c3fd0 2024-01-24T13:06:06.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fccd6a00640 1 -- 172.21.15.29:0/264805137 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0003840 con 0x7fcce00c3fd0 2024-01-24T13:06:06.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.342+0000 7fcce5400640 1 -- 172.21.15.29:0/264805137 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce015d4c0 con 0x7fcce00c3fd0 2024-01-24T13:06:06.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.346+0000 7fcce5400640 1 -- 172.21.15.29:0/264805137 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce004e850 con 0x7fcce00c3fd0 2024-01-24T13:06:06.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.346+0000 7fccd6a00640 1 -- 172.21.15.29:0/264805137 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fccd00039a0 con 0x7fcce00c3fd0 2024-01-24T13:06:06.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.346+0000 7fccd6a00640 1 --2- 172.21.15.29:0/264805137 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fccb8065a90 0x7fccb8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.346+0000 7fccd6a00640 1 -- 172.21.15.29:0/264805137 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fccd0082a10 con 0x7fcce00c3fd0 2024-01-24T13:06:06.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.346+0000 7fccdde00640 1 --2- 172.21.15.29:0/264805137 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fccb8065a90 0x7fccb8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.350+0000 7fccdde00640 1 --2- 172.21.15.29:0/264805137 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fccb8065a90 0x7fccb8067f50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fccc80ae000 tx=0x7fccc80b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:06.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.350+0000 7fccd6a00640 1 -- 172.21.15.29:0/264805137 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fccd0050040 con 0x7fcce00c3fd0 2024-01-24T13:06:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.506+0000 7fcce5400640 1 -- 172.21.15.29:0/264805137 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcce014f3c0 con 0x7fcce00c3fd0 2024-01-24T13:06:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.506+0000 7fccd6a00640 1 -- 172.21.15.29:0/264805137 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7fccd0053660 con 0x7fcce00c3fd0 2024-01-24T13:06:06.511 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:06:06.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.510+0000 7fcce5400640 1 -- 172.21.15.29:0/264805137 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fccb8065a90 msgr2=0x7fccb8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.510+0000 7fcce5400640 1 --2- 172.21.15.29:0/264805137 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fccb8065a90 0x7fccb8067f50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fccc80ae000 tx=0x7fccc80b5040 comp rx=0 tx=0).stop 2024-01-24T13:06:06.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.510+0000 7fcce5400640 1 -- 172.21.15.29:0/264805137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce00c3fd0 msgr2=0x7fcce014f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.510+0000 7fcce5400640 1 --2- 172.21.15.29:0/264805137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce00c3fd0 0x7fcce014f710 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fccd000c3c0 tx=0x7fccd000c880 comp rx=0 tx=0).stop 2024-01-24T13:06:06.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.510+0000 7fcce5400640 1 -- 172.21.15.29:0/264805137 shutdown_connections 2024-01-24T13:06:06.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.510+0000 7fcce5400640 1 --2- 172.21.15.29:0/264805137 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fccb8065a90 0x7fccb8067f50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.510+0000 7fcce5400640 1 --2- 172.21.15.29:0/264805137 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcce015a6f0 0x7fcce0157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.510+0000 7fcce5400640 1 --2- 172.21.15.29:0/264805137 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce00cb010 0x7fcce01f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.510+0000 7fcce5400640 1 --2- 172.21.15.29:0/264805137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce00c3fd0 0x7fcce014f710 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.510+0000 7fcce5400640 1 -- 172.21.15.29:0/264805137 >> 172.21.15.29:0/264805137 conn(0x7fcce0069cd0 msgr2=0x7fcce006a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:06.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.510+0000 7fcce5400640 1 -- 172.21.15.29:0/264805137 shutdown_connections 2024-01-24T13:06:06.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.510+0000 7fcce5400640 1 -- 172.21.15.29:0/264805137 wait complete. 2024-01-24T13:06:06.532 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:06:06.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1aa400640 1 Processor -- start 2024-01-24T13:06:06.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1aa400640 1 -- start start 2024-01-24T13:06:06.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1aa400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1a415c830 0x7fd1a40d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1aa400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a4161070 con 0x7fd1a40cbae0 2024-01-24T13:06:06.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1aa400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a406b160 con 0x7fd1a40ce050 2024-01-24T13:06:06.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1aa400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a415cc10 con 0x7fd1a415c830 2024-01-24T13:06:06.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1a3e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd1a40cbae0 0x7fd1a4160960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45170/0 (socket says 172.21.15.29:45170) 2024-01-24T13:06:06.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1a3e00640 1 -- 172.21.15.29:0/2860738737 learned_addr learned my addr 172.21.15.29:0/2860738737 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:06.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1a3400640 1 --2- 172.21.15.29:0/2860738737 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1a415c830 0x7fd1a40d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1a2000640 1 -- 172.21.15.29:0/2860738737 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100071006 0 0) 0x7fd1a4161070 con 0x7fd1a40cbae0 2024-01-24T13:06:06.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1a2000640 1 -- 172.21.15.29:0/2860738737 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd184003530 con 0x7fd1a40cbae0 2024-01-24T13:06:06.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1a2000640 1 -- 172.21.15.29:0/2860738737 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253864292 0 0) 0x7fd1a406b160 con 0x7fd1a40ce050 2024-01-24T13:06:06.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1a2000640 1 -- 172.21.15.29:0/2860738737 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a4161070 con 0x7fd1a40ce050 2024-01-24T13:06:06.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1a3400640 1 -- 172.21.15.29:0/2860738737 >> v1:172.21.15.163:6789/0 conn(0x7fd1a40ce050 legacy=0x7fd1a4160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1a3400640 1 -- 172.21.15.29:0/2860738737 >> v1:172.21.15.29:6789/0 conn(0x7fd1a40cbae0 legacy=0x7fd1a4160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1a2000640 1 -- 172.21.15.29:0/2860738737 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4062531784 0 0) 0x7fd184003530 con 0x7fd1a40cbae0 2024-01-24T13:06:06.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.674+0000 7fd1a3400640 1 -- 172.21.15.29:0/2860738737 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a406b440 con 0x7fd1a415c830 2024-01-24T13:06:06.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.678+0000 7fd1a3400640 1 --2- 172.21.15.29:0/2860738737 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1a415c830 0x7fd1a40d0e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1940097f0 tx=0x7fd19401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60f911407bd46836 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:06.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.678+0000 7fd1a2000640 1 -- 172.21.15.29:0/2860738737 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c001a00 con 0x7fd1a415c830 2024-01-24T13:06:06.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.678+0000 7fd1a2000640 1 -- 172.21.15.29:0/2860738737 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1940a7050 con 0x7fd1a415c830 2024-01-24T13:06:06.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.678+0000 7fd1a2000640 1 -- 172.21.15.29:0/2860738737 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1940ab620 con 0x7fd1a415c830 2024-01-24T13:06:06.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.678+0000 7fd1aa400640 1 -- 172.21.15.29:0/2860738737 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1a415c830 msgr2=0x7fd1a40d0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.678+0000 7fd1aa400640 1 --2- 172.21.15.29:0/2860738737 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1a415c830 0x7fd1a40d0e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1940097f0 tx=0x7fd19401c3e0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.678+0000 7fd1aa400640 1 -- 172.21.15.29:0/2860738737 shutdown_connections 2024-01-24T13:06:06.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.678+0000 7fd1aa400640 1 --2- 172.21.15.29:0/2860738737 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1a415c830 0x7fd1a40d0e20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.678+0000 7fd1aa400640 1 -- 172.21.15.29:0/2860738737 >> 172.21.15.29:0/2860738737 conn(0x7fd1a4069cd0 msgr2=0x7fd1a406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:06.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.678+0000 7fd1aa400640 1 -- 172.21.15.29:0/2860738737 shutdown_connections 2024-01-24T13:06:06.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.678+0000 7fd1aa400640 1 -- 172.21.15.29:0/2860738737 wait complete. 2024-01-24T13:06:06.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1aa400640 1 Processor -- start 2024-01-24T13:06:06.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1aa400640 1 -- start start 2024-01-24T13:06:06.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1aa400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1a40cbae0 0x7fd1a414c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1aa400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1a40ce050 0x7fd1a40afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1aa400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a415c830 0x7fd1a40b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1aa400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4151070 con 0x7fd1a40cbae0 2024-01-24T13:06:06.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1aa400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a414cbc0 con 0x7fd1a415c830 2024-01-24T13:06:06.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1aa400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40b5b40 con 0x7fd1a40ce050 2024-01-24T13:06:06.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1a3400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1a40cbae0 0x7fd1a414c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1a3400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1a40cbae0 0x7fd1a414c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51872/0 (socket says 172.21.15.29:51872) 2024-01-24T13:06:06.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1a3400640 1 -- 172.21.15.29:0/300857023 learned_addr learned my addr 172.21.15.29:0/300857023 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:06.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1a3e00640 1 --2- 172.21.15.29:0/300857023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a415c830 0x7fd1a40b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1a2a00640 1 --2- 172.21.15.29:0/300857023 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1a40ce050 0x7fd1a40afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1a3400640 1 -- 172.21.15.29:0/300857023 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1a40ce050 msgr2=0x7fd1a40afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1a3400640 1 --2- 172.21.15.29:0/300857023 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1a40ce050 0x7fd1a40afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1a3400640 1 -- 172.21.15.29:0/300857023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a415c830 msgr2=0x7fd1a40b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1a3400640 1 --2- 172.21.15.29:0/300857023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a415c830 0x7fd1a40b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1a3400640 1 -- 172.21.15.29:0/300857023 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd194009420 con 0x7fd1a40cbae0 2024-01-24T13:06:06.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1a3400640 1 --2- 172.21.15.29:0/300857023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1a40cbae0 0x7fd1a414c680 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd1940097f0 tx=0x7fd19401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:06.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd19b400640 1 -- 172.21.15.29:0/300857023 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194004020 con 0x7fd1a40cbae0 2024-01-24T13:06:06.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd19b400640 1 -- 172.21.15.29:0/300857023 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1940041a0 con 0x7fd1a40cbae0 2024-01-24T13:06:06.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd19b400640 1 -- 172.21.15.29:0/300857023 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194003620 con 0x7fd1a40cbae0 2024-01-24T13:06:06.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1aa400640 1 -- 172.21.15.29:0/300857023 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a40c4150 con 0x7fd1a40cbae0 2024-01-24T13:06:06.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.682+0000 7fd1aa400640 1 -- 172.21.15.29:0/300857023 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a40b57d0 con 0x7fd1a40cbae0 2024-01-24T13:06:06.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.686+0000 7fd1aa400640 1 -- 172.21.15.29:0/300857023 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a40afcc0 con 0x7fd1a40cbae0 2024-01-24T13:06:06.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.686+0000 7fd19b400640 1 -- 172.21.15.29:0/300857023 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd194003780 con 0x7fd1a40cbae0 2024-01-24T13:06:06.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.686+0000 7fd19b400640 1 --2- 172.21.15.29:0/300857023 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd17c065a60 0x7fd17c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:06.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.686+0000 7fd19b400640 1 -- 172.21.15.29:0/300857023 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fd19411cd20 con 0x7fd1a40cbae0 2024-01-24T13:06:06.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.686+0000 7fd1a2a00640 1 --2- 172.21.15.29:0/300857023 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd17c065a60 0x7fd17c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:06.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.686+0000 7fd1a2a00640 1 --2- 172.21.15.29:0/300857023 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd17c065a60 0x7fd17c067f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40b0bc0 tx=0x7fd18c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:06.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.690+0000 7fd19b400640 1 -- 172.21.15.29:0/300857023 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd1940ea320 con 0x7fd1a40cbae0 2024-01-24T13:06:06.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.846+0000 7fd1aa400640 1 -- 172.21.15.29:0/300857023 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd1a404e850 con 0x7fd1a40cbae0 2024-01-24T13:06:06.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.846+0000 7fd19b400640 1 -- 172.21.15.29:0/300857023 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd1940ed940 con 0x7fd1a40cbae0 2024-01-24T13:06:06.850 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:06:06.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.846+0000 7fd1aa400640 1 -- 172.21.15.29:0/300857023 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd17c065a60 msgr2=0x7fd17c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.846+0000 7fd1aa400640 1 --2- 172.21.15.29:0/300857023 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd17c065a60 0x7fd17c067f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40b0bc0 tx=0x7fd18c009040 comp rx=0 tx=0).stop 2024-01-24T13:06:06.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.846+0000 7fd1aa400640 1 -- 172.21.15.29:0/300857023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1a40cbae0 msgr2=0x7fd1a414c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:06.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.846+0000 7fd1aa400640 1 --2- 172.21.15.29:0/300857023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1a40cbae0 0x7fd1a414c680 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd1940097f0 tx=0x7fd19401ac20 comp rx=0 tx=0).stop 2024-01-24T13:06:06.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.846+0000 7fd1aa400640 1 -- 172.21.15.29:0/300857023 shutdown_connections 2024-01-24T13:06:06.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.846+0000 7fd1aa400640 1 --2- 172.21.15.29:0/300857023 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd17c065a60 0x7fd17c067f20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.846+0000 7fd1aa400640 1 --2- 172.21.15.29:0/300857023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a415c830 0x7fd1a40b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.846+0000 7fd1aa400640 1 --2- 172.21.15.29:0/300857023 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1a40ce050 0x7fd1a40afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.846+0000 7fd1aa400640 1 --2- 172.21.15.29:0/300857023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1a40cbae0 0x7fd1a414c680 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:06.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.846+0000 7fd1aa400640 1 -- 172.21.15.29:0/300857023 >> 172.21.15.29:0/300857023 conn(0x7fd1a4069cd0 msgr2=0x7fd1a406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:06.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.846+0000 7fd1aa400640 1 -- 172.21.15.29:0/300857023 shutdown_connections 2024-01-24T13:06:06.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:06.846+0000 7fd1aa400640 1 -- 172.21.15.29:0/300857023 wait complete. 2024-01-24T13:06:06.872 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-01-24T13:06:07.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.010+0000 7fe50dc00640 1 Processor -- start 2024-01-24T13:06:07.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.010+0000 7fe50dc00640 1 -- start start 2024-01-24T13:06:07.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.014+0000 7fe50dc00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe508158ca0 0x7fe5080b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.014+0000 7fe50dc00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe508070970 con 0x7fe508070560 2024-01-24T13:06:07.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.014+0000 7fe50dc00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe508070ba0 con 0x7fe50806bbc0 2024-01-24T13:06:07.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.014+0000 7fe50dc00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe508159080 con 0x7fe508158ca0 2024-01-24T13:06:07.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.014+0000 7fe506a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe508158ca0 0x7fe5080b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.014+0000 7fe507400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe508070560 0x7fe5080cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45176/0 (socket says 172.21.15.29:45176) 2024-01-24T13:06:07.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.014+0000 7fe507400640 1 -- 172.21.15.29:0/3816389968 learned_addr learned my addr 172.21.15.29:0/3816389968 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:07.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.014+0000 7fe506a00640 1 -- 172.21.15.29:0/3816389968 >> v1:172.21.15.163:6789/0 conn(0x7fe50806bbc0 legacy=0x7fe50806fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:07.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.014+0000 7fe506a00640 1 -- 172.21.15.29:0/3816389968 >> v1:172.21.15.29:6789/0 conn(0x7fe508070560 legacy=0x7fe5080cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.014+0000 7fe506a00640 1 -- 172.21.15.29:0/3816389968 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5080b18c0 con 0x7fe508158ca0 2024-01-24T13:06:07.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.014+0000 7fe505600640 1 -- 172.21.15.29:0/3816389968 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051544070 0 0) 0x7fe508070970 con 0x7fe508070560 2024-01-24T13:06:07.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.014+0000 7fe506a00640 1 --2- 172.21.15.29:0/3816389968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe508158ca0 0x7fe5080b2680 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80097c0 tx=0x7fe4f801d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35dc864d6a9de2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:07.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe505600640 1 -- 172.21.15.29:0/3816389968 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f80ab670 con 0x7fe508158ca0 2024-01-24T13:06:07.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe505600640 1 -- 172.21.15.29:0/3816389968 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f80ab7d0 con 0x7fe508158ca0 2024-01-24T13:06:07.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe505600640 1 -- 172.21.15.29:0/3816389968 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f80abb60 con 0x7fe508158ca0 2024-01-24T13:06:07.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe50dc00640 1 -- 172.21.15.29:0/3816389968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe508158ca0 msgr2=0x7fe5080b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe50dc00640 1 --2- 172.21.15.29:0/3816389968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe508158ca0 0x7fe5080b2680 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80097c0 tx=0x7fe4f801d520 comp rx=0 tx=0).stop 2024-01-24T13:06:07.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe50dc00640 1 -- 172.21.15.29:0/3816389968 shutdown_connections 2024-01-24T13:06:07.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe50dc00640 1 --2- 172.21.15.29:0/3816389968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe508158ca0 0x7fe5080b2680 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe50dc00640 1 -- 172.21.15.29:0/3816389968 >> 172.21.15.29:0/3816389968 conn(0x7fe50806d700 msgr2=0x7fe508069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:07.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe50dc00640 1 -- 172.21.15.29:0/3816389968 shutdown_connections 2024-01-24T13:06:07.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe50dc00640 1 -- 172.21.15.29:0/3816389968 wait complete. 2024-01-24T13:06:07.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe50dc00640 1 Processor -- start 2024-01-24T13:06:07.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe50dc00640 1 -- start start 2024-01-24T13:06:07.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe50dc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe50806bbc0 0x7fe508149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe50dc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe508070560 0x7fe508150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.018+0000 7fe50dc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe508158ca0 0x7fe5081505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe50dc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe508157bf0 con 0x7fe508158ca0 2024-01-24T13:06:07.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe50dc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50814c0e0 con 0x7fe508070560 2024-01-24T13:06:07.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe50dc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50814a510 con 0x7fe50806bbc0 2024-01-24T13:06:07.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe507400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe508158ca0 0x7fe5081505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe506a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe50806bbc0 0x7fe508149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe506000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe508070560 0x7fe508150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe506a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe50806bbc0 0x7fe508149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:35958/0 (socket says 172.21.15.29:35958) 2024-01-24T13:06:07.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe506000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe508070560 0x7fe508150060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:50850/0 (socket says 172.21.15.29:50850) 2024-01-24T13:06:07.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe506a00640 1 -- 172.21.15.29:0/173675605 learned_addr learned my addr 172.21.15.29:0/173675605 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:07.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe507400640 1 -- 172.21.15.29:0/173675605 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe50806bbc0 msgr2=0x7fe508149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe507400640 1 --2- 172.21.15.29:0/173675605 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe50806bbc0 0x7fe508149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe507400640 1 -- 172.21.15.29:0/173675605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe508070560 msgr2=0x7fe508150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe507400640 1 --2- 172.21.15.29:0/173675605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe508070560 0x7fe508150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe507400640 1 -- 172.21.15.29:0/173675605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f8009420 con 0x7fe508158ca0 2024-01-24T13:06:07.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe507400640 1 --2- 172.21.15.29:0/173675605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe508158ca0 0x7fe5081505a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe50000c750 tx=0x7fe50000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:07.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe4fea00640 1 -- 172.21.15.29:0/173675605 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50000ce60 con 0x7fe508158ca0 2024-01-24T13:06:07.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe4fea00640 1 -- 172.21.15.29:0/173675605 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50000a640 con 0x7fe508158ca0 2024-01-24T13:06:07.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe4fea00640 1 -- 172.21.15.29:0/173675605 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50000a9d0 con 0x7fe508158ca0 2024-01-24T13:06:07.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe50dc00640 1 -- 172.21.15.29:0/173675605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50814d970 con 0x7fe508158ca0 2024-01-24T13:06:07.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe50dc00640 1 -- 172.21.15.29:0/173675605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50814d690 con 0x7fe508158ca0 2024-01-24T13:06:07.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe50dc00640 1 -- 172.21.15.29:0/173675605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe508070070 con 0x7fe508158ca0 2024-01-24T13:06:07.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.022+0000 7fe4fea00640 1 -- 172.21.15.29:0/173675605 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe50000ab30 con 0x7fe508158ca0 2024-01-24T13:06:07.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.026+0000 7fe4fea00640 1 --2- 172.21.15.29:0/173675605 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe4e0065a60 0x7fe4e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.026+0000 7fe4fea00640 1 -- 172.21.15.29:0/173675605 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fe500082710 con 0x7fe508158ca0 2024-01-24T13:06:07.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.026+0000 7fe506a00640 1 --2- 172.21.15.29:0/173675605 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe4e0065a60 0x7fe4e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.026+0000 7fe506a00640 1 --2- 172.21.15.29:0/173675605 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe4e0065a60 0x7fe4e0067f20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80097c0 tx=0x7fe4f8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:07.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.030+0000 7fe4fea00640 1 -- 172.21.15.29:0/173675605 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe50004fef0 con 0x7fe508158ca0 2024-01-24T13:06:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.186+0000 7fe50dc00640 1 -- 172.21.15.29:0/173675605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fe50804e850 con 0x7fe508158ca0 2024-01-24T13:06:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.186+0000 7fe4fea00640 1 -- 172.21.15.29:0/173675605 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v46) v1 ==== 97+0+11 (secure 0 0 0) 0x7fe500018020 con 0x7fe508158ca0 2024-01-24T13:06:07.192 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:06:07.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.190+0000 7fe50dc00640 1 -- 172.21.15.29:0/173675605 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe4e0065a60 msgr2=0x7fe4e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.190+0000 7fe50dc00640 1 --2- 172.21.15.29:0/173675605 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe4e0065a60 0x7fe4e0067f20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80097c0 tx=0x7fe4f8008040 comp rx=0 tx=0).stop 2024-01-24T13:06:07.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.190+0000 7fe50dc00640 1 -- 172.21.15.29:0/173675605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe508158ca0 msgr2=0x7fe5081505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.190+0000 7fe50dc00640 1 --2- 172.21.15.29:0/173675605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe508158ca0 0x7fe5081505a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe50000c750 tx=0x7fe50000cc10 comp rx=0 tx=0).stop 2024-01-24T13:06:07.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.190+0000 7fe50dc00640 1 -- 172.21.15.29:0/173675605 shutdown_connections 2024-01-24T13:06:07.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.190+0000 7fe50dc00640 1 --2- 172.21.15.29:0/173675605 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe4e0065a60 0x7fe4e0067f20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.190+0000 7fe50dc00640 1 --2- 172.21.15.29:0/173675605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe508158ca0 0x7fe5081505a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.190+0000 7fe50dc00640 1 --2- 172.21.15.29:0/173675605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe508070560 0x7fe508150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.190+0000 7fe50dc00640 1 --2- 172.21.15.29:0/173675605 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe50806bbc0 0x7fe508149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.190+0000 7fe50dc00640 1 -- 172.21.15.29:0/173675605 >> 172.21.15.29:0/173675605 conn(0x7fe50806d700 msgr2=0x7fe508153910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:07.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.190+0000 7fe50dc00640 1 -- 172.21.15.29:0/173675605 shutdown_connections 2024-01-24T13:06:07.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.190+0000 7fe50dc00640 1 -- 172.21.15.29:0/173675605 wait complete. 2024-01-24T13:06:07.214 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:06:07.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1d2a00640 1 Processor -- start 2024-01-24T13:06:07.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1d2a00640 1 -- start start 2024-01-24T13:06:07.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1d2a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa1cc0cd460 0x7fa1cc0d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1d2a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1cc15d870 0x7fa1cc0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1d2a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1cc0ce9e0 con 0x7fa1cc0ce5c0 2024-01-24T13:06:07.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1d2a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1cc0d0830 con 0x7fa1cc15d870 2024-01-24T13:06:07.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1d2a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1cc0d0b10 con 0x7fa1cc0cd460 2024-01-24T13:06:07.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1cb400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1cc15d870 0x7fa1cc0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1cb400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1cc15d870 0x7fa1cc0ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51890/0 (socket says 172.21.15.29:51890) 2024-01-24T13:06:07.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1cb400640 1 -- 172.21.15.29:0/4242996400 learned_addr learned my addr 172.21.15.29:0/4242996400 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:07.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1cbe00640 1 --2- 172.21.15.29:0/4242996400 >> v2:172.21.15.163:3300/0 conn(0x7fa1cc0cd460 0x7fa1cc0d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1cb400640 1 -- 172.21.15.29:0/4242996400 >> v2:172.21.15.163:3300/0 conn(0x7fa1cc0cd460 msgr2=0x7fa1cc0d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:07.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1cb400640 1 --2- 172.21.15.29:0/4242996400 >> v2:172.21.15.163:3300/0 conn(0x7fa1cc0cd460 0x7fa1cc0d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1cb400640 1 -- 172.21.15.29:0/4242996400 >> v1:172.21.15.163:6789/0 conn(0x7fa1cc0ce5c0 legacy=0x7fa1cc1603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.354+0000 7fa1cb400640 1 -- 172.21.15.29:0/4242996400 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc0d0df0 con 0x7fa1cc15d870 2024-01-24T13:06:07.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.358+0000 7fa1cb400640 1 --2- 172.21.15.29:0/4242996400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1cc15d870 0x7fa1cc0ce080 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0b2130 tx=0x7fa1b401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813289fa35392055 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:07.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.358+0000 7fa1caa00640 1 -- 172.21.15.29:0/4242996400 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4004230 con 0x7fa1cc15d870 2024-01-24T13:06:07.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.358+0000 7fa1caa00640 1 -- 172.21.15.29:0/4242996400 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b40a7050 con 0x7fa1cc15d870 2024-01-24T13:06:07.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.358+0000 7fa1caa00640 1 -- 172.21.15.29:0/4242996400 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4003620 con 0x7fa1cc15d870 2024-01-24T13:06:07.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.358+0000 7fa1d2a00640 1 -- 172.21.15.29:0/4242996400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1cc15d870 msgr2=0x7fa1cc0ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.358+0000 7fa1d2a00640 1 --2- 172.21.15.29:0/4242996400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1cc15d870 0x7fa1cc0ce080 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0b2130 tx=0x7fa1b401c470 comp rx=0 tx=0).stop 2024-01-24T13:06:07.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.358+0000 7fa1d2a00640 1 -- 172.21.15.29:0/4242996400 shutdown_connections 2024-01-24T13:06:07.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.358+0000 7fa1d2a00640 1 --2- 172.21.15.29:0/4242996400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1cc15d870 0x7fa1cc0ce080 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.358+0000 7fa1d2a00640 1 --2- 172.21.15.29:0/4242996400 >> v2:172.21.15.163:3300/0 conn(0x7fa1cc0cd460 0x7fa1cc0d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.358+0000 7fa1d2a00640 1 -- 172.21.15.29:0/4242996400 >> 172.21.15.29:0/4242996400 conn(0x7fa1cc069cd0 msgr2=0x7fa1cc06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:07.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.358+0000 7fa1d2a00640 1 -- 172.21.15.29:0/4242996400 shutdown_connections 2024-01-24T13:06:07.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.358+0000 7fa1d2a00640 1 -- 172.21.15.29:0/4242996400 wait complete. 2024-01-24T13:06:07.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1d2a00640 1 Processor -- start 2024-01-24T13:06:07.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1d2a00640 1 -- start start 2024-01-24T13:06:07.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1d2a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1cc0cd460 0x7fa1cc152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1d2a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa1cc0ce5c0 0x7fa1cc1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1d2a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1cc15d870 0x7fa1cc0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1d2a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc152fa0 con 0x7fa1cc0cd460 2024-01-24T13:06:07.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1d2a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc0c3fc0 con 0x7fa1cc15d870 2024-01-24T13:06:07.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1d2a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc0c8220 con 0x7fa1cc0ce5c0 2024-01-24T13:06:07.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1cbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1cc0cd460 0x7fa1cc152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1cbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1cc0cd460 0x7fa1cc152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51894/0 (socket says 172.21.15.29:51894) 2024-01-24T13:06:07.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1cbe00640 1 -- 172.21.15.29:0/3350689213 learned_addr learned my addr 172.21.15.29:0/3350689213 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:07.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1cb400640 1 --2- 172.21.15.29:0/3350689213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa1cc0ce5c0 0x7fa1cc1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1d0a00640 1 --2- 172.21.15.29:0/3350689213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1cc15d870 0x7fa1cc0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1cbe00640 1 -- 172.21.15.29:0/3350689213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa1cc0ce5c0 msgr2=0x7fa1cc1566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1cbe00640 1 --2- 172.21.15.29:0/3350689213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa1cc0ce5c0 0x7fa1cc1566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1cbe00640 1 -- 172.21.15.29:0/3350689213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1cc15d870 msgr2=0x7fa1cc0b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1cbe00640 1 --2- 172.21.15.29:0/3350689213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1cc15d870 0x7fa1cc0b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1cbe00640 1 -- 172.21.15.29:0/3350689213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b40094d0 con 0x7fa1cc0cd460 2024-01-24T13:06:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1cbe00640 1 --2- 172.21.15.29:0/3350689213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1cc0cd460 0x7fa1cc152a60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00e930 tx=0x7fa1bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1c3e00640 1 -- 172.21.15.29:0/3350689213 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc009690 con 0x7fa1cc0cd460 2024-01-24T13:06:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1c3e00640 1 -- 172.21.15.29:0/3350689213 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1bc00ca00 con 0x7fa1cc0cd460 2024-01-24T13:06:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1d2a00640 1 -- 172.21.15.29:0/3350689213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1cc0c8500 con 0x7fa1cc0cd460 2024-01-24T13:06:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1c3e00640 1 -- 172.21.15.29:0/3350689213 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc00cd70 con 0x7fa1cc0cd460 2024-01-24T13:06:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.362+0000 7fa1d2a00640 1 -- 172.21.15.29:0/3350689213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1cc0c8ac0 con 0x7fa1cc0cd460 2024-01-24T13:06:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.366+0000 7fa1d2a00640 1 -- 172.21.15.29:0/3350689213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1cc04e850 con 0x7fa1cc0cd460 2024-01-24T13:06:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.366+0000 7fa1c3e00640 1 -- 172.21.15.29:0/3350689213 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa1bc013470 con 0x7fa1cc0cd460 2024-01-24T13:06:07.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.366+0000 7fa1c3e00640 1 --2- 172.21.15.29:0/3350689213 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa1a4065a60 0x7fa1a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.366+0000 7fa1c3e00640 1 -- 172.21.15.29:0/3350689213 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fa1bc083690 con 0x7fa1cc0cd460 2024-01-24T13:06:07.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.366+0000 7fa1cb400640 1 --2- 172.21.15.29:0/3350689213 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa1a4065a60 0x7fa1a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.366+0000 7fa1cb400640 1 --2- 172.21.15.29:0/3350689213 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa1a4065a60 0x7fa1a4067f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40ad000 tx=0x7fa1b40a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:07.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.370+0000 7fa1c3e00640 1 -- 172.21.15.29:0/3350689213 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa1bc050e90 con 0x7fa1cc0cd460 2024-01-24T13:06:07.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.538+0000 7fa1d2a00640 1 -- 172.21.15.29:0/3350689213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa1cc0b6430 con 0x7fa1cc0cd460 2024-01-24T13:06:07.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.538+0000 7fa1c3e00640 1 -- 172.21.15.29:0/3350689213 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa1bc0544b0 con 0x7fa1cc0cd460 2024-01-24T13:06:07.544 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:06:07.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.542+0000 7fa1d2a00640 1 -- 172.21.15.29:0/3350689213 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa1a4065a60 msgr2=0x7fa1a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.542+0000 7fa1d2a00640 1 --2- 172.21.15.29:0/3350689213 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa1a4065a60 0x7fa1a4067f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40ad000 tx=0x7fa1b40a6000 comp rx=0 tx=0).stop 2024-01-24T13:06:07.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.542+0000 7fa1d2a00640 1 -- 172.21.15.29:0/3350689213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1cc0cd460 msgr2=0x7fa1cc152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.542+0000 7fa1d2a00640 1 --2- 172.21.15.29:0/3350689213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1cc0cd460 0x7fa1cc152a60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00e930 tx=0x7fa1bc00edf0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.542+0000 7fa1d2a00640 1 -- 172.21.15.29:0/3350689213 shutdown_connections 2024-01-24T13:06:07.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.542+0000 7fa1d2a00640 1 --2- 172.21.15.29:0/3350689213 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa1a4065a60 0x7fa1a4067f20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.542+0000 7fa1d2a00640 1 --2- 172.21.15.29:0/3350689213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1cc15d870 0x7fa1cc0b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.542+0000 7fa1d2a00640 1 --2- 172.21.15.29:0/3350689213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa1cc0ce5c0 0x7fa1cc1566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.542+0000 7fa1d2a00640 1 --2- 172.21.15.29:0/3350689213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1cc0cd460 0x7fa1cc152a60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.542+0000 7fa1d2a00640 1 -- 172.21.15.29:0/3350689213 >> 172.21.15.29:0/3350689213 conn(0x7fa1cc069cd0 msgr2=0x7fa1cc06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:07.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.542+0000 7fa1d2a00640 1 -- 172.21.15.29:0/3350689213 shutdown_connections 2024-01-24T13:06:07.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.542+0000 7fa1d2a00640 1 -- 172.21.15.29:0/3350689213 wait complete. 2024-01-24T13:06:07.567 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:06:07.567 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:06:07.576 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:06:07.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.754+0000 7f422c800640 1 Processor -- start 2024-01-24T13:06:07.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.754+0000 7f422c800640 1 -- start start 2024-01-24T13:06:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f422c800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f422415c450 0x7f42240cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f422c800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42240b1030 0x7f42240ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f422c800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4224070230 con 0x7f42240b1f50 2024-01-24T13:06:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f422c800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42240712d0 con 0x7f422415c450 2024-01-24T13:06:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f422c800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4224070510 con 0x7f42240b1030 2024-01-24T13:06:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4229400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f42240b1f50 0x7f422406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45190/0 (socket says 172.21.15.29:45190) 2024-01-24T13:06:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4229400640 1 -- 172.21.15.29:0/1106609411 learned_addr learned my addr 172.21.15.29:0/1106609411 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:07.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f422a800640 1 --2- 172.21.15.29:0/1106609411 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42240b1030 0x7f42240ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4229e00640 1 --2- 172.21.15.29:0/1106609411 >> v2:172.21.15.163:3300/0 conn(0x7f422415c450 0x7f42240cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 -- 172.21.15.29:0/1106609411 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872611118 0 0) 0x7f4224070230 con 0x7f42240b1f50 2024-01-24T13:06:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 -- 172.21.15.29:0/1106609411 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4204003530 con 0x7f42240b1f50 2024-01-24T13:06:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 -- 172.21.15.29:0/1106609411 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3098102034 0 0) 0x7f4204003530 con 0x7f42240b1f50 2024-01-24T13:06:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 -- 172.21.15.29:0/1106609411 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42240b1030 msgr2=0x7f42240ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 --2- 172.21.15.29:0/1106609411 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42240b1030 0x7f42240ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 -- 172.21.15.29:0/1106609411 >> v2:172.21.15.163:3300/0 conn(0x7f422415c450 msgr2=0x7f42240cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 --2- 172.21.15.29:0/1106609411 >> v2:172.21.15.163:3300/0 conn(0x7f422415c450 0x7f42240cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 -- 172.21.15.29:0/1106609411 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42240707f0 con 0x7f42240b1f50 2024-01-24T13:06:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 -- 172.21.15.29:0/1106609411 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f420c001680 con 0x7f42240b1f50 2024-01-24T13:06:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 -- 172.21.15.29:0/1106609411 >> v1:172.21.15.29:6789/0 conn(0x7f42240b1f50 legacy=0x7f422406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 --2- 172.21.15.29:0/1106609411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4204003980 0x7f4204003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 --2- 172.21.15.29:0/1106609411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42040047d0 0x7f4204004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 --2- 172.21.15.29:0/1106609411 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42240b1030 0x7f4204005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 -- 172.21.15.29:0/1106609411 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4224070510 con 0x7f42040047d0 2024-01-24T13:06:07.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 -- 172.21.15.29:0/1106609411 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420400b990 con 0x7f4204003980 2024-01-24T13:06:07.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4228a00640 1 -- 172.21.15.29:0/1106609411 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420400bad0 con 0x7f42240b1030 2024-01-24T13:06:07.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4229400640 1 --2- 172.21.15.29:0/1106609411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42040047d0 0x7f4204004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4229e00640 1 --2- 172.21.15.29:0/1106609411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4204003980 0x7f4204003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f422a800640 1 --2- 172.21.15.29:0/1106609411 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42240b1030 0x7f4204005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4229400640 1 -- 172.21.15.29:0/1106609411 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42240b1030 msgr2=0x7f4204005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:07.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4229400640 1 --2- 172.21.15.29:0/1106609411 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42240b1030 0x7f4204005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4229400640 1 -- 172.21.15.29:0/1106609411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4204003980 msgr2=0x7f4204003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:07.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4229400640 1 --2- 172.21.15.29:0/1106609411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4204003980 0x7f4204003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.758+0000 7f4229400640 1 -- 172.21.15.29:0/1106609411 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4204003530 con 0x7f42040047d0 2024-01-24T13:06:07.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.762+0000 7f4229400640 1 --2- 172.21.15.29:0/1106609411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42040047d0 0x7f4204004c50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f42240b2390 tx=0x7f420c01f250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7724020f5d78496f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:07.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.762+0000 7f4228a00640 1 -- 172.21.15.29:0/1106609411 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c0a8bd0 con 0x7f42040047d0 2024-01-24T13:06:07.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.762+0000 7f4228a00640 1 -- 172.21.15.29:0/1106609411 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c0a8d30 con 0x7f42040047d0 2024-01-24T13:06:07.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.762+0000 7f4228a00640 1 -- 172.21.15.29:0/1106609411 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c0a8ea0 con 0x7f42040047d0 2024-01-24T13:06:07.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.762+0000 7f422c800640 1 -- 172.21.15.29:0/1106609411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42040047d0 msgr2=0x7f4204004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.762+0000 7f422c800640 1 --2- 172.21.15.29:0/1106609411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42040047d0 0x7f4204004c50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f42240b2390 tx=0x7f420c01f250 comp rx=0 tx=0).stop 2024-01-24T13:06:07.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.762+0000 7f422a800640 1 -- 172.21.15.29:0/1106609411 reap_dead start 2024-01-24T13:06:07.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.762+0000 7f422c800640 1 -- 172.21.15.29:0/1106609411 shutdown_connections 2024-01-24T13:06:07.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.762+0000 7f422c800640 1 -- 172.21.15.29:0/1106609411 >> 172.21.15.29:0/1106609411 conn(0x7f42240b3950 msgr2=0x7f4224069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:07.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.762+0000 7f422c800640 1 -- 172.21.15.29:0/1106609411 shutdown_connections 2024-01-24T13:06:07.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.762+0000 7f422c800640 1 -- 172.21.15.29:0/1106609411 wait complete. 2024-01-24T13:06:07.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f422c800640 1 Processor -- start 2024-01-24T13:06:07.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f422c800640 1 -- start start 2024-01-24T13:06:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f422c800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42040047d0 0x7f422413eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f422c800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f422413f4e0 0x7f42240cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f422c800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42240cc9f0 0x7f4224157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f422c800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4224153f70 con 0x7f422413f4e0 2024-01-24T13:06:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f422c800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4224154d90 con 0x7f42240cc9f0 2024-01-24T13:06:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f422c800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4224154180 con 0x7f42040047d0 2024-01-24T13:06:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f4229400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f422413f4e0 0x7f42240cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f4229400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f422413f4e0 0x7f42240cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51908/0 (socket says 172.21.15.29:51908) 2024-01-24T13:06:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f4229400640 1 -- 172.21.15.29:0/4218165641 learned_addr learned my addr 172.21.15.29:0/4218165641 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f422a800640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42240cc9f0 0x7f4224157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f4229e00640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42040047d0 0x7f422413eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f4229400640 1 -- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42040047d0 msgr2=0x7f422413eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f4229400640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42040047d0 0x7f422413eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f4229400640 1 -- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42240cc9f0 msgr2=0x7f4224157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f4229400640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42240cc9f0 0x7f4224157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f4229400640 1 -- 172.21.15.29:0/4218165641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4224154460 con 0x7f422413f4e0 2024-01-24T13:06:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f4229e00640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42040047d0 0x7f422413eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f4229400640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f422413f4e0 0x7f42240cc4b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f420c01faf0 tx=0x7f4204005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f4222000640 1 -- 172.21.15.29:0/4218165641 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c0a8ea0 con 0x7f422413f4e0 2024-01-24T13:06:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f4222000640 1 -- 172.21.15.29:0/4218165641 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c0048b0 con 0x7f422413f4e0 2024-01-24T13:06:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f4222000640 1 -- 172.21.15.29:0/4218165641 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c004c40 con 0x7f422413f4e0 2024-01-24T13:06:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f422c800640 1 -- 172.21.15.29:0/4218165641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4224154740 con 0x7f422413f4e0 2024-01-24T13:06:07.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f422c800640 1 -- 172.21.15.29:0/4218165641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422413f070 con 0x7f422413f4e0 2024-01-24T13:06:07.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.766+0000 7f422c800640 1 -- 172.21.15.29:0/4218165641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422404e850 con 0x7f422413f4e0 2024-01-24T13:06:07.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.770+0000 7f4222000640 1 -- 172.21.15.29:0/4218165641 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f420c0b8070 con 0x7f422413f4e0 2024-01-24T13:06:07.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.770+0000 7f4222000640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f41fc065a60 0x7f41fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:07.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.770+0000 7f4222000640 1 -- 172.21.15.29:0/4218165641 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f420c1203b0 con 0x7f422413f4e0 2024-01-24T13:06:07.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.770+0000 7f4229e00640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f41fc065a60 0x7f41fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.770+0000 7f4229e00640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f41fc065a60 0x7f41fc067f20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4214009be0 tx=0x7f4214008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:07.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.774+0000 7f4222000640 1 -- 172.21.15.29:0/4218165641 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f420c0eda40 con 0x7f422413f4e0 2024-01-24T13:06:07.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.934+0000 7f422c800640 1 -- 172.21.15.29:0/4218165641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42240cdb10 con 0x7f422413f4e0 2024-01-24T13:06:07.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.934+0000 7f4222000640 1 -- 172.21.15.29:0/4218165641 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18163 (secure 0 0 0) 0x7f420c0f1060 con 0x7f422413f4e0 2024-01-24T13:06:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:07.938 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":46,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:05:37.734611+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:05:21.225564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-24T13:05:22.188525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-01-24T13:05:35.873766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.6","mappings":[{"from":3,"to":2}]},{"pgid":"6.14","mappings":[{"from":4,"to":2}]},{"pgid":"6.24","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:06:07.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.934+0000 7f422c800640 1 -- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f41fc065a60 msgr2=0x7f41fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.934+0000 7f422c800640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f41fc065a60 0x7f41fc067f20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4214009be0 tx=0x7f4214008040 comp rx=0 tx=0).stop 2024-01-24T13:06:07.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.934+0000 7f422c800640 1 -- 172.21.15.29:0/4218165641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f422413f4e0 msgr2=0x7f42240cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:07.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.934+0000 7f422c800640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f422413f4e0 0x7f42240cc4b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f420c01faf0 tx=0x7f4204005800 comp rx=0 tx=0).stop 2024-01-24T13:06:07.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.934+0000 7f422c800640 1 -- 172.21.15.29:0/4218165641 shutdown_connections 2024-01-24T13:06:07.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.934+0000 7f422c800640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f41fc065a60 0x7f41fc067f20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.934+0000 7f422c800640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42240cc9f0 0x7f4224157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.934+0000 7f422c800640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f422413f4e0 0x7f42240cc4b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.934+0000 7f422c800640 1 --2- 172.21.15.29:0/4218165641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42040047d0 0x7f422413eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:07.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.934+0000 7f422c800640 1 -- 172.21.15.29:0/4218165641 >> 172.21.15.29:0/4218165641 conn(0x7f42240b3950 msgr2=0x7f42240b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:07.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.938+0000 7f422c800640 1 -- 172.21.15.29:0/4218165641 shutdown_connections 2024-01-24T13:06:07.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:07.938+0000 7f422c800640 1 -- 172.21.15.29:0/4218165641 wait complete. 2024-01-24T13:06:07.961 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:05:21.225564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:05:22.188525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2024-01-24T13:05:35.873766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:06:07.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:06:08.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b8c00640 1 Processor -- start 2024-01-24T13:06:08.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b8c00640 1 -- start start 2024-01-24T13:06:08.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b8c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f71b406c860 0x7f71b406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b8c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f71b40cd520 0x7f71b415d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b8c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b406b320 con 0x7f71b4142980 2024-01-24T13:06:08.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b8c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b41611b0 con 0x7f71b40cd520 2024-01-24T13:06:08.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b8c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b4160630 con 0x7f71b406c860 2024-01-24T13:06:08.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b2800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f71b40cd520 0x7f71b415d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b2800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f71b40cd520 0x7f71b415d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51912/0 (socket says 172.21.15.29:51912) 2024-01-24T13:06:08.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b2800640 1 -- 172.21.15.29:0/716126166 learned_addr learned my addr 172.21.15.29:0/716126166 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:08.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b1e00640 1 --2- 172.21.15.29:0/716126166 >> v2:172.21.15.163:3300/0 conn(0x7f71b406c860 0x7f71b406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b2800640 1 -- 172.21.15.29:0/716126166 >> v2:172.21.15.163:3300/0 conn(0x7f71b406c860 msgr2=0x7f71b406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:08.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b2800640 1 --2- 172.21.15.29:0/716126166 >> v2:172.21.15.163:3300/0 conn(0x7f71b406c860 0x7f71b406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b2800640 1 -- 172.21.15.29:0/716126166 >> v1:172.21.15.163:6789/0 conn(0x7f71b4142980 legacy=0x7f71b40cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.102+0000 7f71b2800640 1 -- 172.21.15.29:0/716126166 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b4160910 con 0x7f71b40cd520 2024-01-24T13:06:08.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.106+0000 7f71b2800640 1 --2- 172.21.15.29:0/716126166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b40cd520 0x7f71b415d080 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f71b40d14c0 tx=0x7f71ac01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4db2f9bb0bc01ec server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:08.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.106+0000 7f71b0a00640 1 -- 172.21.15.29:0/716126166 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0a5860 con 0x7f71b40cd520 2024-01-24T13:06:08.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.106+0000 7f71b0a00640 1 -- 172.21.15.29:0/716126166 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac0a59c0 con 0x7f71b40cd520 2024-01-24T13:06:08.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.106+0000 7f71b0a00640 1 -- 172.21.15.29:0/716126166 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0a5d50 con 0x7f71b40cd520 2024-01-24T13:06:08.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.106+0000 7f71b8c00640 1 -- 172.21.15.29:0/716126166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b40cd520 msgr2=0x7f71b415d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.106+0000 7f71b8c00640 1 --2- 172.21.15.29:0/716126166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b40cd520 0x7f71b415d080 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f71b40d14c0 tx=0x7f71ac01c9a0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.106+0000 7f71b8c00640 1 -- 172.21.15.29:0/716126166 shutdown_connections 2024-01-24T13:06:08.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.106+0000 7f71b8c00640 1 --2- 172.21.15.29:0/716126166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b40cd520 0x7f71b415d080 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.106+0000 7f71b8c00640 1 --2- 172.21.15.29:0/716126166 >> v2:172.21.15.163:3300/0 conn(0x7f71b406c860 0x7f71b406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.106+0000 7f71b8c00640 1 -- 172.21.15.29:0/716126166 >> 172.21.15.29:0/716126166 conn(0x7f71b4069cd0 msgr2=0x7f71b406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:08.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.106+0000 7f71b8c00640 1 -- 172.21.15.29:0/716126166 shutdown_connections 2024-01-24T13:06:08.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.106+0000 7f71b8c00640 1 -- 172.21.15.29:0/716126166 wait complete. 2024-01-24T13:06:08.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b8c00640 1 Processor -- start 2024-01-24T13:06:08.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b8c00640 1 -- start start 2024-01-24T13:06:08.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b8c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71b406c860 0x7f71b41550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b8c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b40cd520 0x7f71b41508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b8c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71b4142980 0x7f71b4155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b8c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40b59a0 con 0x7f71b40cd520 2024-01-24T13:06:08.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b8c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40b4900 con 0x7f71b406c860 2024-01-24T13:06:08.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b8c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40b4be0 con 0x7f71b4142980 2024-01-24T13:06:08.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b1400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b40cd520 0x7f71b41508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b1e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71b406c860 0x7f71b41550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b1400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b40cd520 0x7f71b41508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51928/0 (socket says 172.21.15.29:51928) 2024-01-24T13:06:08.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b1400640 1 -- 172.21.15.29:0/3992369504 learned_addr learned my addr 172.21.15.29:0/3992369504 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:08.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b2800640 1 --2- 172.21.15.29:0/3992369504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71b4142980 0x7f71b4155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b1400640 1 -- 172.21.15.29:0/3992369504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71b4142980 msgr2=0x7f71b4155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b1400640 1 --2- 172.21.15.29:0/3992369504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71b4142980 0x7f71b4155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b1400640 1 -- 172.21.15.29:0/3992369504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71b406c860 msgr2=0x7f71b41550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b1400640 1 --2- 172.21.15.29:0/3992369504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71b406c860 0x7f71b41550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b1400640 1 -- 172.21.15.29:0/3992369504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac009b30 con 0x7f71b40cd520 2024-01-24T13:06:08.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b1e00640 1 --2- 172.21.15.29:0/3992369504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71b406c860 0x7f71b41550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:08.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b1400640 1 --2- 172.21.15.29:0/3992369504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b40cd520 0x7f71b41508b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f719c00c3c0 tx=0x7f719c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:08.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71aa000640 1 -- 172.21.15.29:0/3992369504 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c0052d0 con 0x7f71b40cd520 2024-01-24T13:06:08.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71aa000640 1 -- 172.21.15.29:0/3992369504 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c005430 con 0x7f71b40cd520 2024-01-24T13:06:08.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b8c00640 1 -- 172.21.15.29:0/3992369504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b40b4ec0 con 0x7f71b40cd520 2024-01-24T13:06:08.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71aa000640 1 -- 172.21.15.29:0/3992369504 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c003840 con 0x7f71b40cd520 2024-01-24T13:06:08.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.110+0000 7f71b8c00640 1 -- 172.21.15.29:0/3992369504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b40b5480 con 0x7f71b40cd520 2024-01-24T13:06:08.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.114+0000 7f71b8c00640 1 -- 172.21.15.29:0/3992369504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b415d3f0 con 0x7f71b40cd520 2024-01-24T13:06:08.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.114+0000 7f71aa000640 1 -- 172.21.15.29:0/3992369504 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f719c0039a0 con 0x7f71b40cd520 2024-01-24T13:06:08.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.114+0000 7f71aa000640 1 --2- 172.21.15.29:0/3992369504 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f718c065a60 0x7f718c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.114+0000 7f71aa000640 1 -- 172.21.15.29:0/3992369504 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f719c082a70 con 0x7f71b40cd520 2024-01-24T13:06:08.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.114+0000 7f71b1e00640 1 --2- 172.21.15.29:0/3992369504 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f718c065a60 0x7f718c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.114+0000 7f71b1e00640 1 --2- 172.21.15.29:0/3992369504 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f718c065a60 0x7f718c067f20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009f50 tx=0x7f71a4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:08.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.118+0000 7f71aa000640 1 -- 172.21.15.29:0/3992369504 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f719c0500a0 con 0x7f71b40cd520 2024-01-24T13:06:08.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.278+0000 7f71b8c00640 1 -- 172.21.15.29:0/3992369504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71b404e850 con 0x7f71b40cd520 2024-01-24T13:06:08.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.278+0000 7f71aa000640 1 -- 172.21.15.29:0/3992369504 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f719c0536c0 con 0x7f71b40cd520 2024-01-24T13:06:08.284 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:06:08.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.282+0000 7f71b8c00640 1 -- 172.21.15.29:0/3992369504 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f718c065a60 msgr2=0x7f718c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.282+0000 7f71b8c00640 1 --2- 172.21.15.29:0/3992369504 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f718c065a60 0x7f718c067f20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009f50 tx=0x7f71a4009190 comp rx=0 tx=0).stop 2024-01-24T13:06:08.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.282+0000 7f71b8c00640 1 -- 172.21.15.29:0/3992369504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b40cd520 msgr2=0x7f71b41508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.282+0000 7f71b8c00640 1 --2- 172.21.15.29:0/3992369504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b40cd520 0x7f71b41508b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f719c00c3c0 tx=0x7f719c00c880 comp rx=0 tx=0).stop 2024-01-24T13:06:08.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.282+0000 7f71b8c00640 1 -- 172.21.15.29:0/3992369504 shutdown_connections 2024-01-24T13:06:08.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.282+0000 7f71b8c00640 1 --2- 172.21.15.29:0/3992369504 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f718c065a60 0x7f718c067f20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.282+0000 7f71b8c00640 1 --2- 172.21.15.29:0/3992369504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71b4142980 0x7f71b4155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.282+0000 7f71b8c00640 1 --2- 172.21.15.29:0/3992369504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b40cd520 0x7f71b41508b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.282+0000 7f71b8c00640 1 --2- 172.21.15.29:0/3992369504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71b406c860 0x7f71b41550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.282+0000 7f71b8c00640 1 -- 172.21.15.29:0/3992369504 >> 172.21.15.29:0/3992369504 conn(0x7f71b4069cd0 msgr2=0x7f71b40b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:08.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.282+0000 7f71b8c00640 1 -- 172.21.15.29:0/3992369504 shutdown_connections 2024-01-24T13:06:08.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.282+0000 7f71b8c00640 1 -- 172.21.15.29:0/3992369504 wait complete. 2024-01-24T13:06:08.306 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:06:08.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc984800640 1 Processor -- start 2024-01-24T13:06:08.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc984800640 1 -- start start 2024-01-24T13:06:08.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc984800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc97c0cb1e0 0x7fc97c0d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc984800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c0cd1e0 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc984800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c0cd4c0 con 0x7fc97c15a6f0 2024-01-24T13:06:08.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc984800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c15aad0 con 0x7fc97c0cb1e0 2024-01-24T13:06:08.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc981400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc97c0c3fd0 0x7fc97c0caad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45198/0 (socket says 172.21.15.29:45198) 2024-01-24T13:06:08.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc981400640 1 -- 172.21.15.29:0/3143203114 learned_addr learned my addr 172.21.15.29:0/3143203114 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:08.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc982800640 1 --2- 172.21.15.29:0/3143203114 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc97c0cb1e0 0x7fc97c0d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc980a00640 1 -- 172.21.15.29:0/3143203114 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190428842 0 0) 0x7fc97c0cd1e0 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc980a00640 1 -- 172.21.15.29:0/3143203114 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc95c003530 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc980a00640 1 -- 172.21.15.29:0/3143203114 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674375817 0 0) 0x7fc97c0cd4c0 con 0x7fc97c15a6f0 2024-01-24T13:06:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc980a00640 1 -- 172.21.15.29:0/3143203114 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc97c0cd1e0 con 0x7fc97c15a6f0 2024-01-24T13:06:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc982800640 1 -- 172.21.15.29:0/3143203114 >> v1:172.21.15.163:6789/0 conn(0x7fc97c15a6f0 legacy=0x7fc97c0ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc982800640 1 -- 172.21.15.29:0/3143203114 >> v1:172.21.15.29:6789/0 conn(0x7fc97c0c3fd0 legacy=0x7fc97c0caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.450+0000 7fc982800640 1 -- 172.21.15.29:0/3143203114 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c0cd7a0 con 0x7fc97c0cb1e0 2024-01-24T13:06:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.454+0000 7fc982800640 1 --2- 172.21.15.29:0/3143203114 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc97c0cb1e0 0x7fc97c0d0520 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc974009dc0 tx=0x7fc97401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8d4b3f065937383 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.454+0000 7fc980a00640 1 -- 172.21.15.29:0/3143203114 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9740a5910 con 0x7fc97c0cb1e0 2024-01-24T13:06:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.454+0000 7fc980a00640 1 -- 172.21.15.29:0/3143203114 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9740a5a70 con 0x7fc97c0cb1e0 2024-01-24T13:06:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.454+0000 7fc980a00640 1 -- 172.21.15.29:0/3143203114 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9740a5e00 con 0x7fc97c0cb1e0 2024-01-24T13:06:08.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.454+0000 7fc984800640 1 -- 172.21.15.29:0/3143203114 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc97c0cb1e0 msgr2=0x7fc97c0d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.454+0000 7fc984800640 1 --2- 172.21.15.29:0/3143203114 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc97c0cb1e0 0x7fc97c0d0520 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc974009dc0 tx=0x7fc97401c940 comp rx=0 tx=0).stop 2024-01-24T13:06:08.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.454+0000 7fc984800640 1 -- 172.21.15.29:0/3143203114 shutdown_connections 2024-01-24T13:06:08.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.454+0000 7fc984800640 1 --2- 172.21.15.29:0/3143203114 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc97c0cb1e0 0x7fc97c0d0520 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.454+0000 7fc984800640 1 -- 172.21.15.29:0/3143203114 >> 172.21.15.29:0/3143203114 conn(0x7fc97c069cd0 msgr2=0x7fc97c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:08.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.454+0000 7fc984800640 1 -- 172.21.15.29:0/3143203114 shutdown_connections 2024-01-24T13:06:08.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.454+0000 7fc984800640 1 -- 172.21.15.29:0/3143203114 wait complete. 2024-01-24T13:06:08.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc984800640 1 Processor -- start 2024-01-24T13:06:08.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc984800640 1 -- start start 2024-01-24T13:06:08.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc984800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c0c3fd0 0x7fc97c15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc984800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc97c0cb1e0 0x7fc97c0b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc984800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc97c15a6f0 0x7fc97c155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc984800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c153920 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc984800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c153c00 con 0x7fc97c0cb1e0 2024-01-24T13:06:08.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc984800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c153ee0 con 0x7fc97c15a6f0 2024-01-24T13:06:08.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc981e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c0c3fd0 0x7fc97c15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc981e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c0c3fd0 0x7fc97c15ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51942/0 (socket says 172.21.15.29:51942) 2024-01-24T13:06:08.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc981e00640 1 -- 172.21.15.29:0/3411742928 learned_addr learned my addr 172.21.15.29:0/3411742928 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:08.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc982800640 1 --2- 172.21.15.29:0/3411742928 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc97c15a6f0 0x7fc97c155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc981400640 1 --2- 172.21.15.29:0/3411742928 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc97c0cb1e0 0x7fc97c0b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc981e00640 1 -- 172.21.15.29:0/3411742928 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc97c15a6f0 msgr2=0x7fc97c155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc981e00640 1 --2- 172.21.15.29:0/3411742928 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc97c15a6f0 0x7fc97c155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc981e00640 1 -- 172.21.15.29:0/3411742928 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc97c0cb1e0 msgr2=0x7fc97c0b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc981e00640 1 --2- 172.21.15.29:0/3411742928 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc97c0cb1e0 0x7fc97c0b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc981e00640 1 -- 172.21.15.29:0/3411742928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc974009a70 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc981e00640 1 --2- 172.21.15.29:0/3411742928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c0c3fd0 0x7fc97c15ac10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00c430 tx=0x7fc96c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:08.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc97a000640 1 -- 172.21.15.29:0/3411742928 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0052d0 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc97a000640 1 -- 172.21.15.29:0/3411742928 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c005450 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc984800640 1 -- 172.21.15.29:0/3411742928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c1541c0 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc97a000640 1 -- 172.21.15.29:0/3411742928 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c003840 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.458+0000 7fc984800640 1 -- 172.21.15.29:0/3411742928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c0b35c0 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.462+0000 7fc984800640 1 -- 172.21.15.29:0/3411742928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97c154400 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.462+0000 7fc97a000640 1 -- 172.21.15.29:0/3411742928 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc96c0039a0 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.462+0000 7fc97a000640 1 --2- 172.21.15.29:0/3411742928 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc954065a60 0x7fc954067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.462+0000 7fc97a000640 1 -- 172.21.15.29:0/3411742928 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fc96c082a30 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.462+0000 7fc981400640 1 --2- 172.21.15.29:0/3411742928 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc954065a60 0x7fc954067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.462+0000 7fc981400640 1 --2- 172.21.15.29:0/3411742928 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc954065a60 0x7fc954067f20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc97c15a0a0 tx=0x7fc964007d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:08.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.466+0000 7fc97a000640 1 -- 172.21.15.29:0/3411742928 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc96c050170 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.622+0000 7fc984800640 1 -- 172.21.15.29:0/3411742928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc97c153a60 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.622+0000 7fc97a000640 1 -- 172.21.15.29:0/3411742928 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc97c153a60 con 0x7fc97c0c3fd0 2024-01-24T13:06:08.626 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:06:08.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.622+0000 7fc984800640 1 -- 172.21.15.29:0/3411742928 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc954065a60 msgr2=0x7fc954067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.622+0000 7fc984800640 1 --2- 172.21.15.29:0/3411742928 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc954065a60 0x7fc954067f20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc97c15a0a0 tx=0x7fc964007d40 comp rx=0 tx=0).stop 2024-01-24T13:06:08.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.622+0000 7fc984800640 1 -- 172.21.15.29:0/3411742928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c0c3fd0 msgr2=0x7fc97c15ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.622+0000 7fc984800640 1 --2- 172.21.15.29:0/3411742928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c0c3fd0 0x7fc97c15ac10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00c430 tx=0x7fc96c00c8f0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.622+0000 7fc984800640 1 -- 172.21.15.29:0/3411742928 shutdown_connections 2024-01-24T13:06:08.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.622+0000 7fc984800640 1 --2- 172.21.15.29:0/3411742928 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc954065a60 0x7fc954067f20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.622+0000 7fc984800640 1 --2- 172.21.15.29:0/3411742928 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc97c15a6f0 0x7fc97c155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.622+0000 7fc984800640 1 --2- 172.21.15.29:0/3411742928 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc97c0cb1e0 0x7fc97c0b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.622+0000 7fc984800640 1 --2- 172.21.15.29:0/3411742928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c0c3fd0 0x7fc97c15ac10 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.622+0000 7fc984800640 1 -- 172.21.15.29:0/3411742928 >> 172.21.15.29:0/3411742928 conn(0x7fc97c069cd0 msgr2=0x7fc97c0c48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:08.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.626+0000 7fc984800640 1 -- 172.21.15.29:0/3411742928 shutdown_connections 2024-01-24T13:06:08.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.626+0000 7fc984800640 1 -- 172.21.15.29:0/3411742928 wait complete. 2024-01-24T13:06:08.648 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:06:08.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e8200640 1 Processor -- start 2024-01-24T13:06:08.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e8200640 1 -- start start 2024-01-24T13:06:08.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e8200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8e006be20 0x7fb8e015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e8200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb8e013d4b0 0x7fb8e015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e8200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e015b4f0 con 0x7fb8e006c200 2024-01-24T13:06:08.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e8200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e015b7d0 con 0x7fb8e006be20 2024-01-24T13:06:08.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e8200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e00cd0c0 con 0x7fb8e013d4b0 2024-01-24T13:06:08.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e5800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8e006be20 0x7fb8e015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e4e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb8e006c200 0x7fb8e013cda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45200/0 (socket says 172.21.15.29:45200) 2024-01-24T13:06:08.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e4e00640 1 -- 172.21.15.29:0/736991524 learned_addr learned my addr 172.21.15.29:0/736991524 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:08.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e5800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8e006be20 0x7fb8e015a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51952/0 (socket says 172.21.15.29:51952) 2024-01-24T13:06:08.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e6200640 1 --2- 172.21.15.29:0/736991524 >> v2:172.21.15.163:3300/0 conn(0x7fb8e013d4b0 0x7fb8e015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e5800640 1 -- 172.21.15.29:0/736991524 >> v2:172.21.15.163:3300/0 conn(0x7fb8e013d4b0 msgr2=0x7fb8e015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:08.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e5800640 1 --2- 172.21.15.29:0/736991524 >> v2:172.21.15.163:3300/0 conn(0x7fb8e013d4b0 0x7fb8e015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e5800640 1 -- 172.21.15.29:0/736991524 >> v1:172.21.15.29:6789/0 conn(0x7fb8e006c200 legacy=0x7fb8e013cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e5800640 1 -- 172.21.15.29:0/736991524 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e00cd3a0 con 0x7fb8e006be20 2024-01-24T13:06:08.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.790+0000 7fb8e6200640 1 --2- 172.21.15.29:0/736991524 >> v2:172.21.15.163:3300/0 conn(0x7fb8e013d4b0 0x7fb8e015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:08.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.794+0000 7fb8e5800640 1 --2- 172.21.15.29:0/736991524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8e006be20 0x7fb8e015a9c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0155010 tx=0x7fb8d001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678753d8ad07b885 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:08.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.794+0000 7fb8dfe00640 1 -- 172.21.15.29:0/736991524 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d00ab680 con 0x7fb8e006be20 2024-01-24T13:06:08.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.794+0000 7fb8dfe00640 1 -- 172.21.15.29:0/736991524 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d00ab7e0 con 0x7fb8e006be20 2024-01-24T13:06:08.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.794+0000 7fb8dfe00640 1 -- 172.21.15.29:0/736991524 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d00abb70 con 0x7fb8e006be20 2024-01-24T13:06:08.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.794+0000 7fb8e8200640 1 -- 172.21.15.29:0/736991524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8e006be20 msgr2=0x7fb8e015a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.794+0000 7fb8e8200640 1 --2- 172.21.15.29:0/736991524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8e006be20 0x7fb8e015a9c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0155010 tx=0x7fb8d001c420 comp rx=0 tx=0).stop 2024-01-24T13:06:08.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.794+0000 7fb8e8200640 1 -- 172.21.15.29:0/736991524 shutdown_connections 2024-01-24T13:06:08.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.794+0000 7fb8e8200640 1 --2- 172.21.15.29:0/736991524 >> v2:172.21.15.163:3300/0 conn(0x7fb8e013d4b0 0x7fb8e015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.794+0000 7fb8e8200640 1 --2- 172.21.15.29:0/736991524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8e006be20 0x7fb8e015a9c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.794+0000 7fb8e8200640 1 -- 172.21.15.29:0/736991524 >> 172.21.15.29:0/736991524 conn(0x7fb8e006d700 msgr2=0x7fb8e0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:08.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.794+0000 7fb8e8200640 1 -- 172.21.15.29:0/736991524 shutdown_connections 2024-01-24T13:06:08.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.794+0000 7fb8e8200640 1 -- 172.21.15.29:0/736991524 wait complete. 2024-01-24T13:06:08.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e8200640 1 Processor -- start 2024-01-24T13:06:08.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e8200640 1 -- start start 2024-01-24T13:06:08.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e8200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8e006be20 0x7fb8e0148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e8200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8e006c200 0x7fb8e00ac320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e8200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8e013d4b0 0x7fb8e01f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e8200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e00ab8d0 con 0x7fb8e013d4b0 2024-01-24T13:06:08.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e8200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e01f5590 con 0x7fb8e006be20 2024-01-24T13:06:08.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e8200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e01f5870 con 0x7fb8e006c200 2024-01-24T13:06:08.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e6200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8e013d4b0 0x7fb8e01f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e6200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8e013d4b0 0x7fb8e01f4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51966/0 (socket says 172.21.15.29:51966) 2024-01-24T13:06:08.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e6200640 1 -- 172.21.15.29:0/1591896600 learned_addr learned my addr 172.21.15.29:0/1591896600 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:08.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e5800640 1 --2- 172.21.15.29:0/1591896600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8e006be20 0x7fb8e0148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e4e00640 1 --2- 172.21.15.29:0/1591896600 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8e006c200 0x7fb8e00ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e6200640 1 -- 172.21.15.29:0/1591896600 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8e006c200 msgr2=0x7fb8e00ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e6200640 1 --2- 172.21.15.29:0/1591896600 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8e006c200 0x7fb8e00ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e6200640 1 -- 172.21.15.29:0/1591896600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8e006be20 msgr2=0x7fb8e0148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e6200640 1 --2- 172.21.15.29:0/1591896600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8e006be20 0x7fb8e0148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e6200640 1 -- 172.21.15.29:0/1591896600 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d0009420 con 0x7fb8e013d4b0 2024-01-24T13:06:08.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e6200640 1 --2- 172.21.15.29:0/1591896600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8e013d4b0 0x7fb8e01f4a20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800cd80 tx=0x7fb8d800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:08.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8dd600640 1 -- 172.21.15.29:0/1591896600 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d800f680 con 0x7fb8e013d4b0 2024-01-24T13:06:08.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8dd600640 1 -- 172.21.15.29:0/1591896600 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d800f800 con 0x7fb8e013d4b0 2024-01-24T13:06:08.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8dd600640 1 -- 172.21.15.29:0/1591896600 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d800fbb0 con 0x7fb8e013d4b0 2024-01-24T13:06:08.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e8200640 1 -- 172.21.15.29:0/1591896600 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e00abb20 con 0x7fb8e013d4b0 2024-01-24T13:06:08.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.798+0000 7fb8e8200640 1 -- 172.21.15.29:0/1591896600 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e00ad170 con 0x7fb8e013d4b0 2024-01-24T13:06:08.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.802+0000 7fb8e8200640 1 -- 172.21.15.29:0/1591896600 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e004e850 con 0x7fb8e013d4b0 2024-01-24T13:06:08.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.802+0000 7fb8dd600640 1 -- 172.21.15.29:0/1591896600 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb8d800b040 con 0x7fb8e013d4b0 2024-01-24T13:06:08.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.802+0000 7fb8dd600640 1 --2- 172.21.15.29:0/1591896600 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb8b8065a90 0x7fb8b8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:08.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.802+0000 7fb8dd600640 1 -- 172.21.15.29:0/1591896600 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fb8d8083d30 con 0x7fb8e013d4b0 2024-01-24T13:06:08.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.802+0000 7fb8e5800640 1 --2- 172.21.15.29:0/1591896600 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb8b8065a90 0x7fb8b8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:08.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.802+0000 7fb8e5800640 1 --2- 172.21.15.29:0/1591896600 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb8b8065a90 0x7fb8b8067f50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00af000 tx=0x7fb8d00a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:08.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.806+0000 7fb8dd600640 1 -- 172.21.15.29:0/1591896600 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb8d80513e0 con 0x7fb8e013d4b0 2024-01-24T13:06:08.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.962+0000 7fb8e8200640 1 -- 172.21.15.29:0/1591896600 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8e00cc9b0 con 0x7fb8e013d4b0 2024-01-24T13:06:08.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.962+0000 7fb8dd600640 1 -- 172.21.15.29:0/1591896600 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8d8054a00 con 0x7fb8e013d4b0 2024-01-24T13:06:08.968 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:06:08.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.966+0000 7fb8e8200640 1 -- 172.21.15.29:0/1591896600 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb8b8065a90 msgr2=0x7fb8b8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.966+0000 7fb8e8200640 1 --2- 172.21.15.29:0/1591896600 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb8b8065a90 0x7fb8b8067f50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00af000 tx=0x7fb8d00a7000 comp rx=0 tx=0).stop 2024-01-24T13:06:08.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.966+0000 7fb8e8200640 1 -- 172.21.15.29:0/1591896600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8e013d4b0 msgr2=0x7fb8e01f4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:08.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.966+0000 7fb8e8200640 1 --2- 172.21.15.29:0/1591896600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8e013d4b0 0x7fb8e01f4a20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800cd80 tx=0x7fb8d800a650 comp rx=0 tx=0).stop 2024-01-24T13:06:08.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.966+0000 7fb8e8200640 1 -- 172.21.15.29:0/1591896600 shutdown_connections 2024-01-24T13:06:08.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.966+0000 7fb8e8200640 1 --2- 172.21.15.29:0/1591896600 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb8b8065a90 0x7fb8b8067f50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.966+0000 7fb8e8200640 1 --2- 172.21.15.29:0/1591896600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8e013d4b0 0x7fb8e01f4a20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.966+0000 7fb8e8200640 1 --2- 172.21.15.29:0/1591896600 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8e006c200 0x7fb8e00ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.966+0000 7fb8e8200640 1 --2- 172.21.15.29:0/1591896600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8e006be20 0x7fb8e0148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:08.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.966+0000 7fb8e8200640 1 -- 172.21.15.29:0/1591896600 >> 172.21.15.29:0/1591896600 conn(0x7fb8e006d700 msgr2=0x7fb8e00b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:08.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.966+0000 7fb8e8200640 1 -- 172.21.15.29:0/1591896600 shutdown_connections 2024-01-24T13:06:08.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:08.966+0000 7fb8e8200640 1 -- 172.21.15.29:0/1591896600 wait complete. 2024-01-24T13:06:08.991 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-01-24T13:06:09.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.130+0000 7ff2bbc00640 1 Processor -- start 2024-01-24T13:06:09.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.130+0000 7ff2bbc00640 1 -- start start 2024-01-24T13:06:09.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.130+0000 7ff2bbc00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff2b40cd300 0x7ff2b415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:09.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.130+0000 7ff2bbc00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff2b40ce4e0 0x7ff2b40d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:09.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.130+0000 7ff2bbc00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b4161130 con 0x7ff2b40ce050 2024-01-24T13:06:09.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.130+0000 7ff2bbc00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b415dbe0 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.130+0000 7ff2bbc00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b41605b0 con 0x7ff2b40cd300 2024-01-24T13:06:09.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.130+0000 7ff2b9c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff2b40ce4e0 0x7ff2b40d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:09.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.134+0000 7ff2b9c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff2b40ce4e0 0x7ff2b40d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51978/0 (socket says 172.21.15.29:51978) 2024-01-24T13:06:09.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.134+0000 7ff2b9c00640 1 -- 172.21.15.29:0/2016485187 learned_addr learned my addr 172.21.15.29:0/2016485187 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:09.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.134+0000 7ff2b3e00640 1 --1- 172.21.15.29:0/2016485187 >> v1:172.21.15.29:6789/0 conn(0x7ff2b40ce050 0x7ff2b40d0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45214/0 (socket says 172.21.15.29:45214) 2024-01-24T13:06:09.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.134+0000 7ff2b9200640 1 --2- 172.21.15.29:0/2016485187 >> v2:172.21.15.163:3300/0 conn(0x7ff2b40cd300 0x7ff2b415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:09.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.134+0000 7ff2b9c00640 1 -- 172.21.15.29:0/2016485187 >> v2:172.21.15.163:3300/0 conn(0x7ff2b40cd300 msgr2=0x7ff2b415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:09.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.134+0000 7ff2b9c00640 1 --2- 172.21.15.29:0/2016485187 >> v2:172.21.15.163:3300/0 conn(0x7ff2b40cd300 0x7ff2b415d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.134+0000 7ff2b9c00640 1 -- 172.21.15.29:0/2016485187 >> v1:172.21.15.29:6789/0 conn(0x7ff2b40ce050 legacy=0x7ff2b40d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:09.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.134+0000 7ff2b9c00640 1 -- 172.21.15.29:0/2016485187 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b4160890 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.134+0000 7ff2b9200640 1 --2- 172.21.15.29:0/2016485187 >> v2:172.21.15.163:3300/0 conn(0x7ff2b40cd300 0x7ff2b415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:09.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.134+0000 7ff2b9c00640 1 --2- 172.21.15.29:0/2016485187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2b40ce4e0 0x7ff2b40d0b20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40cec60 tx=0x7ff2ac01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b6be97085dbb05 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:09.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.134+0000 7ff2b3400640 1 -- 172.21.15.29:0/2016485187 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0a5890 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.134+0000 7ff2b3400640 1 -- 172.21.15.29:0/2016485187 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac0a59f0 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.134+0000 7ff2b3400640 1 -- 172.21.15.29:0/2016485187 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0a5d80 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 -- 172.21.15.29:0/2016485187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2b40ce4e0 msgr2=0x7ff2b40d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:09.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 --2- 172.21.15.29:0/2016485187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2b40ce4e0 0x7ff2b40d0b20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40cec60 tx=0x7ff2ac01c9d0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 -- 172.21.15.29:0/2016485187 shutdown_connections 2024-01-24T13:06:09.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 --2- 172.21.15.29:0/2016485187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2b40ce4e0 0x7ff2b40d0b20 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 --2- 172.21.15.29:0/2016485187 >> v2:172.21.15.163:3300/0 conn(0x7ff2b40cd300 0x7ff2b415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 -- 172.21.15.29:0/2016485187 >> 172.21.15.29:0/2016485187 conn(0x7ff2b4069cd0 msgr2=0x7ff2b406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:09.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 -- 172.21.15.29:0/2016485187 shutdown_connections 2024-01-24T13:06:09.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 -- 172.21.15.29:0/2016485187 wait complete. 2024-01-24T13:06:09.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 Processor -- start 2024-01-24T13:06:09.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 -- start start 2024-01-24T13:06:09.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b40cd300 0x7ff2b4152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:09.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2b40ce050 0x7ff2b414c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:09.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2b40ce4e0 0x7ff2b4155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:09.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b41510b0 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b4152840 con 0x7ff2b40ce050 2024-01-24T13:06:09.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2bbc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b4155210 con 0x7ff2b40cd300 2024-01-24T13:06:09.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2b9c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2b40ce4e0 0x7ff2b4155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:09.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2b9c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2b40ce4e0 0x7ff2b4155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51992/0 (socket says 172.21.15.29:51992) 2024-01-24T13:06:09.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2b9c00640 1 -- 172.21.15.29:0/3964624867 learned_addr learned my addr 172.21.15.29:0/3964624867 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:09.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2b3e00640 1 --2- 172.21.15.29:0/3964624867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2b40ce050 0x7ff2b414c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:09.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.138+0000 7ff2b9200640 1 --2- 172.21.15.29:0/3964624867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b40cd300 0x7ff2b4152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:09.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2b9c00640 1 -- 172.21.15.29:0/3964624867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b40cd300 msgr2=0x7ff2b4152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:09.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2b9c00640 1 --2- 172.21.15.29:0/3964624867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b40cd300 0x7ff2b4152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2b9c00640 1 -- 172.21.15.29:0/3964624867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2b40ce050 msgr2=0x7ff2b414c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:09.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2b9c00640 1 --2- 172.21.15.29:0/3964624867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2b40ce050 0x7ff2b414c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2b9c00640 1 -- 172.21.15.29:0/3964624867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ac009b30 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2b9c00640 1 --2- 172.21.15.29:0/3964624867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2b40ce4e0 0x7ff2b4155ae0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac0af040 tx=0x7ff2ac019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:09.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2b0c00640 1 -- 172.21.15.29:0/3964624867 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0b8670 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2b0c00640 1 -- 172.21.15.29:0/3964624867 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac0b87d0 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2bbc00640 1 -- 172.21.15.29:0/3964624867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b4151300 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2b0c00640 1 -- 172.21.15.29:0/3964624867 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0b8b80 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2bbc00640 1 -- 172.21.15.29:0/3964624867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b41518c0 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2bbc00640 1 -- 172.21.15.29:0/3964624867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b4151ab0 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2b0c00640 1 -- 172.21.15.29:0/3964624867 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff2ac0b8ce0 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2b0c00640 1 --2- 172.21.15.29:0/3964624867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff28c065a60 0x7ff28c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:09.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.142+0000 7ff2b0c00640 1 -- 172.21.15.29:0/3964624867 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7ff2ac11e9c0 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.146+0000 7ff2b9200640 1 --2- 172.21.15.29:0/3964624867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff28c065a60 0x7ff28c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:09.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.146+0000 7ff2b9200640 1 --2- 172.21.15.29:0/3964624867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff28c065a60 0x7ff28c067f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4006e90 tx=0x7ff2a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:09.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.146+0000 7ff2b0c00640 1 -- 172.21.15.29:0/3964624867 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff2ac0ec080 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.302+0000 7ff2bbc00640 1 -- 172.21.15.29:0/3964624867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7ff2b404e850 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.302+0000 7ff2b0c00640 1 -- 172.21.15.29:0/3964624867 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v46) v1 ==== 97+0+11 (secure 0 0 0) 0x7ff2ac0ef6a0 con 0x7ff2b40ce4e0 2024-01-24T13:06:09.308 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:06:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.306+0000 7ff2bbc00640 1 -- 172.21.15.29:0/3964624867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff28c065a60 msgr2=0x7ff28c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.306+0000 7ff2bbc00640 1 --2- 172.21.15.29:0/3964624867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff28c065a60 0x7ff28c067f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4006e90 tx=0x7ff2a4008040 comp rx=0 tx=0).stop 2024-01-24T13:06:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.306+0000 7ff2bbc00640 1 -- 172.21.15.29:0/3964624867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2b40ce4e0 msgr2=0x7ff2b4155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.306+0000 7ff2bbc00640 1 --2- 172.21.15.29:0/3964624867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2b40ce4e0 0x7ff2b4155ae0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac0af040 tx=0x7ff2ac019770 comp rx=0 tx=0).stop 2024-01-24T13:06:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.306+0000 7ff2bbc00640 1 -- 172.21.15.29:0/3964624867 shutdown_connections 2024-01-24T13:06:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.306+0000 7ff2bbc00640 1 --2- 172.21.15.29:0/3964624867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff28c065a60 0x7ff28c067f20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.306+0000 7ff2bbc00640 1 --2- 172.21.15.29:0/3964624867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2b40ce4e0 0x7ff2b4155ae0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.306+0000 7ff2bbc00640 1 --2- 172.21.15.29:0/3964624867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2b40ce050 0x7ff2b414c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.306+0000 7ff2bbc00640 1 --2- 172.21.15.29:0/3964624867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2b40cd300 0x7ff2b4152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.306+0000 7ff2bbc00640 1 -- 172.21.15.29:0/3964624867 >> 172.21.15.29:0/3964624867 conn(0x7ff2b4069cd0 msgr2=0x7ff2b4152af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:09.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.306+0000 7ff2bbc00640 1 -- 172.21.15.29:0/3964624867 shutdown_connections 2024-01-24T13:06:09.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.306+0000 7ff2bbc00640 1 -- 172.21.15.29:0/3964624867 wait complete. 2024-01-24T13:06:09.330 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:06:09.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.466+0000 7f9f04a00640 1 Processor -- start 2024-01-24T13:06:09.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.466+0000 7f9f04a00640 1 -- start start 2024-01-24T13:06:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.470+0000 7f9f04a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9efc0cd540 0x7f9efc15b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.470+0000 7f9f04a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9efc15b8b0 0x7f9efc0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.470+0000 7f9f04a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9efc15e920 con 0x7f9efc0cd160 2024-01-24T13:06:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.470+0000 7f9f04a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9efc15ec00 con 0x7f9efc0cd540 2024-01-24T13:06:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.470+0000 7f9f04a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc15eee0 con 0x7f9efc15b8b0 2024-01-24T13:06:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.470+0000 7f9f01600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9efc0cd540 0x7f9efc15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.470+0000 7f9f02a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9efc15b8b0 0x7f9efc0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.470+0000 7f9f01600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9efc0cd540 0x7f9efc15b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:50984/0 (socket says 172.21.15.29:50984) 2024-01-24T13:06:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.470+0000 7f9f01600640 1 -- 172.21.15.29:0/2002925226 learned_addr learned my addr 172.21.15.29:0/2002925226 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.470+0000 7f9f02000640 1 --1- 172.21.15.29:0/2002925226 >> v1:172.21.15.163:6789/0 conn(0x7f9efc0cd160 0x7f9efc15e0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:35114/0 (socket says 172.21.15.29:35114) 2024-01-24T13:06:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.470+0000 7f9f01600640 1 -- 172.21.15.29:0/2002925226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9efc15b8b0 msgr2=0x7f9efc0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.470+0000 7f9f01600640 1 --2- 172.21.15.29:0/2002925226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9efc15b8b0 0x7f9efc0cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.470+0000 7f9f01600640 1 -- 172.21.15.29:0/2002925226 >> v1:172.21.15.163:6789/0 conn(0x7f9efc0cd160 legacy=0x7f9efc15e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.470+0000 7f9f01600640 1 -- 172.21.15.29:0/2002925226 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc15ae50 con 0x7f9efc0cd540 2024-01-24T13:06:09.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.474+0000 7f9f01600640 1 --2- 172.21.15.29:0/2002925226 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9efc0cd540 0x7f9efc15b370 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009870 tx=0x7f9ee401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c35f41ecb8486cc1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:09.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.474+0000 7f9f00c00640 1 -- 172.21.15.29:0/2002925226 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee40ab600 con 0x7f9efc0cd540 2024-01-24T13:06:09.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.474+0000 7f9f00c00640 1 -- 172.21.15.29:0/2002925226 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee40a7050 con 0x7f9efc0cd540 2024-01-24T13:06:09.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.474+0000 7f9f00c00640 1 -- 172.21.15.29:0/2002925226 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee40ab980 con 0x7f9efc0cd540 2024-01-24T13:06:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.474+0000 7f9f04a00640 1 -- 172.21.15.29:0/2002925226 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9efc0cd540 msgr2=0x7f9efc15b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.474+0000 7f9f04a00640 1 --2- 172.21.15.29:0/2002925226 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9efc0cd540 0x7f9efc15b370 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009870 tx=0x7f9ee401c540 comp rx=0 tx=0).stop 2024-01-24T13:06:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.474+0000 7f9f04a00640 1 -- 172.21.15.29:0/2002925226 shutdown_connections 2024-01-24T13:06:09.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.474+0000 7f9f04a00640 1 --2- 172.21.15.29:0/2002925226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9efc15b8b0 0x7f9efc0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.474+0000 7f9f04a00640 1 --2- 172.21.15.29:0/2002925226 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9efc0cd540 0x7f9efc15b370 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.474+0000 7f9f04a00640 1 -- 172.21.15.29:0/2002925226 >> 172.21.15.29:0/2002925226 conn(0x7f9efc069cd0 msgr2=0x7f9efc06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:09.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.474+0000 7f9f04a00640 1 -- 172.21.15.29:0/2002925226 shutdown_connections 2024-01-24T13:06:09.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.474+0000 7f9f04a00640 1 -- 172.21.15.29:0/2002925226 wait complete. 2024-01-24T13:06:09.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f04a00640 1 Processor -- start 2024-01-24T13:06:09.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f04a00640 1 -- start start 2024-01-24T13:06:09.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f04a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc0cd160 0x7f9efc152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:09.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f04a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9efc0cd540 0x7f9efc1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:09.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f04a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9efc159b10 0x7f9efc06af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:09.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f04a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc159fa0 con 0x7f9efc0cd160 2024-01-24T13:06:09.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f04a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc06bca0 con 0x7f9efc0cd540 2024-01-24T13:06:09.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f04a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc06bf80 con 0x7f9efc159b10 2024-01-24T13:06:09.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f02000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc0cd160 0x7f9efc152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:09.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f02000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc0cd160 0x7f9efc152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52004/0 (socket says 172.21.15.29:52004) 2024-01-24T13:06:09.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f02000640 1 -- 172.21.15.29:0/886118754 learned_addr learned my addr 172.21.15.29:0/886118754 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f02a00640 1 --2- 172.21.15.29:0/886118754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9efc159b10 0x7f9efc06af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f01600640 1 --2- 172.21.15.29:0/886118754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9efc0cd540 0x7f9efc1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f02000640 1 -- 172.21.15.29:0/886118754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9efc159b10 msgr2=0x7f9efc06af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f02000640 1 --2- 172.21.15.29:0/886118754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9efc159b10 0x7f9efc06af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f02000640 1 -- 172.21.15.29:0/886118754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9efc0cd540 msgr2=0x7f9efc1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f02000640 1 --2- 172.21.15.29:0/886118754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9efc0cd540 0x7f9efc1595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f02000640 1 -- 172.21.15.29:0/886118754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40094d0 con 0x7f9efc0cd160 2024-01-24T13:06:09.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f02000640 1 --2- 172.21.15.29:0/886118754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc0cd160 0x7f9efc152fe0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00c490 tx=0x7f9eec00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:09.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9efa000640 1 -- 172.21.15.29:0/886118754 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec007480 con 0x7f9efc0cd160 2024-01-24T13:06:09.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9efa000640 1 -- 172.21.15.29:0/886118754 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec0075e0 con 0x7f9efc0cd160 2024-01-24T13:06:09.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f04a00640 1 -- 172.21.15.29:0/886118754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9efc06c260 con 0x7f9efc0cd160 2024-01-24T13:06:09.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9efa000640 1 -- 172.21.15.29:0/886118754 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec004a10 con 0x7f9efc0cd160 2024-01-24T13:06:09.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f04a00640 1 -- 172.21.15.29:0/886118754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9efc06c820 con 0x7f9efc0cd160 2024-01-24T13:06:09.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.478+0000 7f9f04a00640 1 -- 172.21.15.29:0/886118754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9efc06ca10 con 0x7f9efc0cd160 2024-01-24T13:06:09.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.482+0000 7f9efa000640 1 -- 172.21.15.29:0/886118754 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9eec004b70 con 0x7f9efc0cd160 2024-01-24T13:06:09.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.482+0000 7f9efa000640 1 --2- 172.21.15.29:0/886118754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9ed4065a90 0x7f9ed4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:09.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.482+0000 7f9efa000640 1 -- 172.21.15.29:0/886118754 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f9eec082890 con 0x7f9efc0cd160 2024-01-24T13:06:09.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.482+0000 7f9f01600640 1 --2- 172.21.15.29:0/886118754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9ed4065a90 0x7f9ed4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:09.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.482+0000 7f9f01600640 1 --2- 172.21.15.29:0/886118754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9ed4065a90 0x7f9ed4067f50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40ad000 tx=0x7f9ee4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:09.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.486+0000 7f9efa000640 1 -- 172.21.15.29:0/886118754 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9eec04ffd0 con 0x7f9efc0cd160 2024-01-24T13:06:09.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.658+0000 7f9f04a00640 1 -- 172.21.15.29:0/886118754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9efc04e850 con 0x7f9efc0cd160 2024-01-24T13:06:09.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.658+0000 7f9efa000640 1 -- 172.21.15.29:0/886118754 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9eec0535f0 con 0x7f9efc0cd160 2024-01-24T13:06:09.664 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:06:09.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.662+0000 7f9f04a00640 1 -- 172.21.15.29:0/886118754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9ed4065a90 msgr2=0x7f9ed4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:09.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.662+0000 7f9f04a00640 1 --2- 172.21.15.29:0/886118754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9ed4065a90 0x7f9ed4067f50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40ad000 tx=0x7f9ee4008040 comp rx=0 tx=0).stop 2024-01-24T13:06:09.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.662+0000 7f9f04a00640 1 -- 172.21.15.29:0/886118754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc0cd160 msgr2=0x7f9efc152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:09.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.662+0000 7f9f04a00640 1 --2- 172.21.15.29:0/886118754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc0cd160 0x7f9efc152fe0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00c490 tx=0x7f9eec00c950 comp rx=0 tx=0).stop 2024-01-24T13:06:09.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.662+0000 7f9f04a00640 1 -- 172.21.15.29:0/886118754 shutdown_connections 2024-01-24T13:06:09.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.662+0000 7f9f04a00640 1 --2- 172.21.15.29:0/886118754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9ed4065a90 0x7f9ed4067f50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.662+0000 7f9f04a00640 1 --2- 172.21.15.29:0/886118754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9efc159b10 0x7f9efc06af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.662+0000 7f9f04a00640 1 --2- 172.21.15.29:0/886118754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9efc0cd540 0x7f9efc1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.662+0000 7f9f04a00640 1 --2- 172.21.15.29:0/886118754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc0cd160 0x7f9efc152fe0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:09.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.662+0000 7f9f04a00640 1 -- 172.21.15.29:0/886118754 >> 172.21.15.29:0/886118754 conn(0x7f9efc069cd0 msgr2=0x7f9efc14e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:09.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.662+0000 7f9f04a00640 1 -- 172.21.15.29:0/886118754 shutdown_connections 2024-01-24T13:06:09.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:09.662+0000 7f9f04a00640 1 -- 172.21.15.29:0/886118754 wait complete. 2024-01-24T13:06:09.685 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-01-24T13:06:09.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:09.685 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:09.704 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[38127]: fuse finished with error 0 and tester_r 0 2024-01-24T13:06:09.706 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:06:15.807 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:06:15.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:15.808 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-24T13:06:15.819 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-01-24T13:06:16.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.014+0000 7fcea8400640 1 Processor -- start 2024-01-24T13:06:16.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.014+0000 7fcea8400640 1 -- start start 2024-01-24T13:06:16.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.018+0000 7fcea8400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcea00ce5b0 0x7fcea00b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:16.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.018+0000 7fcea8400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcea00b3360 0x7fcea00b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:16.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.018+0000 7fcea8400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea0160fc0 con 0x7fcea015c690 2024-01-24T13:06:16.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.018+0000 7fcea8400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea00b2ef0 con 0x7fcea00b3360 2024-01-24T13:06:16.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.018+0000 7fcea8400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea01603f0 con 0x7fcea00ce5b0 2024-01-24T13:06:16.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.018+0000 7fcea6400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcea00b3360 0x7fcea00b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:16.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.018+0000 7fcea5000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcea00ce5b0 0x7fcea00b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:16.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.018+0000 7fcea6400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcea00b3360 0x7fcea00b1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:55098/0 (socket says 172.21.15.29:55098) 2024-01-24T13:06:16.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.018+0000 7fcea5a00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fcea015c690 0x7fcea00cdea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:34804/0 (socket says 172.21.15.29:34804) 2024-01-24T13:06:16.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.018+0000 7fcea6400640 1 -- 172.21.15.29:0/190612435 learned_addr learned my addr 172.21.15.29:0/190612435 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:16.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.018+0000 7fcea6400640 1 -- 172.21.15.29:0/190612435 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcea00ce5b0 msgr2=0x7fcea00b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:16.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.018+0000 7fcea6400640 1 --2- 172.21.15.29:0/190612435 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcea00ce5b0 0x7fcea00b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:16.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.018+0000 7fcea6400640 1 -- 172.21.15.29:0/190612435 >> v1:172.21.15.163:6789/0 conn(0x7fcea015c690 legacy=0x7fcea00cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:16.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.018+0000 7fcea6400640 1 -- 172.21.15.29:0/190612435 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea0160690 con 0x7fcea00b3360 2024-01-24T13:06:16.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.022+0000 7fcea6400640 1 --2- 172.21.15.29:0/190612435 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcea00b3360 0x7fcea00b1be0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fce98009e50 tx=0x7fce9801ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e2f1aa0943fdf38 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:16.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.022+0000 7fce9fe00640 1 -- 172.21.15.29:0/190612435 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce980a58e0 con 0x7fcea00b3360 2024-01-24T13:06:16.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.022+0000 7fce9fe00640 1 -- 172.21.15.29:0/190612435 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce980a5a40 con 0x7fcea00b3360 2024-01-24T13:06:16.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.022+0000 7fce9fe00640 1 -- 172.21.15.29:0/190612435 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce980a5dd0 con 0x7fcea00b3360 2024-01-24T13:06:16.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.022+0000 7fcea8400640 1 -- 172.21.15.29:0/190612435 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcea00b3360 msgr2=0x7fcea00b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:16.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.022+0000 7fcea8400640 1 --2- 172.21.15.29:0/190612435 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcea00b3360 0x7fcea00b1be0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fce98009e50 tx=0x7fce9801ca10 comp rx=0 tx=0).stop 2024-01-24T13:06:16.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.022+0000 7fcea8400640 1 -- 172.21.15.29:0/190612435 shutdown_connections 2024-01-24T13:06:16.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.022+0000 7fcea8400640 1 --2- 172.21.15.29:0/190612435 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcea00b3360 0x7fcea00b1be0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:16.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.022+0000 7fcea8400640 1 --2- 172.21.15.29:0/190612435 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcea00ce5b0 0x7fcea00b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:16.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.022+0000 7fcea8400640 1 -- 172.21.15.29:0/190612435 >> 172.21.15.29:0/190612435 conn(0x7fcea006d700 msgr2=0x7fcea0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:16.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.022+0000 7fcea8400640 1 -- 172.21.15.29:0/190612435 shutdown_connections 2024-01-24T13:06:16.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.022+0000 7fcea8400640 1 -- 172.21.15.29:0/190612435 wait complete. 2024-01-24T13:06:16.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.022+0000 7fcea8400640 1 Processor -- start 2024-01-24T13:06:16.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.022+0000 7fcea8400640 1 -- start start 2024-01-24T13:06:16.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea8400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcea00b3360 0x7fcea015b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:16.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea8400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcea00ce5b0 0x7fcea0151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:16.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea8400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcea015c690 0x7fcea0070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:16.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea8400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea0149800 con 0x7fcea00b3360 2024-01-24T13:06:16.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea8400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea015cd90 con 0x7fcea015c690 2024-01-24T13:06:16.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea8400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea015d070 con 0x7fcea00ce5b0 2024-01-24T13:06:16.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea5a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcea00b3360 0x7fcea015b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:16.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea5a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcea00b3360 0x7fcea015b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33438/0 (socket says 172.21.15.29:33438) 2024-01-24T13:06:16.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea5a00640 1 -- 172.21.15.29:0/1828247724 learned_addr learned my addr 172.21.15.29:0/1828247724 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:16.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea6400640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcea015c690 0x7fcea0070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:16.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea5000640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcea00ce5b0 0x7fcea0151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea5a00640 1 -- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcea00ce5b0 msgr2=0x7fcea0151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea5a00640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcea00ce5b0 0x7fcea0151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea5a00640 1 -- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcea015c690 msgr2=0x7fcea0070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea5a00640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcea015c690 0x7fcea0070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea5a00640 1 -- 172.21.15.29:0/1828247724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98009b30 con 0x7fcea00b3360 2024-01-24T13:06:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea6400640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcea015c690 0x7fcea0070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea5a00640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcea00b3360 0x7fcea015b630 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fce9000c370 tx=0x7fce9000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fce9d600640 1 -- 172.21.15.29:0/1828247724 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce900074e0 con 0x7fcea00b3360 2024-01-24T13:06:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fce9d600640 1 -- 172.21.15.29:0/1828247724 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce90007640 con 0x7fcea00b3360 2024-01-24T13:06:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fce9d600640 1 -- 172.21.15.29:0/1828247724 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90004a30 con 0x7fcea00b3360 2024-01-24T13:06:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea8400640 1 -- 172.21.15.29:0/1828247724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea015d350 con 0x7fcea00b3360 2024-01-24T13:06:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea8400640 1 -- 172.21.15.29:0/1828247724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea015d910 con 0x7fcea00b3360 2024-01-24T13:06:16.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.026+0000 7fcea8400640 1 -- 172.21.15.29:0/1828247724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea004e850 con 0x7fcea00b3360 2024-01-24T13:06:16.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.030+0000 7fce9d600640 1 -- 172.21.15.29:0/1828247724 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fce90004b90 con 0x7fcea00b3360 2024-01-24T13:06:16.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.030+0000 7fce9d600640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fce78065a60 0x7fce78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:16.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.030+0000 7fce9d600640 1 -- 172.21.15.29:0/1828247724 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fce90082e50 con 0x7fcea00b3360 2024-01-24T13:06:16.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.030+0000 7fcea5000640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fce78065a60 0x7fce78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:16.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.030+0000 7fcea5000640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fce78065a60 0x7fce78067f20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcea014ff90 tx=0x7fce88009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:16.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.034+0000 7fce9d600640 1 -- 172.21.15.29:0/1828247724 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fce90050470 con 0x7fcea00b3360 2024-01-24T13:06:16.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.246+0000 7fcea8400640 1 -- 172.21.15.29:0/1828247724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fcea0155a40 con 0x7fcea00b3360 2024-01-24T13:06:16.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.250+0000 7fce9d600640 1 -- 172.21.15.29:0/1828247724 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7fce90053a90 con 0x7fcea00b3360 2024-01-24T13:06:16.254 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2024-01-24T13:06:16.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.250+0000 7fcea8400640 1 -- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fce78065a60 msgr2=0x7fce78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:16.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.250+0000 7fcea8400640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fce78065a60 0x7fce78067f20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcea014ff90 tx=0x7fce88009190 comp rx=0 tx=0).stop 2024-01-24T13:06:16.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.250+0000 7fcea8400640 1 -- 172.21.15.29:0/1828247724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcea00b3360 msgr2=0x7fcea015b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:16.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.250+0000 7fcea8400640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcea00b3360 0x7fcea015b630 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fce9000c370 tx=0x7fce9000c830 comp rx=0 tx=0).stop 2024-01-24T13:06:16.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.250+0000 7fcea8400640 1 -- 172.21.15.29:0/1828247724 shutdown_connections 2024-01-24T13:06:16.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.250+0000 7fcea8400640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fce78065a60 0x7fce78067f20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:16.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.250+0000 7fcea8400640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcea015c690 0x7fcea0070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:16.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.250+0000 7fcea8400640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcea00ce5b0 0x7fcea0151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:16.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.250+0000 7fcea8400640 1 --2- 172.21.15.29:0/1828247724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcea00b3360 0x7fcea015b630 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:16.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.250+0000 7fcea8400640 1 -- 172.21.15.29:0/1828247724 >> 172.21.15.29:0/1828247724 conn(0x7fcea006d700 msgr2=0x7fcea0154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:16.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.254+0000 7fcea8400640 1 -- 172.21.15.29:0/1828247724 shutdown_connections 2024-01-24T13:06:16.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.254+0000 7fcea8400640 1 -- 172.21.15.29:0/1828247724 wait complete. 2024-01-24T13:06:16.276 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-24T13:06:16.276 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-24T13:06:16.355 DEBUG:teuthology.orchestra.run.smithi163:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-24T13:06:16.425 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-24T13:06:16.426 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:06:16.426 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:06:16.435 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357740k,nr_inodes=4089435,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4625 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275996k,nr_inodes=818999,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-24T13:06:16.435 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:06:16.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:16.435 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-24T13:06:16.483 INFO:teuthology.orchestra.run.smithi029.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-01-24T13:06:16.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:06:16.485 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:06:16.485 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:06:16.494 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5116 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-24T13:06:16.495 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:06:16.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:16.495 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-24T13:06:16.546 INFO:teuthology.orchestra.run.smithi163.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-01-24T13:06:16.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:06:16.547 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:06:16.547 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:06:16.556 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357740k,nr_inodes=4089435,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4625 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275996k,nr_inodes=818999,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-24T13:06:16.556 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:06:16.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:16.556 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-01-24T13:06:16.607 INFO:teuthology.orchestra.run.smithi029.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-01-24T13:06:16.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:06:16.609 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:06:16.609 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:06:16.618 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5116 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-24T13:06:16.618 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:06:16.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:16.618 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-01-24T13:06:16.669 INFO:teuthology.orchestra.run.smithi163.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-01-24T13:06:16.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:06:16.671 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:06:16.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb15800640 1 Processor -- start 2024-01-24T13:06:16.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb15800640 1 -- start start 2024-01-24T13:06:16.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb15800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb1015c770 0x7fcb1006d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:16.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb15800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcb100cfe80 0x7fcb100cce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:16.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb15800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1015cb50 con 0x7fcb100cedc0 2024-01-24T13:06:16.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb15800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb10070d10 con 0x7fcb100cfe80 2024-01-24T13:06:16.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb15800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb10070f20 con 0x7fcb1015c770 2024-01-24T13:06:16.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb0e000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcb100cedc0 0x7fcb100cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44694/0 (socket says 172.21.15.29:44694) 2024-01-24T13:06:16.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb0e000640 1 -- 172.21.15.29:0/2637547709 learned_addr learned my addr 172.21.15.29:0/2637547709 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:16.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb0ea00640 1 --2- 172.21.15.29:0/2637547709 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb1015c770 0x7fcb1006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:16.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb0f400640 1 --2- 172.21.15.29:0/2637547709 >> v2:172.21.15.163:3300/0 conn(0x7fcb100cfe80 0x7fcb100cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:16.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb0d600640 1 -- 172.21.15.29:0/2637547709 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833288747 0 0) 0x7fcb1015cb50 con 0x7fcb100cedc0 2024-01-24T13:06:16.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb0d600640 1 -- 172.21.15.29:0/2637547709 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaf0003530 con 0x7fcb100cedc0 2024-01-24T13:06:16.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb0f400640 1 -- 172.21.15.29:0/2637547709 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb1015c770 msgr2=0x7fcb1006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:16.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb0f400640 1 --2- 172.21.15.29:0/2637547709 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb1015c770 0x7fcb1006d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:16.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb0f400640 1 -- 172.21.15.29:0/2637547709 >> v1:172.21.15.29:6789/0 conn(0x7fcb100cedc0 legacy=0x7fcb100cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:16.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb0f400640 1 -- 172.21.15.29:0/2637547709 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10071200 con 0x7fcb100cfe80 2024-01-24T13:06:16.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.810+0000 7fcb0ea00640 1 --2- 172.21.15.29:0/2637547709 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb1015c770 0x7fcb1006d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:16.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.814+0000 7fcb0f400640 1 --2- 172.21.15.29:0/2637547709 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb100cfe80 0x7fcb100cce80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009d90 tx=0x7fcb0801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7335e7d8e33ace26 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:16.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.814+0000 7fcb0d600640 1 -- 172.21.15.29:0/2637547709 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080a5950 con 0x7fcb100cfe80 2024-01-24T13:06:16.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.814+0000 7fcb0d600640 1 -- 172.21.15.29:0/2637547709 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb080a5ab0 con 0x7fcb100cfe80 2024-01-24T13:06:16.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.814+0000 7fcb0d600640 1 -- 172.21.15.29:0/2637547709 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080a5e40 con 0x7fcb100cfe80 2024-01-24T13:06:16.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.814+0000 7fcb15800640 1 -- 172.21.15.29:0/2637547709 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb100cfe80 msgr2=0x7fcb100cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:16.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.814+0000 7fcb15800640 1 --2- 172.21.15.29:0/2637547709 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb100cfe80 0x7fcb100cce80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009d90 tx=0x7fcb0801c890 comp rx=0 tx=0).stop 2024-01-24T13:06:16.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.814+0000 7fcb15800640 1 -- 172.21.15.29:0/2637547709 shutdown_connections 2024-01-24T13:06:16.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.814+0000 7fcb15800640 1 --2- 172.21.15.29:0/2637547709 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb100cfe80 0x7fcb100cce80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:16.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.814+0000 7fcb15800640 1 --2- 172.21.15.29:0/2637547709 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb1015c770 0x7fcb1006d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:16.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.814+0000 7fcb15800640 1 -- 172.21.15.29:0/2637547709 >> 172.21.15.29:0/2637547709 conn(0x7fcb1006b1e0 msgr2=0x7fcb1006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:16.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb15800640 1 -- 172.21.15.29:0/2637547709 shutdown_connections 2024-01-24T13:06:16.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb15800640 1 -- 172.21.15.29:0/2637547709 wait complete. 2024-01-24T13:06:16.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb15800640 1 Processor -- start 2024-01-24T13:06:16.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb15800640 1 -- start start 2024-01-24T13:06:16.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb15800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb100cedc0 0x7fcb1014f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:16.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb15800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb100cfe80 0x7fcb101377b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:16.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb15800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb1015c770 0x7fcb10148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:16.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb15800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1014f5c0 con 0x7fcb100cfe80 2024-01-24T13:06:16.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb15800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb10150100 con 0x7fcb100cedc0 2024-01-24T13:06:16.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb15800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1014f860 con 0x7fcb1015c770 2024-01-24T13:06:16.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb0e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb100cfe80 0x7fcb101377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:16.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb0e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb100cfe80 0x7fcb101377b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33454/0 (socket says 172.21.15.29:33454) 2024-01-24T13:06:16.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb0e000640 1 -- 172.21.15.29:0/4048526861 learned_addr learned my addr 172.21.15.29:0/4048526861 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:16.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb0ea00640 1 --2- 172.21.15.29:0/4048526861 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb100cedc0 0x7fcb1014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:16.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb0f400640 1 --2- 172.21.15.29:0/4048526861 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb1015c770 0x7fcb10148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:16.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb0e000640 1 -- 172.21.15.29:0/4048526861 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb1015c770 msgr2=0x7fcb10148580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:16.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb0e000640 1 --2- 172.21.15.29:0/4048526861 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb1015c770 0x7fcb10148580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:16.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb0e000640 1 -- 172.21.15.29:0/4048526861 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb100cedc0 msgr2=0x7fcb1014f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:16.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb0e000640 1 --2- 172.21.15.29:0/4048526861 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb100cedc0 0x7fcb1014f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:16.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb0e000640 1 -- 172.21.15.29:0/4048526861 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb00009420 con 0x7fcb100cfe80 2024-01-24T13:06:16.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb0e000640 1 --2- 172.21.15.29:0/4048526861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb100cfe80 0x7fcb101377b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800c420 tx=0x7fcaf800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:16.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb06a00640 1 -- 172.21.15.29:0/4048526861 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8005cf0 con 0x7fcb100cfe80 2024-01-24T13:06:16.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.818+0000 7fcb06a00640 1 -- 172.21.15.29:0/4048526861 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf8005e70 con 0x7fcb100cfe80 2024-01-24T13:06:16.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.822+0000 7fcb15800640 1 -- 172.21.15.29:0/4048526861 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb08009a70 con 0x7fcb100cfe80 2024-01-24T13:06:16.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.822+0000 7fcb06a00640 1 -- 172.21.15.29:0/4048526861 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80072f0 con 0x7fcb100cfe80 2024-01-24T13:06:16.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.822+0000 7fcb15800640 1 -- 172.21.15.29:0/4048526861 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1014fe20 con 0x7fcb100cfe80 2024-01-24T13:06:16.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.822+0000 7fcb15800640 1 -- 172.21.15.29:0/4048526861 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1004e850 con 0x7fcb100cfe80 2024-01-24T13:06:16.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.822+0000 7fcb06a00640 1 -- 172.21.15.29:0/4048526861 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcaf8007490 con 0x7fcb100cfe80 2024-01-24T13:06:16.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.822+0000 7fcb06a00640 1 --2- 172.21.15.29:0/4048526861 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcae8065a60 0x7fcae8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:16.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.822+0000 7fcb06a00640 1 -- 172.21.15.29:0/4048526861 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fcaf8082a50 con 0x7fcb100cfe80 2024-01-24T13:06:16.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.822+0000 7fcb0ea00640 1 --2- 172.21.15.29:0/4048526861 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcae8065a60 0x7fcae8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:16.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.826+0000 7fcb0ea00640 1 --2- 172.21.15.29:0/4048526861 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcae8065a60 0x7fcae8067f20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcb00009c50 tx=0x7fcb00009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:16.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:16.826+0000 7fcb06a00640 1 -- 172.21.15.29:0/4048526861 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fcaf8050250 con 0x7fcb100cfe80 2024-01-24T13:06:17.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.018+0000 7fcb15800640 1 -- 172.21.15.29:0/4048526861 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb100ce3e0 con 0x7fcb100cfe80 2024-01-24T13:06:17.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.018+0000 7fcb06a00640 1 -- 172.21.15.29:0/4048526861 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4739 (secure 0 0 0) 0x7fcaf8017020 con 0x7fcb100cfe80 2024-01-24T13:06:17.024 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:17.025 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3468790539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3468790539},{"type":"v1","addr":"172.21.15.29:6834","nonce":3468790539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3278958688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3278958688},{"type":"v1","addr":"172.21.15.29:6835","nonce":3278958688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/1296970243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1296970243},{"type":"v1","addr":"172.21.15.163:6836","nonce":1296970243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:05:23.206301+0000","modified":"2024-01-24T13:05:36.732142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5463":{"gid":5463,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/140413977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":140413977},{"type":"v1","addr":"172.21.15.163:6837","nonce":140413977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-24T13:06:17.025 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-01-24T13:06:17.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.022+0000 7fcb15800640 1 -- 172.21.15.29:0/4048526861 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcae8065a60 msgr2=0x7fcae8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.022+0000 7fcb15800640 1 --2- 172.21.15.29:0/4048526861 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcae8065a60 0x7fcae8067f20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcb00009c50 tx=0x7fcb00009190 comp rx=0 tx=0).stop 2024-01-24T13:06:17.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.022+0000 7fcb15800640 1 -- 172.21.15.29:0/4048526861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb100cfe80 msgr2=0x7fcb101377b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.022+0000 7fcb15800640 1 --2- 172.21.15.29:0/4048526861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb100cfe80 0x7fcb101377b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800c420 tx=0x7fcaf800c8e0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.022+0000 7fcb15800640 1 -- 172.21.15.29:0/4048526861 shutdown_connections 2024-01-24T13:06:17.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.022+0000 7fcb15800640 1 --2- 172.21.15.29:0/4048526861 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcae8065a60 0x7fcae8067f20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.022+0000 7fcb15800640 1 --2- 172.21.15.29:0/4048526861 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb1015c770 0x7fcb10148580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.022+0000 7fcb15800640 1 --2- 172.21.15.29:0/4048526861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb100cfe80 0x7fcb101377b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.022+0000 7fcb15800640 1 --2- 172.21.15.29:0/4048526861 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb100cedc0 0x7fcb1014f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.022+0000 7fcb15800640 1 -- 172.21.15.29:0/4048526861 >> 172.21.15.29:0/4048526861 conn(0x7fcb1006b1e0 msgr2=0x7fcb100c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:17.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.022+0000 7fcb15800640 1 -- 172.21.15.29:0/4048526861 shutdown_connections 2024-01-24T13:06:17.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.022+0000 7fcb15800640 1 -- 172.21.15.29:0/4048526861 wait complete. 2024-01-24T13:06:17.047 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:06:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.182+0000 7f31a5600640 1 Processor -- start 2024-01-24T13:06:17.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.182+0000 7f31a5600640 1 -- start start 2024-01-24T13:06:17.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.186+0000 7f31a5600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31a0159300 0x7f31a00b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.186+0000 7f31a5600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a015de10 con 0x7f31a015d660 2024-01-24T13:06:17.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.186+0000 7f31a5600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a015db30 con 0x7f31a006bc10 2024-01-24T13:06:17.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.186+0000 7f31a5600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a0071140 con 0x7f31a0159300 2024-01-24T13:06:17.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.186+0000 7f319f400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f31a015d660 0x7f31a00cbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44704/0 (socket says 172.21.15.29:44704) 2024-01-24T13:06:17.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.186+0000 7f319ea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31a0159300 0x7f31a00b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.186+0000 7f319f400640 1 -- 172.21.15.29:0/535149605 learned_addr learned my addr 172.21.15.29:0/535149605 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:17.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.186+0000 7f319d600640 1 -- 172.21.15.29:0/535149605 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069391595 0 0) 0x7f31a015de10 con 0x7f31a015d660 2024-01-24T13:06:17.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.186+0000 7f319d600640 1 -- 172.21.15.29:0/535149605 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3180005740 con 0x7f31a015d660 2024-01-24T13:06:17.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.186+0000 7f319ea00640 1 -- 172.21.15.29:0/535149605 >> v1:172.21.15.163:6789/0 conn(0x7f31a006bc10 legacy=0x7f31a015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.186+0000 7f319ea00640 1 -- 172.21.15.29:0/535149605 >> v1:172.21.15.29:6789/0 conn(0x7f31a015d660 legacy=0x7f31a00cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.186+0000 7f319ea00640 1 -- 172.21.15.29:0/535149605 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a00b1160 con 0x7f31a0159300 2024-01-24T13:06:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.190+0000 7f319ea00640 1 --2- 172.21.15.29:0/535149605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31a0159300 0x7f31a00b1c40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f31900097c0 tx=0x7f319001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0e31883377c6b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:17.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.190+0000 7f319d600640 1 -- 172.21.15.29:0/535149605 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31900ab600 con 0x7f31a0159300 2024-01-24T13:06:17.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.190+0000 7f319d600640 1 -- 172.21.15.29:0/535149605 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31900a7050 con 0x7f31a0159300 2024-01-24T13:06:17.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.190+0000 7f319d600640 1 -- 172.21.15.29:0/535149605 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31900ab980 con 0x7f31a0159300 2024-01-24T13:06:17.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.190+0000 7f31a5600640 1 -- 172.21.15.29:0/535149605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31a0159300 msgr2=0x7f31a00b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.190+0000 7f31a5600640 1 --2- 172.21.15.29:0/535149605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31a0159300 0x7f31a00b1c40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f31900097c0 tx=0x7f319001c3c0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.190+0000 7f31a5600640 1 -- 172.21.15.29:0/535149605 shutdown_connections 2024-01-24T13:06:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.190+0000 7f31a5600640 1 --2- 172.21.15.29:0/535149605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31a0159300 0x7f31a00b1c40 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.190+0000 7f31a5600640 1 -- 172.21.15.29:0/535149605 >> 172.21.15.29:0/535149605 conn(0x7f31a00b3950 msgr2=0x7f31a0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.190+0000 7f31a5600640 1 -- 172.21.15.29:0/535149605 shutdown_connections 2024-01-24T13:06:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.190+0000 7f31a5600640 1 -- 172.21.15.29:0/535149605 wait complete. 2024-01-24T13:06:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.190+0000 7f31a5600640 1 Processor -- start 2024-01-24T13:06:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.190+0000 7f31a5600640 1 -- start start 2024-01-24T13:06:17.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f31a5600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31a006bc10 0x7f31a0149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f31a5600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31a0159300 0x7f31a0145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f31a5600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31a015d660 0x7f31a00ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f31a5600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a00aca50 con 0x7f31a006bc10 2024-01-24T13:06:17.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f31a5600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a00abdd0 con 0x7f31a015d660 2024-01-24T13:06:17.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f31a5600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a00ac0b0 con 0x7f31a0159300 2024-01-24T13:06:17.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f319ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31a006bc10 0x7f31a0149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f319ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31a006bc10 0x7f31a0149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33476/0 (socket says 172.21.15.29:33476) 2024-01-24T13:06:17.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f319ea00640 1 -- 172.21.15.29:0/804211018 learned_addr learned my addr 172.21.15.29:0/804211018 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f319f400640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31a015d660 0x7f31a00ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f319e000640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31a0159300 0x7f31a0145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f319ea00640 1 -- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31a0159300 msgr2=0x7f31a0145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f319ea00640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31a0159300 0x7f31a0145560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f319ea00640 1 -- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31a015d660 msgr2=0x7f31a00ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f319ea00640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31a015d660 0x7f31a00ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f319ea00640 1 -- 172.21.15.29:0/804211018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190009420 con 0x7f31a006bc10 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f319f400640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31a015d660 0x7f31a00ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f319e000640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31a0159300 0x7f31a0145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f319ea00640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31a006bc10 0x7f31a0149dd0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f31900ae040 tx=0x7f319001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f3196a00640 1 -- 172.21.15.29:0/804211018 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31900b7450 con 0x7f31a006bc10 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f3196a00640 1 -- 172.21.15.29:0/804211018 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31900b75b0 con 0x7f31a006bc10 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f3196a00640 1 -- 172.21.15.29:0/804211018 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31900b7960 con 0x7f31a006bc10 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f31a5600640 1 -- 172.21.15.29:0/804211018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a00ac390 con 0x7f31a006bc10 2024-01-24T13:06:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f31a5600640 1 -- 172.21.15.29:0/804211018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a014a310 con 0x7f31a006bc10 2024-01-24T13:06:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f31a5600640 1 -- 172.21.15.29:0/804211018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a004e850 con 0x7f31a006bc10 2024-01-24T13:06:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.194+0000 7f3196a00640 1 -- 172.21.15.29:0/804211018 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f31900b7ac0 con 0x7f31a006bc10 2024-01-24T13:06:17.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.198+0000 7f3196a00640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3178065a60 0x7f3178067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.198+0000 7f3196a00640 1 -- 172.21.15.29:0/804211018 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f319011dc60 con 0x7f31a006bc10 2024-01-24T13:06:17.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.198+0000 7f319e000640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3178065a60 0x7f3178067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.198+0000 7f319e000640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3178065a60 0x7f3178067f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f31a00ce080 tx=0x7f3188009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:17.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.202+0000 7f3196a00640 1 -- 172.21.15.29:0/804211018 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f31900eb380 con 0x7f31a006bc10 2024-01-24T13:06:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.358+0000 7f31a5600640 1 -- 172.21.15.29:0/804211018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31a00ac1f0 con 0x7f31a006bc10 2024-01-24T13:06:17.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.362+0000 7f3196a00640 1 -- 172.21.15.29:0/804211018 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18163 (secure 0 0 0) 0x7f31a00ac1f0 con 0x7f31a006bc10 2024-01-24T13:06:17.364 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:17.365 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":46,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:05:37.734611+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:05:21.225564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-24T13:05:22.188525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-01-24T13:05:35.873766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.6","mappings":[{"from":3,"to":2}]},{"pgid":"6.14","mappings":[{"from":4,"to":2}]},{"pgid":"6.24","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:06:17.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.362+0000 7f31a5600640 1 -- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3178065a60 msgr2=0x7f3178067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.362+0000 7f31a5600640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3178065a60 0x7f3178067f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f31a00ce080 tx=0x7f3188009040 comp rx=0 tx=0).stop 2024-01-24T13:06:17.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.362+0000 7f31a5600640 1 -- 172.21.15.29:0/804211018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31a006bc10 msgr2=0x7f31a0149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.362+0000 7f31a5600640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31a006bc10 0x7f31a0149dd0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f31900ae040 tx=0x7f319001ac00 comp rx=0 tx=0).stop 2024-01-24T13:06:17.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.362+0000 7f31a5600640 1 -- 172.21.15.29:0/804211018 shutdown_connections 2024-01-24T13:06:17.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.362+0000 7f31a5600640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3178065a60 0x7f3178067f20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.362+0000 7f31a5600640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31a015d660 0x7f31a00ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.362+0000 7f31a5600640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f31a0159300 0x7f31a0145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.362+0000 7f31a5600640 1 --2- 172.21.15.29:0/804211018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31a006bc10 0x7f31a0149dd0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.362+0000 7f31a5600640 1 -- 172.21.15.29:0/804211018 >> 172.21.15.29:0/804211018 conn(0x7f31a00b3950 msgr2=0x7f31a014d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:17.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.362+0000 7f31a5600640 1 -- 172.21.15.29:0/804211018 shutdown_connections 2024-01-24T13:06:17.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.362+0000 7f31a5600640 1 -- 172.21.15.29:0/804211018 wait complete. 2024-01-24T13:06:17.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:05:21.225564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:05:22.188525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2024-01-24T13:05:35.873766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:06:17.388 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:06:17.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.526+0000 7f63c7600640 1 Processor -- start 2024-01-24T13:06:17.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.526+0000 7f63c7600640 1 -- start start 2024-01-24T13:06:17.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.530+0000 7f63c7600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f63c00ccd60 0x7f63c00cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.530+0000 7f63c7600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c00cd6d0 con 0x7f63c00ce890 2024-01-24T13:06:17.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.530+0000 7f63c7600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c0160b20 con 0x7f63c00ce4b0 2024-01-24T13:06:17.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.530+0000 7f63c7600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c015ce20 con 0x7f63c00ccd60 2024-01-24T13:06:17.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.530+0000 7f63c5600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f63c00ccd60 0x7f63c00cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.530+0000 7f63bfe00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f63c00ce890 0x7f63c0160410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44710/0 (socket says 172.21.15.29:44710) 2024-01-24T13:06:17.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.530+0000 7f63bfe00640 1 -- 172.21.15.29:0/2977826362 learned_addr learned my addr 172.21.15.29:0/2977826362 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:17.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.530+0000 7f63c5600640 1 -- 172.21.15.29:0/2977826362 >> v1:172.21.15.163:6789/0 conn(0x7f63c00ce4b0 legacy=0x7f63c015d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:17.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.530+0000 7f63c5600640 1 -- 172.21.15.29:0/2977826362 >> v1:172.21.15.29:6789/0 conn(0x7f63c00ce890 legacy=0x7f63c0160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.530+0000 7f63bf400640 1 -- 172.21.15.29:0/2977826362 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018044387 0 0) 0x7f63c00cd6d0 con 0x7f63c00ce890 2024-01-24T13:06:17.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.530+0000 7f63c5600640 1 -- 172.21.15.29:0/2977826362 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0160df0 con 0x7f63c00ccd60 2024-01-24T13:06:17.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.530+0000 7f63c5600640 1 --2- 172.21.15.29:0/2977826362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c00ccd60 0x7f63c00cd190 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009d90 tx=0x7f63b801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8800b4122c5b9a40 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:17.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.534+0000 7f63bf400640 1 -- 172.21.15.29:0/2977826362 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b80a5950 con 0x7f63c00ccd60 2024-01-24T13:06:17.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.534+0000 7f63bf400640 1 -- 172.21.15.29:0/2977826362 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b80a5ab0 con 0x7f63c00ccd60 2024-01-24T13:06:17.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.534+0000 7f63bf400640 1 -- 172.21.15.29:0/2977826362 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b80a5e40 con 0x7f63c00ccd60 2024-01-24T13:06:17.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.534+0000 7f63c7600640 1 -- 172.21.15.29:0/2977826362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c00ccd60 msgr2=0x7f63c00cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.534+0000 7f63c7600640 1 --2- 172.21.15.29:0/2977826362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c00ccd60 0x7f63c00cd190 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009d90 tx=0x7f63b801c890 comp rx=0 tx=0).stop 2024-01-24T13:06:17.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.534+0000 7f63c7600640 1 -- 172.21.15.29:0/2977826362 shutdown_connections 2024-01-24T13:06:17.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.534+0000 7f63c7600640 1 --2- 172.21.15.29:0/2977826362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c00ccd60 0x7f63c00cd190 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.534+0000 7f63c7600640 1 -- 172.21.15.29:0/2977826362 >> 172.21.15.29:0/2977826362 conn(0x7f63c00704f0 msgr2=0x7f63c006e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:17.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.534+0000 7f63c7600640 1 -- 172.21.15.29:0/2977826362 shutdown_connections 2024-01-24T13:06:17.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.534+0000 7f63c7600640 1 -- 172.21.15.29:0/2977826362 wait complete. 2024-01-24T13:06:17.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.534+0000 7f63c7600640 1 Processor -- start 2024-01-24T13:06:17.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.534+0000 7f63c7600640 1 -- start start 2024-01-24T13:06:17.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.534+0000 7f63c7600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63c00ccd60 0x7f63c0150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c7600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c00ce4b0 0x7f63c01f87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c7600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c00ce890 0x7f63c0151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c7600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c015d830 con 0x7f63c00ce890 2024-01-24T13:06:17.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c7600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c01f8cf0 con 0x7f63c00ce4b0 2024-01-24T13:06:17.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c7600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c00ac920 con 0x7f63c00ccd60 2024-01-24T13:06:17.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c5600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c00ce890 0x7f63c0151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c5600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c00ce890 0x7f63c0151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33494/0 (socket says 172.21.15.29:33494) 2024-01-24T13:06:17.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c5600640 1 -- 172.21.15.29:0/1310369823 learned_addr learned my addr 172.21.15.29:0/1310369823 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:17.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63bfe00640 1 --2- 172.21.15.29:0/1310369823 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c00ce4b0 0x7f63c01f87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c4c00640 1 --2- 172.21.15.29:0/1310369823 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63c00ccd60 0x7f63c0150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c5600640 1 -- 172.21.15.29:0/1310369823 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63c00ccd60 msgr2=0x7f63c0150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c5600640 1 --2- 172.21.15.29:0/1310369823 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63c00ccd60 0x7f63c0150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c5600640 1 -- 172.21.15.29:0/1310369823 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c00ce4b0 msgr2=0x7f63c01f87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c5600640 1 --2- 172.21.15.29:0/1310369823 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c00ce4b0 0x7f63c01f87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c5600640 1 -- 172.21.15.29:0/1310369823 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b8009a70 con 0x7f63c00ce890 2024-01-24T13:06:17.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c5600640 1 --2- 172.21.15.29:0/1310369823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c00ce890 0x7f63c0151850 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f63b801a4c0 tx=0x7f63b8019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:17.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63bcc00640 1 -- 172.21.15.29:0/1310369823 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b80ade40 con 0x7f63c00ce890 2024-01-24T13:06:17.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63bcc00640 1 -- 172.21.15.29:0/1310369823 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b80b7410 con 0x7f63c00ce890 2024-01-24T13:06:17.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63bcc00640 1 -- 172.21.15.29:0/1310369823 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b80b77a0 con 0x7f63c00ce890 2024-01-24T13:06:17.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c7600640 1 -- 172.21.15.29:0/1310369823 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c00acc00 con 0x7f63c00ce890 2024-01-24T13:06:17.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c7600640 1 -- 172.21.15.29:0/1310369823 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c00ad1c0 con 0x7f63c00ce890 2024-01-24T13:06:17.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63c7600640 1 -- 172.21.15.29:0/1310369823 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c004e850 con 0x7f63c00ce890 2024-01-24T13:06:17.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.538+0000 7f63bcc00640 1 -- 172.21.15.29:0/1310369823 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f63b80b4050 con 0x7f63c00ce890 2024-01-24T13:06:17.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.542+0000 7f63bcc00640 1 --2- 172.21.15.29:0/1310369823 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6398065a60 0x7f6398067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.542+0000 7f63bcc00640 1 -- 172.21.15.29:0/1310369823 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f63b811e8f0 con 0x7f63c00ce890 2024-01-24T13:06:17.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.542+0000 7f63c4c00640 1 --2- 172.21.15.29:0/1310369823 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6398065a60 0x7f6398067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.542+0000 7f63c4c00640 1 --2- 172.21.15.29:0/1310369823 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6398065a60 0x7f6398067f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f63b0007fd0 tx=0x7f63b0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:17.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.546+0000 7f63bcc00640 1 -- 172.21.15.29:0/1310369823 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f63b80ec210 con 0x7f63c00ce890 2024-01-24T13:06:17.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.702+0000 7f63c7600640 1 -- 172.21.15.29:0/1310369823 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63c00cc7a0 con 0x7f63c00ce890 2024-01-24T13:06:17.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.702+0000 7f63bcc00640 1 -- 172.21.15.29:0/1310369823 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f63b80c7020 con 0x7f63c00ce890 2024-01-24T13:06:17.705 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:06:17.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.702+0000 7f63c7600640 1 -- 172.21.15.29:0/1310369823 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6398065a60 msgr2=0x7f6398067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.702+0000 7f63c7600640 1 --2- 172.21.15.29:0/1310369823 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6398065a60 0x7f6398067f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f63b0007fd0 tx=0x7f63b0009040 comp rx=0 tx=0).stop 2024-01-24T13:06:17.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.702+0000 7f63c7600640 1 -- 172.21.15.29:0/1310369823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c00ce890 msgr2=0x7f63c0151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.702+0000 7f63c7600640 1 --2- 172.21.15.29:0/1310369823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c00ce890 0x7f63c0151850 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f63b801a4c0 tx=0x7f63b8019630 comp rx=0 tx=0).stop 2024-01-24T13:06:17.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.702+0000 7f63c7600640 1 -- 172.21.15.29:0/1310369823 shutdown_connections 2024-01-24T13:06:17.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.702+0000 7f63c7600640 1 --2- 172.21.15.29:0/1310369823 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6398065a60 0x7f6398067f20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.702+0000 7f63c7600640 1 --2- 172.21.15.29:0/1310369823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c00ce890 0x7f63c0151850 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.702+0000 7f63c7600640 1 --2- 172.21.15.29:0/1310369823 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c00ce4b0 0x7f63c01f87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.702+0000 7f63c7600640 1 --2- 172.21.15.29:0/1310369823 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f63c00ccd60 0x7f63c0150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.702+0000 7f63c7600640 1 -- 172.21.15.29:0/1310369823 >> 172.21.15.29:0/1310369823 conn(0x7f63c00704f0 msgr2=0x7f63c006e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:17.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.702+0000 7f63c7600640 1 -- 172.21.15.29:0/1310369823 shutdown_connections 2024-01-24T13:06:17.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.702+0000 7f63c7600640 1 -- 172.21.15.29:0/1310369823 wait complete. 2024-01-24T13:06:17.727 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:06:17.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.866+0000 7f78d3a00640 1 Processor -- start 2024-01-24T13:06:17.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.866+0000 7f78d3a00640 1 -- start start 2024-01-24T13:06:17.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.870+0000 7f78d3a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f78cc1603a0 0x7f78cc0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.870+0000 7f78d3a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78cc070cf0 con 0x7f78cc0cd5b0 2024-01-24T13:06:17.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.870+0000 7f78d3a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78cc15cc10 con 0x7f78cc15c830 2024-01-24T13:06:17.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.870+0000 7f78d3a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78cc160910 con 0x7f78cc1603a0 2024-01-24T13:06:17.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.870+0000 7f78cbe00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f78cc0cd5b0 0x7f78cc0711d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44714/0 (socket says 172.21.15.29:44714) 2024-01-24T13:06:17.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.870+0000 7f78cbe00640 1 -- 172.21.15.29:0/1655584808 learned_addr learned my addr 172.21.15.29:0/1655584808 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:17.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.870+0000 7f78d1a00640 1 --2- 172.21.15.29:0/1655584808 >> v2:172.21.15.163:3300/0 conn(0x7f78cc1603a0 0x7f78cc0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.870+0000 7f78cb400640 1 -- 172.21.15.29:0/1655584808 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875141435 0 0) 0x7f78cc070cf0 con 0x7f78cc0cd5b0 2024-01-24T13:06:17.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.870+0000 7f78cb400640 1 -- 172.21.15.29:0/1655584808 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78ac003530 con 0x7f78cc0cd5b0 2024-01-24T13:06:17.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.870+0000 7f78cb400640 1 -- 172.21.15.29:0/1655584808 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529754234 0 0) 0x7f78cc15cc10 con 0x7f78cc15c830 2024-01-24T13:06:17.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.870+0000 7f78cb400640 1 -- 172.21.15.29:0/1655584808 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78cc070cf0 con 0x7f78cc15c830 2024-01-24T13:06:17.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.870+0000 7f78d1a00640 1 -- 172.21.15.29:0/1655584808 >> v1:172.21.15.163:6789/0 conn(0x7f78cc15c830 legacy=0x7f78cc0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.870+0000 7f78d1a00640 1 -- 172.21.15.29:0/1655584808 >> v1:172.21.15.29:6789/0 conn(0x7f78cc0cd5b0 legacy=0x7f78cc0711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.870+0000 7f78d1a00640 1 -- 172.21.15.29:0/1655584808 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc160bf0 con 0x7f78cc1603a0 2024-01-24T13:06:17.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.874+0000 7f78d1a00640 1 --2- 172.21.15.29:0/1655584808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78cc1603a0 0x7f78cc0c9920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009d90 tx=0x7f78c401f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b720e9fcc76853e server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:17.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.874+0000 7f78cb400640 1 -- 172.21.15.29:0/1655584808 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c40af600 con 0x7f78cc1603a0 2024-01-24T13:06:17.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.874+0000 7f78cb400640 1 -- 172.21.15.29:0/1655584808 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c40ab050 con 0x7f78cc1603a0 2024-01-24T13:06:17.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.874+0000 7f78cb400640 1 -- 172.21.15.29:0/1655584808 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c40af980 con 0x7f78cc1603a0 2024-01-24T13:06:17.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.874+0000 7f78d3a00640 1 -- 172.21.15.29:0/1655584808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78cc1603a0 msgr2=0x7f78cc0c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.874+0000 7f78d3a00640 1 --2- 172.21.15.29:0/1655584808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78cc1603a0 0x7f78cc0c9920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009d90 tx=0x7f78c401f130 comp rx=0 tx=0).stop 2024-01-24T13:06:17.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.874+0000 7f78d3a00640 1 -- 172.21.15.29:0/1655584808 shutdown_connections 2024-01-24T13:06:17.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.874+0000 7f78d3a00640 1 --2- 172.21.15.29:0/1655584808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78cc1603a0 0x7f78cc0c9920 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.874+0000 7f78d3a00640 1 -- 172.21.15.29:0/1655584808 >> 172.21.15.29:0/1655584808 conn(0x7f78cc0cbd50 msgr2=0x7f78cc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:17.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.874+0000 7f78d3a00640 1 -- 172.21.15.29:0/1655584808 shutdown_connections 2024-01-24T13:06:17.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.874+0000 7f78d3a00640 1 -- 172.21.15.29:0/1655584808 wait complete. 2024-01-24T13:06:17.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.874+0000 7f78d3a00640 1 Processor -- start 2024-01-24T13:06:17.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.874+0000 7f78d3a00640 1 -- start start 2024-01-24T13:06:17.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78d3a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78cc0cd5b0 0x7f78cc0c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78d3a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78cc15c830 0x7f78cc1f1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78d3a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78cc1603a0 0x7f78cc0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78d3a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc155520 con 0x7f78cc15c830 2024-01-24T13:06:17.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78d3a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc1f6350 con 0x7f78cc0cd5b0 2024-01-24T13:06:17.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78d3a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc1f57d0 con 0x7f78cc1603a0 2024-01-24T13:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78cbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78cc15c830 0x7f78cc1f1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78cbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78cc15c830 0x7f78cc1f1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33508/0 (socket says 172.21.15.29:33508) 2024-01-24T13:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78cbe00640 1 -- 172.21.15.29:0/4157447579 learned_addr learned my addr 172.21.15.29:0/4157447579 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78d1000640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78cc0cd5b0 0x7f78cc0c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78d1a00640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78cc1603a0 0x7f78cc0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78cbe00640 1 -- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78cc1603a0 msgr2=0x7f78cc0c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78cbe00640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78cc1603a0 0x7f78cc0c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78cbe00640 1 -- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78cc0cd5b0 msgr2=0x7f78cc0c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78cbe00640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78cc0cd5b0 0x7f78cc0c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78cbe00640 1 -- 172.21.15.29:0/4157447579 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c4009a70 con 0x7f78cc15c830 2024-01-24T13:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78d1a00640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78cc1603a0 0x7f78cc0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:17.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78cbe00640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78cc15c830 0x7f78cc1f1480 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c4d0 tx=0x7f78b400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:17.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78c8c00640 1 -- 172.21.15.29:0/4157447579 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4005cf0 con 0x7f78cc15c830 2024-01-24T13:06:17.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78c8c00640 1 -- 172.21.15.29:0/4157447579 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b4005e50 con 0x7f78cc15c830 2024-01-24T13:06:17.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78d3a00640 1 -- 172.21.15.29:0/4157447579 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78cc1f5ab0 con 0x7f78cc15c830 2024-01-24T13:06:17.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78c8c00640 1 -- 172.21.15.29:0/4157447579 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4007270 con 0x7f78cc15c830 2024-01-24T13:06:17.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78d3a00640 1 -- 172.21.15.29:0/4157447579 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78cc1f6070 con 0x7f78cc15c830 2024-01-24T13:06:17.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.878+0000 7f78d3a00640 1 -- 172.21.15.29:0/4157447579 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78cc15daa0 con 0x7f78cc15c830 2024-01-24T13:06:17.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.882+0000 7f78c8c00640 1 -- 172.21.15.29:0/4157447579 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f78b40073d0 con 0x7f78cc15c830 2024-01-24T13:06:17.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.882+0000 7f78c8c00640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f78a4065a60 0x7f78a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:17.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.882+0000 7f78c8c00640 1 -- 172.21.15.29:0/4157447579 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f78b4082970 con 0x7f78cc15c830 2024-01-24T13:06:17.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.882+0000 7f78d1000640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f78a4065a60 0x7f78a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:17.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.882+0000 7f78d1000640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f78a4065a60 0x7f78a4067f20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0011f0 tx=0x7f78bc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:17.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:17.886+0000 7f78c8c00640 1 -- 172.21.15.29:0/4157447579 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f78cc15daa0 con 0x7f78cc15c830 2024-01-24T13:06:18.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.042+0000 7f78d3a00640 1 -- 172.21.15.29:0/4157447579 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78cc15daa0 con 0x7f78cc15c830 2024-01-24T13:06:18.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.042+0000 7f78c8c00640 1 -- 172.21.15.29:0/4157447579 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78b4017020 con 0x7f78cc15c830 2024-01-24T13:06:18.048 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:06:18.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.046+0000 7f78d3a00640 1 -- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f78a4065a60 msgr2=0x7f78a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.046+0000 7f78d3a00640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f78a4065a60 0x7f78a4067f20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0011f0 tx=0x7f78bc009040 comp rx=0 tx=0).stop 2024-01-24T13:06:18.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.046+0000 7f78d3a00640 1 -- 172.21.15.29:0/4157447579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78cc15c830 msgr2=0x7f78cc1f1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.046+0000 7f78d3a00640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78cc15c830 0x7f78cc1f1480 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c4d0 tx=0x7f78b400c990 comp rx=0 tx=0).stop 2024-01-24T13:06:18.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.046+0000 7f78d3a00640 1 -- 172.21.15.29:0/4157447579 shutdown_connections 2024-01-24T13:06:18.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.046+0000 7f78d3a00640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f78a4065a60 0x7f78a4067f20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.046+0000 7f78d3a00640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78cc1603a0 0x7f78cc0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.046+0000 7f78d3a00640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78cc15c830 0x7f78cc1f1480 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.046+0000 7f78d3a00640 1 --2- 172.21.15.29:0/4157447579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78cc0cd5b0 0x7f78cc0c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.046+0000 7f78d3a00640 1 -- 172.21.15.29:0/4157447579 >> 172.21.15.29:0/4157447579 conn(0x7f78cc0cbd50 msgr2=0x7f78cc069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:18.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.046+0000 7f78d3a00640 1 -- 172.21.15.29:0/4157447579 shutdown_connections 2024-01-24T13:06:18.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.046+0000 7f78d3a00640 1 -- 172.21.15.29:0/4157447579 wait complete. 2024-01-24T13:06:18.071 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:06:18.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.210+0000 7fe2fca00640 1 Processor -- start 2024-01-24T13:06:18.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.210+0000 7fe2fca00640 1 -- start start 2024-01-24T13:06:18.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2fca00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2f4158ca0 0x7fe2f40b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2fca00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe2f4070560 0x7fe2f406c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2fca00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f406c560 con 0x7fe2f406bbc0 2024-01-24T13:06:18.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2fca00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f4159080 con 0x7fe2f4070560 2024-01-24T13:06:18.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2fca00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4070ba0 con 0x7fe2f4158ca0 2024-01-24T13:06:18.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2faa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe2f4070560 0x7fe2f406c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2f9600640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe2f406bbc0 0x7fe2f406fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44728/0 (socket says 172.21.15.29:44728) 2024-01-24T13:06:18.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2f9600640 1 -- 172.21.15.29:0/3701357252 learned_addr learned my addr 172.21.15.29:0/3701357252 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:18.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2fa000640 1 --2- 172.21.15.29:0/3701357252 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2f4158ca0 0x7fe2f40b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2faa00640 1 -- 172.21.15.29:0/3701357252 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2f4158ca0 msgr2=0x7fe2f40b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:18.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2faa00640 1 --2- 172.21.15.29:0/3701357252 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2f4158ca0 0x7fe2f40b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2faa00640 1 -- 172.21.15.29:0/3701357252 >> v1:172.21.15.29:6789/0 conn(0x7fe2f406bbc0 legacy=0x7fe2f406fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2f8c00640 1 -- 172.21.15.29:0/3701357252 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916273548 0 0) 0x7fe2f406c560 con 0x7fe2f406bbc0 2024-01-24T13:06:18.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2faa00640 1 -- 172.21.15.29:0/3701357252 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40b18c0 con 0x7fe2f4070560 2024-01-24T13:06:18.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.214+0000 7fe2fa000640 1 --2- 172.21.15.29:0/3701357252 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2f4158ca0 0x7fe2f40b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:18.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.218+0000 7fe2faa00640 1 --2- 172.21.15.29:0/3701357252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2f4070560 0x7fe2f406c020 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00aea0 tx=0x7fe2ec01da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111e76030931f914 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:18.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.218+0000 7fe2f8c00640 1 -- 172.21.15.29:0/3701357252 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00a2d0 con 0x7fe2f4070560 2024-01-24T13:06:18.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.218+0000 7fe2f8c00640 1 -- 172.21.15.29:0/3701357252 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec0a6780 con 0x7fe2f4070560 2024-01-24T13:06:18.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.218+0000 7fe2f8c00640 1 -- 172.21.15.29:0/3701357252 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0a6b10 con 0x7fe2f4070560 2024-01-24T13:06:18.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.218+0000 7fe2fca00640 1 -- 172.21.15.29:0/3701357252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2f4070560 msgr2=0x7fe2f406c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.218+0000 7fe2fca00640 1 --2- 172.21.15.29:0/3701357252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2f4070560 0x7fe2f406c020 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00aea0 tx=0x7fe2ec01da50 comp rx=0 tx=0).stop 2024-01-24T13:06:18.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.218+0000 7fe2fca00640 1 -- 172.21.15.29:0/3701357252 shutdown_connections 2024-01-24T13:06:18.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.218+0000 7fe2fca00640 1 --2- 172.21.15.29:0/3701357252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2f4070560 0x7fe2f406c020 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.218+0000 7fe2fca00640 1 --2- 172.21.15.29:0/3701357252 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2f4158ca0 0x7fe2f40b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.218+0000 7fe2fca00640 1 -- 172.21.15.29:0/3701357252 >> 172.21.15.29:0/3701357252 conn(0x7fe2f406d700 msgr2=0x7fe2f4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:18.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.218+0000 7fe2fca00640 1 -- 172.21.15.29:0/3701357252 shutdown_connections 2024-01-24T13:06:18.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.218+0000 7fe2fca00640 1 -- 172.21.15.29:0/3701357252 wait complete. 2024-01-24T13:06:18.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.218+0000 7fe2fca00640 1 Processor -- start 2024-01-24T13:06:18.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.218+0000 7fe2fca00640 1 -- start start 2024-01-24T13:06:18.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fca00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2f406bbc0 0x7fe2f41557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fca00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2f4070560 0x7fe2f414fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fca00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2f4158ca0 0x7fe2f414d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fca00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f41508f0 con 0x7fe2f406bbc0 2024-01-24T13:06:18.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fca00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4150bd0 con 0x7fe2f4070560 2024-01-24T13:06:18.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fca00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4150eb0 con 0x7fe2f4158ca0 2024-01-24T13:06:18.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fa000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2f406bbc0 0x7fe2f41557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fa000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2f406bbc0 0x7fe2f41557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33524/0 (socket says 172.21.15.29:33524) 2024-01-24T13:06:18.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fa000640 1 -- 172.21.15.29:0/3580167789 learned_addr learned my addr 172.21.15.29:0/3580167789 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:18.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2f9600640 1 --2- 172.21.15.29:0/3580167789 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2f4070560 0x7fe2f414fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2faa00640 1 --2- 172.21.15.29:0/3580167789 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2f4158ca0 0x7fe2f414d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fa000640 1 -- 172.21.15.29:0/3580167789 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2f4158ca0 msgr2=0x7fe2f414d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fa000640 1 --2- 172.21.15.29:0/3580167789 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2f4158ca0 0x7fe2f414d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fa000640 1 -- 172.21.15.29:0/3580167789 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2f4070560 msgr2=0x7fe2f414fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fa000640 1 --2- 172.21.15.29:0/3580167789 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2f4070560 0x7fe2f414fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fa000640 1 -- 172.21.15.29:0/3580167789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec00ab80 con 0x7fe2f406bbc0 2024-01-24T13:06:18.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fa000640 1 --2- 172.21.15.29:0/3580167789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2f406bbc0 0x7fe2f41557b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4007b60 tx=0x7fe2e400b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:18.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2f2000640 1 -- 172.21.15.29:0/3580167789 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e400bdc0 con 0x7fe2f406bbc0 2024-01-24T13:06:18.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2f2000640 1 -- 172.21.15.29:0/3580167789 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e4011050 con 0x7fe2f406bbc0 2024-01-24T13:06:18.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2f2000640 1 -- 172.21.15.29:0/3580167789 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e40113e0 con 0x7fe2f406bbc0 2024-01-24T13:06:18.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fca00640 1 -- 172.21.15.29:0/3580167789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f4151190 con 0x7fe2f406bbc0 2024-01-24T13:06:18.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fca00640 1 -- 172.21.15.29:0/3580167789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f414e030 con 0x7fe2f406bbc0 2024-01-24T13:06:18.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.222+0000 7fe2fca00640 1 -- 172.21.15.29:0/3580167789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f404e850 con 0x7fe2f406bbc0 2024-01-24T13:06:18.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.226+0000 7fe2f2000640 1 -- 172.21.15.29:0/3580167789 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe2e4010560 con 0x7fe2f406bbc0 2024-01-24T13:06:18.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.226+0000 7fe2f2000640 1 --2- 172.21.15.29:0/3580167789 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2cc065a60 0x7fe2cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.226+0000 7fe2f2000640 1 -- 172.21.15.29:0/3580167789 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fe2e4086fc0 con 0x7fe2f406bbc0 2024-01-24T13:06:18.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.226+0000 7fe2f9600640 1 --2- 172.21.15.29:0/3580167789 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2cc065a60 0x7fe2cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.226+0000 7fe2f9600640 1 --2- 172.21.15.29:0/3580167789 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2cc065a60 0x7fe2cc067f20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe2f41f5920 tx=0x7fe2dc007d60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:18.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.230+0000 7fe2f2000640 1 -- 172.21.15.29:0/3580167789 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe2e4054670 con 0x7fe2f406bbc0 2024-01-24T13:06:18.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.386+0000 7fe2fca00640 1 -- 172.21.15.29:0/3580167789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2f4156fc0 con 0x7fe2f406bbc0 2024-01-24T13:06:18.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.386+0000 7fe2f2000640 1 -- 172.21.15.29:0/3580167789 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe2e401e020 con 0x7fe2f406bbc0 2024-01-24T13:06:18.392 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:06:18.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.390+0000 7fe2fca00640 1 -- 172.21.15.29:0/3580167789 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2cc065a60 msgr2=0x7fe2cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.390+0000 7fe2fca00640 1 --2- 172.21.15.29:0/3580167789 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2cc065a60 0x7fe2cc067f20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe2f41f5920 tx=0x7fe2dc007d60 comp rx=0 tx=0).stop 2024-01-24T13:06:18.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.390+0000 7fe2fca00640 1 -- 172.21.15.29:0/3580167789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2f406bbc0 msgr2=0x7fe2f41557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.390+0000 7fe2fca00640 1 --2- 172.21.15.29:0/3580167789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2f406bbc0 0x7fe2f41557b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4007b60 tx=0x7fe2e400b4b0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.390+0000 7fe2fca00640 1 -- 172.21.15.29:0/3580167789 shutdown_connections 2024-01-24T13:06:18.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.390+0000 7fe2fca00640 1 --2- 172.21.15.29:0/3580167789 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2cc065a60 0x7fe2cc067f20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.390+0000 7fe2fca00640 1 --2- 172.21.15.29:0/3580167789 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2f4158ca0 0x7fe2f414d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.390+0000 7fe2fca00640 1 --2- 172.21.15.29:0/3580167789 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2f4070560 0x7fe2f414fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.390+0000 7fe2fca00640 1 --2- 172.21.15.29:0/3580167789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2f406bbc0 0x7fe2f41557b0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.390+0000 7fe2fca00640 1 -- 172.21.15.29:0/3580167789 >> 172.21.15.29:0/3580167789 conn(0x7fe2f406d700 msgr2=0x7fe2f41563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:18.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.390+0000 7fe2fca00640 1 -- 172.21.15.29:0/3580167789 shutdown_connections 2024-01-24T13:06:18.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.390+0000 7fe2fca00640 1 -- 172.21.15.29:0/3580167789 wait complete. 2024-01-24T13:06:18.414 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-01-24T13:06:18.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.554+0000 7f9180a00640 1 Processor -- start 2024-01-24T13:06:18.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.554+0000 7f9180a00640 1 -- start start 2024-01-24T13:06:18.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.554+0000 7f9180a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9178158ca0 0x7f91780b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.554+0000 7f9180a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9178070560 0x7f917806c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.554+0000 7f9180a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917806c560 con 0x7f917806bbc0 2024-01-24T13:06:18.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.554+0000 7f9180a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9178159080 con 0x7f9178070560 2024-01-24T13:06:18.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.554+0000 7f9180a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9178070ba0 con 0x7f9178158ca0 2024-01-24T13:06:18.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.554+0000 7f917ea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9178070560 0x7f917806c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.554+0000 7f917d600640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f917806bbc0 0x7f917806fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44740/0 (socket says 172.21.15.29:44740) 2024-01-24T13:06:18.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.554+0000 7f917d600640 1 -- 172.21.15.29:0/3929287941 learned_addr learned my addr 172.21.15.29:0/3929287941 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:18.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.554+0000 7f917e000640 1 --2- 172.21.15.29:0/3929287941 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9178158ca0 0x7f91780b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.558+0000 7f917ea00640 1 -- 172.21.15.29:0/3929287941 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9178158ca0 msgr2=0x7f91780b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.558+0000 7f917ea00640 1 --2- 172.21.15.29:0/3929287941 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9178158ca0 0x7f91780b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.558+0000 7f917ea00640 1 -- 172.21.15.29:0/3929287941 >> v1:172.21.15.29:6789/0 conn(0x7f917806bbc0 legacy=0x7f917806fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.558+0000 7f917ea00640 1 -- 172.21.15.29:0/3929287941 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91780b18c0 con 0x7f9178070560 2024-01-24T13:06:18.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.558+0000 7f917ea00640 1 --2- 172.21.15.29:0/3929287941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9178070560 0x7f917806c020 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9170009d90 tx=0x7f917001da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336458af3464293f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:18.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.558+0000 7f917cc00640 1 -- 172.21.15.29:0/3929287941 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91700a6990 con 0x7f9178070560 2024-01-24T13:06:18.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.558+0000 7f917cc00640 1 -- 172.21.15.29:0/3929287941 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91700a6af0 con 0x7f9178070560 2024-01-24T13:06:18.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.558+0000 7f917cc00640 1 -- 172.21.15.29:0/3929287941 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91700a6e80 con 0x7f9178070560 2024-01-24T13:06:18.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.558+0000 7f9180a00640 1 -- 172.21.15.29:0/3929287941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9178070560 msgr2=0x7f917806c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.558+0000 7f9180a00640 1 --2- 172.21.15.29:0/3929287941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9178070560 0x7f917806c020 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9170009d90 tx=0x7f917001da60 comp rx=0 tx=0).stop 2024-01-24T13:06:18.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f9180a00640 1 -- 172.21.15.29:0/3929287941 shutdown_connections 2024-01-24T13:06:18.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f9180a00640 1 --2- 172.21.15.29:0/3929287941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9178070560 0x7f917806c020 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f9180a00640 1 --2- 172.21.15.29:0/3929287941 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9178158ca0 0x7f91780b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f9180a00640 1 -- 172.21.15.29:0/3929287941 >> 172.21.15.29:0/3929287941 conn(0x7f917806d700 msgr2=0x7f9178069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:18.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f9180a00640 1 -- 172.21.15.29:0/3929287941 shutdown_connections 2024-01-24T13:06:18.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f9180a00640 1 -- 172.21.15.29:0/3929287941 wait complete. 2024-01-24T13:06:18.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f9180a00640 1 Processor -- start 2024-01-24T13:06:18.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f9180a00640 1 -- start start 2024-01-24T13:06:18.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f9180a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806bbc0 0x7f9178151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f9180a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9178070560 0x7f91780c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f9180a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9178158ca0 0x7f9178149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f9180a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9178152010 con 0x7f917806bbc0 2024-01-24T13:06:18.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f9180a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91781528b0 con 0x7f9178158ca0 2024-01-24T13:06:18.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f9180a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91780c7e90 con 0x7f9178070560 2024-01-24T13:06:18.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f917e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806bbc0 0x7f9178151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f917e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806bbc0 0x7f9178151140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33538/0 (socket says 172.21.15.29:33538) 2024-01-24T13:06:18.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f917e000640 1 -- 172.21.15.29:0/167265794 learned_addr learned my addr 172.21.15.29:0/167265794 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:18.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f917ea00640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9178158ca0 0x7f9178149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f917d600640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9178070560 0x7f91780c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f917e000640 1 -- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9178070560 msgr2=0x7f91780c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f917e000640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9178070560 0x7f91780c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f917e000640 1 -- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9178158ca0 msgr2=0x7f9178149720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f917e000640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9178158ca0 0x7f9178149720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f917e000640 1 -- 172.21.15.29:0/167265794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9170009a70 con 0x7f917806bbc0 2024-01-24T13:06:18.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.562+0000 7f917d600640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9178070560 0x7f91780c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:18.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.566+0000 7f917e000640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806bbc0 0x7f9178151140 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f916800e870 tx=0x7f916800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:18.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.566+0000 7f9176000640 1 -- 172.21.15.29:0/167265794 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9168009510 con 0x7f917806bbc0 2024-01-24T13:06:18.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.566+0000 7f9176000640 1 -- 172.21.15.29:0/167265794 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916800eec0 con 0x7f917806bbc0 2024-01-24T13:06:18.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.566+0000 7f9176000640 1 -- 172.21.15.29:0/167265794 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916800cb40 con 0x7f917806bbc0 2024-01-24T13:06:18.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.566+0000 7f9180a00640 1 -- 172.21.15.29:0/167265794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9178152260 con 0x7f917806bbc0 2024-01-24T13:06:18.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.566+0000 7f9180a00640 1 -- 172.21.15.29:0/167265794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917815a3f0 con 0x7f917806bbc0 2024-01-24T13:06:18.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.566+0000 7f9180a00640 1 -- 172.21.15.29:0/167265794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917804e850 con 0x7f917806bbc0 2024-01-24T13:06:18.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.566+0000 7f9176000640 1 -- 172.21.15.29:0/167265794 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f916800ccc0 con 0x7f917806bbc0 2024-01-24T13:06:18.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.566+0000 7f9176000640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9150065a60 0x7f9150067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.566+0000 7f9176000640 1 -- 172.21.15.29:0/167265794 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f9168083560 con 0x7f917806bbc0 2024-01-24T13:06:18.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.566+0000 7f917d600640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9150065a60 0x7f9150067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.570+0000 7f917d600640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9150065a60 0x7f9150067f20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9178163220 tx=0x7f9160009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:18.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.570+0000 7f9176000640 1 -- 172.21.15.29:0/167265794 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9168050c10 con 0x7f917806bbc0 2024-01-24T13:06:18.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.726+0000 7f9180a00640 1 -- 172.21.15.29:0/167265794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f9178151c60 con 0x7f917806bbc0 2024-01-24T13:06:18.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.726+0000 7f9176000640 1 -- 172.21.15.29:0/167265794 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v46) v1 ==== 97+0+11 (secure 0 0 0) 0x7f9168054230 con 0x7f917806bbc0 2024-01-24T13:06:18.732 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:06:18.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.730+0000 7f9180a00640 1 -- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9150065a60 msgr2=0x7f9150067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.730+0000 7f9180a00640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9150065a60 0x7f9150067f20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9178163220 tx=0x7f9160009040 comp rx=0 tx=0).stop 2024-01-24T13:06:18.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.730+0000 7f9180a00640 1 -- 172.21.15.29:0/167265794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806bbc0 msgr2=0x7f9178151140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.730+0000 7f9180a00640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806bbc0 0x7f9178151140 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f916800e870 tx=0x7f916800ec70 comp rx=0 tx=0).stop 2024-01-24T13:06:18.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.730+0000 7f9180a00640 1 -- 172.21.15.29:0/167265794 shutdown_connections 2024-01-24T13:06:18.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.730+0000 7f9180a00640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9150065a60 0x7f9150067f20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.730+0000 7f9180a00640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9178158ca0 0x7f9178149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.730+0000 7f9180a00640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9178070560 0x7f91780c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.730+0000 7f9180a00640 1 --2- 172.21.15.29:0/167265794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917806bbc0 0x7f9178151140 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.730+0000 7f9180a00640 1 -- 172.21.15.29:0/167265794 >> 172.21.15.29:0/167265794 conn(0x7f917806d700 msgr2=0x7f9178069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:18.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.730+0000 7f9180a00640 1 -- 172.21.15.29:0/167265794 shutdown_connections 2024-01-24T13:06:18.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.730+0000 7f9180a00640 1 -- 172.21.15.29:0/167265794 wait complete. 2024-01-24T13:06:18.754 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:06:18.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1baf000640 1 Processor -- start 2024-01-24T13:06:18.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1baf000640 1 -- start start 2024-01-24T13:06:18.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1baf000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ba8143910 0x7f1ba8143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1baf000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ba806c320 0x7f1ba80cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1baf000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba815aa30 con 0x7f1ba8070ac0 2024-01-24T13:06:18.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1baf000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba80712a0 con 0x7f1ba8143910 2024-01-24T13:06:18.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1baf000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba8071580 con 0x7f1ba806c320 2024-01-24T13:06:18.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1ba7e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ba8143910 0x7f1ba8143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1ba7e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ba8143910 0x7f1ba8143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33554/0 (socket says 172.21.15.29:33554) 2024-01-24T13:06:18.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1ba7e00640 1 -- 172.21.15.29:0/547341656 learned_addr learned my addr 172.21.15.29:0/547341656 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:18.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1bad000640 1 --2- 172.21.15.29:0/547341656 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ba806c320 0x7f1ba80cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1ba7e00640 1 -- 172.21.15.29:0/547341656 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ba806c320 msgr2=0x7f1ba80cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:18.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1ba7e00640 1 --2- 172.21.15.29:0/547341656 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ba806c320 0x7f1ba80cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1ba7e00640 1 -- 172.21.15.29:0/547341656 >> v1:172.21.15.163:6789/0 conn(0x7f1ba8070ac0 legacy=0x7f1ba806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1ba7e00640 1 -- 172.21.15.29:0/547341656 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba80cd090 con 0x7f1ba8143910 2024-01-24T13:06:18.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.894+0000 7f1bad000640 1 --2- 172.21.15.29:0/547341656 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ba806c320 0x7f1ba80cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:18.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.898+0000 7f1ba7e00640 1 --2- 172.21.15.29:0/547341656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ba8143910 0x7f1ba8143d30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009870 tx=0x7f1b9801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bce292048c9b64 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:18.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.898+0000 7f1ba6a00640 1 -- 172.21.15.29:0/547341656 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b980aa650 con 0x7f1ba8143910 2024-01-24T13:06:18.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.898+0000 7f1ba6a00640 1 -- 172.21.15.29:0/547341656 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b980aa7b0 con 0x7f1ba8143910 2024-01-24T13:06:18.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.898+0000 7f1ba6a00640 1 -- 172.21.15.29:0/547341656 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b980aab40 con 0x7f1ba8143910 2024-01-24T13:06:18.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.898+0000 7f1baf000640 1 -- 172.21.15.29:0/547341656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ba8143910 msgr2=0x7f1ba8143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.898+0000 7f1baf000640 1 --2- 172.21.15.29:0/547341656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ba8143910 0x7f1ba8143d30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009870 tx=0x7f1b9801c510 comp rx=0 tx=0).stop 2024-01-24T13:06:18.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.898+0000 7f1baf000640 1 -- 172.21.15.29:0/547341656 shutdown_connections 2024-01-24T13:06:18.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.898+0000 7f1baf000640 1 --2- 172.21.15.29:0/547341656 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ba806c320 0x7f1ba80cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.898+0000 7f1baf000640 1 --2- 172.21.15.29:0/547341656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ba8143910 0x7f1ba8143d30 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.898+0000 7f1baf000640 1 -- 172.21.15.29:0/547341656 >> 172.21.15.29:0/547341656 conn(0x7f1ba80b3950 msgr2=0x7f1ba8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:18.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.898+0000 7f1baf000640 1 -- 172.21.15.29:0/547341656 shutdown_connections 2024-01-24T13:06:18.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.898+0000 7f1baf000640 1 -- 172.21.15.29:0/547341656 wait complete. 2024-01-24T13:06:18.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1baf000640 1 Processor -- start 2024-01-24T13:06:18.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1baf000640 1 -- start start 2024-01-24T13:06:18.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1baf000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ba806c320 0x7f1ba80acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1baf000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ba8070ac0 0x7f1ba813a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1baf000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ba8143910 0x7f1ba813c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1baf000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba813bc90 con 0x7f1ba8070ac0 2024-01-24T13:06:18.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1baf000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba813b800 con 0x7f1ba806c320 2024-01-24T13:06:18.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1baf000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba813a950 con 0x7f1ba8143910 2024-01-24T13:06:18.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1ba7400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ba8070ac0 0x7f1ba813a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1ba7400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ba8070ac0 0x7f1ba813a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33564/0 (socket says 172.21.15.29:33564) 2024-01-24T13:06:18.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1ba7400640 1 -- 172.21.15.29:0/3863346938 learned_addr learned my addr 172.21.15.29:0/3863346938 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:18.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1ba7e00640 1 --2- 172.21.15.29:0/3863346938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ba806c320 0x7f1ba80acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1bad000640 1 --2- 172.21.15.29:0/3863346938 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ba8143910 0x7f1ba813c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1ba7400640 1 -- 172.21.15.29:0/3863346938 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ba8143910 msgr2=0x7f1ba813c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1ba7400640 1 --2- 172.21.15.29:0/3863346938 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ba8143910 0x7f1ba813c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1ba7400640 1 -- 172.21.15.29:0/3863346938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ba806c320 msgr2=0x7f1ba80acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:18.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1ba7400640 1 --2- 172.21.15.29:0/3863346938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ba806c320 0x7f1ba80acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:18.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1ba7400640 1 -- 172.21.15.29:0/3863346938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b980094d0 con 0x7f1ba8070ac0 2024-01-24T13:06:18.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1ba7400640 1 --2- 172.21.15.29:0/3863346938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ba8070ac0 0x7f1ba813a410 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000c530 tx=0x7f1b9000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:18.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1b9fe00640 1 -- 172.21.15.29:0/3863346938 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90005220 con 0x7f1ba8070ac0 2024-01-24T13:06:18.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1baf000640 1 -- 172.21.15.29:0/3863346938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba813abf0 con 0x7f1ba8070ac0 2024-01-24T13:06:18.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1b9fe00640 1 -- 172.21.15.29:0/3863346938 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b90005380 con 0x7f1ba8070ac0 2024-01-24T13:06:18.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1b9fe00640 1 -- 172.21.15.29:0/3863346938 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90007270 con 0x7f1ba8070ac0 2024-01-24T13:06:18.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1baf000640 1 -- 172.21.15.29:0/3863346938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba813b1b0 con 0x7f1ba8070ac0 2024-01-24T13:06:18.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.902+0000 7f1baf000640 1 -- 172.21.15.29:0/3863346938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba804e850 con 0x7f1ba8070ac0 2024-01-24T13:06:18.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.906+0000 7f1b9fe00640 1 -- 172.21.15.29:0/3863346938 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1b900073d0 con 0x7f1ba8070ac0 2024-01-24T13:06:18.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.906+0000 7f1b9fe00640 1 --2- 172.21.15.29:0/3863346938 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1b80065a60 0x7f1b80067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:18.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.906+0000 7f1b9fe00640 1 -- 172.21.15.29:0/3863346938 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f1b90082b40 con 0x7f1ba8070ac0 2024-01-24T13:06:18.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.906+0000 7f1ba7e00640 1 --2- 172.21.15.29:0/3863346938 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1b80065a60 0x7f1b80067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:18.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.906+0000 7f1ba7e00640 1 --2- 172.21.15.29:0/3863346938 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1b80065a60 0x7f1b80067f20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1b980ae000 tx=0x7f1b980b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:18.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:18.910+0000 7f1b9fe00640 1 -- 172.21.15.29:0/3863346938 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1b90050200 con 0x7f1ba8070ac0 2024-01-24T13:06:19.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.098+0000 7f1baf000640 1 -- 172.21.15.29:0/3863346938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ba815aa30 con 0x7f1ba8070ac0 2024-01-24T13:06:19.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.098+0000 7f1b9fe00640 1 -- 172.21.15.29:0/3863346938 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f1ba815aa30 con 0x7f1ba8070ac0 2024-01-24T13:06:19.102 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:19.102 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3468790539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3468790539},{"type":"v1","addr":"172.21.15.29:6834","nonce":3468790539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3278958688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3278958688},{"type":"v1","addr":"172.21.15.29:6835","nonce":3278958688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/1296970243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1296970243},{"type":"v1","addr":"172.21.15.163:6836","nonce":1296970243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:05:23.206301+0000","modified":"2024-01-24T13:05:36.732142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5463":{"gid":5463,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/140413977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":140413977},{"type":"v1","addr":"172.21.15.163:6837","nonce":140413977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-24T13:06:19.102 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-01-24T13:06:19.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.098+0000 7f1baf000640 1 -- 172.21.15.29:0/3863346938 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1b80065a60 msgr2=0x7f1b80067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.098+0000 7f1baf000640 1 --2- 172.21.15.29:0/3863346938 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1b80065a60 0x7f1b80067f20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1b980ae000 tx=0x7f1b980b5040 comp rx=0 tx=0).stop 2024-01-24T13:06:19.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.098+0000 7f1baf000640 1 -- 172.21.15.29:0/3863346938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ba8070ac0 msgr2=0x7f1ba813a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.098+0000 7f1baf000640 1 --2- 172.21.15.29:0/3863346938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ba8070ac0 0x7f1ba813a410 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000c530 tx=0x7f1b9000c9f0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.098+0000 7f1baf000640 1 -- 172.21.15.29:0/3863346938 shutdown_connections 2024-01-24T13:06:19.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.098+0000 7f1baf000640 1 --2- 172.21.15.29:0/3863346938 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1b80065a60 0x7f1b80067f20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.098+0000 7f1baf000640 1 --2- 172.21.15.29:0/3863346938 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ba8143910 0x7f1ba813c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.098+0000 7f1baf000640 1 --2- 172.21.15.29:0/3863346938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ba8070ac0 0x7f1ba813a410 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.098+0000 7f1baf000640 1 --2- 172.21.15.29:0/3863346938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ba806c320 0x7f1ba80acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.098+0000 7f1baf000640 1 -- 172.21.15.29:0/3863346938 >> 172.21.15.29:0/3863346938 conn(0x7f1ba80b3950 msgr2=0x7f1ba8141d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:19.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.102+0000 7f1baf000640 1 -- 172.21.15.29:0/3863346938 shutdown_connections 2024-01-24T13:06:19.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.102+0000 7f1baf000640 1 -- 172.21.15.29:0/3863346938 wait complete. 2024-01-24T13:06:19.124 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:06:19.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.262+0000 7f7089400640 1 Processor -- start 2024-01-24T13:06:19.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.262+0000 7f7089400640 1 -- start start 2024-01-24T13:06:19.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.266+0000 7f7089400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f708415d660 0x7f708406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.266+0000 7f7089400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708415de10 con 0x7f708406bc10 2024-01-24T13:06:19.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.266+0000 7f7089400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708415db30 con 0x7f7084159300 2024-01-24T13:06:19.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.266+0000 7f7089400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7084071140 con 0x7f708415d660 2024-01-24T13:06:19.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.266+0000 7f7081e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f708406bc10 0x7f708415cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44742/0 (socket says 172.21.15.29:44742) 2024-01-24T13:06:19.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.266+0000 7f7081e00640 1 -- 172.21.15.29:0/2078947712 learned_addr learned my addr 172.21.15.29:0/2078947712 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:19.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.266+0000 7f7083200640 1 --2- 172.21.15.29:0/2078947712 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f708415d660 0x7f708406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.266+0000 7f7081400640 1 -- 172.21.15.29:0/2078947712 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284418773 0 0) 0x7f708415de10 con 0x7f708406bc10 2024-01-24T13:06:19.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.266+0000 7f7081400640 1 -- 172.21.15.29:0/2078947712 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7064003530 con 0x7f708406bc10 2024-01-24T13:06:19.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.266+0000 7f7081400640 1 -- 172.21.15.29:0/2078947712 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292326852 0 0) 0x7f708415db30 con 0x7f7084159300 2024-01-24T13:06:19.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.266+0000 7f7081400640 1 -- 172.21.15.29:0/2078947712 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f708415de10 con 0x7f7084159300 2024-01-24T13:06:19.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.266+0000 7f7083200640 1 -- 172.21.15.29:0/2078947712 >> v1:172.21.15.163:6789/0 conn(0x7f7084159300 legacy=0x7f70840b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.266+0000 7f7083200640 1 -- 172.21.15.29:0/2078947712 >> v1:172.21.15.29:6789/0 conn(0x7f708406bc10 legacy=0x7f708415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.266+0000 7f7083200640 1 -- 172.21.15.29:0/2078947712 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70840b1160 con 0x7f708415d660 2024-01-24T13:06:19.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.270+0000 7f7083200640 1 --2- 172.21.15.29:0/2078947712 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f708415d660 0x7f708406c0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f707c009dc0 tx=0x7f707c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=820dfa92bf45b6cb server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:19.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.270+0000 7f7081400640 1 -- 172.21.15.29:0/2078947712 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c0a5890 con 0x7f708415d660 2024-01-24T13:06:19.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.270+0000 7f7081400640 1 -- 172.21.15.29:0/2078947712 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c0a59f0 con 0x7f708415d660 2024-01-24T13:06:19.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.270+0000 7f7081400640 1 -- 172.21.15.29:0/2078947712 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c0a5d80 con 0x7f708415d660 2024-01-24T13:06:19.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.270+0000 7f7089400640 1 -- 172.21.15.29:0/2078947712 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f708415d660 msgr2=0x7f708406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.270+0000 7f7089400640 1 --2- 172.21.15.29:0/2078947712 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f708415d660 0x7f708406c0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f707c009dc0 tx=0x7f707c01c8e0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.270+0000 7f7089400640 1 -- 172.21.15.29:0/2078947712 shutdown_connections 2024-01-24T13:06:19.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.270+0000 7f7089400640 1 --2- 172.21.15.29:0/2078947712 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f708415d660 0x7f708406c0a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.270+0000 7f7089400640 1 -- 172.21.15.29:0/2078947712 >> 172.21.15.29:0/2078947712 conn(0x7f70840b3950 msgr2=0x7f7084069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:19.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.270+0000 7f7089400640 1 -- 172.21.15.29:0/2078947712 shutdown_connections 2024-01-24T13:06:19.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.270+0000 7f7089400640 1 -- 172.21.15.29:0/2078947712 wait complete. 2024-01-24T13:06:19.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.270+0000 7f7089400640 1 Processor -- start 2024-01-24T13:06:19.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.270+0000 7f7089400640 1 -- start start 2024-01-24T13:06:19.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7089400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f708406bc10 0x7f70841f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7089400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7084159300 0x7f70840ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7089400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f708415d660 0x7f7084159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7089400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70840acfa0 con 0x7f708406bc10 2024-01-24T13:06:19.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7089400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70840ac390 con 0x7f708415d660 2024-01-24T13:06:19.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7089400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70840ac670 con 0x7f7084159300 2024-01-24T13:06:19.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7082800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f708406bc10 0x7f70841f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7082800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f708406bc10 0x7f70841f43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33576/0 (socket says 172.21.15.29:33576) 2024-01-24T13:06:19.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7082800640 1 -- 172.21.15.29:0/3093941118 learned_addr learned my addr 172.21.15.29:0/3093941118 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7081e00640 1 --2- 172.21.15.29:0/3093941118 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7084159300 0x7f70840ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7083200640 1 --2- 172.21.15.29:0/3093941118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f708415d660 0x7f7084159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7082800640 1 -- 172.21.15.29:0/3093941118 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7084159300 msgr2=0x7f70840ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7082800640 1 --2- 172.21.15.29:0/3093941118 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7084159300 0x7f70840ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7082800640 1 -- 172.21.15.29:0/3093941118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f708415d660 msgr2=0x7f7084159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7082800640 1 --2- 172.21.15.29:0/3093941118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f708415d660 0x7f7084159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7082800640 1 -- 172.21.15.29:0/3093941118 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c009a70 con 0x7f708406bc10 2024-01-24T13:06:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7082800640 1 --2- 172.21.15.29:0/3093941118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f708406bc10 0x7f70841f43f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f707400c490 tx=0x7f707400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f707aa00640 1 -- 172.21.15.29:0/3093941118 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70740052d0 con 0x7f708406bc10 2024-01-24T13:06:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f707aa00640 1 -- 172.21.15.29:0/3093941118 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7074005430 con 0x7f708406bc10 2024-01-24T13:06:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f707aa00640 1 -- 172.21.15.29:0/3093941118 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7074012870 con 0x7f708406bc10 2024-01-24T13:06:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7089400640 1 -- 172.21.15.29:0/3093941118 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70840ac950 con 0x7f708406bc10 2024-01-24T13:06:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7089400640 1 -- 172.21.15.29:0/3093941118 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7084070b80 con 0x7f708406bc10 2024-01-24T13:06:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f7089400640 1 -- 172.21.15.29:0/3093941118 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70840ad110 con 0x7f708406bc10 2024-01-24T13:06:19.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.274+0000 7f707aa00640 1 -- 172.21.15.29:0/3093941118 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f70740129d0 con 0x7f708406bc10 2024-01-24T13:06:19.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.278+0000 7f707aa00640 1 --2- 172.21.15.29:0/3093941118 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f705c065a60 0x7f705c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.278+0000 7f707aa00640 1 -- 172.21.15.29:0/3093941118 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f7074082fe0 con 0x7f708406bc10 2024-01-24T13:06:19.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.278+0000 7f7081e00640 1 --2- 172.21.15.29:0/3093941118 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f705c065a60 0x7f705c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.278+0000 7f7081e00640 1 --2- 172.21.15.29:0/3093941118 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f705c065a60 0x7f705c067f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f70840ad660 tx=0x7f706c007d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:19.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.282+0000 7f707aa00640 1 -- 172.21.15.29:0/3093941118 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7074050690 con 0x7f708406bc10 2024-01-24T13:06:19.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.438+0000 7f7089400640 1 -- 172.21.15.29:0/3093941118 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f708404e850 con 0x7f708406bc10 2024-01-24T13:06:19.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.438+0000 7f707aa00640 1 -- 172.21.15.29:0/3093941118 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18163 (secure 0 0 0) 0x7f7074053cb0 con 0x7f708406bc10 2024-01-24T13:06:19.443 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:19.444 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":46,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:05:37.734611+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:05:21.225564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-24T13:05:22.188525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-01-24T13:05:35.873766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.6","mappings":[{"from":3,"to":2}]},{"pgid":"6.14","mappings":[{"from":4,"to":2}]},{"pgid":"6.24","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:06:19.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.442+0000 7f7089400640 1 -- 172.21.15.29:0/3093941118 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f705c065a60 msgr2=0x7f705c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.442+0000 7f7089400640 1 --2- 172.21.15.29:0/3093941118 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f705c065a60 0x7f705c067f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f70840ad660 tx=0x7f706c007d40 comp rx=0 tx=0).stop 2024-01-24T13:06:19.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.442+0000 7f7089400640 1 -- 172.21.15.29:0/3093941118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f708406bc10 msgr2=0x7f70841f43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.442+0000 7f7089400640 1 --2- 172.21.15.29:0/3093941118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f708406bc10 0x7f70841f43f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f707400c490 tx=0x7f707400c950 comp rx=0 tx=0).stop 2024-01-24T13:06:19.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.442+0000 7f7089400640 1 -- 172.21.15.29:0/3093941118 shutdown_connections 2024-01-24T13:06:19.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.442+0000 7f7089400640 1 --2- 172.21.15.29:0/3093941118 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f705c065a60 0x7f705c067f20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.442+0000 7f7089400640 1 --2- 172.21.15.29:0/3093941118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f708415d660 0x7f7084159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.442+0000 7f7089400640 1 --2- 172.21.15.29:0/3093941118 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7084159300 0x7f70840ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.442+0000 7f7089400640 1 --2- 172.21.15.29:0/3093941118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f708406bc10 0x7f70841f43f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.442+0000 7f7089400640 1 -- 172.21.15.29:0/3093941118 >> 172.21.15.29:0/3093941118 conn(0x7f70840b3950 msgr2=0x7f70840cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:19.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.442+0000 7f7089400640 1 -- 172.21.15.29:0/3093941118 shutdown_connections 2024-01-24T13:06:19.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.442+0000 7f7089400640 1 -- 172.21.15.29:0/3093941118 wait complete. 2024-01-24T13:06:19.466 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-24T13:06:19.466 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:06:19.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.602+0000 7f11d8e00640 1 Processor -- start 2024-01-24T13:06:19.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.602+0000 7f11d8e00640 1 -- start start 2024-01-24T13:06:19.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d8e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11d4143910 0x7f11d4143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d8e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f11d4070ac0 0x7f11d406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d8e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d415aa30 con 0x7f11d406c150 2024-01-24T13:06:19.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d8e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d406c5e0 con 0x7f11d4070ac0 2024-01-24T13:06:19.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d8e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d40712a0 con 0x7f11d4143910 2024-01-24T13:06:19.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d2800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f11d406c150 0x7f11d415dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44750/0 (socket says 172.21.15.29:44750) 2024-01-24T13:06:19.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d2800640 1 -- 172.21.15.29:0/2675175831 learned_addr learned my addr 172.21.15.29:0/2675175831 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:19.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d1400640 1 --2- 172.21.15.29:0/2675175831 >> v2:172.21.15.163:3300/0 conn(0x7f11d4070ac0 0x7f11d406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d1e00640 1 --2- 172.21.15.29:0/2675175831 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11d4143910 0x7f11d4143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d0a00640 1 -- 172.21.15.29:0/2675175831 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281103887 0 0) 0x7f11cc0014a0 con 0x7f11d406c150 2024-01-24T13:06:19.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d0a00640 1 -- 172.21.15.29:0/2675175831 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11b4003530 con 0x7f11d406c150 2024-01-24T13:06:19.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d1e00640 1 -- 172.21.15.29:0/2675175831 >> v2:172.21.15.163:3300/0 conn(0x7f11d4070ac0 msgr2=0x7f11d406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:19.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d1e00640 1 --2- 172.21.15.29:0/2675175831 >> v2:172.21.15.163:3300/0 conn(0x7f11d4070ac0 0x7f11d406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d1e00640 1 -- 172.21.15.29:0/2675175831 >> v1:172.21.15.29:6789/0 conn(0x7f11d406c150 legacy=0x7f11d415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d1e00640 1 -- 172.21.15.29:0/2675175831 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d4071580 con 0x7f11d4143910 2024-01-24T13:06:19.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.606+0000 7f11d1400640 1 --2- 172.21.15.29:0/2675175831 >> v2:172.21.15.163:3300/0 conn(0x7f11d4070ac0 0x7f11d406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:19.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.610+0000 7f11d1e00640 1 --2- 172.21.15.29:0/2675175831 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11d4143910 0x7f11d4143d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f11c40097c0 tx=0x7f11c401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eec52278e5a3a908 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:19.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.610+0000 7f11d0a00640 1 -- 172.21.15.29:0/2675175831 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c40ab600 con 0x7f11d4143910 2024-01-24T13:06:19.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.610+0000 7f11d0a00640 1 -- 172.21.15.29:0/2675175831 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c40a7050 con 0x7f11d4143910 2024-01-24T13:06:19.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.610+0000 7f11d0a00640 1 -- 172.21.15.29:0/2675175831 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c40ab980 con 0x7f11d4143910 2024-01-24T13:06:19.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.610+0000 7f11d8e00640 1 -- 172.21.15.29:0/2675175831 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11d4143910 msgr2=0x7f11d4143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.610+0000 7f11d8e00640 1 --2- 172.21.15.29:0/2675175831 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11d4143910 0x7f11d4143d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f11c40097c0 tx=0x7f11c401c450 comp rx=0 tx=0).stop 2024-01-24T13:06:19.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.610+0000 7f11d8e00640 1 -- 172.21.15.29:0/2675175831 shutdown_connections 2024-01-24T13:06:19.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.610+0000 7f11d8e00640 1 --2- 172.21.15.29:0/2675175831 >> v2:172.21.15.163:3300/0 conn(0x7f11d4070ac0 0x7f11d406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.610+0000 7f11d8e00640 1 --2- 172.21.15.29:0/2675175831 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11d4143910 0x7f11d4143d30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.610+0000 7f11d8e00640 1 -- 172.21.15.29:0/2675175831 >> 172.21.15.29:0/2675175831 conn(0x7f11d40b3950 msgr2=0x7f11d4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:19.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.610+0000 7f11d8e00640 1 -- 172.21.15.29:0/2675175831 shutdown_connections 2024-01-24T13:06:19.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.610+0000 7f11d8e00640 1 -- 172.21.15.29:0/2675175831 wait complete. 2024-01-24T13:06:19.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.610+0000 7f11d8e00640 1 Processor -- start 2024-01-24T13:06:19.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.610+0000 7f11d8e00640 1 -- start start 2024-01-24T13:06:19.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d8e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406c150 0x7f11d4153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d8e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11d4070ac0 0x7f11d4137a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d8e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11d4143910 0x7f11d4155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d8e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d4137f40 con 0x7f11d406c150 2024-01-24T13:06:19.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d8e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d4139980 con 0x7f11d4143910 2024-01-24T13:06:19.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d8e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d41387a0 con 0x7f11d4070ac0 2024-01-24T13:06:19.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d1e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406c150 0x7f11d4153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d1e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406c150 0x7f11d4153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33586/0 (socket says 172.21.15.29:33586) 2024-01-24T13:06:19.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d1e00640 1 -- 172.21.15.29:0/333005011 learned_addr learned my addr 172.21.15.29:0/333005011 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:19.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d2800640 1 --2- 172.21.15.29:0/333005011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11d4143910 0x7f11d4155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d1400640 1 --2- 172.21.15.29:0/333005011 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11d4070ac0 0x7f11d4137a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d1e00640 1 -- 172.21.15.29:0/333005011 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11d4070ac0 msgr2=0x7f11d4137a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d1e00640 1 --2- 172.21.15.29:0/333005011 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11d4070ac0 0x7f11d4137a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d1e00640 1 -- 172.21.15.29:0/333005011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11d4143910 msgr2=0x7f11d4155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d1e00640 1 --2- 172.21.15.29:0/333005011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11d4143910 0x7f11d4155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d1e00640 1 -- 172.21.15.29:0/333005011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc009420 con 0x7f11d406c150 2024-01-24T13:06:19.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d1e00640 1 --2- 172.21.15.29:0/333005011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406c150 0x7f11d4153640 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f11c40ae040 tx=0x7f11c40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:19.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11ca000640 1 -- 172.21.15.29:0/333005011 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c40b4430 con 0x7f11d406c150 2024-01-24T13:06:19.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11ca000640 1 -- 172.21.15.29:0/333005011 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c40b45b0 con 0x7f11d406c150 2024-01-24T13:06:19.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11ca000640 1 -- 172.21.15.29:0/333005011 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c40b4960 con 0x7f11d406c150 2024-01-24T13:06:19.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d8e00640 1 -- 172.21.15.29:0/333005011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c4009420 con 0x7f11d406c150 2024-01-24T13:06:19.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d8e00640 1 -- 172.21.15.29:0/333005011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d41559d0 con 0x7f11d406c150 2024-01-24T13:06:19.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11d8e00640 1 -- 172.21.15.29:0/333005011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d404e850 con 0x7f11d406c150 2024-01-24T13:06:19.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.614+0000 7f11ca000640 1 -- 172.21.15.29:0/333005011 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f11c40b2040 con 0x7f11d406c150 2024-01-24T13:06:19.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.618+0000 7f11ca000640 1 --2- 172.21.15.29:0/333005011 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f11ac065a60 0x7f11ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.618+0000 7f11ca000640 1 -- 172.21.15.29:0/333005011 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f11c411d2b0 con 0x7f11d406c150 2024-01-24T13:06:19.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.618+0000 7f11d1400640 1 --2- 172.21.15.29:0/333005011 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f11ac065a60 0x7f11ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.618+0000 7f11d1400640 1 --2- 172.21.15.29:0/333005011 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f11ac065a60 0x7f11ac067f20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f11d41525f0 tx=0x7f11bc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:19.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.622+0000 7f11ca000640 1 -- 172.21.15.29:0/333005011 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f11c40ea8b0 con 0x7f11d406c150 2024-01-24T13:06:19.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.810+0000 7f11d8e00640 1 -- 172.21.15.29:0/333005011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11d4165160 con 0x7f11d406c150 2024-01-24T13:06:19.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.810+0000 7f11ca000640 1 -- 172.21.15.29:0/333005011 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f11c40eded0 con 0x7f11d406c150 2024-01-24T13:06:19.813 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:19.813 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3468790539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3468790539},{"type":"v1","addr":"172.21.15.29:6834","nonce":3468790539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3278958688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3278958688},{"type":"v1","addr":"172.21.15.29:6835","nonce":3278958688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/1296970243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1296970243},{"type":"v1","addr":"172.21.15.163:6836","nonce":1296970243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:05:23.206301+0000","modified":"2024-01-24T13:05:36.732142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5463":{"gid":5463,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/140413977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":140413977},{"type":"v1","addr":"172.21.15.163:6837","nonce":140413977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-24T13:06:19.813 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-01-24T13:06:19.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.810+0000 7f11d8e00640 1 -- 172.21.15.29:0/333005011 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f11ac065a60 msgr2=0x7f11ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.810+0000 7f11d8e00640 1 --2- 172.21.15.29:0/333005011 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f11ac065a60 0x7f11ac067f20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f11d41525f0 tx=0x7f11bc008040 comp rx=0 tx=0).stop 2024-01-24T13:06:19.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.810+0000 7f11d8e00640 1 -- 172.21.15.29:0/333005011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406c150 msgr2=0x7f11d4153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.810+0000 7f11d8e00640 1 --2- 172.21.15.29:0/333005011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406c150 0x7f11d4153640 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f11c40ae040 tx=0x7f11c40191f0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.810+0000 7f11d8e00640 1 -- 172.21.15.29:0/333005011 shutdown_connections 2024-01-24T13:06:19.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.810+0000 7f11d8e00640 1 --2- 172.21.15.29:0/333005011 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f11ac065a60 0x7f11ac067f20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.810+0000 7f11d8e00640 1 --2- 172.21.15.29:0/333005011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11d4143910 0x7f11d4155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.810+0000 7f11d8e00640 1 --2- 172.21.15.29:0/333005011 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11d4070ac0 0x7f11d4137a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.810+0000 7f11d8e00640 1 --2- 172.21.15.29:0/333005011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406c150 0x7f11d4153640 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.810+0000 7f11d8e00640 1 -- 172.21.15.29:0/333005011 >> 172.21.15.29:0/333005011 conn(0x7f11d40b3950 msgr2=0x7f11d415abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:19.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.810+0000 7f11d8e00640 1 -- 172.21.15.29:0/333005011 shutdown_connections 2024-01-24T13:06:19.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.810+0000 7f11d8e00640 1 -- 172.21.15.29:0/333005011 wait complete. 2024-01-24T13:06:19.835 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:06:19.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe9e600640 1 Processor -- start 2024-01-24T13:06:19.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe9e600640 1 -- start start 2024-01-24T13:06:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe9e600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe9815c730 0x7fbe9806b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe9e600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbe980ccdb0 0x7fbe980cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe9e600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe980cd700 con 0x7fbe980b2700 2024-01-24T13:06:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe9e600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9806cc10 con 0x7fbe980ccdb0 2024-01-24T13:06:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe9e600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9806b7a0 con 0x7fbe9815c730 2024-01-24T13:06:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe97e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbe980ccdb0 0x7fbe980cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe97400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe9815c730 0x7fbe9806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe97400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe9815c730 0x7fbe9806b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:55818/0 (socket says 172.21.15.29:55818) 2024-01-24T13:06:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe97400640 1 -- 172.21.15.29:0/542776717 learned_addr learned my addr 172.21.15.29:0/542776717 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe97e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbe980ccdb0 0x7fbe980cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:55210/0 (socket says 172.21.15.29:55210) 2024-01-24T13:06:19.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe96a00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fbe980b2700 0x7fbe980ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:34840/0 (socket says 172.21.15.29:34840) 2024-01-24T13:06:19.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe97e00640 1 -- 172.21.15.29:0/542776717 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe9815c730 msgr2=0x7fbe9806b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:19.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe97e00640 1 --2- 172.21.15.29:0/542776717 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe9815c730 0x7fbe9806b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe97e00640 1 -- 172.21.15.29:0/542776717 >> v1:172.21.15.163:6789/0 conn(0x7fbe980b2700 legacy=0x7fbe980ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.974+0000 7fbe97e00640 1 -- 172.21.15.29:0/542776717 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9806ba80 con 0x7fbe980ccdb0 2024-01-24T13:06:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.978+0000 7fbe97e00640 1 --2- 172.21.15.29:0/542776717 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe980ccdb0 0x7fbe980cd1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009d90 tx=0x7fbe9001c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d8a1d3096de9e3f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.978+0000 7fbe96000640 1 -- 172.21.15.29:0/542776717 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900a5800 con 0x7fbe980ccdb0 2024-01-24T13:06:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.978+0000 7fbe96000640 1 -- 172.21.15.29:0/542776717 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe900a5960 con 0x7fbe980ccdb0 2024-01-24T13:06:19.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.978+0000 7fbe96000640 1 -- 172.21.15.29:0/542776717 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900a5cf0 con 0x7fbe980ccdb0 2024-01-24T13:06:19.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.978+0000 7fbe9e600640 1 -- 172.21.15.29:0/542776717 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe980ccdb0 msgr2=0x7fbe980cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.978+0000 7fbe9e600640 1 --2- 172.21.15.29:0/542776717 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe980ccdb0 0x7fbe980cd1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009d90 tx=0x7fbe9001c7e0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.978+0000 7fbe9e600640 1 -- 172.21.15.29:0/542776717 shutdown_connections 2024-01-24T13:06:19.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.978+0000 7fbe9e600640 1 --2- 172.21.15.29:0/542776717 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe980ccdb0 0x7fbe980cd1c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.978+0000 7fbe9e600640 1 --2- 172.21.15.29:0/542776717 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe9815c730 0x7fbe9806b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.978+0000 7fbe9e600640 1 -- 172.21.15.29:0/542776717 >> 172.21.15.29:0/542776717 conn(0x7fbe98070570 msgr2=0x7fbe98069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:19.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.978+0000 7fbe9e600640 1 -- 172.21.15.29:0/542776717 shutdown_connections 2024-01-24T13:06:19.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.978+0000 7fbe9e600640 1 -- 172.21.15.29:0/542776717 wait complete. 2024-01-24T13:06:19.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe9e600640 1 Processor -- start 2024-01-24T13:06:19.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe9e600640 1 -- start start 2024-01-24T13:06:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe9e600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe980b2700 0x7fbe980c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe9e600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe980ccdb0 0x7fbe980c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe9e600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe9815c730 0x7fbe98149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe9e600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe98154830 con 0x7fbe9815c730 2024-01-24T13:06:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe9e600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980c4ee0 con 0x7fbe980ccdb0 2024-01-24T13:06:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe9e600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980c6150 con 0x7fbe980b2700 2024-01-24T13:06:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe97e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe9815c730 0x7fbe98149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe97e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe9815c730 0x7fbe98149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33594/0 (socket says 172.21.15.29:33594) 2024-01-24T13:06:19.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe97e00640 1 -- 172.21.15.29:0/2948800104 learned_addr learned my addr 172.21.15.29:0/2948800104 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:19.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe96a00640 1 --2- 172.21.15.29:0/2948800104 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe980ccdb0 0x7fbe980c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe97400640 1 --2- 172.21.15.29:0/2948800104 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe980b2700 0x7fbe980c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe97e00640 1 -- 172.21.15.29:0/2948800104 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe980b2700 msgr2=0x7fbe980c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe97e00640 1 --2- 172.21.15.29:0/2948800104 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe980b2700 0x7fbe980c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe97e00640 1 -- 172.21.15.29:0/2948800104 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe980ccdb0 msgr2=0x7fbe980c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:19.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe97e00640 1 --2- 172.21.15.29:0/2948800104 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe980ccdb0 0x7fbe980c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:19.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe97e00640 1 -- 172.21.15.29:0/2948800104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe90009a70 con 0x7fbe9815c730 2024-01-24T13:06:19.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe97e00640 1 --2- 172.21.15.29:0/2948800104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe9815c730 0x7fbe98149ef0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fbe900b0040 tx=0x7fbe90019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:19.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe8f400640 1 -- 172.21.15.29:0/2948800104 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900adc00 con 0x7fbe9815c730 2024-01-24T13:06:19.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe8f400640 1 -- 172.21.15.29:0/2948800104 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe900add60 con 0x7fbe9815c730 2024-01-24T13:06:19.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe8f400640 1 -- 172.21.15.29:0/2948800104 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900b9690 con 0x7fbe9815c730 2024-01-24T13:06:19.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe9e600640 1 -- 172.21.15.29:0/2948800104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe980c6430 con 0x7fbe9815c730 2024-01-24T13:06:19.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.982+0000 7fbe9e600640 1 -- 172.21.15.29:0/2948800104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9814a430 con 0x7fbe9815c730 2024-01-24T13:06:19.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.986+0000 7fbe9e600640 1 -- 172.21.15.29:0/2948800104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe980cf430 con 0x7fbe9815c730 2024-01-24T13:06:19.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.986+0000 7fbe8f400640 1 -- 172.21.15.29:0/2948800104 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbe900b97f0 con 0x7fbe9815c730 2024-01-24T13:06:19.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.986+0000 7fbe8f400640 1 --2- 172.21.15.29:0/2948800104 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbe70065a60 0x7fbe70067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:19.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.986+0000 7fbe8f400640 1 -- 172.21.15.29:0/2948800104 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fbe9011eb00 con 0x7fbe9815c730 2024-01-24T13:06:19.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.986+0000 7fbe97400640 1 --2- 172.21.15.29:0/2948800104 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbe70065a60 0x7fbe70067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:19.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.986+0000 7fbe97400640 1 --2- 172.21.15.29:0/2948800104 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbe70065a60 0x7fbe70067f20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009ab0 tx=0x7fbe88009240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:19.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:19.990+0000 7fbe8f400640 1 -- 172.21.15.29:0/2948800104 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fbe90120e60 con 0x7fbe9815c730 2024-01-24T13:06:20.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.182+0000 7fbe9e600640 1 -- 172.21.15.29:0/2948800104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe980cf430 con 0x7fbe9815c730 2024-01-24T13:06:20.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.182+0000 7fbe8f400640 1 -- 172.21.15.29:0/2948800104 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4739 (secure 0 0 0) 0x7fbe900b2090 con 0x7fbe9815c730 2024-01-24T13:06:20.188 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:20.188 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3468790539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3468790539},{"type":"v1","addr":"172.21.15.29:6834","nonce":3468790539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3278958688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3278958688},{"type":"v1","addr":"172.21.15.29:6835","nonce":3278958688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/1296970243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1296970243},{"type":"v1","addr":"172.21.15.163:6836","nonce":1296970243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:05:23.206301+0000","modified":"2024-01-24T13:05:36.732142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5463":{"gid":5463,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6837/140413977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":140413977},{"type":"v1","addr":"172.21.15.163:6837","nonce":140413977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-24T13:06:20.188 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-01-24T13:06:20.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.186+0000 7fbe9e600640 1 -- 172.21.15.29:0/2948800104 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbe70065a60 msgr2=0x7fbe70067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.186+0000 7fbe9e600640 1 --2- 172.21.15.29:0/2948800104 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbe70065a60 0x7fbe70067f20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009ab0 tx=0x7fbe88009240 comp rx=0 tx=0).stop 2024-01-24T13:06:20.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.186+0000 7fbe9e600640 1 -- 172.21.15.29:0/2948800104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe9815c730 msgr2=0x7fbe98149ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.186+0000 7fbe9e600640 1 --2- 172.21.15.29:0/2948800104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe9815c730 0x7fbe98149ef0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fbe900b0040 tx=0x7fbe90019580 comp rx=0 tx=0).stop 2024-01-24T13:06:20.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.186+0000 7fbe9e600640 1 -- 172.21.15.29:0/2948800104 shutdown_connections 2024-01-24T13:06:20.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.186+0000 7fbe9e600640 1 --2- 172.21.15.29:0/2948800104 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fbe70065a60 0x7fbe70067f20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.186+0000 7fbe9e600640 1 --2- 172.21.15.29:0/2948800104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe9815c730 0x7fbe98149ef0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.186+0000 7fbe9e600640 1 --2- 172.21.15.29:0/2948800104 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe980ccdb0 0x7fbe980c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.186+0000 7fbe9e600640 1 --2- 172.21.15.29:0/2948800104 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe980b2700 0x7fbe980c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.186+0000 7fbe9e600640 1 -- 172.21.15.29:0/2948800104 >> 172.21.15.29:0/2948800104 conn(0x7fbe98070570 msgr2=0x7fbe98069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:20.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.186+0000 7fbe9e600640 1 -- 172.21.15.29:0/2948800104 shutdown_connections 2024-01-24T13:06:20.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.186+0000 7fbe9e600640 1 -- 172.21.15.29:0/2948800104 wait complete. 2024-01-24T13:06:20.210 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:06:20.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.346+0000 7f189a000640 1 Processor -- start 2024-01-24T13:06:20.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.346+0000 7f189a000640 1 -- start start 2024-01-24T13:06:20.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.350+0000 7f189a000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1894143910 0x7f1894143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:20.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.350+0000 7f189a000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189415aa30 con 0x7f1894070ac0 2024-01-24T13:06:20.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.350+0000 7f189a000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18940712a0 con 0x7f189406c320 2024-01-24T13:06:20.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.350+0000 7f189a000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1894071580 con 0x7f1894143910 2024-01-24T13:06:20.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.350+0000 7f1892a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1894070ac0 0x7f189406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44766/0 (socket says 172.21.15.29:44766) 2024-01-24T13:06:20.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.350+0000 7f1892a00640 1 -- 172.21.15.29:0/1558698818 learned_addr learned my addr 172.21.15.29:0/1558698818 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:20.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.350+0000 7f1893400640 1 --2- 172.21.15.29:0/1558698818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1894143910 0x7f1894143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:20.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.350+0000 7f1892000640 1 -- 172.21.15.29:0/1558698818 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976207121 0 0) 0x7f187c001120 con 0x7f1894070ac0 2024-01-24T13:06:20.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.350+0000 7f1892000640 1 -- 172.21.15.29:0/1558698818 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1874003530 con 0x7f1894070ac0 2024-01-24T13:06:20.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.350+0000 7f1892000640 1 -- 172.21.15.29:0/1558698818 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412619241 0 0) 0x7f18940712a0 con 0x7f189406c320 2024-01-24T13:06:20.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.350+0000 7f1892000640 1 -- 172.21.15.29:0/1558698818 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f187c001120 con 0x7f189406c320 2024-01-24T13:06:20.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.350+0000 7f1893400640 1 -- 172.21.15.29:0/1558698818 >> v1:172.21.15.163:6789/0 conn(0x7f189406c320 legacy=0x7f18940cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.350+0000 7f1893400640 1 -- 172.21.15.29:0/1558698818 >> v1:172.21.15.29:6789/0 conn(0x7f1894070ac0 legacy=0x7f189406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.350+0000 7f1893400640 1 -- 172.21.15.29:0/1558698818 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18940cd090 con 0x7f1894143910 2024-01-24T13:06:20.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.354+0000 7f1893400640 1 --2- 172.21.15.29:0/1558698818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1894143910 0x7f1894143d30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f18840097f0 tx=0x7f188401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d108c30de85bf2f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:20.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.354+0000 7f1892000640 1 -- 172.21.15.29:0/1558698818 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18840ab670 con 0x7f1894143910 2024-01-24T13:06:20.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.354+0000 7f1892000640 1 -- 172.21.15.29:0/1558698818 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18840ab7d0 con 0x7f1894143910 2024-01-24T13:06:20.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.354+0000 7f1892000640 1 -- 172.21.15.29:0/1558698818 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18840abb40 con 0x7f1894143910 2024-01-24T13:06:20.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.354+0000 7f189a000640 1 -- 172.21.15.29:0/1558698818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1894143910 msgr2=0x7f1894143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.354+0000 7f189a000640 1 --2- 172.21.15.29:0/1558698818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1894143910 0x7f1894143d30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f18840097f0 tx=0x7f188401c490 comp rx=0 tx=0).stop 2024-01-24T13:06:20.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.354+0000 7f189a000640 1 -- 172.21.15.29:0/1558698818 shutdown_connections 2024-01-24T13:06:20.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.354+0000 7f189a000640 1 --2- 172.21.15.29:0/1558698818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1894143910 0x7f1894143d30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.354+0000 7f189a000640 1 -- 172.21.15.29:0/1558698818 >> 172.21.15.29:0/1558698818 conn(0x7f18940b3950 msgr2=0x7f1894069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:20.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.354+0000 7f189a000640 1 -- 172.21.15.29:0/1558698818 shutdown_connections 2024-01-24T13:06:20.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.354+0000 7f189a000640 1 -- 172.21.15.29:0/1558698818 wait complete. 2024-01-24T13:06:20.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.354+0000 7f189a000640 1 Processor -- start 2024-01-24T13:06:20.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.354+0000 7f189a000640 1 -- start start 2024-01-24T13:06:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f189a000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f189406c320 0x7f189413c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f189a000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1894070ac0 0x7f1894140460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f189a000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894143910 0x7f189413e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f189a000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18941409a0 con 0x7f1894143910 2024-01-24T13:06:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f189a000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18940aee00 con 0x7f1894070ac0 2024-01-24T13:06:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f189a000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18940b07a0 con 0x7f189406c320 2024-01-24T13:06:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f1893e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894143910 0x7f189413e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f1893e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894143910 0x7f189413e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33608/0 (socket says 172.21.15.29:33608) 2024-01-24T13:06:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f1893e00640 1 -- 172.21.15.29:0/3869509666 learned_addr learned my addr 172.21.15.29:0/3869509666 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f1893400640 1 --2- 172.21.15.29:0/3869509666 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f189406c320 0x7f189413c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f1892a00640 1 --2- 172.21.15.29:0/3869509666 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1894070ac0 0x7f1894140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f1893e00640 1 -- 172.21.15.29:0/3869509666 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f189406c320 msgr2=0x7f189413c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f1893e00640 1 --2- 172.21.15.29:0/3869509666 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f189406c320 0x7f189413c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f1893e00640 1 -- 172.21.15.29:0/3869509666 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1894070ac0 msgr2=0x7f1894140460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f1893e00640 1 --2- 172.21.15.29:0/3869509666 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1894070ac0 0x7f1894140460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f1893e00640 1 -- 172.21.15.29:0/3869509666 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1884009420 con 0x7f1894143910 2024-01-24T13:06:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f1893e00640 1 --2- 172.21.15.29:0/3869509666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894143910 0x7f189413e710 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f188c00c7d0 tx=0x7f188c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f188b400640 1 -- 172.21.15.29:0/3869509666 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c003b80 con 0x7f1894143910 2024-01-24T13:06:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f188b400640 1 -- 172.21.15.29:0/3869509666 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c003ce0 con 0x7f1894143910 2024-01-24T13:06:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f188b400640 1 -- 172.21.15.29:0/3869509666 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00aa90 con 0x7f1894143910 2024-01-24T13:06:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f189a000640 1 -- 172.21.15.29:0/3869509666 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18940b0a80 con 0x7f1894143910 2024-01-24T13:06:20.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.358+0000 7f189a000640 1 -- 172.21.15.29:0/3869509666 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1894158680 con 0x7f1894143910 2024-01-24T13:06:20.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.362+0000 7f189a000640 1 -- 172.21.15.29:0/3869509666 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189404e850 con 0x7f1894143910 2024-01-24T13:06:20.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.362+0000 7f188b400640 1 -- 172.21.15.29:0/3869509666 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f188c00abf0 con 0x7f1894143910 2024-01-24T13:06:20.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.362+0000 7f188b400640 1 --2- 172.21.15.29:0/3869509666 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f186c065a60 0x7f186c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:20.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.362+0000 7f188b400640 1 -- 172.21.15.29:0/3869509666 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f188c083280 con 0x7f1894143910 2024-01-24T13:06:20.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.362+0000 7f1893400640 1 --2- 172.21.15.29:0/3869509666 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f186c065a60 0x7f186c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.362+0000 7f1893400640 1 --2- 172.21.15.29:0/3869509666 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f186c065a60 0x7f186c067f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f18840af000 tx=0x7f18840a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:20.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.366+0000 7f188b400640 1 -- 172.21.15.29:0/3869509666 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f188c050940 con 0x7f1894143910 2024-01-24T13:06:20.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.522+0000 7f189a000640 1 -- 172.21.15.29:0/3869509666 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18940aef40 con 0x7f1894143910 2024-01-24T13:06:20.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.526+0000 7f188b400640 1 -- 172.21.15.29:0/3869509666 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18163 (secure 0 0 0) 0x7f188c053f60 con 0x7f1894143910 2024-01-24T13:06:20.529 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:20.529 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":46,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:05:37.734611+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:05:21.225564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-24T13:05:22.188525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-01-24T13:05:35.873766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.6","mappings":[{"from":3,"to":2}]},{"pgid":"6.14","mappings":[{"from":4,"to":2}]},{"pgid":"6.24","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:06:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.526+0000 7f189a000640 1 -- 172.21.15.29:0/3869509666 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f186c065a60 msgr2=0x7f186c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.526+0000 7f189a000640 1 --2- 172.21.15.29:0/3869509666 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f186c065a60 0x7f186c067f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f18840af000 tx=0x7f18840a7000 comp rx=0 tx=0).stop 2024-01-24T13:06:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.526+0000 7f189a000640 1 -- 172.21.15.29:0/3869509666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894143910 msgr2=0x7f189413e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.526+0000 7f189a000640 1 --2- 172.21.15.29:0/3869509666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894143910 0x7f189413e710 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f188c00c7d0 tx=0x7f188c00cc90 comp rx=0 tx=0).stop 2024-01-24T13:06:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.526+0000 7f189a000640 1 -- 172.21.15.29:0/3869509666 shutdown_connections 2024-01-24T13:06:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.526+0000 7f189a000640 1 --2- 172.21.15.29:0/3869509666 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f186c065a60 0x7f186c067f20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.526+0000 7f189a000640 1 --2- 172.21.15.29:0/3869509666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894143910 0x7f189413e710 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.526+0000 7f189a000640 1 --2- 172.21.15.29:0/3869509666 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1894070ac0 0x7f1894140460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.526+0000 7f189a000640 1 --2- 172.21.15.29:0/3869509666 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f189406c320 0x7f189413c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.526+0000 7f189a000640 1 -- 172.21.15.29:0/3869509666 >> 172.21.15.29:0/3869509666 conn(0x7f18940b3950 msgr2=0x7f18940b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.526+0000 7f189a000640 1 -- 172.21.15.29:0/3869509666 shutdown_connections 2024-01-24T13:06:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.526+0000 7f189a000640 1 -- 172.21.15.29:0/3869509666 wait complete. 2024-01-24T13:06:20.551 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-24T13:06:20.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4507a00640 1 Processor -- start 2024-01-24T13:06:20.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4507a00640 1 -- start start 2024-01-24T13:06:20.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4507a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f45000cd460 0x7f45000d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:20.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4507a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f450015d870 0x7f45000ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:20.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4507a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45000ce9e0 con 0x7f45000ce5c0 2024-01-24T13:06:20.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4507a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45000d0830 con 0x7f45000cd460 2024-01-24T13:06:20.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4507a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45000d0b10 con 0x7f450015d870 2024-01-24T13:06:20.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4505a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f45000ce5c0 0x7f45001603e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44770/0 (socket says 172.21.15.29:44770) 2024-01-24T13:06:20.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4505a00640 1 -- 172.21.15.29:0/2671184131 learned_addr learned my addr 172.21.15.29:0/2671184131 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:20.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ffe00640 1 --2- 172.21.15.29:0/2671184131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f450015d870 0x7f45000ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:20.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4505000640 1 --2- 172.21.15.29:0/2671184131 >> v2:172.21.15.163:3300/0 conn(0x7f45000cd460 0x7f45000d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:20.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 -- 172.21.15.29:0/2671184131 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234732080 0 0) 0x7f45000ce9e0 con 0x7f45000ce5c0 2024-01-24T13:06:20.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 -- 172.21.15.29:0/2671184131 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44e0003530 con 0x7f45000ce5c0 2024-01-24T13:06:20.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 -- 172.21.15.29:0/2671184131 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1687515913 0 0) 0x7f44e0003530 con 0x7f45000ce5c0 2024-01-24T13:06:20.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 -- 172.21.15.29:0/2671184131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f450015d870 msgr2=0x7f45000ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:20.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 --2- 172.21.15.29:0/2671184131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f450015d870 0x7f45000ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 -- 172.21.15.29:0/2671184131 >> v2:172.21.15.163:3300/0 conn(0x7f45000cd460 msgr2=0x7f45000d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:20.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 --2- 172.21.15.29:0/2671184131 >> v2:172.21.15.163:3300/0 conn(0x7f45000cd460 0x7f45000d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 -- 172.21.15.29:0/2671184131 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45000d0df0 con 0x7f45000ce5c0 2024-01-24T13:06:20.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 -- 172.21.15.29:0/2671184131 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f44f8001a00 con 0x7f45000ce5c0 2024-01-24T13:06:20.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4505000640 1 --2- 172.21.15.29:0/2671184131 >> v2:172.21.15.163:3300/0 conn(0x7f45000cd460 0x7f45000d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:20.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 -- 172.21.15.29:0/2671184131 >> v1:172.21.15.29:6789/0 conn(0x7f45000ce5c0 legacy=0x7f45001603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 --2- 172.21.15.29:0/2671184131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44e0003980 0x7f44e0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:20.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 --2- 172.21.15.29:0/2671184131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f450015d870 0x7f44e00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:20.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 --2- 172.21.15.29:0/2671184131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44e0004d10 0x7f44e0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:20.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 -- 172.21.15.29:0/2671184131 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45000d0830 con 0x7f44e0003980 2024-01-24T13:06:20.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 -- 172.21.15.29:0/2671184131 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45000d0b10 con 0x7f44e0004d10 2024-01-24T13:06:20.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ff400640 1 -- 172.21.15.29:0/2671184131 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e000b990 con 0x7f450015d870 2024-01-24T13:06:20.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4505000640 1 --2- 172.21.15.29:0/2671184131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44e0003980 0x7f44e0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:20.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4505a00640 1 --2- 172.21.15.29:0/2671184131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44e0004d10 0x7f44e0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:20.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ffe00640 1 --2- 172.21.15.29:0/2671184131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f450015d870 0x7f44e00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:20.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4505000640 1 -- 172.21.15.29:0/2671184131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f450015d870 msgr2=0x7f44e00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:20.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4505000640 1 --2- 172.21.15.29:0/2671184131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f450015d870 0x7f44e00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4505000640 1 -- 172.21.15.29:0/2671184131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44e0004d10 msgr2=0x7f44e0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:20.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4505000640 1 --2- 172.21.15.29:0/2671184131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44e0004d10 0x7f44e0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4505000640 1 -- 172.21.15.29:0/2671184131 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0003530 con 0x7f44e0003980 2024-01-24T13:06:20.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f4505a00640 1 --2- 172.21.15.29:0/2671184131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44e0004d10 0x7f44e0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:20.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.690+0000 7f44ffe00640 1 --2- 172.21.15.29:0/2671184131 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f450015d870 0x7f44e00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:20.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.694+0000 7f4505000640 1 --2- 172.21.15.29:0/2671184131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44e0003980 0x7f44e0003da0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009cb0 tx=0x7f44f001cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ce0eb8811b5f05 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:20.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.694+0000 7f44ff400640 1 -- 172.21.15.29:0/2671184131 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00a5820 con 0x7f44e0003980 2024-01-24T13:06:20.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.694+0000 7f44ff400640 1 -- 172.21.15.29:0/2671184131 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f00a5980 con 0x7f44e0003980 2024-01-24T13:06:20.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.694+0000 7f44ff400640 1 -- 172.21.15.29:0/2671184131 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00a5d30 con 0x7f44e0003980 2024-01-24T13:06:20.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.694+0000 7f4507a00640 1 -- 172.21.15.29:0/2671184131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44e0003980 msgr2=0x7f44e0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.694+0000 7f4507a00640 1 --2- 172.21.15.29:0/2671184131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44e0003980 0x7f44e0003da0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009cb0 tx=0x7f44f001cc70 comp rx=0 tx=0).stop 2024-01-24T13:06:20.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.694+0000 7f4505a00640 1 -- 172.21.15.29:0/2671184131 reap_dead start 2024-01-24T13:06:20.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.694+0000 7f4507a00640 1 -- 172.21.15.29:0/2671184131 shutdown_connections 2024-01-24T13:06:20.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.694+0000 7f4507a00640 1 -- 172.21.15.29:0/2671184131 >> 172.21.15.29:0/2671184131 conn(0x7f4500069cd0 msgr2=0x7f450006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:20.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.694+0000 7f4507a00640 1 -- 172.21.15.29:0/2671184131 shutdown_connections 2024-01-24T13:06:20.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.694+0000 7f4507a00640 1 -- 172.21.15.29:0/2671184131 wait complete. 2024-01-24T13:06:20.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4507a00640 1 Processor -- start 2024-01-24T13:06:20.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4507a00640 1 -- start start 2024-01-24T13:06:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4507a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44e0003980 0x7f45000c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4507a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45000c9380 0x7f45001556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4507a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4500147370 0x7f45001477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4507a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45000b38f0 con 0x7f44e0003980 2024-01-24T13:06:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4507a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4500147d30 con 0x7f4500147370 2024-01-24T13:06:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4507a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45000c9910 con 0x7f45000c9380 2024-01-24T13:06:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4505000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44e0003980 0x7f45000c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4505000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44e0003980 0x7f45000c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33628/0 (socket says 172.21.15.29:33628) 2024-01-24T13:06:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4505000640 1 -- 172.21.15.29:0/2985993606 learned_addr learned my addr 172.21.15.29:0/2985993606 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4505a00640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4500147370 0x7f45001477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f44ffe00640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45000c9380 0x7f45001556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4505000640 1 -- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45000c9380 msgr2=0x7f45001556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4505000640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45000c9380 0x7f45001556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4505000640 1 -- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4500147370 msgr2=0x7f45001477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4505000640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4500147370 0x7f45001477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4505000640 1 -- 172.21.15.29:0/2985993606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45000c9bf0 con 0x7f44e0003980 2024-01-24T13:06:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4505a00640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4500147370 0x7f45001477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4505000640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44e0003980 0x7f45000c69b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f44f00b0040 tx=0x7f44e0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f44fcc00640 1 -- 172.21.15.29:0/2985993606 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0004020 con 0x7f44e0003980 2024-01-24T13:06:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f44fcc00640 1 -- 172.21.15.29:0/2985993606 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f0004180 con 0x7f44e0003980 2024-01-24T13:06:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f44fcc00640 1 -- 172.21.15.29:0/2985993606 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0003620 con 0x7f44e0003980 2024-01-24T13:06:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.698+0000 7f4507a00640 1 -- 172.21.15.29:0/2985993606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45000c9ed0 con 0x7f44e0003980 2024-01-24T13:06:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.702+0000 7f4507a00640 1 -- 172.21.15.29:0/2985993606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45000ca490 con 0x7f44e0003980 2024-01-24T13:06:20.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.702+0000 7f4507a00640 1 -- 172.21.15.29:0/2985993606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45000b3880 con 0x7f44e0003980 2024-01-24T13:06:20.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.702+0000 7f44fcc00640 1 -- 172.21.15.29:0/2985993606 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f44f00b4040 con 0x7f44e0003980 2024-01-24T13:06:20.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.702+0000 7f44fcc00640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f44d8065a60 0x7f44d8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:20.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.702+0000 7f44fcc00640 1 -- 172.21.15.29:0/2985993606 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f44f011d640 con 0x7f44e0003980 2024-01-24T13:06:20.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.702+0000 7f44ffe00640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f44d8065a60 0x7f44d8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:20.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.702+0000 7f44ffe00640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f44d8065a60 0x7f44d8067f20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f45001451b0 tx=0x7f44e8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:20.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.706+0000 7f44fcc00640 1 -- 172.21.15.29:0/2985993606 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f44f00eacf0 con 0x7f44e0003980 2024-01-24T13:06:20.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.898+0000 7f4507a00640 1 -- 172.21.15.29:0/2985993606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f450004e850 con 0x7f44e0003980 2024-01-24T13:06:20.904 INFO:tasks.ceph.mon.a.smithi029.stderr:2024-01-24T13:06:20.898+0000 7f8d5fe00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-24T13:06:20.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.910+0000 7f44fcc00640 1 -- 172.21.15.29:0/2985993606 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f44f00ee310 con 0x7f44e0003980 2024-01-24T13:06:20.914 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-24T13:06:20.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.910+0000 7f4507a00640 1 -- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f44d8065a60 msgr2=0x7f44d8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.910+0000 7f4507a00640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f44d8065a60 0x7f44d8067f20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f45001451b0 tx=0x7f44e8008040 comp rx=0 tx=0).stop 2024-01-24T13:06:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.910+0000 7f4507a00640 1 -- 172.21.15.29:0/2985993606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44e0003980 msgr2=0x7f45000c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.910+0000 7f4507a00640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44e0003980 0x7f45000c69b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f44f00b0040 tx=0x7f44e0005800 comp rx=0 tx=0).stop 2024-01-24T13:06:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.914+0000 7f4507a00640 1 -- 172.21.15.29:0/2985993606 shutdown_connections 2024-01-24T13:06:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.914+0000 7f4507a00640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f44d8065a60 0x7f44d8067f20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.914+0000 7f4507a00640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4500147370 0x7f45001477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.914+0000 7f4507a00640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45000c9380 0x7f45001556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.914+0000 7f4507a00640 1 --2- 172.21.15.29:0/2985993606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44e0003980 0x7f45000c69b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.914+0000 7f4507a00640 1 -- 172.21.15.29:0/2985993606 >> 172.21.15.29:0/2985993606 conn(0x7f4500069cd0 msgr2=0x7f4500160360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:20.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.914+0000 7f4507a00640 1 -- 172.21.15.29:0/2985993606 shutdown_connections 2024-01-24T13:06:20.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:20.914+0000 7f4507a00640 1 -- 172.21.15.29:0/2985993606 wait complete. 2024-01-24T13:06:20.922 INFO:tasks.ceph.mds.b.smithi163.stderr: -3850> 2024-01-24T13:05:26.773+0000 7fa1f5000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-24T13:06:20.938 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-24T13:06:20.971 INFO:tasks.ceph.mds.b.smithi163.stdout:starting mds.b at 2024-01-24T13:06:21.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb13b200640 1 Processor -- start 2024-01-24T13:06:21.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb13b200640 1 -- start start 2024-01-24T13:06:21.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb13b200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb13415d070 0x7fb13415d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:21.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb13b200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb13406ade0 0x7fb13406b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:21.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb13b200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13415de00 con 0x7fb1340ccdb0 2024-01-24T13:06:21.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb13b200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb134157380 con 0x7fb13415d070 2024-01-24T13:06:21.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb13b200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1340d0040 con 0x7fb13406ade0 2024-01-24T13:06:21.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb133400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb13415d070 0x7fb13415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:21.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb133400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb13415d070 0x7fb13415d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36052/0 (socket says 172.21.15.29:36052) 2024-01-24T13:06:21.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb133400640 1 -- 172.21.15.29:0/323735275 learned_addr learned my addr 172.21.15.29:0/323735275 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:21.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb139200640 1 --2- 172.21.15.29:0/323735275 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb13406ade0 0x7fb13406b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:21.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb133400640 1 -- 172.21.15.29:0/323735275 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb13406ade0 msgr2=0x7fb13406b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:21.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb133400640 1 --2- 172.21.15.29:0/323735275 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb13406ade0 0x7fb13406b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:21.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb133400640 1 -- 172.21.15.29:0/323735275 >> v1:172.21.15.163:6789/0 conn(0x7fb1340ccdb0 legacy=0x7fb1340cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:21.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.090+0000 7fb133400640 1 -- 172.21.15.29:0/323735275 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1340d0250 con 0x7fb13415d070 2024-01-24T13:06:21.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.094+0000 7fb133400640 1 --2- 172.21.15.29:0/323735275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb13415d070 0x7fb13415d520 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb11c009870 tx=0x7fb11c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68a0be5e800eaea server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:21.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.094+0000 7fb132a00640 1 -- 172.21.15.29:0/323735275 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0aa430 con 0x7fb13415d070 2024-01-24T13:06:21.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.094+0000 7fb132a00640 1 -- 172.21.15.29:0/323735275 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c0aa590 con 0x7fb13415d070 2024-01-24T13:06:21.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.094+0000 7fb132a00640 1 -- 172.21.15.29:0/323735275 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0aa920 con 0x7fb13415d070 2024-01-24T13:06:21.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.094+0000 7fb13b200640 1 -- 172.21.15.29:0/323735275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb13415d070 msgr2=0x7fb13415d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:21.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.094+0000 7fb13b200640 1 --2- 172.21.15.29:0/323735275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb13415d070 0x7fb13415d520 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb11c009870 tx=0x7fb11c01c4d0 comp rx=0 tx=0).stop 2024-01-24T13:06:21.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.094+0000 7fb13b200640 1 -- 172.21.15.29:0/323735275 shutdown_connections 2024-01-24T13:06:21.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.094+0000 7fb13b200640 1 --2- 172.21.15.29:0/323735275 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb13406ade0 0x7fb13406b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:21.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.094+0000 7fb13b200640 1 --2- 172.21.15.29:0/323735275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb13415d070 0x7fb13415d520 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:21.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.094+0000 7fb13b200640 1 -- 172.21.15.29:0/323735275 >> 172.21.15.29:0/323735275 conn(0x7fb1340705d0 msgr2=0x7fb134069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:21.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.094+0000 7fb13b200640 1 -- 172.21.15.29:0/323735275 shutdown_connections 2024-01-24T13:06:21.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.094+0000 7fb13b200640 1 -- 172.21.15.29:0/323735275 wait complete. 2024-01-24T13:06:21.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb13b200640 1 Processor -- start 2024-01-24T13:06:21.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb13b200640 1 -- start start 2024-01-24T13:06:21.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb13b200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb13406ade0 0x7fb134150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:21.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb13b200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1340ccdb0 0x7fb134157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:21.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb13b200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb13415d070 0x7fb1340b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:21.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb13b200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1341511f0 con 0x7fb13415d070 2024-01-24T13:06:21.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb13b200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb134151440 con 0x7fb1340ccdb0 2024-01-24T13:06:21.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb13b200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb134151720 con 0x7fb13406ade0 2024-01-24T13:06:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb139200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb13415d070 0x7fb1340b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb139200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb13415d070 0x7fb1340b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36060/0 (socket says 172.21.15.29:36060) 2024-01-24T13:06:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb139200640 1 -- 172.21.15.29:0/2086977846 learned_addr learned my addr 172.21.15.29:0/2086977846 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb133400640 1 --2- 172.21.15.29:0/2086977846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1340ccdb0 0x7fb134157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb133e00640 1 --2- 172.21.15.29:0/2086977846 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb13406ade0 0x7fb134150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb139200640 1 -- 172.21.15.29:0/2086977846 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb13406ade0 msgr2=0x7fb134150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb139200640 1 --2- 172.21.15.29:0/2086977846 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb13406ade0 0x7fb134150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb139200640 1 -- 172.21.15.29:0/2086977846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1340ccdb0 msgr2=0x7fb134157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb139200640 1 --2- 172.21.15.29:0/2086977846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1340ccdb0 0x7fb134157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb139200640 1 -- 172.21.15.29:0/2086977846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c0094d0 con 0x7fb13415d070 2024-01-24T13:06:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb139200640 1 --2- 172.21.15.29:0/2086977846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb13415d070 0x7fb1340b45b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb12c007e40 tx=0x7fb12c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb12be00640 1 -- 172.21.15.29:0/2086977846 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c014620 con 0x7fb13415d070 2024-01-24T13:06:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb12be00640 1 -- 172.21.15.29:0/2086977846 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c00ee90 con 0x7fb13415d070 2024-01-24T13:06:21.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb13b200640 1 -- 172.21.15.29:0/2086977846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb134151a00 con 0x7fb13415d070 2024-01-24T13:06:21.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb12be00640 1 -- 172.21.15.29:0/2086977846 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0149e0 con 0x7fb13415d070 2024-01-24T13:06:21.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.098+0000 7fb13b200640 1 -- 172.21.15.29:0/2086977846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb134150ed0 con 0x7fb13415d070 2024-01-24T13:06:21.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.102+0000 7fb13b200640 1 -- 172.21.15.29:0/2086977846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13404e850 con 0x7fb13415d070 2024-01-24T13:06:21.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.102+0000 7fb12be00640 1 -- 172.21.15.29:0/2086977846 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb12c014b40 con 0x7fb13415d070 2024-01-24T13:06:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.102+0000 7fb12be00640 1 --2- 172.21.15.29:0/2086977846 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb10c065a60 0x7fb10c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.102+0000 7fb12be00640 1 -- 172.21.15.29:0/2086977846 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fb12c083da0 con 0x7fb13415d070 2024-01-24T13:06:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.102+0000 7fb133e00640 1 --2- 172.21.15.29:0/2086977846 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb10c065a60 0x7fb10c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:21.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.106+0000 7fb133e00640 1 --2- 172.21.15.29:0/2086977846 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb10c065a60 0x7fb10c067f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb124007fd0 tx=0x7fb124009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:21.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.106+0000 7fb12be00640 1 -- 172.21.15.29:0/2086977846 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb12c051480 con 0x7fb13415d070 2024-01-24T13:06:21.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.298+0000 7fb13b200640 1 -- 172.21.15.29:0/2086977846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb1340b29c0 con 0x7fb13415d070 2024-01-24T13:06:21.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.914+0000 7fb12be00640 1 -- 172.21.15.29:0/2086977846 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb12c054aa0 con 0x7fb13415d070 2024-01-24T13:06:21.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.914+0000 7fb13b200640 1 -- 172.21.15.29:0/2086977846 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb10c065a60 msgr2=0x7fb10c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:21.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.914+0000 7fb13b200640 1 --2- 172.21.15.29:0/2086977846 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb10c065a60 0x7fb10c067f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb124007fd0 tx=0x7fb124009040 comp rx=0 tx=0).stop 2024-01-24T13:06:21.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.914+0000 7fb13b200640 1 -- 172.21.15.29:0/2086977846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb13415d070 msgr2=0x7fb1340b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:21.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.914+0000 7fb13b200640 1 --2- 172.21.15.29:0/2086977846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb13415d070 0x7fb1340b45b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb12c007e40 tx=0x7fb12c00e4b0 comp rx=0 tx=0).stop 2024-01-24T13:06:21.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.914+0000 7fb13b200640 1 -- 172.21.15.29:0/2086977846 shutdown_connections 2024-01-24T13:06:21.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.914+0000 7fb13b200640 1 --2- 172.21.15.29:0/2086977846 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb10c065a60 0x7fb10c067f20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:21.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.914+0000 7fb13b200640 1 --2- 172.21.15.29:0/2086977846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb13415d070 0x7fb1340b45b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:21.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.914+0000 7fb13b200640 1 --2- 172.21.15.29:0/2086977846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1340ccdb0 0x7fb134157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:21.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.914+0000 7fb13b200640 1 --2- 172.21.15.29:0/2086977846 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb13406ade0 0x7fb134150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:21.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.914+0000 7fb13b200640 1 -- 172.21.15.29:0/2086977846 >> 172.21.15.29:0/2086977846 conn(0x7fb1340705d0 msgr2=0x7fb13415c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:21.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.914+0000 7fb13b200640 1 -- 172.21.15.29:0/2086977846 shutdown_connections 2024-01-24T13:06:21.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:21.914+0000 7fb13b200640 1 -- 172.21.15.29:0/2086977846 wait complete. 2024-01-24T13:06:21.942 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-24T13:06:22.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d8800640 1 Processor -- start 2024-01-24T13:06:22.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d8800640 1 -- start start 2024-01-24T13:06:22.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d8800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1d00cd460 0x7fd1d00d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:22.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d8800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd1d00ce790 0x7fd1d006b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:22.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d8800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d00d0830 con 0x7fd1d015d870 2024-01-24T13:06:22.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d8800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d00d0b10 con 0x7fd1d00ce790 2024-01-24T13:06:22.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d8800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00d0df0 con 0x7fd1d00cd460 2024-01-24T13:06:22.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d6800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd1d00ce790 0x7fd1d006b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:22.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d5400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd1d015d870 0x7fd1d00ce080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44832/0 (socket says 172.21.15.29:44832) 2024-01-24T13:06:22.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d6800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd1d00ce790 0x7fd1d006b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36062/0 (socket says 172.21.15.29:36062) 2024-01-24T13:06:22.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d5400640 1 -- 172.21.15.29:0/3249773724 learned_addr learned my addr 172.21.15.29:0/3249773724 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:22.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d5e00640 1 --2- 172.21.15.29:0/3249773724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1d00cd460 0x7fd1d00d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:22.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d6800640 1 -- 172.21.15.29:0/3249773724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1d00cd460 msgr2=0x7fd1d00d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:22.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d6800640 1 --2- 172.21.15.29:0/3249773724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1d00cd460 0x7fd1d00d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:22.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d6800640 1 -- 172.21.15.29:0/3249773724 >> v1:172.21.15.29:6789/0 conn(0x7fd1d015d870 legacy=0x7fd1d00ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:22.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d6800640 1 -- 172.21.15.29:0/3249773724 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00d10d0 con 0x7fd1d00ce790 2024-01-24T13:06:22.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.086+0000 7fd1d4a00640 1 -- 172.21.15.29:0/3249773724 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488420475 0 0) 0x7fd1d00d0830 con 0x7fd1d015d870 2024-01-24T13:06:22.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.090+0000 7fd1d6800640 1 --2- 172.21.15.29:0/3249773724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00ce790 0x7fd1d006b1a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009d90 tx=0x7fd1c801c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e58cc5bd63ed96f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:22.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.090+0000 7fd1d4a00640 1 -- 172.21.15.29:0/3249773724 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80a5850 con 0x7fd1d00ce790 2024-01-24T13:06:22.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.090+0000 7fd1d4a00640 1 -- 172.21.15.29:0/3249773724 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c80a59b0 con 0x7fd1d00ce790 2024-01-24T13:06:22.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.090+0000 7fd1d4a00640 1 -- 172.21.15.29:0/3249773724 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80a5d40 con 0x7fd1d00ce790 2024-01-24T13:06:22.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.090+0000 7fd1d8800640 1 -- 172.21.15.29:0/3249773724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00ce790 msgr2=0x7fd1d006b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:22.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.090+0000 7fd1d8800640 1 --2- 172.21.15.29:0/3249773724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00ce790 0x7fd1d006b1a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009d90 tx=0x7fd1c801c860 comp rx=0 tx=0).stop 2024-01-24T13:06:22.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.090+0000 7fd1d8800640 1 -- 172.21.15.29:0/3249773724 shutdown_connections 2024-01-24T13:06:22.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.090+0000 7fd1d8800640 1 --2- 172.21.15.29:0/3249773724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00ce790 0x7fd1d006b1a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:22.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.090+0000 7fd1d8800640 1 --2- 172.21.15.29:0/3249773724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1d00cd460 0x7fd1d00d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:22.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.090+0000 7fd1d8800640 1 -- 172.21.15.29:0/3249773724 >> 172.21.15.29:0/3249773724 conn(0x7fd1d0069cd0 msgr2=0x7fd1d006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:22.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.090+0000 7fd1d8800640 1 -- 172.21.15.29:0/3249773724 shutdown_connections 2024-01-24T13:06:22.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.090+0000 7fd1d8800640 1 -- 172.21.15.29:0/3249773724 wait complete. 2024-01-24T13:06:22.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d8800640 1 Processor -- start 2024-01-24T13:06:22.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d8800640 1 -- start start 2024-01-24T13:06:22.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d8800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00cd460 0x7fd1d014b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:22.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d8800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1d00ce790 0x7fd1d00c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:22.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d8800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1d015d870 0x7fd1d00c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:22.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d8800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d014b5c0 con 0x7fd1d00cd460 2024-01-24T13:06:22.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d8800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00c5b10 con 0x7fd1d00ce790 2024-01-24T13:06:22.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d8800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d0154850 con 0x7fd1d015d870 2024-01-24T13:06:22.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d5e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00cd460 0x7fd1d014b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d5e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00cd460 0x7fd1d014b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36076/0 (socket says 172.21.15.29:36076) 2024-01-24T13:06:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d5e00640 1 -- 172.21.15.29:0/3734754124 learned_addr learned my addr 172.21.15.29:0/3734754124 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d6800640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1d015d870 0x7fd1d00c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d5e00640 1 -- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1d015d870 msgr2=0x7fd1d00c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d5400640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1d00ce790 0x7fd1d00c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d5e00640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1d015d870 0x7fd1d00c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d5e00640 1 -- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1d00ce790 msgr2=0x7fd1d00c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d5e00640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1d00ce790 0x7fd1d00c4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d5e00640 1 -- 172.21.15.29:0/3734754124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8009a70 con 0x7fd1d00cd460 2024-01-24T13:06:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d5400640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1d00ce790 0x7fd1d00c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d5e00640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00cd460 0x7fd1d014b080 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000d800 tx=0x7fd1c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1ce000640 1 -- 172.21.15.29:0/3734754124 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c000b6c0 con 0x7fd1d00cd460 2024-01-24T13:06:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1ce000640 1 -- 172.21.15.29:0/3734754124 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c000b820 con 0x7fd1d00cd460 2024-01-24T13:06:22.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1d8800640 1 -- 172.21.15.29:0/3734754124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d0154b30 con 0x7fd1d00cd460 2024-01-24T13:06:22.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.094+0000 7fd1ce000640 1 -- 172.21.15.29:0/3734754124 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c000bb90 con 0x7fd1d00cd460 2024-01-24T13:06:22.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.098+0000 7fd1d8800640 1 -- 172.21.15.29:0/3734754124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d01550f0 con 0x7fd1d00cd460 2024-01-24T13:06:22.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.098+0000 7fd1d8800640 1 -- 172.21.15.29:0/3734754124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d004e000 con 0x7fd1d00cd460 2024-01-24T13:06:22.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.098+0000 7fd1ce000640 1 -- 172.21.15.29:0/3734754124 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd1c000bcf0 con 0x7fd1d00cd460 2024-01-24T13:06:22.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.098+0000 7fd1ce000640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd1a8065a60 0x7fd1a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:22.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.098+0000 7fd1ce000640 1 -- 172.21.15.29:0/3734754124 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fd1c0083b40 con 0x7fd1d00cd460 2024-01-24T13:06:22.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.098+0000 7fd1d5400640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd1a8065a60 0x7fd1a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:22.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.102+0000 7fd1d5400640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd1a8065a60 0x7fd1a8067f20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8007fd0 tx=0x7fd1b8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:22.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.102+0000 7fd1ce000640 1 -- 172.21.15.29:0/3734754124 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd1c00510e0 con 0x7fd1d00cd460 2024-01-24T13:06:22.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.262+0000 7fd1d8800640 1 -- 172.21.15.29:0/3734754124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd1d00b6430 con 0x7fd1d00cd460 2024-01-24T13:06:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2024-01-24T13:06:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.914+0000 7fd1ce000640 1 -- 172.21.15.29:0/3734754124 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd1c0054700 con 0x7fd1d00cd460 2024-01-24T13:06:22.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.918+0000 7fd1d8800640 1 -- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd1a8065a60 msgr2=0x7fd1a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:22.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.918+0000 7fd1d8800640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd1a8065a60 0x7fd1a8067f20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8007fd0 tx=0x7fd1b8009040 comp rx=0 tx=0).stop 2024-01-24T13:06:22.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.918+0000 7fd1d8800640 1 -- 172.21.15.29:0/3734754124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00cd460 msgr2=0x7fd1d014b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:22.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.918+0000 7fd1d8800640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00cd460 0x7fd1d014b080 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000d800 tx=0x7fd1c000dcc0 comp rx=0 tx=0).stop 2024-01-24T13:06:22.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.918+0000 7fd1d8800640 1 -- 172.21.15.29:0/3734754124 shutdown_connections 2024-01-24T13:06:22.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.918+0000 7fd1d8800640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd1a8065a60 0x7fd1a8067f20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:22.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.918+0000 7fd1d8800640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd1d015d870 0x7fd1d00c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:22.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.918+0000 7fd1d8800640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1d00ce790 0x7fd1d00c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:22.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.918+0000 7fd1d8800640 1 --2- 172.21.15.29:0/3734754124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00cd460 0x7fd1d014b080 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:22.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.918+0000 7fd1d8800640 1 -- 172.21.15.29:0/3734754124 >> 172.21.15.29:0/3734754124 conn(0x7fd1d0069cd0 msgr2=0x7fd1d00ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:22.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.918+0000 7fd1d8800640 1 -- 172.21.15.29:0/3734754124 shutdown_connections 2024-01-24T13:06:22.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:22.918+0000 7fd1d8800640 1 -- 172.21.15.29:0/3734754124 wait complete. 2024-01-24T13:06:22.947 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-24T13:06:23.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.090+0000 7f3c29c00640 1 Processor -- start 2024-01-24T13:06:23.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.090+0000 7f3c29c00640 1 -- start start 2024-01-24T13:06:23.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.094+0000 7f3c29c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c240d0e50 0x7f3c240cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:23.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.094+0000 7f3c29c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3c240cb040 0x7f3c240ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:23.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.094+0000 7f3c29c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c240d0400 con 0x7f3c240cd420 2024-01-24T13:06:23.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.094+0000 7f3c29c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c240cb4d0 con 0x7f3c240cb040 2024-01-24T13:06:23.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.094+0000 7f3c29c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240d09c0 con 0x7f3c240d0e50 2024-01-24T13:06:23.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.094+0000 7f3c22000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c240d0e50 0x7f3c240cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:23.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.094+0000 7f3c23400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3c240cb040 0x7f3c240ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:23.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.094+0000 7f3c23400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3c240cb040 0x7f3c240ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:55784/0 (socket says 172.21.15.29:55784) 2024-01-24T13:06:23.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.094+0000 7f3c23400640 1 -- 172.21.15.29:0/2245266788 learned_addr learned my addr 172.21.15.29:0/2245266788 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:23.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.094+0000 7f3c22000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c240d0e50 0x7f3c240cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:44450/0 (socket says 172.21.15.29:44450) 2024-01-24T13:06:23.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.094+0000 7f3c23400640 1 -- 172.21.15.29:0/2245266788 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c240d0e50 msgr2=0x7f3c240cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:23.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.094+0000 7f3c23400640 1 --2- 172.21.15.29:0/2245266788 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c240d0e50 0x7f3c240cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:23.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.094+0000 7f3c23400640 1 -- 172.21.15.29:0/2245266788 >> v1:172.21.15.163:6789/0 conn(0x7f3c240cd420 legacy=0x7f3c2415ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:23.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.094+0000 7f3c23400640 1 -- 172.21.15.29:0/2245266788 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240d12b0 con 0x7f3c240cb040 2024-01-24T13:06:23.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.098+0000 7f3c23400640 1 --2- 172.21.15.29:0/2245266788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c240cb040 0x7f3c240ce080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009e50 tx=0x7f3c1c01c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2865de12ce165595 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:23.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.098+0000 7f3c21600640 1 -- 172.21.15.29:0/2245266788 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c240cedd0 con 0x7f3c240cb040 2024-01-24T13:06:23.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.098+0000 7f3c21600640 1 -- 172.21.15.29:0/2245266788 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c0a58a0 con 0x7f3c240cb040 2024-01-24T13:06:23.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.098+0000 7f3c21600640 1 -- 172.21.15.29:0/2245266788 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0a5c30 con 0x7f3c240cb040 2024-01-24T13:06:23.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.098+0000 7f3c29c00640 1 -- 172.21.15.29:0/2245266788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c240cb040 msgr2=0x7f3c240ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:23.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.098+0000 7f3c29c00640 1 --2- 172.21.15.29:0/2245266788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c240cb040 0x7f3c240ce080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009e50 tx=0x7f3c1c01c9e0 comp rx=0 tx=0).stop 2024-01-24T13:06:23.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.098+0000 7f3c29c00640 1 -- 172.21.15.29:0/2245266788 shutdown_connections 2024-01-24T13:06:23.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.098+0000 7f3c29c00640 1 --2- 172.21.15.29:0/2245266788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c240cb040 0x7f3c240ce080 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:23.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.098+0000 7f3c29c00640 1 --2- 172.21.15.29:0/2245266788 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c240d0e50 0x7f3c240cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:23.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.098+0000 7f3c29c00640 1 -- 172.21.15.29:0/2245266788 >> 172.21.15.29:0/2245266788 conn(0x7f3c24069cd0 msgr2=0x7f3c2406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:23.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.098+0000 7f3c29c00640 1 -- 172.21.15.29:0/2245266788 shutdown_connections 2024-01-24T13:06:23.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.098+0000 7f3c29c00640 1 -- 172.21.15.29:0/2245266788 wait complete. 2024-01-24T13:06:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c29c00640 1 Processor -- start 2024-01-24T13:06:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c29c00640 1 -- start start 2024-01-24T13:06:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c29c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c240cb040 0x7f3c24153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c29c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c240cd420 0x7f3c2415e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c29c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c240d0e50 0x7f3c24153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c29c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240ca640 con 0x7f3c240d0e50 2024-01-24T13:06:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c29c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2415d1e0 con 0x7f3c240cd420 2024-01-24T13:06:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c29c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2415d4c0 con 0x7f3c240cb040 2024-01-24T13:06:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c23400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c240d0e50 0x7f3c24153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c23400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c240d0e50 0x7f3c24153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36086/0 (socket says 172.21.15.29:36086) 2024-01-24T13:06:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c23400640 1 -- 172.21.15.29:0/2223966294 learned_addr learned my addr 172.21.15.29:0/2223966294 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c22a00640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c240cb040 0x7f3c24153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c22000640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c240cd420 0x7f3c2415e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c23400640 1 -- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c240cb040 msgr2=0x7f3c24153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c23400640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c240cb040 0x7f3c24153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c23400640 1 -- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c240cd420 msgr2=0x7f3c2415e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c23400640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c240cd420 0x7f3c2415e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:23.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c23400640 1 -- 172.21.15.29:0/2223966294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c009b30 con 0x7f3c240d0e50 2024-01-24T13:06:23.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c22a00640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c240cb040 0x7f3c24153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:23.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c23400640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c240d0e50 0x7f3c24153a70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0af040 tx=0x7f3c1c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:23.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c1aa00640 1 -- 172.21.15.29:0/2223966294 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0b8670 con 0x7f3c240d0e50 2024-01-24T13:06:23.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c1aa00640 1 -- 172.21.15.29:0/2223966294 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c0b87d0 con 0x7f3c240d0e50 2024-01-24T13:06:23.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c29c00640 1 -- 172.21.15.29:0/2223966294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2415d7a0 con 0x7f3c240d0e50 2024-01-24T13:06:23.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c1aa00640 1 -- 172.21.15.29:0/2223966294 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0b8b80 con 0x7f3c240d0e50 2024-01-24T13:06:23.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c29c00640 1 -- 172.21.15.29:0/2223966294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2415dd60 con 0x7f3c240d0e50 2024-01-24T13:06:23.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.102+0000 7f3c29c00640 1 -- 172.21.15.29:0/2223966294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2404e000 con 0x7f3c240d0e50 2024-01-24T13:06:23.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.106+0000 7f3c1aa00640 1 -- 172.21.15.29:0/2223966294 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3c1c0b8ce0 con 0x7f3c240d0e50 2024-01-24T13:06:23.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.106+0000 7f3c1aa00640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3bfc065a60 0x7f3bfc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:23.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.106+0000 7f3c1aa00640 1 -- 172.21.15.29:0/2223966294 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3c1c11e860 con 0x7f3c240d0e50 2024-01-24T13:06:23.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.106+0000 7f3c22a00640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3bfc065a60 0x7f3bfc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:23.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.106+0000 7f3c22a00640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3bfc065a60 0x7f3bfc067f20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3c14007fd0 tx=0x7f3c14009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:23.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.110+0000 7f3c1aa00640 1 -- 172.21.15.29:0/2223966294 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3c1c0ec220 con 0x7f3c240d0e50 2024-01-24T13:06:23.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.266+0000 7f3c29c00640 1 -- 172.21.15.29:0/2223966294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3c240c7fa0 con 0x7f3c240d0e50 2024-01-24T13:06:23.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.922+0000 7f3c1aa00640 1 -- 172.21.15.29:0/2223966294 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3c1c0ef840 con 0x7f3c240d0e50 2024-01-24T13:06:23.929 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2024-01-24T13:06:23.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.930+0000 7f3c29c00640 1 -- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3bfc065a60 msgr2=0x7f3bfc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:23.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.930+0000 7f3c29c00640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3bfc065a60 0x7f3bfc067f20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3c14007fd0 tx=0x7f3c14009040 comp rx=0 tx=0).stop 2024-01-24T13:06:23.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.930+0000 7f3c29c00640 1 -- 172.21.15.29:0/2223966294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c240d0e50 msgr2=0x7f3c24153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:23.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.930+0000 7f3c29c00640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c240d0e50 0x7f3c24153a70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0af040 tx=0x7f3c1c019780 comp rx=0 tx=0).stop 2024-01-24T13:06:23.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.930+0000 7f3c29c00640 1 -- 172.21.15.29:0/2223966294 shutdown_connections 2024-01-24T13:06:23.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.930+0000 7f3c29c00640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3bfc065a60 0x7f3bfc067f20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:23.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.930+0000 7f3c29c00640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c240d0e50 0x7f3c24153a70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:23.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.930+0000 7f3c29c00640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c240cd420 0x7f3c2415e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:23.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.930+0000 7f3c29c00640 1 --2- 172.21.15.29:0/2223966294 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c240cb040 0x7f3c24153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:23.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.930+0000 7f3c29c00640 1 -- 172.21.15.29:0/2223966294 >> 172.21.15.29:0/2223966294 conn(0x7f3c24069cd0 msgr2=0x7f3c240afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:23.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.930+0000 7f3c29c00640 1 -- 172.21.15.29:0/2223966294 shutdown_connections 2024-01-24T13:06:23.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:23.930+0000 7f3c29c00640 1 -- 172.21.15.29:0/2223966294 wait complete. 2024-01-24T13:06:23.962 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2024-01-24T13:06:24.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.106+0000 7f6a3b600640 1 Processor -- start 2024-01-24T13:06:24.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.106+0000 7f6a3b600640 1 -- start start 2024-01-24T13:06:24.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.110+0000 7f6a3b600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a340b07d0 0x7f6a3415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:24.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.110+0000 7f6a3b600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6a3415d730 0x7f6a34070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:24.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.110+0000 7f6a3b600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a340cacd0 con 0x7f6a340ca0f0 2024-01-24T13:06:24.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.110+0000 7f6a3b600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a340cba90 con 0x7f6a3415d730 2024-01-24T13:06:24.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.110+0000 7f6a3b600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340cafb0 con 0x7f6a340b07d0 2024-01-24T13:06:24.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.110+0000 7f6a39600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6a3415d730 0x7f6a34070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:24.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.110+0000 7f6a39600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6a3415d730 0x7f6a34070a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36102/0 (socket says 172.21.15.29:36102) 2024-01-24T13:06:24.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.110+0000 7f6a39600640 1 -- 172.21.15.29:0/2189516323 learned_addr learned my addr 172.21.15.29:0/2189516323 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:24.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.110+0000 7f6a33e00640 1 --2- 172.21.15.29:0/2189516323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a340b07d0 0x7f6a3415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:24.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.110+0000 7f6a39600640 1 -- 172.21.15.29:0/2189516323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a340b07d0 msgr2=0x7f6a3415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:24.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.110+0000 7f6a39600640 1 --2- 172.21.15.29:0/2189516323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a340b07d0 0x7f6a3415d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:24.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.110+0000 7f6a39600640 1 -- 172.21.15.29:0/2189516323 >> v1:172.21.15.163:6789/0 conn(0x7f6a340ca0f0 legacy=0x7f6a340b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:24.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.110+0000 7f6a39600640 1 -- 172.21.15.29:0/2189516323 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a340cb290 con 0x7f6a3415d730 2024-01-24T13:06:24.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.110+0000 7f6a39600640 1 --2- 172.21.15.29:0/2189516323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415d730 0x7f6a34070a80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009e50 tx=0x7f6a2c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1724ace8754b285 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:24.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.114+0000 7f6a33400640 1 -- 172.21.15.29:0/2189516323 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0a5710 con 0x7f6a3415d730 2024-01-24T13:06:24.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.114+0000 7f6a33400640 1 -- 172.21.15.29:0/2189516323 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0a5870 con 0x7f6a3415d730 2024-01-24T13:06:24.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.114+0000 7f6a33400640 1 -- 172.21.15.29:0/2189516323 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0a5c00 con 0x7f6a3415d730 2024-01-24T13:06:24.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.114+0000 7f6a3b600640 1 -- 172.21.15.29:0/2189516323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415d730 msgr2=0x7f6a34070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:24.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.114+0000 7f6a3b600640 1 --2- 172.21.15.29:0/2189516323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415d730 0x7f6a34070a80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009e50 tx=0x7f6a2c01c980 comp rx=0 tx=0).stop 2024-01-24T13:06:24.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.114+0000 7f6a3b600640 1 -- 172.21.15.29:0/2189516323 shutdown_connections 2024-01-24T13:06:24.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.114+0000 7f6a3b600640 1 --2- 172.21.15.29:0/2189516323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415d730 0x7f6a34070a80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:24.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.114+0000 7f6a3b600640 1 --2- 172.21.15.29:0/2189516323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a340b07d0 0x7f6a3415d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:24.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.114+0000 7f6a3b600640 1 -- 172.21.15.29:0/2189516323 >> 172.21.15.29:0/2189516323 conn(0x7f6a3406a0d0 msgr2=0x7f6a3406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:24.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.114+0000 7f6a3b600640 1 -- 172.21.15.29:0/2189516323 shutdown_connections 2024-01-24T13:06:24.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.114+0000 7f6a3b600640 1 -- 172.21.15.29:0/2189516323 wait complete. 2024-01-24T13:06:24.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.114+0000 7f6a3b600640 1 Processor -- start 2024-01-24T13:06:24.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.114+0000 7f6a3b600640 1 -- start start 2024-01-24T13:06:24.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.114+0000 7f6a3b600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a340b07d0 0x7f6a340b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:24.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a3b600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a340ca0f0 0x7f6a34153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:24.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a3b600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a3415d730 0x7f6a34153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:24.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a3b600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34152270 con 0x7f6a340b07d0 2024-01-24T13:06:24.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a3b600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34158b10 con 0x7f6a340ca0f0 2024-01-24T13:06:24.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a3b600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34151ab0 con 0x7f6a3415d730 2024-01-24T13:06:24.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a38c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a340b07d0 0x7f6a340b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:24.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a38c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a340b07d0 0x7f6a340b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36118/0 (socket says 172.21.15.29:36118) 2024-01-24T13:06:24.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a38c00640 1 -- 172.21.15.29:0/243148699 learned_addr learned my addr 172.21.15.29:0/243148699 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:24.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a33e00640 1 --2- 172.21.15.29:0/243148699 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a340ca0f0 0x7f6a34153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:24.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a39600640 1 --2- 172.21.15.29:0/243148699 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a3415d730 0x7f6a34153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:24.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a38c00640 1 -- 172.21.15.29:0/243148699 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a3415d730 msgr2=0x7f6a34153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:24.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a38c00640 1 --2- 172.21.15.29:0/243148699 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a3415d730 0x7f6a34153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:24.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a38c00640 1 -- 172.21.15.29:0/243148699 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a340ca0f0 msgr2=0x7f6a34153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:24.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a38c00640 1 --2- 172.21.15.29:0/243148699 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a340ca0f0 0x7f6a34153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:24.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a38c00640 1 -- 172.21.15.29:0/243148699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c009b30 con 0x7f6a340b07d0 2024-01-24T13:06:24.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a38c00640 1 --2- 172.21.15.29:0/243148699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a340b07d0 0x7f6a340b38b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400c500 tx=0x7f6a2400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:24.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a30c00640 1 -- 172.21.15.29:0/243148699 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a24005220 con 0x7f6a340b07d0 2024-01-24T13:06:24.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a30c00640 1 -- 172.21.15.29:0/243148699 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a24005380 con 0x7f6a340b07d0 2024-01-24T13:06:24.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a3b600640 1 -- 172.21.15.29:0/243148699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a34158db0 con 0x7f6a340b07d0 2024-01-24T13:06:24.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a30c00640 1 -- 172.21.15.29:0/243148699 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a24007270 con 0x7f6a340b07d0 2024-01-24T13:06:24.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a3b600640 1 -- 172.21.15.29:0/243148699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a341f6100 con 0x7f6a340b07d0 2024-01-24T13:06:24.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a3b600640 1 -- 172.21.15.29:0/243148699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3404e000 con 0x7f6a340b07d0 2024-01-24T13:06:24.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.118+0000 7f6a30c00640 1 -- 172.21.15.29:0/243148699 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6a240073d0 con 0x7f6a340b07d0 2024-01-24T13:06:24.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.122+0000 7f6a30c00640 1 --2- 172.21.15.29:0/243148699 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6a0c065a60 0x7f6a0c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:24.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.122+0000 7f6a30c00640 1 -- 172.21.15.29:0/243148699 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5658+0+0 (secure 0 0 0) 0x7f6a24082990 con 0x7f6a340b07d0 2024-01-24T13:06:24.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.122+0000 7f6a33e00640 1 --2- 172.21.15.29:0/243148699 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6a0c065a60 0x7f6a0c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:24.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.122+0000 7f6a33e00640 1 --2- 172.21.15.29:0/243148699 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6a0c065a60 0x7f6a0c067f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6a34154a20 tx=0x7f6a1c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:24.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.126+0000 7f6a30c00640 1 -- 172.21.15.29:0/243148699 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f6a240503a0 con 0x7f6a340b07d0 2024-01-24T13:06:24.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.282+0000 7f6a3b600640 1 -- 172.21.15.29:0/243148699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6a3415cfd0 con 0x7f6a340b07d0 2024-01-24T13:06:24.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.930+0000 7f6a30c00640 1 -- 172.21.15.29:0/243148699 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v50) v1 ==== 160+0+0 (secure 0 0 0) 0x7f6a240539c0 con 0x7f6a340b07d0 2024-01-24T13:06:24.932 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'data_new' removed 2024-01-24T13:06:24.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.930+0000 7f6a3b600640 1 -- 172.21.15.29:0/243148699 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6a0c065a60 msgr2=0x7f6a0c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:24.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.930+0000 7f6a3b600640 1 --2- 172.21.15.29:0/243148699 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6a0c065a60 0x7f6a0c067f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6a34154a20 tx=0x7f6a1c008040 comp rx=0 tx=0).stop 2024-01-24T13:06:24.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.930+0000 7f6a3b600640 1 -- 172.21.15.29:0/243148699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a340b07d0 msgr2=0x7f6a340b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:24.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.930+0000 7f6a3b600640 1 --2- 172.21.15.29:0/243148699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a340b07d0 0x7f6a340b38b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400c500 tx=0x7f6a2400c9c0 comp rx=0 tx=0).stop 2024-01-24T13:06:24.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.934+0000 7f6a3b600640 1 -- 172.21.15.29:0/243148699 shutdown_connections 2024-01-24T13:06:24.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.934+0000 7f6a3b600640 1 --2- 172.21.15.29:0/243148699 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6a0c065a60 0x7f6a0c067f20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:24.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.934+0000 7f6a3b600640 1 --2- 172.21.15.29:0/243148699 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a3415d730 0x7f6a34153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:24.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.934+0000 7f6a3b600640 1 --2- 172.21.15.29:0/243148699 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a340ca0f0 0x7f6a34153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:24.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.934+0000 7f6a3b600640 1 --2- 172.21.15.29:0/243148699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a340b07d0 0x7f6a340b38b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:24.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.934+0000 7f6a3b600640 1 -- 172.21.15.29:0/243148699 >> 172.21.15.29:0/243148699 conn(0x7f6a3406a0d0 msgr2=0x7f6a340c3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:24.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.934+0000 7f6a3b600640 1 -- 172.21.15.29:0/243148699 shutdown_connections 2024-01-24T13:06:24.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:24.934+0000 7f6a3b600640 1 -- 172.21.15.29:0/243148699 wait complete. 2024-01-24T13:06:24.963 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-24T13:06:25.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.102+0000 7f895c800640 1 Processor -- start 2024-01-24T13:06:25.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.102+0000 7f895c800640 1 -- start start 2024-01-24T13:06:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.102+0000 7f895c800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f895415ca60 0x7f89540b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.102+0000 7f895c800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89540716c0 0x7f89540cde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.102+0000 7f895c800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89540b2010 con 0x7f89540ce390 2024-01-24T13:06:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.102+0000 7f895c800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89540cdcb0 con 0x7f895415ca60 2024-01-24T13:06:25.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.102+0000 7f895c800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89540ce810 con 0x7f89540716c0 2024-01-24T13:06:25.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.102+0000 7f8959e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f895415ca60 0x7f89540b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:25.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.102+0000 7f8959e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f895415ca60 0x7f89540b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:55800/0 (socket says 172.21.15.29:55800) 2024-01-24T13:06:25.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.102+0000 7f8959400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89540716c0 0x7f89540cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:25.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.102+0000 7f8959e00640 1 -- 172.21.15.29:0/1861871201 learned_addr learned my addr 172.21.15.29:0/1861871201 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:25.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.102+0000 7f895a800640 1 --1- 172.21.15.29:0/1861871201 >> v1:172.21.15.163:6789/0 conn(0x7f89540ce390 0x7f895406fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:45268/0 (socket says 172.21.15.29:45268) 2024-01-24T13:06:25.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.106+0000 7f8959400640 1 -- 172.21.15.29:0/1861871201 >> v2:172.21.15.163:3300/0 conn(0x7f895415ca60 msgr2=0x7f89540b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:25.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.106+0000 7f8959400640 1 --2- 172.21.15.29:0/1861871201 >> v2:172.21.15.163:3300/0 conn(0x7f895415ca60 0x7f89540b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.106+0000 7f8959400640 1 -- 172.21.15.29:0/1861871201 >> v1:172.21.15.163:6789/0 conn(0x7f89540ce390 legacy=0x7f895406fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:25.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.106+0000 7f8959400640 1 -- 172.21.15.29:0/1861871201 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89540b2480 con 0x7f89540716c0 2024-01-24T13:06:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.106+0000 7f8959400640 1 --2- 172.21.15.29:0/1861871201 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89540716c0 0x7f89540cde50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f893c0097c0 tx=0x7f893c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bcb7b19a8d14846 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.106+0000 7f8958a00640 1 -- 172.21.15.29:0/1861871201 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c0ab600 con 0x7f89540716c0 2024-01-24T13:06:25.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.106+0000 7f8958a00640 1 -- 172.21.15.29:0/1861871201 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c0a7050 con 0x7f89540716c0 2024-01-24T13:06:25.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.106+0000 7f8958a00640 1 -- 172.21.15.29:0/1861871201 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c0ab980 con 0x7f89540716c0 2024-01-24T13:06:25.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 -- 172.21.15.29:0/1861871201 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89540716c0 msgr2=0x7f89540cde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:25.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 --2- 172.21.15.29:0/1861871201 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89540716c0 0x7f89540cde50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f893c0097c0 tx=0x7f893c01c450 comp rx=0 tx=0).stop 2024-01-24T13:06:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 -- 172.21.15.29:0/1861871201 shutdown_connections 2024-01-24T13:06:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 --2- 172.21.15.29:0/1861871201 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89540716c0 0x7f89540cde50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 --2- 172.21.15.29:0/1861871201 >> v2:172.21.15.163:3300/0 conn(0x7f895415ca60 0x7f89540b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 -- 172.21.15.29:0/1861871201 >> 172.21.15.29:0/1861871201 conn(0x7f895406d790 msgr2=0x7f8954069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 -- 172.21.15.29:0/1861871201 shutdown_connections 2024-01-24T13:06:25.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 -- 172.21.15.29:0/1861871201 wait complete. 2024-01-24T13:06:25.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 Processor -- start 2024-01-24T13:06:25.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 -- start start 2024-01-24T13:06:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89540716c0 0x7f895414fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89540ce390 0x7f89540ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f895415ca60 0x7f89540ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8954157210 con 0x7f89540716c0 2024-01-24T13:06:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8954156640 con 0x7f89540ce390 2024-01-24T13:06:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f895c800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89541568e0 con 0x7f895415ca60 2024-01-24T13:06:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f8959e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89540716c0 0x7f895414fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f8959e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89540716c0 0x7f895414fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36134/0 (socket says 172.21.15.29:36134) 2024-01-24T13:06:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.110+0000 7f8959e00640 1 -- 172.21.15.29:0/2445519946 learned_addr learned my addr 172.21.15.29:0/2445519946 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:25.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f8959400640 1 --2- 172.21.15.29:0/2445519946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89540ce390 0x7f89540ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f895a800640 1 --2- 172.21.15.29:0/2445519946 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f895415ca60 0x7f89540ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f8959e00640 1 -- 172.21.15.29:0/2445519946 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f895415ca60 msgr2=0x7f89540ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f8959e00640 1 --2- 172.21.15.29:0/2445519946 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f895415ca60 0x7f89540ace60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f8959e00640 1 -- 172.21.15.29:0/2445519946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89540ce390 msgr2=0x7f89540ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f8959e00640 1 --2- 172.21.15.29:0/2445519946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89540ce390 0x7f89540ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f8959e00640 1 -- 172.21.15.29:0/2445519946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c009420 con 0x7f89540716c0 2024-01-24T13:06:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f8959e00640 1 --2- 172.21.15.29:0/2445519946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89540716c0 0x7f895414fce0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f894400e7f0 tx=0x7f894400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f8952000640 1 -- 172.21.15.29:0/2445519946 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944009580 con 0x7f89540716c0 2024-01-24T13:06:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f8952000640 1 -- 172.21.15.29:0/2445519946 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894400c940 con 0x7f89540716c0 2024-01-24T13:06:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f8952000640 1 -- 172.21.15.29:0/2445519946 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894400ccf0 con 0x7f89540716c0 2024-01-24T13:06:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f895c800640 1 -- 172.21.15.29:0/2445519946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8954156bc0 con 0x7f89540716c0 2024-01-24T13:06:25.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f895c800640 1 -- 172.21.15.29:0/2445519946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8954150220 con 0x7f89540716c0 2024-01-24T13:06:25.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f895c800640 1 -- 172.21.15.29:0/2445519946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895404e850 con 0x7f89540716c0 2024-01-24T13:06:25.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f8952000640 1 -- 172.21.15.29:0/2445519946 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8944013470 con 0x7f89540716c0 2024-01-24T13:06:25.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f8952000640 1 --2- 172.21.15.29:0/2445519946 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f892c065a60 0x7f892c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:25.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.114+0000 7f8952000640 1 -- 172.21.15.29:0/2445519946 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8944083120 con 0x7f89540716c0 2024-01-24T13:06:25.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.118+0000 7f8959400640 1 --2- 172.21.15.29:0/2445519946 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f892c065a60 0x7f892c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:25.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.118+0000 7f8959400640 1 --2- 172.21.15.29:0/2445519946 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f892c065a60 0x7f892c067f20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f893c0ad000 tx=0x7f893c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:25.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.118+0000 7f8952000640 1 -- 172.21.15.29:0/2445519946 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f8944050c20 con 0x7f89540716c0 2024-01-24T13:06:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.286+0000 7f895c800640 1 -- 172.21.15.29:0/2445519946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8954070f60 con 0x7f89540716c0 2024-01-24T13:06:25.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.290+0000 7f8952000640 1 -- 172.21.15.29:0/2445519946 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8944054240 con 0x7f89540716c0 2024-01-24T13:06:25.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.294+0000 7f895c800640 1 -- 172.21.15.29:0/2445519946 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f892c065a60 msgr2=0x7f892c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:25.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.294+0000 7f895c800640 1 --2- 172.21.15.29:0/2445519946 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f892c065a60 0x7f892c067f20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f893c0ad000 tx=0x7f893c008040 comp rx=0 tx=0).stop 2024-01-24T13:06:25.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.294+0000 7f895c800640 1 -- 172.21.15.29:0/2445519946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89540716c0 msgr2=0x7f895414fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:25.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.294+0000 7f895c800640 1 --2- 172.21.15.29:0/2445519946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89540716c0 0x7f895414fce0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f894400e7f0 tx=0x7f894400ecb0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.294+0000 7f895c800640 1 -- 172.21.15.29:0/2445519946 shutdown_connections 2024-01-24T13:06:25.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.294+0000 7f895c800640 1 --2- 172.21.15.29:0/2445519946 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f892c065a60 0x7f892c067f20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.294+0000 7f895c800640 1 --2- 172.21.15.29:0/2445519946 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f895415ca60 0x7f89540ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.294+0000 7f895c800640 1 --2- 172.21.15.29:0/2445519946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89540ce390 0x7f89540ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.294+0000 7f895c800640 1 --2- 172.21.15.29:0/2445519946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89540716c0 0x7f895414fce0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.294+0000 7f895c800640 1 -- 172.21.15.29:0/2445519946 >> 172.21.15.29:0/2445519946 conn(0x7f895406d790 msgr2=0x7f895415b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:25.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.294+0000 7f895c800640 1 -- 172.21.15.29:0/2445519946 shutdown_connections 2024-01-24T13:06:25.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.294+0000 7f895c800640 1 -- 172.21.15.29:0/2445519946 wait complete. 2024-01-24T13:06:25.317 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-01-24T13:06:25.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.454+0000 7f7274400640 1 Processor -- start 2024-01-24T13:06:25.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.454+0000 7f7274400640 1 -- start start 2024-01-24T13:06:25.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.454+0000 7f7274400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f726c0c96c0 0x7f726c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:25.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.454+0000 7f7274400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f726c15d5a0 0x7f726c15da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:25.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.454+0000 7f7274400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726c15df70 con 0x7f726c06bd10 2024-01-24T13:06:25.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.454+0000 7f7274400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726c15d0c0 con 0x7f726c15d5a0 2024-01-24T13:06:25.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.454+0000 7f7274400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726c0c9c30 con 0x7f726c0c96c0 2024-01-24T13:06:25.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.454+0000 7f7272400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f726c15d5a0 0x7f726c15da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:25.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.454+0000 7f7272400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f726c15d5a0 0x7f726c15da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36144/0 (socket says 172.21.15.29:36144) 2024-01-24T13:06:25.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.454+0000 7f7272400640 1 -- 172.21.15.29:0/3807318509 learned_addr learned my addr 172.21.15.29:0/3807318509 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:25.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.458+0000 7f7271000640 1 --2- 172.21.15.29:0/3807318509 >> v2:172.21.15.163:3300/0 conn(0x7f726c0c96c0 0x7f726c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:25.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.458+0000 7f7272400640 1 -- 172.21.15.29:0/3807318509 >> v2:172.21.15.163:3300/0 conn(0x7f726c0c96c0 msgr2=0x7f726c0cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:25.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.458+0000 7f7272400640 1 --2- 172.21.15.29:0/3807318509 >> v2:172.21.15.163:3300/0 conn(0x7f726c0c96c0 0x7f726c0cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.458+0000 7f7272400640 1 -- 172.21.15.29:0/3807318509 >> v1:172.21.15.163:6789/0 conn(0x7f726c06bd10 legacy=0x7f726c06c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:25.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.458+0000 7f7272400640 1 -- 172.21.15.29:0/3807318509 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0c9f10 con 0x7f726c15d5a0 2024-01-24T13:06:25.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.458+0000 7f7272400640 1 --2- 172.21.15.29:0/3807318509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f726c15d5a0 0x7f726c15da30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f726c06ace0 tx=0x7f726401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be48d9de48b24b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:25.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.458+0000 7f726be00640 1 -- 172.21.15.29:0/3807318509 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640a57f0 con 0x7f726c15d5a0 2024-01-24T13:06:25.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.458+0000 7f726be00640 1 -- 172.21.15.29:0/3807318509 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72640a5950 con 0x7f726c15d5a0 2024-01-24T13:06:25.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.458+0000 7f726be00640 1 -- 172.21.15.29:0/3807318509 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640a5ce0 con 0x7f726c15d5a0 2024-01-24T13:06:25.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 -- 172.21.15.29:0/3807318509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f726c15d5a0 msgr2=0x7f726c15da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:25.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 --2- 172.21.15.29:0/3807318509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f726c15d5a0 0x7f726c15da30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f726c06ace0 tx=0x7f726401c910 comp rx=0 tx=0).stop 2024-01-24T13:06:25.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 -- 172.21.15.29:0/3807318509 shutdown_connections 2024-01-24T13:06:25.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 --2- 172.21.15.29:0/3807318509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f726c15d5a0 0x7f726c15da30 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 --2- 172.21.15.29:0/3807318509 >> v2:172.21.15.163:3300/0 conn(0x7f726c0c96c0 0x7f726c0cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 -- 172.21.15.29:0/3807318509 >> 172.21.15.29:0/3807318509 conn(0x7f726c06a2d0 msgr2=0x7f726c0cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:25.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 -- 172.21.15.29:0/3807318509 shutdown_connections 2024-01-24T13:06:25.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 -- 172.21.15.29:0/3807318509 wait complete. 2024-01-24T13:06:25.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 Processor -- start 2024-01-24T13:06:25.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 -- start start 2024-01-24T13:06:25.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f726c06bd10 0x7f726c14f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:25.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f726c0c96c0 0x7f726c14d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:25.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f726c15d5a0 0x7f726c14de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:25.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c150de0 con 0x7f726c06bd10 2024-01-24T13:06:25.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c1510c0 con 0x7f726c0c96c0 2024-01-24T13:06:25.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7274400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c1513a0 con 0x7f726c15d5a0 2024-01-24T13:06:25.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7271a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f726c06bd10 0x7f726c14f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:25.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7271a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f726c06bd10 0x7f726c14f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36154/0 (socket says 172.21.15.29:36154) 2024-01-24T13:06:25.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7271a00640 1 -- 172.21.15.29:0/816902723 learned_addr learned my addr 172.21.15.29:0/816902723 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:25.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7272400640 1 --2- 172.21.15.29:0/816902723 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f726c15d5a0 0x7f726c14de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:25.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7271000640 1 --2- 172.21.15.29:0/816902723 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f726c0c96c0 0x7f726c14d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:25.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7271a00640 1 -- 172.21.15.29:0/816902723 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f726c15d5a0 msgr2=0x7f726c14de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:25.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7271a00640 1 --2- 172.21.15.29:0/816902723 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f726c15d5a0 0x7f726c14de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7271a00640 1 -- 172.21.15.29:0/816902723 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f726c0c96c0 msgr2=0x7f726c14d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:25.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7271a00640 1 --2- 172.21.15.29:0/816902723 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f726c0c96c0 0x7f726c14d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.462+0000 7f7271a00640 1 -- 172.21.15.29:0/816902723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009b30 con 0x7f726c06bd10 2024-01-24T13:06:25.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.466+0000 7f7271a00640 1 --2- 172.21.15.29:0/816902723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f726c06bd10 0x7f726c14f3a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f725c00c500 tx=0x7f725c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:25.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.466+0000 7f7269600640 1 -- 172.21.15.29:0/816902723 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c005220 con 0x7f726c06bd10 2024-01-24T13:06:25.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.466+0000 7f7269600640 1 -- 172.21.15.29:0/816902723 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c005380 con 0x7f726c06bd10 2024-01-24T13:06:25.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.466+0000 7f7274400640 1 -- 172.21.15.29:0/816902723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c151680 con 0x7f726c06bd10 2024-01-24T13:06:25.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.466+0000 7f7269600640 1 -- 172.21.15.29:0/816902723 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c007270 con 0x7f726c06bd10 2024-01-24T13:06:25.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.466+0000 7f7274400640 1 -- 172.21.15.29:0/816902723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c14dbd0 con 0x7f726c06bd10 2024-01-24T13:06:25.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.466+0000 7f7274400640 1 -- 172.21.15.29:0/816902723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726c151b30 con 0x7f726c06bd10 2024-01-24T13:06:25.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.466+0000 7f7269600640 1 -- 172.21.15.29:0/816902723 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f725c0073d0 con 0x7f726c06bd10 2024-01-24T13:06:25.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.466+0000 7f7269600640 1 --2- 172.21.15.29:0/816902723 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7244065a60 0x7f7244067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:25.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.466+0000 7f7269600640 1 -- 172.21.15.29:0/816902723 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f725c082570 con 0x7f726c06bd10 2024-01-24T13:06:25.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.466+0000 7f7271000640 1 --2- 172.21.15.29:0/816902723 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7244065a60 0x7f7244067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:25.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.470+0000 7f7271000640 1 --2- 172.21.15.29:0/816902723 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7244065a60 0x7f7244067f20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f726c0c1c20 tx=0x7f7254008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:25.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.470+0000 7f7269600640 1 -- 172.21.15.29:0/816902723 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f726c151b30 con 0x7f726c06bd10 2024-01-24T13:06:25.649 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:06:25.654 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:06:25.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.686+0000 7f7274400640 1 -- 172.21.15.29:0/816902723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f726c15df70 con 0x7f726c06bd10 2024-01-24T13:06:25.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.930+0000 7f7269600640 1 -- 172.21.15.29:0/816902723 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v155) v1 ==== 147+0+0 (secure 0 0 0) 0x7f726c15df70 con 0x7f726c06bd10 2024-01-24T13:06:25.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.934+0000 7f7274400640 1 -- 172.21.15.29:0/816902723 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7244065a60 msgr2=0x7f7244067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:25.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.934+0000 7f7274400640 1 --2- 172.21.15.29:0/816902723 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7244065a60 0x7f7244067f20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f726c0c1c20 tx=0x7f7254008040 comp rx=0 tx=0).stop 2024-01-24T13:06:25.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.934+0000 7f7274400640 1 -- 172.21.15.29:0/816902723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f726c06bd10 msgr2=0x7f726c14f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:25.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.934+0000 7f7274400640 1 --2- 172.21.15.29:0/816902723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f726c06bd10 0x7f726c14f3a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f725c00c500 tx=0x7f725c00c9c0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.934+0000 7f7274400640 1 -- 172.21.15.29:0/816902723 shutdown_connections 2024-01-24T13:06:25.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.934+0000 7f7274400640 1 --2- 172.21.15.29:0/816902723 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7244065a60 0x7f7244067f20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.934+0000 7f7274400640 1 --2- 172.21.15.29:0/816902723 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f726c15d5a0 0x7f726c14de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.934+0000 7f7274400640 1 --2- 172.21.15.29:0/816902723 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f726c0c96c0 0x7f726c14d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.934+0000 7f7274400640 1 --2- 172.21.15.29:0/816902723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f726c06bd10 0x7f726c14f3a0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:25.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.934+0000 7f7274400640 1 -- 172.21.15.29:0/816902723 >> 172.21.15.29:0/816902723 conn(0x7f726c06a2d0 msgr2=0x7f726c153690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:25.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.934+0000 7f7274400640 1 -- 172.21.15.29:0/816902723 shutdown_connections 2024-01-24T13:06:25.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:25.934+0000 7f7274400640 1 -- 172.21.15.29:0/816902723 wait complete. 2024-01-24T13:06:25.958 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2024-01-24T13:06:25.958 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-01-24T13:06:25.958 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-01-24T13:06:26.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.094+0000 7fb1d6800640 1 Processor -- start 2024-01-24T13:06:26.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.094+0000 7fb1d6800640 1 -- start start 2024-01-24T13:06:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1d6800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb1d006bc10 0x7fb1d006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1d6800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb1d015cf50 0x7fb1d015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1d6800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d015de10 con 0x7fb1d0159300 2024-01-24T13:06:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1d6800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d0071140 con 0x7fb1d006bc10 2024-01-24T13:06:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1d6800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d006c5e0 con 0x7fb1d015cf50 2024-01-24T13:06:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1cea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb1d006bc10 0x7fb1d006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:26.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1cf400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb1d0159300 0x7fb1d00b1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44836/0 (socket says 172.21.15.29:44836) 2024-01-24T13:06:26.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1cf400640 1 -- 172.21.15.29:0/2406971294 learned_addr learned my addr 172.21.15.29:0/2406971294 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:26.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1cfe00640 1 --2- 172.21.15.29:0/2406971294 >> v2:172.21.15.163:3300/0 conn(0x7fb1d015cf50 0x7fb1d015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:26.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1cea00640 1 -- 172.21.15.29:0/2406971294 >> v2:172.21.15.163:3300/0 conn(0x7fb1d015cf50 msgr2=0x7fb1d015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:26.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1cea00640 1 --2- 172.21.15.29:0/2406971294 >> v2:172.21.15.163:3300/0 conn(0x7fb1d015cf50 0x7fb1d015d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:26.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1cea00640 1 -- 172.21.15.29:0/2406971294 >> v1:172.21.15.29:6789/0 conn(0x7fb1d0159300 legacy=0x7fb1d00b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:26.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1ce000640 1 -- 172.21.15.29:0/2406971294 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943627998 0 0) 0x7fb1d015de10 con 0x7fb1d0159300 2024-01-24T13:06:26.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1cea00640 1 -- 172.21.15.29:0/2406971294 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d015db30 con 0x7fb1d006bc10 2024-01-24T13:06:26.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1cfe00640 1 --2- 172.21.15.29:0/2406971294 >> v2:172.21.15.163:3300/0 conn(0x7fb1d015cf50 0x7fb1d015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:26.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.098+0000 7fb1cea00640 1 --2- 172.21.15.29:0/2406971294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d006bc10 0x7fb1d006c0a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00cb840 tx=0x7fb1b801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b775a7563ca93e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:26.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1ce000640 1 -- 172.21.15.29:0/2406971294 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80ab600 con 0x7fb1d006bc10 2024-01-24T13:06:26.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1ce000640 1 -- 172.21.15.29:0/2406971294 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b80a7050 con 0x7fb1d006bc10 2024-01-24T13:06:26.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1ce000640 1 -- 172.21.15.29:0/2406971294 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80ab980 con 0x7fb1d006bc10 2024-01-24T13:06:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 -- 172.21.15.29:0/2406971294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d006bc10 msgr2=0x7fb1d006c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 --2- 172.21.15.29:0/2406971294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d006bc10 0x7fb1d006c0a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00cb840 tx=0x7fb1b801c3d0 comp rx=0 tx=0).stop 2024-01-24T13:06:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 -- 172.21.15.29:0/2406971294 shutdown_connections 2024-01-24T13:06:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 --2- 172.21.15.29:0/2406971294 >> v2:172.21.15.163:3300/0 conn(0x7fb1d015cf50 0x7fb1d015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 --2- 172.21.15.29:0/2406971294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d006bc10 0x7fb1d006c0a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 -- 172.21.15.29:0/2406971294 >> 172.21.15.29:0/2406971294 conn(0x7fb1d00b3950 msgr2=0x7fb1d0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 -- 172.21.15.29:0/2406971294 shutdown_connections 2024-01-24T13:06:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 -- 172.21.15.29:0/2406971294 wait complete. 2024-01-24T13:06:26.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 Processor -- start 2024-01-24T13:06:26.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 -- start start 2024-01-24T13:06:26.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d006bc10 0x7fb1d0146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:26.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1d0159300 0x7fb1d00cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1d015cf50 0x7fb1d014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00ce810 con 0x7fb1d006bc10 2024-01-24T13:06:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00ceca0 con 0x7fb1d015cf50 2024-01-24T13:06:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.102+0000 7fb1d6800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00cdc00 con 0x7fb1d0159300 2024-01-24T13:06:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1cf400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d006bc10 0x7fb1d0146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1cf400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d006bc10 0x7fb1d0146260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36180/0 (socket says 172.21.15.29:36180) 2024-01-24T13:06:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1cf400640 1 -- 172.21.15.29:0/1156616519 learned_addr learned my addr 172.21.15.29:0/1156616519 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1cea00640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1d0159300 0x7fb1d00cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1cfe00640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1d015cf50 0x7fb1d014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1cf400640 1 -- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1d0159300 msgr2=0x7fb1d00cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:26.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1cf400640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1d0159300 0x7fb1d00cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1cf400640 1 -- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1d015cf50 msgr2=0x7fb1d014cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1cf400640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1d015cf50 0x7fb1d014cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1cf400640 1 -- 172.21.15.29:0/1156616519 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b8009420 con 0x7fb1d006bc10 2024-01-24T13:06:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1cea00640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1d0159300 0x7fb1d00cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1cf400640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d006bc10 0x7fb1d0146260 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00011f0 tx=0x7fb1c000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1c7400640 1 -- 172.21.15.29:0/1156616519 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00074e0 con 0x7fb1d006bc10 2024-01-24T13:06:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1c7400640 1 -- 172.21.15.29:0/1156616519 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c0007640 con 0x7fb1d006bc10 2024-01-24T13:06:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1c7400640 1 -- 172.21.15.29:0/1156616519 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0004a10 con 0x7fb1d006bc10 2024-01-24T13:06:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1d6800640 1 -- 172.21.15.29:0/1156616519 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d00cdee0 con 0x7fb1d006bc10 2024-01-24T13:06:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1d6800640 1 -- 172.21.15.29:0/1156616519 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d00ce4a0 con 0x7fb1d006bc10 2024-01-24T13:06:26.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1d6800640 1 -- 172.21.15.29:0/1156616519 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d004e850 con 0x7fb1d006bc10 2024-01-24T13:06:26.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.106+0000 7fb1c7400640 1 -- 172.21.15.29:0/1156616519 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb1c0004b70 con 0x7fb1d006bc10 2024-01-24T13:06:26.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.110+0000 7fb1c7400640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb1a8065a60 0x7fb1a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:26.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.110+0000 7fb1c7400640 1 -- 172.21.15.29:0/1156616519 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb1c00822f0 con 0x7fb1d006bc10 2024-01-24T13:06:26.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.110+0000 7fb1cea00640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb1a8065a60 0x7fb1a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:26.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.110+0000 7fb1cea00640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb1a8065a60 0x7fb1a8067f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80ad000 tx=0x7fb1b8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:26.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.114+0000 7fb1c7400640 1 -- 172.21.15.29:0/1156616519 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb1c004fe60 con 0x7fb1d006bc10 2024-01-24T13:06:26.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.322+0000 7fb1d6800640 1 -- 172.21.15.29:0/1156616519 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7fb1d00008e0 con 0x7fb1d006bc10 2024-01-24T13:06:26.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.934+0000 7fb1c7400640 1 -- 172.21.15.29:0/1156616519 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v156) v1 ==== 137+0+0 (secure 0 0 0) 0x7fb1c00180d0 con 0x7fb1d006bc10 2024-01-24T13:06:26.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.934+0000 7fb1d6800640 1 -- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb1a8065a60 msgr2=0x7fb1a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:26.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.934+0000 7fb1d6800640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb1a8065a60 0x7fb1a8067f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80ad000 tx=0x7fb1b8008040 comp rx=0 tx=0).stop 2024-01-24T13:06:26.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.934+0000 7fb1d6800640 1 -- 172.21.15.29:0/1156616519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d006bc10 msgr2=0x7fb1d0146260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:26.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.934+0000 7fb1d6800640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d006bc10 0x7fb1d0146260 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00011f0 tx=0x7fb1c000c9b0 comp rx=0 tx=0).stop 2024-01-24T13:06:26.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.934+0000 7fb1d6800640 1 -- 172.21.15.29:0/1156616519 shutdown_connections 2024-01-24T13:06:26.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.934+0000 7fb1d6800640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb1a8065a60 0x7fb1a8067f20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:26.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.934+0000 7fb1d6800640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1d015cf50 0x7fb1d014cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:26.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.934+0000 7fb1d6800640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1d0159300 0x7fb1d00cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:26.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.934+0000 7fb1d6800640 1 --2- 172.21.15.29:0/1156616519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d006bc10 0x7fb1d0146260 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:26.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.934+0000 7fb1d6800640 1 -- 172.21.15.29:0/1156616519 >> 172.21.15.29:0/1156616519 conn(0x7fb1d00b3950 msgr2=0x7fb1d0157530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:26.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.934+0000 7fb1d6800640 1 -- 172.21.15.29:0/1156616519 shutdown_connections 2024-01-24T13:06:26.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:26.934+0000 7fb1d6800640 1 -- 172.21.15.29:0/1156616519 wait complete. 2024-01-24T13:06:26.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-24T13:06:27.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.102+0000 7f7936400640 1 Processor -- start 2024-01-24T13:06:27.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.102+0000 7f7936400640 1 -- start start 2024-01-24T13:06:27.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.106+0000 7f7936400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7930070b70 0x7f79300cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:27.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.106+0000 7f7936400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7930069d70 con 0x7f79300ccdc0 2024-01-24T13:06:27.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.106+0000 7f7936400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793006a050 con 0x7f793015cb10 2024-01-24T13:06:27.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.106+0000 7f7936400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793006a710 con 0x7f7930070b70 2024-01-24T13:06:27.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.106+0000 7f792fe00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f79300ccdc0 0x7f79300c91e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44852/0 (socket says 172.21.15.29:44852) 2024-01-24T13:06:27.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.106+0000 7f792fe00640 1 -- 172.21.15.29:0/3810984070 learned_addr learned my addr 172.21.15.29:0/3810984070 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.106+0000 7f792ea00640 1 --2- 172.21.15.29:0/3810984070 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7930070b70 0x7f79300cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.106+0000 7f792e000640 1 -- 172.21.15.29:0/3810984070 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090595712 0 0) 0x7f7930069d70 con 0x7f79300ccdc0 2024-01-24T13:06:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.106+0000 7f792e000640 1 -- 172.21.15.29:0/3810984070 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7910003530 con 0x7f79300ccdc0 2024-01-24T13:06:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.106+0000 7f792e000640 1 -- 172.21.15.29:0/3810984070 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633730981 0 0) 0x7f793006a050 con 0x7f793015cb10 2024-01-24T13:06:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.106+0000 7f792e000640 1 -- 172.21.15.29:0/3810984070 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7930069d70 con 0x7f793015cb10 2024-01-24T13:06:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.106+0000 7f792ea00640 1 -- 172.21.15.29:0/3810984070 >> v1:172.21.15.163:6789/0 conn(0x7f793015cb10 legacy=0x7f7930070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.106+0000 7f792ea00640 1 -- 172.21.15.29:0/3810984070 >> v1:172.21.15.29:6789/0 conn(0x7f79300ccdc0 legacy=0x7f79300c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.106+0000 7f792ea00640 1 -- 172.21.15.29:0/3810984070 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793006a330 con 0x7f7930070b70 2024-01-24T13:06:27.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.110+0000 7f792ea00640 1 --2- 172.21.15.29:0/3810984070 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7930070b70 0x7f79300cc880 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79180097f0 tx=0x7f791801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=813a93ae54865fe server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:27.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.110+0000 7f792e000640 1 -- 172.21.15.29:0/3810984070 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79180ab3f0 con 0x7f7930070b70 2024-01-24T13:06:27.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.110+0000 7f792e000640 1 -- 172.21.15.29:0/3810984070 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79180ab550 con 0x7f7930070b70 2024-01-24T13:06:27.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.110+0000 7f792e000640 1 -- 172.21.15.29:0/3810984070 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79180ab8e0 con 0x7f7930070b70 2024-01-24T13:06:27.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.110+0000 7f7936400640 1 -- 172.21.15.29:0/3810984070 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7930070b70 msgr2=0x7f79300cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:27.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.110+0000 7f7936400640 1 --2- 172.21.15.29:0/3810984070 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7930070b70 0x7f79300cc880 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79180097f0 tx=0x7f791801c430 comp rx=0 tx=0).stop 2024-01-24T13:06:27.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.110+0000 7f7936400640 1 -- 172.21.15.29:0/3810984070 shutdown_connections 2024-01-24T13:06:27.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.110+0000 7f7936400640 1 --2- 172.21.15.29:0/3810984070 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7930070b70 0x7f79300cc880 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.110+0000 7f7936400640 1 -- 172.21.15.29:0/3810984070 >> 172.21.15.29:0/3810984070 conn(0x7f79300cb6a0 msgr2=0x7f79300cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:27.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.110+0000 7f7936400640 1 -- 172.21.15.29:0/3810984070 shutdown_connections 2024-01-24T13:06:27.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.110+0000 7f7936400640 1 -- 172.21.15.29:0/3810984070 wait complete. 2024-01-24T13:06:27.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.110+0000 7f7936400640 1 Processor -- start 2024-01-24T13:06:27.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.110+0000 7f7936400640 1 -- start start 2024-01-24T13:06:27.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f7936400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7930070b70 0x7f793015faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:27.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f7936400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79300ccdc0 0x7f7930155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:27.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f7936400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f793015cb10 0x7f7930153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:27.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f7936400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793015f660 con 0x7f793015cb10 2024-01-24T13:06:27.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f7936400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7930155970 con 0x7f7930070b70 2024-01-24T13:06:27.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f7936400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79301541f0 con 0x7f79300ccdc0 2024-01-24T13:06:27.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f792fe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f793015cb10 0x7f7930153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:27.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f792fe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f793015cb10 0x7f7930153cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36182/0 (socket says 172.21.15.29:36182) 2024-01-24T13:06:27.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f792fe00640 1 -- 172.21.15.29:0/3293267164 learned_addr learned my addr 172.21.15.29:0/3293267164 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:27.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f792ea00640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79300ccdc0 0x7f7930155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:27.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f792f400640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7930070b70 0x7f793015faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:27.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f792fe00640 1 -- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79300ccdc0 msgr2=0x7f7930155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:27.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f792fe00640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79300ccdc0 0x7f7930155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f792fe00640 1 -- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7930070b70 msgr2=0x7f793015faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:27.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f792fe00640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7930070b70 0x7f793015faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f792fe00640 1 -- 172.21.15.29:0/3293267164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918009420 con 0x7f793015cb10 2024-01-24T13:06:27.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f792f400640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7930070b70 0x7f793015faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:27.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f792fe00640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f793015cb10 0x7f7930153cb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f792800cba0 tx=0x7f792800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:27.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f7927400640 1 -- 172.21.15.29:0/3293267164 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792800ace0 con 0x7f793015cb10 2024-01-24T13:06:27.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f7927400640 1 -- 172.21.15.29:0/3293267164 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792800ae40 con 0x7f793015cb10 2024-01-24T13:06:27.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f7936400640 1 -- 172.21.15.29:0/3293267164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793015ea50 con 0x7f793015cb10 2024-01-24T13:06:27.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f7927400640 1 -- 172.21.15.29:0/3293267164 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7928012620 con 0x7f793015cb10 2024-01-24T13:06:27.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f7936400640 1 -- 172.21.15.29:0/3293267164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793015f010 con 0x7f793015cb10 2024-01-24T13:06:27.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.114+0000 7f7936400640 1 -- 172.21.15.29:0/3293267164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793015f7d0 con 0x7f793015cb10 2024-01-24T13:06:27.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.118+0000 7f7927400640 1 -- 172.21.15.29:0/3293267164 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7928007070 con 0x7f793015cb10 2024-01-24T13:06:27.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.118+0000 7f7927400640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7908065a90 0x7f7908067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:27.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.118+0000 7f7927400640 1 -- 172.21.15.29:0/3293267164 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7928082fd0 con 0x7f793015cb10 2024-01-24T13:06:27.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.118+0000 7f792f400640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7908065a90 0x7f7908067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:27.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.118+0000 7f792f400640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7908065a90 0x7f7908067f50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f79200011f0 tx=0x7f7920009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:27.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.122+0000 7f7927400640 1 -- 172.21.15.29:0/3293267164 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7928054600 con 0x7f793015cb10 2024-01-24T13:06:27.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.282+0000 7f7936400640 1 -- 172.21.15.29:0/3293267164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f793004e850 con 0x7f793015cb10 2024-01-24T13:06:27.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.286+0000 7f7927400640 1 -- 172.21.15.29:0/3293267164 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7928054190 con 0x7f793015cb10 2024-01-24T13:06:27.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.286+0000 7f7936400640 1 -- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7908065a90 msgr2=0x7f7908067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:27.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.286+0000 7f7936400640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7908065a90 0x7f7908067f50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f79200011f0 tx=0x7f7920009040 comp rx=0 tx=0).stop 2024-01-24T13:06:27.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.286+0000 7f7936400640 1 -- 172.21.15.29:0/3293267164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f793015cb10 msgr2=0x7f7930153cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:27.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.286+0000 7f7936400640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f793015cb10 0x7f7930153cb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f792800cba0 tx=0x7f792800a430 comp rx=0 tx=0).stop 2024-01-24T13:06:27.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.290+0000 7f7936400640 1 -- 172.21.15.29:0/3293267164 shutdown_connections 2024-01-24T13:06:27.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.290+0000 7f7936400640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7908065a90 0x7f7908067f50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.290+0000 7f7936400640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f793015cb10 0x7f7930153cb0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.290+0000 7f7936400640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79300ccdc0 0x7f7930155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.290+0000 7f7936400640 1 --2- 172.21.15.29:0/3293267164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7930070b70 0x7f793015faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.290+0000 7f7936400640 1 -- 172.21.15.29:0/3293267164 >> 172.21.15.29:0/3293267164 conn(0x7f79300cb6a0 msgr2=0x7f79300b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:27.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.290+0000 7f7936400640 1 -- 172.21.15.29:0/3293267164 shutdown_connections 2024-01-24T13:06:27.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.290+0000 7f7936400640 1 -- 172.21.15.29:0/3293267164 wait complete. 2024-01-24T13:06:27.313 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-24T13:06:27.313 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-24T13:06:27.402 DEBUG:teuthology.orchestra.run.smithi163:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-24T13:06:27.485 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-24T13:06:27.485 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:06:27.485 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:06:27.494 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357740k,nr_inodes=4089435,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4625 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275996k,nr_inodes=818999,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-24T13:06:27.494 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:06:27.494 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:06:27.503 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5116 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-24T13:06:27.503 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:06:27.503 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:06:27.543 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357740k,nr_inodes=4089435,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4625 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275996k,nr_inodes=818999,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-24T13:06:27.544 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:06:27.544 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:06:27.558 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5116 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-24T13:06:27.558 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-24T13:06:27.558 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:06:27.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.722+0000 7f8592800640 1 Processor -- start 2024-01-24T13:06:27.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.722+0000 7f8592800640 1 -- start start 2024-01-24T13:06:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f8592800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c159300 0x7f858c0b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f8592800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f858c06bc10 0x7f858c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f8592800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858c06c5b0 con 0x7f858c15cf50 2024-01-24T13:06:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f8592800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858c071140 con 0x7f858c06bc10 2024-01-24T13:06:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f8592800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c15de10 con 0x7f858c159300 2024-01-24T13:06:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f858aa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f858c06bc10 0x7f858c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f858be00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f858c15cf50 0x7f858c0cbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44866/0 (socket says 172.21.15.29:44866) 2024-01-24T13:06:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f858be00640 1 -- 172.21.15.29:0/2908995156 learned_addr learned my addr 172.21.15.29:0/2908995156 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f858b400640 1 --2- 172.21.15.29:0/2908995156 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c159300 0x7f858c0b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f858aa00640 1 -- 172.21.15.29:0/2908995156 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c159300 msgr2=0x7f858c0b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f858aa00640 1 --2- 172.21.15.29:0/2908995156 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c159300 0x7f858c0b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f858aa00640 1 -- 172.21.15.29:0/2908995156 >> v1:172.21.15.29:6789/0 conn(0x7f858c15cf50 legacy=0x7f858c0cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f858a000640 1 -- 172.21.15.29:0/2908995156 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315487783 0 0) 0x7f858c06c5b0 con 0x7f858c15cf50 2024-01-24T13:06:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f858aa00640 1 -- 172.21.15.29:0/2908995156 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c15db30 con 0x7f858c06bc10 2024-01-24T13:06:27.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.726+0000 7f858b400640 1 --2- 172.21.15.29:0/2908995156 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c159300 0x7f858c0b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:27.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.730+0000 7f858aa00640 1 --2- 172.21.15.29:0/2908995156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c06bc10 0x7f858c06c070 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f85740097c0 tx=0x7f857401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c402128bb85a77 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:27.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.730+0000 7f858a000640 1 -- 172.21.15.29:0/2908995156 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85740ac620 con 0x7f858c06bc10 2024-01-24T13:06:27.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.730+0000 7f858a000640 1 -- 172.21.15.29:0/2908995156 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85740ac780 con 0x7f858c06bc10 2024-01-24T13:06:27.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.730+0000 7f858a000640 1 -- 172.21.15.29:0/2908995156 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85740acb10 con 0x7f858c06bc10 2024-01-24T13:06:27.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.730+0000 7f8592800640 1 -- 172.21.15.29:0/2908995156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c06bc10 msgr2=0x7f858c06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:27.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.730+0000 7f8592800640 1 --2- 172.21.15.29:0/2908995156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c06bc10 0x7f858c06c070 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f85740097c0 tx=0x7f857401c3c0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.730+0000 7f8592800640 1 -- 172.21.15.29:0/2908995156 shutdown_connections 2024-01-24T13:06:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.730+0000 7f8592800640 1 --2- 172.21.15.29:0/2908995156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c06bc10 0x7f858c06c070 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.730+0000 7f8592800640 1 --2- 172.21.15.29:0/2908995156 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c159300 0x7f858c0b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.730+0000 7f8592800640 1 -- 172.21.15.29:0/2908995156 >> 172.21.15.29:0/2908995156 conn(0x7f858c0b3950 msgr2=0x7f858c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.730+0000 7f8592800640 1 -- 172.21.15.29:0/2908995156 shutdown_connections 2024-01-24T13:06:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.730+0000 7f8592800640 1 -- 172.21.15.29:0/2908995156 wait complete. 2024-01-24T13:06:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.730+0000 7f8592800640 1 Processor -- start 2024-01-24T13:06:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.730+0000 7f8592800640 1 -- start start 2024-01-24T13:06:27.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f8592800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c06bc10 0x7f858c153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:27.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f8592800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c159300 0x7f858c14fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:27.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f8592800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f858c15cf50 0x7f858c151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:27.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f8592800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c153c40 con 0x7f858c159300 2024-01-24T13:06:27.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f8592800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c153f20 con 0x7f858c15cf50 2024-01-24T13:06:27.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f8592800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c154200 con 0x7f858c06bc10 2024-01-24T13:06:27.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f858aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c159300 0x7f858c14fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:27.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f858aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c159300 0x7f858c14fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36196/0 (socket says 172.21.15.29:36196) 2024-01-24T13:06:27.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f858aa00640 1 -- 172.21.15.29:0/1292699904 learned_addr learned my addr 172.21.15.29:0/1292699904 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:27.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f858b400640 1 --2- 172.21.15.29:0/1292699904 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c06bc10 0x7f858c153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:27.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f858be00640 1 --2- 172.21.15.29:0/1292699904 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f858c15cf50 0x7f858c151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:27.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f858aa00640 1 -- 172.21.15.29:0/1292699904 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c06bc10 msgr2=0x7f858c153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:27.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f858aa00640 1 --2- 172.21.15.29:0/1292699904 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c06bc10 0x7f858c153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f858aa00640 1 -- 172.21.15.29:0/1292699904 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f858c15cf50 msgr2=0x7f858c151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:27.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f858aa00640 1 --2- 172.21.15.29:0/1292699904 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f858c15cf50 0x7f858c151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f858aa00640 1 -- 172.21.15.29:0/1292699904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8574009420 con 0x7f858c159300 2024-01-24T13:06:27.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f858aa00640 1 --2- 172.21.15.29:0/1292699904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c159300 0x7f858c14fc20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8574019ff0 tx=0x7f8574019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:27.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f8583400640 1 -- 172.21.15.29:0/1292699904 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85740b5610 con 0x7f858c159300 2024-01-24T13:06:27.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f8583400640 1 -- 172.21.15.29:0/1292699904 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85740b5790 con 0x7f858c159300 2024-01-24T13:06:27.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f8583400640 1 -- 172.21.15.29:0/1292699904 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85740b5b40 con 0x7f858c159300 2024-01-24T13:06:27.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f8592800640 1 -- 172.21.15.29:0/1292699904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858c1544e0 con 0x7f858c159300 2024-01-24T13:06:27.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f8592800640 1 -- 172.21.15.29:0/1292699904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858c150160 con 0x7f858c159300 2024-01-24T13:06:27.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.734+0000 7f8592800640 1 -- 172.21.15.29:0/1292699904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858c04e850 con 0x7f858c159300 2024-01-24T13:06:27.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.738+0000 7f8583400640 1 -- 172.21.15.29:0/1292699904 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f85740b3040 con 0x7f858c159300 2024-01-24T13:06:27.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.738+0000 7f8583400640 1 --2- 172.21.15.29:0/1292699904 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8564065a60 0x7f8564067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:27.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.738+0000 7f8583400640 1 -- 172.21.15.29:0/1292699904 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f857411d470 con 0x7f858c159300 2024-01-24T13:06:27.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.738+0000 7f858b400640 1 --2- 172.21.15.29:0/1292699904 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8564065a60 0x7f8564067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:27.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.738+0000 7f858b400640 1 --2- 172.21.15.29:0/1292699904 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8564065a60 0x7f8564067f20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f857c00a9a0 tx=0x7f857c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:27.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.742+0000 7f8583400640 1 -- 172.21.15.29:0/1292699904 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f85740eaf60 con 0x7f858c159300 2024-01-24T13:06:27.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.930+0000 7f8592800640 1 -- 172.21.15.29:0/1292699904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f858c154990 con 0x7f858c159300 2024-01-24T13:06:27.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.930+0000 7f8583400640 1 -- 172.21.15.29:0/1292699904 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f85740b1de0 con 0x7f858c159300 2024-01-24T13:06:27.934 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:27.934 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5042,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3468790539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3468790539},{"type":"v1","addr":"172.21.15.29:6834","nonce":3468790539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3278958688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3278958688},{"type":"v1","addr":"172.21.15.29:6835","nonce":3278958688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/1296970243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":1296970243},{"type":"v1","addr":"172.21.15.163:6836","nonce":1296970243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5845,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/2060934071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2060934071},{"type":"v1","addr":"172.21.15.163:6837","nonce":2060934071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[]} 2024-01-24T13:06:27.935 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-01-24T13:06:27.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.930+0000 7f8592800640 1 -- 172.21.15.29:0/1292699904 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8564065a60 msgr2=0x7f8564067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:27.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.930+0000 7f8592800640 1 --2- 172.21.15.29:0/1292699904 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8564065a60 0x7f8564067f20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f857c00a9a0 tx=0x7f857c008040 comp rx=0 tx=0).stop 2024-01-24T13:06:27.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.934+0000 7f8592800640 1 -- 172.21.15.29:0/1292699904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c159300 msgr2=0x7f858c14fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:27.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.934+0000 7f8592800640 1 --2- 172.21.15.29:0/1292699904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c159300 0x7f858c14fc20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8574019ff0 tx=0x7f8574019160 comp rx=0 tx=0).stop 2024-01-24T13:06:27.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.934+0000 7f8592800640 1 -- 172.21.15.29:0/1292699904 shutdown_connections 2024-01-24T13:06:27.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.934+0000 7f8592800640 1 --2- 172.21.15.29:0/1292699904 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8564065a60 0x7f8564067f20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.934+0000 7f8592800640 1 --2- 172.21.15.29:0/1292699904 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f858c15cf50 0x7f858c151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.934+0000 7f8592800640 1 --2- 172.21.15.29:0/1292699904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c159300 0x7f858c14fc20 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.934+0000 7f8592800640 1 --2- 172.21.15.29:0/1292699904 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c06bc10 0x7f858c153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:27.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.934+0000 7f8592800640 1 -- 172.21.15.29:0/1292699904 >> 172.21.15.29:0/1292699904 conn(0x7f858c0b3950 msgr2=0x7f858c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:27.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.934+0000 7f8592800640 1 -- 172.21.15.29:0/1292699904 shutdown_connections 2024-01-24T13:06:27.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:27.934+0000 7f8592800640 1 -- 172.21.15.29:0/1292699904 wait complete. 2024-01-24T13:06:27.957 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-24T13:06:27.957 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-24T13:06:27.957 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-24T13:06:27.957 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:06:27.957 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-24T13:06:27.957 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-24T13:06:27.958 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-24T13:06:27.958 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:06:27.958 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-24T13:06:27.958 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-24T13:06:27.958 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-24T13:06:27.958 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:06:27.958 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-24T13:06:27.959 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-24T13:06:27.959 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-24T13:06:27.959 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:06:27.970 INFO:tasks.ceph.mds.a:Stopped 2024-01-24T13:06:27.970 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-24T13:06:27.971 INFO:tasks.ceph.mds.c:Stopped 2024-01-24T13:06:27.971 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-24T13:06:27.974 INFO:tasks.ceph.mds.b:Stopped 2024-01-24T13:06:27.975 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-24T13:06:27.975 INFO:tasks.ceph.mds.d:Stopped 2024-01-24T13:06:27.976 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-24T13:06:28.015 INFO:tasks.ceph.mds.a:Started 2024-01-24T13:06:28.015 DEBUG:teuthology.parallel:result is None 2024-01-24T13:06:28.016 INFO:tasks.ceph.mds.c:Started 2024-01-24T13:06:28.016 DEBUG:teuthology.parallel:result is None 2024-01-24T13:06:28.020 INFO:tasks.ceph.mds.b:Started 2024-01-24T13:06:28.021 DEBUG:teuthology.parallel:result is None 2024-01-24T13:06:28.022 INFO:tasks.ceph.mds.d:Started 2024-01-24T13:06:28.022 DEBUG:teuthology.parallel:result is None 2024-01-24T13:06:28.022 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-24T13:06:28.101 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-01-24T13:06:28.102 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2024-01-24T13:06:28.108 INFO:tasks.ceph.mds.b.smithi163.stdout:starting mds.b at 2024-01-24T13:06:28.108 INFO:tasks.ceph.mds.d.smithi163.stdout:starting mds.d at 2024-01-24T13:06:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bbcc00640 1 Processor -- start 2024-01-24T13:06:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bbcc00640 1 -- start start 2024-01-24T13:06:28.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bbcc00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2bb80ce790 0x7f2bb8167770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bbcc00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb80d05e0 con 0x7f2bb80d0150 2024-01-24T13:06:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bbcc00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb80d0830 con 0x7f2bb80cd460 2024-01-24T13:06:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bbcc00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb80d0b10 con 0x7f2bb80ce790 2024-01-24T13:06:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bb5400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2bb80d0150 0x7f2bb80ce080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44878/0 (socket says 172.21.15.29:44878) 2024-01-24T13:06:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bb5400640 1 -- 172.21.15.29:0/1409579608 learned_addr learned my addr 172.21.15.29:0/1409579608 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bb6800640 1 --2- 172.21.15.29:0/1409579608 >> v2:172.21.15.163:3300/0 conn(0x7f2bb80ce790 0x7f2bb8167770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bb4a00640 1 -- 172.21.15.29:0/1409579608 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515703514 0 0) 0x7f2bb80d05e0 con 0x7f2bb80d0150 2024-01-24T13:06:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bb4a00640 1 -- 172.21.15.29:0/1409579608 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b98003530 con 0x7f2bb80d0150 2024-01-24T13:06:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bb4a00640 1 -- 172.21.15.29:0/1409579608 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530486208 0 0) 0x7f2bb80d0830 con 0x7f2bb80cd460 2024-01-24T13:06:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bb4a00640 1 -- 172.21.15.29:0/1409579608 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bb80d05e0 con 0x7f2bb80cd460 2024-01-24T13:06:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bb6800640 1 -- 172.21.15.29:0/1409579608 >> v1:172.21.15.163:6789/0 conn(0x7f2bb80cd460 legacy=0x7f2bb815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bb6800640 1 -- 172.21.15.29:0/1409579608 >> v1:172.21.15.29:6789/0 conn(0x7f2bb80d0150 legacy=0x7f2bb80ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.170+0000 7f2bb6800640 1 -- 172.21.15.29:0/1409579608 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb80d0df0 con 0x7f2bb80ce790 2024-01-24T13:06:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.174+0000 7f2bb6800640 1 --2- 172.21.15.29:0/1409579608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb80ce790 0x7f2bb8167770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009d90 tx=0x7f2bb001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e37acd25187cf72b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.174+0000 7f2bb4a00640 1 -- 172.21.15.29:0/1409579608 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00a5940 con 0x7f2bb80ce790 2024-01-24T13:06:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.174+0000 7f2bb4a00640 1 -- 172.21.15.29:0/1409579608 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb00a5aa0 con 0x7f2bb80ce790 2024-01-24T13:06:28.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.174+0000 7f2bb4a00640 1 -- 172.21.15.29:0/1409579608 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00a5e30 con 0x7f2bb80ce790 2024-01-24T13:06:28.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.174+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1409579608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb80ce790 msgr2=0x7f2bb8167770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:28.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.174+0000 7f2bbcc00640 1 --2- 172.21.15.29:0/1409579608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb80ce790 0x7f2bb8167770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009d90 tx=0x7f2bb001c8c0 comp rx=0 tx=0).stop 2024-01-24T13:06:28.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.174+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1409579608 shutdown_connections 2024-01-24T13:06:28.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.174+0000 7f2bbcc00640 1 --2- 172.21.15.29:0/1409579608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb80ce790 0x7f2bb8167770 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:28.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.174+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1409579608 >> 172.21.15.29:0/1409579608 conn(0x7f2bb8069cd0 msgr2=0x7f2bb806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:28.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.174+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1409579608 shutdown_connections 2024-01-24T13:06:28.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.174+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1409579608 wait complete. 2024-01-24T13:06:28.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bbcc00640 1 Processor -- start 2024-01-24T13:06:28.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bbcc00640 1 -- start start 2024-01-24T13:06:28.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bbcc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bb80cd460 0x7f2bb8160620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:28.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bbcc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bb80ce790 0x7f2bb815d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:28.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bbcc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb80d0150 0x7f2bb80b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:28.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bbcc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb815f580 con 0x7f2bb80ce790 2024-01-24T13:06:28.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bbcc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb815f860 con 0x7f2bb80d0150 2024-01-24T13:06:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bbcc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb815fb40 con 0x7f2bb80cd460 2024-01-24T13:06:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bb5400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bb80ce790 0x7f2bb815d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bb5400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bb80ce790 0x7f2bb815d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36244/0 (socket says 172.21.15.29:36244) 2024-01-24T13:06:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bb6800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb80d0150 0x7f2bb80b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bb5400640 1 -- 172.21.15.29:0/1290968278 learned_addr learned my addr 172.21.15.29:0/1290968278 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bb5e00640 1 --2- 172.21.15.29:0/1290968278 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bb80cd460 0x7f2bb8160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:28.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bb5400640 1 -- 172.21.15.29:0/1290968278 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bb80cd460 msgr2=0x7f2bb8160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:28.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bb5400640 1 --2- 172.21.15.29:0/1290968278 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bb80cd460 0x7f2bb8160620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bb5400640 1 -- 172.21.15.29:0/1290968278 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb80d0150 msgr2=0x7f2bb80b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bb5400640 1 --2- 172.21.15.29:0/1290968278 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb80d0150 0x7f2bb80b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bb5400640 1 -- 172.21.15.29:0/1290968278 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb0009a70 con 0x7f2bb80ce790 2024-01-24T13:06:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bb6800640 1 --2- 172.21.15.29:0/1290968278 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb80d0150 0x7f2bb80b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bb5400640 1 --2- 172.21.15.29:0/1290968278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bb80ce790 0x7f2bb815d6a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c420 tx=0x7f2ba000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bae000640 1 -- 172.21.15.29:0/1290968278 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0005cf0 con 0x7f2bb80ce790 2024-01-24T13:06:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bae000640 1 -- 172.21.15.29:0/1290968278 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba0005e50 con 0x7f2bb80ce790 2024-01-24T13:06:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bae000640 1 -- 172.21.15.29:0/1290968278 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba00072d0 con 0x7f2bb80ce790 2024-01-24T13:06:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1290968278 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb815fe20 con 0x7f2bb80ce790 2024-01-24T13:06:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.178+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1290968278 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb80b4220 con 0x7f2bb80ce790 2024-01-24T13:06:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.182+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1290968278 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb804e850 con 0x7f2bb80ce790 2024-01-24T13:06:28.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.182+0000 7f2bae000640 1 -- 172.21.15.29:0/1290968278 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2ba0007430 con 0x7f2bb80ce790 2024-01-24T13:06:28.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.182+0000 7f2bae000640 1 --2- 172.21.15.29:0/1290968278 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2b90065a60 0x7f2b90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:28.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.182+0000 7f2bae000640 1 -- 172.21.15.29:0/1290968278 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2ba0082550 con 0x7f2bb80ce790 2024-01-24T13:06:28.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.182+0000 7f2bb5e00640 1 --2- 172.21.15.29:0/1290968278 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2b90065a60 0x7f2b90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:28.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.182+0000 7f2bb5e00640 1 --2- 172.21.15.29:0/1290968278 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2b90065a60 0x7f2b90067f20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80011f0 tx=0x7f2ba8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:28.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.186+0000 7f2bae000640 1 -- 172.21.15.29:0/1290968278 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2ba00500e0 con 0x7f2bb80ce790 2024-01-24T13:06:28.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:28.358+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1290968278 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2bb81602d0 con 0x7f2bb80ce790 2024-01-24T13:06:29.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.290+0000 7f2bae000640 1 -- 172.21.15.29:0/1290968278 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v55) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2ba0053700 con 0x7f2bb80ce790 2024-01-24T13:06:29.295 INFO:teuthology.orchestra.run.smithi029.stderr: removed all blocklist entries 2024-01-24T13:06:29.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.294+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1290968278 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2b90065a60 msgr2=0x7f2b90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:29.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.294+0000 7f2bbcc00640 1 --2- 172.21.15.29:0/1290968278 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2b90065a60 0x7f2b90067f20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80011f0 tx=0x7f2ba8009040 comp rx=0 tx=0).stop 2024-01-24T13:06:29.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.294+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1290968278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bb80ce790 msgr2=0x7f2bb815d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:29.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.294+0000 7f2bbcc00640 1 --2- 172.21.15.29:0/1290968278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bb80ce790 0x7f2bb815d6a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c420 tx=0x7f2ba000c8e0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.294+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1290968278 shutdown_connections 2024-01-24T13:06:29.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.294+0000 7f2bbcc00640 1 --2- 172.21.15.29:0/1290968278 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2b90065a60 0x7f2b90067f20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.294+0000 7f2bbcc00640 1 --2- 172.21.15.29:0/1290968278 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb80d0150 0x7f2bb80b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.294+0000 7f2bbcc00640 1 --2- 172.21.15.29:0/1290968278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bb80ce790 0x7f2bb815d6a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.294+0000 7f2bbcc00640 1 --2- 172.21.15.29:0/1290968278 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2bb80cd460 0x7f2bb8160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.294+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1290968278 >> 172.21.15.29:0/1290968278 conn(0x7f2bb8069cd0 msgr2=0x7f2bb80c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:29.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.294+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1290968278 shutdown_connections 2024-01-24T13:06:29.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.294+0000 7f2bbcc00640 1 -- 172.21.15.29:0/1290968278 wait complete. 2024-01-24T13:06:29.319 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-24T13:06:29.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.458+0000 7f9c10000640 1 Processor -- start 2024-01-24T13:06:29.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.458+0000 7f9c10000640 1 -- start start 2024-01-24T13:06:29.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.458+0000 7f9c10000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9c0815aac0 0x7f9c0806c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:29.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.458+0000 7f9c10000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9c080658e0 0x7f9c0806cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.458+0000 7f9c10000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c080b2be0 con 0x7f9c0806d700 2024-01-24T13:06:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.458+0000 7f9c10000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c080c9ce0 con 0x7f9c0815aac0 2024-01-24T13:06:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.458+0000 7f9c10000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0815e720 con 0x7f9c080658e0 2024-01-24T13:06:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.458+0000 7f9c0d600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9c0815aac0 0x7f9c0806c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.458+0000 7f9c0d600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9c0815aac0 0x7f9c0806c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36252/0 (socket says 172.21.15.29:36252) 2024-01-24T13:06:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.458+0000 7f9c0d600640 1 -- 172.21.15.29:0/2830947974 learned_addr learned my addr 172.21.15.29:0/2830947974 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.458+0000 7f9c0cc00640 1 --2- 172.21.15.29:0/2830947974 >> v2:172.21.15.163:3300/0 conn(0x7f9c080658e0 0x7f9c0806cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.462+0000 7f9c0d600640 1 -- 172.21.15.29:0/2830947974 >> v2:172.21.15.163:3300/0 conn(0x7f9c080658e0 msgr2=0x7f9c0806cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.462+0000 7f9c0d600640 1 --2- 172.21.15.29:0/2830947974 >> v2:172.21.15.163:3300/0 conn(0x7f9c080658e0 0x7f9c0806cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.462+0000 7f9c0d600640 1 -- 172.21.15.29:0/2830947974 >> v1:172.21.15.29:6789/0 conn(0x7f9c0806d700 legacy=0x7f9c08069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.462+0000 7f9c0d600640 1 -- 172.21.15.29:0/2830947974 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c080c9f30 con 0x7f9c0815aac0 2024-01-24T13:06:29.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.462+0000 7f9c0d600640 1 --2- 172.21.15.29:0/2830947974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c0815aac0 0x7f9c0806c8b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9c080b1b60 tx=0x7f9bf801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d572ec1d835ce9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:29.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.462+0000 7f9c07e00640 1 -- 172.21.15.29:0/2830947974 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80ab600 con 0x7f9c0815aac0 2024-01-24T13:06:29.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.462+0000 7f9c07e00640 1 -- 172.21.15.29:0/2830947974 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf80a7050 con 0x7f9c0815aac0 2024-01-24T13:06:29.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.462+0000 7f9c07e00640 1 -- 172.21.15.29:0/2830947974 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80ab980 con 0x7f9c0815aac0 2024-01-24T13:06:29.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.462+0000 7f9c10000640 1 -- 172.21.15.29:0/2830947974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c0815aac0 msgr2=0x7f9c0806c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:29.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.462+0000 7f9c10000640 1 --2- 172.21.15.29:0/2830947974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c0815aac0 0x7f9c0806c8b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9c080b1b60 tx=0x7f9bf801c470 comp rx=0 tx=0).stop 2024-01-24T13:06:29.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c10000640 1 -- 172.21.15.29:0/2830947974 shutdown_connections 2024-01-24T13:06:29.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c10000640 1 --2- 172.21.15.29:0/2830947974 >> v2:172.21.15.163:3300/0 conn(0x7f9c080658e0 0x7f9c0806cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c10000640 1 --2- 172.21.15.29:0/2830947974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c0815aac0 0x7f9c0806c8b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c10000640 1 -- 172.21.15.29:0/2830947974 >> 172.21.15.29:0/2830947974 conn(0x7f9c080cb700 msgr2=0x7f9c080cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c10000640 1 -- 172.21.15.29:0/2830947974 shutdown_connections 2024-01-24T13:06:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c10000640 1 -- 172.21.15.29:0/2830947974 wait complete. 2024-01-24T13:06:29.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c10000640 1 Processor -- start 2024-01-24T13:06:29.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c10000640 1 -- start start 2024-01-24T13:06:29.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c10000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c080658e0 0x7f9c0814ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:29.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c10000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c0806d700 0x7f9c08153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:29.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c10000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c0815aac0 0x7f9c080b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:29.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c10000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c08157310 con 0x7f9c080658e0 2024-01-24T13:06:29.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c10000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c081569e0 con 0x7f9c0815aac0 2024-01-24T13:06:29.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c10000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c08156cc0 con 0x7f9c0806d700 2024-01-24T13:06:29.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c0d600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c080658e0 0x7f9c0814ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:29.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c0d600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c080658e0 0x7f9c0814ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36266/0 (socket says 172.21.15.29:36266) 2024-01-24T13:06:29.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c0d600640 1 -- 172.21.15.29:0/1947372822 learned_addr learned my addr 172.21.15.29:0/1947372822 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:29.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c0e000640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c0815aac0 0x7f9c080b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:29.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c0cc00640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c0806d700 0x7f9c08153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:29.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c0d600640 1 -- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c0806d700 msgr2=0x7f9c08153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:29.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c0d600640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c0806d700 0x7f9c08153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c0d600640 1 -- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c0815aac0 msgr2=0x7f9c080b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:29.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c0d600640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c0815aac0 0x7f9c080b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c0d600640 1 -- 172.21.15.29:0/1947372822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf80094d0 con 0x7f9c080658e0 2024-01-24T13:06:29.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c0cc00640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c0806d700 0x7f9c08153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:29.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c0e000640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c0815aac0 0x7f9c080b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:29.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.466+0000 7f9c0d600640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c080658e0 0x7f9c0814ba60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8019080 tx=0x7f9bf8019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:29.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.470+0000 7f9c05600640 1 -- 172.21.15.29:0/1947372822 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80b4620 con 0x7f9c080658e0 2024-01-24T13:06:29.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.470+0000 7f9c05600640 1 -- 172.21.15.29:0/1947372822 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf80b4780 con 0x7f9c080658e0 2024-01-24T13:06:29.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.470+0000 7f9c10000640 1 -- 172.21.15.29:0/1947372822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c08156fa0 con 0x7f9c080658e0 2024-01-24T13:06:29.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.470+0000 7f9c05600640 1 -- 172.21.15.29:0/1947372822 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80b4b30 con 0x7f9c080658e0 2024-01-24T13:06:29.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.470+0000 7f9c10000640 1 -- 172.21.15.29:0/1947372822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c08154da0 con 0x7f9c080658e0 2024-01-24T13:06:29.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.470+0000 7f9c10000640 1 -- 172.21.15.29:0/1947372822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c080b16d0 con 0x7f9c080658e0 2024-01-24T13:06:29.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.470+0000 7f9c05600640 1 -- 172.21.15.29:0/1947372822 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9bf80b2070 con 0x7f9c080658e0 2024-01-24T13:06:29.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.470+0000 7f9c05600640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9be0065a60 0x7f9be0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:29.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.470+0000 7f9c05600640 1 -- 172.21.15.29:0/1947372822 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9bf811c2f0 con 0x7f9c080658e0 2024-01-24T13:06:29.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.470+0000 7f9c0cc00640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9be0065a60 0x7f9be0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:29.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.474+0000 7f9c0cc00640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9be0065a60 0x7f9be0067f20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9c080ce570 tx=0x7f9bf0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:29.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.474+0000 7f9c05600640 1 -- 172.21.15.29:0/1947372822 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9bf80e9da0 con 0x7f9c080658e0 2024-01-24T13:06:29.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.686+0000 7f9c10000640 1 -- 172.21.15.29:0/1947372822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9c0804e850 con 0x7f9c080658e0 2024-01-24T13:06:29.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.686+0000 7f9c05600640 1 -- 172.21.15.29:0/1947372822 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f9bf80ed3c0 con 0x7f9c080658e0 2024-01-24T13:06:29.690 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:29.691 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:06:29.691 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_dump": [ 2024-01-24T13:06:29.691 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.691 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.a", 2024-01-24T13:06:29.691 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCBCrFlfcc0LxAAcfzIx22lqaFU0QzMcxcnsA==", 2024-01-24T13:06:29.691 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.691 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:06:29.691 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-24T13:06:29.691 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-24T13:06:29.691 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.691 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.691 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.691 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.692 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.b", 2024-01-24T13:06:29.692 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCBCrFlejZvOxAAg3f/x3idsEKvMP7TkC/XVg==", 2024-01-24T13:06:29.692 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.692 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:06:29.692 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-24T13:06:29.692 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-24T13:06:29.692 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.692 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.692 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.692 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.692 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.c", 2024-01-24T13:06:29.692 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCBCrFlmpRhNhAAQAXfv9fO1+pk6zLArr63uw==", 2024-01-24T13:06:29.692 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.692 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:06:29.693 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-24T13:06:29.693 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-24T13:06:29.693 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.693 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.693 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.693 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.693 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.d", 2024-01-24T13:06:29.693 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCCCrFl8fcPBxAAUGmu768hahYetBTAMaaOqw==", 2024-01-24T13:06:29.693 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.693 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:06:29.693 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-24T13:06:29.693 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-24T13:06:29.693 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.693 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.694 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.694 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.694 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.0", 2024-01-24T13:06:29.694 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCDCrFlA2upKBAA/lD3Zf4Zwuct9CuHohEY4Q==", 2024-01-24T13:06:29.694 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.694 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:06:29.694 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:06:29.694 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.694 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.694 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.694 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.694 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.1", 2024-01-24T13:06:29.694 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCGCrFlPxMuMBAAX00zw2rQ5p4gj+6qr8joLQ==", 2024-01-24T13:06:29.694 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.695 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:06:29.695 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:06:29.695 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.695 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.695 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.695 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.695 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.2", 2024-01-24T13:06:29.695 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCJCrFlX09NNhAAs0XO4DOuWxSde/FX27SAlQ==", 2024-01-24T13:06:29.695 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.695 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:06:29.695 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:06:29.695 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.695 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.695 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.696 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.696 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.3", 2024-01-24T13:06:29.696 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCNCrFlYQPpABAAwXMaiadTeodv89ipFnbtfw==", 2024-01-24T13:06:29.696 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.696 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:06:29.696 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:06:29.696 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.696 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.696 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.696 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.696 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.4", 2024-01-24T13:06:29.696 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCTCrFlkicqDBAAwNHahMGIHvoUyoTiGYMipQ==", 2024-01-24T13:06:29.696 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.697 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:06:29.697 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:06:29.697 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.697 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.697 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.697 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.697 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.5", 2024-01-24T13:06:29.697 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCWCrFlOjajEhAAI8zgPXBucICda0RviagEzg==", 2024-01-24T13:06:29.697 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.697 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:06:29.697 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:06:29.697 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.697 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.697 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.698 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.698 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.6", 2024-01-24T13:06:29.698 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCZCrFlp/ISGRAADWHsw5NUXfuuT6mK++jfyQ==", 2024-01-24T13:06:29.698 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.698 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:06:29.698 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:06:29.698 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.698 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.698 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.699 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.699 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.7", 2024-01-24T13:06:29.699 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCcCrFlUUSsHxAASrwuwRULMRoJ8N5268ifPA==", 2024-01-24T13:06:29.699 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.699 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-24T13:06:29.699 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-24T13:06:29.699 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.699 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.699 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.699 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.699 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.0", 2024-01-24T13:06:29.699 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCCCrFlb6/4ChAAXuhDbbXWzUiqLFkxjl338w==", 2024-01-24T13:06:29.700 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.700 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:06:29.700 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow r", 2024-01-24T13:06:29.700 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rw pool=cephfs_data" 2024-01-24T13:06:29.700 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.700 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.700 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.700 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.1", 2024-01-24T13:06:29.701 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCCCrFlAr33FBAAa9i6dmMB95s9F6uS9H29Tw==", 2024-01-24T13:06:29.701 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.701 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:06:29.701 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2024-01-24T13:06:29.701 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2024-01-24T13:06:29.701 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2024-01-24T13:06:29.701 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.701 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.701 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.701 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.2", 2024-01-24T13:06:29.701 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCCCrFlgpxlERAAQtpVfRyxSqXBmfFO2TMiuw==", 2024-01-24T13:06:29.701 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.701 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:06:29.701 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2024-01-24T13:06:29.702 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2024-01-24T13:06:29.702 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2024-01-24T13:06:29.702 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.702 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.702 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.702 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.3", 2024-01-24T13:06:29.702 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCCCrFli6DxGhAAvXbTcKz7CyokwecCpCRAhg==", 2024-01-24T13:06:29.702 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.702 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-24T13:06:29.702 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2024-01-24T13:06:29.702 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2024-01-24T13:06:29.702 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2024-01-24T13:06:29.702 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.702 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.703 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.703 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.admin", 2024-01-24T13:06:29.703 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCBCrFlm28DExAAamnPiAr8qULuxfOkv+GlFA==", 2024-01-24T13:06:29.703 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.703 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2024-01-24T13:06:29.703 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-24T13:06:29.703 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-24T13:06:29.703 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.703 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.703 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.703 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.703 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.x", 2024-01-24T13:06:29.703 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCBCrFlL3vuKhAASZI1JPwrC06IrY+iYb6jvA==", 2024-01-24T13:06:29.703 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.704 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2024-01-24T13:06:29.704 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2024-01-24T13:06:29.704 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.704 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.704 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:29.704 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:29.704 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.y", 2024-01-24T13:06:29.704 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQCBCrFl07wJJxAA9zO/ZHwphgGeFXCrWFYJKA==", 2024-01-24T13:06:29.704 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-24T13:06:29.704 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2024-01-24T13:06:29.704 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2024-01-24T13:06:29.704 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-24T13:06:29.704 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.704 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:29.705 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-01-24T13:06:29.705 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:06:29.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.690+0000 7f9c10000640 1 -- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9be0065a60 msgr2=0x7f9be0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:29.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.690+0000 7f9c10000640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9be0065a60 0x7f9be0067f20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9c080ce570 tx=0x7f9bf0008040 comp rx=0 tx=0).stop 2024-01-24T13:06:29.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.690+0000 7f9c10000640 1 -- 172.21.15.29:0/1947372822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c080658e0 msgr2=0x7f9c0814ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:29.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.690+0000 7f9c10000640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c080658e0 0x7f9c0814ba60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8019080 tx=0x7f9bf8019210 comp rx=0 tx=0).stop 2024-01-24T13:06:29.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.690+0000 7f9c10000640 1 -- 172.21.15.29:0/1947372822 shutdown_connections 2024-01-24T13:06:29.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.690+0000 7f9c10000640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9be0065a60 0x7f9be0067f20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.690+0000 7f9c10000640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c0815aac0 0x7f9c080b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.690+0000 7f9c10000640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9c0806d700 0x7f9c08153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.690+0000 7f9c10000640 1 --2- 172.21.15.29:0/1947372822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c080658e0 0x7f9c0814ba60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.690+0000 7f9c10000640 1 -- 172.21.15.29:0/1947372822 >> 172.21.15.29:0/1947372822 conn(0x7f9c080cb700 msgr2=0x7f9c080b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:29.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.690+0000 7f9c10000640 1 -- 172.21.15.29:0/1947372822 shutdown_connections 2024-01-24T13:06:29.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.690+0000 7f9c10000640 1 -- 172.21.15.29:0/1947372822 wait complete. 2024-01-24T13:06:29.713 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:06:29.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.850+0000 7f636da00640 1 Processor -- start 2024-01-24T13:06:29.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.850+0000 7f636da00640 1 -- start start 2024-01-24T13:06:29.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f636da00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f636815c770 0x7f636806d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:29.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f636da00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f63680cedc0 0x7f63680cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:29.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f636da00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6368071ce0 0x7f63680cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:29.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f636da00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6368070d10 con 0x7f63680cedc0 2024-01-24T13:06:29.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f636da00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636815cb50 con 0x7f636815c770 2024-01-24T13:06:29.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f636da00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6368070f20 con 0x7f6368071ce0 2024-01-24T13:06:29.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f6366000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f63680cedc0 0x7f63680cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:29.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f6366000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f63680cedc0 0x7f63680cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36274/0 (socket says 172.21.15.29:36274) 2024-01-24T13:06:29.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f6366000640 1 -- 172.21.15.29:0/1915418308 learned_addr learned my addr 172.21.15.29:0/1915418308 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:29.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f6367400640 1 --2- 172.21.15.29:0/1915418308 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6368071ce0 0x7f63680cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:29.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f6366a00640 1 --2- 172.21.15.29:0/1915418308 >> v2:172.21.15.163:3300/0 conn(0x7f636815c770 0x7f636806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:29.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f6366000640 1 -- 172.21.15.29:0/1915418308 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6368071ce0 msgr2=0x7f63680cfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:29.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f6366000640 1 --2- 172.21.15.29:0/1915418308 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6368071ce0 0x7f63680cfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f6366000640 1 -- 172.21.15.29:0/1915418308 >> v2:172.21.15.163:3300/0 conn(0x7f636815c770 msgr2=0x7f636806d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:29.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f6366000640 1 --2- 172.21.15.29:0/1915418308 >> v2:172.21.15.163:3300/0 conn(0x7f636815c770 0x7f636806d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f6366000640 1 -- 172.21.15.29:0/1915418308 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6368071200 con 0x7f63680cedc0 2024-01-24T13:06:29.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f6367400640 1 --2- 172.21.15.29:0/1915418308 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6368071ce0 0x7f63680cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:29.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f6366a00640 1 --2- 172.21.15.29:0/1915418308 >> v2:172.21.15.163:3300/0 conn(0x7f636815c770 0x7f636806d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:29.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.854+0000 7f6366000640 1 --2- 172.21.15.29:0/1915418308 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63680cedc0 0x7f63680cf770 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f636806ad80 tx=0x7f635001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad07c6fa7f147296 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:29.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.858+0000 7f6365600640 1 -- 172.21.15.29:0/1915418308 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63500ab620 con 0x7f63680cedc0 2024-01-24T13:06:29.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.858+0000 7f6365600640 1 -- 172.21.15.29:0/1915418308 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63500ab780 con 0x7f63680cedc0 2024-01-24T13:06:29.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.858+0000 7f6365600640 1 -- 172.21.15.29:0/1915418308 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63500abb10 con 0x7f63680cedc0 2024-01-24T13:06:29.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.858+0000 7f636da00640 1 -- 172.21.15.29:0/1915418308 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63680cedc0 msgr2=0x7f63680cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:29.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.858+0000 7f636da00640 1 --2- 172.21.15.29:0/1915418308 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63680cedc0 0x7f63680cf770 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f636806ad80 tx=0x7f635001c440 comp rx=0 tx=0).stop 2024-01-24T13:06:29.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.858+0000 7f636da00640 1 -- 172.21.15.29:0/1915418308 shutdown_connections 2024-01-24T13:06:29.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.858+0000 7f636da00640 1 --2- 172.21.15.29:0/1915418308 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6368071ce0 0x7f63680cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.858+0000 7f636da00640 1 --2- 172.21.15.29:0/1915418308 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63680cedc0 0x7f63680cf770 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.858+0000 7f636da00640 1 --2- 172.21.15.29:0/1915418308 >> v2:172.21.15.163:3300/0 conn(0x7f636815c770 0x7f636806d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.858+0000 7f636da00640 1 -- 172.21.15.29:0/1915418308 >> 172.21.15.29:0/1915418308 conn(0x7f636806b1e0 msgr2=0x7f636806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:29.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.858+0000 7f636da00640 1 -- 172.21.15.29:0/1915418308 shutdown_connections 2024-01-24T13:06:29.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.858+0000 7f636da00640 1 -- 172.21.15.29:0/1915418308 wait complete. 2024-01-24T13:06:29.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.858+0000 7f636da00640 1 Processor -- start 2024-01-24T13:06:29.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.858+0000 7f636da00640 1 -- start start 2024-01-24T13:06:29.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f636da00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6368071ce0 0x7f63681495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:29.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f636da00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63680cedc0 0x7f6368155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:29.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f636da00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f636815c770 0x7f636814ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:29.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f636da00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636814f720 con 0x7f63680cedc0 2024-01-24T13:06:29.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f636da00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63681568d0 con 0x7f636815c770 2024-01-24T13:06:29.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f636da00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636814ee10 con 0x7f6368071ce0 2024-01-24T13:06:29.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f6366000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63680cedc0 0x7f6368155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:29.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f6366000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63680cedc0 0x7f6368155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36280/0 (socket says 172.21.15.29:36280) 2024-01-24T13:06:29.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f6366000640 1 -- 172.21.15.29:0/2955618241 learned_addr learned my addr 172.21.15.29:0/2955618241 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:29.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f6366a00640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6368071ce0 0x7f63681495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:29.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f6367400640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f636815c770 0x7f636814ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:29.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f6366000640 1 -- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6368071ce0 msgr2=0x7f63681495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:29.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f6366000640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6368071ce0 0x7f63681495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f6366000640 1 -- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f636815c770 msgr2=0x7f636814ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:29.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f6366000640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f636815c770 0x7f636814ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:29.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f6366000640 1 -- 172.21.15.29:0/2955618241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63500094d0 con 0x7f63680cedc0 2024-01-24T13:06:29.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f6367400640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f636815c770 0x7f636814ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:29.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f6366000640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63680cedc0 0x7f6368155cf0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f635001aaf0 tx=0x7f635001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:29.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f635ea00640 1 -- 172.21.15.29:0/2955618241 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63500be3f0 con 0x7f63680cedc0 2024-01-24T13:06:29.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f635ea00640 1 -- 172.21.15.29:0/2955618241 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63500be550 con 0x7f63680cedc0 2024-01-24T13:06:29.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f635ea00640 1 -- 172.21.15.29:0/2955618241 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63500be900 con 0x7f63680cedc0 2024-01-24T13:06:29.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f636da00640 1 -- 172.21.15.29:0/2955618241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6368149b10 con 0x7f63680cedc0 2024-01-24T13:06:29.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f636da00640 1 -- 172.21.15.29:0/2955618241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636814f060 con 0x7f63680cedc0 2024-01-24T13:06:29.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f636da00640 1 -- 172.21.15.29:0/2955618241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636814f860 con 0x7f63680cedc0 2024-01-24T13:06:29.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.862+0000 7f635ea00640 1 -- 172.21.15.29:0/2955618241 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f63500c7440 con 0x7f63680cedc0 2024-01-24T13:06:29.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.866+0000 7f635ea00640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6340065a60 0x7f6340067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:29.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.866+0000 7f635ea00640 1 -- 172.21.15.29:0/2955618241 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f635011d730 con 0x7f63680cedc0 2024-01-24T13:06:29.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.866+0000 7f6366a00640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6340065a60 0x7f6340067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:29.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.866+0000 7f6366a00640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6340065a60 0x7f6340067f20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6358006fd0 tx=0x7f6358008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:29.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:29.870+0000 7f635ea00640 1 -- 172.21.15.29:0/2955618241 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f636814f860 con 0x7f63680cedc0 2024-01-24T13:06:30.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.030+0000 7f636da00640 1 -- 172.21.15.29:0/2955618241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f636814f860 con 0x7f63680cedc0 2024-01-24T13:06:30.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.030+0000 7f635ea00640 1 -- 172.21.15.29:0/2955618241 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+12594 (secure 0 0 0) 0x7f636814f860 con 0x7f63680cedc0 2024-01-24T13:06:30.036 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:30.036 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":55,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:06:29.290992+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:06:30.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.034+0000 7f636da00640 1 -- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6340065a60 msgr2=0x7f6340067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.034+0000 7f636da00640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6340065a60 0x7f6340067f20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6358006fd0 tx=0x7f6358008040 comp rx=0 tx=0).stop 2024-01-24T13:06:30.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.034+0000 7f636da00640 1 -- 172.21.15.29:0/2955618241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63680cedc0 msgr2=0x7f6368155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.034+0000 7f636da00640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63680cedc0 0x7f6368155cf0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f635001aaf0 tx=0x7f635001ac80 comp rx=0 tx=0).stop 2024-01-24T13:06:30.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.034+0000 7f636da00640 1 -- 172.21.15.29:0/2955618241 shutdown_connections 2024-01-24T13:06:30.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.034+0000 7f636da00640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6340065a60 0x7f6340067f20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.034+0000 7f636da00640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f636815c770 0x7f636814ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.034+0000 7f636da00640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63680cedc0 0x7f6368155cf0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.034+0000 7f636da00640 1 --2- 172.21.15.29:0/2955618241 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6368071ce0 0x7f63681495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.034+0000 7f636da00640 1 -- 172.21.15.29:0/2955618241 >> 172.21.15.29:0/2955618241 conn(0x7f636806b1e0 msgr2=0x7f63680cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:30.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.034+0000 7f636da00640 1 -- 172.21.15.29:0/2955618241 shutdown_connections 2024-01-24T13:06:30.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.034+0000 7f636da00640 1 -- 172.21.15.29:0/2955618241 wait complete. 2024-01-24T13:06:30.058 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:06:30.059 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:06:30.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.198+0000 7f0d5c800640 1 Processor -- start 2024-01-24T13:06:30.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.198+0000 7f0d5c800640 1 -- start start 2024-01-24T13:06:30.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.198+0000 7f0d5c800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d540b2760 0x7f0d540b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.198+0000 7f0d5c800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d5415cef0 0x7f0d5415d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.198+0000 7f0d5c800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d54153de0 con 0x7f0d54153a00 2024-01-24T13:06:30.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.198+0000 7f0d5c800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d540b3150 con 0x7f0d540b2760 2024-01-24T13:06:30.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.198+0000 7f0d5c800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54071d10 con 0x7f0d5415cef0 2024-01-24T13:06:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.202+0000 7f0d59400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d540b2760 0x7f0d540b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.202+0000 7f0d59e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0d54153a00 0x7f0d54071600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44888/0 (socket says 172.21.15.29:44888) 2024-01-24T13:06:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.202+0000 7f0d59e00640 1 -- 172.21.15.29:0/1623423028 learned_addr learned my addr 172.21.15.29:0/1623423028 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.202+0000 7f0d5a800640 1 --2- 172.21.15.29:0/1623423028 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d5415cef0 0x7f0d5415d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.202+0000 7f0d59400640 1 -- 172.21.15.29:0/1623423028 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d5415cef0 msgr2=0x7f0d5415d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.202+0000 7f0d59400640 1 --2- 172.21.15.29:0/1623423028 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d5415cef0 0x7f0d5415d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.202+0000 7f0d59400640 1 -- 172.21.15.29:0/1623423028 >> v1:172.21.15.29:6789/0 conn(0x7f0d54153a00 legacy=0x7f0d54071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.202+0000 7f0d59400640 1 -- 172.21.15.29:0/1623423028 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54159900 con 0x7f0d540b2760 2024-01-24T13:06:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.202+0000 7f0d58a00640 1 -- 172.21.15.29:0/1623423028 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307907186 0 0) 0x7f0d54153de0 con 0x7f0d54153a00 2024-01-24T13:06:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.202+0000 7f0d5a800640 1 --2- 172.21.15.29:0/1623423028 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d5415cef0 0x7f0d5415d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:30.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.202+0000 7f0d59400640 1 --2- 172.21.15.29:0/1623423028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d540b2760 0x7f0d540b2c10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0097c0 tx=0x7f0d3c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e580c1433a41755 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d58a00640 1 -- 172.21.15.29:0/1623423028 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0ac620 con 0x7f0d540b2760 2024-01-24T13:06:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d58a00640 1 -- 172.21.15.29:0/1623423028 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0ac780 con 0x7f0d540b2760 2024-01-24T13:06:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d58a00640 1 -- 172.21.15.29:0/1623423028 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0acb10 con 0x7f0d540b2760 2024-01-24T13:06:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 -- 172.21.15.29:0/1623423028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d540b2760 msgr2=0x7f0d540b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 --2- 172.21.15.29:0/1623423028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d540b2760 0x7f0d540b2c10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0097c0 tx=0x7f0d3c01c3c0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 -- 172.21.15.29:0/1623423028 shutdown_connections 2024-01-24T13:06:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 --2- 172.21.15.29:0/1623423028 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d5415cef0 0x7f0d5415d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 --2- 172.21.15.29:0/1623423028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d540b2760 0x7f0d540b2c10 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 -- 172.21.15.29:0/1623423028 >> 172.21.15.29:0/1623423028 conn(0x7f0d5406d700 msgr2=0x7f0d54069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 -- 172.21.15.29:0/1623423028 shutdown_connections 2024-01-24T13:06:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 -- 172.21.15.29:0/1623423028 wait complete. 2024-01-24T13:06:30.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 Processor -- start 2024-01-24T13:06:30.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 -- start start 2024-01-24T13:06:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d540b2760 0x7f0d5414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d54153a00 0x7f0d541473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d5415cef0 0x7f0d541583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540cea30 con 0x7f0d5415cef0 2024-01-24T13:06:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540cdeb0 con 0x7f0d540b2760 2024-01-24T13:06:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.206+0000 7f0d5c800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540ce190 con 0x7f0d54153a00 2024-01-24T13:06:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d5a800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d5415cef0 0x7f0d541583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d5a800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d5415cef0 0x7f0d541583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36284/0 (socket says 172.21.15.29:36284) 2024-01-24T13:06:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d5a800640 1 -- 172.21.15.29:0/1282358094 learned_addr learned my addr 172.21.15.29:0/1282358094 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d59e00640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d540b2760 0x7f0d5414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d59400640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d54153a00 0x7f0d541473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d5a800640 1 -- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d54153a00 msgr2=0x7f0d541473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d5a800640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d54153a00 0x7f0d541473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d5a800640 1 -- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d540b2760 msgr2=0x7f0d5414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d5a800640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d540b2760 0x7f0d5414cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d5a800640 1 -- 172.21.15.29:0/1282358094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c009420 con 0x7f0d5415cef0 2024-01-24T13:06:30.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d59e00640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d540b2760 0x7f0d5414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:30.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d59400640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d54153a00 0x7f0d541473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:30.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d5a800640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d5415cef0 0x7f0d541583d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c007ef0 tx=0x7f0d4c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:30.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d52000640 1 -- 172.21.15.29:0/1282358094 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c003ba0 con 0x7f0d5415cef0 2024-01-24T13:06:30.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d52000640 1 -- 172.21.15.29:0/1282358094 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c00f040 con 0x7f0d5415cef0 2024-01-24T13:06:30.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d52000640 1 -- 172.21.15.29:0/1282358094 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00de80 con 0x7f0d5415cef0 2024-01-24T13:06:30.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d5c800640 1 -- 172.21.15.29:0/1282358094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d540ce470 con 0x7f0d5415cef0 2024-01-24T13:06:30.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d5c800640 1 -- 172.21.15.29:0/1282358094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d541f5100 con 0x7f0d5415cef0 2024-01-24T13:06:30.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d5c800640 1 -- 172.21.15.29:0/1282358094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d54151070 con 0x7f0d5415cef0 2024-01-24T13:06:30.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d52000640 1 -- 172.21.15.29:0/1282358094 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0d4c004030 con 0x7f0d5415cef0 2024-01-24T13:06:30.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.210+0000 7f0d52000640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0d2c065a60 0x7f0d2c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.214+0000 7f0d52000640 1 -- 172.21.15.29:0/1282358094 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0d4c0832d0 con 0x7f0d5415cef0 2024-01-24T13:06:30.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.214+0000 7f0d59e00640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0d2c065a60 0x7f0d2c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.214+0000 7f0d59e00640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0d2c065a60 0x7f0d2c067f20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0d44000f70 tx=0x7f0d44009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.214+0000 7f0d52000640 1 -- 172.21.15.29:0/1282358094 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f0d54151070 con 0x7f0d5415cef0 2024-01-24T13:06:30.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.374+0000 7f0d5c800640 1 -- 172.21.15.29:0/1282358094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d54151070 con 0x7f0d5415cef0 2024-01-24T13:06:30.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.374+0000 7f0d52000640 1 -- 172.21.15.29:0/1282358094 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d4c01a020 con 0x7f0d5415cef0 2024-01-24T13:06:30.378 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:06:30.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.374+0000 7f0d5c800640 1 -- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0d2c065a60 msgr2=0x7f0d2c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.374+0000 7f0d5c800640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0d2c065a60 0x7f0d2c067f20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0d44000f70 tx=0x7f0d44009040 comp rx=0 tx=0).stop 2024-01-24T13:06:30.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.374+0000 7f0d5c800640 1 -- 172.21.15.29:0/1282358094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d5415cef0 msgr2=0x7f0d541583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.374+0000 7f0d5c800640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d5415cef0 0x7f0d541583d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c007ef0 tx=0x7f0d4c00d4a0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.378+0000 7f0d5c800640 1 -- 172.21.15.29:0/1282358094 shutdown_connections 2024-01-24T13:06:30.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.378+0000 7f0d5c800640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0d2c065a60 0x7f0d2c067f20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.378+0000 7f0d5c800640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d5415cef0 0x7f0d541583d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.378+0000 7f0d5c800640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d54153a00 0x7f0d541473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.378+0000 7f0d5c800640 1 --2- 172.21.15.29:0/1282358094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d540b2760 0x7f0d5414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.378+0000 7f0d5c800640 1 -- 172.21.15.29:0/1282358094 >> 172.21.15.29:0/1282358094 conn(0x7f0d5406d700 msgr2=0x7f0d5414f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:30.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.378+0000 7f0d5c800640 1 -- 172.21.15.29:0/1282358094 shutdown_connections 2024-01-24T13:06:30.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.378+0000 7f0d5c800640 1 -- 172.21.15.29:0/1282358094 wait complete. 2024-01-24T13:06:30.401 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-24T13:06:30.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f3da00640 1 Processor -- start 2024-01-24T13:06:30.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f3da00640 1 -- start start 2024-01-24T13:06:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f3da00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f38143910 0x7f4f38143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f3da00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4f38070ac0 0x7f4f3806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f3da00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f3806c150 0x7f4f3815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f3da00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3806c5e0 con 0x7f4f38143910 2024-01-24T13:06:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f3da00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3815aa30 con 0x7f4f38070ac0 2024-01-24T13:06:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f3da00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380712a0 con 0x7f4f3806c150 2024-01-24T13:06:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f36a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f38143910 0x7f4f38143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f36a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f38143910 0x7f4f38143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36296/0 (socket says 172.21.15.29:36296) 2024-01-24T13:06:30.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f36a00640 1 -- 172.21.15.29:0/1493468500 learned_addr learned my addr 172.21.15.29:0/1493468500 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:30.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f37400640 1 --2- 172.21.15.29:0/1493468500 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f3806c150 0x7f4f3815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f36000640 1 --2- 172.21.15.29:0/1493468500 >> v2:172.21.15.163:3300/0 conn(0x7f4f38070ac0 0x7f4f3806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f36a00640 1 -- 172.21.15.29:0/1493468500 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f3806c150 msgr2=0x7f4f3815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:30.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f36a00640 1 --2- 172.21.15.29:0/1493468500 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f3806c150 0x7f4f3815dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f36a00640 1 -- 172.21.15.29:0/1493468500 >> v2:172.21.15.163:3300/0 conn(0x7f4f38070ac0 msgr2=0x7f4f3806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:30.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f36a00640 1 --2- 172.21.15.29:0/1493468500 >> v2:172.21.15.163:3300/0 conn(0x7f4f38070ac0 0x7f4f3806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.538+0000 7f4f36a00640 1 -- 172.21.15.29:0/1493468500 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f38071580 con 0x7f4f38143910 2024-01-24T13:06:30.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.542+0000 7f4f36a00640 1 --2- 172.21.15.29:0/1493468500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f38143910 0x7f4f38143d30 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4f38144360 tx=0x7f4f2801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e21efd6f38bafe4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:30.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.542+0000 7f4f35600640 1 -- 172.21.15.29:0/1493468500 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280ab600 con 0x7f4f38143910 2024-01-24T13:06:30.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.542+0000 7f4f35600640 1 -- 172.21.15.29:0/1493468500 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f280a7050 con 0x7f4f38143910 2024-01-24T13:06:30.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.542+0000 7f4f35600640 1 -- 172.21.15.29:0/1493468500 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280ab980 con 0x7f4f38143910 2024-01-24T13:06:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.542+0000 7f4f3da00640 1 -- 172.21.15.29:0/1493468500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f38143910 msgr2=0x7f4f38143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.542+0000 7f4f3da00640 1 --2- 172.21.15.29:0/1493468500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f38143910 0x7f4f38143d30 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4f38144360 tx=0x7f4f2801c210 comp rx=0 tx=0).stop 2024-01-24T13:06:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.542+0000 7f4f3da00640 1 -- 172.21.15.29:0/1493468500 shutdown_connections 2024-01-24T13:06:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.542+0000 7f4f3da00640 1 --2- 172.21.15.29:0/1493468500 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f3806c150 0x7f4f3815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.542+0000 7f4f3da00640 1 --2- 172.21.15.29:0/1493468500 >> v2:172.21.15.163:3300/0 conn(0x7f4f38070ac0 0x7f4f3806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.542+0000 7f4f3da00640 1 --2- 172.21.15.29:0/1493468500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f38143910 0x7f4f38143d30 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.542+0000 7f4f3da00640 1 -- 172.21.15.29:0/1493468500 >> 172.21.15.29:0/1493468500 conn(0x7f4f380b3950 msgr2=0x7f4f38069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.542+0000 7f4f3da00640 1 -- 172.21.15.29:0/1493468500 shutdown_connections 2024-01-24T13:06:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.542+0000 7f4f3da00640 1 -- 172.21.15.29:0/1493468500 wait complete. 2024-01-24T13:06:30.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f3da00640 1 Processor -- start 2024-01-24T13:06:30.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f3da00640 1 -- start start 2024-01-24T13:06:30.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f3da00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f3806c150 0x7f4f38159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f3da00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f38070ac0 0x7f4f38153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f3da00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f38143910 0x7f4f38137960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f3da00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f381380c0 con 0x7f4f3806c150 2024-01-24T13:06:30.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f3da00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f381383a0 con 0x7f4f38143910 2024-01-24T13:06:30.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f3da00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f381537a0 con 0x7f4f38070ac0 2024-01-24T13:06:30.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f36a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f3806c150 0x7f4f38159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f36a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f3806c150 0x7f4f38159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36308/0 (socket says 172.21.15.29:36308) 2024-01-24T13:06:30.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f36a00640 1 -- 172.21.15.29:0/1282050003 learned_addr learned my addr 172.21.15.29:0/1282050003 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:30.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f36000640 1 --2- 172.21.15.29:0/1282050003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f38070ac0 0x7f4f38153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f37400640 1 --2- 172.21.15.29:0/1282050003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f38143910 0x7f4f38137960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f36a00640 1 -- 172.21.15.29:0/1282050003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f38070ac0 msgr2=0x7f4f38153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f36a00640 1 --2- 172.21.15.29:0/1282050003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f38070ac0 0x7f4f38153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f36a00640 1 -- 172.21.15.29:0/1282050003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f38143910 msgr2=0x7f4f38137960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f36a00640 1 --2- 172.21.15.29:0/1282050003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f38143910 0x7f4f38137960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f36a00640 1 -- 172.21.15.29:0/1282050003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280094d0 con 0x7f4f3806c150 2024-01-24T13:06:30.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f36a00640 1 --2- 172.21.15.29:0/1282050003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f3806c150 0x7f4f38159290 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4f280ae040 tx=0x7f4f28018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:30.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f2ea00640 1 -- 172.21.15.29:0/1282050003 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280b4420 con 0x7f4f3806c150 2024-01-24T13:06:30.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f2ea00640 1 -- 172.21.15.29:0/1282050003 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f280b45a0 con 0x7f4f3806c150 2024-01-24T13:06:30.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f2ea00640 1 -- 172.21.15.29:0/1282050003 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280b4950 con 0x7f4f3806c150 2024-01-24T13:06:30.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f3da00640 1 -- 172.21.15.29:0/1282050003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f38137ea0 con 0x7f4f3806c150 2024-01-24T13:06:30.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.546+0000 7f4f3da00640 1 -- 172.21.15.29:0/1282050003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f38159970 con 0x7f4f3806c150 2024-01-24T13:06:30.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.550+0000 7f4f3da00640 1 -- 172.21.15.29:0/1282050003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3804e850 con 0x7f4f3806c150 2024-01-24T13:06:30.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.550+0000 7f4f2ea00640 1 -- 172.21.15.29:0/1282050003 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4f280b2070 con 0x7f4f3806c150 2024-01-24T13:06:30.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.550+0000 7f4f2ea00640 1 --2- 172.21.15.29:0/1282050003 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4f10065a90 0x7f4f10067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.550+0000 7f4f2ea00640 1 -- 172.21.15.29:0/1282050003 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4f2811c1f0 con 0x7f4f3806c150 2024-01-24T13:06:30.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.550+0000 7f4f36000640 1 --2- 172.21.15.29:0/1282050003 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4f10065a90 0x7f4f10067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.554+0000 7f4f36000640 1 --2- 172.21.15.29:0/1282050003 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4f10065a90 0x7f4f10067f50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f380af5c0 tx=0x7f4f20009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.554+0000 7f4f2ea00640 1 -- 172.21.15.29:0/1282050003 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4f280e9ee0 con 0x7f4f3806c150 2024-01-24T13:06:30.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.714+0000 7f4f3da00640 1 -- 172.21.15.29:0/1282050003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4f3806a9a0 con 0x7f4f3806c150 2024-01-24T13:06:30.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.714+0000 7f4f2ea00640 1 -- 172.21.15.29:0/1282050003 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4f280ed500 con 0x7f4f3806c150 2024-01-24T13:06:30.717 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:30.717 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2024-01-24T13:06:30.717 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-24T13:06:30.717 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2024-01-24T13:06:30.717 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2024-01-24T13:06:30.717 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:30.717 INFO:teuthology.orchestra.run.smithi029.stdout:] 2024-01-24T13:06:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.714+0000 7f4f3da00640 1 -- 172.21.15.29:0/1282050003 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4f10065a90 msgr2=0x7f4f10067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.714+0000 7f4f3da00640 1 --2- 172.21.15.29:0/1282050003 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4f10065a90 0x7f4f10067f50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f380af5c0 tx=0x7f4f20009190 comp rx=0 tx=0).stop 2024-01-24T13:06:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.714+0000 7f4f3da00640 1 -- 172.21.15.29:0/1282050003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f3806c150 msgr2=0x7f4f38159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.714+0000 7f4f3da00640 1 --2- 172.21.15.29:0/1282050003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f3806c150 0x7f4f38159290 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4f280ae040 tx=0x7f4f28018fb0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.714+0000 7f4f3da00640 1 -- 172.21.15.29:0/1282050003 shutdown_connections 2024-01-24T13:06:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.714+0000 7f4f3da00640 1 --2- 172.21.15.29:0/1282050003 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4f10065a90 0x7f4f10067f50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.714+0000 7f4f3da00640 1 --2- 172.21.15.29:0/1282050003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f38143910 0x7f4f38137960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.714+0000 7f4f3da00640 1 --2- 172.21.15.29:0/1282050003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f38070ac0 0x7f4f38153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.714+0000 7f4f3da00640 1 --2- 172.21.15.29:0/1282050003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f3806c150 0x7f4f38159290 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.714+0000 7f4f3da00640 1 -- 172.21.15.29:0/1282050003 >> 172.21.15.29:0/1282050003 conn(0x7f4f380b3950 msgr2=0x7f4f380adc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:30.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.714+0000 7f4f3da00640 1 -- 172.21.15.29:0/1282050003 shutdown_connections 2024-01-24T13:06:30.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.714+0000 7f4f3da00640 1 -- 172.21.15.29:0/1282050003 wait complete. 2024-01-24T13:06:30.739 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-24T13:06:30.739 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-24T13:06:30.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.878+0000 7f7cd6c00640 1 Processor -- start 2024-01-24T13:06:30.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.878+0000 7f7cd6c00640 1 -- start start 2024-01-24T13:06:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.882+0000 7f7cd6c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7cd01532d0 0x7f7cd00c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.882+0000 7f7cd6c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7cd00c8d40 0x7f7cd015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.882+0000 7f7cd6c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd0070910 con 0x7f7cd015cd30 2024-01-24T13:06:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.882+0000 7f7cd6c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd01536b0 con 0x7f7cd01532d0 2024-01-24T13:06:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.882+0000 7f7cd6c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd015d2b0 con 0x7f7cd00c8d40 2024-01-24T13:06:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.882+0000 7f7ccfe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7cd01532d0 0x7f7cd00c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.882+0000 7f7ccfe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7cd01532d0 0x7f7cd00c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60938/0 (socket says 172.21.15.29:60938) 2024-01-24T13:06:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.882+0000 7f7ccfe00640 1 -- 172.21.15.29:0/1325126381 learned_addr learned my addr 172.21.15.29:0/1325126381 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.882+0000 7f7ccf400640 1 --2- 172.21.15.29:0/1325126381 >> v2:172.21.15.163:3300/0 conn(0x7f7cd00c8d40 0x7f7cd015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.882+0000 7f7ccfe00640 1 -- 172.21.15.29:0/1325126381 >> v2:172.21.15.163:3300/0 conn(0x7f7cd00c8d40 msgr2=0x7f7cd015c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.882+0000 7f7ccfe00640 1 --2- 172.21.15.29:0/1325126381 >> v2:172.21.15.163:3300/0 conn(0x7f7cd00c8d40 0x7f7cd015c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.882+0000 7f7ccfe00640 1 -- 172.21.15.29:0/1325126381 >> v1:172.21.15.163:6789/0 conn(0x7f7cd015cd30 legacy=0x7f7cd0070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.882+0000 7f7ccfe00640 1 -- 172.21.15.29:0/1325126381 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd015d590 con 0x7f7cd01532d0 2024-01-24T13:06:30.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.886+0000 7f7ccfe00640 1 --2- 172.21.15.29:0/1325126381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd01532d0 0x7f7cd00c8800 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00cee40 tx=0x7f7cc001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3d6bc837ecc7a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:30.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.886+0000 7f7ccea00640 1 -- 172.21.15.29:0/1325126381 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00ab600 con 0x7f7cd01532d0 2024-01-24T13:06:30.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.886+0000 7f7ccea00640 1 -- 172.21.15.29:0/1325126381 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc00a7050 con 0x7f7cd01532d0 2024-01-24T13:06:30.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.886+0000 7f7ccea00640 1 -- 172.21.15.29:0/1325126381 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00ab980 con 0x7f7cd01532d0 2024-01-24T13:06:30.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.886+0000 7f7cd6c00640 1 -- 172.21.15.29:0/1325126381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd01532d0 msgr2=0x7f7cd00c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.886+0000 7f7cd6c00640 1 --2- 172.21.15.29:0/1325126381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd01532d0 0x7f7cd00c8800 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00cee40 tx=0x7f7cc001c4d0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.886+0000 7f7cd6c00640 1 -- 172.21.15.29:0/1325126381 shutdown_connections 2024-01-24T13:06:30.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.886+0000 7f7cd6c00640 1 --2- 172.21.15.29:0/1325126381 >> v2:172.21.15.163:3300/0 conn(0x7f7cd00c8d40 0x7f7cd015c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.886+0000 7f7cd6c00640 1 --2- 172.21.15.29:0/1325126381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd01532d0 0x7f7cd00c8800 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.886+0000 7f7cd6c00640 1 -- 172.21.15.29:0/1325126381 >> 172.21.15.29:0/1325126381 conn(0x7f7cd006a0d0 msgr2=0x7f7cd006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:30.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.886+0000 7f7cd6c00640 1 -- 172.21.15.29:0/1325126381 shutdown_connections 2024-01-24T13:06:30.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.886+0000 7f7cd6c00640 1 -- 172.21.15.29:0/1325126381 wait complete. 2024-01-24T13:06:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.886+0000 7f7cd6c00640 1 Processor -- start 2024-01-24T13:06:30.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.886+0000 7f7cd6c00640 1 -- start start 2024-01-24T13:06:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd6c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7cd00c8d40 0x7f7cd00c13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd6c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7cd01532d0 0x7f7cd0157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd6c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd015cd30 0x7f7cd0158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd6c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd014c2a0 con 0x7f7cd015cd30 2024-01-24T13:06:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd6c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd014b690 con 0x7f7cd01532d0 2024-01-24T13:06:30.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd6c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd014b970 con 0x7f7cd00c8d40 2024-01-24T13:06:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd4c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd015cd30 0x7f7cd0158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd4c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd015cd30 0x7f7cd0158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60944/0 (socket says 172.21.15.29:60944) 2024-01-24T13:06:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd4c00640 1 -- 172.21.15.29:0/3287821998 learned_addr learned my addr 172.21.15.29:0/3287821998 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7ccfe00640 1 --2- 172.21.15.29:0/3287821998 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7cd00c8d40 0x7f7cd00c13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7ccf400640 1 --2- 172.21.15.29:0/3287821998 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7cd01532d0 0x7f7cd0157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd4c00640 1 -- 172.21.15.29:0/3287821998 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7cd00c8d40 msgr2=0x7f7cd00c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd4c00640 1 --2- 172.21.15.29:0/3287821998 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7cd00c8d40 0x7f7cd00c13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd4c00640 1 -- 172.21.15.29:0/3287821998 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7cd01532d0 msgr2=0x7f7cd0157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd4c00640 1 --2- 172.21.15.29:0/3287821998 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7cd01532d0 0x7f7cd0157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd4c00640 1 -- 172.21.15.29:0/3287821998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc00094d0 con 0x7f7cd015cd30 2024-01-24T13:06:30.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd4c00640 1 --2- 172.21.15.29:0/3287821998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd015cd30 0x7f7cd0158140 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800c730 tx=0x7f7cc800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cc7e00640 1 -- 172.21.15.29:0/3287821998 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8003b80 con 0x7f7cd015cd30 2024-01-24T13:06:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cc7e00640 1 -- 172.21.15.29:0/3287821998 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc8003ce0 con 0x7f7cd015cd30 2024-01-24T13:06:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd6c00640 1 -- 172.21.15.29:0/3287821998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd014bc50 con 0x7f7cd015cd30 2024-01-24T13:06:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cc7e00640 1 -- 172.21.15.29:0/3287821998 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800aa30 con 0x7f7cd015cd30 2024-01-24T13:06:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd6c00640 1 -- 172.21.15.29:0/3287821998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd00cd500 con 0x7f7cd015cd30 2024-01-24T13:06:30.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cd6c00640 1 -- 172.21.15.29:0/3287821998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd014c450 con 0x7f7cd015cd30 2024-01-24T13:06:30.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.890+0000 7f7cc7e00640 1 -- 172.21.15.29:0/3287821998 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7cc800ab90 con 0x7f7cd015cd30 2024-01-24T13:06:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.894+0000 7f7cc7e00640 1 --2- 172.21.15.29:0/3287821998 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ca8065a60 0x7f7ca8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.894+0000 7f7cc7e00640 1 -- 172.21.15.29:0/3287821998 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7cc8082d00 con 0x7f7cd015cd30 2024-01-24T13:06:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.894+0000 7f7ccfe00640 1 --2- 172.21.15.29:0/3287821998 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ca8065a60 0x7f7ca8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:30.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.894+0000 7f7ccfe00640 1 --2- 172.21.15.29:0/3287821998 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ca8065a60 0x7f7ca8067f20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00ad000 tx=0x7f7cc0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:30.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:30.898+0000 7f7cc7e00640 1 -- 172.21.15.29:0/3287821998 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7cd014c450 con 0x7f7cd015cd30 2024-01-24T13:06:31.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:31.054+0000 7f7cd6c00640 1 -- 172.21.15.29:0/3287821998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7cd004e000 con 0x7f7cd015cd30 2024-01-24T13:06:31.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:31.954+0000 7f7cc7e00640 1 -- 172.21.15.29:0/3287821998 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v56) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7cc8050860 con 0x7f7cd015cd30 2024-01-24T13:06:31.956 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2024-01-24T13:06:31.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:31.954+0000 7f7cd6c00640 1 -- 172.21.15.29:0/3287821998 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ca8065a60 msgr2=0x7f7ca8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:31.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:31.954+0000 7f7cd6c00640 1 --2- 172.21.15.29:0/3287821998 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ca8065a60 0x7f7ca8067f20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00ad000 tx=0x7f7cc0008040 comp rx=0 tx=0).stop 2024-01-24T13:06:31.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:31.954+0000 7f7cd6c00640 1 -- 172.21.15.29:0/3287821998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd015cd30 msgr2=0x7f7cd0158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:31.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:31.954+0000 7f7cd6c00640 1 --2- 172.21.15.29:0/3287821998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd015cd30 0x7f7cd0158140 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800c730 tx=0x7f7cc800cbf0 comp rx=0 tx=0).stop 2024-01-24T13:06:31.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:31.958+0000 7f7cd6c00640 1 -- 172.21.15.29:0/3287821998 shutdown_connections 2024-01-24T13:06:31.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:31.958+0000 7f7cd6c00640 1 --2- 172.21.15.29:0/3287821998 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7ca8065a60 0x7f7ca8067f20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:31.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:31.958+0000 7f7cd6c00640 1 --2- 172.21.15.29:0/3287821998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd015cd30 0x7f7cd0158140 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:31.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:31.958+0000 7f7cd6c00640 1 --2- 172.21.15.29:0/3287821998 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7cd01532d0 0x7f7cd0157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:31.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:31.958+0000 7f7cd6c00640 1 --2- 172.21.15.29:0/3287821998 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7cd00c8d40 0x7f7cd00c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:31.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:31.958+0000 7f7cd6c00640 1 -- 172.21.15.29:0/3287821998 >> 172.21.15.29:0/3287821998 conn(0x7f7cd006a0d0 msgr2=0x7f7cd00cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:31.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:31.958+0000 7f7cd6c00640 1 -- 172.21.15.29:0/3287821998 shutdown_connections 2024-01-24T13:06:31.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:31.958+0000 7f7cd6c00640 1 -- 172.21.15.29:0/3287821998 wait complete. 2024-01-24T13:06:31.988 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-24T13:06:32.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5cc000640 1 Processor -- start 2024-01-24T13:06:32.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5cc000640 1 -- start start 2024-01-24T13:06:32.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5cc000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c40c3fd0 0x7fe5c40caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:32.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5cc000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c40cd1e0 con 0x7fe5c40cb010 2024-01-24T13:06:32.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5cc000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c40cd4c0 con 0x7fe5c415a6f0 2024-01-24T13:06:32.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5cc000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40cb4a0 con 0x7fe5c40c3fd0 2024-01-24T13:06:32.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5ca000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe5c40cb010 0x7fe5c40d0520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55056/0 (socket says 172.21.15.29:55056) 2024-01-24T13:06:32.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5ca000640 1 -- 172.21.15.29:0/1182840474 learned_addr learned my addr 172.21.15.29:0/1182840474 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:32.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c8c00640 1 --2- 172.21.15.29:0/1182840474 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c40c3fd0 0x7fe5c40caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:32.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 -- 172.21.15.29:0/1182840474 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845772726 0 0) 0x7fe5c40cd1e0 con 0x7fe5c40cb010 2024-01-24T13:06:32.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 -- 172.21.15.29:0/1182840474 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a4003530 con 0x7fe5c40cb010 2024-01-24T13:06:32.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 -- 172.21.15.29:0/1182840474 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548995153 0 0) 0x7fe5a4003530 con 0x7fe5c40cb010 2024-01-24T13:06:32.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 -- 172.21.15.29:0/1182840474 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c40c3fd0 msgr2=0x7fe5c40caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:32.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 --2- 172.21.15.29:0/1182840474 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c40c3fd0 0x7fe5c40caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:32.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 -- 172.21.15.29:0/1182840474 >> v1:172.21.15.163:6789/0 conn(0x7fe5c415a6f0 legacy=0x7fe5c40ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:32.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 -- 172.21.15.29:0/1182840474 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c40cd7a0 con 0x7fe5c40cb010 2024-01-24T13:06:32.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 -- 172.21.15.29:0/1182840474 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7fe5bc001a00 con 0x7fe5c40cb010 2024-01-24T13:06:32.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c8c00640 1 --2- 172.21.15.29:0/1182840474 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c40c3fd0 0x7fe5c40caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 -- 172.21.15.29:0/1182840474 >> v1:172.21.15.29:6789/0 conn(0x7fe5c40cb010 legacy=0x7fe5c40d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 --2- 172.21.15.29:0/1182840474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a40039b0 0x7fe5a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 --2- 172.21.15.29:0/1182840474 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c40c3fd0 0x7fe5a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 --2- 172.21.15.29:0/1182840474 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5a4004d10 0x7fe5a4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 -- 172.21.15.29:0/1182840474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40cb4a0 con 0x7fe5a40039b0 2024-01-24T13:06:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 -- 172.21.15.29:0/1182840474 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a400b990 con 0x7fe5a4004d10 2024-01-24T13:06:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c3e00640 1 -- 172.21.15.29:0/1182840474 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a400bb00 con 0x7fe5c40c3fd0 2024-01-24T13:06:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c9600640 1 --2- 172.21.15.29:0/1182840474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a40039b0 0x7fe5a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5c8c00640 1 --2- 172.21.15.29:0/1182840474 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c40c3fd0 0x7fe5a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.134+0000 7fe5ca000640 1 --2- 172.21.15.29:0/1182840474 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5a4004d10 0x7fe5a4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.138+0000 7fe5c9600640 1 -- 172.21.15.29:0/1182840474 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c40c3fd0 msgr2=0x7fe5a40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.138+0000 7fe5c9600640 1 --2- 172.21.15.29:0/1182840474 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c40c3fd0 0x7fe5a40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:32.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.138+0000 7fe5c9600640 1 -- 172.21.15.29:0/1182840474 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5a4004d10 msgr2=0x7fe5a4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:32.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.138+0000 7fe5c9600640 1 --2- 172.21.15.29:0/1182840474 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5a4004d10 0x7fe5a4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:32.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.138+0000 7fe5c9600640 1 -- 172.21.15.29:0/1182840474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac009420 con 0x7fe5a40039b0 2024-01-24T13:06:32.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.138+0000 7fe5c8c00640 1 --2- 172.21.15.29:0/1182840474 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c40c3fd0 0x7fe5a40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:32.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.138+0000 7fe5c9600640 1 --2- 172.21.15.29:0/1182840474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a40039b0 0x7fe5a4003d90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4001860 tx=0x7fe5b401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e564522ea8af8d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:32.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.138+0000 7fe5c3e00640 1 -- 172.21.15.29:0/1182840474 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40ab600 con 0x7fe5a40039b0 2024-01-24T13:06:32.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.138+0000 7fe5c3e00640 1 -- 172.21.15.29:0/1182840474 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b40a7050 con 0x7fe5a40039b0 2024-01-24T13:06:32.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.138+0000 7fe5c3e00640 1 -- 172.21.15.29:0/1182840474 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40ab9a0 con 0x7fe5a40039b0 2024-01-24T13:06:32.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.138+0000 7fe5cc000640 1 -- 172.21.15.29:0/1182840474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a40039b0 msgr2=0x7fe5a4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:32.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.138+0000 7fe5cc000640 1 --2- 172.21.15.29:0/1182840474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a40039b0 0x7fe5a4003d90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4001860 tx=0x7fe5b401c500 comp rx=0 tx=0).stop 2024-01-24T13:06:32.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.138+0000 7fe5ca000640 1 -- 172.21.15.29:0/1182840474 reap_dead start 2024-01-24T13:06:32.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5cc000640 1 -- 172.21.15.29:0/1182840474 shutdown_connections 2024-01-24T13:06:32.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5cc000640 1 -- 172.21.15.29:0/1182840474 >> 172.21.15.29:0/1182840474 conn(0x7fe5c4069cd0 msgr2=0x7fe5c406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:32.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5cc000640 1 -- 172.21.15.29:0/1182840474 shutdown_connections 2024-01-24T13:06:32.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5cc000640 1 -- 172.21.15.29:0/1182840474 wait complete. 2024-01-24T13:06:32.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5cc000640 1 Processor -- start 2024-01-24T13:06:32.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5cc000640 1 -- start start 2024-01-24T13:06:32.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5cc000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a40039b0 0x7fe5c406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:32.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5cc000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c406c460 0x7fe5c40c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:32.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5cc000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5c415cf00 0x7fe5c40c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:32.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5cc000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c406b3c0 con 0x7fe5a40039b0 2024-01-24T13:06:32.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5cc000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c406b6a0 con 0x7fe5c415cf00 2024-01-24T13:06:32.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5cc000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c406b980 con 0x7fe5c406c460 2024-01-24T13:06:32.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5c9600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a40039b0 0x7fe5c406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:32.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5c9600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a40039b0 0x7fe5c406ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60950/0 (socket says 172.21.15.29:60950) 2024-01-24T13:06:32.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5c9600640 1 -- 172.21.15.29:0/1897562321 learned_addr learned my addr 172.21.15.29:0/1897562321 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:32.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5ca000640 1 --2- 172.21.15.29:0/1897562321 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5c415cf00 0x7fe5c40c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:32.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5c8c00640 1 --2- 172.21.15.29:0/1897562321 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c406c460 0x7fe5c40c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:32.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5c9600640 1 -- 172.21.15.29:0/1897562321 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c406c460 msgr2=0x7fe5c40c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:32.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5c9600640 1 --2- 172.21.15.29:0/1897562321 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c406c460 0x7fe5c40c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:32.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5c9600640 1 -- 172.21.15.29:0/1897562321 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5c415cf00 msgr2=0x7fe5c40c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:32.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5c9600640 1 --2- 172.21.15.29:0/1897562321 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5c415cf00 0x7fe5c40c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:32.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.142+0000 7fe5c9600640 1 -- 172.21.15.29:0/1897562321 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c406bc60 con 0x7fe5a40039b0 2024-01-24T13:06:32.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.146+0000 7fe5c9600640 1 --2- 172.21.15.29:0/1897562321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a40039b0 0x7fe5c406ade0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe5b401c330 tx=0x7fe5a4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:32.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.146+0000 7fe5c1600640 1 -- 172.21.15.29:0/1897562321 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40abc80 con 0x7fe5a40039b0 2024-01-24T13:06:32.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.146+0000 7fe5c1600640 1 -- 172.21.15.29:0/1897562321 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b40abde0 con 0x7fe5a40039b0 2024-01-24T13:06:32.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.146+0000 7fe5c1600640 1 -- 172.21.15.29:0/1897562321 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4005270 con 0x7fe5a40039b0 2024-01-24T13:06:32.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.146+0000 7fe5cc000640 1 -- 172.21.15.29:0/1897562321 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c406bf40 con 0x7fe5a40039b0 2024-01-24T13:06:32.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.146+0000 7fe5cc000640 1 -- 172.21.15.29:0/1897562321 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c415d3b0 con 0x7fe5a40039b0 2024-01-24T13:06:32.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.146+0000 7fe5cc000640 1 -- 172.21.15.29:0/1897562321 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c404e850 con 0x7fe5a40039b0 2024-01-24T13:06:32.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.146+0000 7fe5c1600640 1 -- 172.21.15.29:0/1897562321 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe5b40b2050 con 0x7fe5a40039b0 2024-01-24T13:06:32.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.146+0000 7fe5c1600640 1 --2- 172.21.15.29:0/1897562321 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe59c065a90 0x7fe59c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:32.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.146+0000 7fe5c1600640 1 -- 172.21.15.29:0/1897562321 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fe5b411ce30 con 0x7fe5a40039b0 2024-01-24T13:06:32.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.146+0000 7fe5c8c00640 1 --2- 172.21.15.29:0/1897562321 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe59c065a90 0x7fe59c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:32.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.150+0000 7fe5c8c00640 1 --2- 172.21.15.29:0/1897562321 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe59c065a90 0x7fe59c067f50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009850 tx=0x7fe5ac009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:32.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.150+0000 7fe5c1600640 1 -- 172.21.15.29:0/1897562321 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe5b40ea8a0 con 0x7fe5a40039b0 2024-01-24T13:06:32.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.306+0000 7fe5cc000640 1 -- 172.21.15.29:0/1897562321 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe5c40b6380 con 0x7fe5a40039b0 2024-01-24T13:06:32.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.962+0000 7fe5c1600640 1 -- 172.21.15.29:0/1897562321 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v57) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe5b40b00d0 con 0x7fe5a40039b0 2024-01-24T13:06:32.965 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2024-01-24T13:06:32.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.970+0000 7fe5cc000640 1 -- 172.21.15.29:0/1897562321 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe59c065a90 msgr2=0x7fe59c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:32.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.970+0000 7fe5cc000640 1 --2- 172.21.15.29:0/1897562321 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe59c065a90 0x7fe59c067f50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009850 tx=0x7fe5ac009190 comp rx=0 tx=0).stop 2024-01-24T13:06:32.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.970+0000 7fe5cc000640 1 -- 172.21.15.29:0/1897562321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a40039b0 msgr2=0x7fe5c406ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:32.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.970+0000 7fe5cc000640 1 --2- 172.21.15.29:0/1897562321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a40039b0 0x7fe5c406ade0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe5b401c330 tx=0x7fe5a4005800 comp rx=0 tx=0).stop 2024-01-24T13:06:32.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.970+0000 7fe5cc000640 1 -- 172.21.15.29:0/1897562321 shutdown_connections 2024-01-24T13:06:32.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.970+0000 7fe5cc000640 1 --2- 172.21.15.29:0/1897562321 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe59c065a90 0x7fe59c067f50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:32.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.970+0000 7fe5cc000640 1 --2- 172.21.15.29:0/1897562321 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5c415cf00 0x7fe5c40c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:32.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.970+0000 7fe5cc000640 1 --2- 172.21.15.29:0/1897562321 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5c406c460 0x7fe5c40c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:32.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.970+0000 7fe5cc000640 1 --2- 172.21.15.29:0/1897562321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a40039b0 0x7fe5c406ade0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:32.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.970+0000 7fe5cc000640 1 -- 172.21.15.29:0/1897562321 >> 172.21.15.29:0/1897562321 conn(0x7fe5c4069cd0 msgr2=0x7fe5c406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:32.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.974+0000 7fe5cc000640 1 -- 172.21.15.29:0/1897562321 shutdown_connections 2024-01-24T13:06:32.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:32.974+0000 7fe5cc000640 1 -- 172.21.15.29:0/1897562321 wait complete. 2024-01-24T13:06:33.009 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-24T13:06:33.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee29800640 1 Processor -- start 2024-01-24T13:06:33.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee29800640 1 -- start start 2024-01-24T13:06:33.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee29800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fee2406c200 0x7fee2413cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee29800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fee2413d2e0 0x7fee240cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee29800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2413d750 con 0x7fee2406be20 2024-01-24T13:06:33.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee29800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2415b4f0 con 0x7fee2413d2e0 2024-01-24T13:06:33.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee29800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2415b7d0 con 0x7fee2406c200 2024-01-24T13:06:33.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee23400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fee2413d2e0 0x7fee240cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee23400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fee2413d2e0 0x7fee240cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60966/0 (socket says 172.21.15.29:60966) 2024-01-24T13:06:33.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee23400640 1 -- 172.21.15.29:0/3820481988 learned_addr learned my addr 172.21.15.29:0/3820481988 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:33.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee22000640 1 --2- 172.21.15.29:0/3820481988 >> v2:172.21.15.163:3300/0 conn(0x7fee2406c200 0x7fee2413cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee23400640 1 -- 172.21.15.29:0/3820481988 >> v2:172.21.15.163:3300/0 conn(0x7fee2406c200 msgr2=0x7fee2413cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:33.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee23400640 1 --2- 172.21.15.29:0/3820481988 >> v2:172.21.15.163:3300/0 conn(0x7fee2406c200 0x7fee2413cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee23400640 1 -- 172.21.15.29:0/3820481988 >> v1:172.21.15.163:6789/0 conn(0x7fee2406be20 legacy=0x7fee2415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.150+0000 7fee23400640 1 -- 172.21.15.29:0/3820481988 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee240cd0c0 con 0x7fee2413d2e0 2024-01-24T13:06:33.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.154+0000 7fee23400640 1 --2- 172.21.15.29:0/3820481988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee2413d2e0 0x7fee240cd8c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fee240cf2b0 tx=0x7fee1c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cf53143b73f606 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:33.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.154+0000 7fee21600640 1 -- 172.21.15.29:0/3820481988 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0a5840 con 0x7fee2413d2e0 2024-01-24T13:06:33.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.154+0000 7fee21600640 1 -- 172.21.15.29:0/3820481988 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c0a59a0 con 0x7fee2413d2e0 2024-01-24T13:06:33.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.154+0000 7fee21600640 1 -- 172.21.15.29:0/3820481988 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0a5d30 con 0x7fee2413d2e0 2024-01-24T13:06:33.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.154+0000 7fee29800640 1 -- 172.21.15.29:0/3820481988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee2413d2e0 msgr2=0x7fee240cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.154+0000 7fee29800640 1 --2- 172.21.15.29:0/3820481988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee2413d2e0 0x7fee240cd8c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fee240cf2b0 tx=0x7fee1c01c9a0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.154+0000 7fee29800640 1 -- 172.21.15.29:0/3820481988 shutdown_connections 2024-01-24T13:06:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.154+0000 7fee29800640 1 --2- 172.21.15.29:0/3820481988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee2413d2e0 0x7fee240cd8c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.154+0000 7fee29800640 1 --2- 172.21.15.29:0/3820481988 >> v2:172.21.15.163:3300/0 conn(0x7fee2406c200 0x7fee2413cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.154+0000 7fee29800640 1 -- 172.21.15.29:0/3820481988 >> 172.21.15.29:0/3820481988 conn(0x7fee2406d700 msgr2=0x7fee24069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.154+0000 7fee29800640 1 -- 172.21.15.29:0/3820481988 shutdown_connections 2024-01-24T13:06:33.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.154+0000 7fee29800640 1 -- 172.21.15.29:0/3820481988 wait complete. 2024-01-24T13:06:33.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee29800640 1 Processor -- start 2024-01-24T13:06:33.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee29800640 1 -- start start 2024-01-24T13:06:33.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee29800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee2406be20 0x7fee24136ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee29800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee2406c200 0x7fee24147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee29800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee2413d2e0 0x7fee24149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee29800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2413b780 con 0x7fee2413d2e0 2024-01-24T13:06:33.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee29800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2414ee00 con 0x7fee2406c200 2024-01-24T13:06:33.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee29800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2414f0e0 con 0x7fee2406be20 2024-01-24T13:06:33.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee23400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee2413d2e0 0x7fee24149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee23400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee2413d2e0 0x7fee24149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60982/0 (socket says 172.21.15.29:60982) 2024-01-24T13:06:33.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee23400640 1 -- 172.21.15.29:0/3155238948 learned_addr learned my addr 172.21.15.29:0/3155238948 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:33.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee22000640 1 --2- 172.21.15.29:0/3155238948 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee2406c200 0x7fee24147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee22a00640 1 --2- 172.21.15.29:0/3155238948 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee2406be20 0x7fee24136ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee23400640 1 -- 172.21.15.29:0/3155238948 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee2406be20 msgr2=0x7fee24136ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee23400640 1 --2- 172.21.15.29:0/3155238948 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee2406be20 0x7fee24136ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee23400640 1 -- 172.21.15.29:0/3155238948 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee2406c200 msgr2=0x7fee24147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee23400640 1 --2- 172.21.15.29:0/3155238948 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee2406c200 0x7fee24147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee23400640 1 -- 172.21.15.29:0/3155238948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c009b30 con 0x7fee2413d2e0 2024-01-24T13:06:33.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee23400640 1 --2- 172.21.15.29:0/3155238948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee2413d2e0 0x7fee24149040 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0af040 tx=0x7fee1c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:33.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee1aa00640 1 -- 172.21.15.29:0/3155238948 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0b8670 con 0x7fee2413d2e0 2024-01-24T13:06:33.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee1aa00640 1 -- 172.21.15.29:0/3155238948 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c0b87f0 con 0x7fee2413d2e0 2024-01-24T13:06:33.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee1aa00640 1 -- 172.21.15.29:0/3155238948 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0b8ba0 con 0x7fee2413d2e0 2024-01-24T13:06:33.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.158+0000 7fee29800640 1 -- 172.21.15.29:0/3155238948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2414f3c0 con 0x7fee2413d2e0 2024-01-24T13:06:33.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.162+0000 7fee29800640 1 -- 172.21.15.29:0/3155238948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee241477d0 con 0x7fee2413d2e0 2024-01-24T13:06:33.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.162+0000 7fee29800640 1 -- 172.21.15.29:0/3155238948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2414f220 con 0x7fee2413d2e0 2024-01-24T13:06:33.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.162+0000 7fee1aa00640 1 -- 172.21.15.29:0/3155238948 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fee1c0b8d00 con 0x7fee2413d2e0 2024-01-24T13:06:33.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.162+0000 7fee1aa00640 1 --2- 172.21.15.29:0/3155238948 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fedfc065a60 0x7fedfc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.162+0000 7fee1aa00640 1 -- 172.21.15.29:0/3155238948 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fee1c11f190 con 0x7fee2413d2e0 2024-01-24T13:06:33.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.162+0000 7fee22a00640 1 --2- 172.21.15.29:0/3155238948 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fedfc065a60 0x7fedfc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.162+0000 7fee22a00640 1 --2- 172.21.15.29:0/3155238948 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fedfc065a60 0x7fedfc067f20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fee14007fd0 tx=0x7fee14009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:33.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.166+0000 7fee1aa00640 1 -- 172.21.15.29:0/3155238948 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fee1c0eca30 con 0x7fee2413d2e0 2024-01-24T13:06:33.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.354+0000 7fee29800640 1 -- 172.21.15.29:0/3155238948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fee2414f220 con 0x7fee2413d2e0 2024-01-24T13:06:33.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.366+0000 7fee1aa00640 1 -- 172.21.15.29:0/3155238948 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7fee2414f220 con 0x7fee2413d2e0 2024-01-24T13:06:33.369 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 8 and data pool 9 2024-01-24T13:06:33.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.374+0000 7fee29800640 1 -- 172.21.15.29:0/3155238948 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fedfc065a60 msgr2=0x7fedfc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.374+0000 7fee29800640 1 --2- 172.21.15.29:0/3155238948 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fedfc065a60 0x7fedfc067f20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fee14007fd0 tx=0x7fee14009040 comp rx=0 tx=0).stop 2024-01-24T13:06:33.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.374+0000 7fee29800640 1 -- 172.21.15.29:0/3155238948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee2413d2e0 msgr2=0x7fee24149040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.374+0000 7fee29800640 1 --2- 172.21.15.29:0/3155238948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee2413d2e0 0x7fee24149040 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0af040 tx=0x7fee1c019740 comp rx=0 tx=0).stop 2024-01-24T13:06:33.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.374+0000 7fee29800640 1 -- 172.21.15.29:0/3155238948 shutdown_connections 2024-01-24T13:06:33.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.374+0000 7fee29800640 1 --2- 172.21.15.29:0/3155238948 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fedfc065a60 0x7fedfc067f20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.374+0000 7fee29800640 1 --2- 172.21.15.29:0/3155238948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee2413d2e0 0x7fee24149040 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.374+0000 7fee29800640 1 --2- 172.21.15.29:0/3155238948 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee2406c200 0x7fee24147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.374+0000 7fee29800640 1 --2- 172.21.15.29:0/3155238948 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee2406be20 0x7fee24136ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.374+0000 7fee29800640 1 -- 172.21.15.29:0/3155238948 >> 172.21.15.29:0/3155238948 conn(0x7fee2406d700 msgr2=0x7fee240af690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:33.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.378+0000 7fee29800640 1 -- 172.21.15.29:0/3155238948 shutdown_connections 2024-01-24T13:06:33.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.378+0000 7fee29800640 1 -- 172.21.15.29:0/3155238948 wait complete. 2024-01-24T13:06:33.418 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:06:33.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.554+0000 7fa511c00640 1 Processor -- start 2024-01-24T13:06:33.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.554+0000 7fa511c00640 1 -- start start 2024-01-24T13:06:33.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.558+0000 7fa511c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa50c1588d0 0x7fa50c158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.558+0000 7fa511c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa50c070950 0x7fa50c0b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.558+0000 7fa511c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50c15c830 con 0x7fa50c1591f0 2024-01-24T13:06:33.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.558+0000 7fa511c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50c15cb10 con 0x7fa50c1588d0 2024-01-24T13:06:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.558+0000 7fa511c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c15cdf0 con 0x7fa50c070950 2024-01-24T13:06:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.558+0000 7fa50aa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa50c1588d0 0x7fa50c158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.558+0000 7fa50aa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa50c1588d0 0x7fa50c158cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60990/0 (socket says 172.21.15.29:60990) 2024-01-24T13:06:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.558+0000 7fa50aa00640 1 -- 172.21.15.29:0/540866352 learned_addr learned my addr 172.21.15.29:0/540866352 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.558+0000 7fa50aa00640 1 -- 172.21.15.29:0/540866352 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa50c070950 msgr2=0x7fa50c0b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.558+0000 7fa50aa00640 1 --2- 172.21.15.29:0/540866352 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa50c070950 0x7fa50c0b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.558+0000 7fa50aa00640 1 -- 172.21.15.29:0/540866352 >> v1:172.21.15.163:6789/0 conn(0x7fa50c1591f0 legacy=0x7fa50c070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.558+0000 7fa50aa00640 1 -- 172.21.15.29:0/540866352 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c15d0d0 con 0x7fa50c1588d0 2024-01-24T13:06:33.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.562+0000 7fa50aa00640 1 --2- 172.21.15.29:0/540866352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa50c1588d0 0x7fa50c158cb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009870 tx=0x7fa4fc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e470ce5bc24e433 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:33.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.562+0000 7fa509600640 1 -- 172.21.15.29:0/540866352 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0ab600 con 0x7fa50c1588d0 2024-01-24T13:06:33.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.562+0000 7fa509600640 1 -- 172.21.15.29:0/540866352 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc0a7050 con 0x7fa50c1588d0 2024-01-24T13:06:33.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.562+0000 7fa509600640 1 -- 172.21.15.29:0/540866352 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0ab980 con 0x7fa50c1588d0 2024-01-24T13:06:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.562+0000 7fa511c00640 1 -- 172.21.15.29:0/540866352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa50c1588d0 msgr2=0x7fa50c158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.562+0000 7fa511c00640 1 --2- 172.21.15.29:0/540866352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa50c1588d0 0x7fa50c158cb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009870 tx=0x7fa4fc01c440 comp rx=0 tx=0).stop 2024-01-24T13:06:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.562+0000 7fa511c00640 1 -- 172.21.15.29:0/540866352 shutdown_connections 2024-01-24T13:06:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.562+0000 7fa511c00640 1 --2- 172.21.15.29:0/540866352 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa50c070950 0x7fa50c0b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.562+0000 7fa511c00640 1 --2- 172.21.15.29:0/540866352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa50c1588d0 0x7fa50c158cb0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.562+0000 7fa511c00640 1 -- 172.21.15.29:0/540866352 >> 172.21.15.29:0/540866352 conn(0x7fa50c0b3950 msgr2=0x7fa50c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.562+0000 7fa511c00640 1 -- 172.21.15.29:0/540866352 shutdown_connections 2024-01-24T13:06:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.562+0000 7fa511c00640 1 -- 172.21.15.29:0/540866352 wait complete. 2024-01-24T13:06:33.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.562+0000 7fa511c00640 1 Processor -- start 2024-01-24T13:06:33.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.562+0000 7fa511c00640 1 -- start start 2024-01-24T13:06:33.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa511c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa50c070950 0x7fa50c0ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa511c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa50c1588d0 0x7fa50c143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa511c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa50c0af4c0 0x7fa50c0cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa511c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c0af0a0 con 0x7fa50c070950 2024-01-24T13:06:33.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa511c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c0ae420 con 0x7fa50c0af4c0 2024-01-24T13:06:33.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa511c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c0ae700 con 0x7fa50c1588d0 2024-01-24T13:06:33.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa50aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa50c070950 0x7fa50c0ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa50aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa50c070950 0x7fa50c0ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60992/0 (socket says 172.21.15.29:60992) 2024-01-24T13:06:33.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa50aa00640 1 -- 172.21.15.29:0/1409182236 learned_addr learned my addr 172.21.15.29:0/1409182236 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:33.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa50a000640 1 --2- 172.21.15.29:0/1409182236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa50c1588d0 0x7fa50c143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa50b400640 1 --2- 172.21.15.29:0/1409182236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa50c0af4c0 0x7fa50c0cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa50aa00640 1 -- 172.21.15.29:0/1409182236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa50c1588d0 msgr2=0x7fa50c143cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa50aa00640 1 --2- 172.21.15.29:0/1409182236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa50c1588d0 0x7fa50c143cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa50aa00640 1 -- 172.21.15.29:0/1409182236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa50c0af4c0 msgr2=0x7fa50c0cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa50aa00640 1 --2- 172.21.15.29:0/1409182236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa50c0af4c0 0x7fa50c0cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa50aa00640 1 -- 172.21.15.29:0/1409182236 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc0094d0 con 0x7fa50c070950 2024-01-24T13:06:33.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa50aa00640 1 --2- 172.21.15.29:0/1409182236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa50c070950 0x7fa50c0ade40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc01aaf0 tx=0x7fa4fc0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:33.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa502a00640 1 -- 172.21.15.29:0/1409182236 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0b5600 con 0x7fa50c070950 2024-01-24T13:06:33.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa502a00640 1 -- 172.21.15.29:0/1409182236 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc0b5760 con 0x7fa50c070950 2024-01-24T13:06:33.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa511c00640 1 -- 172.21.15.29:0/1409182236 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c15a3e0 con 0x7fa50c070950 2024-01-24T13:06:33.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa502a00640 1 -- 172.21.15.29:0/1409182236 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0b5ad0 con 0x7fa50c070950 2024-01-24T13:06:33.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa511c00640 1 -- 172.21.15.29:0/1409182236 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c0aecc0 con 0x7fa50c070950 2024-01-24T13:06:33.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.566+0000 7fa511c00640 1 -- 172.21.15.29:0/1409182236 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c04e850 con 0x7fa50c070950 2024-01-24T13:06:33.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.570+0000 7fa502a00640 1 -- 172.21.15.29:0/1409182236 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa4fc0b5c30 con 0x7fa50c070950 2024-01-24T13:06:33.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.570+0000 7fa502a00640 1 --2- 172.21.15.29:0/1409182236 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa4e4065a90 0x7fa4e4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.570+0000 7fa502a00640 1 -- 172.21.15.29:0/1409182236 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa4fc11da00 con 0x7fa50c070950 2024-01-24T13:06:33.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.570+0000 7fa50a000640 1 --2- 172.21.15.29:0/1409182236 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa4e4065a90 0x7fa4e4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.570+0000 7fa50a000640 1 --2- 172.21.15.29:0/1409182236 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa4e4065a90 0x7fa4e4067f50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0ace30 tx=0x7fa4f4009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:33.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.574+0000 7fa502a00640 1 -- 172.21.15.29:0/1409182236 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa4fc0eb290 con 0x7fa50c070950 2024-01-24T13:06:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.730+0000 7fa511c00640 1 -- 172.21.15.29:0/1409182236 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa50c0b1960 con 0x7fa50c070950 2024-01-24T13:06:33.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.734+0000 7fa502a00640 1 -- 172.21.15.29:0/1409182236 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16315 (secure 0 0 0) 0x7fa4fc0b0090 con 0x7fa50c070950 2024-01-24T13:06:33.737 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:33.737 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":58,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:06:33.362000+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:06:31.105908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-24T13:06:32.357292+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:06:33.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.734+0000 7fa511c00640 1 -- 172.21.15.29:0/1409182236 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa4e4065a90 msgr2=0x7fa4e4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.734+0000 7fa511c00640 1 --2- 172.21.15.29:0/1409182236 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa4e4065a90 0x7fa4e4067f50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0ace30 tx=0x7fa4f4009060 comp rx=0 tx=0).stop 2024-01-24T13:06:33.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.734+0000 7fa511c00640 1 -- 172.21.15.29:0/1409182236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa50c070950 msgr2=0x7fa50c0ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.734+0000 7fa511c00640 1 --2- 172.21.15.29:0/1409182236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa50c070950 0x7fa50c0ade40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc01aaf0 tx=0x7fa4fc0191e0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.734+0000 7fa511c00640 1 -- 172.21.15.29:0/1409182236 shutdown_connections 2024-01-24T13:06:33.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.734+0000 7fa511c00640 1 --2- 172.21.15.29:0/1409182236 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa4e4065a90 0x7fa4e4067f50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.734+0000 7fa511c00640 1 --2- 172.21.15.29:0/1409182236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa50c0af4c0 0x7fa50c0cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.734+0000 7fa511c00640 1 --2- 172.21.15.29:0/1409182236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa50c1588d0 0x7fa50c143cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.734+0000 7fa511c00640 1 --2- 172.21.15.29:0/1409182236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa50c070950 0x7fa50c0ade40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.734+0000 7fa511c00640 1 -- 172.21.15.29:0/1409182236 >> 172.21.15.29:0/1409182236 conn(0x7fa50c0b3950 msgr2=0x7fa50c14ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:33.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.734+0000 7fa511c00640 1 -- 172.21.15.29:0/1409182236 shutdown_connections 2024-01-24T13:06:33.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.734+0000 7fa511c00640 1 -- 172.21.15.29:0/1409182236 wait complete. 2024-01-24T13:06:33.759 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:06:33.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.894+0000 7fdb7f200640 1 Processor -- start 2024-01-24T13:06:33.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb7f200640 1 -- start start 2024-01-24T13:06:33.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb7f200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb781588d0 0x7fdb78158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb7f200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdb78070950 0x7fdb780b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb7f200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7815c830 con 0x7fdb781591f0 2024-01-24T13:06:33.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb7f200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7815cb10 con 0x7fdb78070950 2024-01-24T13:06:33.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb7f200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7815cdf0 con 0x7fdb781588d0 2024-01-24T13:06:33.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb77e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb781588d0 0x7fdb78158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb7d200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdb78070950 0x7fdb780b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb77400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fdb781591f0 0x7fdb78070240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:35988/0 (socket says 172.21.15.29:35988) 2024-01-24T13:06:33.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb77400640 1 -- 172.21.15.29:0/4246835716 learned_addr learned my addr 172.21.15.29:0/4246835716 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:33.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb76a00640 1 -- 172.21.15.29:0/4246835716 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427613326 0 0) 0x7fdb7815c830 con 0x7fdb781591f0 2024-01-24T13:06:33.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb77e00640 1 -- 172.21.15.29:0/4246835716 >> v2:172.21.15.163:3300/0 conn(0x7fdb78070950 msgr2=0x7fdb780b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:33.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb77e00640 1 --2- 172.21.15.29:0/4246835716 >> v2:172.21.15.163:3300/0 conn(0x7fdb78070950 0x7fdb780b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb77e00640 1 -- 172.21.15.29:0/4246835716 >> v1:172.21.15.163:6789/0 conn(0x7fdb781591f0 legacy=0x7fdb78070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.898+0000 7fdb77e00640 1 -- 172.21.15.29:0/4246835716 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7815d0d0 con 0x7fdb781588d0 2024-01-24T13:06:33.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.902+0000 7fdb77e00640 1 --2- 172.21.15.29:0/4246835716 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb781588d0 0x7fdb78158cb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800ba60 tx=0x7fdb6801ea90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f468309df702b482 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:33.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.902+0000 7fdb76a00640 1 -- 172.21.15.29:0/4246835716 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680a7a00 con 0x7fdb781588d0 2024-01-24T13:06:33.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.902+0000 7fdb76a00640 1 -- 172.21.15.29:0/4246835716 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb680a7b60 con 0x7fdb781588d0 2024-01-24T13:06:33.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.902+0000 7fdb76a00640 1 -- 172.21.15.29:0/4246835716 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680af440 con 0x7fdb781588d0 2024-01-24T13:06:33.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.902+0000 7fdb7f200640 1 -- 172.21.15.29:0/4246835716 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb781588d0 msgr2=0x7fdb78158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.902+0000 7fdb7f200640 1 --2- 172.21.15.29:0/4246835716 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb781588d0 0x7fdb78158cb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800ba60 tx=0x7fdb6801ea90 comp rx=0 tx=0).stop 2024-01-24T13:06:33.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.902+0000 7fdb7f200640 1 -- 172.21.15.29:0/4246835716 shutdown_connections 2024-01-24T13:06:33.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.902+0000 7fdb7f200640 1 --2- 172.21.15.29:0/4246835716 >> v2:172.21.15.163:3300/0 conn(0x7fdb78070950 0x7fdb780b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.902+0000 7fdb7f200640 1 --2- 172.21.15.29:0/4246835716 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb781588d0 0x7fdb78158cb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.902+0000 7fdb7f200640 1 -- 172.21.15.29:0/4246835716 >> 172.21.15.29:0/4246835716 conn(0x7fdb780b3950 msgr2=0x7fdb78069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:33.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.902+0000 7fdb7f200640 1 -- 172.21.15.29:0/4246835716 shutdown_connections 2024-01-24T13:06:33.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.902+0000 7fdb7f200640 1 -- 172.21.15.29:0/4246835716 wait complete. 2024-01-24T13:06:33.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb7f200640 1 Processor -- start 2024-01-24T13:06:33.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb7f200640 1 -- start start 2024-01-24T13:06:33.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb7f200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb78070950 0x7fdb78140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb7f200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb781588d0 0x7fdb7814eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb7f200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7814cb10 0x7fdb7814ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb7f200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb78141420 con 0x7fdb78070950 2024-01-24T13:06:33.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb7f200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7814f3d0 con 0x7fdb7814cb10 2024-01-24T13:06:33.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb7f200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7814f6b0 con 0x7fdb781588d0 2024-01-24T13:06:33.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb77e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb78070950 0x7fdb78140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb77e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb78070950 0x7fdb78140ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60994/0 (socket says 172.21.15.29:60994) 2024-01-24T13:06:33.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb77e00640 1 -- 172.21.15.29:0/3023376679 learned_addr learned my addr 172.21.15.29:0/3023376679 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:33.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb77400640 1 --2- 172.21.15.29:0/3023376679 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb781588d0 0x7fdb7814eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb7d200640 1 --2- 172.21.15.29:0/3023376679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7814cb10 0x7fdb7814ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb77e00640 1 -- 172.21.15.29:0/3023376679 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb781588d0 msgr2=0x7fdb7814eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb77e00640 1 --2- 172.21.15.29:0/3023376679 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb781588d0 0x7fdb7814eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb77e00640 1 -- 172.21.15.29:0/3023376679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7814cb10 msgr2=0x7fdb7814ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:33.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb77e00640 1 --2- 172.21.15.29:0/3023376679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7814cb10 0x7fdb7814ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:33.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb77e00640 1 -- 172.21.15.29:0/3023376679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6800b6c0 con 0x7fdb78070950 2024-01-24T13:06:33.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb77e00640 1 --2- 172.21.15.29:0/3023376679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb78070950 0x7fdb78140ee0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdb680b2040 tx=0x7fdb6801b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:33.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb6fe00640 1 -- 172.21.15.29:0/3023376679 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680afe10 con 0x7fdb78070950 2024-01-24T13:06:33.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb6fe00640 1 -- 172.21.15.29:0/3023376679 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb680b9410 con 0x7fdb78070950 2024-01-24T13:06:33.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb6fe00640 1 -- 172.21.15.29:0/3023376679 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680b97c0 con 0x7fdb78070950 2024-01-24T13:06:33.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb7f200640 1 -- 172.21.15.29:0/3023376679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7815a3e0 con 0x7fdb78070950 2024-01-24T13:06:33.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.906+0000 7fdb7f200640 1 -- 172.21.15.29:0/3023376679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7814fc70 con 0x7fdb78070950 2024-01-24T13:06:33.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.910+0000 7fdb7f200640 1 -- 172.21.15.29:0/3023376679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb781457d0 con 0x7fdb78070950 2024-01-24T13:06:33.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.910+0000 7fdb6fe00640 1 -- 172.21.15.29:0/3023376679 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdb680b6050 con 0x7fdb78070950 2024-01-24T13:06:33.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.910+0000 7fdb6fe00640 1 --2- 172.21.15.29:0/3023376679 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb50065a60 0x7fdb50067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:33.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.910+0000 7fdb6fe00640 1 -- 172.21.15.29:0/3023376679 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdb68120520 con 0x7fdb78070950 2024-01-24T13:06:33.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.910+0000 7fdb77400640 1 --2- 172.21.15.29:0/3023376679 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb50065a60 0x7fdb50067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:33.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.910+0000 7fdb77400640 1 --2- 172.21.15.29:0/3023376679 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb50065a60 0x7fdb50067f20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb7814e5e0 tx=0x7fdb60007df0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:33.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:33.914+0000 7fdb6fe00640 1 -- 172.21.15.29:0/3023376679 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fdb680edf70 con 0x7fdb78070950 2024-01-24T13:06:34.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.074+0000 7fdb7f200640 1 -- 172.21.15.29:0/3023376679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb7804e850 con 0x7fdb78070950 2024-01-24T13:06:34.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.074+0000 7fdb6fe00640 1 -- 172.21.15.29:0/3023376679 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16315 (secure 0 0 0) 0x7fdb680b4090 con 0x7fdb78070950 2024-01-24T13:06:34.079 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:34.079 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":58,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:06:33.362000+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:06:31.105908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-24T13:06:32.357292+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:06:34.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.078+0000 7fdb7f200640 1 -- 172.21.15.29:0/3023376679 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb50065a60 msgr2=0x7fdb50067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:34.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.078+0000 7fdb7f200640 1 --2- 172.21.15.29:0/3023376679 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb50065a60 0x7fdb50067f20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb7814e5e0 tx=0x7fdb60007df0 comp rx=0 tx=0).stop 2024-01-24T13:06:34.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.078+0000 7fdb7f200640 1 -- 172.21.15.29:0/3023376679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb78070950 msgr2=0x7fdb78140ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:34.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.078+0000 7fdb7f200640 1 --2- 172.21.15.29:0/3023376679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb78070950 0x7fdb78140ee0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdb680b2040 tx=0x7fdb6801b830 comp rx=0 tx=0).stop 2024-01-24T13:06:34.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.078+0000 7fdb7f200640 1 -- 172.21.15.29:0/3023376679 shutdown_connections 2024-01-24T13:06:34.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.078+0000 7fdb7f200640 1 --2- 172.21.15.29:0/3023376679 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb50065a60 0x7fdb50067f20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:34.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.078+0000 7fdb7f200640 1 --2- 172.21.15.29:0/3023376679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7814cb10 0x7fdb7814ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:34.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.078+0000 7fdb7f200640 1 --2- 172.21.15.29:0/3023376679 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb781588d0 0x7fdb7814eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:34.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.078+0000 7fdb7f200640 1 --2- 172.21.15.29:0/3023376679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb78070950 0x7fdb78140ee0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:34.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.078+0000 7fdb7f200640 1 -- 172.21.15.29:0/3023376679 >> 172.21.15.29:0/3023376679 conn(0x7fdb780b3950 msgr2=0x7fdb7815a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:34.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.078+0000 7fdb7f200640 1 -- 172.21.15.29:0/3023376679 shutdown_connections 2024-01-24T13:06:34.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.078+0000 7fdb7f200640 1 -- 172.21.15.29:0/3023376679 wait complete. 2024-01-24T13:06:34.102 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-24T13:06:34.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdb1800640 1 Processor -- start 2024-01-24T13:06:34.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdb1800640 1 -- start start 2024-01-24T13:06:34.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdb1800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdac06be20 0x7fcdac15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:34.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdb1800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcdac06c200 0x7fcdac15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:34.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdb1800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcdac13cda0 0x7fcdac13d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:34.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdb1800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac13d720 con 0x7fcdac13cda0 2024-01-24T13:06:34.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdb1800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac15b4f0 con 0x7fcdac06c200 2024-01-24T13:06:34.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdb1800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac15b7d0 con 0x7fcdac06be20 2024-01-24T13:06:34.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdab400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcdac13cda0 0x7fcdac13d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:34.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdab400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcdac13cda0 0x7fcdac13d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:32776/0 (socket says 172.21.15.29:32776) 2024-01-24T13:06:34.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdab400640 1 -- 172.21.15.29:0/3077128659 learned_addr learned my addr 172.21.15.29:0/3077128659 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:34.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdaa000640 1 --2- 172.21.15.29:0/3077128659 >> v2:172.21.15.163:3300/0 conn(0x7fcdac06c200 0x7fcdac15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:34.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdab400640 1 -- 172.21.15.29:0/3077128659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdac06be20 msgr2=0x7fcdac15a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:34.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdaaa00640 1 --2- 172.21.15.29:0/3077128659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdac06be20 0x7fcdac15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:34.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdab400640 1 --2- 172.21.15.29:0/3077128659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdac06be20 0x7fcdac15a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:34.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdab400640 1 -- 172.21.15.29:0/3077128659 >> v2:172.21.15.163:3300/0 conn(0x7fcdac06c200 msgr2=0x7fcdac15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:34.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdab400640 1 --2- 172.21.15.29:0/3077128659 >> v2:172.21.15.163:3300/0 conn(0x7fcdac06c200 0x7fcdac15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:34.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdab400640 1 -- 172.21.15.29:0/3077128659 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac0cd0c0 con 0x7fcdac13cda0 2024-01-24T13:06:34.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdaa000640 1 --2- 172.21.15.29:0/3077128659 >> v2:172.21.15.163:3300/0 conn(0x7fcdac06c200 0x7fcdac15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:34.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.242+0000 7fcdaaa00640 1 --2- 172.21.15.29:0/3077128659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdac06be20 0x7fcdac15a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:34.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.246+0000 7fcdab400640 1 --2- 172.21.15.29:0/3077128659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdac13cda0 0x7fcdac13d1e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0720d0 tx=0x7fcda401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59672e1f246ed5e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:34.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.246+0000 7fcda9600640 1 -- 172.21.15.29:0/3077128659 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda40a5800 con 0x7fcdac13cda0 2024-01-24T13:06:34.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.246+0000 7fcda9600640 1 -- 172.21.15.29:0/3077128659 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda40a5960 con 0x7fcdac13cda0 2024-01-24T13:06:34.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.246+0000 7fcda9600640 1 -- 172.21.15.29:0/3077128659 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda40a5cf0 con 0x7fcdac13cda0 2024-01-24T13:06:34.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.246+0000 7fcdb1800640 1 -- 172.21.15.29:0/3077128659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdac13cda0 msgr2=0x7fcdac13d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:34.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.246+0000 7fcdb1800640 1 --2- 172.21.15.29:0/3077128659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdac13cda0 0x7fcdac13d1e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0720d0 tx=0x7fcda401c9a0 comp rx=0 tx=0).stop 2024-01-24T13:06:34.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.246+0000 7fcdb1800640 1 -- 172.21.15.29:0/3077128659 shutdown_connections 2024-01-24T13:06:34.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.246+0000 7fcdb1800640 1 --2- 172.21.15.29:0/3077128659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdac13cda0 0x7fcdac13d1e0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:34.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.246+0000 7fcdb1800640 1 --2- 172.21.15.29:0/3077128659 >> v2:172.21.15.163:3300/0 conn(0x7fcdac06c200 0x7fcdac15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:34.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.246+0000 7fcdb1800640 1 --2- 172.21.15.29:0/3077128659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdac06be20 0x7fcdac15a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:34.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.246+0000 7fcdb1800640 1 -- 172.21.15.29:0/3077128659 >> 172.21.15.29:0/3077128659 conn(0x7fcdac06d700 msgr2=0x7fcdac069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:34.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.246+0000 7fcdb1800640 1 -- 172.21.15.29:0/3077128659 shutdown_connections 2024-01-24T13:06:34.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.246+0000 7fcdb1800640 1 -- 172.21.15.29:0/3077128659 wait complete. 2024-01-24T13:06:34.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdb1800640 1 Processor -- start 2024-01-24T13:06:34.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdb1800640 1 -- start start 2024-01-24T13:06:34.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdb1800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdac06be20 0x7fcdac1481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:34.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdb1800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdac06c200 0x7fcdac1387e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:34.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdb1800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdac13cda0 0x7fcdac14eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:34.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdb1800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac1486e0 con 0x7fcdac13cda0 2024-01-24T13:06:34.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdb1800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac071000 con 0x7fcdac06be20 2024-01-24T13:06:34.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdb1800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0712e0 con 0x7fcdac06c200 2024-01-24T13:06:34.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdab400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdac13cda0 0x7fcdac14eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:34.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdab400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdac13cda0 0x7fcdac14eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:32784/0 (socket says 172.21.15.29:32784) 2024-01-24T13:06:34.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdab400640 1 -- 172.21.15.29:0/1138227065 learned_addr learned my addr 172.21.15.29:0/1138227065 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:34.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdaaa00640 1 --2- 172.21.15.29:0/1138227065 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdac06be20 0x7fcdac1481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:34.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdaa000640 1 --2- 172.21.15.29:0/1138227065 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdac06c200 0x7fcdac1387e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:34.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdab400640 1 -- 172.21.15.29:0/1138227065 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdac06c200 msgr2=0x7fcdac1387e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:34.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdab400640 1 --2- 172.21.15.29:0/1138227065 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdac06c200 0x7fcdac1387e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:34.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdab400640 1 -- 172.21.15.29:0/1138227065 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdac06be20 msgr2=0x7fcdac1481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:34.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdab400640 1 --2- 172.21.15.29:0/1138227065 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdac06be20 0x7fcdac1481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:34.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdab400640 1 -- 172.21.15.29:0/1138227065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda4009b30 con 0x7fcdac13cda0 2024-01-24T13:06:34.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdab400640 1 --2- 172.21.15.29:0/1138227065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdac13cda0 0x7fcdac14eca0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fcda40af040 tx=0x7fcda4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:34.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcda2a00640 1 -- 172.21.15.29:0/1138227065 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda40b8640 con 0x7fcdac13cda0 2024-01-24T13:06:34.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcda2a00640 1 -- 172.21.15.29:0/1138227065 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda40b87a0 con 0x7fcdac13cda0 2024-01-24T13:06:34.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdb1800640 1 -- 172.21.15.29:0/1138227065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac0715c0 con 0x7fcdac13cda0 2024-01-24T13:06:34.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcda2a00640 1 -- 172.21.15.29:0/1138227065 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda40b8b10 con 0x7fcdac13cda0 2024-01-24T13:06:34.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.250+0000 7fcdb1800640 1 -- 172.21.15.29:0/1138227065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac138d20 con 0x7fcdac13cda0 2024-01-24T13:06:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.254+0000 7fcdb1800640 1 -- 172.21.15.29:0/1138227065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac04e850 con 0x7fcdac13cda0 2024-01-24T13:06:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.254+0000 7fcda2a00640 1 -- 172.21.15.29:0/1138227065 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcda40b8c70 con 0x7fcdac13cda0 2024-01-24T13:06:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.254+0000 7fcda2a00640 1 --2- 172.21.15.29:0/1138227065 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcd84065a60 0x7fcd84067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.254+0000 7fcda2a00640 1 -- 172.21.15.29:0/1138227065 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcda411e730 con 0x7fcdac13cda0 2024-01-24T13:06:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.254+0000 7fcdaaa00640 1 --2- 172.21.15.29:0/1138227065 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcd84065a60 0x7fcd84067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.254+0000 7fcdaaa00640 1 --2- 172.21.15.29:0/1138227065 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcd84065a60 0x7fcd84067f20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00ab60 tx=0x7fcd9c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:34.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.258+0000 7fcda2a00640 1 -- 172.21.15.29:0/1138227065 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fcda40ec050 con 0x7fcdac13cda0 2024-01-24T13:06:34.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:34.450+0000 7fcdb1800640 1 -- 172.21.15.29:0/1138227065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcdac06fc20 con 0x7fcdac13cda0 2024-01-24T13:06:35.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.370+0000 7fcda2a00640 1 -- 172.21.15.29:0/1138227065 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcda40ef670 con 0x7fcdac13cda0 2024-01-24T13:06:35.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.374+0000 7fcdb1800640 1 -- 172.21.15.29:0/1138227065 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcd84065a60 msgr2=0x7fcd84067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:35.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.374+0000 7fcdb1800640 1 --2- 172.21.15.29:0/1138227065 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcd84065a60 0x7fcd84067f20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00ab60 tx=0x7fcd9c008040 comp rx=0 tx=0).stop 2024-01-24T13:06:35.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.374+0000 7fcdb1800640 1 -- 172.21.15.29:0/1138227065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdac13cda0 msgr2=0x7fcdac14eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:35.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.374+0000 7fcdb1800640 1 --2- 172.21.15.29:0/1138227065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdac13cda0 0x7fcdac14eca0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fcda40af040 tx=0x7fcda4019740 comp rx=0 tx=0).stop 2024-01-24T13:06:35.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.374+0000 7fcdb1800640 1 -- 172.21.15.29:0/1138227065 shutdown_connections 2024-01-24T13:06:35.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.374+0000 7fcdb1800640 1 --2- 172.21.15.29:0/1138227065 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fcd84065a60 0x7fcd84067f20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:35.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.374+0000 7fcdb1800640 1 --2- 172.21.15.29:0/1138227065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdac13cda0 0x7fcdac14eca0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:35.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.374+0000 7fcdb1800640 1 --2- 172.21.15.29:0/1138227065 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdac06c200 0x7fcdac1387e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:35.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.374+0000 7fcdb1800640 1 --2- 172.21.15.29:0/1138227065 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdac06be20 0x7fcdac1481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:35.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.374+0000 7fcdb1800640 1 -- 172.21.15.29:0/1138227065 >> 172.21.15.29:0/1138227065 conn(0x7fcdac06d700 msgr2=0x7fcdac0ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:35.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.374+0000 7fcdb1800640 1 -- 172.21.15.29:0/1138227065 shutdown_connections 2024-01-24T13:06:35.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.374+0000 7fcdb1800640 1 -- 172.21.15.29:0/1138227065 wait complete. 2024-01-24T13:06:35.400 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-24T13:06:35.400 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-24T13:06:35.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.546+0000 7f2794200640 1 Processor -- start 2024-01-24T13:06:35.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.546+0000 7f2794200640 1 -- start start 2024-01-24T13:06:35.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.546+0000 7f2794200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f278c13d4b0 0x7f278c165130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:35.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.546+0000 7f2794200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c15b4f0 con 0x7f278c06be20 2024-01-24T13:06:35.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.546+0000 7f2794200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c15b7d0 con 0x7f278c06c200 2024-01-24T13:06:35.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.546+0000 7f2794200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278c0cd0c0 con 0x7f278c13d4b0 2024-01-24T13:06:35.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.546+0000 7f2792200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f278c13d4b0 0x7f278c165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:35.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.546+0000 7f2791800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f278c06be20 0x7f278c15a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55070/0 (socket says 172.21.15.29:55070) 2024-01-24T13:06:35.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.546+0000 7f2791800640 1 -- 172.21.15.29:0/2543065339 learned_addr learned my addr 172.21.15.29:0/2543065339 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:35.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.550+0000 7f2792200640 1 -- 172.21.15.29:0/2543065339 >> v1:172.21.15.163:6789/0 conn(0x7f278c06c200 legacy=0x7f278c13cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:35.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.550+0000 7f2792200640 1 -- 172.21.15.29:0/2543065339 >> v1:172.21.15.29:6789/0 conn(0x7f278c06be20 legacy=0x7f278c15a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:35.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.550+0000 7f2792200640 1 -- 172.21.15.29:0/2543065339 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c0cd3a0 con 0x7f278c13d4b0 2024-01-24T13:06:35.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.550+0000 7f2792200640 1 --2- 172.21.15.29:0/2543065339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f278c13d4b0 0x7f278c165130 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f2784009d90 tx=0x7f278401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256f016d1fd1da34 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:35.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.550+0000 7f278be00640 1 -- 172.21.15.29:0/2543065339 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27840a5a30 con 0x7f278c13d4b0 2024-01-24T13:06:35.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.550+0000 7f278be00640 1 -- 172.21.15.29:0/2543065339 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27840a5b90 con 0x7f278c13d4b0 2024-01-24T13:06:35.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.550+0000 7f278be00640 1 -- 172.21.15.29:0/2543065339 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27840ad440 con 0x7f278c13d4b0 2024-01-24T13:06:35.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 -- 172.21.15.29:0/2543065339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f278c13d4b0 msgr2=0x7f278c165130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:35.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 --2- 172.21.15.29:0/2543065339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f278c13d4b0 0x7f278c165130 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f2784009d90 tx=0x7f278401c910 comp rx=0 tx=0).stop 2024-01-24T13:06:35.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 -- 172.21.15.29:0/2543065339 shutdown_connections 2024-01-24T13:06:35.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 --2- 172.21.15.29:0/2543065339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f278c13d4b0 0x7f278c165130 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:35.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 -- 172.21.15.29:0/2543065339 >> 172.21.15.29:0/2543065339 conn(0x7f278c06d700 msgr2=0x7f278c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:35.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 -- 172.21.15.29:0/2543065339 shutdown_connections 2024-01-24T13:06:35.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 -- 172.21.15.29:0/2543065339 wait complete. 2024-01-24T13:06:35.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 Processor -- start 2024-01-24T13:06:35.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 -- start start 2024-01-24T13:06:35.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f278c06be20 0x7f278c149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:35.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f278c06c200 0x7f278c06fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:35.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f278c13d4b0 0x7f278c070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:35.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0b2fc0 con 0x7f278c06be20 2024-01-24T13:06:35.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0b2440 con 0x7f278c06c200 2024-01-24T13:06:35.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2794200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0b2720 con 0x7f278c13d4b0 2024-01-24T13:06:35.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2791800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f278c06be20 0x7f278c149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:35.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2791800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f278c06be20 0x7f278c149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:32794/0 (socket says 172.21.15.29:32794) 2024-01-24T13:06:35.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.554+0000 7f2791800640 1 -- 172.21.15.29:0/2753209708 learned_addr learned my addr 172.21.15.29:0/2753209708 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:35.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2790e00640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f278c06c200 0x7f278c06fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:35.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2792200640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f278c13d4b0 0x7f278c070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:35.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2791800640 1 -- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f278c13d4b0 msgr2=0x7f278c070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:35.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2791800640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f278c13d4b0 0x7f278c070160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:35.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2791800640 1 -- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f278c06c200 msgr2=0x7f278c06fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2791800640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f278c06c200 0x7f278c06fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2791800640 1 -- 172.21.15.29:0/2753209708 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2784009a70 con 0x7f278c06be20 2024-01-24T13:06:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2790e00640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f278c06c200 0x7f278c06fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2792200640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f278c13d4b0 0x7f278c070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2791800640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f278c06be20 0x7f278c149470 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f277c00c500 tx=0x7f277c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2789600640 1 -- 172.21.15.29:0/2753209708 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c005cf0 con 0x7f278c06be20 2024-01-24T13:06:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2789600640 1 -- 172.21.15.29:0/2753209708 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c005e50 con 0x7f278c06be20 2024-01-24T13:06:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2789600640 1 -- 172.21.15.29:0/2753209708 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c0072f0 con 0x7f278c06be20 2024-01-24T13:06:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2794200640 1 -- 172.21.15.29:0/2753209708 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278c0b2a00 con 0x7f278c06be20 2024-01-24T13:06:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2794200640 1 -- 172.21.15.29:0/2753209708 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278c0b16c0 con 0x7f278c06be20 2024-01-24T13:06:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2794200640 1 -- 172.21.15.29:0/2753209708 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278c14abb0 con 0x7f278c06be20 2024-01-24T13:06:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2789600640 1 -- 172.21.15.29:0/2753209708 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f277c007450 con 0x7f278c06be20 2024-01-24T13:06:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2789600640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2764065a90 0x7f2764067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.558+0000 7f2789600640 1 -- 172.21.15.29:0/2753209708 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f277c0826e0 con 0x7f278c06be20 2024-01-24T13:06:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.562+0000 7f2790e00640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2764065a90 0x7f2764067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.562+0000 7f2790e00640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2764065a90 0x7f2764067f50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f278c071e00 tx=0x7f2774009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:35.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.566+0000 7f2789600640 1 -- 172.21.15.29:0/2753209708 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f278c14abb0 con 0x7f278c06be20 2024-01-24T13:06:35.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:35.754+0000 7f2794200640 1 -- 172.21.15.29:0/2753209708 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f278c14abb0 con 0x7f278c06be20 2024-01-24T13:06:36.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.378+0000 7f2789600640 1 -- 172.21.15.29:0/2753209708 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f278c14abb0 con 0x7f278c06be20 2024-01-24T13:06:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.378+0000 7f2794200640 1 -- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2764065a90 msgr2=0x7f2764067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.378+0000 7f2794200640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2764065a90 0x7f2764067f50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f278c071e00 tx=0x7f2774009040 comp rx=0 tx=0).stop 2024-01-24T13:06:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.378+0000 7f2794200640 1 -- 172.21.15.29:0/2753209708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f278c06be20 msgr2=0x7f278c149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.378+0000 7f2794200640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f278c06be20 0x7f278c149470 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f277c00c500 tx=0x7f277c00c9c0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.378+0000 7f2794200640 1 -- 172.21.15.29:0/2753209708 shutdown_connections 2024-01-24T13:06:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.378+0000 7f2794200640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2764065a90 0x7f2764067f50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.378+0000 7f2794200640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f278c13d4b0 0x7f278c070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.378+0000 7f2794200640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f278c06c200 0x7f278c06fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.378+0000 7f2794200640 1 --2- 172.21.15.29:0/2753209708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f278c06be20 0x7f278c149470 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.378+0000 7f2794200640 1 -- 172.21.15.29:0/2753209708 >> 172.21.15.29:0/2753209708 conn(0x7f278c06d700 msgr2=0x7f278c15e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.382+0000 7f2794200640 1 -- 172.21.15.29:0/2753209708 shutdown_connections 2024-01-24T13:06:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.382+0000 7f2794200640 1 -- 172.21.15.29:0/2753209708 wait complete. 2024-01-24T13:06:36.405 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-24T13:06:36.405 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:06:36.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.542+0000 7fa815800640 1 Processor -- start 2024-01-24T13:06:36.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.542+0000 7fa815800640 1 -- start start 2024-01-24T13:06:36.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.546+0000 7fa815800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa81015c730 0x7fa81006b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:36.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.546+0000 7fa815800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa8100b2700 0x7fa8100ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:36.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.546+0000 7fa815800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81006cc10 con 0x7fa8100ccdb0 2024-01-24T13:06:36.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.546+0000 7fa815800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81006b7a0 con 0x7fa8100b2700 2024-01-24T13:06:36.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.546+0000 7fa815800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81006ba80 con 0x7fa81015c730 2024-01-24T13:06:36.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.546+0000 7fa80e000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa8100b2700 0x7fa8100ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:36.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.546+0000 7fa80e000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa8100b2700 0x7fa8100ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:32810/0 (socket says 172.21.15.29:32810) 2024-01-24T13:06:36.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.546+0000 7fa80e000640 1 -- 172.21.15.29:0/2171688832 learned_addr learned my addr 172.21.15.29:0/2171688832 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:36.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.546+0000 7fa80ea00640 1 --2- 172.21.15.29:0/2171688832 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa81015c730 0x7fa81006b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:36.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.546+0000 7fa80e000640 1 -- 172.21.15.29:0/2171688832 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa81015c730 msgr2=0x7fa81006b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:36.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.546+0000 7fa80e000640 1 --2- 172.21.15.29:0/2171688832 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa81015c730 0x7fa81006b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.546+0000 7fa80e000640 1 -- 172.21.15.29:0/2171688832 >> v1:172.21.15.163:6789/0 conn(0x7fa8100ccdb0 legacy=0x7fa8100cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:36.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.546+0000 7fa80e000640 1 -- 172.21.15.29:0/2171688832 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81006bd60 con 0x7fa8100b2700 2024-01-24T13:06:36.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.550+0000 7fa80e000640 1 --2- 172.21.15.29:0/2171688832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8100b2700 0x7fa8100ca9f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009870 tx=0x7fa7f801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49121f61e54d89e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:36.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.550+0000 7fa80d600640 1 -- 172.21.15.29:0/2171688832 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80aa670 con 0x7fa8100b2700 2024-01-24T13:06:36.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.550+0000 7fa80d600640 1 -- 172.21.15.29:0/2171688832 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f80aa7d0 con 0x7fa8100b2700 2024-01-24T13:06:36.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.550+0000 7fa80d600640 1 -- 172.21.15.29:0/2171688832 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80aab60 con 0x7fa8100b2700 2024-01-24T13:06:36.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.550+0000 7fa815800640 1 -- 172.21.15.29:0/2171688832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8100b2700 msgr2=0x7fa8100ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:36.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.550+0000 7fa815800640 1 --2- 172.21.15.29:0/2171688832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8100b2700 0x7fa8100ca9f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009870 tx=0x7fa7f801c510 comp rx=0 tx=0).stop 2024-01-24T13:06:36.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.550+0000 7fa815800640 1 -- 172.21.15.29:0/2171688832 shutdown_connections 2024-01-24T13:06:36.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.550+0000 7fa815800640 1 --2- 172.21.15.29:0/2171688832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8100b2700 0x7fa8100ca9f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.550+0000 7fa815800640 1 --2- 172.21.15.29:0/2171688832 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa81015c730 0x7fa81006b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.550+0000 7fa815800640 1 -- 172.21.15.29:0/2171688832 >> 172.21.15.29:0/2171688832 conn(0x7fa810070570 msgr2=0x7fa810069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:36.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.550+0000 7fa815800640 1 -- 172.21.15.29:0/2171688832 shutdown_connections 2024-01-24T13:06:36.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.550+0000 7fa815800640 1 -- 172.21.15.29:0/2171688832 wait complete. 2024-01-24T13:06:36.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.550+0000 7fa815800640 1 Processor -- start 2024-01-24T13:06:36.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.550+0000 7fa815800640 1 -- start start 2024-01-24T13:06:36.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa815800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8100b2700 0x7fa81014f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:36.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa815800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8100ccdb0 0x7fa8101536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:36.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa815800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa81015c730 0x7fa810156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:36.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa815800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa810157bb0 con 0x7fa8100b2700 2024-01-24T13:06:36.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa815800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81014fe60 con 0x7fa81015c730 2024-01-24T13:06:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa815800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8101575f0 con 0x7fa8100ccdb0 2024-01-24T13:06:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa80ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8100b2700 0x7fa81014f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa80ea00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8100b2700 0x7fa81014f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:32814/0 (socket says 172.21.15.29:32814) 2024-01-24T13:06:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa80ea00640 1 -- 172.21.15.29:0/2361168461 learned_addr learned my addr 172.21.15.29:0/2361168461 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa80e000640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8100ccdb0 0x7fa8101536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa80f400640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa81015c730 0x7fa810156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa80ea00640 1 -- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8100ccdb0 msgr2=0x7fa8101536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa80ea00640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8100ccdb0 0x7fa8101536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa80ea00640 1 -- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa81015c730 msgr2=0x7fa810156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa80ea00640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa81015c730 0x7fa810156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa80ea00640 1 -- 172.21.15.29:0/2361168461 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80094d0 con 0x7fa8100b2700 2024-01-24T13:06:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa80f400640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa81015c730 0x7fa810156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa80ea00640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8100b2700 0x7fa81014f920 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa80000e870 tx=0x7fa80000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa806a00640 1 -- 172.21.15.29:0/2361168461 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800009510 con 0x7fa8100b2700 2024-01-24T13:06:36.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa806a00640 1 -- 172.21.15.29:0/2361168461 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80000eec0 con 0x7fa8100b2700 2024-01-24T13:06:36.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa815800640 1 -- 172.21.15.29:0/2361168461 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8101578d0 con 0x7fa8100b2700 2024-01-24T13:06:36.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa806a00640 1 -- 172.21.15.29:0/2361168461 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80000cb40 con 0x7fa8100b2700 2024-01-24T13:06:36.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa815800640 1 -- 172.21.15.29:0/2361168461 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8100b3fe0 con 0x7fa8100b2700 2024-01-24T13:06:36.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.554+0000 7fa815800640 1 -- 172.21.15.29:0/2361168461 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8100cf430 con 0x7fa8100b2700 2024-01-24T13:06:36.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.558+0000 7fa806a00640 1 -- 172.21.15.29:0/2361168461 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa80000cca0 con 0x7fa8100b2700 2024-01-24T13:06:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.558+0000 7fa806a00640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa7e8065a60 0x7fa7e8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.558+0000 7fa806a00640 1 -- 172.21.15.29:0/2361168461 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa800083380 con 0x7fa8100b2700 2024-01-24T13:06:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.558+0000 7fa80e000640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa7e8065a60 0x7fa7e8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.558+0000 7fa80e000640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa7e8065a60 0x7fa7e8067f20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80ae000 tx=0x7fa7f80b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:36.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.562+0000 7fa806a00640 1 -- 172.21.15.29:0/2361168461 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa800050ca0 con 0x7fa8100b2700 2024-01-24T13:06:36.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.750+0000 7fa815800640 1 -- 172.21.15.29:0/2361168461 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8100b3b40 con 0x7fa8100b2700 2024-01-24T13:06:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.750+0000 7fa806a00640 1 -- 172.21.15.29:0/2361168461 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4734 (secure 0 0 0) 0x7fa8000542c0 con 0x7fa8100b2700 2024-01-24T13:06:36.756 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:36.756 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/2169087472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2169087472},{"type":"v1","addr":"172.21.15.163:6836","nonce":2169087472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/88874113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":88874113},{"type":"v1","addr":"172.21.15.163:6837","nonce":88874113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6177,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1411376794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1411376794},{"type":"v1","addr":"172.21.15.29:6834","nonce":1411376794}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:06:33.362322+0000","modified":"2024-01-24T13:06:36.373536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6180":{"gid":6180,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2075296900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2075296900},{"type":"v1","addr":"172.21.15.29:6835","nonce":2075296900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-24T13:06:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 26 2024-01-24T13:06:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.754+0000 7fa815800640 1 -- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa7e8065a60 msgr2=0x7fa7e8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.754+0000 7fa815800640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa7e8065a60 0x7fa7e8067f20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80ae000 tx=0x7fa7f80b5040 comp rx=0 tx=0).stop 2024-01-24T13:06:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.754+0000 7fa815800640 1 -- 172.21.15.29:0/2361168461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8100b2700 msgr2=0x7fa81014f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.754+0000 7fa815800640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8100b2700 0x7fa81014f920 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa80000e870 tx=0x7fa80000ec70 comp rx=0 tx=0).stop 2024-01-24T13:06:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.754+0000 7fa815800640 1 -- 172.21.15.29:0/2361168461 shutdown_connections 2024-01-24T13:06:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.754+0000 7fa815800640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa7e8065a60 0x7fa7e8067f20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.754+0000 7fa815800640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa81015c730 0x7fa810156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.754+0000 7fa815800640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8100ccdb0 0x7fa8101536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.754+0000 7fa815800640 1 --2- 172.21.15.29:0/2361168461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8100b2700 0x7fa81014f920 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.754+0000 7fa815800640 1 -- 172.21.15.29:0/2361168461 >> 172.21.15.29:0/2361168461 conn(0x7fa810070570 msgr2=0x7fa8100cdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.754+0000 7fa815800640 1 -- 172.21.15.29:0/2361168461 shutdown_connections 2024-01-24T13:06:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.754+0000 7fa815800640 1 -- 172.21.15.29:0/2361168461 wait complete. 2024-01-24T13:06:36.778 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:06:36.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.914+0000 7fca40c00640 1 Processor -- start 2024-01-24T13:06:36.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.914+0000 7fca40c00640 1 -- start start 2024-01-24T13:06:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.914+0000 7fca40c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fca3c143910 0x7fca3c143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.914+0000 7fca40c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3c15aa30 con 0x7fca3c06c320 2024-01-24T13:06:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.914+0000 7fca40c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3c0712a0 con 0x7fca3c070ac0 2024-01-24T13:06:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.914+0000 7fca40c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3c071580 con 0x7fca3c143910 2024-01-24T13:06:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.918+0000 7fca39e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fca3c143910 0x7fca3c143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.918+0000 7fca3a800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fca3c06c320 0x7fca3c0cd890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55076/0 (socket says 172.21.15.29:55076) 2024-01-24T13:06:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.918+0000 7fca39e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fca3c143910 0x7fca3c143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:32828/0 (socket says 172.21.15.29:32828) 2024-01-24T13:06:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.918+0000 7fca3a800640 1 -- 172.21.15.29:0/2444318784 learned_addr learned my addr 172.21.15.29:0/2444318784 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.918+0000 7fca39e00640 1 -- 172.21.15.29:0/2444318784 >> v1:172.21.15.163:6789/0 conn(0x7fca3c070ac0 legacy=0x7fca3c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.918+0000 7fca39e00640 1 -- 172.21.15.29:0/2444318784 >> v1:172.21.15.29:6789/0 conn(0x7fca3c06c320 legacy=0x7fca3c0cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.918+0000 7fca39e00640 1 -- 172.21.15.29:0/2444318784 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c0cd090 con 0x7fca3c143910 2024-01-24T13:06:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.918+0000 7fca38a00640 1 -- 172.21.15.29:0/2444318784 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113952356 0 0) 0x7fca340014a0 con 0x7fca3c06c320 2024-01-24T13:06:36.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.918+0000 7fca39e00640 1 --2- 172.21.15.29:0/2444318784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c143910 0x7fca3c143d30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fca2c0097c0 tx=0x7fca2c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad0247be2d8bc3f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:36.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.918+0000 7fca38a00640 1 -- 172.21.15.29:0/2444318784 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0a7070 con 0x7fca3c143910 2024-01-24T13:06:36.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.918+0000 7fca38a00640 1 -- 172.21.15.29:0/2444318784 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c0ab430 con 0x7fca3c143910 2024-01-24T13:06:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.918+0000 7fca38a00640 1 -- 172.21.15.29:0/2444318784 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0ab7c0 con 0x7fca3c143910 2024-01-24T13:06:36.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 -- 172.21.15.29:0/2444318784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c143910 msgr2=0x7fca3c143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:36.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 --2- 172.21.15.29:0/2444318784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c143910 0x7fca3c143d30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fca2c0097c0 tx=0x7fca2c01c450 comp rx=0 tx=0).stop 2024-01-24T13:06:36.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 -- 172.21.15.29:0/2444318784 shutdown_connections 2024-01-24T13:06:36.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 --2- 172.21.15.29:0/2444318784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c143910 0x7fca3c143d30 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 -- 172.21.15.29:0/2444318784 >> 172.21.15.29:0/2444318784 conn(0x7fca3c0b3950 msgr2=0x7fca3c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:36.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 -- 172.21.15.29:0/2444318784 shutdown_connections 2024-01-24T13:06:36.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 -- 172.21.15.29:0/2444318784 wait complete. 2024-01-24T13:06:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 Processor -- start 2024-01-24T13:06:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 -- start start 2024-01-24T13:06:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c06c320 0x7fca3c156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca3c070ac0 0x7fca3c13e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3c143910 0x7fca3c13ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0b2d90 con 0x7fca3c06c320 2024-01-24T13:06:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c139d60 con 0x7fca3c070ac0 2024-01-24T13:06:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca40c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0af440 con 0x7fca3c143910 2024-01-24T13:06:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca39e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c06c320 0x7fca3c156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca39e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c06c320 0x7fca3c156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:32842/0 (socket says 172.21.15.29:32842) 2024-01-24T13:06:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.922+0000 7fca39e00640 1 -- 172.21.15.29:0/2763487730 learned_addr learned my addr 172.21.15.29:0/2763487730 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:36.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca39400640 1 --2- 172.21.15.29:0/2763487730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca3c070ac0 0x7fca3c13e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca39e00640 1 -- 172.21.15.29:0/2763487730 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3c143910 msgr2=0x7fca3c13ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca39e00640 1 --2- 172.21.15.29:0/2763487730 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3c143910 0x7fca3c13ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca39e00640 1 -- 172.21.15.29:0/2763487730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca3c070ac0 msgr2=0x7fca3c13e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca39e00640 1 --2- 172.21.15.29:0/2763487730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca3c070ac0 0x7fca3c13e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca39e00640 1 -- 172.21.15.29:0/2763487730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c009420 con 0x7fca3c06c320 2024-01-24T13:06:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca39400640 1 --2- 172.21.15.29:0/2763487730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca3c070ac0 0x7fca3c13e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca39e00640 1 --2- 172.21.15.29:0/2763487730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c06c320 0x7fca3c156a90 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fca2c0ad040 tx=0x7fca2c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca32000640 1 -- 172.21.15.29:0/2763487730 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c004230 con 0x7fca3c06c320 2024-01-24T13:06:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca32000640 1 -- 172.21.15.29:0/2763487730 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c0b9070 con 0x7fca3c06c320 2024-01-24T13:06:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca32000640 1 -- 172.21.15.29:0/2763487730 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0abe30 con 0x7fca3c06c320 2024-01-24T13:06:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca40c00640 1 -- 172.21.15.29:0/2763487730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3c0af720 con 0x7fca3c06c320 2024-01-24T13:06:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca40c00640 1 -- 172.21.15.29:0/2763487730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3c0afa00 con 0x7fca3c06c320 2024-01-24T13:06:36.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca40c00640 1 -- 172.21.15.29:0/2763487730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3c04e850 con 0x7fca3c06c320 2024-01-24T13:06:36.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca32000640 1 -- 172.21.15.29:0/2763487730 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fca2c003620 con 0x7fca3c06c320 2024-01-24T13:06:36.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca32000640 1 --2- 172.21.15.29:0/2763487730 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca14065a60 0x7fca14067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:36.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.926+0000 7fca32000640 1 -- 172.21.15.29:0/2763487730 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fca2c0bb070 con 0x7fca3c06c320 2024-01-24T13:06:36.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.930+0000 7fca39400640 1 --2- 172.21.15.29:0/2763487730 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca14065a60 0x7fca14067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:36.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.930+0000 7fca39400640 1 --2- 172.21.15.29:0/2763487730 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca14065a60 0x7fca14067f20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fca3c15eb60 tx=0x7fca24009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:36.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:36.930+0000 7fca32000640 1 -- 172.21.15.29:0/2763487730 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fca2c0eb330 con 0x7fca3c06c320 2024-01-24T13:06:37.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.090+0000 7fca40c00640 1 -- 172.21.15.29:0/2763487730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca3c06a9a0 con 0x7fca3c06c320 2024-01-24T13:06:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.094+0000 7fca32000640 1 -- 172.21.15.29:0/2763487730 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16302 (secure 0 0 0) 0x7fca2c0c4020 con 0x7fca3c06c320 2024-01-24T13:06:37.096 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:37.097 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":59,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:06:34.365221+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:06:31.105908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-24T13:06:32.357292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:06:37.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.094+0000 7fca40c00640 1 -- 172.21.15.29:0/2763487730 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca14065a60 msgr2=0x7fca14067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.094+0000 7fca40c00640 1 --2- 172.21.15.29:0/2763487730 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca14065a60 0x7fca14067f20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fca3c15eb60 tx=0x7fca24009040 comp rx=0 tx=0).stop 2024-01-24T13:06:37.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.094+0000 7fca40c00640 1 -- 172.21.15.29:0/2763487730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c06c320 msgr2=0x7fca3c156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.094+0000 7fca40c00640 1 --2- 172.21.15.29:0/2763487730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c06c320 0x7fca3c156a90 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fca2c0ad040 tx=0x7fca2c01ac90 comp rx=0 tx=0).stop 2024-01-24T13:06:37.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.094+0000 7fca40c00640 1 -- 172.21.15.29:0/2763487730 shutdown_connections 2024-01-24T13:06:37.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.094+0000 7fca40c00640 1 --2- 172.21.15.29:0/2763487730 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca14065a60 0x7fca14067f20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.094+0000 7fca40c00640 1 --2- 172.21.15.29:0/2763487730 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca3c143910 0x7fca3c13ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.094+0000 7fca40c00640 1 --2- 172.21.15.29:0/2763487730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca3c070ac0 0x7fca3c13e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.094+0000 7fca40c00640 1 --2- 172.21.15.29:0/2763487730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c06c320 0x7fca3c156a90 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.094+0000 7fca40c00640 1 -- 172.21.15.29:0/2763487730 >> 172.21.15.29:0/2763487730 conn(0x7fca3c0b3950 msgr2=0x7fca3c15d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:37.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.094+0000 7fca40c00640 1 -- 172.21.15.29:0/2763487730 shutdown_connections 2024-01-24T13:06:37.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.094+0000 7fca40c00640 1 -- 172.21.15.29:0/2763487730 wait complete. 2024-01-24T13:06:37.119 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-24T13:06:37.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:06:37.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.258+0000 7fda1c200640 1 Processor -- start 2024-01-24T13:06:37.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.258+0000 7fda1c200640 1 -- start start 2024-01-24T13:06:37.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.258+0000 7fda1c200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fda140b1f50 0x7fda140ac460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:37.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.258+0000 7fda1c200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda14070230 con 0x7fda140ce5e0 2024-01-24T13:06:37.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.258+0000 7fda1c200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda14070510 con 0x7fda1415c450 2024-01-24T13:06:37.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.258+0000 7fda1c200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda140712d0 con 0x7fda140b1f50 2024-01-24T13:06:37.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.258+0000 7fda18e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fda140ce5e0 0x7fda140abd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55082/0 (socket says 172.21.15.29:55082) 2024-01-24T13:06:37.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.258+0000 7fda18e00640 1 -- 172.21.15.29:0/3194357668 learned_addr learned my addr 172.21.15.29:0/3194357668 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:37.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.258+0000 7fda1a200640 1 --2- 172.21.15.29:0/3194357668 >> v2:172.21.15.163:3300/0 conn(0x7fda140b1f50 0x7fda140ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:37.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.258+0000 7fda13e00640 1 -- 172.21.15.29:0/3194357668 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850228105 0 0) 0x7fda14070230 con 0x7fda140ce5e0 2024-01-24T13:06:37.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.258+0000 7fda13e00640 1 -- 172.21.15.29:0/3194357668 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9f4003530 con 0x7fda140ce5e0 2024-01-24T13:06:37.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda13e00640 1 -- 172.21.15.29:0/3194357668 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1628144610 0 0) 0x7fd9f4003530 con 0x7fda140ce5e0 2024-01-24T13:06:37.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda13e00640 1 -- 172.21.15.29:0/3194357668 >> v2:172.21.15.163:3300/0 conn(0x7fda140b1f50 msgr2=0x7fda140ac460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:37.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda13e00640 1 --2- 172.21.15.29:0/3194357668 >> v2:172.21.15.163:3300/0 conn(0x7fda140b1f50 0x7fda140ac460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda13e00640 1 -- 172.21.15.29:0/3194357668 >> v1:172.21.15.163:6789/0 conn(0x7fda1415c450 legacy=0x7fda140cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda13e00640 1 -- 172.21.15.29:0/3194357668 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda140707f0 con 0x7fda140ce5e0 2024-01-24T13:06:37.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda13e00640 1 -- 172.21.15.29:0/3194357668 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7fd9fc001680 con 0x7fda140ce5e0 2024-01-24T13:06:37.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda13e00640 1 -- 172.21.15.29:0/3194357668 >> v1:172.21.15.29:6789/0 conn(0x7fda140ce5e0 legacy=0x7fda140abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda13e00640 1 --2- 172.21.15.29:0/3194357668 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd9f4003980 0x7fd9f4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:37.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda13e00640 1 --2- 172.21.15.29:0/3194357668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9f4004380 0x7fd9f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:37.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda13e00640 1 --2- 172.21.15.29:0/3194357668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9f40050f0 0x7fd9f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:37.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda13e00640 1 -- 172.21.15.29:0/3194357668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f400c000 con 0x7fd9f4004380 2024-01-24T13:06:37.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda13e00640 1 -- 172.21.15.29:0/3194357668 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f400c170 con 0x7fd9f40050f0 2024-01-24T13:06:37.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda13e00640 1 -- 172.21.15.29:0/3194357668 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f400c330 con 0x7fd9f4003980 2024-01-24T13:06:37.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda18e00640 1 --2- 172.21.15.29:0/3194357668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9f4004380 0x7fd9f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:37.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda1a200640 1 --2- 172.21.15.29:0/3194357668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9f40050f0 0x7fd9f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:37.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda19800640 1 --2- 172.21.15.29:0/3194357668 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd9f4003980 0x7fd9f4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:37.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda18e00640 1 -- 172.21.15.29:0/3194357668 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd9f4003980 msgr2=0x7fd9f4003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:37.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda18e00640 1 --2- 172.21.15.29:0/3194357668 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd9f4003980 0x7fd9f4003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda18e00640 1 -- 172.21.15.29:0/3194357668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9f40050f0 msgr2=0x7fd9f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:37.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda18e00640 1 --2- 172.21.15.29:0/3194357668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9f40050f0 0x7fd9f400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda18e00640 1 -- 172.21.15.29:0/3194357668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f4003530 con 0x7fd9f4004380 2024-01-24T13:06:37.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.262+0000 7fda1a200640 1 -- 172.21.15.29:0/3194357668 reap_dead start 2024-01-24T13:06:37.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.266+0000 7fda18e00640 1 --2- 172.21.15.29:0/3194357668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9f4004380 0x7fd9f4004850 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00c190 tx=0x7fd9fc01cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389556cac695b505 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:37.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.266+0000 7fda13e00640 1 -- 172.21.15.29:0/3194357668 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc005ae0 con 0x7fd9f4004380 2024-01-24T13:06:37.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.266+0000 7fda13e00640 1 -- 172.21.15.29:0/3194357668 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc005c40 con 0x7fd9f4004380 2024-01-24T13:06:37.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.266+0000 7fda13e00640 1 -- 172.21.15.29:0/3194357668 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc0a5840 con 0x7fd9f4004380 2024-01-24T13:06:37.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.266+0000 7fda1c200640 1 -- 172.21.15.29:0/3194357668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9f4004380 msgr2=0x7fd9f4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.266+0000 7fda1c200640 1 --2- 172.21.15.29:0/3194357668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9f4004380 0x7fd9f4004850 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00c190 tx=0x7fd9fc01cb40 comp rx=0 tx=0).stop 2024-01-24T13:06:37.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.266+0000 7fda1c200640 1 -- 172.21.15.29:0/3194357668 shutdown_connections 2024-01-24T13:06:37.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.266+0000 7fda1c200640 1 --2- 172.21.15.29:0/3194357668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9f4004380 0x7fd9f4004850 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.266+0000 7fda1c200640 1 -- 172.21.15.29:0/3194357668 >> 172.21.15.29:0/3194357668 conn(0x7fda140b3950 msgr2=0x7fda14069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:37.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.266+0000 7fda1c200640 1 -- 172.21.15.29:0/3194357668 shutdown_connections 2024-01-24T13:06:37.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.266+0000 7fda1c200640 1 -- 172.21.15.29:0/3194357668 wait complete. 2024-01-24T13:06:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.266+0000 7fda1c200640 1 Processor -- start 2024-01-24T13:06:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.266+0000 7fda1c200640 1 -- start start 2024-01-24T13:06:37.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1c200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9f4004380 0x7fda141e20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:37.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1c200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda140cad90 0x7fda140cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:37.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1c200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda140ac250 0x7fda140ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:37.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1c200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda140acd10 con 0x7fda140ac250 2024-01-24T13:06:37.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1c200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda140acff0 con 0x7fd9f4004380 2024-01-24T13:06:37.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1c200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda140ad2d0 con 0x7fda140cad90 2024-01-24T13:06:37.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1a200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda140ac250 0x7fda140ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:37.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1a200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda140ac250 0x7fda140ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:32862/0 (socket says 172.21.15.29:32862) 2024-01-24T13:06:37.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1a200640 1 -- 172.21.15.29:0/1435590715 learned_addr learned my addr 172.21.15.29:0/1435590715 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:37.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda18e00640 1 --2- 172.21.15.29:0/1435590715 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda140cad90 0x7fda140cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:37.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda19800640 1 --2- 172.21.15.29:0/1435590715 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9f4004380 0x7fda141e20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:37.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1a200640 1 -- 172.21.15.29:0/1435590715 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda140cad90 msgr2=0x7fda140cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1a200640 1 --2- 172.21.15.29:0/1435590715 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda140cad90 0x7fda140cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1a200640 1 -- 172.21.15.29:0/1435590715 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9f4004380 msgr2=0x7fda141e20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1a200640 1 --2- 172.21.15.29:0/1435590715 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9f4004380 0x7fda141e20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1a200640 1 -- 172.21.15.29:0/1435590715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda141e4cb0 con 0x7fda140ac250 2024-01-24T13:06:37.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1a200640 1 --2- 172.21.15.29:0/1435590715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda140ac250 0x7fda140ac6d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fda140b3280 tx=0x7fda0c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda11600640 1 -- 172.21.15.29:0/1435590715 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c00e040 con 0x7fda140ac250 2024-01-24T13:06:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda11600640 1 -- 172.21.15.29:0/1435590715 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c00f040 con 0x7fda140ac250 2024-01-24T13:06:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda11600640 1 -- 172.21.15.29:0/1435590715 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c015430 con 0x7fda140ac250 2024-01-24T13:06:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1c200640 1 -- 172.21.15.29:0/1435590715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda141e4f90 con 0x7fda140ac250 2024-01-24T13:06:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1c200640 1 -- 172.21.15.29:0/1435590715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda141e2610 con 0x7fda140ac250 2024-01-24T13:06:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda1c200640 1 -- 172.21.15.29:0/1435590715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda141e5180 con 0x7fda140ac250 2024-01-24T13:06:37.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.270+0000 7fda11600640 1 -- 172.21.15.29:0/1435590715 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fda0c015590 con 0x7fda140ac250 2024-01-24T13:06:37.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.274+0000 7fda11600640 1 --2- 172.21.15.29:0/1435590715 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd9ec065a60 0x7fd9ec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:37.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.274+0000 7fda11600640 1 -- 172.21.15.29:0/1435590715 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fda0c083c00 con 0x7fda140ac250 2024-01-24T13:06:37.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.274+0000 7fda19800640 1 --2- 172.21.15.29:0/1435590715 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd9ec065a60 0x7fd9ec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:37.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.274+0000 7fda19800640 1 --2- 172.21.15.29:0/1435590715 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd9ec065a60 0x7fd9ec067f20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fda04007990 tx=0x7fda04007900 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:37.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.278+0000 7fda11600640 1 -- 172.21.15.29:0/1435590715 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fda0c0513e0 con 0x7fda140ac250 2024-01-24T13:06:37.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.430+0000 7fda1c200640 1 -- 172.21.15.29:0/1435590715 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda141e2830 con 0x7fd9ec065a60 2024-01-24T13:06:37.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.438+0000 7fda11600640 1 -- 172.21.15.29:0/1435590715 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278328 (secure 0 0 0) 0x7fda141e2830 con 0x7fd9ec065a60 2024-01-24T13:06:37.447 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:06:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.442+0000 7fda1c200640 1 -- 172.21.15.29:0/1435590715 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd9ec065a60 msgr2=0x7fd9ec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.442+0000 7fda1c200640 1 --2- 172.21.15.29:0/1435590715 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd9ec065a60 0x7fd9ec067f20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fda04007990 tx=0x7fda04007900 comp rx=0 tx=0).stop 2024-01-24T13:06:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.442+0000 7fda1c200640 1 -- 172.21.15.29:0/1435590715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda140ac250 msgr2=0x7fda140ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.442+0000 7fda1c200640 1 --2- 172.21.15.29:0/1435590715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda140ac250 0x7fda140ac6d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fda140b3280 tx=0x7fda0c00f580 comp rx=0 tx=0).stop 2024-01-24T13:06:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.442+0000 7fda1c200640 1 -- 172.21.15.29:0/1435590715 shutdown_connections 2024-01-24T13:06:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.442+0000 7fda1c200640 1 --2- 172.21.15.29:0/1435590715 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd9ec065a60 0x7fd9ec067f20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.442+0000 7fda1c200640 1 --2- 172.21.15.29:0/1435590715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda140ac250 0x7fda140ac6d0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.442+0000 7fda1c200640 1 --2- 172.21.15.29:0/1435590715 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda140cad90 0x7fda140cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.442+0000 7fda1c200640 1 --2- 172.21.15.29:0/1435590715 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9f4004380 0x7fda141e20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.442+0000 7fda1c200640 1 -- 172.21.15.29:0/1435590715 >> 172.21.15.29:0/1435590715 conn(0x7fda140b3950 msgr2=0x7fda14144b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:37.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.442+0000 7fda1c200640 1 -- 172.21.15.29:0/1435590715 shutdown_connections 2024-01-24T13:06:37.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.442+0000 7fda1c200640 1 -- 172.21.15.29:0/1435590715 wait complete. 2024-01-24T13:06:37.468 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-01-24T13:06:35.576205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":54,"acting":54,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238896,"kb_used_data":6308,"kb_used_omap":13,"kb_used_meta":232434,"kb_avail":754735824,"statfs":{"total":773094113280,"available":772849483776,"internally_reserved":0,"allocated":6459392,"data_stored":3491669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":238012504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000569"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961098+0000","last_change":"2024-01-24T13:06:31.961098+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961098+0000","last_undegraded":"2024-01-24T13:06:31.961098+0000","last_fullsized":"2024-01-24T13:06:31.961098+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:03:08.159676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.967595+0000","last_change":"2024-01-24T13:06:31.967595+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.967595+0000","last_undegraded":"2024-01-24T13:06:31.967595+0000","last_fullsized":"2024-01-24T13:06:31.967595+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:40:00.227482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960766+0000","last_change":"2024-01-24T13:06:31.960766+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960766+0000","last_undegraded":"2024-01-24T13:06:31.960766+0000","last_fullsized":"2024-01-24T13:06:31.960766+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:29:48.431683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964243+0000","last_change":"2024-01-24T13:06:31.964243+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964243+0000","last_undegraded":"2024-01-24T13:06:31.964243+0000","last_fullsized":"2024-01-24T13:06:31.964243+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:39:47.187887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961108+0000","last_change":"2024-01-24T13:06:31.961108+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961108+0000","last_undegraded":"2024-01-24T13:06:31.961108+0000","last_fullsized":"2024-01-24T13:06:31.961108+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:38:05.514545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960766+0000","last_change":"2024-01-24T13:06:31.960766+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960766+0000","last_undegraded":"2024-01-24T13:06:31.960766+0000","last_fullsized":"2024-01-24T13:06:31.960766+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:53:06.966206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.965205+0000","last_change":"2024-01-24T13:06:31.965205+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.965205+0000","last_undegraded":"2024-01-24T13:06:31.965205+0000","last_fullsized":"2024-01-24T13:06:31.965205+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.958565+0000","last_change":"2024-01-24T13:06:31.958565+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.958565+0000","last_undegraded":"2024-01-24T13:06:31.958565+0000","last_fullsized":"2024-01-24T13:06:31.958565+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:44:14.249644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.965190+0000","last_change":"2024-01-24T13:06:31.965190+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.965190+0000","last_undegraded":"2024-01-24T13:06:31.965190+0000","last_fullsized":"2024-01-24T13:06:31.965190+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:31.948336+0000","last_change":"2024-01-24T13:06:31.948336+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.948336+0000","last_undegraded":"2024-01-24T13:06:31.948336+0000","last_fullsized":"2024-01-24T13:06:31.948336+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964396+0000","last_change":"2024-01-24T13:06:31.964396+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964396+0000","last_undegraded":"2024-01-24T13:06:31.964396+0000","last_fullsized":"2024-01-24T13:06:31.964396+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:13:10.025823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.958729+0000","last_change":"2024-01-24T13:06:31.958729+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.958729+0000","last_undegraded":"2024-01-24T13:06:31.958729+0000","last_fullsized":"2024-01-24T13:06:31.958729+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:31.948336+0000","last_change":"2024-01-24T13:06:31.948336+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.948336+0000","last_undegraded":"2024-01-24T13:06:31.948336+0000","last_fullsized":"2024-01-24T13:06:31.948336+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964375+0000","last_change":"2024-01-24T13:06:31.964375+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964375+0000","last_undegraded":"2024-01-24T13:06:31.964375+0000","last_fullsized":"2024-01-24T13:06:31.964375+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:17:48.959635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964339+0000","last_change":"2024-01-24T13:06:31.964339+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964339+0000","last_undegraded":"2024-01-24T13:06:31.964339+0000","last_fullsized":"2024-01-24T13:06:31.964339+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:03:45.497890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964325+0000","last_change":"2024-01-24T13:06:31.964325+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964325+0000","last_undegraded":"2024-01-24T13:06:31.964325+0000","last_fullsized":"2024-01-24T13:06:31.964325+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:49:10.726348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.968112+0000","last_change":"2024-01-24T13:06:31.968112+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.968112+0000","last_undegraded":"2024-01-24T13:06:31.968112+0000","last_fullsized":"2024-01-24T13:06:31.968112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:31.948336+0000","last_change":"2024-01-24T13:06:31.948336+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.948336+0000","last_undegraded":"2024-01-24T13:06:31.948336+0000","last_fullsized":"2024-01-24T13:06:31.948336+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961076+0000","last_change":"2024-01-24T13:06:31.961076+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961076+0000","last_undegraded":"2024-01-24T13:06:31.961076+0000","last_fullsized":"2024-01-24T13:06:31.961076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:36:01.523707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:31.948336+0000","last_change":"2024-01-24T13:06:31.948336+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.948336+0000","last_undegraded":"2024-01-24T13:06:31.948336+0000","last_fullsized":"2024-01-24T13:06:31.948336+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960798+0000","last_change":"2024-01-24T13:06:31.960798+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960798+0000","last_undegraded":"2024-01-24T13:06:31.960798+0000","last_fullsized":"2024-01-24T13:06:31.960798+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:24:45.430111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:31.948336+0000","last_change":"2024-01-24T13:06:31.948336+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.948336+0000","last_undegraded":"2024-01-24T13:06:31.948336+0000","last_fullsized":"2024-01-24T13:06:31.948336+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.965834+0000","last_change":"2024-01-24T13:06:31.965834+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.965834+0000","last_undegraded":"2024-01-24T13:06:31.965834+0000","last_fullsized":"2024-01-24T13:06:31.965834+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:40:00.227482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.967562+0000","last_change":"2024-01-24T13:06:31.967562+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.967562+0000","last_undegraded":"2024-01-24T13:06:31.967562+0000","last_fullsized":"2024-01-24T13:06:31.967562+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960886+0000","last_change":"2024-01-24T13:06:31.960886+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960886+0000","last_undegraded":"2024-01-24T13:06:31.960886+0000","last_fullsized":"2024-01-24T13:06:31.960886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:16:21.150556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.966302+0000","last_change":"2024-01-24T13:06:31.966302+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.966302+0000","last_undegraded":"2024-01-24T13:06:31.966302+0000","last_fullsized":"2024-01-24T13:06:31.966302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:00:19.578573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961108+0000","last_change":"2024-01-24T13:06:31.961108+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961108+0000","last_undegraded":"2024-01-24T13:06:31.961108+0000","last_fullsized":"2024-01-24T13:06:31.961108+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:23:53.805299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.967621+0000","last_change":"2024-01-24T13:06:31.967621+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.967621+0000","last_undegraded":"2024-01-24T13:06:31.967621+0000","last_fullsized":"2024-01-24T13:06:31.967621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:00:19.578573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961089+0000","last_change":"2024-01-24T13:06:31.961089+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961089+0000","last_undegraded":"2024-01-24T13:06:31.961089+0000","last_fullsized":"2024-01-24T13:06:31.961089+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:07.082513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960698+0000","last_change":"2024-01-24T13:06:31.960698+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960698+0000","last_undegraded":"2024-01-24T13:06:31.960698+0000","last_fullsized":"2024-01-24T13:06:31.960698+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:35:10.934452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:31.948336+0000","last_change":"2024-01-24T13:06:31.948336+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.948336+0000","last_undegraded":"2024-01-24T13:06:31.948336+0000","last_fullsized":"2024-01-24T13:06:31.948336+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.958648+0000","last_change":"2024-01-24T13:06:31.958648+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.958648+0000","last_undegraded":"2024-01-24T13:06:31.958648+0000","last_fullsized":"2024-01-24T13:06:31.958648+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":192,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-24T13:06:30.231173+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:06:30.231173+0000","last_peered":"2024-01-24T13:06:30.231173+0000","last_clean":"2024-01-24T13:06:30.231173+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:06:30.231173+0000","last_undegraded":"2024-01-24T13:06:30.231173+0000","last_fullsized":"2024-01-24T13:06:30.231173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":285031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.47099999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83799999999999997,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79800000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.61499999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.53800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92700000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.745,"15min":0.755},"min":{"1min":0.56599999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84399999999999997,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.56000000000000005}]},{"osd":3,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.61299999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.89700000000000002,"5min":1.131,"15min":1.131},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.93999999999999995,"5min":1.05,"15min":1.05},"last":0.67500000000000004}]},{"osd":4,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63400000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77300000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.873,"5min":1.341,"15min":1.341},"last":0.746}]},{"osd":5,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89600000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92400000000000004,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54300000000000004}]},{"osd":6,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96599999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91200000000000003,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.60599999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.46600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91500000000000004,"5min":2.827,"15min":2.827},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81000000000000005,"5min":2.052,"15min":2.052},"last":0.72399999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.72299999999999998,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86699999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.92300000000000004,"15min":0.97099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.74099999999999999,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.77200000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.85199999999999998,"15min":0.88600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.83899999999999997,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.94299999999999995,"15min":0.98499999999999999},"min":{"1min":0.54200000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.83999999999999997,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.93999999999999995}]},{"osd":3,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.91700000000000004,"15min":0.95899999999999996},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80600000000000005,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.82199999999999995,"15min":0.84699999999999998},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.85099999999999998,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90300000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.80200000000000005}]},{"osd":5,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.47899999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84699999999999998,"5min":4.274,"15min":4.274},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.81200000000000006,"15min":0.82199999999999995},"min":{"1min":0.63,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88800000000000001,"5min":2.645,"15min":2.645},"last":0.69899999999999995}]},{"osd":7,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.84499999999999997,"15min":0.873},"min":{"1min":0.50900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86699999999999999,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.86199999999999999,"15min":0.88600000000000001},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.92400000000000004,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.628}]}]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63900000000000001,"15min":0.63300000000000001},"min":{"1min":0.47599999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.79500000000000004}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98399999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.014,"5min":1.484,"15min":1.484},"last":0.77800000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68200000000000005,"15min":0.67400000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.878},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.66500000000000004}]},{"osd":3,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.51400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58199999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.629},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.97999999999999998,"5min":1.002,"15min":1.002},"last":0.60399999999999998}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.499,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.54200000000000004}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70299999999999996,"15min":0.69999999999999996},"min":{"1min":0.55500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.59699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95299999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75900000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":651264,"data_stored":285031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.433,"15min":0.44500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53100000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.495},{"interface":"front","average":{"1min":0.443,"5min":0.46300000000000002,"15min":0.46600000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.58199999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.40400000000000003}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46600000000000003,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55300000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68200000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.59899999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.435},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60599999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45300000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.75,"15min":0.76500000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.91500000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78500000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.86299999999999999,"5min":1.014,"15min":1.014},"last":0.81799999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88300000000000001,"5min":1.032,"15min":1.032},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72699999999999998}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79600000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.90500000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.82499999999999996,"15min":0.84499999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.89400000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.83199999999999996,"15min":0.85099999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.875,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":0.85899999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.752}]}]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.46700000000000003,"15min":0.48399999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54300000000000004,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91900000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52400000000000002}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.53100000000000003,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64100000000000001,"5min":1.379,"15min":1.379},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.374,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88700000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.60899999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.63400000000000001,"15min":0.65800000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67700000000000005,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89500000000000002,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97699999999999998,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.98999999999999999}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.52200000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.099,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98499999999999999,"5min":1.448,"15min":1.448},"last":1.115}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.58299999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94099999999999995,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.079},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0449999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0920000000000001}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95999999999999996,"5min":1.554,"15min":1.554},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.84399999999999997,"15min":0.86199999999999999},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0760000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1539999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1257472,"data_stored":881536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64900000000000002,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.502},{"interface":"front","average":{"1min":0.441,"5min":0.57899999999999996,"15min":0.60199999999999998},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82999999999999996,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66600000000000004,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.59199999999999997,"15min":0.61199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":1.958,"15min":1.958},"last":0.61399999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.65800000000000003,"15min":0.67900000000000005},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.626}]},{"osd":4,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.81599999999999995,"15min":0.83999999999999997},"min":{"1min":0.51500000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80200000000000005,"5min":1.601,"15min":1.601},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.84199999999999997,"15min":0.86799999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93799999999999994,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.73199999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.83499999999999996,"15min":0.85699999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.92200000000000004,"5min":1.627,"15min":1.627},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.90100000000000002,"15min":0.93100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.94099999999999995,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.76600000000000001}]},{"osd":6,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.85899999999999999,"15min":0.88500000000000001},"min":{"1min":0.54400000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91700000000000004,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.83799999999999997,"15min":0.85799999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89300000000000002,"5min":1.421,"15min":1.421},"last":0.86699999999999999}]},{"osd":7,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.84499999999999997,"15min":0.86599999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91800000000000004,"5min":1.452,"15min":1.452},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.879,"15min":0.90500000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94599999999999995,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.75}]}]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.47699999999999998,"15min":0.49299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61399999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.71299999999999997,"15min":0.75700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65500000000000003,"5min":5.556,"15min":5.556},"last":0.442}]},{"osd":2,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.74099999999999999,"15min":0.78300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61099999999999999,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.64200000000000002,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.57299999999999995,"15min":0.59499999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65700000000000003,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.57799999999999996}]},{"osd":4,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.56899999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90900000000000003,"5min":1.925,"15min":1.925},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.626,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97599999999999998,"5min":1.512,"15min":1.512},"last":0.77700000000000002}]},{"osd":5,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0169999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.874},{"interface":"front","average":{"1min":0.755,"5min":0.83699999999999997,"15min":0.85099999999999998},"min":{"1min":0.66200000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.90900000000000003,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.60699999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.91800000000000004,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.621},{"interface":"front","average":{"1min":0.753,"5min":0.84299999999999997,"15min":0.85799999999999998},"min":{"1min":0.64400000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.96199999999999997,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.84899999999999998}]},{"osd":7,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.84999999999999998,"15min":0.86599999999999999},"min":{"1min":0.65400000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.84099999999999997,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0389999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.71399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1245184,"data_stored":875399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90000000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.502},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93899999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84099999999999997,"5min":0.872,"15min":0.872},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.42699999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.92600000000000005,"5min":1.012,"15min":1.012},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.55200000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93600000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.60499999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.871,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76200000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97099999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88500000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.83799999999999997}]},{"osd":4,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.86699999999999999}]},{"osd":6,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91000000000000003,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92000000000000004,"5min":1.107,"15min":1.107},"last":0.89000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:06:37.473 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:06:37.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f885c400640 1 Processor -- start 2024-01-24T13:06:37.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f885c400640 1 -- start start 2024-01-24T13:06:37.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f885c400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88540b2700 0x7f885406b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:37.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f885c400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885406cc10 con 0x7f88540ccdb0 2024-01-24T13:06:37.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f885c400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885406b7a0 con 0x7f885415c730 2024-01-24T13:06:37.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f885c400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885406ba80 con 0x7f88540b2700 2024-01-24T13:06:37.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f885a400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f88540ccdb0 0x7f88540d0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55084/0 (socket says 172.21.15.29:55084) 2024-01-24T13:06:37.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f885a400640 1 -- 172.21.15.29:0/1249981481 learned_addr learned my addr 172.21.15.29:0/1249981481 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:37.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f8859000640 1 --2- 172.21.15.29:0/1249981481 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88540b2700 0x7f885406b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:37.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f8853e00640 1 -- 172.21.15.29:0/1249981481 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733796871 0 0) 0x7f885406cc10 con 0x7f88540ccdb0 2024-01-24T13:06:37.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f8853e00640 1 -- 172.21.15.29:0/1249981481 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8834003530 con 0x7f88540ccdb0 2024-01-24T13:06:37.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f8853e00640 1 -- 172.21.15.29:0/1249981481 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411508409 0 0) 0x7f885406b7a0 con 0x7f885415c730 2024-01-24T13:06:37.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f8853e00640 1 -- 172.21.15.29:0/1249981481 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f885406cc10 con 0x7f885415c730 2024-01-24T13:06:37.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f8859000640 1 -- 172.21.15.29:0/1249981481 >> v1:172.21.15.163:6789/0 conn(0x7f885415c730 legacy=0x7f88540ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f8859000640 1 -- 172.21.15.29:0/1249981481 >> v1:172.21.15.29:6789/0 conn(0x7f88540ccdb0 legacy=0x7f88540d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.654+0000 7f8859000640 1 -- 172.21.15.29:0/1249981481 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885406bd60 con 0x7f88540b2700 2024-01-24T13:06:37.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.658+0000 7f8859000640 1 --2- 172.21.15.29:0/1249981481 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88540b2700 0x7f885406b110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f883c0097f0 tx=0x7f883c01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9ce9c014f9056a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:37.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.658+0000 7f8853e00640 1 -- 172.21.15.29:0/1249981481 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0ab600 con 0x7f88540b2700 2024-01-24T13:06:37.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.658+0000 7f8853e00640 1 -- 172.21.15.29:0/1249981481 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c0a7050 con 0x7f88540b2700 2024-01-24T13:06:37.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.658+0000 7f8853e00640 1 -- 172.21.15.29:0/1249981481 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0ab980 con 0x7f88540b2700 2024-01-24T13:06:37.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.658+0000 7f885c400640 1 -- 172.21.15.29:0/1249981481 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88540b2700 msgr2=0x7f885406b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.658+0000 7f885c400640 1 --2- 172.21.15.29:0/1249981481 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88540b2700 0x7f885406b110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f883c0097f0 tx=0x7f883c01c4c0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.658+0000 7f885c400640 1 -- 172.21.15.29:0/1249981481 shutdown_connections 2024-01-24T13:06:37.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.658+0000 7f885c400640 1 --2- 172.21.15.29:0/1249981481 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88540b2700 0x7f885406b110 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.658+0000 7f885c400640 1 -- 172.21.15.29:0/1249981481 >> 172.21.15.29:0/1249981481 conn(0x7f8854070570 msgr2=0x7f8854069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:37.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f885c400640 1 -- 172.21.15.29:0/1249981481 shutdown_connections 2024-01-24T13:06:37.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f885c400640 1 -- 172.21.15.29:0/1249981481 wait complete. 2024-01-24T13:06:37.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f885c400640 1 Processor -- start 2024-01-24T13:06:37.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f885c400640 1 -- start start 2024-01-24T13:06:37.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f885c400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88540b2700 0x7f88540c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:37.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f885c400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88540ccdb0 0x7f88540c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f885c400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f885415c730 0x7f885415acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f885c400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885415cf70 con 0x7f88540ccdb0 2024-01-24T13:06:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f885c400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88540c4ef0 con 0x7f885415c730 2024-01-24T13:06:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f885c400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885415d1a0 con 0x7f88540b2700 2024-01-24T13:06:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f8859000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88540ccdb0 0x7f88540c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f8859000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88540ccdb0 0x7f88540c3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:32874/0 (socket says 172.21.15.29:32874) 2024-01-24T13:06:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f8859000640 1 -- 172.21.15.29:0/809969119 learned_addr learned my addr 172.21.15.29:0/809969119 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f8859a00640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88540b2700 0x7f88540c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f885a400640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f885415c730 0x7f885415acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f8859000640 1 -- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88540b2700 msgr2=0x7f88540c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f8859000640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88540b2700 0x7f88540c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f8859000640 1 -- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f885415c730 msgr2=0x7f885415acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f8859000640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f885415c730 0x7f885415acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f8859000640 1 -- 172.21.15.29:0/809969119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c009420 con 0x7f88540ccdb0 2024-01-24T13:06:37.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.662+0000 7f8859a00640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88540b2700 0x7f88540c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.666+0000 7f8859000640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88540ccdb0 0x7f88540c3e00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f883c0190d0 tx=0x7f883c019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.666+0000 7f8851600640 1 -- 172.21.15.29:0/809969119 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0b4430 con 0x7f88540ccdb0 2024-01-24T13:06:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.666+0000 7f8851600640 1 -- 172.21.15.29:0/809969119 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c0b45b0 con 0x7f88540ccdb0 2024-01-24T13:06:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.666+0000 7f8851600640 1 -- 172.21.15.29:0/809969119 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0b4960 con 0x7f88540ccdb0 2024-01-24T13:06:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.666+0000 7f885c400640 1 -- 172.21.15.29:0/809969119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88540cd750 con 0x7f88540ccdb0 2024-01-24T13:06:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.666+0000 7f885c400640 1 -- 172.21.15.29:0/809969119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88540c4930 con 0x7f88540ccdb0 2024-01-24T13:06:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.666+0000 7f885c400640 1 -- 172.21.15.29:0/809969119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88540cf430 con 0x7f88540ccdb0 2024-01-24T13:06:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.666+0000 7f8851600640 1 -- 172.21.15.29:0/809969119 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f883c0b2040 con 0x7f88540ccdb0 2024-01-24T13:06:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.666+0000 7f8851600640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f882c065a60 0x7f882c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.666+0000 7f8851600640 1 -- 172.21.15.29:0/809969119 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f883c11d080 con 0x7f88540ccdb0 2024-01-24T13:06:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.666+0000 7f8859a00640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f882c065a60 0x7f882c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:37.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.670+0000 7f8859a00640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f882c065a60 0x7f882c067f20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f88440011f0 tx=0x7f8844009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:37.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.670+0000 7f8851600640 1 -- 172.21.15.29:0/809969119 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f883c0ea9a0 con 0x7f88540ccdb0 2024-01-24T13:06:37.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.826+0000 7f885c400640 1 -- 172.21.15.29:0/809969119 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88540cd5d0 con 0x7f882c065a60 2024-01-24T13:06:37.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.838+0000 7f8851600640 1 -- 172.21.15.29:0/809969119 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280770 (secure 0 0 0) 0x7f8844001cf0 con 0x7f882c065a60 2024-01-24T13:06:37.841 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:37.843 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:06:37.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.838+0000 7f885c400640 1 -- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f882c065a60 msgr2=0x7f882c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.838+0000 7f885c400640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f882c065a60 0x7f882c067f20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f88440011f0 tx=0x7f8844009040 comp rx=0 tx=0).stop 2024-01-24T13:06:37.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.838+0000 7f885c400640 1 -- 172.21.15.29:0/809969119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88540ccdb0 msgr2=0x7f88540c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:37.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.838+0000 7f885c400640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88540ccdb0 0x7f88540c3e00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f883c0190d0 tx=0x7f883c019260 comp rx=0 tx=0).stop 2024-01-24T13:06:37.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.838+0000 7f885c400640 1 -- 172.21.15.29:0/809969119 shutdown_connections 2024-01-24T13:06:37.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.838+0000 7f885c400640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f882c065a60 0x7f882c067f20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.838+0000 7f885c400640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f885415c730 0x7f885415acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.838+0000 7f885c400640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88540ccdb0 0x7f88540c3e00 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.838+0000 7f885c400640 1 --2- 172.21.15.29:0/809969119 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88540b2700 0x7f88540c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:37.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.838+0000 7f885c400640 1 -- 172.21.15.29:0/809969119 >> 172.21.15.29:0/809969119 conn(0x7f8854070570 msgr2=0x7f88540b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:37.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.838+0000 7f885c400640 1 -- 172.21.15.29:0/809969119 shutdown_connections 2024-01-24T13:06:37.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:37.838+0000 7f885c400640 1 -- 172.21.15.29:0/809969119 wait complete. 2024-01-24T13:06:37.863 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-01-24T13:06:37.576634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":88,"acting":88,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238936,"kb_used_data":6360,"kb_used_omap":13,"kb_used_meta":232434,"kb_avail":754735784,"statfs":{"total":773094113280,"available":772849442816,"internally_reserved":0,"allocated":6512640,"data_stored":3518150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":238012504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.618386"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375060+0000","last_change":"2024-01-24T13:06:33.406014+0000","last_active":"2024-01-24T13:06:34.375060+0000","last_peered":"2024-01-24T13:06:34.375060+0000","last_clean":"2024-01-24T13:06:34.375060+0000","last_became_active":"2024-01-24T13:06:33.405730+0000","last_became_peered":"2024-01-24T13:06:33.405730+0000","last_unstale":"2024-01-24T13:06:34.375060+0000","last_undegraded":"2024-01-24T13:06:34.375060+0000","last_fullsized":"2024-01-24T13:06:34.375060+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:27:37.923610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375822+0000","last_change":"2024-01-24T13:06:33.400907+0000","last_active":"2024-01-24T13:06:34.375822+0000","last_peered":"2024-01-24T13:06:34.375822+0000","last_clean":"2024-01-24T13:06:34.375822+0000","last_became_active":"2024-01-24T13:06:33.400591+0000","last_became_peered":"2024-01-24T13:06:33.400591+0000","last_unstale":"2024-01-24T13:06:34.375822+0000","last_undegraded":"2024-01-24T13:06:34.375822+0000","last_fullsized":"2024-01-24T13:06:34.375822+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:26:32.145531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375405+0000","last_change":"2024-01-24T13:06:33.392452+0000","last_active":"2024-01-24T13:06:34.375405+0000","last_peered":"2024-01-24T13:06:34.375405+0000","last_clean":"2024-01-24T13:06:34.375405+0000","last_became_active":"2024-01-24T13:06:33.392187+0000","last_became_peered":"2024-01-24T13:06:33.392187+0000","last_unstale":"2024-01-24T13:06:34.375405+0000","last_undegraded":"2024-01-24T13:06:34.375405+0000","last_fullsized":"2024-01-24T13:06:34.375405+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:23:21.241419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961098+0000","last_change":"2024-01-24T13:06:31.961098+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961098+0000","last_undegraded":"2024-01-24T13:06:31.961098+0000","last_fullsized":"2024-01-24T13:06:31.961098+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:03:08.159676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.967595+0000","last_change":"2024-01-24T13:06:31.967595+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.967595+0000","last_undegraded":"2024-01-24T13:06:31.967595+0000","last_fullsized":"2024-01-24T13:06:31.967595+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:40:00.227482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375599+0000","last_change":"2024-01-24T13:06:33.392163+0000","last_active":"2024-01-24T13:06:34.375599+0000","last_peered":"2024-01-24T13:06:34.375599+0000","last_clean":"2024-01-24T13:06:34.375599+0000","last_became_active":"2024-01-24T13:06:33.391881+0000","last_became_peered":"2024-01-24T13:06:33.391881+0000","last_unstale":"2024-01-24T13:06:34.375599+0000","last_undegraded":"2024-01-24T13:06:34.375599+0000","last_fullsized":"2024-01-24T13:06:34.375599+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:47.551144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960766+0000","last_change":"2024-01-24T13:06:31.960766+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960766+0000","last_undegraded":"2024-01-24T13:06:31.960766+0000","last_fullsized":"2024-01-24T13:06:31.960766+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:29:48.431683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964243+0000","last_change":"2024-01-24T13:06:31.964243+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964243+0000","last_undegraded":"2024-01-24T13:06:31.964243+0000","last_fullsized":"2024-01-24T13:06:31.964243+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:39:47.187887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375478+0000","last_change":"2024-01-24T13:06:33.404960+0000","last_active":"2024-01-24T13:06:34.375478+0000","last_peered":"2024-01-24T13:06:34.375478+0000","last_clean":"2024-01-24T13:06:34.375478+0000","last_became_active":"2024-01-24T13:06:33.404311+0000","last_became_peered":"2024-01-24T13:06:33.404311+0000","last_unstale":"2024-01-24T13:06:34.375478+0000","last_undegraded":"2024-01-24T13:06:34.375478+0000","last_fullsized":"2024-01-24T13:06:34.375478+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:26:49.633149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961108+0000","last_change":"2024-01-24T13:06:31.961108+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961108+0000","last_undegraded":"2024-01-24T13:06:31.961108+0000","last_fullsized":"2024-01-24T13:06:31.961108+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:38:05.514545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960766+0000","last_change":"2024-01-24T13:06:31.960766+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960766+0000","last_undegraded":"2024-01-24T13:06:31.960766+0000","last_fullsized":"2024-01-24T13:06:31.960766+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:53:06.966206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.965205+0000","last_change":"2024-01-24T13:06:31.965205+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.965205+0000","last_undegraded":"2024-01-24T13:06:31.965205+0000","last_fullsized":"2024-01-24T13:06:31.965205+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.958565+0000","last_change":"2024-01-24T13:06:31.958565+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.958565+0000","last_undegraded":"2024-01-24T13:06:31.958565+0000","last_fullsized":"2024-01-24T13:06:31.958565+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:44:14.249644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.965190+0000","last_change":"2024-01-24T13:06:31.965190+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.965190+0000","last_undegraded":"2024-01-24T13:06:31.965190+0000","last_fullsized":"2024-01-24T13:06:31.965190+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375785+0000","last_change":"2024-01-24T13:06:32.985695+0000","last_active":"2024-01-24T13:06:34.375785+0000","last_peered":"2024-01-24T13:06:34.375785+0000","last_clean":"2024-01-24T13:06:34.375785+0000","last_became_active":"2024-01-24T13:06:32.985403+0000","last_became_peered":"2024-01-24T13:06:32.985403+0000","last_unstale":"2024-01-24T13:06:34.375785+0000","last_undegraded":"2024-01-24T13:06:34.375785+0000","last_fullsized":"2024-01-24T13:06:34.375785+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:11:33.948670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375718+0000","last_change":"2024-01-24T13:06:33.391836+0000","last_active":"2024-01-24T13:06:34.375718+0000","last_peered":"2024-01-24T13:06:34.375718+0000","last_clean":"2024-01-24T13:06:34.375718+0000","last_became_active":"2024-01-24T13:06:33.391363+0000","last_became_peered":"2024-01-24T13:06:33.391363+0000","last_unstale":"2024-01-24T13:06:34.375718+0000","last_undegraded":"2024-01-24T13:06:34.375718+0000","last_fullsized":"2024-01-24T13:06:34.375718+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:04:35.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964396+0000","last_change":"2024-01-24T13:06:31.964396+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964396+0000","last_undegraded":"2024-01-24T13:06:31.964396+0000","last_fullsized":"2024-01-24T13:06:31.964396+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:13:10.025823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.958729+0000","last_change":"2024-01-24T13:06:31.958729+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.958729+0000","last_undegraded":"2024-01-24T13:06:31.958729+0000","last_fullsized":"2024-01-24T13:06:31.958729+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375598+0000","last_change":"2024-01-24T13:06:32.981791+0000","last_active":"2024-01-24T13:06:34.375598+0000","last_peered":"2024-01-24T13:06:34.375598+0000","last_clean":"2024-01-24T13:06:34.375598+0000","last_became_active":"2024-01-24T13:06:32.981523+0000","last_became_peered":"2024-01-24T13:06:32.981523+0000","last_unstale":"2024-01-24T13:06:34.375598+0000","last_undegraded":"2024-01-24T13:06:34.375598+0000","last_fullsized":"2024-01-24T13:06:34.375598+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:46:44.914023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964375+0000","last_change":"2024-01-24T13:06:31.964375+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964375+0000","last_undegraded":"2024-01-24T13:06:31.964375+0000","last_fullsized":"2024-01-24T13:06:31.964375+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:17:48.959635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964339+0000","last_change":"2024-01-24T13:06:31.964339+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964339+0000","last_undegraded":"2024-01-24T13:06:31.964339+0000","last_fullsized":"2024-01-24T13:06:31.964339+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:03:45.497890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964325+0000","last_change":"2024-01-24T13:06:31.964325+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964325+0000","last_undegraded":"2024-01-24T13:06:31.964325+0000","last_fullsized":"2024-01-24T13:06:31.964325+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:49:10.726348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.968112+0000","last_change":"2024-01-24T13:06:31.968112+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.968112+0000","last_undegraded":"2024-01-24T13:06:31.968112+0000","last_fullsized":"2024-01-24T13:06:31.968112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375884+0000","last_change":"2024-01-24T13:06:32.982486+0000","last_active":"2024-01-24T13:06:34.375884+0000","last_peered":"2024-01-24T13:06:34.375884+0000","last_clean":"2024-01-24T13:06:34.375884+0000","last_became_active":"2024-01-24T13:06:32.982212+0000","last_became_peered":"2024-01-24T13:06:32.982212+0000","last_unstale":"2024-01-24T13:06:34.375884+0000","last_undegraded":"2024-01-24T13:06:34.375884+0000","last_fullsized":"2024-01-24T13:06:34.375884+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:53:18.968759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961076+0000","last_change":"2024-01-24T13:06:31.961076+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961076+0000","last_undegraded":"2024-01-24T13:06:31.961076+0000","last_fullsized":"2024-01-24T13:06:31.961076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:36:01.523707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375906+0000","last_change":"2024-01-24T13:06:32.985653+0000","last_active":"2024-01-24T13:06:34.375906+0000","last_peered":"2024-01-24T13:06:34.375906+0000","last_clean":"2024-01-24T13:06:34.375906+0000","last_became_active":"2024-01-24T13:06:32.985358+0000","last_became_peered":"2024-01-24T13:06:32.985358+0000","last_unstale":"2024-01-24T13:06:34.375906+0000","last_undegraded":"2024-01-24T13:06:34.375906+0000","last_fullsized":"2024-01-24T13:06:34.375906+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:32:32.585192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960798+0000","last_change":"2024-01-24T13:06:31.960798+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960798+0000","last_undegraded":"2024-01-24T13:06:31.960798+0000","last_fullsized":"2024-01-24T13:06:31.960798+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:24:45.430111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375502+0000","last_change":"2024-01-24T13:06:33.404938+0000","last_active":"2024-01-24T13:06:34.375502+0000","last_peered":"2024-01-24T13:06:34.375502+0000","last_clean":"2024-01-24T13:06:34.375502+0000","last_became_active":"2024-01-24T13:06:33.404554+0000","last_became_peered":"2024-01-24T13:06:33.404554+0000","last_unstale":"2024-01-24T13:06:34.375502+0000","last_undegraded":"2024-01-24T13:06:34.375502+0000","last_fullsized":"2024-01-24T13:06:34.375502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:14:22.773502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375855+0000","last_change":"2024-01-24T13:06:32.976649+0000","last_active":"2024-01-24T13:06:34.375855+0000","last_peered":"2024-01-24T13:06:34.375855+0000","last_clean":"2024-01-24T13:06:34.375855+0000","last_became_active":"2024-01-24T13:06:32.976204+0000","last_became_peered":"2024-01-24T13:06:32.976204+0000","last_unstale":"2024-01-24T13:06:34.375855+0000","last_undegraded":"2024-01-24T13:06:34.375855+0000","last_fullsized":"2024-01-24T13:06:34.375855+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:50.783109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375805+0000","last_change":"2024-01-24T13:06:33.400926+0000","last_active":"2024-01-24T13:06:34.375805+0000","last_peered":"2024-01-24T13:06:34.375805+0000","last_clean":"2024-01-24T13:06:34.375805+0000","last_became_active":"2024-01-24T13:06:33.400651+0000","last_became_peered":"2024-01-24T13:06:33.400651+0000","last_unstale":"2024-01-24T13:06:34.375805+0000","last_undegraded":"2024-01-24T13:06:34.375805+0000","last_fullsized":"2024-01-24T13:06:34.375805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:38:46.742749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.965834+0000","last_change":"2024-01-24T13:06:31.965834+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.965834+0000","last_undegraded":"2024-01-24T13:06:31.965834+0000","last_fullsized":"2024-01-24T13:06:31.965834+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:40:00.227482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.967562+0000","last_change":"2024-01-24T13:06:31.967562+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.967562+0000","last_undegraded":"2024-01-24T13:06:31.967562+0000","last_fullsized":"2024-01-24T13:06:31.967562+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960886+0000","last_change":"2024-01-24T13:06:31.960886+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960886+0000","last_undegraded":"2024-01-24T13:06:31.960886+0000","last_fullsized":"2024-01-24T13:06:31.960886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:16:21.150556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.966302+0000","last_change":"2024-01-24T13:06:31.966302+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.966302+0000","last_undegraded":"2024-01-24T13:06:31.966302+0000","last_fullsized":"2024-01-24T13:06:31.966302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:00:19.578573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.376028+0000","last_change":"2024-01-24T13:06:33.400864+0000","last_active":"2024-01-24T13:06:34.376028+0000","last_peered":"2024-01-24T13:06:34.376028+0000","last_clean":"2024-01-24T13:06:34.376028+0000","last_became_active":"2024-01-24T13:06:33.400583+0000","last_became_peered":"2024-01-24T13:06:33.400583+0000","last_unstale":"2024-01-24T13:06:34.376028+0000","last_undegraded":"2024-01-24T13:06:34.376028+0000","last_fullsized":"2024-01-24T13:06:34.376028+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:35.231436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961108+0000","last_change":"2024-01-24T13:06:31.961108+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961108+0000","last_undegraded":"2024-01-24T13:06:31.961108+0000","last_fullsized":"2024-01-24T13:06:31.961108+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:23:53.805299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.967621+0000","last_change":"2024-01-24T13:06:31.967621+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.967621+0000","last_undegraded":"2024-01-24T13:06:31.967621+0000","last_fullsized":"2024-01-24T13:06:31.967621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:00:19.578573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961089+0000","last_change":"2024-01-24T13:06:31.961089+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961089+0000","last_undegraded":"2024-01-24T13:06:31.961089+0000","last_fullsized":"2024-01-24T13:06:31.961089+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:07.082513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375158+0000","last_change":"2024-01-24T13:06:33.393627+0000","last_active":"2024-01-24T13:06:34.375158+0000","last_peered":"2024-01-24T13:06:34.375158+0000","last_clean":"2024-01-24T13:06:34.375158+0000","last_became_active":"2024-01-24T13:06:33.393249+0000","last_became_peered":"2024-01-24T13:06:33.393249+0000","last_unstale":"2024-01-24T13:06:34.375158+0000","last_undegraded":"2024-01-24T13:06:34.375158+0000","last_fullsized":"2024-01-24T13:06:34.375158+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:26:43.515702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960698+0000","last_change":"2024-01-24T13:06:31.960698+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960698+0000","last_undegraded":"2024-01-24T13:06:31.960698+0000","last_fullsized":"2024-01-24T13:06:31.960698+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:35:10.934452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375242+0000","last_change":"2024-01-24T13:06:32.978254+0000","last_active":"2024-01-24T13:06:34.375242+0000","last_peered":"2024-01-24T13:06:34.375242+0000","last_clean":"2024-01-24T13:06:34.375242+0000","last_became_active":"2024-01-24T13:06:32.977940+0000","last_became_peered":"2024-01-24T13:06:32.977940+0000","last_unstale":"2024-01-24T13:06:34.375242+0000","last_undegraded":"2024-01-24T13:06:34.375242+0000","last_fullsized":"2024-01-24T13:06:34.375242+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:27:03.333403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375333+0000","last_change":"2024-01-24T13:06:33.403559+0000","last_active":"2024-01-24T13:06:34.375333+0000","last_peered":"2024-01-24T13:06:34.375333+0000","last_clean":"2024-01-24T13:06:34.375333+0000","last_became_active":"2024-01-24T13:06:33.403199+0000","last_became_peered":"2024-01-24T13:06:33.403199+0000","last_unstale":"2024-01-24T13:06:34.375333+0000","last_undegraded":"2024-01-24T13:06:34.375333+0000","last_fullsized":"2024-01-24T13:06:34.375333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:10:40.996705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.958648+0000","last_change":"2024-01-24T13:06:31.958648+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.958648+0000","last_undegraded":"2024-01-24T13:06:31.958648+0000","last_fullsized":"2024-01-24T13:06:31.958648+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":192,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-24T13:06:30.231173+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:06:30.231173+0000","last_peered":"2024-01-24T13:06:30.231173+0000","last_clean":"2024-01-24T13:06:30.231173+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:06:30.231173+0000","last_undegraded":"2024-01-24T13:06:30.231173+0000","last_fullsized":"2024-01-24T13:06:30.231173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":285031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.47099999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83799999999999997,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79800000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.61499999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.53800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92700000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.745,"15min":0.755},"min":{"1min":0.56599999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84399999999999997,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.56000000000000005}]},{"osd":3,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.61299999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.89700000000000002,"5min":1.131,"15min":1.131},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.93999999999999995,"5min":1.05,"15min":1.05},"last":0.67500000000000004}]},{"osd":4,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63400000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77300000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.873,"5min":1.341,"15min":1.341},"last":0.746}]},{"osd":5,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89600000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92400000000000004,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54300000000000004}]},{"osd":6,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96599999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91200000000000003,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.60599999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.46600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91500000000000004,"5min":2.827,"15min":2.827},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81000000000000005,"5min":2.052,"15min":2.052},"last":0.72399999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.72299999999999998,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86699999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.92300000000000004,"15min":0.97099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.74099999999999999,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.77200000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.85199999999999998,"15min":0.88600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.83899999999999997,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.94299999999999995,"15min":0.98499999999999999},"min":{"1min":0.54200000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.83999999999999997,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.93999999999999995}]},{"osd":3,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.91700000000000004,"15min":0.95899999999999996},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80600000000000005,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.82199999999999995,"15min":0.84699999999999998},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.85099999999999998,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90300000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.80200000000000005}]},{"osd":5,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.47899999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84699999999999998,"5min":4.274,"15min":4.274},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.81200000000000006,"15min":0.82199999999999995},"min":{"1min":0.63,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88800000000000001,"5min":2.645,"15min":2.645},"last":0.69899999999999995}]},{"osd":7,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.84499999999999997,"15min":0.873},"min":{"1min":0.50900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86699999999999999,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.86199999999999999,"15min":0.88600000000000001},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.92400000000000004,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.628}]}]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63900000000000001,"15min":0.63300000000000001},"min":{"1min":0.47599999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.79500000000000004}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98399999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.014,"5min":1.484,"15min":1.484},"last":0.77800000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68200000000000005,"15min":0.67400000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.878},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.66500000000000004}]},{"osd":3,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.51400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58199999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.629},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.97999999999999998,"5min":1.002,"15min":1.002},"last":0.60399999999999998}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.499,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.54200000000000004}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70299999999999996,"15min":0.69999999999999996},"min":{"1min":0.55500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.59699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95299999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75900000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":651264,"data_stored":285031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.433,"15min":0.44500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53100000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.495},{"interface":"front","average":{"1min":0.443,"5min":0.46300000000000002,"15min":0.46600000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.58199999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.40400000000000003}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46600000000000003,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55300000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68200000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.59899999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.435},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60599999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45300000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.75,"15min":0.76500000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.91500000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78500000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.86299999999999999,"5min":1.014,"15min":1.014},"last":0.81799999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88300000000000001,"5min":1.032,"15min":1.032},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72699999999999998}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79600000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.90500000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.82499999999999996,"15min":0.84499999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.89400000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.83199999999999996,"15min":0.85099999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.875,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":0.85899999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.752}]}]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.46700000000000003,"15min":0.48399999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54300000000000004,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91900000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52400000000000002}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.53100000000000003,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64100000000000001,"5min":1.379,"15min":1.379},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.374,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88700000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.60899999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.63400000000000001,"15min":0.65800000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67700000000000005,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89500000000000002,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97699999999999998,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.98999999999999999}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.52200000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.099,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98499999999999999,"5min":1.448,"15min":1.448},"last":1.115}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.58299999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94099999999999995,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.079},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0449999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0920000000000001}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95999999999999996,"5min":1.554,"15min":1.554},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.84399999999999997,"15min":0.86199999999999999},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0760000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1539999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1257472,"data_stored":881536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64900000000000002,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.502},{"interface":"front","average":{"1min":0.441,"5min":0.57899999999999996,"15min":0.60199999999999998},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82999999999999996,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66600000000000004,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.59199999999999997,"15min":0.61199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":1.958,"15min":1.958},"last":0.61399999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.65800000000000003,"15min":0.67900000000000005},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.626}]},{"osd":4,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.81599999999999995,"15min":0.83999999999999997},"min":{"1min":0.51500000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80200000000000005,"5min":1.601,"15min":1.601},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.84199999999999997,"15min":0.86799999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93799999999999994,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.73199999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.83499999999999996,"15min":0.85699999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.92200000000000004,"5min":1.627,"15min":1.627},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.90100000000000002,"15min":0.93100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.94099999999999995,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.76600000000000001}]},{"osd":6,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.85899999999999999,"15min":0.88500000000000001},"min":{"1min":0.54400000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91700000000000004,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.83799999999999997,"15min":0.85799999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89300000000000002,"5min":1.421,"15min":1.421},"last":0.86699999999999999}]},{"osd":7,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.84499999999999997,"15min":0.86599999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91800000000000004,"5min":1.452,"15min":1.452},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.879,"15min":0.90500000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94599999999999995,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.75}]}]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.47699999999999998,"15min":0.49299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61399999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.71299999999999997,"15min":0.75700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65500000000000003,"5min":5.556,"15min":5.556},"last":0.442}]},{"osd":2,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.74099999999999999,"15min":0.78300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61099999999999999,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.64200000000000002,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.57299999999999995,"15min":0.59499999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65700000000000003,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.57799999999999996}]},{"osd":4,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.56899999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90900000000000003,"5min":1.925,"15min":1.925},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.626,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97599999999999998,"5min":1.512,"15min":1.512},"last":0.77700000000000002}]},{"osd":5,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0169999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.874},{"interface":"front","average":{"1min":0.755,"5min":0.83699999999999997,"15min":0.85099999999999998},"min":{"1min":0.66200000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.90900000000000003,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.60699999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.91800000000000004,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.621},{"interface":"front","average":{"1min":0.753,"5min":0.84299999999999997,"15min":0.85799999999999998},"min":{"1min":0.64400000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.96199999999999997,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.84899999999999998}]},{"osd":7,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.84999999999999998,"15min":0.86599999999999999},"min":{"1min":0.65400000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.84099999999999997,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0389999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.71399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1298432,"data_stored":901880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90000000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93899999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.67000000000000004}]},{"osd":1,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84099999999999997,"5min":0.872,"15min":0.872},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.42699999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.92600000000000005,"5min":1.012,"15min":1.012},"last":0.74099999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.55200000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93600000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.60499999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.871,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.75700000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97099999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88500000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91000000000000003,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92000000000000004,"5min":1.107,"15min":1.107},"last":0.81499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:06:37.868 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:06:38.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.046+0000 7f0639200640 1 Processor -- start 2024-01-24T13:06:38.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.046+0000 7f0639200640 1 -- start start 2024-01-24T13:06:38.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.050+0000 7f0639200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f063406bc10 0x7f063406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.050+0000 7f0639200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f063415cf50 0x7f063415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.050+0000 7f0639200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063415de10 con 0x7f0634159300 2024-01-24T13:06:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.050+0000 7f0639200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0634071140 con 0x7f063406bc10 2024-01-24T13:06:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.050+0000 7f0639200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063406c5e0 con 0x7f063415cf50 2024-01-24T13:06:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.050+0000 7f0631400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f063406bc10 0x7f063406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.050+0000 7f0631400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f063406bc10 0x7f063406c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:32880/0 (socket says 172.21.15.29:32880) 2024-01-24T13:06:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.050+0000 7f0631400640 1 -- 172.21.15.29:0/763221129 learned_addr learned my addr 172.21.15.29:0/763221129 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.050+0000 7f0632800640 1 --2- 172.21.15.29:0/763221129 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f063415cf50 0x7f063415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.050+0000 7f0631400640 1 -- 172.21.15.29:0/763221129 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f063415cf50 msgr2=0x7f063415d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.050+0000 7f0631400640 1 --2- 172.21.15.29:0/763221129 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f063415cf50 0x7f063415d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.050+0000 7f0631400640 1 -- 172.21.15.29:0/763221129 >> v1:172.21.15.163:6789/0 conn(0x7f0634159300 legacy=0x7f06340b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.050+0000 7f0631400640 1 -- 172.21.15.29:0/763221129 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063415db30 con 0x7f063406bc10 2024-01-24T13:06:38.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.054+0000 7f0631400640 1 --2- 172.21.15.29:0/763221129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f063406bc10 0x7f063406c0a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f061c009870 tx=0x7f061c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51fd7c846a49c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:38.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.054+0000 7f0630a00640 1 -- 172.21.15.29:0/763221129 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c0ac600 con 0x7f063406bc10 2024-01-24T13:06:38.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.054+0000 7f0630a00640 1 -- 172.21.15.29:0/763221129 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c0a8050 con 0x7f063406bc10 2024-01-24T13:06:38.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.054+0000 7f0630a00640 1 -- 172.21.15.29:0/763221129 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c0ac980 con 0x7f063406bc10 2024-01-24T13:06:38.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.054+0000 7f0639200640 1 -- 172.21.15.29:0/763221129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f063406bc10 msgr2=0x7f063406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.054+0000 7f0639200640 1 --2- 172.21.15.29:0/763221129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f063406bc10 0x7f063406c0a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f061c009870 tx=0x7f061c01c4b0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.054+0000 7f0639200640 1 -- 172.21.15.29:0/763221129 shutdown_connections 2024-01-24T13:06:38.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.054+0000 7f0639200640 1 --2- 172.21.15.29:0/763221129 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f063415cf50 0x7f063415d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.054+0000 7f0639200640 1 --2- 172.21.15.29:0/763221129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f063406bc10 0x7f063406c0a0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.054+0000 7f0639200640 1 -- 172.21.15.29:0/763221129 >> 172.21.15.29:0/763221129 conn(0x7f06340b3950 msgr2=0x7f0634069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:38.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.054+0000 7f0639200640 1 -- 172.21.15.29:0/763221129 shutdown_connections 2024-01-24T13:06:38.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.054+0000 7f0639200640 1 -- 172.21.15.29:0/763221129 wait complete. 2024-01-24T13:06:38.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.054+0000 7f0639200640 1 Processor -- start 2024-01-24T13:06:38.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.054+0000 7f0639200640 1 -- start start 2024-01-24T13:06:38.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0639200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f063406bc10 0x7f063415ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0639200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0634159300 0x7f06340ce560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0639200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f063415cf50 0x7f06341f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0639200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063413e270 con 0x7f0634159300 2024-01-24T13:06:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0639200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0634158910 con 0x7f063406bc10 2024-01-24T13:06:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0639200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063413d5f0 con 0x7f063415cf50 2024-01-24T13:06:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0631400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0634159300 0x7f06340ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0631400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0634159300 0x7f06340ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:32886/0 (socket says 172.21.15.29:32886) 2024-01-24T13:06:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0631400640 1 -- 172.21.15.29:0/560993242 learned_addr learned my addr 172.21.15.29:0/560993242 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0631e00640 1 --2- 172.21.15.29:0/560993242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f063406bc10 0x7f063415ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0632800640 1 --2- 172.21.15.29:0/560993242 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f063415cf50 0x7f06341f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0631400640 1 -- 172.21.15.29:0/560993242 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f063415cf50 msgr2=0x7f06341f3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0631400640 1 --2- 172.21.15.29:0/560993242 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f063415cf50 0x7f06341f3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0631400640 1 -- 172.21.15.29:0/560993242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f063406bc10 msgr2=0x7f063415ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0631400640 1 --2- 172.21.15.29:0/560993242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f063406bc10 0x7f063415ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0631400640 1 -- 172.21.15.29:0/560993242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c0094d0 con 0x7f0634159300 2024-01-24T13:06:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0631400640 1 --2- 172.21.15.29:0/560993242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0634159300 0x7f06340ce560 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f061c01a0e0 tx=0x7f061c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f062a000640 1 -- 172.21.15.29:0/560993242 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c0b7650 con 0x7f0634159300 2024-01-24T13:06:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f062a000640 1 -- 172.21.15.29:0/560993242 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c0b77b0 con 0x7f0634159300 2024-01-24T13:06:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f062a000640 1 -- 172.21.15.29:0/560993242 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c0b7b20 con 0x7f0634159300 2024-01-24T13:06:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0639200640 1 -- 172.21.15.29:0/560993242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063413d8d0 con 0x7f0634159300 2024-01-24T13:06:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0639200640 1 -- 172.21.15.29:0/560993242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063413de90 con 0x7f0634159300 2024-01-24T13:06:38.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.058+0000 7f0639200640 1 -- 172.21.15.29:0/560993242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063413e3b0 con 0x7f0634159300 2024-01-24T13:06:38.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.062+0000 7f062a000640 1 -- 172.21.15.29:0/560993242 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f061c0b3070 con 0x7f0634159300 2024-01-24T13:06:38.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.062+0000 7f062a000640 1 --2- 172.21.15.29:0/560993242 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f060c065a60 0x7f060c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.062+0000 7f062a000640 1 -- 172.21.15.29:0/560993242 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f061c11d8d0 con 0x7f0634159300 2024-01-24T13:06:38.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.062+0000 7f0631e00640 1 --2- 172.21.15.29:0/560993242 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f060c065a60 0x7f060c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.062+0000 7f0631e00640 1 --2- 172.21.15.29:0/560993242 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f060c065a60 0x7f060c067f20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0624007fd0 tx=0x7f0624009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:38.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.066+0000 7f062a000640 1 -- 172.21.15.29:0/560993242 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f063413e3b0 con 0x7f0634159300 2024-01-24T13:06:38.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.218+0000 7f0639200640 1 -- 172.21.15.29:0/560993242 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06341596e0 con 0x7f060c065a60 2024-01-24T13:06:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.230+0000 7f062a000640 1 -- 172.21.15.29:0/560993242 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280770 (secure 0 0 0) 0x7f06240014f0 con 0x7f060c065a60 2024-01-24T13:06:38.233 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:38.235 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:06:38.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.230+0000 7f0639200640 1 -- 172.21.15.29:0/560993242 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f060c065a60 msgr2=0x7f060c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.230+0000 7f0639200640 1 --2- 172.21.15.29:0/560993242 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f060c065a60 0x7f060c067f20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0624007fd0 tx=0x7f0624009040 comp rx=0 tx=0).stop 2024-01-24T13:06:38.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.230+0000 7f0639200640 1 -- 172.21.15.29:0/560993242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0634159300 msgr2=0x7f06340ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.230+0000 7f0639200640 1 --2- 172.21.15.29:0/560993242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0634159300 0x7f06340ce560 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f061c01a0e0 tx=0x7f061c01acf0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.230+0000 7f0639200640 1 -- 172.21.15.29:0/560993242 shutdown_connections 2024-01-24T13:06:38.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.230+0000 7f0639200640 1 --2- 172.21.15.29:0/560993242 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f060c065a60 0x7f060c067f20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.230+0000 7f0639200640 1 --2- 172.21.15.29:0/560993242 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f063415cf50 0x7f06341f3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.230+0000 7f0639200640 1 --2- 172.21.15.29:0/560993242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0634159300 0x7f06340ce560 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.230+0000 7f0639200640 1 --2- 172.21.15.29:0/560993242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f063406bc10 0x7f063415ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.230+0000 7f0639200640 1 -- 172.21.15.29:0/560993242 >> 172.21.15.29:0/560993242 conn(0x7f06340b3950 msgr2=0x7f063406fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:38.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.230+0000 7f0639200640 1 -- 172.21.15.29:0/560993242 shutdown_connections 2024-01-24T13:06:38.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.230+0000 7f0639200640 1 -- 172.21.15.29:0/560993242 wait complete. 2024-01-24T13:06:38.254 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-01-24T13:06:37.576634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":88,"acting":88,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238936,"kb_used_data":6360,"kb_used_omap":13,"kb_used_meta":232434,"kb_avail":754735784,"statfs":{"total":773094113280,"available":772849442816,"internally_reserved":0,"allocated":6512640,"data_stored":3518150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":238012504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.618386"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375060+0000","last_change":"2024-01-24T13:06:33.406014+0000","last_active":"2024-01-24T13:06:34.375060+0000","last_peered":"2024-01-24T13:06:34.375060+0000","last_clean":"2024-01-24T13:06:34.375060+0000","last_became_active":"2024-01-24T13:06:33.405730+0000","last_became_peered":"2024-01-24T13:06:33.405730+0000","last_unstale":"2024-01-24T13:06:34.375060+0000","last_undegraded":"2024-01-24T13:06:34.375060+0000","last_fullsized":"2024-01-24T13:06:34.375060+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:27:37.923610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375822+0000","last_change":"2024-01-24T13:06:33.400907+0000","last_active":"2024-01-24T13:06:34.375822+0000","last_peered":"2024-01-24T13:06:34.375822+0000","last_clean":"2024-01-24T13:06:34.375822+0000","last_became_active":"2024-01-24T13:06:33.400591+0000","last_became_peered":"2024-01-24T13:06:33.400591+0000","last_unstale":"2024-01-24T13:06:34.375822+0000","last_undegraded":"2024-01-24T13:06:34.375822+0000","last_fullsized":"2024-01-24T13:06:34.375822+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:26:32.145531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375405+0000","last_change":"2024-01-24T13:06:33.392452+0000","last_active":"2024-01-24T13:06:34.375405+0000","last_peered":"2024-01-24T13:06:34.375405+0000","last_clean":"2024-01-24T13:06:34.375405+0000","last_became_active":"2024-01-24T13:06:33.392187+0000","last_became_peered":"2024-01-24T13:06:33.392187+0000","last_unstale":"2024-01-24T13:06:34.375405+0000","last_undegraded":"2024-01-24T13:06:34.375405+0000","last_fullsized":"2024-01-24T13:06:34.375405+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:23:21.241419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961098+0000","last_change":"2024-01-24T13:06:31.961098+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961098+0000","last_undegraded":"2024-01-24T13:06:31.961098+0000","last_fullsized":"2024-01-24T13:06:31.961098+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:03:08.159676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.967595+0000","last_change":"2024-01-24T13:06:31.967595+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.967595+0000","last_undegraded":"2024-01-24T13:06:31.967595+0000","last_fullsized":"2024-01-24T13:06:31.967595+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:40:00.227482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375599+0000","last_change":"2024-01-24T13:06:33.392163+0000","last_active":"2024-01-24T13:06:34.375599+0000","last_peered":"2024-01-24T13:06:34.375599+0000","last_clean":"2024-01-24T13:06:34.375599+0000","last_became_active":"2024-01-24T13:06:33.391881+0000","last_became_peered":"2024-01-24T13:06:33.391881+0000","last_unstale":"2024-01-24T13:06:34.375599+0000","last_undegraded":"2024-01-24T13:06:34.375599+0000","last_fullsized":"2024-01-24T13:06:34.375599+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:47.551144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960766+0000","last_change":"2024-01-24T13:06:31.960766+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960766+0000","last_undegraded":"2024-01-24T13:06:31.960766+0000","last_fullsized":"2024-01-24T13:06:31.960766+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:29:48.431683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964243+0000","last_change":"2024-01-24T13:06:31.964243+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964243+0000","last_undegraded":"2024-01-24T13:06:31.964243+0000","last_fullsized":"2024-01-24T13:06:31.964243+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:39:47.187887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375478+0000","last_change":"2024-01-24T13:06:33.404960+0000","last_active":"2024-01-24T13:06:34.375478+0000","last_peered":"2024-01-24T13:06:34.375478+0000","last_clean":"2024-01-24T13:06:34.375478+0000","last_became_active":"2024-01-24T13:06:33.404311+0000","last_became_peered":"2024-01-24T13:06:33.404311+0000","last_unstale":"2024-01-24T13:06:34.375478+0000","last_undegraded":"2024-01-24T13:06:34.375478+0000","last_fullsized":"2024-01-24T13:06:34.375478+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:26:49.633149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961108+0000","last_change":"2024-01-24T13:06:31.961108+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961108+0000","last_undegraded":"2024-01-24T13:06:31.961108+0000","last_fullsized":"2024-01-24T13:06:31.961108+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:38:05.514545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960766+0000","last_change":"2024-01-24T13:06:31.960766+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960766+0000","last_undegraded":"2024-01-24T13:06:31.960766+0000","last_fullsized":"2024-01-24T13:06:31.960766+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:53:06.966206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.965205+0000","last_change":"2024-01-24T13:06:31.965205+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.965205+0000","last_undegraded":"2024-01-24T13:06:31.965205+0000","last_fullsized":"2024-01-24T13:06:31.965205+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.958565+0000","last_change":"2024-01-24T13:06:31.958565+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.958565+0000","last_undegraded":"2024-01-24T13:06:31.958565+0000","last_fullsized":"2024-01-24T13:06:31.958565+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:44:14.249644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.965190+0000","last_change":"2024-01-24T13:06:31.965190+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.965190+0000","last_undegraded":"2024-01-24T13:06:31.965190+0000","last_fullsized":"2024-01-24T13:06:31.965190+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375785+0000","last_change":"2024-01-24T13:06:32.985695+0000","last_active":"2024-01-24T13:06:34.375785+0000","last_peered":"2024-01-24T13:06:34.375785+0000","last_clean":"2024-01-24T13:06:34.375785+0000","last_became_active":"2024-01-24T13:06:32.985403+0000","last_became_peered":"2024-01-24T13:06:32.985403+0000","last_unstale":"2024-01-24T13:06:34.375785+0000","last_undegraded":"2024-01-24T13:06:34.375785+0000","last_fullsized":"2024-01-24T13:06:34.375785+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:11:33.948670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375718+0000","last_change":"2024-01-24T13:06:33.391836+0000","last_active":"2024-01-24T13:06:34.375718+0000","last_peered":"2024-01-24T13:06:34.375718+0000","last_clean":"2024-01-24T13:06:34.375718+0000","last_became_active":"2024-01-24T13:06:33.391363+0000","last_became_peered":"2024-01-24T13:06:33.391363+0000","last_unstale":"2024-01-24T13:06:34.375718+0000","last_undegraded":"2024-01-24T13:06:34.375718+0000","last_fullsized":"2024-01-24T13:06:34.375718+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:04:35.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964396+0000","last_change":"2024-01-24T13:06:31.964396+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964396+0000","last_undegraded":"2024-01-24T13:06:31.964396+0000","last_fullsized":"2024-01-24T13:06:31.964396+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:13:10.025823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.958729+0000","last_change":"2024-01-24T13:06:31.958729+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.958729+0000","last_undegraded":"2024-01-24T13:06:31.958729+0000","last_fullsized":"2024-01-24T13:06:31.958729+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375598+0000","last_change":"2024-01-24T13:06:32.981791+0000","last_active":"2024-01-24T13:06:34.375598+0000","last_peered":"2024-01-24T13:06:34.375598+0000","last_clean":"2024-01-24T13:06:34.375598+0000","last_became_active":"2024-01-24T13:06:32.981523+0000","last_became_peered":"2024-01-24T13:06:32.981523+0000","last_unstale":"2024-01-24T13:06:34.375598+0000","last_undegraded":"2024-01-24T13:06:34.375598+0000","last_fullsized":"2024-01-24T13:06:34.375598+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:46:44.914023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964375+0000","last_change":"2024-01-24T13:06:31.964375+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964375+0000","last_undegraded":"2024-01-24T13:06:31.964375+0000","last_fullsized":"2024-01-24T13:06:31.964375+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:17:48.959635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964339+0000","last_change":"2024-01-24T13:06:31.964339+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964339+0000","last_undegraded":"2024-01-24T13:06:31.964339+0000","last_fullsized":"2024-01-24T13:06:31.964339+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:03:45.497890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964325+0000","last_change":"2024-01-24T13:06:31.964325+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964325+0000","last_undegraded":"2024-01-24T13:06:31.964325+0000","last_fullsized":"2024-01-24T13:06:31.964325+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:49:10.726348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.968112+0000","last_change":"2024-01-24T13:06:31.968112+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.968112+0000","last_undegraded":"2024-01-24T13:06:31.968112+0000","last_fullsized":"2024-01-24T13:06:31.968112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375884+0000","last_change":"2024-01-24T13:06:32.982486+0000","last_active":"2024-01-24T13:06:34.375884+0000","last_peered":"2024-01-24T13:06:34.375884+0000","last_clean":"2024-01-24T13:06:34.375884+0000","last_became_active":"2024-01-24T13:06:32.982212+0000","last_became_peered":"2024-01-24T13:06:32.982212+0000","last_unstale":"2024-01-24T13:06:34.375884+0000","last_undegraded":"2024-01-24T13:06:34.375884+0000","last_fullsized":"2024-01-24T13:06:34.375884+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:53:18.968759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961076+0000","last_change":"2024-01-24T13:06:31.961076+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961076+0000","last_undegraded":"2024-01-24T13:06:31.961076+0000","last_fullsized":"2024-01-24T13:06:31.961076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:36:01.523707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375906+0000","last_change":"2024-01-24T13:06:32.985653+0000","last_active":"2024-01-24T13:06:34.375906+0000","last_peered":"2024-01-24T13:06:34.375906+0000","last_clean":"2024-01-24T13:06:34.375906+0000","last_became_active":"2024-01-24T13:06:32.985358+0000","last_became_peered":"2024-01-24T13:06:32.985358+0000","last_unstale":"2024-01-24T13:06:34.375906+0000","last_undegraded":"2024-01-24T13:06:34.375906+0000","last_fullsized":"2024-01-24T13:06:34.375906+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:32:32.585192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960798+0000","last_change":"2024-01-24T13:06:31.960798+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960798+0000","last_undegraded":"2024-01-24T13:06:31.960798+0000","last_fullsized":"2024-01-24T13:06:31.960798+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:24:45.430111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375502+0000","last_change":"2024-01-24T13:06:33.404938+0000","last_active":"2024-01-24T13:06:34.375502+0000","last_peered":"2024-01-24T13:06:34.375502+0000","last_clean":"2024-01-24T13:06:34.375502+0000","last_became_active":"2024-01-24T13:06:33.404554+0000","last_became_peered":"2024-01-24T13:06:33.404554+0000","last_unstale":"2024-01-24T13:06:34.375502+0000","last_undegraded":"2024-01-24T13:06:34.375502+0000","last_fullsized":"2024-01-24T13:06:34.375502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:14:22.773502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375855+0000","last_change":"2024-01-24T13:06:32.976649+0000","last_active":"2024-01-24T13:06:34.375855+0000","last_peered":"2024-01-24T13:06:34.375855+0000","last_clean":"2024-01-24T13:06:34.375855+0000","last_became_active":"2024-01-24T13:06:32.976204+0000","last_became_peered":"2024-01-24T13:06:32.976204+0000","last_unstale":"2024-01-24T13:06:34.375855+0000","last_undegraded":"2024-01-24T13:06:34.375855+0000","last_fullsized":"2024-01-24T13:06:34.375855+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:50.783109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375805+0000","last_change":"2024-01-24T13:06:33.400926+0000","last_active":"2024-01-24T13:06:34.375805+0000","last_peered":"2024-01-24T13:06:34.375805+0000","last_clean":"2024-01-24T13:06:34.375805+0000","last_became_active":"2024-01-24T13:06:33.400651+0000","last_became_peered":"2024-01-24T13:06:33.400651+0000","last_unstale":"2024-01-24T13:06:34.375805+0000","last_undegraded":"2024-01-24T13:06:34.375805+0000","last_fullsized":"2024-01-24T13:06:34.375805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:38:46.742749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.965834+0000","last_change":"2024-01-24T13:06:31.965834+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.965834+0000","last_undegraded":"2024-01-24T13:06:31.965834+0000","last_fullsized":"2024-01-24T13:06:31.965834+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:40:00.227482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.967562+0000","last_change":"2024-01-24T13:06:31.967562+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.967562+0000","last_undegraded":"2024-01-24T13:06:31.967562+0000","last_fullsized":"2024-01-24T13:06:31.967562+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960886+0000","last_change":"2024-01-24T13:06:31.960886+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960886+0000","last_undegraded":"2024-01-24T13:06:31.960886+0000","last_fullsized":"2024-01-24T13:06:31.960886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:16:21.150556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.966302+0000","last_change":"2024-01-24T13:06:31.966302+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.966302+0000","last_undegraded":"2024-01-24T13:06:31.966302+0000","last_fullsized":"2024-01-24T13:06:31.966302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:00:19.578573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.376028+0000","last_change":"2024-01-24T13:06:33.400864+0000","last_active":"2024-01-24T13:06:34.376028+0000","last_peered":"2024-01-24T13:06:34.376028+0000","last_clean":"2024-01-24T13:06:34.376028+0000","last_became_active":"2024-01-24T13:06:33.400583+0000","last_became_peered":"2024-01-24T13:06:33.400583+0000","last_unstale":"2024-01-24T13:06:34.376028+0000","last_undegraded":"2024-01-24T13:06:34.376028+0000","last_fullsized":"2024-01-24T13:06:34.376028+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:35.231436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961108+0000","last_change":"2024-01-24T13:06:31.961108+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961108+0000","last_undegraded":"2024-01-24T13:06:31.961108+0000","last_fullsized":"2024-01-24T13:06:31.961108+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:23:53.805299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.967621+0000","last_change":"2024-01-24T13:06:31.967621+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.967621+0000","last_undegraded":"2024-01-24T13:06:31.967621+0000","last_fullsized":"2024-01-24T13:06:31.967621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:00:19.578573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961089+0000","last_change":"2024-01-24T13:06:31.961089+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961089+0000","last_undegraded":"2024-01-24T13:06:31.961089+0000","last_fullsized":"2024-01-24T13:06:31.961089+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:07.082513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375158+0000","last_change":"2024-01-24T13:06:33.393627+0000","last_active":"2024-01-24T13:06:34.375158+0000","last_peered":"2024-01-24T13:06:34.375158+0000","last_clean":"2024-01-24T13:06:34.375158+0000","last_became_active":"2024-01-24T13:06:33.393249+0000","last_became_peered":"2024-01-24T13:06:33.393249+0000","last_unstale":"2024-01-24T13:06:34.375158+0000","last_undegraded":"2024-01-24T13:06:34.375158+0000","last_fullsized":"2024-01-24T13:06:34.375158+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:26:43.515702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960698+0000","last_change":"2024-01-24T13:06:31.960698+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960698+0000","last_undegraded":"2024-01-24T13:06:31.960698+0000","last_fullsized":"2024-01-24T13:06:31.960698+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:35:10.934452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375242+0000","last_change":"2024-01-24T13:06:32.978254+0000","last_active":"2024-01-24T13:06:34.375242+0000","last_peered":"2024-01-24T13:06:34.375242+0000","last_clean":"2024-01-24T13:06:34.375242+0000","last_became_active":"2024-01-24T13:06:32.977940+0000","last_became_peered":"2024-01-24T13:06:32.977940+0000","last_unstale":"2024-01-24T13:06:34.375242+0000","last_undegraded":"2024-01-24T13:06:34.375242+0000","last_fullsized":"2024-01-24T13:06:34.375242+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:27:03.333403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375333+0000","last_change":"2024-01-24T13:06:33.403559+0000","last_active":"2024-01-24T13:06:34.375333+0000","last_peered":"2024-01-24T13:06:34.375333+0000","last_clean":"2024-01-24T13:06:34.375333+0000","last_became_active":"2024-01-24T13:06:33.403199+0000","last_became_peered":"2024-01-24T13:06:33.403199+0000","last_unstale":"2024-01-24T13:06:34.375333+0000","last_undegraded":"2024-01-24T13:06:34.375333+0000","last_fullsized":"2024-01-24T13:06:34.375333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:10:40.996705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.958648+0000","last_change":"2024-01-24T13:06:31.958648+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.958648+0000","last_undegraded":"2024-01-24T13:06:31.958648+0000","last_fullsized":"2024-01-24T13:06:31.958648+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":192,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-24T13:06:30.231173+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:06:30.231173+0000","last_peered":"2024-01-24T13:06:30.231173+0000","last_clean":"2024-01-24T13:06:30.231173+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:06:30.231173+0000","last_undegraded":"2024-01-24T13:06:30.231173+0000","last_fullsized":"2024-01-24T13:06:30.231173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":285031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.47099999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83799999999999997,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79800000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.61499999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.53800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92700000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.745,"15min":0.755},"min":{"1min":0.56599999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84399999999999997,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.56000000000000005}]},{"osd":3,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.61299999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.89700000000000002,"5min":1.131,"15min":1.131},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.93999999999999995,"5min":1.05,"15min":1.05},"last":0.67500000000000004}]},{"osd":4,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63400000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77300000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.873,"5min":1.341,"15min":1.341},"last":0.746}]},{"osd":5,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89600000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92400000000000004,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54300000000000004}]},{"osd":6,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96599999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91200000000000003,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.60599999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.46600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91500000000000004,"5min":2.827,"15min":2.827},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81000000000000005,"5min":2.052,"15min":2.052},"last":0.72399999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.72299999999999998,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86699999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.92300000000000004,"15min":0.97099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.74099999999999999,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.77200000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.85199999999999998,"15min":0.88600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.83899999999999997,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.94299999999999995,"15min":0.98499999999999999},"min":{"1min":0.54200000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.83999999999999997,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.93999999999999995}]},{"osd":3,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.91700000000000004,"15min":0.95899999999999996},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80600000000000005,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.82199999999999995,"15min":0.84699999999999998},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.85099999999999998,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90300000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.80200000000000005}]},{"osd":5,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.47899999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84699999999999998,"5min":4.274,"15min":4.274},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.81200000000000006,"15min":0.82199999999999995},"min":{"1min":0.63,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88800000000000001,"5min":2.645,"15min":2.645},"last":0.69899999999999995}]},{"osd":7,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.84499999999999997,"15min":0.873},"min":{"1min":0.50900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86699999999999999,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.86199999999999999,"15min":0.88600000000000001},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.92400000000000004,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.628}]}]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63900000000000001,"15min":0.63300000000000001},"min":{"1min":0.47599999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.79500000000000004}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98399999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.014,"5min":1.484,"15min":1.484},"last":0.77800000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68200000000000005,"15min":0.67400000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.878},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.66500000000000004}]},{"osd":3,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.51400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58199999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.629},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.97999999999999998,"5min":1.002,"15min":1.002},"last":0.60399999999999998}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.499,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.54200000000000004}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70299999999999996,"15min":0.69999999999999996},"min":{"1min":0.55500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.59699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95299999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75900000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":651264,"data_stored":285031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.433,"15min":0.44500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53100000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.495},{"interface":"front","average":{"1min":0.443,"5min":0.46300000000000002,"15min":0.46600000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.58199999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.40400000000000003}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46600000000000003,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55300000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68200000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.59899999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.435},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60599999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45300000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.75,"15min":0.76500000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.91500000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78500000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.86299999999999999,"5min":1.014,"15min":1.014},"last":0.81799999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88300000000000001,"5min":1.032,"15min":1.032},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72699999999999998}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79600000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.90500000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.82499999999999996,"15min":0.84499999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.89400000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.83199999999999996,"15min":0.85099999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.875,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":0.85899999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.752}]}]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.46700000000000003,"15min":0.48399999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54300000000000004,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91900000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52400000000000002}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.53100000000000003,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64100000000000001,"5min":1.379,"15min":1.379},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.374,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88700000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.60899999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.63400000000000001,"15min":0.65800000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67700000000000005,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89500000000000002,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97699999999999998,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.98999999999999999}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.52200000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.099,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98499999999999999,"5min":1.448,"15min":1.448},"last":1.115}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.58299999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94099999999999995,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.079},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0449999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0920000000000001}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95999999999999996,"5min":1.554,"15min":1.554},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.84399999999999997,"15min":0.86199999999999999},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0760000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1539999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1257472,"data_stored":881536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64900000000000002,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.502},{"interface":"front","average":{"1min":0.441,"5min":0.57899999999999996,"15min":0.60199999999999998},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82999999999999996,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66600000000000004,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.59199999999999997,"15min":0.61199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":1.958,"15min":1.958},"last":0.61399999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.65800000000000003,"15min":0.67900000000000005},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.626}]},{"osd":4,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.81599999999999995,"15min":0.83999999999999997},"min":{"1min":0.51500000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80200000000000005,"5min":1.601,"15min":1.601},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.84199999999999997,"15min":0.86799999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93799999999999994,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.73199999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.83499999999999996,"15min":0.85699999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.92200000000000004,"5min":1.627,"15min":1.627},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.90100000000000002,"15min":0.93100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.94099999999999995,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.76600000000000001}]},{"osd":6,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.85899999999999999,"15min":0.88500000000000001},"min":{"1min":0.54400000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91700000000000004,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.83799999999999997,"15min":0.85799999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89300000000000002,"5min":1.421,"15min":1.421},"last":0.86699999999999999}]},{"osd":7,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.84499999999999997,"15min":0.86599999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91800000000000004,"5min":1.452,"15min":1.452},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.879,"15min":0.90500000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94599999999999995,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.75}]}]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.47699999999999998,"15min":0.49299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61399999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.71299999999999997,"15min":0.75700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65500000000000003,"5min":5.556,"15min":5.556},"last":0.442}]},{"osd":2,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.74099999999999999,"15min":0.78300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61099999999999999,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.64200000000000002,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.57299999999999995,"15min":0.59499999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65700000000000003,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.57799999999999996}]},{"osd":4,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.56899999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90900000000000003,"5min":1.925,"15min":1.925},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.626,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97599999999999998,"5min":1.512,"15min":1.512},"last":0.77700000000000002}]},{"osd":5,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0169999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.874},{"interface":"front","average":{"1min":0.755,"5min":0.83699999999999997,"15min":0.85099999999999998},"min":{"1min":0.66200000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.90900000000000003,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.60699999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.91800000000000004,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.621},{"interface":"front","average":{"1min":0.753,"5min":0.84299999999999997,"15min":0.85799999999999998},"min":{"1min":0.64400000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.96199999999999997,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.84899999999999998}]},{"osd":7,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.84999999999999998,"15min":0.86599999999999999},"min":{"1min":0.65400000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.84099999999999997,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0389999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.71399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1298432,"data_stored":901880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90000000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93899999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.67000000000000004}]},{"osd":1,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84099999999999997,"5min":0.872,"15min":0.872},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.42699999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.92600000000000005,"5min":1.012,"15min":1.012},"last":0.74099999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.55200000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93600000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.60499999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.871,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.75700000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97099999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88500000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91000000000000003,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92000000000000004,"5min":1.107,"15min":1.107},"last":0.81499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:06:38.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2024-01-24T13:06:38.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2024-01-24T13:06:38.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2024-01-24T13:06:38.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2024-01-24T13:06:38.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2024-01-24T13:06:38.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2024-01-24T13:06:38.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2024-01-24T13:06:38.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2024-01-24T13:06:38.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2024-01-24T13:06:38.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2024-01-24T13:06:38.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2024-01-24T13:06:38.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2024-01-24T13:06:38.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2024-01-24T13:06:38.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2024-01-24T13:06:38.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2024-01-24T13:06:38.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2024-01-24T13:06:38.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2024-01-24T13:06:38.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2024-01-24T13:06:38.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2024-01-24T13:06:38.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2024-01-24T13:06:38.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2024-01-24T13:06:38.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2024-01-24T13:06:38.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2024-01-24T13:06:38.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2024-01-24T13:06:38.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2024-01-24T13:06:38.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2024-01-24T13:06:38.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2024-01-24T13:06:38.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2024-01-24T13:06:38.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2024-01-24T13:06:38.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2024-01-24T13:06:38.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2024-01-24T13:06:38.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.961098+0000', 'last_change': '2024-01-24T13:06:31.961098+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.961098+0000', 'last_undegraded': '2024-01-24T13:06:31.961098+0000', 'last_fullsized': '2024-01-24T13:06:31.961098+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T22:03:08.159676+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-24T13:06:38.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2024-01-24T13:06:38.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2024-01-24T13:06:38.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.967595+0000', 'last_change': '2024-01-24T13:06:31.967595+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.967595+0000', 'last_undegraded': '2024-01-24T13:06:31.967595+0000', 'last_fullsized': '2024-01-24T13:06:31.967595+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T22:40:00.227482+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-24T13:06:38.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2024-01-24T13:06:38.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.960766+0000', 'last_change': '2024-01-24T13:06:31.960766+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.960766+0000', 'last_undegraded': '2024-01-24T13:06:31.960766+0000', 'last_fullsized': '2024-01-24T13:06:31.960766+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T17:29:48.431683+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-24T13:06:38.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2024-01-24T13:06:38.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2024-01-24T13:06:38.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.964243+0000', 'last_change': '2024-01-24T13:06:31.964243+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.964243+0000', 'last_undegraded': '2024-01-24T13:06:31.964243+0000', 'last_fullsized': '2024-01-24T13:06:31.964243+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T13:39:47.187887+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-24T13:06:38.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2024-01-24T13:06:38.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.961108+0000', 'last_change': '2024-01-24T13:06:31.961108+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.961108+0000', 'last_undegraded': '2024-01-24T13:06:31.961108+0000', 'last_fullsized': '2024-01-24T13:06:31.961108+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T22:38:05.514545+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-24T13:06:38.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2024-01-24T13:06:38.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2024-01-24T13:06:38.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.960766+0000', 'last_change': '2024-01-24T13:06:31.960766+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.960766+0000', 'last_undegraded': '2024-01-24T13:06:31.960766+0000', 'last_fullsized': '2024-01-24T13:06:31.960766+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T15:53:06.966206+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-24T13:06:38.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2024-01-24T13:06:38.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2024-01-24T13:06:38.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.965205+0000', 'last_change': '2024-01-24T13:06:31.965205+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.965205+0000', 'last_undegraded': '2024-01-24T13:06:31.965205+0000', 'last_fullsized': '2024-01-24T13:06:31.965205+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-24T13:06:38.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2024-01-24T13:06:38.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2024-01-24T13:06:38.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.958565+0000', 'last_change': '2024-01-24T13:06:31.958565+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.958565+0000', 'last_undegraded': '2024-01-24T13:06:31.958565+0000', 'last_fullsized': '2024-01-24T13:06:31.958565+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T20:44:14.249644+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-24T13:06:38.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2024-01-24T13:06:38.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2024-01-24T13:06:38.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.965190+0000', 'last_change': '2024-01-24T13:06:31.965190+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.965190+0000', 'last_undegraded': '2024-01-24T13:06:31.965190+0000', 'last_fullsized': '2024-01-24T13:06:31.965190+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-24T13:06:38.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2024-01-24T13:06:38.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2024-01-24T13:06:38.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.964396+0000', 'last_change': '2024-01-24T13:06:31.964396+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.964396+0000', 'last_undegraded': '2024-01-24T13:06:31.964396+0000', 'last_fullsized': '2024-01-24T13:06:31.964396+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T23:13:10.025823+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-24T13:06:38.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2024-01-24T13:06:38.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2024-01-24T13:06:38.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.958729+0000', 'last_change': '2024-01-24T13:06:31.958729+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.958729+0000', 'last_undegraded': '2024-01-24T13:06:31.958729+0000', 'last_fullsized': '2024-01-24T13:06:31.958729+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-24T13:06:38.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2024-01-24T13:06:38.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2024-01-24T13:06:38.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-01-24T13:06:38.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.964375+0000', 'last_change': '2024-01-24T13:06:31.964375+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.964375+0000', 'last_undegraded': '2024-01-24T13:06:31.964375+0000', 'last_fullsized': '2024-01-24T13:06:31.964375+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T23:17:48.959635+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-24T13:06:38.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2024-01-24T13:06:38.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2024-01-24T13:06:38.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.964339+0000', 'last_change': '2024-01-24T13:06:31.964339+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.964339+0000', 'last_undegraded': '2024-01-24T13:06:31.964339+0000', 'last_fullsized': '2024-01-24T13:06:31.964339+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T14:03:45.497890+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-24T13:06:38.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2024-01-24T13:06:38.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2024-01-24T13:06:38.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.964325+0000', 'last_change': '2024-01-24T13:06:31.964325+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.964325+0000', 'last_undegraded': '2024-01-24T13:06:31.964325+0000', 'last_fullsized': '2024-01-24T13:06:31.964325+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T15:49:10.726348+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-24T13:06:38.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2024-01-24T13:06:38.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2024-01-24T13:06:38.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.968112+0000', 'last_change': '2024-01-24T13:06:31.968112+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.968112+0000', 'last_undegraded': '2024-01-24T13:06:31.968112+0000', 'last_fullsized': '2024-01-24T13:06:31.968112+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-24T13:06:38.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2024-01-24T13:06:38.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2024-01-24T13:06:38.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2024-01-24T13:06:38.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.961076+0000', 'last_change': '2024-01-24T13:06:31.961076+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.961076+0000', 'last_undegraded': '2024-01-24T13:06:31.961076+0000', 'last_fullsized': '2024-01-24T13:06:31.961076+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T22:36:01.523707+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-24T13:06:38.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2024-01-24T13:06:38.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2024-01-24T13:06:38.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2024-01-24T13:06:38.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.960798+0000', 'last_change': '2024-01-24T13:06:31.960798+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.960798+0000', 'last_undegraded': '2024-01-24T13:06:31.960798+0000', 'last_fullsized': '2024-01-24T13:06:31.960798+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T15:24:45.430111+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-24T13:06:38.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2024-01-24T13:06:38.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.965834+0000', 'last_change': '2024-01-24T13:06:31.965834+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.965834+0000', 'last_undegraded': '2024-01-24T13:06:31.965834+0000', 'last_fullsized': '2024-01-24T13:06:31.965834+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T22:40:00.227482+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-24T13:06:38.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2024-01-24T13:06:38.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-01-24T13:06:38.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.967562+0000', 'last_change': '2024-01-24T13:06:31.967562+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.967562+0000', 'last_undegraded': '2024-01-24T13:06:31.967562+0000', 'last_fullsized': '2024-01-24T13:06:31.967562+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-24T13:06:38.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2024-01-24T13:06:38.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2024-01-24T13:06:38.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.960886+0000', 'last_change': '2024-01-24T13:06:31.960886+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.960886+0000', 'last_undegraded': '2024-01-24T13:06:31.960886+0000', 'last_fullsized': '2024-01-24T13:06:31.960886+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T23:16:21.150556+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-24T13:06:38.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2024-01-24T13:06:38.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-01-24T13:06:38.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.966302+0000', 'last_change': '2024-01-24T13:06:31.966302+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.966302+0000', 'last_undegraded': '2024-01-24T13:06:31.966302+0000', 'last_fullsized': '2024-01-24T13:06:31.966302+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T17:00:19.578573+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-24T13:06:38.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2024-01-24T13:06:38.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.961108+0000', 'last_change': '2024-01-24T13:06:31.961108+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.961108+0000', 'last_undegraded': '2024-01-24T13:06:31.961108+0000', 'last_fullsized': '2024-01-24T13:06:31.961108+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T19:23:53.805299+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-24T13:06:38.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2024-01-24T13:06:38.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-01-24T13:06:38.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.967621+0000', 'last_change': '2024-01-24T13:06:31.967621+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.967621+0000', 'last_undegraded': '2024-01-24T13:06:31.967621+0000', 'last_fullsized': '2024-01-24T13:06:31.967621+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T17:00:19.578573+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-24T13:06:38.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2024-01-24T13:06:38.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2024-01-24T13:06:38.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.961089+0000', 'last_change': '2024-01-24T13:06:31.961089+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.961089+0000', 'last_undegraded': '2024-01-24T13:06:31.961089+0000', 'last_fullsized': '2024-01-24T13:06:31.961089+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T22:43:07.082513+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-24T13:06:38.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-01-24T13:06:38.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.960698+0000', 'last_change': '2024-01-24T13:06:31.960698+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.960698+0000', 'last_undegraded': '2024-01-24T13:06:31.960698+0000', 'last_fullsized': '2024-01-24T13:06:31.960698+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T16:35:10.934452+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-24T13:06:38.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2024-01-24T13:06:38.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-24T13:06:32.955728+0000', 'last_change': '2024-01-24T13:06:32.955728+0000', 'last_active': '2024-01-24T13:06:32.955728+0000', 'last_peered': '2024-01-24T13:06:32.955728+0000', 'last_clean': '2024-01-24T13:06:32.955728+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:32.955728+0000', 'last_undegraded': '2024-01-24T13:06:32.955728+0000', 'last_fullsized': '2024-01-24T13:06:32.955728+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:32.955728+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-24T13:06:38.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-01-24T13:06:38.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-01-24T13:06:31.958648+0000', 'last_change': '2024-01-24T13:06:31.958648+0000', 'last_active': '2024-01-24T13:06:31.948336+0000', 'last_peered': '2024-01-24T13:06:31.948336+0000', 'last_clean': '2024-01-24T13:06:31.948336+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-24T13:06:31.958648+0000', 'last_undegraded': '2024-01-24T13:06:31.958648+0000', 'last_fullsized': '2024-01-24T13:06:31.958648+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'last_clean_scrub_stamp': '2024-01-24T13:06:31.948336+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-24T13:06:38.274 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-24T13:06:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.430+0000 7ff5b5a00640 1 Processor -- start 2024-01-24T13:06:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5b5a00640 1 -- start start 2024-01-24T13:06:38.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5b5a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff5b015a630 0x7ff5b00cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5b5a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b00cb100 0x7ff5b00ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5b5a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b00cfe50 con 0x7ff5b00c3ef0 2024-01-24T13:06:38.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5b5a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b00cf380 con 0x7ff5b015a630 2024-01-24T13:06:38.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5b5a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b015aa10 con 0x7ff5b00cb100 2024-01-24T13:06:38.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5aea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff5b015a630 0x7ff5b00cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5ae000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff5b00c3ef0 0x7ff5b00ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55100/0 (socket says 172.21.15.29:55100) 2024-01-24T13:06:38.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5ae000640 1 -- 172.21.15.29:0/1184842471 learned_addr learned my addr 172.21.15.29:0/1184842471 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:38.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5af400640 1 --2- 172.21.15.29:0/1184842471 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b00cb100 0x7ff5b00ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5aea00640 1 -- 172.21.15.29:0/1184842471 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b00cb100 msgr2=0x7ff5b00ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:38.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5aea00640 1 --2- 172.21.15.29:0/1184842471 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b00cb100 0x7ff5b00ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5aea00640 1 -- 172.21.15.29:0/1184842471 >> v1:172.21.15.29:6789/0 conn(0x7ff5b00c3ef0 legacy=0x7ff5b00ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5aea00640 1 -- 172.21.15.29:0/1184842471 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b00b2b70 con 0x7ff5b015a630 2024-01-24T13:06:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.434+0000 7ff5af400640 1 --2- 172.21.15.29:0/1184842471 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b00cb100 0x7ff5b00ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.438+0000 7ff5aea00640 1 --2- 172.21.15.29:0/1184842471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b015a630 0x7ff5b00cdf70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00097c0 tx=0x7ff5a001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597edad048a5542b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.438+0000 7ff5ad600640 1 -- 172.21.15.29:0/1184842471 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a00ab650 con 0x7ff5b015a630 2024-01-24T13:06:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.438+0000 7ff5ad600640 1 -- 172.21.15.29:0/1184842471 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a00ab7b0 con 0x7ff5b015a630 2024-01-24T13:06:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.438+0000 7ff5ad600640 1 -- 172.21.15.29:0/1184842471 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a00abb40 con 0x7ff5b015a630 2024-01-24T13:06:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.438+0000 7ff5b5a00640 1 -- 172.21.15.29:0/1184842471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b015a630 msgr2=0x7ff5b00cdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.438+0000 7ff5b5a00640 1 --2- 172.21.15.29:0/1184842471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b015a630 0x7ff5b00cdf70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00097c0 tx=0x7ff5a001c450 comp rx=0 tx=0).stop 2024-01-24T13:06:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.438+0000 7ff5b5a00640 1 -- 172.21.15.29:0/1184842471 shutdown_connections 2024-01-24T13:06:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.438+0000 7ff5b5a00640 1 --2- 172.21.15.29:0/1184842471 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b00cb100 0x7ff5b00ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.438+0000 7ff5b5a00640 1 --2- 172.21.15.29:0/1184842471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b015a630 0x7ff5b00cdf70 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.438+0000 7ff5b5a00640 1 -- 172.21.15.29:0/1184842471 >> 172.21.15.29:0/1184842471 conn(0x7ff5b0070570 msgr2=0x7ff5b0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:38.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.438+0000 7ff5b5a00640 1 -- 172.21.15.29:0/1184842471 shutdown_connections 2024-01-24T13:06:38.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.438+0000 7ff5b5a00640 1 -- 172.21.15.29:0/1184842471 wait complete. 2024-01-24T13:06:38.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.438+0000 7ff5b5a00640 1 Processor -- start 2024-01-24T13:06:38.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.438+0000 7ff5b5a00640 1 -- start start 2024-01-24T13:06:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5b5a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b00c3ef0 0x7ff5b01f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5b5a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b00cb100 0x7ff5b015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5b5a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b015a630 0x7ff5b006c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5b5a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b015ce80 con 0x7ff5b00cb100 2024-01-24T13:06:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5b5a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b015b330 con 0x7ff5b00c3ef0 2024-01-24T13:06:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5b5a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b015b600 con 0x7ff5b015a630 2024-01-24T13:06:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5ae000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b00cb100 0x7ff5b015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5af400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b015a630 0x7ff5b006c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5ae000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b00cb100 0x7ff5b015adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:32914/0 (socket says 172.21.15.29:32914) 2024-01-24T13:06:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5ae000640 1 -- 172.21.15.29:0/2399392372 learned_addr learned my addr 172.21.15.29:0/2399392372 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5aea00640 1 --2- 172.21.15.29:0/2399392372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b00c3ef0 0x7ff5b01f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5ae000640 1 -- 172.21.15.29:0/2399392372 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b015a630 msgr2=0x7ff5b006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5ae000640 1 --2- 172.21.15.29:0/2399392372 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b015a630 0x7ff5b006c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5ae000640 1 -- 172.21.15.29:0/2399392372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b00c3ef0 msgr2=0x7ff5b01f8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5ae000640 1 --2- 172.21.15.29:0/2399392372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b00c3ef0 0x7ff5b01f8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5ae000640 1 -- 172.21.15.29:0/2399392372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0009420 con 0x7ff5b00cb100 2024-01-24T13:06:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5ae000640 1 --2- 172.21.15.29:0/2399392372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b00cb100 0x7ff5b015adf0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff59800c500 tx=0x7ff59800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5a6a00640 1 -- 172.21.15.29:0/2399392372 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598005cf0 con 0x7ff5b00cb100 2024-01-24T13:06:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5a6a00640 1 -- 172.21.15.29:0/2399392372 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff598005e50 con 0x7ff5b00cb100 2024-01-24T13:06:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5a6a00640 1 -- 172.21.15.29:0/2399392372 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5980072f0 con 0x7ff5b00cb100 2024-01-24T13:06:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5b5a00640 1 -- 172.21.15.29:0/2399392372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b015b8e0 con 0x7ff5b00cb100 2024-01-24T13:06:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5b5a00640 1 -- 172.21.15.29:0/2399392372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b00c4e60 con 0x7ff5b00cb100 2024-01-24T13:06:38.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.442+0000 7ff5b5a00640 1 -- 172.21.15.29:0/2399392372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b00c50a0 con 0x7ff5b00cb100 2024-01-24T13:06:38.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.446+0000 7ff5a6a00640 1 -- 172.21.15.29:0/2399392372 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff598007450 con 0x7ff5b00cb100 2024-01-24T13:06:38.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.446+0000 7ff5a6a00640 1 --2- 172.21.15.29:0/2399392372 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff588065a60 0x7ff588067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.446+0000 7ff5a6a00640 1 -- 172.21.15.29:0/2399392372 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff598082790 con 0x7ff5b00cb100 2024-01-24T13:06:38.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.446+0000 7ff5aea00640 1 --2- 172.21.15.29:0/2399392372 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff588065a60 0x7ff588067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.446+0000 7ff5aea00640 1 --2- 172.21.15.29:0/2399392372 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff588065a60 0x7ff588067f20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00af000 tx=0x7ff5a00a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.450+0000 7ff5a6a00640 1 -- 172.21.15.29:0/2399392372 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff5b00c50a0 con 0x7ff5b00cb100 2024-01-24T13:06:38.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.666+0000 7ff5b5a00640 1 -- 172.21.15.29:0/2399392372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff5b00c50a0 con 0x7ff5b00cb100 2024-01-24T13:06:38.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.666+0000 7ff5a6a00640 1 -- 172.21.15.29:0/2399392372 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1172 (secure 0 0 0) 0x7ff5b00c50a0 con 0x7ff5b00cb100 2024-01-24T13:06:38.671 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:38.671 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":188,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":59,"num_osds":8,"num_up_osds":8,"osd_up_since":1706101422,"num_in_osds":8,"osd_in_since":1706101413,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":53},{"state_name":"creating+peering","count":26},{"state_name":"active+clean","count":18}],"num_pgs":97,"num_pools":3,"num_objects":5,"data_bytes":590402,"bytes_used":244670464,"bytes_avail":772849442816,"bytes_total":773094113280,"unknown_pgs_ratio":0.54639172554016113,"inactive_pgs_ratio":0.2680412232875824,"write_bytes_sec":1275,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":26,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":6180}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-01-24T13:06:21.573918+0000","services":{}},"progress_events":{}} 2024-01-24T13:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.670+0000 7ff5b5a00640 1 -- 172.21.15.29:0/2399392372 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff588065a60 msgr2=0x7ff588067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.670+0000 7ff5b5a00640 1 --2- 172.21.15.29:0/2399392372 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff588065a60 0x7ff588067f20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00af000 tx=0x7ff5a00a7000 comp rx=0 tx=0).stop 2024-01-24T13:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.670+0000 7ff5b5a00640 1 -- 172.21.15.29:0/2399392372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b00cb100 msgr2=0x7ff5b015adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.670+0000 7ff5b5a00640 1 --2- 172.21.15.29:0/2399392372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b00cb100 0x7ff5b015adf0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff59800c500 tx=0x7ff59800c9c0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.670+0000 7ff5b5a00640 1 -- 172.21.15.29:0/2399392372 shutdown_connections 2024-01-24T13:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.670+0000 7ff5b5a00640 1 --2- 172.21.15.29:0/2399392372 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff588065a60 0x7ff588067f20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.670+0000 7ff5b5a00640 1 --2- 172.21.15.29:0/2399392372 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b015a630 0x7ff5b006c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.670+0000 7ff5b5a00640 1 --2- 172.21.15.29:0/2399392372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b00cb100 0x7ff5b015adf0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.670+0000 7ff5b5a00640 1 --2- 172.21.15.29:0/2399392372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b00c3ef0 0x7ff5b01f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.670+0000 7ff5b5a00640 1 -- 172.21.15.29:0/2399392372 >> 172.21.15.29:0/2399392372 conn(0x7ff5b0070570 msgr2=0x7ff5b00cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.670+0000 7ff5b5a00640 1 -- 172.21.15.29:0/2399392372 shutdown_connections 2024-01-24T13:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.670+0000 7ff5b5a00640 1 -- 172.21.15.29:0/2399392372 wait complete. 2024-01-24T13:06:38.692 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-24T13:06:38.692 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:06:38.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e10400640 1 Processor -- start 2024-01-24T13:06:38.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e10400640 1 -- start start 2024-01-24T13:06:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e10400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e080c3ef0 0x7f6e080ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e10400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e080caf30 0x7f6e080d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e10400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e080cfe50 con 0x7f6e0815a630 2024-01-24T13:06:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e10400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e080cf380 con 0x7f6e080caf30 2024-01-24T13:06:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e10400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e080cb3c0 con 0x7f6e080c3ef0 2024-01-24T13:06:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e0e400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e080caf30 0x7f6e080d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e0e400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e080caf30 0x7f6e080d02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:32918/0 (socket says 172.21.15.29:32918) 2024-01-24T13:06:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e0e400640 1 -- 172.21.15.29:0/2604955575 learned_addr learned my addr 172.21.15.29:0/2604955575 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e0d000640 1 --2- 172.21.15.29:0/2604955575 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e080c3ef0 0x7f6e080ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e0e400640 1 -- 172.21.15.29:0/2604955575 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e080c3ef0 msgr2=0x7f6e080ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e0e400640 1 --2- 172.21.15.29:0/2604955575 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e080c3ef0 0x7f6e080ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e0e400640 1 -- 172.21.15.29:0/2604955575 >> v1:172.21.15.163:6789/0 conn(0x7f6e0815a630 legacy=0x7f6e080cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e0e400640 1 -- 172.21.15.29:0/2604955575 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0815aa10 con 0x7f6e080caf30 2024-01-24T13:06:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.830+0000 7f6e0d000640 1 --2- 172.21.15.29:0/2604955575 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e080c3ef0 0x7f6e080ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:38.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.834+0000 7f6e0e400640 1 --2- 172.21.15.29:0/2604955575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e080caf30 0x7f6e080d02e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009e50 tx=0x7f6e0001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bbc422d3a826b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:38.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.834+0000 7f6e07e00640 1 -- 172.21.15.29:0/2604955575 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e000a58b0 con 0x7f6e080caf30 2024-01-24T13:06:38.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.834+0000 7f6e07e00640 1 -- 172.21.15.29:0/2604955575 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e000a5a10 con 0x7f6e080caf30 2024-01-24T13:06:38.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.834+0000 7f6e07e00640 1 -- 172.21.15.29:0/2604955575 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e000a5da0 con 0x7f6e080caf30 2024-01-24T13:06:38.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.834+0000 7f6e10400640 1 -- 172.21.15.29:0/2604955575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e080caf30 msgr2=0x7f6e080d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.834+0000 7f6e10400640 1 --2- 172.21.15.29:0/2604955575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e080caf30 0x7f6e080d02e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009e50 tx=0x7f6e0001c9f0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.834+0000 7f6e10400640 1 -- 172.21.15.29:0/2604955575 shutdown_connections 2024-01-24T13:06:38.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.834+0000 7f6e10400640 1 --2- 172.21.15.29:0/2604955575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e080caf30 0x7f6e080d02e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.834+0000 7f6e10400640 1 --2- 172.21.15.29:0/2604955575 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e080c3ef0 0x7f6e080ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.834+0000 7f6e10400640 1 -- 172.21.15.29:0/2604955575 >> 172.21.15.29:0/2604955575 conn(0x7f6e08070570 msgr2=0x7f6e08069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:38.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.834+0000 7f6e10400640 1 -- 172.21.15.29:0/2604955575 shutdown_connections 2024-01-24T13:06:38.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.834+0000 7f6e10400640 1 -- 172.21.15.29:0/2604955575 wait complete. 2024-01-24T13:06:38.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e10400640 1 Processor -- start 2024-01-24T13:06:38.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e10400640 1 -- start start 2024-01-24T13:06:38.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e10400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e080c3ef0 0x7f6e080c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e10400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e080caf30 0x7f6e08162c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e10400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e0815a630 0x7f6e08164430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e10400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e08163180 con 0x7f6e080c3ef0 2024-01-24T13:06:38.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e10400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e08163fa0 con 0x7f6e080caf30 2024-01-24T13:06:38.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e10400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e08163390 con 0x7f6e0815a630 2024-01-24T13:06:38.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e0da00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e080c3ef0 0x7f6e080c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e0da00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e080c3ef0 0x7f6e080c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:32932/0 (socket says 172.21.15.29:32932) 2024-01-24T13:06:38.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e0da00640 1 -- 172.21.15.29:0/2089820571 learned_addr learned my addr 172.21.15.29:0/2089820571 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:38.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e0e400640 1 --2- 172.21.15.29:0/2089820571 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e0815a630 0x7f6e08164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e0d000640 1 --2- 172.21.15.29:0/2089820571 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e080caf30 0x7f6e08162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e0da00640 1 -- 172.21.15.29:0/2089820571 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e0815a630 msgr2=0x7f6e08164430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e0da00640 1 --2- 172.21.15.29:0/2089820571 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e0815a630 0x7f6e08164430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e0da00640 1 -- 172.21.15.29:0/2089820571 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e080caf30 msgr2=0x7f6e08162c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:38.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e0da00640 1 --2- 172.21.15.29:0/2089820571 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e080caf30 0x7f6e08162c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:38.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e0da00640 1 -- 172.21.15.29:0/2089820571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e00009b30 con 0x7f6e080c3ef0 2024-01-24T13:06:38.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e0da00640 1 --2- 172.21.15.29:0/2089820571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e080c3ef0 0x7f6e080c68b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6df800c3c0 tx=0x7f6df800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:38.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e05600640 1 -- 172.21.15.29:0/2089820571 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df80052d0 con 0x7f6e080c3ef0 2024-01-24T13:06:38.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e05600640 1 -- 172.21.15.29:0/2089820571 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df8005430 con 0x7f6e080c3ef0 2024-01-24T13:06:38.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e10400640 1 -- 172.21.15.29:0/2089820571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e08163670 con 0x7f6e080c3ef0 2024-01-24T13:06:38.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e05600640 1 -- 172.21.15.29:0/2089820571 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df8003840 con 0x7f6e080c3ef0 2024-01-24T13:06:38.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e10400640 1 -- 172.21.15.29:0/2089820571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e08163c30 con 0x7f6e080c3ef0 2024-01-24T13:06:38.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.838+0000 7f6e10400640 1 -- 172.21.15.29:0/2089820571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0804e850 con 0x7f6e080c3ef0 2024-01-24T13:06:38.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.842+0000 7f6e05600640 1 -- 172.21.15.29:0/2089820571 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6df80039a0 con 0x7f6e080c3ef0 2024-01-24T13:06:38.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.842+0000 7f6e05600640 1 --2- 172.21.15.29:0/2089820571 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6de0065a60 0x7f6de0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:38.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.842+0000 7f6e05600640 1 -- 172.21.15.29:0/2089820571 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6df8082800 con 0x7f6e080c3ef0 2024-01-24T13:06:38.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.842+0000 7f6e0d000640 1 --2- 172.21.15.29:0/2089820571 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6de0065a60 0x7f6de0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:38.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.842+0000 7f6e0d000640 1 --2- 172.21.15.29:0/2089820571 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6de0065a60 0x7f6de0067f20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6e080b6220 tx=0x7f6df0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:38.846+0000 7f6e05600640 1 -- 172.21.15.29:0/2089820571 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f6df80500a0 con 0x7f6e080c3ef0 2024-01-24T13:06:38.949 INFO:tasks.ceph.mds.c.smithi029.stderr:2024-01-24T13:06:38.946+0000 7f4e0c200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-24T13:06:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:39.002+0000 7f6e10400640 1 -- 172.21.15.29:0/2089820571 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e080cf0a0 con 0x7f6de0065a60 2024-01-24T13:06:39.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:39.014+0000 7f6e05600640 1 -- 172.21.15.29:0/2089820571 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280770 (secure 0 0 0) 0x7f6df000c040 con 0x7f6de0065a60 2024-01-24T13:06:39.016 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:39.019 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:06:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:39.014+0000 7f6e10400640 1 -- 172.21.15.29:0/2089820571 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6de0065a60 msgr2=0x7f6de0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:39.014+0000 7f6e10400640 1 --2- 172.21.15.29:0/2089820571 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6de0065a60 0x7f6de0067f20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6e080b6220 tx=0x7f6df0008040 comp rx=0 tx=0).stop 2024-01-24T13:06:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:39.014+0000 7f6e10400640 1 -- 172.21.15.29:0/2089820571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e080c3ef0 msgr2=0x7f6e080c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:39.014+0000 7f6e10400640 1 --2- 172.21.15.29:0/2089820571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e080c3ef0 0x7f6e080c68b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6df800c3c0 tx=0x7f6df800c880 comp rx=0 tx=0).stop 2024-01-24T13:06:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:39.014+0000 7f6e10400640 1 -- 172.21.15.29:0/2089820571 shutdown_connections 2024-01-24T13:06:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:39.014+0000 7f6e10400640 1 --2- 172.21.15.29:0/2089820571 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6de0065a60 0x7f6de0067f20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:39.014+0000 7f6e10400640 1 --2- 172.21.15.29:0/2089820571 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e0815a630 0x7f6e08164430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:39.014+0000 7f6e10400640 1 --2- 172.21.15.29:0/2089820571 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e080caf30 0x7f6e08162c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:39.014+0000 7f6e10400640 1 --2- 172.21.15.29:0/2089820571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e080c3ef0 0x7f6e080c68b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:39.014+0000 7f6e10400640 1 -- 172.21.15.29:0/2089820571 >> 172.21.15.29:0/2089820571 conn(0x7f6e08070570 msgr2=0x7f6e0806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:39.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:39.014+0000 7f6e10400640 1 -- 172.21.15.29:0/2089820571 shutdown_connections 2024-01-24T13:06:39.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:39.014+0000 7f6e10400640 1 -- 172.21.15.29:0/2089820571 wait complete. 2024-01-24T13:06:39.038 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-01-24T13:06:37.576634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":88,"acting":88,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238936,"kb_used_data":6360,"kb_used_omap":13,"kb_used_meta":232434,"kb_avail":754735784,"statfs":{"total":773094113280,"available":772849442816,"internally_reserved":0,"allocated":6512640,"data_stored":3518150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":238012504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.618386"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375060+0000","last_change":"2024-01-24T13:06:33.406014+0000","last_active":"2024-01-24T13:06:34.375060+0000","last_peered":"2024-01-24T13:06:34.375060+0000","last_clean":"2024-01-24T13:06:34.375060+0000","last_became_active":"2024-01-24T13:06:33.405730+0000","last_became_peered":"2024-01-24T13:06:33.405730+0000","last_unstale":"2024-01-24T13:06:34.375060+0000","last_undegraded":"2024-01-24T13:06:34.375060+0000","last_fullsized":"2024-01-24T13:06:34.375060+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:27:37.923610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375822+0000","last_change":"2024-01-24T13:06:33.400907+0000","last_active":"2024-01-24T13:06:34.375822+0000","last_peered":"2024-01-24T13:06:34.375822+0000","last_clean":"2024-01-24T13:06:34.375822+0000","last_became_active":"2024-01-24T13:06:33.400591+0000","last_became_peered":"2024-01-24T13:06:33.400591+0000","last_unstale":"2024-01-24T13:06:34.375822+0000","last_undegraded":"2024-01-24T13:06:34.375822+0000","last_fullsized":"2024-01-24T13:06:34.375822+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:26:32.145531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375405+0000","last_change":"2024-01-24T13:06:33.392452+0000","last_active":"2024-01-24T13:06:34.375405+0000","last_peered":"2024-01-24T13:06:34.375405+0000","last_clean":"2024-01-24T13:06:34.375405+0000","last_became_active":"2024-01-24T13:06:33.392187+0000","last_became_peered":"2024-01-24T13:06:33.392187+0000","last_unstale":"2024-01-24T13:06:34.375405+0000","last_undegraded":"2024-01-24T13:06:34.375405+0000","last_fullsized":"2024-01-24T13:06:34.375405+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:23:21.241419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961098+0000","last_change":"2024-01-24T13:06:31.961098+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961098+0000","last_undegraded":"2024-01-24T13:06:31.961098+0000","last_fullsized":"2024-01-24T13:06:31.961098+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:03:08.159676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.967595+0000","last_change":"2024-01-24T13:06:31.967595+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.967595+0000","last_undegraded":"2024-01-24T13:06:31.967595+0000","last_fullsized":"2024-01-24T13:06:31.967595+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:40:00.227482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375599+0000","last_change":"2024-01-24T13:06:33.392163+0000","last_active":"2024-01-24T13:06:34.375599+0000","last_peered":"2024-01-24T13:06:34.375599+0000","last_clean":"2024-01-24T13:06:34.375599+0000","last_became_active":"2024-01-24T13:06:33.391881+0000","last_became_peered":"2024-01-24T13:06:33.391881+0000","last_unstale":"2024-01-24T13:06:34.375599+0000","last_undegraded":"2024-01-24T13:06:34.375599+0000","last_fullsized":"2024-01-24T13:06:34.375599+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:47.551144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960766+0000","last_change":"2024-01-24T13:06:31.960766+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960766+0000","last_undegraded":"2024-01-24T13:06:31.960766+0000","last_fullsized":"2024-01-24T13:06:31.960766+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:29:48.431683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964243+0000","last_change":"2024-01-24T13:06:31.964243+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964243+0000","last_undegraded":"2024-01-24T13:06:31.964243+0000","last_fullsized":"2024-01-24T13:06:31.964243+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:39:47.187887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375478+0000","last_change":"2024-01-24T13:06:33.404960+0000","last_active":"2024-01-24T13:06:34.375478+0000","last_peered":"2024-01-24T13:06:34.375478+0000","last_clean":"2024-01-24T13:06:34.375478+0000","last_became_active":"2024-01-24T13:06:33.404311+0000","last_became_peered":"2024-01-24T13:06:33.404311+0000","last_unstale":"2024-01-24T13:06:34.375478+0000","last_undegraded":"2024-01-24T13:06:34.375478+0000","last_fullsized":"2024-01-24T13:06:34.375478+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:26:49.633149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961108+0000","last_change":"2024-01-24T13:06:31.961108+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961108+0000","last_undegraded":"2024-01-24T13:06:31.961108+0000","last_fullsized":"2024-01-24T13:06:31.961108+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:38:05.514545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960766+0000","last_change":"2024-01-24T13:06:31.960766+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960766+0000","last_undegraded":"2024-01-24T13:06:31.960766+0000","last_fullsized":"2024-01-24T13:06:31.960766+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:53:06.966206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.965205+0000","last_change":"2024-01-24T13:06:31.965205+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.965205+0000","last_undegraded":"2024-01-24T13:06:31.965205+0000","last_fullsized":"2024-01-24T13:06:31.965205+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.958565+0000","last_change":"2024-01-24T13:06:31.958565+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.958565+0000","last_undegraded":"2024-01-24T13:06:31.958565+0000","last_fullsized":"2024-01-24T13:06:31.958565+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:44:14.249644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.965190+0000","last_change":"2024-01-24T13:06:31.965190+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.965190+0000","last_undegraded":"2024-01-24T13:06:31.965190+0000","last_fullsized":"2024-01-24T13:06:31.965190+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375785+0000","last_change":"2024-01-24T13:06:32.985695+0000","last_active":"2024-01-24T13:06:34.375785+0000","last_peered":"2024-01-24T13:06:34.375785+0000","last_clean":"2024-01-24T13:06:34.375785+0000","last_became_active":"2024-01-24T13:06:32.985403+0000","last_became_peered":"2024-01-24T13:06:32.985403+0000","last_unstale":"2024-01-24T13:06:34.375785+0000","last_undegraded":"2024-01-24T13:06:34.375785+0000","last_fullsized":"2024-01-24T13:06:34.375785+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:11:33.948670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375718+0000","last_change":"2024-01-24T13:06:33.391836+0000","last_active":"2024-01-24T13:06:34.375718+0000","last_peered":"2024-01-24T13:06:34.375718+0000","last_clean":"2024-01-24T13:06:34.375718+0000","last_became_active":"2024-01-24T13:06:33.391363+0000","last_became_peered":"2024-01-24T13:06:33.391363+0000","last_unstale":"2024-01-24T13:06:34.375718+0000","last_undegraded":"2024-01-24T13:06:34.375718+0000","last_fullsized":"2024-01-24T13:06:34.375718+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:04:35.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964396+0000","last_change":"2024-01-24T13:06:31.964396+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964396+0000","last_undegraded":"2024-01-24T13:06:31.964396+0000","last_fullsized":"2024-01-24T13:06:31.964396+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:13:10.025823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.958729+0000","last_change":"2024-01-24T13:06:31.958729+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.958729+0000","last_undegraded":"2024-01-24T13:06:31.958729+0000","last_fullsized":"2024-01-24T13:06:31.958729+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375598+0000","last_change":"2024-01-24T13:06:32.981791+0000","last_active":"2024-01-24T13:06:34.375598+0000","last_peered":"2024-01-24T13:06:34.375598+0000","last_clean":"2024-01-24T13:06:34.375598+0000","last_became_active":"2024-01-24T13:06:32.981523+0000","last_became_peered":"2024-01-24T13:06:32.981523+0000","last_unstale":"2024-01-24T13:06:34.375598+0000","last_undegraded":"2024-01-24T13:06:34.375598+0000","last_fullsized":"2024-01-24T13:06:34.375598+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:46:44.914023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964375+0000","last_change":"2024-01-24T13:06:31.964375+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964375+0000","last_undegraded":"2024-01-24T13:06:31.964375+0000","last_fullsized":"2024-01-24T13:06:31.964375+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:17:48.959635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964339+0000","last_change":"2024-01-24T13:06:31.964339+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964339+0000","last_undegraded":"2024-01-24T13:06:31.964339+0000","last_fullsized":"2024-01-24T13:06:31.964339+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:03:45.497890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.964325+0000","last_change":"2024-01-24T13:06:31.964325+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.964325+0000","last_undegraded":"2024-01-24T13:06:31.964325+0000","last_fullsized":"2024-01-24T13:06:31.964325+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:49:10.726348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.968112+0000","last_change":"2024-01-24T13:06:31.968112+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.968112+0000","last_undegraded":"2024-01-24T13:06:31.968112+0000","last_fullsized":"2024-01-24T13:06:31.968112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375884+0000","last_change":"2024-01-24T13:06:32.982486+0000","last_active":"2024-01-24T13:06:34.375884+0000","last_peered":"2024-01-24T13:06:34.375884+0000","last_clean":"2024-01-24T13:06:34.375884+0000","last_became_active":"2024-01-24T13:06:32.982212+0000","last_became_peered":"2024-01-24T13:06:32.982212+0000","last_unstale":"2024-01-24T13:06:34.375884+0000","last_undegraded":"2024-01-24T13:06:34.375884+0000","last_fullsized":"2024-01-24T13:06:34.375884+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:53:18.968759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961076+0000","last_change":"2024-01-24T13:06:31.961076+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961076+0000","last_undegraded":"2024-01-24T13:06:31.961076+0000","last_fullsized":"2024-01-24T13:06:31.961076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:36:01.523707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375906+0000","last_change":"2024-01-24T13:06:32.985653+0000","last_active":"2024-01-24T13:06:34.375906+0000","last_peered":"2024-01-24T13:06:34.375906+0000","last_clean":"2024-01-24T13:06:34.375906+0000","last_became_active":"2024-01-24T13:06:32.985358+0000","last_became_peered":"2024-01-24T13:06:32.985358+0000","last_unstale":"2024-01-24T13:06:34.375906+0000","last_undegraded":"2024-01-24T13:06:34.375906+0000","last_fullsized":"2024-01-24T13:06:34.375906+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:32:32.585192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960798+0000","last_change":"2024-01-24T13:06:31.960798+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960798+0000","last_undegraded":"2024-01-24T13:06:31.960798+0000","last_fullsized":"2024-01-24T13:06:31.960798+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:24:45.430111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375502+0000","last_change":"2024-01-24T13:06:33.404938+0000","last_active":"2024-01-24T13:06:34.375502+0000","last_peered":"2024-01-24T13:06:34.375502+0000","last_clean":"2024-01-24T13:06:34.375502+0000","last_became_active":"2024-01-24T13:06:33.404554+0000","last_became_peered":"2024-01-24T13:06:33.404554+0000","last_unstale":"2024-01-24T13:06:34.375502+0000","last_undegraded":"2024-01-24T13:06:34.375502+0000","last_fullsized":"2024-01-24T13:06:34.375502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:14:22.773502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375855+0000","last_change":"2024-01-24T13:06:32.976649+0000","last_active":"2024-01-24T13:06:34.375855+0000","last_peered":"2024-01-24T13:06:34.375855+0000","last_clean":"2024-01-24T13:06:34.375855+0000","last_became_active":"2024-01-24T13:06:32.976204+0000","last_became_peered":"2024-01-24T13:06:32.976204+0000","last_unstale":"2024-01-24T13:06:34.375855+0000","last_undegraded":"2024-01-24T13:06:34.375855+0000","last_fullsized":"2024-01-24T13:06:34.375855+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:50.783109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375805+0000","last_change":"2024-01-24T13:06:33.400926+0000","last_active":"2024-01-24T13:06:34.375805+0000","last_peered":"2024-01-24T13:06:34.375805+0000","last_clean":"2024-01-24T13:06:34.375805+0000","last_became_active":"2024-01-24T13:06:33.400651+0000","last_became_peered":"2024-01-24T13:06:33.400651+0000","last_unstale":"2024-01-24T13:06:34.375805+0000","last_undegraded":"2024-01-24T13:06:34.375805+0000","last_fullsized":"2024-01-24T13:06:34.375805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:38:46.742749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.965834+0000","last_change":"2024-01-24T13:06:31.965834+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.965834+0000","last_undegraded":"2024-01-24T13:06:31.965834+0000","last_fullsized":"2024-01-24T13:06:31.965834+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:40:00.227482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.967562+0000","last_change":"2024-01-24T13:06:31.967562+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.967562+0000","last_undegraded":"2024-01-24T13:06:31.967562+0000","last_fullsized":"2024-01-24T13:06:31.967562+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960886+0000","last_change":"2024-01-24T13:06:31.960886+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960886+0000","last_undegraded":"2024-01-24T13:06:31.960886+0000","last_fullsized":"2024-01-24T13:06:31.960886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:16:21.150556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.966302+0000","last_change":"2024-01-24T13:06:31.966302+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.966302+0000","last_undegraded":"2024-01-24T13:06:31.966302+0000","last_fullsized":"2024-01-24T13:06:31.966302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:00:19.578573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.376028+0000","last_change":"2024-01-24T13:06:33.400864+0000","last_active":"2024-01-24T13:06:34.376028+0000","last_peered":"2024-01-24T13:06:34.376028+0000","last_clean":"2024-01-24T13:06:34.376028+0000","last_became_active":"2024-01-24T13:06:33.400583+0000","last_became_peered":"2024-01-24T13:06:33.400583+0000","last_unstale":"2024-01-24T13:06:34.376028+0000","last_undegraded":"2024-01-24T13:06:34.376028+0000","last_fullsized":"2024-01-24T13:06:34.376028+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:35.231436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961108+0000","last_change":"2024-01-24T13:06:31.961108+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961108+0000","last_undegraded":"2024-01-24T13:06:31.961108+0000","last_fullsized":"2024-01-24T13:06:31.961108+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:23:53.805299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.967621+0000","last_change":"2024-01-24T13:06:31.967621+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.967621+0000","last_undegraded":"2024-01-24T13:06:31.967621+0000","last_fullsized":"2024-01-24T13:06:31.967621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:00:19.578573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.961089+0000","last_change":"2024-01-24T13:06:31.961089+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.961089+0000","last_undegraded":"2024-01-24T13:06:31.961089+0000","last_fullsized":"2024-01-24T13:06:31.961089+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:07.082513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375158+0000","last_change":"2024-01-24T13:06:33.393627+0000","last_active":"2024-01-24T13:06:34.375158+0000","last_peered":"2024-01-24T13:06:34.375158+0000","last_clean":"2024-01-24T13:06:34.375158+0000","last_became_active":"2024-01-24T13:06:33.393249+0000","last_became_peered":"2024-01-24T13:06:33.393249+0000","last_unstale":"2024-01-24T13:06:34.375158+0000","last_undegraded":"2024-01-24T13:06:34.375158+0000","last_fullsized":"2024-01-24T13:06:34.375158+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:26:43.515702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.960698+0000","last_change":"2024-01-24T13:06:31.960698+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.960698+0000","last_undegraded":"2024-01-24T13:06:31.960698+0000","last_fullsized":"2024-01-24T13:06:31.960698+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:35:10.934452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T13:06:32.955728+0000","last_change":"2024-01-24T13:06:32.955728+0000","last_active":"2024-01-24T13:06:32.955728+0000","last_peered":"2024-01-24T13:06:32.955728+0000","last_clean":"2024-01-24T13:06:32.955728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:32.955728+0000","last_undegraded":"2024-01-24T13:06:32.955728+0000","last_fullsized":"2024-01-24T13:06:32.955728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375242+0000","last_change":"2024-01-24T13:06:32.978254+0000","last_active":"2024-01-24T13:06:34.375242+0000","last_peered":"2024-01-24T13:06:34.375242+0000","last_clean":"2024-01-24T13:06:34.375242+0000","last_became_active":"2024-01-24T13:06:32.977940+0000","last_became_peered":"2024-01-24T13:06:32.977940+0000","last_unstale":"2024-01-24T13:06:34.375242+0000","last_undegraded":"2024-01-24T13:06:34.375242+0000","last_fullsized":"2024-01-24T13:06:34.375242+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:27:03.333403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375333+0000","last_change":"2024-01-24T13:06:33.403559+0000","last_active":"2024-01-24T13:06:34.375333+0000","last_peered":"2024-01-24T13:06:34.375333+0000","last_clean":"2024-01-24T13:06:34.375333+0000","last_became_active":"2024-01-24T13:06:33.403199+0000","last_became_peered":"2024-01-24T13:06:33.403199+0000","last_unstale":"2024-01-24T13:06:34.375333+0000","last_undegraded":"2024-01-24T13:06:34.375333+0000","last_fullsized":"2024-01-24T13:06:34.375333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:10:40.996705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-01-24T13:06:31.958648+0000","last_change":"2024-01-24T13:06:31.958648+0000","last_active":"2024-01-24T13:06:31.948336+0000","last_peered":"2024-01-24T13:06:31.948336+0000","last_clean":"2024-01-24T13:06:31.948336+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T13:06:31.958648+0000","last_undegraded":"2024-01-24T13:06:31.958648+0000","last_fullsized":"2024-01-24T13:06:31.958648+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":192,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-24T13:06:30.231173+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:06:30.231173+0000","last_peered":"2024-01-24T13:06:30.231173+0000","last_clean":"2024-01-24T13:06:30.231173+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:06:30.231173+0000","last_undegraded":"2024-01-24T13:06:30.231173+0000","last_fullsized":"2024-01-24T13:06:30.231173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":285031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.47099999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83799999999999997,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79800000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.61499999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.53800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92700000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.745,"15min":0.755},"min":{"1min":0.56599999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84399999999999997,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.56000000000000005}]},{"osd":3,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.61299999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.89700000000000002,"5min":1.131,"15min":1.131},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.93999999999999995,"5min":1.05,"15min":1.05},"last":0.67500000000000004}]},{"osd":4,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63400000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77300000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.873,"5min":1.341,"15min":1.341},"last":0.746}]},{"osd":5,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89600000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92400000000000004,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54300000000000004}]},{"osd":6,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96599999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91200000000000003,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.60599999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.46600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91500000000000004,"5min":2.827,"15min":2.827},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81000000000000005,"5min":2.052,"15min":2.052},"last":0.72399999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.72299999999999998,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86699999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.92300000000000004,"15min":0.97099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.74099999999999999,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.77200000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.85199999999999998,"15min":0.88600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.83899999999999997,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.94299999999999995,"15min":0.98499999999999999},"min":{"1min":0.54200000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.83999999999999997,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.93999999999999995}]},{"osd":3,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.91700000000000004,"15min":0.95899999999999996},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80600000000000005,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.82199999999999995,"15min":0.84699999999999998},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.85099999999999998,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90300000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.80200000000000005}]},{"osd":5,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.47899999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84699999999999998,"5min":4.274,"15min":4.274},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.81200000000000006,"15min":0.82199999999999995},"min":{"1min":0.63,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88800000000000001,"5min":2.645,"15min":2.645},"last":0.69899999999999995}]},{"osd":7,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.84499999999999997,"15min":0.873},"min":{"1min":0.50900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86699999999999999,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.86199999999999999,"15min":0.88600000000000001},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.92400000000000004,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.628}]}]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63900000000000001,"15min":0.63300000000000001},"min":{"1min":0.47599999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.79500000000000004}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98399999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.014,"5min":1.484,"15min":1.484},"last":0.77800000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68200000000000005,"15min":0.67400000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.878},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.66500000000000004}]},{"osd":3,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.51400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58199999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.629},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.97999999999999998,"5min":1.002,"15min":1.002},"last":0.60399999999999998}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.499,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.54200000000000004}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70299999999999996,"15min":0.69999999999999996},"min":{"1min":0.55500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.59699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95299999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75900000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":651264,"data_stored":285031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.433,"15min":0.44500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53100000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.495},{"interface":"front","average":{"1min":0.443,"5min":0.46300000000000002,"15min":0.46600000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.58199999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.40400000000000003}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46600000000000003,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55300000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68200000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.59899999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.435},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60599999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45300000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.75,"15min":0.76500000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.91500000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78500000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.86299999999999999,"5min":1.014,"15min":1.014},"last":0.81799999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88300000000000001,"5min":1.032,"15min":1.032},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72699999999999998}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79600000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.90500000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.82499999999999996,"15min":0.84499999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.89400000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.83199999999999996,"15min":0.85099999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.875,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":0.85899999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.752}]}]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.46700000000000003,"15min":0.48399999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54300000000000004,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91900000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52400000000000002}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.53100000000000003,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64100000000000001,"5min":1.379,"15min":1.379},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.374,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88700000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.60899999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.63400000000000001,"15min":0.65800000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67700000000000005,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89500000000000002,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97699999999999998,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.98999999999999999}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.52200000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.099,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98499999999999999,"5min":1.448,"15min":1.448},"last":1.115}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.58299999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94099999999999995,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.079},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0449999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0920000000000001}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95999999999999996,"5min":1.554,"15min":1.554},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.84399999999999997,"15min":0.86199999999999999},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0760000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1539999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1257472,"data_stored":881536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64900000000000002,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.502},{"interface":"front","average":{"1min":0.441,"5min":0.57899999999999996,"15min":0.60199999999999998},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82999999999999996,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66600000000000004,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.59199999999999997,"15min":0.61199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":1.958,"15min":1.958},"last":0.61399999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.65800000000000003,"15min":0.67900000000000005},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.626}]},{"osd":4,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.81599999999999995,"15min":0.83999999999999997},"min":{"1min":0.51500000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80200000000000005,"5min":1.601,"15min":1.601},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.84199999999999997,"15min":0.86799999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93799999999999994,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.73199999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.83499999999999996,"15min":0.85699999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.92200000000000004,"5min":1.627,"15min":1.627},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.90100000000000002,"15min":0.93100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.94099999999999995,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.76600000000000001}]},{"osd":6,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.85899999999999999,"15min":0.88500000000000001},"min":{"1min":0.54400000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91700000000000004,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.83799999999999997,"15min":0.85799999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89300000000000002,"5min":1.421,"15min":1.421},"last":0.86699999999999999}]},{"osd":7,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.84499999999999997,"15min":0.86599999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91800000000000004,"5min":1.452,"15min":1.452},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.879,"15min":0.90500000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94599999999999995,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.75}]}]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":291168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.47699999999999998,"15min":0.49299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61399999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.71299999999999997,"15min":0.75700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65500000000000003,"5min":5.556,"15min":5.556},"last":0.442}]},{"osd":2,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.74099999999999999,"15min":0.78300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61099999999999999,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.64200000000000002,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.57299999999999995,"15min":0.59499999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65700000000000003,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.57799999999999996}]},{"osd":4,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.56899999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90900000000000003,"5min":1.925,"15min":1.925},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.626,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97599999999999998,"5min":1.512,"15min":1.512},"last":0.77700000000000002}]},{"osd":5,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0169999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.874},{"interface":"front","average":{"1min":0.755,"5min":0.83699999999999997,"15min":0.85099999999999998},"min":{"1min":0.66200000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.90900000000000003,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.60699999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.91800000000000004,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.621},{"interface":"front","average":{"1min":0.753,"5min":0.84299999999999997,"15min":0.85799999999999998},"min":{"1min":0.64400000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.96199999999999997,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.84899999999999998}]},{"osd":7,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.84999999999999998,"15min":0.86599999999999999},"min":{"1min":0.65400000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.84099999999999997,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0389999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.71399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1298432,"data_stored":901880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90000000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93899999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.67000000000000004}]},{"osd":1,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84099999999999997,"5min":0.872,"15min":0.872},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.42699999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.92600000000000005,"5min":1.012,"15min":1.012},"last":0.74099999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.55200000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93600000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.60499999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.871,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.75700000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97099999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88500000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91000000000000003,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92000000000000004,"5min":1.107,"15min":1.107},"last":0.81499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:06:42.046 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:06:42.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.194+0000 7fb4dc800640 1 Processor -- start 2024-01-24T13:06:42.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.194+0000 7fb4dc800640 1 -- start start 2024-01-24T13:06:42.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.198+0000 7fb4dc800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4d4143910 0x7fb4d4143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.198+0000 7fb4dc800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb4d406c320 0x7fb4d40cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.198+0000 7fb4dc800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d415aa30 con 0x7fb4d4070ac0 2024-01-24T13:06:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.198+0000 7fb4dc800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d40712a0 con 0x7fb4d406c320 2024-01-24T13:06:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.198+0000 7fb4dc800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d4071580 con 0x7fb4d4143910 2024-01-24T13:06:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.198+0000 7fb4da800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb4d406c320 0x7fb4d40cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.198+0000 7fb4da800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb4d406c320 0x7fb4d40cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58118/0 (socket says 172.21.15.29:58118) 2024-01-24T13:06:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.198+0000 7fb4da800640 1 -- 172.21.15.29:0/3859110125 learned_addr learned my addr 172.21.15.29:0/3859110125 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.198+0000 7fb4d9e00640 1 --2- 172.21.15.29:0/3859110125 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4d4143910 0x7fb4d4143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.198+0000 7fb4da800640 1 -- 172.21.15.29:0/3859110125 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4d4143910 msgr2=0x7fb4d4143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.198+0000 7fb4da800640 1 --2- 172.21.15.29:0/3859110125 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4d4143910 0x7fb4d4143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.198+0000 7fb4da800640 1 -- 172.21.15.29:0/3859110125 >> v1:172.21.15.163:6789/0 conn(0x7fb4d4070ac0 legacy=0x7fb4d406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.198+0000 7fb4da800640 1 -- 172.21.15.29:0/3859110125 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d40cd090 con 0x7fb4d406c320 2024-01-24T13:06:42.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.202+0000 7fb4da800640 1 --2- 172.21.15.29:0/3859110125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4d406c320 0x7fb4d40cd890 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc009e50 tx=0x7fb4cc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cabca47722bd0b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:42.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.202+0000 7fb4d8a00640 1 -- 172.21.15.29:0/3859110125 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc0a5890 con 0x7fb4d406c320 2024-01-24T13:06:42.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.202+0000 7fb4d8a00640 1 -- 172.21.15.29:0/3859110125 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4cc0a59f0 con 0x7fb4d406c320 2024-01-24T13:06:42.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.202+0000 7fb4d8a00640 1 -- 172.21.15.29:0/3859110125 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc0a5d80 con 0x7fb4d406c320 2024-01-24T13:06:42.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.202+0000 7fb4dc800640 1 -- 172.21.15.29:0/3859110125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4d406c320 msgr2=0x7fb4d40cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:42.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.202+0000 7fb4dc800640 1 --2- 172.21.15.29:0/3859110125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4d406c320 0x7fb4d40cd890 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc009e50 tx=0x7fb4cc01c9e0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.202+0000 7fb4dc800640 1 -- 172.21.15.29:0/3859110125 shutdown_connections 2024-01-24T13:06:42.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.202+0000 7fb4dc800640 1 --2- 172.21.15.29:0/3859110125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4d406c320 0x7fb4d40cd890 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.202+0000 7fb4dc800640 1 --2- 172.21.15.29:0/3859110125 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4d4143910 0x7fb4d4143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.202+0000 7fb4dc800640 1 -- 172.21.15.29:0/3859110125 >> 172.21.15.29:0/3859110125 conn(0x7fb4d40b3950 msgr2=0x7fb4d4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:42.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.202+0000 7fb4dc800640 1 -- 172.21.15.29:0/3859110125 shutdown_connections 2024-01-24T13:06:42.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.202+0000 7fb4dc800640 1 -- 172.21.15.29:0/3859110125 wait complete. 2024-01-24T13:06:42.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.202+0000 7fb4dc800640 1 Processor -- start 2024-01-24T13:06:42.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.202+0000 7fb4dc800640 1 -- start start 2024-01-24T13:06:42.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4dc800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb4d406c320 0x7fb4d413d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:42.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4dc800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4d4070ac0 0x7fb4d4158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:42.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4dc800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4d4143910 0x7fb4d415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:42.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4dc800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d41539f0 con 0x7fb4d4143910 2024-01-24T13:06:42.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4dc800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d4139a80 con 0x7fb4d406c320 2024-01-24T13:06:42.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4dc800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d4153350 con 0x7fb4d4070ac0 2024-01-24T13:06:42.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4da800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4d4143910 0x7fb4d415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:42.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4d9400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4d4070ac0 0x7fb4d4158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:42.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4d9e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb4d406c320 0x7fb4d413d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:42.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4d9400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4d4070ac0 0x7fb4d4158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:51786/0 (socket says 172.21.15.29:51786) 2024-01-24T13:06:42.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4d9400640 1 -- 172.21.15.29:0/161236097 learned_addr learned my addr 172.21.15.29:0/161236097 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:42.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4d9400640 1 -- 172.21.15.29:0/161236097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb4d406c320 msgr2=0x7fb4d413d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:42.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4d9400640 1 --2- 172.21.15.29:0/161236097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb4d406c320 0x7fb4d413d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4d9400640 1 -- 172.21.15.29:0/161236097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4d4143910 msgr2=0x7fb4d415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:42.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4d9400640 1 --2- 172.21.15.29:0/161236097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4d4143910 0x7fb4d415c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4d9400640 1 -- 172.21.15.29:0/161236097 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4cc009b30 con 0x7fb4d4070ac0 2024-01-24T13:06:42.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4d9e00640 1 --2- 172.21.15.29:0/161236097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb4d406c320 0x7fb4d413d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:42.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4da800640 1 --2- 172.21.15.29:0/161236097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4d4143910 0x7fb4d415c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:42.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4d9400640 1 --2- 172.21.15.29:0/161236097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4d4070ac0 0x7fb4d4158f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00c500 tx=0x7fb4bc00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:42.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4d2000640 1 -- 172.21.15.29:0/161236097 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc005220 con 0x7fb4d4070ac0 2024-01-24T13:06:42.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4d2000640 1 -- 172.21.15.29:0/161236097 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc005380 con 0x7fb4d4070ac0 2024-01-24T13:06:42.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4dc800640 1 -- 172.21.15.29:0/161236097 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d415b980 con 0x7fb4d4070ac0 2024-01-24T13:06:42.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4d2000640 1 -- 172.21.15.29:0/161236097 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc007270 con 0x7fb4d4070ac0 2024-01-24T13:06:42.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4dc800640 1 -- 172.21.15.29:0/161236097 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d4153610 con 0x7fb4d4070ac0 2024-01-24T13:06:42.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.206+0000 7fb4dc800640 1 -- 172.21.15.29:0/161236097 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d4153b30 con 0x7fb4d4070ac0 2024-01-24T13:06:42.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.210+0000 7fb4d2000640 1 -- 172.21.15.29:0/161236097 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb4bc0073d0 con 0x7fb4d4070ac0 2024-01-24T13:06:42.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.210+0000 7fb4d2000640 1 --2- 172.21.15.29:0/161236097 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb4ac065a60 0x7fb4ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:42.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.210+0000 7fb4d2000640 1 -- 172.21.15.29:0/161236097 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb4bc082a00 con 0x7fb4d4070ac0 2024-01-24T13:06:42.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.210+0000 7fb4d9e00640 1 --2- 172.21.15.29:0/161236097 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb4ac065a60 0x7fb4ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:42.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.210+0000 7fb4d9e00640 1 --2- 172.21.15.29:0/161236097 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb4ac065a60 0x7fb4ac067f20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4007db0 tx=0x7fb4c4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:42.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.214+0000 7fb4d2000640 1 -- 172.21.15.29:0/161236097 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb4d4153b30 con 0x7fb4d4070ac0 2024-01-24T13:06:42.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.370+0000 7fb4dc800640 1 -- 172.21.15.29:0/161236097 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4d40ce5e0 con 0x7fb4ac065a60 2024-01-24T13:06:42.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.378+0000 7fb4d2000640 1 -- 172.21.15.29:0/161236097 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289693 (secure 0 0 0) 0x7fb4c4007a00 con 0x7fb4ac065a60 2024-01-24T13:06:42.384 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:42.385 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:06:42.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.382+0000 7fb4dc800640 1 -- 172.21.15.29:0/161236097 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb4ac065a60 msgr2=0x7fb4ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:42.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.382+0000 7fb4dc800640 1 --2- 172.21.15.29:0/161236097 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb4ac065a60 0x7fb4ac067f20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4007db0 tx=0x7fb4c4008040 comp rx=0 tx=0).stop 2024-01-24T13:06:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.382+0000 7fb4dc800640 1 -- 172.21.15.29:0/161236097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4d4070ac0 msgr2=0x7fb4d4158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.382+0000 7fb4dc800640 1 --2- 172.21.15.29:0/161236097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4d4070ac0 0x7fb4d4158f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00c500 tx=0x7fb4bc00c9c0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.382+0000 7fb4dc800640 1 -- 172.21.15.29:0/161236097 shutdown_connections 2024-01-24T13:06:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.382+0000 7fb4dc800640 1 --2- 172.21.15.29:0/161236097 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb4ac065a60 0x7fb4ac067f20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.382+0000 7fb4dc800640 1 --2- 172.21.15.29:0/161236097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4d4143910 0x7fb4d415c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.382+0000 7fb4dc800640 1 --2- 172.21.15.29:0/161236097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4d4070ac0 0x7fb4d4158f80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.382+0000 7fb4dc800640 1 --2- 172.21.15.29:0/161236097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb4d406c320 0x7fb4d413d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.382+0000 7fb4dc800640 1 -- 172.21.15.29:0/161236097 >> 172.21.15.29:0/161236097 conn(0x7fb4d40b3950 msgr2=0x7fb4d4140070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.382+0000 7fb4dc800640 1 -- 172.21.15.29:0/161236097 shutdown_connections 2024-01-24T13:06:42.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.382+0000 7fb4dc800640 1 -- 172.21.15.29:0/161236097 wait complete. 2024-01-24T13:06:42.404 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-01-24T13:06:41.577719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239296,"kb_used_data":6696,"kb_used_omap":13,"kb_used_meta":232434,"kb_avail":754735424,"statfs":{"total":773094113280,"available":772849074176,"internally_reserved":0,"allocated":6856704,"data_stored":3677284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":238012504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.209308"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559384+0000","last_change":"2024-01-24T13:06:33.399920+0000","last_active":"2024-01-24T13:06:34.559384+0000","last_peered":"2024-01-24T13:06:34.559384+0000","last_clean":"2024-01-24T13:06:34.559384+0000","last_became_active":"2024-01-24T13:06:33.399143+0000","last_became_peered":"2024-01-24T13:06:33.399143+0000","last_unstale":"2024-01-24T13:06:34.559384+0000","last_undegraded":"2024-01-24T13:06:34.559384+0000","last_fullsized":"2024-01-24T13:06:34.559384+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:57.088960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559482+0000","last_change":"2024-01-24T13:06:33.386205+0000","last_active":"2024-01-24T13:06:34.559482+0000","last_peered":"2024-01-24T13:06:34.559482+0000","last_clean":"2024-01-24T13:06:34.559482+0000","last_became_active":"2024-01-24T13:06:33.385832+0000","last_became_peered":"2024-01-24T13:06:33.385832+0000","last_unstale":"2024-01-24T13:06:34.559482+0000","last_undegraded":"2024-01-24T13:06:34.559482+0000","last_fullsized":"2024-01-24T13:06:34.559482+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:36:02.531099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559107+0000","last_change":"2024-01-24T13:06:33.385200+0000","last_active":"2024-01-24T13:06:34.559107+0000","last_peered":"2024-01-24T13:06:34.559107+0000","last_clean":"2024-01-24T13:06:34.559107+0000","last_became_active":"2024-01-24T13:06:33.384959+0000","last_became_peered":"2024-01-24T13:06:33.384959+0000","last_unstale":"2024-01-24T13:06:34.559107+0000","last_undegraded":"2024-01-24T13:06:34.559107+0000","last_fullsized":"2024-01-24T13:06:34.559107+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:51:23.985387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559085+0000","last_change":"2024-01-24T13:06:33.391529+0000","last_active":"2024-01-24T13:06:34.559085+0000","last_peered":"2024-01-24T13:06:34.559085+0000","last_clean":"2024-01-24T13:06:34.559085+0000","last_became_active":"2024-01-24T13:06:33.391142+0000","last_became_peered":"2024-01-24T13:06:33.391142+0000","last_unstale":"2024-01-24T13:06:34.559085+0000","last_undegraded":"2024-01-24T13:06:34.559085+0000","last_fullsized":"2024-01-24T13:06:34.559085+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T01:03:52.526947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558634+0000","last_change":"2024-01-24T13:06:33.404344+0000","last_active":"2024-01-24T13:06:34.558634+0000","last_peered":"2024-01-24T13:06:34.558634+0000","last_clean":"2024-01-24T13:06:34.558634+0000","last_became_active":"2024-01-24T13:06:33.402892+0000","last_became_peered":"2024-01-24T13:06:33.402892+0000","last_unstale":"2024-01-24T13:06:34.558634+0000","last_undegraded":"2024-01-24T13:06:34.558634+0000","last_fullsized":"2024-01-24T13:06:34.558634+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:26:16.273236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558716+0000","last_change":"2024-01-24T13:06:33.399856+0000","last_active":"2024-01-24T13:06:34.558716+0000","last_peered":"2024-01-24T13:06:34.558716+0000","last_clean":"2024-01-24T13:06:34.558716+0000","last_became_active":"2024-01-24T13:06:33.399508+0000","last_became_peered":"2024-01-24T13:06:33.399508+0000","last_unstale":"2024-01-24T13:06:34.558716+0000","last_undegraded":"2024-01-24T13:06:34.558716+0000","last_fullsized":"2024-01-24T13:06:34.558716+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:25:54.635950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558461+0000","last_change":"2024-01-24T13:06:33.391326+0000","last_active":"2024-01-24T13:06:34.558461+0000","last_peered":"2024-01-24T13:06:34.558461+0000","last_clean":"2024-01-24T13:06:34.558461+0000","last_became_active":"2024-01-24T13:06:33.391017+0000","last_became_peered":"2024-01-24T13:06:33.391017+0000","last_unstale":"2024-01-24T13:06:34.558461+0000","last_undegraded":"2024-01-24T13:06:34.558461+0000","last_fullsized":"2024-01-24T13:06:34.558461+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:34:20.452166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375060+0000","last_change":"2024-01-24T13:06:33.406014+0000","last_active":"2024-01-24T13:06:34.375060+0000","last_peered":"2024-01-24T13:06:34.375060+0000","last_clean":"2024-01-24T13:06:34.375060+0000","last_became_active":"2024-01-24T13:06:33.405730+0000","last_became_peered":"2024-01-24T13:06:33.405730+0000","last_unstale":"2024-01-24T13:06:34.375060+0000","last_undegraded":"2024-01-24T13:06:34.375060+0000","last_fullsized":"2024-01-24T13:06:34.375060+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:27:37.923610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559195+0000","last_change":"2024-01-24T13:06:33.386788+0000","last_active":"2024-01-24T13:06:34.559195+0000","last_peered":"2024-01-24T13:06:34.559195+0000","last_clean":"2024-01-24T13:06:34.559195+0000","last_became_active":"2024-01-24T13:06:33.386527+0000","last_became_peered":"2024-01-24T13:06:33.386527+0000","last_unstale":"2024-01-24T13:06:34.559195+0000","last_undegraded":"2024-01-24T13:06:34.559195+0000","last_fullsized":"2024-01-24T13:06:34.559195+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:38:06.521937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559195+0000","last_change":"2024-01-24T13:06:33.386916+0000","last_active":"2024-01-24T13:06:34.559195+0000","last_peered":"2024-01-24T13:06:34.559195+0000","last_clean":"2024-01-24T13:06:34.559195+0000","last_became_active":"2024-01-24T13:06:33.386684+0000","last_became_peered":"2024-01-24T13:06:33.386684+0000","last_unstale":"2024-01-24T13:06:34.559195+0000","last_undegraded":"2024-01-24T13:06:34.559195+0000","last_fullsized":"2024-01-24T13:06:34.559195+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T01:06:04.610278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375610+0000","last_change":"2024-01-24T13:06:33.403274+0000","last_active":"2024-01-24T13:06:34.375610+0000","last_peered":"2024-01-24T13:06:34.375610+0000","last_clean":"2024-01-24T13:06:34.375610+0000","last_became_active":"2024-01-24T13:06:33.401770+0000","last_became_peered":"2024-01-24T13:06:33.401770+0000","last_unstale":"2024-01-24T13:06:34.375610+0000","last_undegraded":"2024-01-24T13:06:34.375610+0000","last_fullsized":"2024-01-24T13:06:34.375610+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:39:48.195279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558817+0000","last_change":"2024-01-24T13:06:33.390239+0000","last_active":"2024-01-24T13:06:34.558817+0000","last_peered":"2024-01-24T13:06:34.558817+0000","last_clean":"2024-01-24T13:06:34.558817+0000","last_became_active":"2024-01-24T13:06:33.389977+0000","last_became_peered":"2024-01-24T13:06:33.389977+0000","last_unstale":"2024-01-24T13:06:34.558817+0000","last_undegraded":"2024-01-24T13:06:34.558817+0000","last_fullsized":"2024-01-24T13:06:34.558817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:24:10.812123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.373498+0000","last_change":"2024-01-24T13:06:33.387079+0000","last_active":"2024-01-24T13:06:34.373498+0000","last_peered":"2024-01-24T13:06:34.373498+0000","last_clean":"2024-01-24T13:06:34.373498+0000","last_became_active":"2024-01-24T13:06:33.386776+0000","last_became_peered":"2024-01-24T13:06:33.386776+0000","last_unstale":"2024-01-24T13:06:34.373498+0000","last_undegraded":"2024-01-24T13:06:34.373498+0000","last_fullsized":"2024-01-24T13:06:34.373498+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:23:54.812691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558289+0000","last_change":"2024-01-24T13:06:33.389628+0000","last_active":"2024-01-24T13:06:34.558289+0000","last_peered":"2024-01-24T13:06:34.558289+0000","last_clean":"2024-01-24T13:06:34.558289+0000","last_became_active":"2024-01-24T13:06:33.389363+0000","last_became_peered":"2024-01-24T13:06:33.389363+0000","last_unstale":"2024-01-24T13:06:34.558289+0000","last_undegraded":"2024-01-24T13:06:34.558289+0000","last_fullsized":"2024-01-24T13:06:34.558289+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:25:45.972886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.373260+0000","last_change":"2024-01-24T13:06:33.387022+0000","last_active":"2024-01-24T13:06:34.373260+0000","last_peered":"2024-01-24T13:06:34.373260+0000","last_clean":"2024-01-24T13:06:34.373260+0000","last_became_active":"2024-01-24T13:06:33.386716+0000","last_became_peered":"2024-01-24T13:06:33.386716+0000","last_unstale":"2024-01-24T13:06:34.373260+0000","last_undegraded":"2024-01-24T13:06:34.373260+0000","last_fullsized":"2024-01-24T13:06:34.373260+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:22:13.092207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558429+0000","last_change":"2024-01-24T13:06:33.397930+0000","last_active":"2024-01-24T13:06:34.558429+0000","last_peered":"2024-01-24T13:06:34.558429+0000","last_clean":"2024-01-24T13:06:34.558429+0000","last_became_active":"2024-01-24T13:06:33.397530+0000","last_became_peered":"2024-01-24T13:06:33.397530+0000","last_unstale":"2024-01-24T13:06:34.558429+0000","last_undegraded":"2024-01-24T13:06:34.558429+0000","last_fullsized":"2024-01-24T13:06:34.558429+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:20:03.903452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559382+0000","last_change":"2024-01-24T13:06:33.388186+0000","last_active":"2024-01-24T13:06:34.559382+0000","last_peered":"2024-01-24T13:06:34.559382+0000","last_clean":"2024-01-24T13:06:34.559382+0000","last_became_active":"2024-01-24T13:06:33.386759+0000","last_became_peered":"2024-01-24T13:06:33.386759+0000","last_unstale":"2024-01-24T13:06:34.559382+0000","last_undegraded":"2024-01-24T13:06:34.559382+0000","last_fullsized":"2024-01-24T13:06:34.559382+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:05:35.553969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559344+0000","last_change":"2024-01-24T13:06:33.380286+0000","last_active":"2024-01-24T13:06:34.559344+0000","last_peered":"2024-01-24T13:06:34.559344+0000","last_clean":"2024-01-24T13:06:34.559344+0000","last_became_active":"2024-01-24T13:06:33.379858+0000","last_became_peered":"2024-01-24T13:06:33.379858+0000","last_unstale":"2024-01-24T13:06:34.559344+0000","last_undegraded":"2024-01-24T13:06:34.559344+0000","last_fullsized":"2024-01-24T13:06:34.559344+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:03:09.167068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559435+0000","last_change":"2024-01-24T13:06:33.402904+0000","last_active":"2024-01-24T13:06:34.559435+0000","last_peered":"2024-01-24T13:06:34.559435+0000","last_clean":"2024-01-24T13:06:34.559435+0000","last_became_active":"2024-01-24T13:06:33.402632+0000","last_became_peered":"2024-01-24T13:06:33.402632+0000","last_unstale":"2024-01-24T13:06:34.559435+0000","last_undegraded":"2024-01-24T13:06:34.559435+0000","last_fullsized":"2024-01-24T13:06:34.559435+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:38:06.521937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375565+0000","last_change":"2024-01-24T13:06:33.395902+0000","last_active":"2024-01-24T13:06:34.375565+0000","last_peered":"2024-01-24T13:06:34.375565+0000","last_clean":"2024-01-24T13:06:34.375565+0000","last_became_active":"2024-01-24T13:06:33.391093+0000","last_became_peered":"2024-01-24T13:06:33.391093+0000","last_unstale":"2024-01-24T13:06:34.375565+0000","last_undegraded":"2024-01-24T13:06:34.375565+0000","last_fullsized":"2024-01-24T13:06:34.375565+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:49:11.733740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.373520+0000","last_change":"2024-01-24T13:06:33.385612+0000","last_active":"2024-01-24T13:06:34.373520+0000","last_peered":"2024-01-24T13:06:34.373520+0000","last_clean":"2024-01-24T13:06:34.373520+0000","last_became_active":"2024-01-24T13:06:33.385012+0000","last_became_peered":"2024-01-24T13:06:33.385012+0000","last_unstale":"2024-01-24T13:06:34.373520+0000","last_undegraded":"2024-01-24T13:06:34.373520+0000","last_fullsized":"2024-01-24T13:06:34.373520+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:38:06.521937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375274+0000","last_change":"2024-01-24T13:06:33.395434+0000","last_active":"2024-01-24T13:06:34.375274+0000","last_peered":"2024-01-24T13:06:34.375274+0000","last_clean":"2024-01-24T13:06:34.375274+0000","last_became_active":"2024-01-24T13:06:33.395074+0000","last_became_peered":"2024-01-24T13:06:33.395074+0000","last_unstale":"2024-01-24T13:06:34.375274+0000","last_undegraded":"2024-01-24T13:06:34.375274+0000","last_fullsized":"2024-01-24T13:06:34.375274+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:43:41.457844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558545+0000","last_change":"2024-01-24T13:06:33.387792+0000","last_active":"2024-01-24T13:06:34.558545+0000","last_peered":"2024-01-24T13:06:34.558545+0000","last_clean":"2024-01-24T13:06:34.558545+0000","last_became_active":"2024-01-24T13:06:33.387546+0000","last_became_peered":"2024-01-24T13:06:33.387546+0000","last_unstale":"2024-01-24T13:06:34.558545+0000","last_undegraded":"2024-01-24T13:06:34.558545+0000","last_fullsized":"2024-01-24T13:06:34.558545+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T01:03:18.616127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558628+0000","last_change":"2024-01-24T13:06:33.388272+0000","last_active":"2024-01-24T13:06:34.558628+0000","last_peered":"2024-01-24T13:06:34.558628+0000","last_clean":"2024-01-24T13:06:34.558628+0000","last_became_active":"2024-01-24T13:06:33.387923+0000","last_became_peered":"2024-01-24T13:06:33.387923+0000","last_unstale":"2024-01-24T13:06:34.558628+0000","last_undegraded":"2024-01-24T13:06:34.558628+0000","last_fullsized":"2024-01-24T13:06:34.558628+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:22:13.092207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559441+0000","last_change":"2024-01-24T13:06:33.391671+0000","last_active":"2024-01-24T13:06:34.559441+0000","last_peered":"2024-01-24T13:06:34.559441+0000","last_clean":"2024-01-24T13:06:34.559441+0000","last_became_active":"2024-01-24T13:06:33.390725+0000","last_became_peered":"2024-01-24T13:06:33.390725+0000","last_unstale":"2024-01-24T13:06:34.559441+0000","last_undegraded":"2024-01-24T13:06:34.559441+0000","last_fullsized":"2024-01-24T13:06:34.559441+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:08.089905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.373732+0000","last_change":"2024-01-24T13:06:33.399267+0000","last_active":"2024-01-24T13:06:34.373732+0000","last_peered":"2024-01-24T13:06:34.373732+0000","last_clean":"2024-01-24T13:06:34.373732+0000","last_became_active":"2024-01-24T13:06:33.399015+0000","last_became_peered":"2024-01-24T13:06:33.399015+0000","last_unstale":"2024-01-24T13:06:34.373732+0000","last_undegraded":"2024-01-24T13:06:34.373732+0000","last_fullsized":"2024-01-24T13:06:34.373732+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:29:49.439075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559525+0000","last_change":"2024-01-24T13:06:33.382508+0000","last_active":"2024-01-24T13:06:34.559525+0000","last_peered":"2024-01-24T13:06:34.559525+0000","last_clean":"2024-01-24T13:06:34.559525+0000","last_became_active":"2024-01-24T13:06:33.382256+0000","last_became_peered":"2024-01-24T13:06:33.382256+0000","last_unstale":"2024-01-24T13:06:34.559525+0000","last_undegraded":"2024-01-24T13:06:34.559525+0000","last_fullsized":"2024-01-24T13:06:34.559525+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:23:54.812691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375822+0000","last_change":"2024-01-24T13:06:33.400907+0000","last_active":"2024-01-24T13:06:34.375822+0000","last_peered":"2024-01-24T13:06:34.375822+0000","last_clean":"2024-01-24T13:06:34.375822+0000","last_became_active":"2024-01-24T13:06:33.400591+0000","last_became_peered":"2024-01-24T13:06:33.400591+0000","last_unstale":"2024-01-24T13:06:34.375822+0000","last_undegraded":"2024-01-24T13:06:34.375822+0000","last_fullsized":"2024-01-24T13:06:34.375822+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:26:32.145531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375405+0000","last_change":"2024-01-24T13:06:33.392452+0000","last_active":"2024-01-24T13:06:34.375405+0000","last_peered":"2024-01-24T13:06:34.375405+0000","last_clean":"2024-01-24T13:06:34.375405+0000","last_became_active":"2024-01-24T13:06:33.392187+0000","last_became_peered":"2024-01-24T13:06:33.392187+0000","last_unstale":"2024-01-24T13:06:34.375405+0000","last_undegraded":"2024-01-24T13:06:34.375405+0000","last_fullsized":"2024-01-24T13:06:34.375405+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:23:21.241419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558443+0000","last_change":"2024-01-24T13:06:33.388650+0000","last_active":"2024-01-24T13:06:34.558443+0000","last_peered":"2024-01-24T13:06:34.558443+0000","last_clean":"2024-01-24T13:06:34.558443+0000","last_became_active":"2024-01-24T13:06:33.388386+0000","last_became_peered":"2024-01-24T13:06:33.388386+0000","last_unstale":"2024-01-24T13:06:34.558443+0000","last_undegraded":"2024-01-24T13:06:34.558443+0000","last_fullsized":"2024-01-24T13:06:34.558443+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:07:50.916836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558688+0000","last_change":"2024-01-24T13:06:33.385222+0000","last_active":"2024-01-24T13:06:34.558688+0000","last_peered":"2024-01-24T13:06:34.558688+0000","last_clean":"2024-01-24T13:06:34.558688+0000","last_became_active":"2024-01-24T13:06:33.384961+0000","last_became_peered":"2024-01-24T13:06:33.384961+0000","last_unstale":"2024-01-24T13:06:34.558688+0000","last_undegraded":"2024-01-24T13:06:34.558688+0000","last_fullsized":"2024-01-24T13:06:34.558688+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:13:14.838351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.374843+0000","last_change":"2024-01-24T13:06:33.382650+0000","last_active":"2024-01-24T13:06:34.374843+0000","last_peered":"2024-01-24T13:06:34.374843+0000","last_clean":"2024-01-24T13:06:34.374843+0000","last_became_active":"2024-01-24T13:06:33.382398+0000","last_became_peered":"2024-01-24T13:06:33.382398+0000","last_unstale":"2024-01-24T13:06:34.374843+0000","last_undegraded":"2024-01-24T13:06:34.374843+0000","last_fullsized":"2024-01-24T13:06:34.374843+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:47:07.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559228+0000","last_change":"2024-01-24T13:06:33.385695+0000","last_active":"2024-01-24T13:06:34.559228+0000","last_peered":"2024-01-24T13:06:34.559228+0000","last_clean":"2024-01-24T13:06:34.559228+0000","last_became_active":"2024-01-24T13:06:33.385419+0000","last_became_peered":"2024-01-24T13:06:33.385419+0000","last_unstale":"2024-01-24T13:06:34.559228+0000","last_undegraded":"2024-01-24T13:06:34.559228+0000","last_fullsized":"2024-01-24T13:06:34.559228+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:24:52.264512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"58'4","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.407896+0000","last_change":"2024-01-24T13:06:32.988326+0000","last_active":"2024-01-24T13:06:33.407896+0000","last_peered":"2024-01-24T13:06:33.407896+0000","last_clean":"2024-01-24T13:06:33.407896+0000","last_became_active":"2024-01-24T13:06:32.987953+0000","last_became_peered":"2024-01-24T13:06:32.987953+0000","last_unstale":"2024-01-24T13:06:33.407896+0000","last_undegraded":"2024-01-24T13:06:33.407896+0000","last_fullsized":"2024-01-24T13:06:33.407896+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:03:08.159676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559480+0000","last_change":"2024-01-24T13:06:33.400151+0000","last_active":"2024-01-24T13:06:34.559480+0000","last_peered":"2024-01-24T13:06:34.559480+0000","last_clean":"2024-01-24T13:06:34.559480+0000","last_became_active":"2024-01-24T13:06:33.399869+0000","last_became_peered":"2024-01-24T13:06:33.399869+0000","last_unstale":"2024-01-24T13:06:34.559480+0000","last_undegraded":"2024-01-24T13:06:34.559480+0000","last_fullsized":"2024-01-24T13:06:34.559480+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:51:23.985387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.388722+0000","last_change":"2024-01-24T13:06:32.993343+0000","last_active":"2024-01-24T13:06:33.388722+0000","last_peered":"2024-01-24T13:06:33.388722+0000","last_clean":"2024-01-24T13:06:33.388722+0000","last_became_active":"2024-01-24T13:06:32.992916+0000","last_became_peered":"2024-01-24T13:06:32.992916+0000","last_unstale":"2024-01-24T13:06:33.388722+0000","last_undegraded":"2024-01-24T13:06:33.388722+0000","last_fullsized":"2024-01-24T13:06:33.388722+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:40:00.227482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375599+0000","last_change":"2024-01-24T13:06:33.392163+0000","last_active":"2024-01-24T13:06:34.375599+0000","last_peered":"2024-01-24T13:06:34.375599+0000","last_clean":"2024-01-24T13:06:34.375599+0000","last_became_active":"2024-01-24T13:06:33.391881+0000","last_became_peered":"2024-01-24T13:06:33.391881+0000","last_unstale":"2024-01-24T13:06:34.375599+0000","last_undegraded":"2024-01-24T13:06:34.375599+0000","last_fullsized":"2024-01-24T13:06:34.375599+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:47.551144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.395574+0000","last_change":"2024-01-24T13:06:32.991160+0000","last_active":"2024-01-24T13:06:33.395574+0000","last_peered":"2024-01-24T13:06:33.395574+0000","last_clean":"2024-01-24T13:06:33.395574+0000","last_became_active":"2024-01-24T13:06:32.990872+0000","last_became_peered":"2024-01-24T13:06:32.990872+0000","last_unstale":"2024-01-24T13:06:33.395574+0000","last_undegraded":"2024-01-24T13:06:33.395574+0000","last_fullsized":"2024-01-24T13:06:33.395574+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:29:48.431683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558964+0000","last_change":"2024-01-24T13:06:33.389188+0000","last_active":"2024-01-24T13:06:34.558964+0000","last_peered":"2024-01-24T13:06:34.558964+0000","last_clean":"2024-01-24T13:06:34.558964+0000","last_became_active":"2024-01-24T13:06:33.388956+0000","last_became_peered":"2024-01-24T13:06:33.388956+0000","last_unstale":"2024-01-24T13:06:34.558964+0000","last_undegraded":"2024-01-24T13:06:34.558964+0000","last_fullsized":"2024-01-24T13:06:34.558964+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:25:45.972886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.402164+0000","last_change":"2024-01-24T13:06:32.987644+0000","last_active":"2024-01-24T13:06:33.402164+0000","last_peered":"2024-01-24T13:06:33.402164+0000","last_clean":"2024-01-24T13:06:33.402164+0000","last_became_active":"2024-01-24T13:06:32.986646+0000","last_became_peered":"2024-01-24T13:06:32.986646+0000","last_unstale":"2024-01-24T13:06:33.402164+0000","last_undegraded":"2024-01-24T13:06:33.402164+0000","last_fullsized":"2024-01-24T13:06:33.402164+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:39:47.187887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375478+0000","last_change":"2024-01-24T13:06:33.404960+0000","last_active":"2024-01-24T13:06:34.375478+0000","last_peered":"2024-01-24T13:06:34.375478+0000","last_clean":"2024-01-24T13:06:34.375478+0000","last_became_active":"2024-01-24T13:06:33.404311+0000","last_became_peered":"2024-01-24T13:06:33.404311+0000","last_unstale":"2024-01-24T13:06:34.375478+0000","last_undegraded":"2024-01-24T13:06:34.375478+0000","last_fullsized":"2024-01-24T13:06:34.375478+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:26:49.633149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.392504+0000","last_change":"2024-01-24T13:06:32.977444+0000","last_active":"2024-01-24T13:06:33.392504+0000","last_peered":"2024-01-24T13:06:33.392504+0000","last_clean":"2024-01-24T13:06:33.392504+0000","last_became_active":"2024-01-24T13:06:32.977139+0000","last_became_peered":"2024-01-24T13:06:32.977139+0000","last_unstale":"2024-01-24T13:06:33.392504+0000","last_undegraded":"2024-01-24T13:06:33.392504+0000","last_fullsized":"2024-01-24T13:06:33.392504+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:38:05.514545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375380+0000","last_change":"2024-01-24T13:06:33.394343+0000","last_active":"2024-01-24T13:06:34.375380+0000","last_peered":"2024-01-24T13:06:34.375380+0000","last_clean":"2024-01-24T13:06:34.375380+0000","last_became_active":"2024-01-24T13:06:33.393984+0000","last_became_peered":"2024-01-24T13:06:33.393984+0000","last_unstale":"2024-01-24T13:06:34.375380+0000","last_undegraded":"2024-01-24T13:06:34.375380+0000","last_fullsized":"2024-01-24T13:06:34.375380+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:13:11.033215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.393139+0000","last_change":"2024-01-24T13:06:32.987301+0000","last_active":"2024-01-24T13:06:33.393139+0000","last_peered":"2024-01-24T13:06:33.393139+0000","last_clean":"2024-01-24T13:06:33.393139+0000","last_became_active":"2024-01-24T13:06:32.986433+0000","last_became_peered":"2024-01-24T13:06:32.986433+0000","last_unstale":"2024-01-24T13:06:33.393139+0000","last_undegraded":"2024-01-24T13:06:33.393139+0000","last_fullsized":"2024-01-24T13:06:33.393139+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:53:06.966206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558309+0000","last_change":"2024-01-24T13:06:33.400873+0000","last_active":"2024-01-24T13:06:34.558309+0000","last_peered":"2024-01-24T13:06:34.558309+0000","last_clean":"2024-01-24T13:06:34.558309+0000","last_became_active":"2024-01-24T13:06:33.399286+0000","last_became_peered":"2024-01-24T13:06:33.399286+0000","last_unstale":"2024-01-24T13:06:34.558309+0000","last_undegraded":"2024-01-24T13:06:34.558309+0000","last_fullsized":"2024-01-24T13:06:34.558309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:38:11.419654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.379636+0000","last_change":"2024-01-24T13:06:32.982809+0000","last_active":"2024-01-24T13:06:33.379636+0000","last_peered":"2024-01-24T13:06:33.379636+0000","last_clean":"2024-01-24T13:06:33.379636+0000","last_became_active":"2024-01-24T13:06:32.982558+0000","last_became_peered":"2024-01-24T13:06:32.982558+0000","last_unstale":"2024-01-24T13:06:33.379636+0000","last_undegraded":"2024-01-24T13:06:33.379636+0000","last_fullsized":"2024-01-24T13:06:33.379636+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558469+0000","last_change":"2024-01-24T13:06:33.393635+0000","last_active":"2024-01-24T13:06:34.558469+0000","last_peered":"2024-01-24T13:06:34.558469+0000","last_clean":"2024-01-24T13:06:34.558469+0000","last_became_active":"2024-01-24T13:06:33.393320+0000","last_became_peered":"2024-01-24T13:06:33.393320+0000","last_unstale":"2024-01-24T13:06:34.558469+0000","last_undegraded":"2024-01-24T13:06:34.558469+0000","last_fullsized":"2024-01-24T13:06:34.558469+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:22:59.202141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.374598+0000","last_change":"2024-01-24T13:06:32.977444+0000","last_active":"2024-01-24T13:06:33.374598+0000","last_peered":"2024-01-24T13:06:33.374598+0000","last_clean":"2024-01-24T13:06:33.374598+0000","last_became_active":"2024-01-24T13:06:32.977168+0000","last_became_peered":"2024-01-24T13:06:32.977168+0000","last_unstale":"2024-01-24T13:06:33.374598+0000","last_undegraded":"2024-01-24T13:06:33.374598+0000","last_fullsized":"2024-01-24T13:06:33.374598+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:44:14.249644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.373759+0000","last_change":"2024-01-24T13:06:33.393108+0000","last_active":"2024-01-24T13:06:34.373759+0000","last_peered":"2024-01-24T13:06:34.373759+0000","last_clean":"2024-01-24T13:06:34.373759+0000","last_became_active":"2024-01-24T13:06:33.392831+0000","last_became_peered":"2024-01-24T13:06:33.392831+0000","last_unstale":"2024-01-24T13:06:34.373759+0000","last_undegraded":"2024-01-24T13:06:34.373759+0000","last_fullsized":"2024-01-24T13:06:34.373759+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:53:07.973598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.380811+0000","last_change":"2024-01-24T13:06:32.989812+0000","last_active":"2024-01-24T13:06:33.380811+0000","last_peered":"2024-01-24T13:06:33.380811+0000","last_clean":"2024-01-24T13:06:33.380811+0000","last_became_active":"2024-01-24T13:06:32.989500+0000","last_became_peered":"2024-01-24T13:06:32.989500+0000","last_unstale":"2024-01-24T13:06:33.380811+0000","last_undegraded":"2024-01-24T13:06:33.380811+0000","last_fullsized":"2024-01-24T13:06:33.380811+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559433+0000","last_change":"2024-01-24T13:06:33.394905+0000","last_active":"2024-01-24T13:06:34.559433+0000","last_peered":"2024-01-24T13:06:34.559433+0000","last_clean":"2024-01-24T13:06:34.559433+0000","last_became_active":"2024-01-24T13:06:33.393533+0000","last_became_peered":"2024-01-24T13:06:33.393533+0000","last_unstale":"2024-01-24T13:06:34.559433+0000","last_undegraded":"2024-01-24T13:06:34.559433+0000","last_fullsized":"2024-01-24T13:06:34.559433+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:24:46.437503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375785+0000","last_change":"2024-01-24T13:06:32.985695+0000","last_active":"2024-01-24T13:06:34.375785+0000","last_peered":"2024-01-24T13:06:34.375785+0000","last_clean":"2024-01-24T13:06:34.375785+0000","last_became_active":"2024-01-24T13:06:32.985403+0000","last_became_peered":"2024-01-24T13:06:32.985403+0000","last_unstale":"2024-01-24T13:06:34.375785+0000","last_undegraded":"2024-01-24T13:06:34.375785+0000","last_fullsized":"2024-01-24T13:06:34.375785+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:11:33.948670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375718+0000","last_change":"2024-01-24T13:06:33.391836+0000","last_active":"2024-01-24T13:06:34.375718+0000","last_peered":"2024-01-24T13:06:34.375718+0000","last_clean":"2024-01-24T13:06:34.375718+0000","last_became_active":"2024-01-24T13:06:33.391363+0000","last_became_peered":"2024-01-24T13:06:33.391363+0000","last_unstale":"2024-01-24T13:06:34.375718+0000","last_undegraded":"2024-01-24T13:06:34.375718+0000","last_fullsized":"2024-01-24T13:06:34.375718+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:04:35.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.402318+0000","last_change":"2024-01-24T13:06:32.986560+0000","last_active":"2024-01-24T13:06:33.402318+0000","last_peered":"2024-01-24T13:06:33.402318+0000","last_clean":"2024-01-24T13:06:33.402318+0000","last_became_active":"2024-01-24T13:06:32.986252+0000","last_became_peered":"2024-01-24T13:06:32.986252+0000","last_unstale":"2024-01-24T13:06:33.402318+0000","last_undegraded":"2024-01-24T13:06:33.402318+0000","last_fullsized":"2024-01-24T13:06:33.402318+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:13:10.025823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559560+0000","last_change":"2024-01-24T13:06:33.399419+0000","last_active":"2024-01-24T13:06:34.559560+0000","last_peered":"2024-01-24T13:06:34.559560+0000","last_clean":"2024-01-24T13:06:34.559560+0000","last_became_active":"2024-01-24T13:06:33.398762+0000","last_became_peered":"2024-01-24T13:06:33.398762+0000","last_unstale":"2024-01-24T13:06:34.559560+0000","last_undegraded":"2024-01-24T13:06:34.559560+0000","last_fullsized":"2024-01-24T13:06:34.559560+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:30:32.693451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.404181+0000","last_change":"2024-01-24T13:06:32.988237+0000","last_active":"2024-01-24T13:06:33.404181+0000","last_peered":"2024-01-24T13:06:33.404181+0000","last_clean":"2024-01-24T13:06:33.404181+0000","last_became_active":"2024-01-24T13:06:32.987973+0000","last_became_peered":"2024-01-24T13:06:32.987973+0000","last_unstale":"2024-01-24T13:06:33.404181+0000","last_undegraded":"2024-01-24T13:06:33.404181+0000","last_fullsized":"2024-01-24T13:06:33.404181+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558613+0000","last_change":"2024-01-24T13:06:33.395806+0000","last_active":"2024-01-24T13:06:34.558613+0000","last_peered":"2024-01-24T13:06:34.558613+0000","last_clean":"2024-01-24T13:06:34.558613+0000","last_became_active":"2024-01-24T13:06:33.395398+0000","last_became_peered":"2024-01-24T13:06:33.395398+0000","last_unstale":"2024-01-24T13:06:34.558613+0000","last_undegraded":"2024-01-24T13:06:34.558613+0000","last_fullsized":"2024-01-24T13:06:34.558613+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:55:52.425904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375598+0000","last_change":"2024-01-24T13:06:32.981791+0000","last_active":"2024-01-24T13:06:34.375598+0000","last_peered":"2024-01-24T13:06:34.375598+0000","last_clean":"2024-01-24T13:06:34.375598+0000","last_became_active":"2024-01-24T13:06:32.981523+0000","last_became_peered":"2024-01-24T13:06:32.981523+0000","last_unstale":"2024-01-24T13:06:34.375598+0000","last_undegraded":"2024-01-24T13:06:34.375598+0000","last_fullsized":"2024-01-24T13:06:34.375598+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:46:44.914023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558496+0000","last_change":"2024-01-24T13:06:33.383396+0000","last_active":"2024-01-24T13:06:34.558496+0000","last_peered":"2024-01-24T13:06:34.558496+0000","last_clean":"2024-01-24T13:06:34.558496+0000","last_became_active":"2024-01-24T13:06:33.383105+0000","last_became_peered":"2024-01-24T13:06:33.383105+0000","last_unstale":"2024-01-24T13:06:34.558496+0000","last_undegraded":"2024-01-24T13:06:34.558496+0000","last_fullsized":"2024-01-24T13:06:34.558496+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:25:54.635950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.377170+0000","last_change":"2024-01-24T13:06:32.984915+0000","last_active":"2024-01-24T13:06:33.377170+0000","last_peered":"2024-01-24T13:06:33.377170+0000","last_clean":"2024-01-24T13:06:33.377170+0000","last_became_active":"2024-01-24T13:06:32.984652+0000","last_became_peered":"2024-01-24T13:06:32.984652+0000","last_unstale":"2024-01-24T13:06:33.377170+0000","last_undegraded":"2024-01-24T13:06:33.377170+0000","last_fullsized":"2024-01-24T13:06:33.377170+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:17:48.959635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558717+0000","last_change":"2024-01-24T13:06:33.388847+0000","last_active":"2024-01-24T13:06:34.558717+0000","last_peered":"2024-01-24T13:06:34.558717+0000","last_clean":"2024-01-24T13:06:34.558717+0000","last_became_active":"2024-01-24T13:06:33.388214+0000","last_became_peered":"2024-01-24T13:06:33.388214+0000","last_unstale":"2024-01-24T13:06:34.558717+0000","last_undegraded":"2024-01-24T13:06:34.558717+0000","last_fullsized":"2024-01-24T13:06:34.558717+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:59:54.967201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.377710+0000","last_change":"2024-01-24T13:06:32.991542+0000","last_active":"2024-01-24T13:06:33.377710+0000","last_peered":"2024-01-24T13:06:33.377710+0000","last_clean":"2024-01-24T13:06:33.377710+0000","last_became_active":"2024-01-24T13:06:32.991065+0000","last_became_peered":"2024-01-24T13:06:32.991065+0000","last_unstale":"2024-01-24T13:06:33.377710+0000","last_undegraded":"2024-01-24T13:06:33.377710+0000","last_fullsized":"2024-01-24T13:06:33.377710+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:03:45.497890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558631+0000","last_change":"2024-01-24T13:06:33.388480+0000","last_active":"2024-01-24T13:06:34.558631+0000","last_peered":"2024-01-24T13:06:34.558631+0000","last_clean":"2024-01-24T13:06:34.558631+0000","last_became_active":"2024-01-24T13:06:33.387247+0000","last_became_peered":"2024-01-24T13:06:33.387247+0000","last_unstale":"2024-01-24T13:06:34.558631+0000","last_undegraded":"2024-01-24T13:06:34.558631+0000","last_fullsized":"2024-01-24T13:06:34.558631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:05:58.916072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.402174+0000","last_change":"2024-01-24T13:06:32.979133+0000","last_active":"2024-01-24T13:06:33.402174+0000","last_peered":"2024-01-24T13:06:33.402174+0000","last_clean":"2024-01-24T13:06:33.402174+0000","last_became_active":"2024-01-24T13:06:32.978825+0000","last_became_peered":"2024-01-24T13:06:32.978825+0000","last_unstale":"2024-01-24T13:06:33.402174+0000","last_undegraded":"2024-01-24T13:06:33.402174+0000","last_fullsized":"2024-01-24T13:06:33.402174+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:49:10.726348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559190+0000","last_change":"2024-01-24T13:06:33.391996+0000","last_active":"2024-01-24T13:06:34.559190+0000","last_peered":"2024-01-24T13:06:34.559190+0000","last_clean":"2024-01-24T13:06:34.559190+0000","last_became_active":"2024-01-24T13:06:33.391664+0000","last_became_peered":"2024-01-24T13:06:33.391664+0000","last_unstale":"2024-01-24T13:06:34.559190+0000","last_undegraded":"2024-01-24T13:06:34.559190+0000","last_fullsized":"2024-01-24T13:06:34.559190+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:52:31.869284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.390512+0000","last_change":"2024-01-24T13:06:32.995798+0000","last_active":"2024-01-24T13:06:33.390512+0000","last_peered":"2024-01-24T13:06:33.390512+0000","last_clean":"2024-01-24T13:06:33.390512+0000","last_became_active":"2024-01-24T13:06:32.995354+0000","last_became_peered":"2024-01-24T13:06:32.995354+0000","last_unstale":"2024-01-24T13:06:33.390512+0000","last_undegraded":"2024-01-24T13:06:33.390512+0000","last_fullsized":"2024-01-24T13:06:33.390512+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559439+0000","last_change":"2024-01-24T13:06:33.394688+0000","last_active":"2024-01-24T13:06:34.559439+0000","last_peered":"2024-01-24T13:06:34.559439+0000","last_clean":"2024-01-24T13:06:34.559439+0000","last_became_active":"2024-01-24T13:06:33.393196+0000","last_became_peered":"2024-01-24T13:06:33.393196+0000","last_unstale":"2024-01-24T13:06:34.559439+0000","last_undegraded":"2024-01-24T13:06:34.559439+0000","last_fullsized":"2024-01-24T13:06:34.559439+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:31:13.551955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375884+0000","last_change":"2024-01-24T13:06:32.982486+0000","last_active":"2024-01-24T13:06:34.375884+0000","last_peered":"2024-01-24T13:06:34.375884+0000","last_clean":"2024-01-24T13:06:34.375884+0000","last_became_active":"2024-01-24T13:06:32.982212+0000","last_became_peered":"2024-01-24T13:06:32.982212+0000","last_unstale":"2024-01-24T13:06:34.375884+0000","last_undegraded":"2024-01-24T13:06:34.375884+0000","last_fullsized":"2024-01-24T13:06:34.375884+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:53:18.968759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558838+0000","last_change":"2024-01-24T13:06:33.388589+0000","last_active":"2024-01-24T13:06:34.558838+0000","last_peered":"2024-01-24T13:06:34.558838+0000","last_clean":"2024-01-24T13:06:34.558838+0000","last_became_active":"2024-01-24T13:06:33.388337+0000","last_became_peered":"2024-01-24T13:06:33.388337+0000","last_unstale":"2024-01-24T13:06:34.558838+0000","last_undegraded":"2024-01-24T13:06:34.558838+0000","last_fullsized":"2024-01-24T13:06:34.558838+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:36.788368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.391078+0000","last_change":"2024-01-24T13:06:32.986674+0000","last_active":"2024-01-24T13:06:33.391078+0000","last_peered":"2024-01-24T13:06:33.391078+0000","last_clean":"2024-01-24T13:06:33.391078+0000","last_became_active":"2024-01-24T13:06:32.986419+0000","last_became_peered":"2024-01-24T13:06:32.986419+0000","last_unstale":"2024-01-24T13:06:33.391078+0000","last_undegraded":"2024-01-24T13:06:33.391078+0000","last_fullsized":"2024-01-24T13:06:33.391078+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:36:01.523707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558901+0000","last_change":"2024-01-24T13:06:33.390318+0000","last_active":"2024-01-24T13:06:34.558901+0000","last_peered":"2024-01-24T13:06:34.558901+0000","last_clean":"2024-01-24T13:06:34.558901+0000","last_became_active":"2024-01-24T13:06:33.390069+0000","last_became_peered":"2024-01-24T13:06:33.390069+0000","last_unstale":"2024-01-24T13:06:34.558901+0000","last_undegraded":"2024-01-24T13:06:34.558901+0000","last_fullsized":"2024-01-24T13:06:34.558901+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:16:31.606986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375906+0000","last_change":"2024-01-24T13:06:32.985653+0000","last_active":"2024-01-24T13:06:34.375906+0000","last_peered":"2024-01-24T13:06:34.375906+0000","last_clean":"2024-01-24T13:06:34.375906+0000","last_became_active":"2024-01-24T13:06:32.985358+0000","last_became_peered":"2024-01-24T13:06:32.985358+0000","last_unstale":"2024-01-24T13:06:34.375906+0000","last_undegraded":"2024-01-24T13:06:34.375906+0000","last_fullsized":"2024-01-24T13:06:34.375906+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:32:32.585192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558772+0000","last_change":"2024-01-24T13:06:33.394086+0000","last_active":"2024-01-24T13:06:34.558772+0000","last_peered":"2024-01-24T13:06:34.558772+0000","last_clean":"2024-01-24T13:06:34.558772+0000","last_became_active":"2024-01-24T13:06:33.387526+0000","last_became_peered":"2024-01-24T13:06:33.387526+0000","last_unstale":"2024-01-24T13:06:34.558772+0000","last_undegraded":"2024-01-24T13:06:34.558772+0000","last_fullsized":"2024-01-24T13:06:34.558772+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:13:14.838351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.406607+0000","last_change":"2024-01-24T13:06:32.992392+0000","last_active":"2024-01-24T13:06:33.406607+0000","last_peered":"2024-01-24T13:06:33.406607+0000","last_clean":"2024-01-24T13:06:33.406607+0000","last_became_active":"2024-01-24T13:06:32.992120+0000","last_became_peered":"2024-01-24T13:06:32.992120+0000","last_unstale":"2024-01-24T13:06:33.406607+0000","last_undegraded":"2024-01-24T13:06:33.406607+0000","last_fullsized":"2024-01-24T13:06:33.406607+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:24:45.430111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375502+0000","last_change":"2024-01-24T13:06:33.404938+0000","last_active":"2024-01-24T13:06:34.375502+0000","last_peered":"2024-01-24T13:06:34.375502+0000","last_clean":"2024-01-24T13:06:34.375502+0000","last_became_active":"2024-01-24T13:06:33.404554+0000","last_became_peered":"2024-01-24T13:06:33.404554+0000","last_unstale":"2024-01-24T13:06:34.375502+0000","last_undegraded":"2024-01-24T13:06:34.375502+0000","last_fullsized":"2024-01-24T13:06:34.375502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:14:22.773502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375855+0000","last_change":"2024-01-24T13:06:32.976649+0000","last_active":"2024-01-24T13:06:34.375855+0000","last_peered":"2024-01-24T13:06:34.375855+0000","last_clean":"2024-01-24T13:06:34.375855+0000","last_became_active":"2024-01-24T13:06:32.976204+0000","last_became_peered":"2024-01-24T13:06:32.976204+0000","last_unstale":"2024-01-24T13:06:34.375855+0000","last_undegraded":"2024-01-24T13:06:34.375855+0000","last_fullsized":"2024-01-24T13:06:34.375855+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:20:50.783109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375805+0000","last_change":"2024-01-24T13:06:33.400926+0000","last_active":"2024-01-24T13:06:34.375805+0000","last_peered":"2024-01-24T13:06:34.375805+0000","last_clean":"2024-01-24T13:06:34.375805+0000","last_became_active":"2024-01-24T13:06:33.400651+0000","last_became_peered":"2024-01-24T13:06:33.400651+0000","last_unstale":"2024-01-24T13:06:34.375805+0000","last_undegraded":"2024-01-24T13:06:34.375805+0000","last_fullsized":"2024-01-24T13:06:34.375805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:38:46.742749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.379286+0000","last_change":"2024-01-24T13:06:32.982735+0000","last_active":"2024-01-24T13:06:33.379286+0000","last_peered":"2024-01-24T13:06:33.379286+0000","last_clean":"2024-01-24T13:06:33.379286+0000","last_became_active":"2024-01-24T13:06:32.982214+0000","last_became_peered":"2024-01-24T13:06:32.982214+0000","last_unstale":"2024-01-24T13:06:33.379286+0000","last_undegraded":"2024-01-24T13:06:33.379286+0000","last_fullsized":"2024-01-24T13:06:33.379286+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:40:00.227482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559323+0000","last_change":"2024-01-24T13:06:33.380103+0000","last_active":"2024-01-24T13:06:34.559323+0000","last_peered":"2024-01-24T13:06:34.559323+0000","last_clean":"2024-01-24T13:06:34.559323+0000","last_became_active":"2024-01-24T13:06:33.379496+0000","last_became_peered":"2024-01-24T13:06:33.379496+0000","last_unstale":"2024-01-24T13:06:34.559323+0000","last_undegraded":"2024-01-24T13:06:34.559323+0000","last_fullsized":"2024-01-24T13:06:34.559323+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:53:19.964849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.386853+0000","last_change":"2024-01-24T13:06:32.993271+0000","last_active":"2024-01-24T13:06:33.386853+0000","last_peered":"2024-01-24T13:06:33.386853+0000","last_clean":"2024-01-24T13:06:33.386853+0000","last_became_active":"2024-01-24T13:06:32.992995+0000","last_became_peered":"2024-01-24T13:06:32.992995+0000","last_unstale":"2024-01-24T13:06:33.386853+0000","last_undegraded":"2024-01-24T13:06:33.386853+0000","last_fullsized":"2024-01-24T13:06:33.386853+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:38:59.914148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559520+0000","last_change":"2024-01-24T13:06:33.391667+0000","last_active":"2024-01-24T13:06:34.559520+0000","last_peered":"2024-01-24T13:06:34.559520+0000","last_clean":"2024-01-24T13:06:34.559520+0000","last_became_active":"2024-01-24T13:06:33.391411+0000","last_became_peered":"2024-01-24T13:06:33.391411+0000","last_unstale":"2024-01-24T13:06:34.559520+0000","last_undegraded":"2024-01-24T13:06:34.559520+0000","last_fullsized":"2024-01-24T13:06:34.559520+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:02:34.565839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.378715+0000","last_change":"2024-01-24T13:06:32.986769+0000","last_active":"2024-01-24T13:06:33.378715+0000","last_peered":"2024-01-24T13:06:33.378715+0000","last_clean":"2024-01-24T13:06:33.378715+0000","last_became_active":"2024-01-24T13:06:32.986470+0000","last_became_peered":"2024-01-24T13:06:32.986470+0000","last_unstale":"2024-01-24T13:06:33.378715+0000","last_undegraded":"2024-01-24T13:06:33.378715+0000","last_fullsized":"2024-01-24T13:06:33.378715+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:16:21.150556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559025+0000","last_change":"2024-01-24T13:06:33.399286+0000","last_active":"2024-01-24T13:06:34.559025+0000","last_peered":"2024-01-24T13:06:34.559025+0000","last_clean":"2024-01-24T13:06:34.559025+0000","last_became_active":"2024-01-24T13:06:33.398849+0000","last_became_peered":"2024-01-24T13:06:33.398849+0000","last_unstale":"2024-01-24T13:06:34.559025+0000","last_undegraded":"2024-01-24T13:06:34.559025+0000","last_fullsized":"2024-01-24T13:06:34.559025+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:16:22.157948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.380029+0000","last_change":"2024-01-24T13:06:32.978920+0000","last_active":"2024-01-24T13:06:33.380029+0000","last_peered":"2024-01-24T13:06:33.380029+0000","last_clean":"2024-01-24T13:06:33.380029+0000","last_became_active":"2024-01-24T13:06:32.978664+0000","last_became_peered":"2024-01-24T13:06:32.978664+0000","last_unstale":"2024-01-24T13:06:33.380029+0000","last_undegraded":"2024-01-24T13:06:33.380029+0000","last_fullsized":"2024-01-24T13:06:33.380029+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:00:19.578573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.376028+0000","last_change":"2024-01-24T13:06:33.400864+0000","last_active":"2024-01-24T13:06:34.376028+0000","last_peered":"2024-01-24T13:06:34.376028+0000","last_clean":"2024-01-24T13:06:34.376028+0000","last_became_active":"2024-01-24T13:06:33.400583+0000","last_became_peered":"2024-01-24T13:06:33.400583+0000","last_unstale":"2024-01-24T13:06:34.376028+0000","last_undegraded":"2024-01-24T13:06:34.376028+0000","last_fullsized":"2024-01-24T13:06:34.376028+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:35.231436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.367687+0000","last_change":"2024-01-24T13:06:32.983497+0000","last_active":"2024-01-24T13:06:33.367687+0000","last_peered":"2024-01-24T13:06:33.367687+0000","last_clean":"2024-01-24T13:06:33.367687+0000","last_became_active":"2024-01-24T13:06:32.983226+0000","last_became_peered":"2024-01-24T13:06:32.983226+0000","last_unstale":"2024-01-24T13:06:33.367687+0000","last_undegraded":"2024-01-24T13:06:33.367687+0000","last_fullsized":"2024-01-24T13:06:33.367687+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:23:53.805299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558576+0000","last_change":"2024-01-24T13:06:33.399788+0000","last_active":"2024-01-24T13:06:34.558576+0000","last_peered":"2024-01-24T13:06:34.558576+0000","last_clean":"2024-01-24T13:06:34.558576+0000","last_became_active":"2024-01-24T13:06:33.399488+0000","last_became_peered":"2024-01-24T13:06:33.399488+0000","last_unstale":"2024-01-24T13:06:34.558576+0000","last_undegraded":"2024-01-24T13:06:34.558576+0000","last_fullsized":"2024-01-24T13:06:34.558576+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:00:04.878666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.371990+0000","last_change":"2024-01-24T13:06:32.995569+0000","last_active":"2024-01-24T13:06:33.371990+0000","last_peered":"2024-01-24T13:06:33.371990+0000","last_clean":"2024-01-24T13:06:33.371990+0000","last_became_active":"2024-01-24T13:06:32.995312+0000","last_became_peered":"2024-01-24T13:06:32.995312+0000","last_unstale":"2024-01-24T13:06:33.371990+0000","last_undegraded":"2024-01-24T13:06:33.371990+0000","last_fullsized":"2024-01-24T13:06:33.371990+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:00:19.578573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.373619+0000","last_change":"2024-01-24T13:06:33.397632+0000","last_active":"2024-01-24T13:06:34.373619+0000","last_peered":"2024-01-24T13:06:34.373619+0000","last_clean":"2024-01-24T13:06:34.373619+0000","last_became_active":"2024-01-24T13:06:33.397362+0000","last_became_peered":"2024-01-24T13:06:33.397362+0000","last_unstale":"2024-01-24T13:06:34.373619+0000","last_undegraded":"2024-01-24T13:06:34.373619+0000","last_fullsized":"2024-01-24T13:06:34.373619+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:13:14.838351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.367555+0000","last_change":"2024-01-24T13:06:32.983636+0000","last_active":"2024-01-24T13:06:33.367555+0000","last_peered":"2024-01-24T13:06:33.367555+0000","last_clean":"2024-01-24T13:06:33.367555+0000","last_became_active":"2024-01-24T13:06:32.983377+0000","last_became_peered":"2024-01-24T13:06:32.983377+0000","last_unstale":"2024-01-24T13:06:33.367555+0000","last_undegraded":"2024-01-24T13:06:33.367555+0000","last_fullsized":"2024-01-24T13:06:33.367555+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:07.082513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375158+0000","last_change":"2024-01-24T13:06:33.393627+0000","last_active":"2024-01-24T13:06:34.375158+0000","last_peered":"2024-01-24T13:06:34.375158+0000","last_clean":"2024-01-24T13:06:34.375158+0000","last_became_active":"2024-01-24T13:06:33.393249+0000","last_became_peered":"2024-01-24T13:06:33.393249+0000","last_unstale":"2024-01-24T13:06:34.375158+0000","last_undegraded":"2024-01-24T13:06:34.375158+0000","last_fullsized":"2024-01-24T13:06:34.375158+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:26:43.515702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.377918+0000","last_change":"2024-01-24T13:06:32.984641+0000","last_active":"2024-01-24T13:06:33.377918+0000","last_peered":"2024-01-24T13:06:33.377918+0000","last_clean":"2024-01-24T13:06:33.377918+0000","last_became_active":"2024-01-24T13:06:32.984387+0000","last_became_peered":"2024-01-24T13:06:32.984387+0000","last_unstale":"2024-01-24T13:06:33.377918+0000","last_undegraded":"2024-01-24T13:06:33.377918+0000","last_fullsized":"2024-01-24T13:06:33.377918+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:35:10.934452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.558798+0000","last_change":"2024-01-24T13:06:33.396542+0000","last_active":"2024-01-24T13:06:34.558798+0000","last_peered":"2024-01-24T13:06:34.558798+0000","last_clean":"2024-01-24T13:06:34.558798+0000","last_became_active":"2024-01-24T13:06:33.396290+0000","last_became_peered":"2024-01-24T13:06:33.396290+0000","last_unstale":"2024-01-24T13:06:34.558798+0000","last_undegraded":"2024-01-24T13:06:34.558798+0000","last_fullsized":"2024-01-24T13:06:34.558798+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:24:10.812123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375242+0000","last_change":"2024-01-24T13:06:32.978254+0000","last_active":"2024-01-24T13:06:34.375242+0000","last_peered":"2024-01-24T13:06:34.375242+0000","last_clean":"2024-01-24T13:06:34.375242+0000","last_became_active":"2024-01-24T13:06:32.977940+0000","last_became_peered":"2024-01-24T13:06:32.977940+0000","last_unstale":"2024-01-24T13:06:34.375242+0000","last_undegraded":"2024-01-24T13:06:34.375242+0000","last_fullsized":"2024-01-24T13:06:34.375242+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:27:03.333403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.375333+0000","last_change":"2024-01-24T13:06:33.403559+0000","last_active":"2024-01-24T13:06:34.375333+0000","last_peered":"2024-01-24T13:06:34.375333+0000","last_clean":"2024-01-24T13:06:34.375333+0000","last_became_active":"2024-01-24T13:06:33.403199+0000","last_became_peered":"2024-01-24T13:06:33.403199+0000","last_unstale":"2024-01-24T13:06:34.375333+0000","last_undegraded":"2024-01-24T13:06:34.375333+0000","last_fullsized":"2024-01-24T13:06:34.375333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:32.955728+0000","last_clean_scrub_stamp":"2024-01-24T13:06:32.955728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:10:40.996705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.375461+0000","last_change":"2024-01-24T13:06:32.986153+0000","last_active":"2024-01-24T13:06:33.375461+0000","last_peered":"2024-01-24T13:06:33.375461+0000","last_clean":"2024-01-24T13:06:33.375461+0000","last_became_active":"2024-01-24T13:06:32.985812+0000","last_became_peered":"2024-01-24T13:06:32.985812+0000","last_unstale":"2024-01-24T13:06:33.375461+0000","last_undegraded":"2024-01-24T13:06:33.375461+0000","last_fullsized":"2024-01-24T13:06:33.375461+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:06:31.948336+0000","last_clean_scrub_stamp":"2024-01-24T13:06:31.948336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:47:20.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":195,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-01-24T13:06:33.379376+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:06:33.379376+0000","last_peered":"2024-01-24T13:06:33.379376+0000","last_clean":"2024-01-24T13:06:33.379376+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:06:33.379376+0000","last_undegraded":"2024-01-24T13:06:33.379376+0000","last_fullsized":"2024-01-24T13:06:33.379376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":708608,"data_stored":311570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.47099999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83799999999999997,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.86199999999999999}]},{"osd":1,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79800000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.70199999999999996}]},{"osd":2,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.53800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92700000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.745,"15min":0.755},"min":{"1min":0.56599999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84399999999999997,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.68600000000000005}]},{"osd":3,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.61299999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.89700000000000002,"5min":1.131,"15min":1.131},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74399999999999999,"15min":0.749},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.93999999999999995,"5min":1.05,"15min":1.05},"last":0.78000000000000003}]},{"osd":4,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63400000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77300000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.873,"5min":1.341,"15min":1.341},"last":0.5}]},{"osd":5,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89600000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92400000000000004,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.57999999999999996}]},{"osd":6,"last update":"Wed Jan 24 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96599999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91200000000000003,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.55300000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509478,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":704512,"data_stored":311500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.46600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91500000000000004,"5min":2.827,"15min":2.827},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81000000000000005,"5min":2.052,"15min":2.052},"last":0.627}]},{"osd":1,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.72299999999999998,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86699999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.92300000000000004,"15min":0.97099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.74099999999999999,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.68500000000000005}]},{"osd":2,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.85199999999999998,"15min":0.88600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.83899999999999997,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.94299999999999995,"15min":0.98499999999999999},"min":{"1min":0.54200000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.83999999999999997,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.51200000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.91700000000000004,"15min":0.95899999999999996},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80600000000000005,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.82199999999999995,"15min":0.84699999999999998},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.59999999999999998}]},{"osd":4,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.85099999999999998,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90300000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.76000000000000001}]},{"osd":5,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.47899999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84699999999999998,"5min":4.274,"15min":4.274},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.81200000000000006,"15min":0.82199999999999995},"min":{"1min":0.63,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88800000000000001,"5min":2.645,"15min":2.645},"last":0.73399999999999999}]},{"osd":7,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.84499999999999997,"15min":0.873},"min":{"1min":0.50900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86699999999999999,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.86199999999999999,"15min":0.88600000000000001},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.92400000000000004,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.67300000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":708608,"data_stored":312094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63900000000000001,"15min":0.63300000000000001},"min":{"1min":0.47599999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.72799999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98399999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.014,"5min":1.484,"15min":1.484},"last":0.55800000000000005}]},{"osd":2,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68200000000000005,"15min":0.67400000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.64900000000000002}]},{"osd":3,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.51400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58199999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.97999999999999998,"5min":1.002,"15min":1.002},"last":0.68200000000000005}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.499,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.627},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69799999999999995}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70299999999999996,"15min":0.69999999999999996},"min":{"1min":0.55500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.753},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.59699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95299999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.73999999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":704512,"data_stored":311568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.433,"15min":0.44500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53100000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.46300000000000002,"15min":0.46600000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.58199999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.46300000000000002}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46600000000000003,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55300000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68200000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.59899999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60599999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.495}]},{"osd":4,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.75,"15min":0.76500000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.91500000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78500000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.86299999999999999,"5min":1.014,"15min":1.014},"last":0.65800000000000003}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88300000000000001,"5min":1.032,"15min":1.032},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79600000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.90500000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.627},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.82499999999999996,"15min":0.84499999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.89400000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.83199999999999996,"15min":0.85099999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.875,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":0.85899999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.68100000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":720896,"data_stored":313202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.46700000000000003,"15min":0.48399999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54300000000000004,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91900000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54400000000000004}]},{"osd":1,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.53100000000000003,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64100000000000001,"5min":1.379,"15min":1.379},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.374,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88700000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.624}]},{"osd":3,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.60899999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.63400000000000001,"15min":0.65800000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67700000000000005,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.69199999999999995}]},{"osd":4,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89500000000000002,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97699999999999998,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.89400000000000002}]},{"osd":5,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.52200000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.099,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98499999999999999,"5min":1.448,"15min":1.448},"last":0.876}]},{"osd":6,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.58299999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94099999999999995,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0449999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.95099999999999996}]},{"osd":7,"last update":"Wed Jan 24 13:05:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95999999999999996,"5min":1.554,"15min":1.554},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.84399999999999997,"15min":0.86199999999999999},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0760000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.90900000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509478,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1298432,"data_stored":902428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64900000000000002,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.315},{"interface":"front","average":{"1min":0.441,"5min":0.57899999999999996,"15min":0.60199999999999998},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82999999999999996,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.47799999999999998}]},{"osd":2,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66600000000000004,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.502},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.59199999999999997,"15min":0.61199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":1.958,"15min":1.958},"last":0.49399999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.65800000000000003,"15min":0.67900000000000005},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.42599999999999999}]},{"osd":4,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.81599999999999995,"15min":0.83999999999999997},"min":{"1min":0.51500000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80200000000000005,"5min":1.601,"15min":1.601},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.84199999999999997,"15min":0.86799999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93799999999999994,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.52200000000000002}]},{"osd":5,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.83499999999999996,"15min":0.85699999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.92200000000000004,"5min":1.627,"15min":1.627},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.90100000000000002,"15min":0.93100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.94099999999999995,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.65300000000000002}]},{"osd":6,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.85899999999999999,"15min":0.88500000000000001},"min":{"1min":0.54400000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91700000000000004,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.83799999999999997,"15min":0.85799999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89300000000000002,"5min":1.421,"15min":1.421},"last":0.70099999999999996}]},{"osd":7,"last update":"Wed Jan 24 13:05:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.84499999999999997,"15min":0.86599999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91800000000000004,"5min":1.452,"15min":1.452},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.879,"15min":0.90500000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94599999999999995,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.56200000000000006}]}]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":712704,"data_stored":313042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.47699999999999998,"15min":0.49299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61399999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.71299999999999997,"15min":0.75700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65500000000000003,"5min":5.556,"15min":5.556},"last":0.438}]},{"osd":2,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.74099999999999999,"15min":0.78300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61099999999999999,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.64200000000000002,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.51100000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.57299999999999995,"15min":0.59499999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65700000000000003,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.52900000000000003}]},{"osd":4,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.56899999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90900000000000003,"5min":1.925,"15min":1.925},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.626,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97599999999999998,"5min":1.512,"15min":1.512},"last":0.66000000000000003}]},{"osd":5,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0169999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.83699999999999997,"15min":0.85099999999999998},"min":{"1min":0.66200000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.90900000000000003,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.73599999999999999}]},{"osd":6,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.60699999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.91800000000000004,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.84299999999999997,"15min":0.85799999999999998},"min":{"1min":0.64400000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.96199999999999997,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Wed Jan 24 13:05:47 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.84999999999999998,"15min":0.86599999999999999},"min":{"1min":0.65400000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.84099999999999997,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0389999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.71299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1298432,"data_stored":901880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90000000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93899999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84099999999999997,"5min":0.872,"15min":0.872},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.42699999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.92600000000000005,"5min":1.012,"15min":1.012},"last":0.874}]},{"osd":2,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.55200000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93600000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.60499999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.871,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.86299999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97099999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88500000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.89600000000000002}]},{"osd":4,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91000000000000003,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.73299999999999998}]},{"osd":7,"last update":"Wed Jan 24 13:05:42 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92000000000000004,"5min":1.107,"15min":1.107},"last":0.753}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:06:42.409 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-24T13:06:42.409 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-24T13:06:42.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.594+0000 7f3c4b400640 1 Processor -- start 2024-01-24T13:06:42.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.594+0000 7f3c4b400640 1 -- start start 2024-01-24T13:06:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.598+0000 7f3c4b400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3c4415a330 0x7f3c4415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.598+0000 7f3c4b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3c440b28d0 0x7f3c440d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.598+0000 7f3c4b400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4415a710 con 0x7f3c440d0560 2024-01-24T13:06:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.598+0000 7f3c4b400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4415d2b0 con 0x7f3c440b28d0 2024-01-24T13:06:42.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.598+0000 7f3c4b400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4415d590 con 0x7f3c4415a330 2024-01-24T13:06:42.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.598+0000 7f3c43e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3c440b28d0 0x7f3c440d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:42.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.598+0000 7f3c43e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3c440b28d0 0x7f3c440d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58142/0 (socket says 172.21.15.29:58142) 2024-01-24T13:06:42.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.598+0000 7f3c43e00640 1 -- 172.21.15.29:0/3520449215 learned_addr learned my addr 172.21.15.29:0/3520449215 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:42.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.598+0000 7f3c48a00640 1 --2- 172.21.15.29:0/3520449215 >> v2:172.21.15.163:3300/0 conn(0x7f3c4415a330 0x7f3c4415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:42.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.598+0000 7f3c43e00640 1 -- 172.21.15.29:0/3520449215 >> v2:172.21.15.163:3300/0 conn(0x7f3c4415a330 msgr2=0x7f3c4415cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:42.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.598+0000 7f3c43e00640 1 --2- 172.21.15.29:0/3520449215 >> v2:172.21.15.163:3300/0 conn(0x7f3c4415a330 0x7f3c4415cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.598+0000 7f3c43e00640 1 -- 172.21.15.29:0/3520449215 >> v1:172.21.15.163:6789/0 conn(0x7f3c440d0560 legacy=0x7f3c440cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:42.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.598+0000 7f3c43e00640 1 -- 172.21.15.29:0/3520449215 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4415d870 con 0x7f3c440b28d0 2024-01-24T13:06:42.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.602+0000 7f3c43e00640 1 --2- 172.21.15.29:0/3520449215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c440b28d0 0x7f3c440d0020 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3c4406f050 tx=0x7f3c2c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ae20bedd1ab35f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:42.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.602+0000 7f3c43400640 1 -- 172.21.15.29:0/3520449215 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0aa430 con 0x7f3c440b28d0 2024-01-24T13:06:42.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.602+0000 7f3c43400640 1 -- 172.21.15.29:0/3520449215 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c0aa590 con 0x7f3c440b28d0 2024-01-24T13:06:42.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.602+0000 7f3c43400640 1 -- 172.21.15.29:0/3520449215 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0aa920 con 0x7f3c440b28d0 2024-01-24T13:06:42.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.602+0000 7f3c4b400640 1 -- 172.21.15.29:0/3520449215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c440b28d0 msgr2=0x7f3c440d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:42.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.602+0000 7f3c4b400640 1 --2- 172.21.15.29:0/3520449215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c440b28d0 0x7f3c440d0020 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3c4406f050 tx=0x7f3c2c01c4d0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.602+0000 7f3c4b400640 1 -- 172.21.15.29:0/3520449215 shutdown_connections 2024-01-24T13:06:42.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.602+0000 7f3c4b400640 1 --2- 172.21.15.29:0/3520449215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c440b28d0 0x7f3c440d0020 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.602+0000 7f3c4b400640 1 --2- 172.21.15.29:0/3520449215 >> v2:172.21.15.163:3300/0 conn(0x7f3c4415a330 0x7f3c4415cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.602+0000 7f3c4b400640 1 -- 172.21.15.29:0/3520449215 >> 172.21.15.29:0/3520449215 conn(0x7f3c44069cd0 msgr2=0x7f3c4406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:42.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.602+0000 7f3c4b400640 1 -- 172.21.15.29:0/3520449215 shutdown_connections 2024-01-24T13:06:42.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.602+0000 7f3c4b400640 1 -- 172.21.15.29:0/3520449215 wait complete. 2024-01-24T13:06:42.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.602+0000 7f3c4b400640 1 Processor -- start 2024-01-24T13:06:42.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.602+0000 7f3c4b400640 1 -- start start 2024-01-24T13:06:42.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c4b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c440b28d0 0x7f3c44150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:42.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c4b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c440d0560 0x7f3c440b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:42.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c4b400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c4415a330 0x7f3c4414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:42.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c4b400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4415b7d0 con 0x7f3c440b28d0 2024-01-24T13:06:42.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c4b400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44150120 con 0x7f3c440d0560 2024-01-24T13:06:42.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c4b400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44150400 con 0x7f3c4415a330 2024-01-24T13:06:42.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c48a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c440b28d0 0x7f3c44150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c48a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c440b28d0 0x7f3c44150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58158/0 (socket says 172.21.15.29:58158) 2024-01-24T13:06:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c48a00640 1 -- 172.21.15.29:0/2848603193 learned_addr learned my addr 172.21.15.29:0/2848603193 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c43e00640 1 --2- 172.21.15.29:0/2848603193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c440d0560 0x7f3c440b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c49400640 1 --2- 172.21.15.29:0/2848603193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c4415a330 0x7f3c4414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c48a00640 1 -- 172.21.15.29:0/2848603193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c4415a330 msgr2=0x7f3c4414f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c48a00640 1 --2- 172.21.15.29:0/2848603193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c4415a330 0x7f3c4414f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c48a00640 1 -- 172.21.15.29:0/2848603193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c440d0560 msgr2=0x7f3c440b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c48a00640 1 --2- 172.21.15.29:0/2848603193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c440d0560 0x7f3c440b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c48a00640 1 -- 172.21.15.29:0/2848603193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c0094d0 con 0x7f3c440b28d0 2024-01-24T13:06:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c48a00640 1 --2- 172.21.15.29:0/2848603193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c440b28d0 0x7f3c44150ee0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400d5f0 tx=0x7f3c3400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:42.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c40c00640 1 -- 172.21.15.29:0/2848603193 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c340125f0 con 0x7f3c440b28d0 2024-01-24T13:06:42.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c40c00640 1 -- 172.21.15.29:0/2848603193 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c34012750 con 0x7f3c440b28d0 2024-01-24T13:06:42.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c40c00640 1 -- 172.21.15.29:0/2848603193 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34012ae0 con 0x7f3c440b28d0 2024-01-24T13:06:42.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c4b400640 1 -- 172.21.15.29:0/2848603193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c441506e0 con 0x7f3c440b28d0 2024-01-24T13:06:42.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c4b400640 1 -- 172.21.15.29:0/2848603193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4414fc80 con 0x7f3c440b28d0 2024-01-24T13:06:42.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c4b400640 1 -- 172.21.15.29:0/2848603193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4404e850 con 0x7f3c440b28d0 2024-01-24T13:06:42.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.606+0000 7f3c40c00640 1 -- 172.21.15.29:0/2848603193 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3c34012c40 con 0x7f3c440b28d0 2024-01-24T13:06:42.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.610+0000 7f3c40c00640 1 --2- 172.21.15.29:0/2848603193 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3c1c065a60 0x7f3c1c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:42.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.610+0000 7f3c40c00640 1 -- 172.21.15.29:0/2848603193 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3c340836e0 con 0x7f3c440b28d0 2024-01-24T13:06:42.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.610+0000 7f3c43e00640 1 --2- 172.21.15.29:0/2848603193 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3c1c065a60 0x7f3c1c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:42.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.610+0000 7f3c43e00640 1 --2- 172.21.15.29:0/2848603193 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3c1c065a60 0x7f3c1c067f20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0ae000 tx=0x7f3c2c0b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:42.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.614+0000 7f3c40c00640 1 -- 172.21.15.29:0/2848603193 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3c34050f70 con 0x7f3c440b28d0 2024-01-24T13:06:42.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.826+0000 7f3c4b400640 1 -- 172.21.15.29:0/2848603193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3c440b6400 con 0x7f3c440b28d0 2024-01-24T13:06:42.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.830+0000 7f3c40c00640 1 -- 172.21.15.29:0/2848603193 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3c34054590 con 0x7f3c440b28d0 2024-01-24T13:06:42.834 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2024-01-24T13:06:42.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.834+0000 7f3c4b400640 1 -- 172.21.15.29:0/2848603193 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3c1c065a60 msgr2=0x7f3c1c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.834+0000 7f3c4b400640 1 --2- 172.21.15.29:0/2848603193 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3c1c065a60 0x7f3c1c067f20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0ae000 tx=0x7f3c2c0b5040 comp rx=0 tx=0).stop 2024-01-24T13:06:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.834+0000 7f3c4b400640 1 -- 172.21.15.29:0/2848603193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c440b28d0 msgr2=0x7f3c44150ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.834+0000 7f3c4b400640 1 --2- 172.21.15.29:0/2848603193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c440b28d0 0x7f3c44150ee0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400d5f0 tx=0x7f3c3400dab0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.834+0000 7f3c4b400640 1 -- 172.21.15.29:0/2848603193 shutdown_connections 2024-01-24T13:06:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.834+0000 7f3c4b400640 1 --2- 172.21.15.29:0/2848603193 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3c1c065a60 0x7f3c1c067f20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.834+0000 7f3c4b400640 1 --2- 172.21.15.29:0/2848603193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3c4415a330 0x7f3c4414f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.834+0000 7f3c4b400640 1 --2- 172.21.15.29:0/2848603193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c440d0560 0x7f3c440b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.834+0000 7f3c4b400640 1 --2- 172.21.15.29:0/2848603193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c440b28d0 0x7f3c44150ee0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.834+0000 7f3c4b400640 1 -- 172.21.15.29:0/2848603193 >> 172.21.15.29:0/2848603193 conn(0x7f3c44069cd0 msgr2=0x7f3c4415de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.834+0000 7f3c4b400640 1 -- 172.21.15.29:0/2848603193 shutdown_connections 2024-01-24T13:06:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.834+0000 7f3c4b400640 1 -- 172.21.15.29:0/2848603193 wait complete. 2024-01-24T13:06:42.857 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:06:42.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.994+0000 7fdbb3200640 1 Processor -- start 2024-01-24T13:06:42.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.994+0000 7fdbb3200640 1 -- start start 2024-01-24T13:06:43.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.994+0000 7fdbb3200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdbac15c730 0x7fdbac06b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.994+0000 7fdbb3200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdbac0ccdb0 0x7fdbac0cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.994+0000 7fdbb3200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbac0cd720 con 0x7fdbac0b2700 2024-01-24T13:06:43.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.994+0000 7fdbb3200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbac06cc10 con 0x7fdbac0ccdb0 2024-01-24T13:06:43.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.994+0000 7fdbb3200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbac06b7a0 con 0x7fdbac15c730 2024-01-24T13:06:43.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.998+0000 7fdbb1200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdbac0ccdb0 0x7fdbac0cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.998+0000 7fdbb1200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdbac0ccdb0 0x7fdbac0cd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58174/0 (socket says 172.21.15.29:58174) 2024-01-24T13:06:43.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.998+0000 7fdbb1200640 1 -- 172.21.15.29:0/1792524746 learned_addr learned my addr 172.21.15.29:0/1792524746 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:43.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.998+0000 7fdbabe00640 1 --2- 172.21.15.29:0/1792524746 >> v2:172.21.15.163:3300/0 conn(0x7fdbac15c730 0x7fdbac06b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.998+0000 7fdbb1200640 1 -- 172.21.15.29:0/1792524746 >> v2:172.21.15.163:3300/0 conn(0x7fdbac15c730 msgr2=0x7fdbac06b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:43.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.998+0000 7fdbb1200640 1 --2- 172.21.15.29:0/1792524746 >> v2:172.21.15.163:3300/0 conn(0x7fdbac15c730 0x7fdbac06b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.998+0000 7fdbb1200640 1 -- 172.21.15.29:0/1792524746 >> v1:172.21.15.163:6789/0 conn(0x7fdbac0b2700 legacy=0x7fdbac0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.998+0000 7fdbb1200640 1 -- 172.21.15.29:0/1792524746 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac06ba80 con 0x7fdbac0ccdb0 2024-01-24T13:06:43.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.998+0000 7fdbb1200640 1 --2- 172.21.15.29:0/1792524746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbac0ccdb0 0x7fdbac0cd1e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0d1410 tx=0x7fdba401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94734671e66116c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:43.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.998+0000 7fdbaaa00640 1 -- 172.21.15.29:0/1792524746 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba40a5780 con 0x7fdbac0ccdb0 2024-01-24T13:06:43.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.998+0000 7fdbaaa00640 1 -- 172.21.15.29:0/1792524746 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba40a58e0 con 0x7fdbac0ccdb0 2024-01-24T13:06:43.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:42.998+0000 7fdbaaa00640 1 -- 172.21.15.29:0/1792524746 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba40a5c70 con 0x7fdbac0ccdb0 2024-01-24T13:06:43.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 -- 172.21.15.29:0/1792524746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbac0ccdb0 msgr2=0x7fdbac0cd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 --2- 172.21.15.29:0/1792524746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbac0ccdb0 0x7fdbac0cd1e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0d1410 tx=0x7fdba401c9d0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 -- 172.21.15.29:0/1792524746 shutdown_connections 2024-01-24T13:06:43.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 --2- 172.21.15.29:0/1792524746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbac0ccdb0 0x7fdbac0cd1e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 --2- 172.21.15.29:0/1792524746 >> v2:172.21.15.163:3300/0 conn(0x7fdbac15c730 0x7fdbac06b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 -- 172.21.15.29:0/1792524746 >> 172.21.15.29:0/1792524746 conn(0x7fdbac070570 msgr2=0x7fdbac069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:43.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 -- 172.21.15.29:0/1792524746 shutdown_connections 2024-01-24T13:06:43.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 -- 172.21.15.29:0/1792524746 wait complete. 2024-01-24T13:06:43.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 Processor -- start 2024-01-24T13:06:43.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 -- start start 2024-01-24T13:06:43.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbac0b2700 0x7fdbac0b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbac0ccdb0 0x7fdbac15cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdbac15c730 0x7fdbac15d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac154a10 con 0x7fdbac0b2700 2024-01-24T13:06:43.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac157390 con 0x7fdbac0ccdb0 2024-01-24T13:06:43.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbb3200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac1570b0 con 0x7fdbac15c730 2024-01-24T13:06:43.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbabe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbac0b2700 0x7fdbac0b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbabe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbac0b2700 0x7fdbac0b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58190/0 (socket says 172.21.15.29:58190) 2024-01-24T13:06:43.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.002+0000 7fdbabe00640 1 -- 172.21.15.29:0/689489608 learned_addr learned my addr 172.21.15.29:0/689489608 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:43.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdbb1200640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdbac15c730 0x7fdbac15d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdbab400640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbac0ccdb0 0x7fdbac15cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdbabe00640 1 -- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdbac15c730 msgr2=0x7fdbac15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdbabe00640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdbac15c730 0x7fdbac15d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdbabe00640 1 -- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbac0ccdb0 msgr2=0x7fdbac15cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdbabe00640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbac0ccdb0 0x7fdbac15cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdbabe00640 1 -- 172.21.15.29:0/689489608 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba4009b30 con 0x7fdbac0b2700 2024-01-24T13:06:43.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdbab400640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbac0ccdb0 0x7fdbac15cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:43.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdbabe00640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbac0b2700 0x7fdbac0b0b70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00e870 tx=0x7fdb9c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:43.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdba3e00640 1 -- 172.21.15.29:0/689489608 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c009510 con 0x7fdbac0b2700 2024-01-24T13:06:43.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdba3e00640 1 -- 172.21.15.29:0/689489608 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c00eec0 con 0x7fdbac0b2700 2024-01-24T13:06:43.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdba3e00640 1 -- 172.21.15.29:0/689489608 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c00cb40 con 0x7fdbac0b2700 2024-01-24T13:06:43.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdbb3200640 1 -- 172.21.15.29:0/689489608 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac1543c0 con 0x7fdbac0b2700 2024-01-24T13:06:43.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdbb3200640 1 -- 172.21.15.29:0/689489608 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac15fd40 con 0x7fdbac0b2700 2024-01-24T13:06:43.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdbb3200640 1 -- 172.21.15.29:0/689489608 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac0cf430 con 0x7fdbac0b2700 2024-01-24T13:06:43.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdba3e00640 1 -- 172.21.15.29:0/689489608 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdb9c00cca0 con 0x7fdbac0b2700 2024-01-24T13:06:43.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdba3e00640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb84065a60 0x7fdb84067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdba3e00640 1 -- 172.21.15.29:0/689489608 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdb9c0833f0 con 0x7fdbac0b2700 2024-01-24T13:06:43.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.006+0000 7fdbab400640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb84065a60 0x7fdb84067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.010+0000 7fdbab400640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb84065a60 0x7fdb84067f20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdbac158680 tx=0x7fdb94009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:43.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.010+0000 7fdba3e00640 1 -- 172.21.15.29:0/689489608 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fdb9c050c60 con 0x7fdbac0b2700 2024-01-24T13:06:43.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.206+0000 7fdbb3200640 1 -- 172.21.15.29:0/689489608 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbac04e850 con 0x7fdbac0b2700 2024-01-24T13:06:43.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.206+0000 7fdba3e00640 1 -- 172.21.15.29:0/689489608 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4734 (secure 0 0 0) 0x7fdb9c054280 con 0x7fdbac0b2700 2024-01-24T13:06:43.210 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:43.210 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/2169087472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2169087472},{"type":"v1","addr":"172.21.15.163:6836","nonce":2169087472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/88874113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":88874113},{"type":"v1","addr":"172.21.15.163:6837","nonce":88874113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6177,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1411376794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1411376794},{"type":"v1","addr":"172.21.15.29:6834","nonce":1411376794}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:06:33.362322+0000","modified":"2024-01-24T13:06:36.373536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6180":{"gid":6180,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2075296900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2075296900},{"type":"v1","addr":"172.21.15.29:6835","nonce":2075296900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-24T13:06:43.211 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 26 2024-01-24T13:06:43.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.210+0000 7fdbb3200640 1 -- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb84065a60 msgr2=0x7fdb84067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.210+0000 7fdbb3200640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb84065a60 0x7fdb84067f20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdbac158680 tx=0x7fdb94009040 comp rx=0 tx=0).stop 2024-01-24T13:06:43.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.210+0000 7fdbb3200640 1 -- 172.21.15.29:0/689489608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbac0b2700 msgr2=0x7fdbac0b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.210+0000 7fdbb3200640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbac0b2700 0x7fdbac0b0b70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00e870 tx=0x7fdb9c00ec70 comp rx=0 tx=0).stop 2024-01-24T13:06:43.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.210+0000 7fdbb3200640 1 -- 172.21.15.29:0/689489608 shutdown_connections 2024-01-24T13:06:43.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.210+0000 7fdbb3200640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fdb84065a60 0x7fdb84067f20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.210+0000 7fdbb3200640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdbac15c730 0x7fdbac15d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.210+0000 7fdbb3200640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbac0ccdb0 0x7fdbac15cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.210+0000 7fdbb3200640 1 --2- 172.21.15.29:0/689489608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbac0b2700 0x7fdbac0b0b70 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.210+0000 7fdbb3200640 1 -- 172.21.15.29:0/689489608 >> 172.21.15.29:0/689489608 conn(0x7fdbac070570 msgr2=0x7fdbac0afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:43.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.210+0000 7fdbb3200640 1 -- 172.21.15.29:0/689489608 shutdown_connections 2024-01-24T13:06:43.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.210+0000 7fdbb3200640 1 -- 172.21.15.29:0/689489608 wait complete. 2024-01-24T13:06:43.637 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-24T13:06:33.362322+0000', 'modified': '2024-01-24T13:06:36.373536+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6180}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6180': {'gid': 6180, 'name': 'c', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6835/2075296900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6833', 'nonce': 2075296900}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 2075296900}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-24T13:06:43.638 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-24T13:06:43.638 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-24T13:06:43.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.778+0000 7ff6e2600640 1 Processor -- start 2024-01-24T13:06:43.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.778+0000 7ff6e2600640 1 -- start start 2024-01-24T13:06:43.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.778+0000 7ff6e2600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6dc0cb110 0x7ff6dc0cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.778+0000 7ff6e2600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff6dc15c790 0x7ff6dc0c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.778+0000 7ff6e2600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6dc0cb880 con 0x7ff6dc158c10 2024-01-24T13:06:43.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.778+0000 7ff6e2600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6dc0701c0 con 0x7ff6dc15c790 2024-01-24T13:06:43.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.778+0000 7ff6e2600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc0ccd40 con 0x7ff6dc0cb110 2024-01-24T13:06:43.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.778+0000 7ff6daa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6dc0cb110 0x7ff6dc0cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.778+0000 7ff6daa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6dc0cb110 0x7ff6dc0cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:51818/0 (socket says 172.21.15.29:51818) 2024-01-24T13:06:43.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.778+0000 7ff6daa00640 1 -- 172.21.15.29:0/4035094592 learned_addr learned my addr 172.21.15.29:0/4035094592 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:43.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.778+0000 7ff6dbe00640 1 --2- 172.21.15.29:0/4035094592 >> v2:172.21.15.163:3300/0 conn(0x7ff6dc15c790 0x7ff6dc0c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.782+0000 7ff6daa00640 1 -- 172.21.15.29:0/4035094592 >> v2:172.21.15.163:3300/0 conn(0x7ff6dc15c790 msgr2=0x7ff6dc0c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:43.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.782+0000 7ff6daa00640 1 --2- 172.21.15.29:0/4035094592 >> v2:172.21.15.163:3300/0 conn(0x7ff6dc15c790 0x7ff6dc0c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.782+0000 7ff6daa00640 1 -- 172.21.15.29:0/4035094592 >> v1:172.21.15.163:6789/0 conn(0x7ff6dc158c10 legacy=0x7ff6dc0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.782+0000 7ff6daa00640 1 -- 172.21.15.29:0/4035094592 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc0cd020 con 0x7ff6dc0cb110 2024-01-24T13:06:43.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.782+0000 7ff6da000640 1 -- 172.21.15.29:0/4035094592 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542079255 0 0) 0x7ff6dc0cb880 con 0x7ff6dc158c10 2024-01-24T13:06:43.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.782+0000 7ff6dbe00640 1 --2- 172.21.15.29:0/4035094592 >> v2:172.21.15.163:3300/0 conn(0x7ff6dc15c790 0x7ff6dc0c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:43.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.782+0000 7ff6daa00640 1 --2- 172.21.15.29:0/4035094592 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6dc0cb110 0x7ff6dc0cc640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400aa10 tx=0x7ff6c401d910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=210ea3130bae81b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:43.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.782+0000 7ff6da000640 1 -- 172.21.15.29:0/4035094592 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c40a6940 con 0x7ff6dc0cb110 2024-01-24T13:06:43.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.782+0000 7ff6da000640 1 -- 172.21.15.29:0/4035094592 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c40a6aa0 con 0x7ff6dc0cb110 2024-01-24T13:06:43.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.782+0000 7ff6da000640 1 -- 172.21.15.29:0/4035094592 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c40a6e30 con 0x7ff6dc0cb110 2024-01-24T13:06:43.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 -- 172.21.15.29:0/4035094592 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6dc0cb110 msgr2=0x7ff6dc0cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 --2- 172.21.15.29:0/4035094592 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6dc0cb110 0x7ff6dc0cc640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400aa10 tx=0x7ff6c401d910 comp rx=0 tx=0).stop 2024-01-24T13:06:43.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 -- 172.21.15.29:0/4035094592 shutdown_connections 2024-01-24T13:06:43.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 --2- 172.21.15.29:0/4035094592 >> v2:172.21.15.163:3300/0 conn(0x7ff6dc15c790 0x7ff6dc0c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 --2- 172.21.15.29:0/4035094592 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6dc0cb110 0x7ff6dc0cc640 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 -- 172.21.15.29:0/4035094592 >> 172.21.15.29:0/4035094592 conn(0x7ff6dc06a2d0 msgr2=0x7ff6dc0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:43.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 -- 172.21.15.29:0/4035094592 shutdown_connections 2024-01-24T13:06:43.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 -- 172.21.15.29:0/4035094592 wait complete. 2024-01-24T13:06:43.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 Processor -- start 2024-01-24T13:06:43.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 -- start start 2024-01-24T13:06:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6dc0cb110 0x7ff6dc14c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6dc158c10 0x7ff6dc161c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6dc15c790 0x7ff6dc1621d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc155c60 con 0x7ff6dc15c790 2024-01-24T13:06:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc150e70 con 0x7ff6dc0cb110 2024-01-24T13:06:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6e2600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc14cef0 con 0x7ff6dc158c10 2024-01-24T13:06:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6dbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6dc15c790 0x7ff6dc1621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6dbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6dc15c790 0x7ff6dc1621d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58200/0 (socket says 172.21.15.29:58200) 2024-01-24T13:06:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.786+0000 7ff6dbe00640 1 -- 172.21.15.29:0/1497057311 learned_addr learned my addr 172.21.15.29:0/1497057311 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6daa00640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6dc158c10 0x7ff6dc161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6db400640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6dc0cb110 0x7ff6dc14c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6dbe00640 1 -- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6dc158c10 msgr2=0x7ff6dc161c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6dbe00640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6dc158c10 0x7ff6dc161c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6dbe00640 1 -- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6dc0cb110 msgr2=0x7ff6dc14c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6dbe00640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6dc0cb110 0x7ff6dc14c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6dbe00640 1 -- 172.21.15.29:0/1497057311 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d4009a70 con 0x7ff6dc15c790 2024-01-24T13:06:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6db400640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6dc0cb110 0x7ff6dc14c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:43.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6dbe00640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6dc15c790 0x7ff6dc1621d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400efc0 tx=0x7ff6d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:43.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6d3400640 1 -- 172.21.15.29:0/1497057311 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4009cd0 con 0x7ff6dc15c790 2024-01-24T13:06:43.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6d3400640 1 -- 172.21.15.29:0/1497057311 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d400f040 con 0x7ff6dc15c790 2024-01-24T13:06:43.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6d3400640 1 -- 172.21.15.29:0/1497057311 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d40039a0 con 0x7ff6dc15c790 2024-01-24T13:06:43.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6e2600640 1 -- 172.21.15.29:0/1497057311 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c400a670 con 0x7ff6dc15c790 2024-01-24T13:06:43.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6e2600640 1 -- 172.21.15.29:0/1497057311 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc1556a0 con 0x7ff6dc15c790 2024-01-24T13:06:43.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.790+0000 7ff6d3400640 1 -- 172.21.15.29:0/1497057311 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff6d4014480 con 0x7ff6dc15c790 2024-01-24T13:06:43.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6d3400640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff6b4065a60 0x7ff6b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6d3400640 1 -- 172.21.15.29:0/1497057311 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff6d4083f50 con 0x7ff6dc15c790 2024-01-24T13:06:43.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 Processor -- start 2024-01-24T13:06:43.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 -- start start 2024-01-24T13:06:43.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6db400640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff6b4065a60 0x7ff6b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52774980 0x55bb52774d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb527752a0 0x55bb527287f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6db400640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff6b4065a60 0x7ff6b4067f20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc000fc0 tx=0x7ff6cc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb52728d30 0x55bb52729110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb52580350 con 0x55bb52774980 2024-01-24T13:06:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb5257d920 con 0x55bb527752a0 2024-01-24T13:06:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb52579210 con 0x55bb52728d30 2024-01-24T13:06:43.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6db400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52774980 0x55bb52774d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6db400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52774980 0x55bb52774d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58204/0 (socket says 172.21.15.29:58204) 2024-01-24T13:06:43.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6db400640 1 -- 172.21.15.29:0/3743049490 learned_addr learned my addr 172.21.15.29:0/3743049490 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:43.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6dbe00640 1 --2- 172.21.15.29:0/3743049490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb52728d30 0x55bb52729110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6daa00640 1 --2- 172.21.15.29:0/3743049490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb527752a0 0x55bb527287f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6db400640 1 -- 172.21.15.29:0/3743049490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb52728d30 msgr2=0x55bb52729110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:43.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6db400640 1 --2- 172.21.15.29:0/3743049490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb52728d30 0x55bb52729110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6db400640 1 -- 172.21.15.29:0/3743049490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb527752a0 msgr2=0x55bb527287f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:43.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6db400640 1 --2- 172.21.15.29:0/3743049490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb527752a0 0x55bb527287f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6db400640 1 -- 172.21.15.29:0/3743049490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb52519ff0 con 0x55bb52774980 2024-01-24T13:06:43.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6db400640 1 --2- 172.21.15.29:0/3743049490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52774980 0x55bb52774d60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc005180 tx=0x7ff6cc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161c22c8c9ef416f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:43.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6cbe00640 1 -- 172.21.15.29:0/3743049490 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc003650 con 0x55bb52774980 2024-01-24T13:06:43.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6cbe00640 1 -- 172.21.15.29:0/3743049490 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc0037b0 con 0x55bb52774980 2024-01-24T13:06:43.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6cbe00640 1 -- 172.21.15.29:0/3743049490 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc003b20 con 0x55bb52774980 2024-01-24T13:06:43.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 -- 172.21.15.29:0/3743049490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52774980 msgr2=0x55bb52774d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 --2- 172.21.15.29:0/3743049490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52774980 0x55bb52774d60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc005180 tx=0x7ff6cc011000 comp rx=0 tx=0).stop 2024-01-24T13:06:43.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 -- 172.21.15.29:0/3743049490 shutdown_connections 2024-01-24T13:06:43.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 --2- 172.21.15.29:0/3743049490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb52728d30 0x55bb52729110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 --2- 172.21.15.29:0/3743049490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb527752a0 0x55bb527287f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 --2- 172.21.15.29:0/3743049490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52774980 0x55bb52774d60 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 -- 172.21.15.29:0/3743049490 >> 172.21.15.29:0/3743049490 conn(0x55bb5262e430 msgr2=0x55bb52757b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:43.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 -- 172.21.15.29:0/3743049490 shutdown_connections 2024-01-24T13:06:43.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.794+0000 7ff6e5966000 1 -- 172.21.15.29:0/3743049490 wait complete. 2024-01-24T13:06:43.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 1 -- start start 2024-01-24T13:06:43.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 1 Processor -- start 2024-01-24T13:06:43.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52728d30 0x55bb52758210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52774980 0x55bb52775890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb527752a0 0x55bb52775dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb52518420 con 0x55bb52728d30 2024-01-24T13:06:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb52536890 con 0x55bb52774980 2024-01-24T13:06:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb52236940 con 0x55bb527752a0 2024-01-24T13:06:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 10 client.0 _ll_register_callbacks cb 0x55bb5256df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-24T13:06:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6db400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52728d30 0x55bb52758210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6db400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52728d30 0x55bb52758210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58212/0 (socket says 172.21.15.29:58212) 2024-01-24T13:06:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6db400640 1 -- 172.21.15.29:0/2197324132 learned_addr learned my addr 172.21.15.29:0/2197324132 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6daa00640 1 --2- 172.21.15.29:0/2197324132 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52774980 0x55bb52775890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6dbe00640 1 --2- 172.21.15.29:0/2197324132 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb527752a0 0x55bb52775dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6db400640 1 -- 172.21.15.29:0/2197324132 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb527752a0 msgr2=0x55bb52775dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6db400640 1 --2- 172.21.15.29:0/2197324132 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb527752a0 0x55bb52775dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6db400640 1 -- 172.21.15.29:0/2197324132 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52774980 msgr2=0x55bb52775890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6db400640 1 --2- 172.21.15.29:0/2197324132 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52774980 0x55bb52775890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6db400640 1 -- 172.21.15.29:0/2197324132 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc00f040 con 0x55bb52728d30 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6db400640 1 --2- 172.21.15.29:0/2197324132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52728d30 0x55bb52758210 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc005660 tx=0x7ff6cc000f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2b1b216959604c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6c8c00640 1 -- 172.21.15.29:0/2197324132 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc027070 con 0x55bb52728d30 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6c8c00640 1 -- 172.21.15.29:0/2197324132 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff6cc021450 con 0x55bb52728d30 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 1 -- 172.21.15.29:0/2197324132 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb5253ecc0 con 0x55bb52728d30 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6c8c00640 1 -- 172.21.15.29:0/2197324132 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6cc021610 con 0x55bb52728d30 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 10 client.6339 fetch_fsmap learned FSMap version 26 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 1 -- 172.21.15.29:0/2197324132 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55bb52275890 con 0x55bb52728d30 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6c8c00640 1 -- 172.21.15.29:0/2197324132 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb5253ecc0 con 0x55bb52728d30 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6c8c00640 1 -- 172.21.15.29:0/2197324132 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 26) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff6cc021770 con 0x55bb52728d30 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 10 client.6339 fetch_fsmap finished waiting for FSMap version 26 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 10 client.6339 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-24T13:06:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 20 client.6339 populate_metadata read hostname 'smithi029' 2024-01-24T13:06:43.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 1 --2- 172.21.15.29:0/2197324132 >> [v2:172.21.15.29:6833/2075296900,v1:172.21.15.29:6835/2075296900] conn(0x55bb527767e0 0x55bb52776bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 4 client.6339 mds_command: new command op to 6180 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-24T13:06:43.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.798+0000 7ff6e5966000 1 -- 172.21.15.29:0/2197324132 --> [v2:172.21.15.29:6833/2075296900,v1:172.21.15.29:6835/2075296900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb52577b60 con 0x55bb527767e0 2024-01-24T13:06:43.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6daa00640 1 --2- 172.21.15.29:0/2197324132 >> [v2:172.21.15.29:6833/2075296900,v1:172.21.15.29:6835/2075296900] conn(0x55bb527767e0 0x55bb52776bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6c8c00640 10 client.6339 ms_handle_connect on v2:172.21.15.29:6833/2075296900 2024-01-24T13:06:43.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6daa00640 1 --2- 172.21.15.29:0/2197324132 >> [v2:172.21.15.29:6833/2075296900,v1:172.21.15.29:6835/2075296900] conn(0x55bb527767e0 0x55bb52776bc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75ea2436e6385e18 server_cookie=5eb54f0e27dead70 in_seq=0 out_seq=0 2024-01-24T13:06:43.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6c8c00640 1 -- 172.21.15.29:0/2197324132 <== mds.0 v2:172.21.15.29:6833/2075296900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55bb52577b60 con 0x55bb527767e0 2024-01-24T13:06:43.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6c8c00640 10 client.6339 handle_command_reply: tid=0 2024-01-24T13:06:43.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6e5966000 1 client.6339 shutdown 2024-01-24T13:06:43.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6e5966000 1 -- 172.21.15.29:0/2197324132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52728d30 msgr2=0x55bb52758210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6e5966000 1 --2- 172.21.15.29:0/2197324132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52728d30 0x55bb52758210 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc005660 tx=0x7ff6cc000f30 comp rx=0 tx=0).stop 2024-01-24T13:06:43.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6e5966000 1 -- 172.21.15.29:0/2197324132 shutdown_connections 2024-01-24T13:06:43.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6e5966000 1 --2- 172.21.15.29:0/2197324132 >> [v2:172.21.15.29:6833/2075296900,v1:172.21.15.29:6835/2075296900] conn(0x55bb527767e0 0x55bb52776bc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6e5966000 1 --2- 172.21.15.29:0/2197324132 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb527752a0 0x55bb52775dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6e5966000 1 --2- 172.21.15.29:0/2197324132 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52774980 0x55bb52775890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6e5966000 1 --2- 172.21.15.29:0/2197324132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52728d30 0x55bb52758210 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6e5966000 1 -- 172.21.15.29:0/2197324132 >> 172.21.15.29:0/2197324132 conn(0x55bb5262e430 msgr2=0x55bb52727ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:43.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6c8c00640 0 client.6339 ms_handle_reset on v2:172.21.15.29:6833/2075296900 2024-01-24T13:06:43.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6e5966000 1 -- 172.21.15.29:0/2197324132 shutdown_connections 2024-01-24T13:06:43.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6e5966000 1 -- 172.21.15.29:0/2197324132 wait complete. 2024-01-24T13:06:43.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.802+0000 7ff6e5966000 20 client.6339 trim_cache size 0 max 16384 2024-01-24T13:06:43.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6e5966000 1 Processor -- start 2024-01-24T13:06:43.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6e5966000 1 -- start start 2024-01-24T13:06:43.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6e5966000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb5262e430 0x55bb52727f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6e5966000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52728d30 0x55bb527284a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6e5966000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52774980 0x55bb52731690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6e5966000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb52504410 con 0x55bb52774980 2024-01-24T13:06:43.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6e5966000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb525bce10 con 0x55bb52728d30 2024-01-24T13:06:43.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6e5966000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb5278a3c0 con 0x55bb5262e430 2024-01-24T13:06:43.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6dbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52774980 0x55bb52731690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6dbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52774980 0x55bb52731690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58228/0 (socket says 172.21.15.29:58228) 2024-01-24T13:06:43.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6dbe00640 1 -- 172.21.15.29:0/939619593 learned_addr learned my addr 172.21.15.29:0/939619593 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:43.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6db400640 1 --2- 172.21.15.29:0/939619593 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb5262e430 0x55bb52727f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6daa00640 1 --2- 172.21.15.29:0/939619593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52728d30 0x55bb527284a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6dbe00640 1 -- 172.21.15.29:0/939619593 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb5262e430 msgr2=0x55bb52727f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:43.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6dbe00640 1 --2- 172.21.15.29:0/939619593 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb5262e430 0x55bb52727f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6dbe00640 1 -- 172.21.15.29:0/939619593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52728d30 msgr2=0x55bb527284a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:43.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6dbe00640 1 --2- 172.21.15.29:0/939619593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52728d30 0x55bb527284a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6dbe00640 1 -- 172.21.15.29:0/939619593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc152640 con 0x55bb52774980 2024-01-24T13:06:43.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6dbe00640 1 --2- 172.21.15.29:0/939619593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52774980 0x55bb52731690 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4055060 tx=0x7ff6d4055470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf56db1ec169971 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:43.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6d0c00640 1 -- 172.21.15.29:0/939619593 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4053560 con 0x55bb52774980 2024-01-24T13:06:43.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6d0c00640 1 -- 172.21.15.29:0/939619593 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d4051a70 con 0x55bb52774980 2024-01-24T13:06:43.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.818+0000 7ff6d0c00640 1 -- 172.21.15.29:0/939619593 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d405d140 con 0x55bb52774980 2024-01-24T13:06:43.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 -- 172.21.15.29:0/939619593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52774980 msgr2=0x55bb52731690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 --2- 172.21.15.29:0/939619593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52774980 0x55bb52731690 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4055060 tx=0x7ff6d4055470 comp rx=0 tx=0).stop 2024-01-24T13:06:43.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 -- 172.21.15.29:0/939619593 shutdown_connections 2024-01-24T13:06:43.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 --2- 172.21.15.29:0/939619593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52774980 0x55bb52731690 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 --2- 172.21.15.29:0/939619593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52728d30 0x55bb527284a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 --2- 172.21.15.29:0/939619593 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb5262e430 0x55bb52727f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 -- 172.21.15.29:0/939619593 >> 172.21.15.29:0/939619593 conn(0x55bb52757260 msgr2=0x55bb52773d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:43.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 -- 172.21.15.29:0/939619593 shutdown_connections 2024-01-24T13:06:43.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 -- 172.21.15.29:0/939619593 wait complete. 2024-01-24T13:06:43.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 -- start start 2024-01-24T13:06:43.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 Processor -- start 2024-01-24T13:06:43.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb5262e430 0x55bb52731ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52728d30 0x55bb527cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52774980 0x55bb527cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb5257cec0 con 0x55bb52728d30 2024-01-24T13:06:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb52781010 con 0x55bb52774980 2024-01-24T13:06:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb525815e0 con 0x55bb5262e430 2024-01-24T13:06:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 10 client.0 _ll_register_callbacks cb 0x55bb526f7700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-24T13:06:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6daa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52728d30 0x55bb527cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6daa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52728d30 0x55bb527cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58236/0 (socket says 172.21.15.29:58236) 2024-01-24T13:06:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6daa00640 1 -- 172.21.15.29:0/3240731265 learned_addr learned my addr 172.21.15.29:0/3240731265 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6db400640 1 --2- 172.21.15.29:0/3240731265 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb5262e430 0x55bb52731ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6dbe00640 1 --2- 172.21.15.29:0/3240731265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52774980 0x55bb527cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6daa00640 1 -- 172.21.15.29:0/3240731265 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb5262e430 msgr2=0x55bb52731ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6daa00640 1 --2- 172.21.15.29:0/3240731265 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb5262e430 0x55bb52731ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6daa00640 1 -- 172.21.15.29:0/3240731265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52774980 msgr2=0x55bb527cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6daa00640 1 --2- 172.21.15.29:0/3240731265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52774980 0x55bb527cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6daa00640 1 -- 172.21.15.29:0/3240731265 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc1556a0 con 0x55bb52728d30 2024-01-24T13:06:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6dbe00640 1 --2- 172.21.15.29:0/3240731265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52774980 0x55bb527cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6daa00640 1 --2- 172.21.15.29:0/3240731265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52728d30 0x55bb527cd720 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400aa10 tx=0x7ff6c40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c211c4f730f0abf4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-01-24T13:06:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6c8c00640 1 -- 172.21.15.29:0/3240731265 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c40c49f0 con 0x55bb52728d30 2024-01-24T13:06:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6c8c00640 1 -- 172.21.15.29:0/3240731265 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff6c40bd040 con 0x55bb52728d30 2024-01-24T13:06:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.822+0000 7ff6e5966000 1 -- 172.21.15.29:0/3240731265 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb52532a00 con 0x55bb52728d30 2024-01-24T13:06:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6c8c00640 1 -- 172.21.15.29:0/3240731265 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6c40c4b50 con 0x55bb52728d30 2024-01-24T13:06:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 10 client.6345 fetch_fsmap learned FSMap version 26 2024-01-24T13:06:43.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 1 -- 172.21.15.29:0/3240731265 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55bb5253e2d0 con 0x55bb52728d30 2024-01-24T13:06:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6c8c00640 1 -- 172.21.15.29:0/3240731265 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb52532a00 con 0x55bb52728d30 2024-01-24T13:06:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6c8c00640 1 -- 172.21.15.29:0/3240731265 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 26) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff6c40c1070 con 0x55bb52728d30 2024-01-24T13:06:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 10 client.6345 fetch_fsmap finished waiting for FSMap version 26 2024-01-24T13:06:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 10 client.6345 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-24T13:06:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 20 client.6345 populate_metadata read hostname 'smithi029' 2024-01-24T13:06:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 1 --2- 172.21.15.29:0/3240731265 >> [v2:172.21.15.29:6833/2075296900,v1:172.21.15.29:6835/2075296900] conn(0x55bb527752a0 0x55bb5272b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 4 client.6345 mds_command: new command op to 6180 tid=0[{"prefix": "status"}] 2024-01-24T13:06:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 1 -- 172.21.15.29:0/3240731265 --> [v2:172.21.15.29:6833/2075296900,v1:172.21.15.29:6835/2075296900] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bb52572290 con 0x55bb527752a0 2024-01-24T13:06:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6db400640 1 --2- 172.21.15.29:0/3240731265 >> [v2:172.21.15.29:6833/2075296900,v1:172.21.15.29:6835/2075296900] conn(0x55bb527752a0 0x55bb5272b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6db400640 1 --2- 172.21.15.29:0/3240731265 >> [v2:172.21.15.29:6833/2075296900,v1:172.21.15.29:6835/2075296900] conn(0x55bb527752a0 0x55bb5272b120 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c794be7ece7d2946 server_cookie=d52a7d5ddc72c251 in_seq=0 out_seq=0 2024-01-24T13:06:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6c8c00640 10 client.6345 ms_handle_connect on v2:172.21.15.29:6833/2075296900 2024-01-24T13:06:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6c8c00640 1 -- 172.21.15.29:0/3240731265 <== mds.0 v2:172.21.15.29:6833/2075296900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55bb52572290 con 0x55bb527752a0 2024-01-24T13:06:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6c8c00640 10 client.6345 handle_command_reply: tid=0 2024-01-24T13:06:43.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 1 client.6345 shutdown 2024-01-24T13:06:43.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 1 -- 172.21.15.29:0/3240731265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52728d30 msgr2=0x55bb527cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 1 --2- 172.21.15.29:0/3240731265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52728d30 0x55bb527cd720 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400aa10 tx=0x7ff6c40046d0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 1 -- 172.21.15.29:0/3240731265 shutdown_connections 2024-01-24T13:06:43.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 1 --2- 172.21.15.29:0/3240731265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bb52774980 0x55bb527cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 1 --2- 172.21.15.29:0/3240731265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bb52728d30 0x55bb527cd720 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 1 --2- 172.21.15.29:0/3240731265 >> [v2:172.21.15.29:6833/2075296900,v1:172.21.15.29:6835/2075296900] conn(0x55bb527752a0 0x55bb5272b120 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 1 --2- 172.21.15.29:0/3240731265 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55bb5262e430 0x55bb52731ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6c8c00640 0 client.6345 ms_handle_reset on v2:172.21.15.29:6833/2075296900 2024-01-24T13:06:43.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 1 -- 172.21.15.29:0/3240731265 >> 172.21.15.29:0/3240731265 conn(0x55bb52757260 msgr2=0x55bb52726f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:43.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 1 -- 172.21.15.29:0/3240731265 shutdown_connections 2024-01-24T13:06:43.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 1 -- 172.21.15.29:0/3240731265 wait complete. 2024-01-24T13:06:43.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e5966000 20 client.6345 trim_cache size 0 max 16384 2024-01-24T13:06:43.834 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:06:43.834 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "065451ff-9152-4ec9-a888-63a66559ccfb", 2024-01-24T13:06:43.835 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-01-24T13:06:43.835 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 6180, 2024-01-24T13:06:43.835 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-01-24T13:06:43.835 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-01-24T13:06:43.835 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-01-24T13:06:43.835 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 10.465969313, 2024-01-24T13:06:43.835 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 26, 2024-01-24T13:06:43.835 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 59, 2024-01-24T13:06:43.835 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 59, 2024-01-24T13:06:43.835 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 15.722306542 2024-01-24T13:06:43.835 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:06:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e2600640 1 -- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff6b4065a60 msgr2=0x7ff6b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e2600640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff6b4065a60 0x7ff6b4067f20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc000fc0 tx=0x7ff6cc009040 comp rx=0 tx=0).stop 2024-01-24T13:06:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e2600640 1 -- 172.21.15.29:0/1497057311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6dc15c790 msgr2=0x7ff6dc1621d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e2600640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6dc15c790 0x7ff6dc1621d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400efc0 tx=0x7ff6d400c490 comp rx=0 tx=0).stop 2024-01-24T13:06:43.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e2600640 1 -- 172.21.15.29:0/1497057311 shutdown_connections 2024-01-24T13:06:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e2600640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff6b4065a60 0x7ff6b4067f20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e2600640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6dc15c790 0x7ff6dc1621d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e2600640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff6dc158c10 0x7ff6dc161c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e2600640 1 --2- 172.21.15.29:0/1497057311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6dc0cb110 0x7ff6dc14c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e2600640 1 -- 172.21.15.29:0/1497057311 >> 172.21.15.29:0/1497057311 conn(0x7ff6dc06a2d0 msgr2=0x7ff6dc162dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e2600640 1 -- 172.21.15.29:0/1497057311 shutdown_connections 2024-01-24T13:06:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.826+0000 7ff6e2600640 1 -- 172.21.15.29:0/1497057311 wait complete. 2024-01-24T13:06:43.853 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-24T13:06:43.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.990+0000 7f4ae4200640 1 Processor -- start 2024-01-24T13:06:43.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.990+0000 7f4ae4200640 1 -- start start 2024-01-24T13:06:43.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.990+0000 7f4ae4200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4adc06bc10 0x7f4adc06c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.990+0000 7f4ae4200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4adc06c5b0 con 0x7f4adc159300 2024-01-24T13:06:43.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.990+0000 7f4ae4200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4adc15de10 con 0x7f4adc15cf50 2024-01-24T13:06:43.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.990+0000 7f4ae4200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc071140 con 0x7f4adc06bc10 2024-01-24T13:06:43.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.990+0000 7f4ae1800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4adc159300 0x7f4adc0b1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47076/0 (socket says 172.21.15.29:47076) 2024-01-24T13:06:43.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.990+0000 7f4ae1800640 1 -- 172.21.15.29:0/684665659 learned_addr learned my addr 172.21.15.29:0/684665659 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:43.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4ae0e00640 1 --2- 172.21.15.29:0/684665659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4adc06bc10 0x7f4adc06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028423945 0 0) 0x7f4adc06c5b0 con 0x7f4adc159300 2024-01-24T13:06:43.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4abc005740 con 0x7f4adc159300 2024-01-24T13:06:43.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935684656 0 0) 0x7f4adc15de10 con 0x7f4adc15cf50 2024-01-24T13:06:43.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4adc06c5b0 con 0x7f4adc15cf50 2024-01-24T13:06:43.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2022867696 0 0) 0x7f4abc005740 con 0x7f4adc159300 2024-01-24T13:06:43.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4adc06bc10 msgr2=0x7f4adc06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:43.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 --2- 172.21.15.29:0/684665659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4adc06bc10 0x7f4adc06c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:43.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 >> v1:172.21.15.163:6789/0 conn(0x7f4adc15cf50 legacy=0x7f4adc0cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc15db30 con 0x7f4adc159300 2024-01-24T13:06:43.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f4acc001680 con 0x7f4adc159300 2024-01-24T13:06:43.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 >> v1:172.21.15.29:6789/0 conn(0x7f4adc159300 legacy=0x7f4adc0b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:43.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 --2- 172.21.15.29:0/684665659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4adc06bc10 0x7f4abc005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 --2- 172.21.15.29:0/684665659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4abc0062b0 0x7f4abc0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 --2- 172.21.15.29:0/684665659 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4abc006f20 0x7f4abc0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:43.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc00dd30 con 0x7f4abc0062b0 2024-01-24T13:06:43.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc00de70 con 0x7f4abc006f20 2024-01-24T13:06:43.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc00e000 con 0x7f4adc06bc10 2024-01-24T13:06:43.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4ae0e00640 1 --2- 172.21.15.29:0/684665659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4abc0062b0 0x7f4abc0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4ae1800640 1 --2- 172.21.15.29:0/684665659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4adc06bc10 0x7f4abc005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4ae2200640 1 --2- 172.21.15.29:0/684665659 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4abc006f20 0x7f4abc0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:43.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4ae0e00640 1 -- 172.21.15.29:0/684665659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4adc06bc10 msgr2=0x7f4abc005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:44.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4ae0e00640 1 --2- 172.21.15.29:0/684665659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4adc06bc10 0x7f4abc005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:44.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4ae0e00640 1 -- 172.21.15.29:0/684665659 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4abc006f20 msgr2=0x7f4abc0073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:44.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4ae0e00640 1 --2- 172.21.15.29:0/684665659 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4abc006f20 0x7f4abc0073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:44.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.994+0000 7f4ae0e00640 1 -- 172.21.15.29:0/684665659 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc005740 con 0x7f4abc0062b0 2024-01-24T13:06:44.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.998+0000 7f4ae0e00640 1 --2- 172.21.15.29:0/684665659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4abc0062b0 0x7f4abc0069e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009ae0 tx=0x7f4ac401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f613ecae53e3847e server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:44.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.998+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40a6410 con 0x7f4abc0062b0 2024-01-24T13:06:44.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.998+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac40a6570 con 0x7f4abc0062b0 2024-01-24T13:06:44.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.998+0000 7f4adbe00640 1 -- 172.21.15.29:0/684665659 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40a6920 con 0x7f4abc0062b0 2024-01-24T13:06:44.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.998+0000 7f4ae4200640 1 -- 172.21.15.29:0/684665659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4abc0062b0 msgr2=0x7f4abc0069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:44.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.998+0000 7f4ae4200640 1 --2- 172.21.15.29:0/684665659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4abc0062b0 0x7f4abc0069e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009ae0 tx=0x7f4ac401ca20 comp rx=0 tx=0).stop 2024-01-24T13:06:44.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.998+0000 7f4ae2200640 1 -- 172.21.15.29:0/684665659 reap_dead start 2024-01-24T13:06:44.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.998+0000 7f4ae4200640 1 -- 172.21.15.29:0/684665659 shutdown_connections 2024-01-24T13:06:44.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.998+0000 7f4ae4200640 1 -- 172.21.15.29:0/684665659 >> 172.21.15.29:0/684665659 conn(0x7f4adc0b3950 msgr2=0x7f4adc069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:44.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.998+0000 7f4ae4200640 1 -- 172.21.15.29:0/684665659 shutdown_connections 2024-01-24T13:06:44.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.998+0000 7f4ae4200640 1 -- 172.21.15.29:0/684665659 wait complete. 2024-01-24T13:06:44.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.998+0000 7f4ae4200640 1 Processor -- start 2024-01-24T13:06:44.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:43.998+0000 7f4ae4200640 1 -- start start 2024-01-24T13:06:44.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae4200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4abc0062b0 0x7f4adc14f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:44.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae4200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4adc1e79c0 0x7f4adc1580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:44.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae4200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4adc15f0b0 0x7f4adc15f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:44.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae4200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc15ca10 con 0x7f4adc1e79c0 2024-01-24T13:06:44.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae4200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc15fa70 con 0x7f4adc15f0b0 2024-01-24T13:06:44.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae4200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc1e8640 con 0x7f4abc0062b0 2024-01-24T13:06:44.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae0e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4adc1e79c0 0x7f4adc1580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:44.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae0e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4adc1e79c0 0x7f4adc1580e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58254/0 (socket says 172.21.15.29:58254) 2024-01-24T13:06:44.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae0e00640 1 -- 172.21.15.29:0/185849988 learned_addr learned my addr 172.21.15.29:0/185849988 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:44.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae2200640 1 --2- 172.21.15.29:0/185849988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4adc15f0b0 0x7f4adc15f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:44.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae1800640 1 --2- 172.21.15.29:0/185849988 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4abc0062b0 0x7f4adc14f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:44.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae0e00640 1 -- 172.21.15.29:0/185849988 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4abc0062b0 msgr2=0x7f4adc14f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:44.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae0e00640 1 --2- 172.21.15.29:0/185849988 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4abc0062b0 0x7f4adc14f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:44.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae0e00640 1 -- 172.21.15.29:0/185849988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4adc15f0b0 msgr2=0x7f4adc15f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:44.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae0e00640 1 --2- 172.21.15.29:0/185849988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4adc15f0b0 0x7f4adc15f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:44.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae0e00640 1 -- 172.21.15.29:0/185849988 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc1e8920 con 0x7f4adc1e79c0 2024-01-24T13:06:44.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae0e00640 1 --2- 172.21.15.29:0/185849988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4adc1e79c0 0x7f4adc1580e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009ae0 tx=0x7f4abc007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:44.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ad9600640 1 -- 172.21.15.29:0/185849988 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac400f000 con 0x7f4adc1e79c0 2024-01-24T13:06:44.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ad9600640 1 -- 172.21.15.29:0/185849988 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac40a6d60 con 0x7f4adc1e79c0 2024-01-24T13:06:44.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ad9600640 1 -- 172.21.15.29:0/185849988 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40b9630 con 0x7f4adc1e79c0 2024-01-24T13:06:44.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae4200640 1 -- 172.21.15.29:0/185849988 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4adc1e8c00 con 0x7f4adc1e79c0 2024-01-24T13:06:44.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae4200640 1 -- 172.21.15.29:0/185849988 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4adc1e91c0 con 0x7f4adc1e79c0 2024-01-24T13:06:44.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.002+0000 7f4ae4200640 1 -- 172.21.15.29:0/185849988 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4adc04e850 con 0x7f4adc1e79c0 2024-01-24T13:06:44.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.006+0000 7f4ad9600640 1 -- 172.21.15.29:0/185849988 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4ac40b03f0 con 0x7f4adc1e79c0 2024-01-24T13:06:44.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.006+0000 7f4ad9600640 1 --2- 172.21.15.29:0/185849988 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4ab4065a90 0x7f4ab4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:44.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.006+0000 7f4ad9600640 1 -- 172.21.15.29:0/185849988 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4ac411cb30 con 0x7f4adc1e79c0 2024-01-24T13:06:44.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.006+0000 7f4ae1800640 1 --2- 172.21.15.29:0/185849988 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4ab4065a90 0x7f4ab4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:44.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.006+0000 7f4ae1800640 1 --2- 172.21.15.29:0/185849988 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4ab4065a90 0x7f4ab4067f50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4acc001ec0 tx=0x7f4acc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.010+0000 7f4ad9600640 1 -- 172.21.15.29:0/185849988 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4ac40ea390 con 0x7f4adc1e79c0 2024-01-24T13:06:44.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.202+0000 7f4ae4200640 1 -- 172.21.15.29:0/185849988 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4adc06a260 con 0x7f4adc1e79c0 2024-01-24T13:06:44.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.202+0000 7f4ad9600640 1 -- 172.21.15.29:0/185849988 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4ac40be020 con 0x7f4adc1e79c0 2024-01-24T13:06:44.206 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-24T13:06:44.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.206+0000 7f4ae4200640 1 -- 172.21.15.29:0/185849988 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4ab4065a90 msgr2=0x7f4ab4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:44.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.206+0000 7f4ae4200640 1 --2- 172.21.15.29:0/185849988 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4ab4065a90 0x7f4ab4067f50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4acc001ec0 tx=0x7f4acc009040 comp rx=0 tx=0).stop 2024-01-24T13:06:44.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.206+0000 7f4ae4200640 1 -- 172.21.15.29:0/185849988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4adc1e79c0 msgr2=0x7f4adc1580e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:44.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.206+0000 7f4ae4200640 1 --2- 172.21.15.29:0/185849988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4adc1e79c0 0x7f4adc1580e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009ae0 tx=0x7f4abc007a10 comp rx=0 tx=0).stop 2024-01-24T13:06:44.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.206+0000 7f4ae4200640 1 -- 172.21.15.29:0/185849988 shutdown_connections 2024-01-24T13:06:44.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.206+0000 7f4ae4200640 1 --2- 172.21.15.29:0/185849988 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4ab4065a90 0x7f4ab4067f50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:44.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.206+0000 7f4ae4200640 1 --2- 172.21.15.29:0/185849988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4adc15f0b0 0x7f4adc15f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:44.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.206+0000 7f4ae4200640 1 --2- 172.21.15.29:0/185849988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4adc1e79c0 0x7f4adc1580e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:44.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.206+0000 7f4ae4200640 1 --2- 172.21.15.29:0/185849988 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4abc0062b0 0x7f4adc14f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:44.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.206+0000 7f4ae4200640 1 -- 172.21.15.29:0/185849988 >> 172.21.15.29:0/185849988 conn(0x7f4adc0b3950 msgr2=0x7f4adc154520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:44.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.206+0000 7f4ae4200640 1 -- 172.21.15.29:0/185849988 shutdown_connections 2024-01-24T13:06:44.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:44.206+0000 7f4ae4200640 1 -- 172.21.15.29:0/185849988 wait complete. 2024-01-24T13:06:44.228 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-24T13:06:44.228 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-24T13:06:44.228 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-01-24T13:06:44.229 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-24T13:06:44.229 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:44.229 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-24T13:06:44.229 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-24T13:06:44.229 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-24T13:06:44.229 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:06:44.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:44.229 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-01-24T13:06:44.239 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:06:44.239 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:06:44.239 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:06:44.239 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:44.239 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-24T13:06:44.239 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:44.239 INFO:teuthology.orchestra.run.smithi029.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-24T13:06:44.239 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:44.240 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-01-24T13:06:44.240 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-24T13:06:44.240 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42294sec preferred_lft 42294sec 2024-01-24T13:06:44.240 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-01-24T13:06:44.240 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:44.240 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:06:44.240 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:44.240 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-01-24T13:06:44.240 INFO:teuthology.orchestra.run.smithi029.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:06:44.240 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:44.240 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-01-24T13:06:44.240 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:06:44.240 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:44.241 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-01-24T13:06:44.241 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-24T13:06:44.241 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:b4:3c:c7:07 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:44.241 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-24T13:06:44.241 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:44.241 INFO:teuthology.orchestra.run.smithi029.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-24T13:06:44.241 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:44.241 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-24T13:06:44.241 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:44.241 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-24T13:06:44.241 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:44.241 INFO:teuthology.orchestra.run.smithi029.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T13:06:44.242 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-24T13:06:44.242 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-24T13:06:44.242 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:44.242 INFO:teuthology.orchestra.run.smithi029.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T13:06:44.242 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-24T13:06:44.242 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-01-24T13:06:44.242 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:44.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:44.242 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-24T13:06:44.301 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-01-24T13:06:44.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:44.304 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-01-24T13:06:44.357 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-01-24T13:06:44.357 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-24T13:06:44.357 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-24T13:06:44.357 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-24T13:06:44.357 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-24T13:06:44.357 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-24T13:06:44.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:44.358 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:06:44.358 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:06:44.358 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-24T13:06:44.358 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-24T13:06:44.358 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-24T13:06:44.358 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:06:44.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:44.450 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-24T13:06:44.460 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-24T13:06:44.460 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-24T13:06:44.460 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:06:44.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:44.460 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-01-24T13:06:44.524 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-24T13:06:44.524 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:06:44.524 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:44.576 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:06:44.577 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:06:44.577 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:44.627 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:06:44.692 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:06:44.693 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:06:44.754 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:06:44.755 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:06:44.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:44.756 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:06:44.808 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-24T13:06:44.808 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-24T13:06:44.858 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:06:44.879 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:06:44.879 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:06:44.946 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:06:44.948 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:06:44.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:44.948 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:06:44.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2024-01-24T13:06:44.950+0000 7f0dd6e47580 -1 init, newargv = 0x561275e07060 newargc=15 2024-01-24T13:06:44.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[39834]: starting ceph client 2024-01-24T13:06:44.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[39834]: starting fuse 2024-01-24T13:06:44.964 INFO:teuthology.orchestra.run.smithi029.stdout:43 2024-01-24T13:06:44.964 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-24T13:06:44.965 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-24T13:06:44.965 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-01-24T13:06:44.965 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-01-24T13:06:44.965 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-01-24T13:06:44.965 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-01-24T13:06:44.965 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:06:44.965 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-01-24T13:06:44.965 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-24T13:06:44.965 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-24T13:06:44.966 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:06:44.967 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2024-01-24T13:06:44.967 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-01-24T13:06:45.092 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.39834.asok 2024-01-24T13:06:45.276 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39834.asok 2024-01-24T13:06:45.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:45.277 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39834.asok status 2024-01-24T13:06:45.451 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:06:45.452 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-01-24T13:06:45.452 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "4e3182a65800aed6d4aa2f6b86da3cfd72188134", 2024-01-24T13:06:45.452 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable)", 2024-01-24T13:06:45.452 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2024-01-24T13:06:45.452 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-01-24T13:06:45.452 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-24T13:06:45.452 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "39834", 2024-01-24T13:06:45.452 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-01-24T13:06:45.452 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:45.452 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-01-24T13:06:45.452 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-01-24T13:06:45.453 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 6360, 2024-01-24T13:06:45.453 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-01-24T13:06:45.453 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-01-24T13:06:45.453 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-01-24T13:06:45.453 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 6360 2024-01-24T13:06:45.453 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:45.453 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:06:45.453 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:06:45.453 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:06:45.453 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 1758835179 2024-01-24T13:06:45.453 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:45.453 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:45.453 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:06:45.453 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:06:45.454 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:06:45.454 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 1758835179 2024-01-24T13:06:45.454 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:45.454 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.6360 192.168.0.1:0/1758835179", 2024-01-24T13:06:45.454 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/1758835179", 2024-01-24T13:06:45.454 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-01-24T13:06:45.454 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 26, 2024-01-24T13:06:45.454 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 59, 2024-01-24T13:06:45.454 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-01-24T13:06:45.454 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-01-24T13:06:45.454 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-01-24T13:06:45.454 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:06:45.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:45.468 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-01-24T13:06:45.468 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:45.477 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-01-24T13:06:45.477 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:45.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:45.477 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:45.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:45.540 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2024-01-24T13:06:45.604 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2024-01-24T13:06:45.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.794+0000 7f5f6d200640 1 Processor -- start 2024-01-24T13:06:45.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.794+0000 7f5f6d200640 1 -- start start 2024-01-24T13:06:45.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.794+0000 7f5f6d200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f6815a9d0 0x7f5f680b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:45.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.794+0000 7f5f6d200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5f680b4590 0x7f5f68070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:45.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.794+0000 7f5f6d200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6815f310 con 0x7f5f680709a0 2024-01-24T13:06:45.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.794+0000 7f5f6d200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f68070e30 con 0x7f5f680b4590 2024-01-24T13:06:45.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.794+0000 7f5f6d200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680b4b10 con 0x7f5f6815a9d0 2024-01-24T13:06:45.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.794+0000 7f5f66800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5f680709a0 0x7f5f6806c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47092/0 (socket says 172.21.15.29:47092) 2024-01-24T13:06:45.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.794+0000 7f5f66800640 1 -- 172.21.15.29:0/3880965684 learned_addr learned my addr 172.21.15.29:0/3880965684 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:45.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.794+0000 7f5f65400640 1 --2- 172.21.15.29:0/3880965684 >> v2:172.21.15.163:3300/0 conn(0x7f5f680b4590 0x7f5f68070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:45.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.798+0000 7f5f65e00640 1 --2- 172.21.15.29:0/3880965684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f6815a9d0 0x7f5f680b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:45.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.798+0000 7f5f64a00640 1 -- 172.21.15.29:0/3880965684 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601171161 0 0) 0x7f5f6815f310 con 0x7f5f680709a0 2024-01-24T13:06:45.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.798+0000 7f5f64a00640 1 -- 172.21.15.29:0/3880965684 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f48003530 con 0x7f5f680709a0 2024-01-24T13:06:45.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.798+0000 7f5f65400640 1 -- 172.21.15.29:0/3880965684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f6815a9d0 msgr2=0x7f5f680b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:45.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.798+0000 7f5f65400640 1 --2- 172.21.15.29:0/3880965684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f6815a9d0 0x7f5f680b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:45.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.798+0000 7f5f65400640 1 -- 172.21.15.29:0/3880965684 >> v1:172.21.15.29:6789/0 conn(0x7f5f680709a0 legacy=0x7f5f6806c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:45.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.798+0000 7f5f65400640 1 -- 172.21.15.29:0/3880965684 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6815ee80 con 0x7f5f680b4590 2024-01-24T13:06:45.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.798+0000 7f5f65400640 1 --2- 172.21.15.29:0/3880965684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f680b4590 0x7f5f68070460 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5f500097c0 tx=0x7f5f5001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80e66158a66abcd8 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:45.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f64a00640 1 -- 172.21.15.29:0/3880965684 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f500ab600 con 0x7f5f680b4590 2024-01-24T13:06:45.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f64a00640 1 -- 172.21.15.29:0/3880965684 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f500a7050 con 0x7f5f680b4590 2024-01-24T13:06:45.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f64a00640 1 -- 172.21.15.29:0/3880965684 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f500ab980 con 0x7f5f680b4590 2024-01-24T13:06:45.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 -- 172.21.15.29:0/3880965684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f680b4590 msgr2=0x7f5f68070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:45.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 --2- 172.21.15.29:0/3880965684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f680b4590 0x7f5f68070460 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5f500097c0 tx=0x7f5f5001c450 comp rx=0 tx=0).stop 2024-01-24T13:06:45.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 -- 172.21.15.29:0/3880965684 shutdown_connections 2024-01-24T13:06:45.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 --2- 172.21.15.29:0/3880965684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f680b4590 0x7f5f68070460 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:45.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 --2- 172.21.15.29:0/3880965684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f6815a9d0 0x7f5f680b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:45.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 -- 172.21.15.29:0/3880965684 >> 172.21.15.29:0/3880965684 conn(0x7f5f680cb6a0 msgr2=0x7f5f680cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:45.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 -- 172.21.15.29:0/3880965684 shutdown_connections 2024-01-24T13:06:45.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 -- 172.21.15.29:0/3880965684 wait complete. 2024-01-24T13:06:45.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 Processor -- start 2024-01-24T13:06:45.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 -- start start 2024-01-24T13:06:45.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f680709a0 0x7f5f680c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:45.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f680b4590 0x7f5f68146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:45.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f6815a9d0 0x7f5f681f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:45.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f68146dd0 con 0x7f5f6815a9d0 2024-01-24T13:06:45.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680c5d70 con 0x7f5f680709a0 2024-01-24T13:06:45.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.802+0000 7f5f6d200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680c3990 con 0x7f5f680b4590 2024-01-24T13:06:45.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f66800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f6815a9d0 0x7f5f681f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:45.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f66800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f6815a9d0 0x7f5f681f5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58258/0 (socket says 172.21.15.29:58258) 2024-01-24T13:06:45.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f66800640 1 -- 172.21.15.29:0/1664362033 learned_addr learned my addr 172.21.15.29:0/1664362033 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:45.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f65e00640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f680709a0 0x7f5f680c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:45.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f65400640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f680b4590 0x7f5f68146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:45.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f66800640 1 -- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f680b4590 msgr2=0x7f5f68146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:45.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f66800640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f680b4590 0x7f5f68146890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:45.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f66800640 1 -- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f680709a0 msgr2=0x7f5f680c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:45.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f66800640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f680709a0 0x7f5f680c30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:45.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f66800640 1 -- 172.21.15.29:0/1664362033 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f50009420 con 0x7f5f6815a9d0 2024-01-24T13:06:45.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f65400640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f680b4590 0x7f5f68146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:45.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f65e00640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f680709a0 0x7f5f680c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:45.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f66800640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f6815a9d0 0x7f5f681f5e30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000cb40 tx=0x7f5f6000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:45.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f5e000640 1 -- 172.21.15.29:0/1664362033 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000aca0 con 0x7f5f6815a9d0 2024-01-24T13:06:45.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f5e000640 1 -- 172.21.15.29:0/1664362033 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6000ae00 con 0x7f5f6815a9d0 2024-01-24T13:06:45.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f5e000640 1 -- 172.21.15.29:0/1664362033 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60012620 con 0x7f5f6815a9d0 2024-01-24T13:06:45.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f6d200640 1 -- 172.21.15.29:0/1664362033 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f680c36b0 con 0x7f5f6815a9d0 2024-01-24T13:06:45.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f6d200640 1 -- 172.21.15.29:0/1664362033 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6815b1c0 con 0x7f5f6815a9d0 2024-01-24T13:06:45.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f6d200640 1 -- 172.21.15.29:0/1664362033 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6804e850 con 0x7f5f6815a9d0 2024-01-24T13:06:45.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.806+0000 7f5f5e000640 1 -- 172.21.15.29:0/1664362033 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5f60007070 con 0x7f5f6815a9d0 2024-01-24T13:06:45.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.810+0000 7f5f5e000640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5f40065a60 0x7f5f40067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:45.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.810+0000 7f5f5e000640 1 -- 172.21.15.29:0/1664362033 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5f600833c0 con 0x7f5f6815a9d0 2024-01-24T13:06:45.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.810+0000 7f5f65e00640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5f40065a60 0x7f5f40067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:45.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.810+0000 7f5f65e00640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5f40065a60 0x7f5f40067f20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009a40 tx=0x7f5f58008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:45.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:45.814+0000 7f5f5e000640 1 -- 172.21.15.29:0/1664362033 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f5f60050ba0 con 0x7f5f6815a9d0 2024-01-24T13:06:46.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.022+0000 7f5f6d200640 1 -- 172.21.15.29:0/1664362033 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) v1 -- 0x7f5f680c2460 con 0x7f5f6815a9d0 2024-01-24T13:06:46.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.026+0000 7f5f5e000640 1 -- 172.21.15.29:0/1664362033 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v18) v1 ==== 183+0+0 (secure 0 0 0) 0x7f5f600541c0 con 0x7f5f6815a9d0 2024-01-24T13:06:46.032 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2024-01-24T13:06:46.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.030+0000 7f5f6d200640 1 -- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5f40065a60 msgr2=0x7f5f40067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.030+0000 7f5f6d200640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5f40065a60 0x7f5f40067f20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009a40 tx=0x7f5f58008040 comp rx=0 tx=0).stop 2024-01-24T13:06:46.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.030+0000 7f5f6d200640 1 -- 172.21.15.29:0/1664362033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f6815a9d0 msgr2=0x7f5f681f5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.030+0000 7f5f6d200640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f6815a9d0 0x7f5f681f5e30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000cb40 tx=0x7f5f6000a060 comp rx=0 tx=0).stop 2024-01-24T13:06:46.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.030+0000 7f5f6d200640 1 -- 172.21.15.29:0/1664362033 shutdown_connections 2024-01-24T13:06:46.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.030+0000 7f5f6d200640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5f40065a60 0x7f5f40067f20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.030+0000 7f5f6d200640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f6815a9d0 0x7f5f681f5e30 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.030+0000 7f5f6d200640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f680b4590 0x7f5f68146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.030+0000 7f5f6d200640 1 --2- 172.21.15.29:0/1664362033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f680709a0 0x7f5f680c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.030+0000 7f5f6d200640 1 -- 172.21.15.29:0/1664362033 >> 172.21.15.29:0/1664362033 conn(0x7f5f680cb6a0 msgr2=0x7f5f6814f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:46.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.030+0000 7f5f6d200640 1 -- 172.21.15.29:0/1664362033 shutdown_connections 2024-01-24T13:06:46.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.030+0000 7f5f6d200640 1 -- 172.21.15.29:0/1664362033 wait complete. 2024-01-24T13:06:46.054 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:06:46.054 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:06:46.063 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:06:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.238+0000 7f9d76e00640 1 Processor -- start 2024-01-24T13:06:46.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.238+0000 7f9d76e00640 1 -- start start 2024-01-24T13:06:46.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.242+0000 7f9d76e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d70159300 0x7f9d700b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.242+0000 7f9d76e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7015de10 con 0x7f9d7006bc10 2024-01-24T13:06:46.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.242+0000 7f9d76e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7015db30 con 0x7f9d7015d660 2024-01-24T13:06:46.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.242+0000 7f9d76e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d70071140 con 0x7f9d70159300 2024-01-24T13:06:46.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.242+0000 7f9d6f400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9d7006bc10 0x7f9d7015cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47094/0 (socket says 172.21.15.29:47094) 2024-01-24T13:06:46.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.242+0000 7f9d6f400640 1 -- 172.21.15.29:0/2291253379 learned_addr learned my addr 172.21.15.29:0/2291253379 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.242+0000 7f9d6fe00640 1 --2- 172.21.15.29:0/2291253379 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d70159300 0x7f9d700b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.242+0000 7f9d6ea00640 1 -- 172.21.15.29:0/2291253379 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129231551 0 0) 0x7f9d7015de10 con 0x7f9d7006bc10 2024-01-24T13:06:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.242+0000 7f9d6ea00640 1 -- 172.21.15.29:0/2291253379 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d50003530 con 0x7f9d7006bc10 2024-01-24T13:06:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.242+0000 7f9d6ea00640 1 -- 172.21.15.29:0/2291253379 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600503321 0 0) 0x7f9d7015db30 con 0x7f9d7015d660 2024-01-24T13:06:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.242+0000 7f9d6ea00640 1 -- 172.21.15.29:0/2291253379 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d7015de10 con 0x7f9d7015d660 2024-01-24T13:06:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.242+0000 7f9d6fe00640 1 -- 172.21.15.29:0/2291253379 >> v1:172.21.15.163:6789/0 conn(0x7f9d7015d660 legacy=0x7f9d700cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.242+0000 7f9d6fe00640 1 -- 172.21.15.29:0/2291253379 >> v1:172.21.15.29:6789/0 conn(0x7f9d7006bc10 legacy=0x7f9d7015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.242+0000 7f9d6fe00640 1 -- 172.21.15.29:0/2291253379 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d700b1160 con 0x7f9d70159300 2024-01-24T13:06:46.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.246+0000 7f9d6fe00640 1 --2- 172.21.15.29:0/2291253379 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d70159300 0x7f9d700b1c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d600097f0 tx=0x7f9d6001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22ff9f036c432710 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:46.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.246+0000 7f9d6ea00640 1 -- 172.21.15.29:0/2291253379 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600ab600 con 0x7f9d70159300 2024-01-24T13:06:46.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.246+0000 7f9d6ea00640 1 -- 172.21.15.29:0/2291253379 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d600ab760 con 0x7f9d70159300 2024-01-24T13:06:46.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.246+0000 7f9d6ea00640 1 -- 172.21.15.29:0/2291253379 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600abaf0 con 0x7f9d70159300 2024-01-24T13:06:46.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.246+0000 7f9d76e00640 1 -- 172.21.15.29:0/2291253379 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d70159300 msgr2=0x7f9d700b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.246+0000 7f9d76e00640 1 --2- 172.21.15.29:0/2291253379 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d70159300 0x7f9d700b1c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d600097f0 tx=0x7f9d6001c400 comp rx=0 tx=0).stop 2024-01-24T13:06:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.246+0000 7f9d76e00640 1 -- 172.21.15.29:0/2291253379 shutdown_connections 2024-01-24T13:06:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.246+0000 7f9d76e00640 1 --2- 172.21.15.29:0/2291253379 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d70159300 0x7f9d700b1c40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.246+0000 7f9d76e00640 1 -- 172.21.15.29:0/2291253379 >> 172.21.15.29:0/2291253379 conn(0x7f9d700b3950 msgr2=0x7f9d70069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.246+0000 7f9d76e00640 1 -- 172.21.15.29:0/2291253379 shutdown_connections 2024-01-24T13:06:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.246+0000 7f9d76e00640 1 -- 172.21.15.29:0/2291253379 wait complete. 2024-01-24T13:06:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.246+0000 7f9d76e00640 1 Processor -- start 2024-01-24T13:06:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.246+0000 7f9d76e00640 1 -- start start 2024-01-24T13:06:46.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d76e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d7006bc10 0x7f9d70150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d76e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d70159300 0x7f9d7015ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d76e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d7015d660 0x7f9d70162d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d76e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d700ae0a0 con 0x7f9d70159300 2024-01-24T13:06:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d76e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d701632d0 con 0x7f9d7006bc10 2024-01-24T13:06:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d76e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7015b560 con 0x7f9d7015d660 2024-01-24T13:06:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d6f400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d70159300 0x7f9d7015ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d6f400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d70159300 0x7f9d7015ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58266/0 (socket says 172.21.15.29:58266) 2024-01-24T13:06:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d6f400640 1 -- 172.21.15.29:0/3464869460 learned_addr learned my addr 172.21.15.29:0/3464869460 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d74e00640 1 --2- 172.21.15.29:0/3464869460 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d7015d660 0x7f9d70162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d6fe00640 1 --2- 172.21.15.29:0/3464869460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d7006bc10 0x7f9d70150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d6f400640 1 -- 172.21.15.29:0/3464869460 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d7015d660 msgr2=0x7f9d70162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d6f400640 1 --2- 172.21.15.29:0/3464869460 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d7015d660 0x7f9d70162d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d6f400640 1 -- 172.21.15.29:0/3464869460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d7006bc10 msgr2=0x7f9d70150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d6f400640 1 --2- 172.21.15.29:0/3464869460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d7006bc10 0x7f9d70150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d6f400640 1 -- 172.21.15.29:0/3464869460 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d60009420 con 0x7f9d70159300 2024-01-24T13:06:46.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d6f400640 1 --2- 172.21.15.29:0/3464869460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d70159300 0x7f9d7015ae80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800c4d0 tx=0x7f9d5800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:46.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d67e00640 1 -- 172.21.15.29:0/3464869460 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d58005cf0 con 0x7f9d70159300 2024-01-24T13:06:46.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d67e00640 1 -- 172.21.15.29:0/3464869460 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d58005e50 con 0x7f9d70159300 2024-01-24T13:06:46.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d67e00640 1 -- 172.21.15.29:0/3464869460 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d58007270 con 0x7f9d70159300 2024-01-24T13:06:46.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d76e00640 1 -- 172.21.15.29:0/3464869460 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7015b840 con 0x7f9d70159300 2024-01-24T13:06:46.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d76e00640 1 -- 172.21.15.29:0/3464869460 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d700ae5d0 con 0x7f9d70159300 2024-01-24T13:06:46.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.250+0000 7f9d76e00640 1 -- 172.21.15.29:0/3464869460 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7015ba30 con 0x7f9d70159300 2024-01-24T13:06:46.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.254+0000 7f9d67e00640 1 -- 172.21.15.29:0/3464869460 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9d580073d0 con 0x7f9d70159300 2024-01-24T13:06:46.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.254+0000 7f9d67e00640 1 --2- 172.21.15.29:0/3464869460 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9d48065a60 0x7f9d48067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.254+0000 7f9d67e00640 1 -- 172.21.15.29:0/3464869460 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9d58082870 con 0x7f9d70159300 2024-01-24T13:06:46.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.254+0000 7f9d6fe00640 1 --2- 172.21.15.29:0/3464869460 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9d48065a60 0x7f9d48067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.254+0000 7f9d6fe00640 1 --2- 172.21.15.29:0/3464869460 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9d48065a60 0x7f9d48067f20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9d600af000 tx=0x7f9d600a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:46.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.258+0000 7f9d67e00640 1 -- 172.21.15.29:0/3464869460 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9d58050080 con 0x7f9d70159300 2024-01-24T13:06:46.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.418+0000 7f9d76e00640 1 -- 172.21.15.29:0/3464869460 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d70071f30 con 0x7f9d70159300 2024-01-24T13:06:46.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.422+0000 7f9d67e00640 1 -- 172.21.15.29:0/3464869460 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16302 (secure 0 0 0) 0x7f9d580536a0 con 0x7f9d70159300 2024-01-24T13:06:46.425 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:46.425 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":59,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:06:34.365221+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:06:31.105908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-24T13:06:32.357292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:06:46.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.422+0000 7f9d76e00640 1 -- 172.21.15.29:0/3464869460 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9d48065a60 msgr2=0x7f9d48067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.422+0000 7f9d76e00640 1 --2- 172.21.15.29:0/3464869460 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9d48065a60 0x7f9d48067f20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9d600af000 tx=0x7f9d600a7000 comp rx=0 tx=0).stop 2024-01-24T13:06:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.422+0000 7f9d76e00640 1 -- 172.21.15.29:0/3464869460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d70159300 msgr2=0x7f9d7015ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.422+0000 7f9d76e00640 1 --2- 172.21.15.29:0/3464869460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d70159300 0x7f9d7015ae80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800c4d0 tx=0x7f9d5800c990 comp rx=0 tx=0).stop 2024-01-24T13:06:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.422+0000 7f9d76e00640 1 -- 172.21.15.29:0/3464869460 shutdown_connections 2024-01-24T13:06:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.422+0000 7f9d76e00640 1 --2- 172.21.15.29:0/3464869460 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9d48065a60 0x7f9d48067f20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.422+0000 7f9d76e00640 1 --2- 172.21.15.29:0/3464869460 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d7015d660 0x7f9d70162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.422+0000 7f9d76e00640 1 --2- 172.21.15.29:0/3464869460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d70159300 0x7f9d7015ae80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.422+0000 7f9d76e00640 1 --2- 172.21.15.29:0/3464869460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d7006bc10 0x7f9d70150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.422+0000 7f9d76e00640 1 -- 172.21.15.29:0/3464869460 >> 172.21.15.29:0/3464869460 conn(0x7f9d700b3950 msgr2=0x7f9d70164610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.422+0000 7f9d76e00640 1 -- 172.21.15.29:0/3464869460 shutdown_connections 2024-01-24T13:06:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.422+0000 7f9d76e00640 1 -- 172.21.15.29:0/3464869460 wait complete. 2024-01-24T13:06:46.447 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:06:31.105908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:06:32.357292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:06:46.448 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:06:46.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.590+0000 7f8592000640 1 Processor -- start 2024-01-24T13:06:46.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.590+0000 7f8592000640 1 -- start start 2024-01-24T13:06:46.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.590+0000 7f8592000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f858c0ce4b0 0x7f858c15d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.590+0000 7f8592000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f858c0ce890 0x7f858c160410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.590+0000 7f8592000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858c15dd70 con 0x7f858c160950 2024-01-24T13:06:46.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.590+0000 7f8592000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858c15ce20 con 0x7f858c0ce4b0 2024-01-24T13:06:46.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.590+0000 7f8592000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858c160df0 con 0x7f858c0ce890 2024-01-24T13:06:46.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.590+0000 7f858b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f858c0ce4b0 0x7f858c15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.590+0000 7f858b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f858c0ce4b0 0x7f858c15d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58280/0 (socket says 172.21.15.29:58280) 2024-01-24T13:06:46.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.590+0000 7f858b400640 1 -- 172.21.15.29:0/3935567153 learned_addr learned my addr 172.21.15.29:0/3935567153 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:46.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.590+0000 7f858b400640 1 -- 172.21.15.29:0/3935567153 >> v2:172.21.15.163:3300/0 conn(0x7f858c0ce890 msgr2=0x7f858c160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:46.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.590+0000 7f858b400640 1 --2- 172.21.15.29:0/3935567153 >> v2:172.21.15.163:3300/0 conn(0x7f858c0ce890 0x7f858c160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.590+0000 7f858b400640 1 -- 172.21.15.29:0/3935567153 >> v1:172.21.15.163:6789/0 conn(0x7f858c160950 legacy=0x7f858c0ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:46.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.590+0000 7f858b400640 1 -- 172.21.15.29:0/3935567153 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c1610d0 con 0x7f858c0ce4b0 2024-01-24T13:06:46.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.594+0000 7f858b400640 1 --2- 172.21.15.29:0/3935567153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c0ce4b0 0x7f858c15d830 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f858c0cfa70 tx=0x7f857c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66c5110c8ce3c4a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:46.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.594+0000 7f858a000640 1 -- 172.21.15.29:0/3935567153 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c0ab600 con 0x7f858c0ce4b0 2024-01-24T13:06:46.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.594+0000 7f858a000640 1 -- 172.21.15.29:0/3935567153 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c0ab760 con 0x7f858c0ce4b0 2024-01-24T13:06:46.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.594+0000 7f858a000640 1 -- 172.21.15.29:0/3935567153 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c0abaf0 con 0x7f858c0ce4b0 2024-01-24T13:06:46.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.594+0000 7f8592000640 1 -- 172.21.15.29:0/3935567153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c0ce4b0 msgr2=0x7f858c15d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.594+0000 7f8592000640 1 --2- 172.21.15.29:0/3935567153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c0ce4b0 0x7f858c15d830 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f858c0cfa70 tx=0x7f857c01c400 comp rx=0 tx=0).stop 2024-01-24T13:06:46.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.594+0000 7f8592000640 1 -- 172.21.15.29:0/3935567153 shutdown_connections 2024-01-24T13:06:46.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.594+0000 7f8592000640 1 --2- 172.21.15.29:0/3935567153 >> v2:172.21.15.163:3300/0 conn(0x7f858c0ce890 0x7f858c160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.594+0000 7f8592000640 1 --2- 172.21.15.29:0/3935567153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c0ce4b0 0x7f858c15d830 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.594+0000 7f8592000640 1 -- 172.21.15.29:0/3935567153 >> 172.21.15.29:0/3935567153 conn(0x7f858c0704f0 msgr2=0x7f858c06e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:46.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.594+0000 7f8592000640 1 -- 172.21.15.29:0/3935567153 shutdown_connections 2024-01-24T13:06:46.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.594+0000 7f8592000640 1 -- 172.21.15.29:0/3935567153 wait complete. 2024-01-24T13:06:46.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f8592000640 1 Processor -- start 2024-01-24T13:06:46.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f8592000640 1 -- start start 2024-01-24T13:06:46.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f8592000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c0ce4b0 0x7f858c154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f8592000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c0ce890 0x7f858c0ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f8592000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f858c160950 0x7f858c14c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f8592000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c155420 con 0x7f858c0ce890 2024-01-24T13:06:46.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f8592000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c0d1040 con 0x7f858c160950 2024-01-24T13:06:46.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f8592000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c0d0a80 con 0x7f858c0ce4b0 2024-01-24T13:06:46.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f858aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c0ce890 0x7f858c0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f858aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c0ce890 0x7f858c0ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58288/0 (socket says 172.21.15.29:58288) 2024-01-24T13:06:46.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f858aa00640 1 -- 172.21.15.29:0/705823751 learned_addr learned my addr 172.21.15.29:0/705823751 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:46.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f858be00640 1 --2- 172.21.15.29:0/705823751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f858c160950 0x7f858c14c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f858b400640 1 --2- 172.21.15.29:0/705823751 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c0ce4b0 0x7f858c154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f858aa00640 1 -- 172.21.15.29:0/705823751 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c0ce4b0 msgr2=0x7f858c154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f858aa00640 1 --2- 172.21.15.29:0/705823751 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c0ce4b0 0x7f858c154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f858aa00640 1 -- 172.21.15.29:0/705823751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f858c160950 msgr2=0x7f858c14c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f858aa00640 1 --2- 172.21.15.29:0/705823751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f858c160950 0x7f858c14c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f858aa00640 1 -- 172.21.15.29:0/705823751 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c0094d0 con 0x7f858c0ce890 2024-01-24T13:06:46.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f858aa00640 1 --2- 172.21.15.29:0/705823751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c0ce890 0x7f858c0ab8e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f857400b550 tx=0x7f857400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:46.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f8583400640 1 -- 172.21.15.29:0/705823751 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8574010870 con 0x7f858c0ce890 2024-01-24T13:06:46.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f8583400640 1 -- 172.21.15.29:0/705823751 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85740109f0 con 0x7f858c0ce890 2024-01-24T13:06:46.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f8583400640 1 -- 172.21.15.29:0/705823751 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8574010da0 con 0x7f858c0ce890 2024-01-24T13:06:46.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f8592000640 1 -- 172.21.15.29:0/705823751 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858c0d0d60 con 0x7f858c0ce890 2024-01-24T13:06:46.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.598+0000 7f8592000640 1 -- 172.21.15.29:0/705823751 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858c1549c0 con 0x7f858c0ce890 2024-01-24T13:06:46.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.602+0000 7f8592000640 1 -- 172.21.15.29:0/705823751 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858c04e850 con 0x7f858c0ce890 2024-01-24T13:06:46.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.602+0000 7f8583400640 1 -- 172.21.15.29:0/705823751 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f857400f3c0 con 0x7f858c0ce890 2024-01-24T13:06:46.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.602+0000 7f8583400640 1 --2- 172.21.15.29:0/705823751 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8564065a60 0x7f8564067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.602+0000 7f8583400640 1 -- 172.21.15.29:0/705823751 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f85740832b0 con 0x7f858c0ce890 2024-01-24T13:06:46.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.602+0000 7f858b400640 1 --2- 172.21.15.29:0/705823751 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8564065a60 0x7f8564067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.602+0000 7f858b400640 1 --2- 172.21.15.29:0/705823751 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8564065a60 0x7f8564067f20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f857c0af000 tx=0x7f857c0b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:46.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.606+0000 7f8583400640 1 -- 172.21.15.29:0/705823751 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f8574050b40 con 0x7f858c0ce890 2024-01-24T13:06:46.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.766+0000 7f8592000640 1 -- 172.21.15.29:0/705823751 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f858c168590 con 0x7f858c0ce890 2024-01-24T13:06:46.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.766+0000 7f8583400640 1 -- 172.21.15.29:0/705823751 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8574054160 con 0x7f858c0ce890 2024-01-24T13:06:46.769 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:06:46.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.766+0000 7f8592000640 1 -- 172.21.15.29:0/705823751 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8564065a60 msgr2=0x7f8564067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.766+0000 7f8592000640 1 --2- 172.21.15.29:0/705823751 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8564065a60 0x7f8564067f20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f857c0af000 tx=0x7f857c0b6040 comp rx=0 tx=0).stop 2024-01-24T13:06:46.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.766+0000 7f8592000640 1 -- 172.21.15.29:0/705823751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c0ce890 msgr2=0x7f858c0ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.766+0000 7f8592000640 1 --2- 172.21.15.29:0/705823751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c0ce890 0x7f858c0ab8e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f857400b550 tx=0x7f857400ba10 comp rx=0 tx=0).stop 2024-01-24T13:06:46.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.766+0000 7f8592000640 1 -- 172.21.15.29:0/705823751 shutdown_connections 2024-01-24T13:06:46.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.766+0000 7f8592000640 1 --2- 172.21.15.29:0/705823751 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8564065a60 0x7f8564067f20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.766+0000 7f8592000640 1 --2- 172.21.15.29:0/705823751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f858c160950 0x7f858c14c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.766+0000 7f8592000640 1 --2- 172.21.15.29:0/705823751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f858c0ce890 0x7f858c0ab8e0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.766+0000 7f8592000640 1 --2- 172.21.15.29:0/705823751 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f858c0ce4b0 0x7f858c154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.766+0000 7f8592000640 1 -- 172.21.15.29:0/705823751 >> 172.21.15.29:0/705823751 conn(0x7f858c0704f0 msgr2=0x7f858c06e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:46.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.766+0000 7f8592000640 1 -- 172.21.15.29:0/705823751 shutdown_connections 2024-01-24T13:06:46.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.766+0000 7f8592000640 1 -- 172.21.15.29:0/705823751 wait complete. 2024-01-24T13:06:46.790 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:06:46.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.930+0000 7fa721400640 1 Processor -- start 2024-01-24T13:06:46.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.930+0000 7fa721400640 1 -- start start 2024-01-24T13:06:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.934+0000 7fa721400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa71c1603a0 0x7fa71c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.934+0000 7fa721400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71c070cf0 con 0x7fa71c0cd5b0 2024-01-24T13:06:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.934+0000 7fa721400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71c15cc10 con 0x7fa71c15c830 2024-01-24T13:06:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.934+0000 7fa721400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71c160910 con 0x7fa71c1603a0 2024-01-24T13:06:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.934+0000 7fa719e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa71c0cd5b0 0x7fa71c0711d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47096/0 (socket says 172.21.15.29:47096) 2024-01-24T13:06:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.934+0000 7fa719e00640 1 -- 172.21.15.29:0/704541876 learned_addr learned my addr 172.21.15.29:0/704541876 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.934+0000 7fa71b200640 1 --2- 172.21.15.29:0/704541876 >> v2:172.21.15.163:3300/0 conn(0x7fa71c1603a0 0x7fa71c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.934+0000 7fa719400640 1 -- 172.21.15.29:0/704541876 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548345574 0 0) 0x7fa71c070cf0 con 0x7fa71c0cd5b0 2024-01-24T13:06:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.934+0000 7fa719400640 1 -- 172.21.15.29:0/704541876 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6fc003530 con 0x7fa71c0cd5b0 2024-01-24T13:06:46.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.934+0000 7fa71b200640 1 -- 172.21.15.29:0/704541876 >> v1:172.21.15.163:6789/0 conn(0x7fa71c15c830 legacy=0x7fa71c0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.934+0000 7fa71b200640 1 -- 172.21.15.29:0/704541876 >> v1:172.21.15.29:6789/0 conn(0x7fa71c0cd5b0 legacy=0x7fa71c0711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.934+0000 7fa71b200640 1 -- 172.21.15.29:0/704541876 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c160bf0 con 0x7fa71c1603a0 2024-01-24T13:06:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.938+0000 7fa71b200640 1 --2- 172.21.15.29:0/704541876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c1603a0 0x7fa71c0c9920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa714009d90 tx=0x7fa71401f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=541e25d3be13c82a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.938+0000 7fa719400640 1 -- 172.21.15.29:0/704541876 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7140af600 con 0x7fa71c1603a0 2024-01-24T13:06:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.938+0000 7fa719400640 1 -- 172.21.15.29:0/704541876 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7140ab050 con 0x7fa71c1603a0 2024-01-24T13:06:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.938+0000 7fa719400640 1 -- 172.21.15.29:0/704541876 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7140af980 con 0x7fa71c1603a0 2024-01-24T13:06:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.938+0000 7fa721400640 1 -- 172.21.15.29:0/704541876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c1603a0 msgr2=0x7fa71c0c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.938+0000 7fa721400640 1 --2- 172.21.15.29:0/704541876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c1603a0 0x7fa71c0c9920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa714009d90 tx=0x7fa71401f130 comp rx=0 tx=0).stop 2024-01-24T13:06:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.938+0000 7fa721400640 1 -- 172.21.15.29:0/704541876 shutdown_connections 2024-01-24T13:06:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.938+0000 7fa721400640 1 --2- 172.21.15.29:0/704541876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c1603a0 0x7fa71c0c9920 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.938+0000 7fa721400640 1 -- 172.21.15.29:0/704541876 >> 172.21.15.29:0/704541876 conn(0x7fa71c0cbd50 msgr2=0x7fa71c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.938+0000 7fa721400640 1 -- 172.21.15.29:0/704541876 shutdown_connections 2024-01-24T13:06:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.938+0000 7fa721400640 1 -- 172.21.15.29:0/704541876 wait complete. 2024-01-24T13:06:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.938+0000 7fa721400640 1 Processor -- start 2024-01-24T13:06:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.938+0000 7fa721400640 1 -- start start 2024-01-24T13:06:46.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa721400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa71c0cd5b0 0x7fa71c0ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa721400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c15c830 0x7fa71c1f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa721400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa71c1603a0 0x7fa71c0ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa721400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c0c72b0 con 0x7fa71c1603a0 2024-01-24T13:06:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa721400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c0c7590 con 0x7fa71c15c830 2024-01-24T13:06:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa721400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c0c7ad0 con 0x7fa71c0cd5b0 2024-01-24T13:06:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa71b200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa71c1603a0 0x7fa71c0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa71b200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa71c1603a0 0x7fa71c0ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58292/0 (socket says 172.21.15.29:58292) 2024-01-24T13:06:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa71b200640 1 -- 172.21.15.29:0/545183614 learned_addr learned my addr 172.21.15.29:0/545183614 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa71a800640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa71c0cd5b0 0x7fa71c0ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa719e00640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c15c830 0x7fa71c1f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa71b200640 1 -- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa71c0cd5b0 msgr2=0x7fa71c0ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa71b200640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa71c0cd5b0 0x7fa71c0ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa71b200640 1 -- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c15c830 msgr2=0x7fa71c1f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:46.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa71b200640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c15c830 0x7fa71c1f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:46.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa71b200640 1 -- 172.21.15.29:0/545183614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa714009a70 con 0x7fa71c1603a0 2024-01-24T13:06:46.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa71a800640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa71c0cd5b0 0x7fa71c0ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:46.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa71b200640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa71c1603a0 0x7fa71c0ab8e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa7140b2040 tx=0x7fa71401bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:46.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa712a00640 1 -- 172.21.15.29:0/545183614 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa714009450 con 0x7fa71c1603a0 2024-01-24T13:06:46.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa712a00640 1 -- 172.21.15.29:0/545183614 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7140b9410 con 0x7fa71c1603a0 2024-01-24T13:06:46.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa712a00640 1 -- 172.21.15.29:0/545183614 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7140b97c0 con 0x7fa71c1603a0 2024-01-24T13:06:46.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa721400640 1 -- 172.21.15.29:0/545183614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71c0c7db0 con 0x7fa71c1603a0 2024-01-24T13:06:46.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa721400640 1 -- 172.21.15.29:0/545183614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71c0ae610 con 0x7fa71c1603a0 2024-01-24T13:06:46.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa721400640 1 -- 172.21.15.29:0/545183614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71c04e850 con 0x7fa71c1603a0 2024-01-24T13:06:46.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.942+0000 7fa712a00640 1 -- 172.21.15.29:0/545183614 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa7140b6050 con 0x7fa71c1603a0 2024-01-24T13:06:46.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.946+0000 7fa712a00640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa6f4065a60 0x7fa6f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:46.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.946+0000 7fa712a00640 1 -- 172.21.15.29:0/545183614 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa714121800 con 0x7fa71c1603a0 2024-01-24T13:06:46.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.946+0000 7fa71a800640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa6f4065a60 0x7fa6f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:46.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.946+0000 7fa71a800640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa6f4065a60 0x7fa6f4067f20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa70c007fd0 tx=0x7fa70c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:46.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:46.950+0000 7fa712a00640 1 -- 172.21.15.29:0/545183614 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa7140ef120 con 0x7fa71c1603a0 2024-01-24T13:06:47.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.118+0000 7fa721400640 1 -- 172.21.15.29:0/545183614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa71c0661a0 con 0x7fa71c1603a0 2024-01-24T13:06:47.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.118+0000 7fa712a00640 1 -- 172.21.15.29:0/545183614 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa7140f2740 con 0x7fa71c1603a0 2024-01-24T13:06:47.122 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:06:47.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.122+0000 7fa721400640 1 -- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa6f4065a60 msgr2=0x7fa6f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.122+0000 7fa721400640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa6f4065a60 0x7fa6f4067f20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa70c007fd0 tx=0x7fa70c009040 comp rx=0 tx=0).stop 2024-01-24T13:06:47.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.122+0000 7fa721400640 1 -- 172.21.15.29:0/545183614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa71c1603a0 msgr2=0x7fa71c0ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.122+0000 7fa721400640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa71c1603a0 0x7fa71c0ab8e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa7140b2040 tx=0x7fa71401bed0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.122+0000 7fa721400640 1 -- 172.21.15.29:0/545183614 shutdown_connections 2024-01-24T13:06:47.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.122+0000 7fa721400640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa6f4065a60 0x7fa6f4067f20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.122+0000 7fa721400640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa71c1603a0 0x7fa71c0ab8e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.122+0000 7fa721400640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c15c830 0x7fa71c1f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.122+0000 7fa721400640 1 --2- 172.21.15.29:0/545183614 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa71c0cd5b0 0x7fa71c0ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.122+0000 7fa721400640 1 -- 172.21.15.29:0/545183614 >> 172.21.15.29:0/545183614 conn(0x7fa71c0cbd50 msgr2=0x7fa71c0aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:47.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.122+0000 7fa721400640 1 -- 172.21.15.29:0/545183614 shutdown_connections 2024-01-24T13:06:47.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.122+0000 7fa721400640 1 -- 172.21.15.29:0/545183614 wait complete. 2024-01-24T13:06:47.144 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:06:47.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.282+0000 7f5aac400640 1 Processor -- start 2024-01-24T13:06:47.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.282+0000 7f5aac400640 1 -- start start 2024-01-24T13:06:47.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.286+0000 7f5aac400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5aa406be20 0x7f5aa415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:47.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.286+0000 7f5aac400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5aa413d4b0 0x7f5aa415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:47.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.286+0000 7f5aac400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa415b4f0 con 0x7f5aa406c200 2024-01-24T13:06:47.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.286+0000 7f5aac400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa415b7d0 con 0x7f5aa413d4b0 2024-01-24T13:06:47.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.286+0000 7f5aac400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa40cd0c0 con 0x7f5aa406be20 2024-01-24T13:06:47.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.286+0000 7f5aaa400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5aa413d4b0 0x7f5aa415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:47.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.286+0000 7f5aa9000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5aa406c200 0x7f5aa413cda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47104/0 (socket says 172.21.15.29:47104) 2024-01-24T13:06:47.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.286+0000 7f5aaa400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5aa413d4b0 0x7f5aa415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58296/0 (socket says 172.21.15.29:58296) 2024-01-24T13:06:47.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.286+0000 7f5aa9000640 1 -- 172.21.15.29:0/4212976224 learned_addr learned my addr 172.21.15.29:0/4212976224 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:47.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.286+0000 7f5aa9a00640 1 --2- 172.21.15.29:0/4212976224 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5aa406be20 0x7f5aa415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:47.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.286+0000 7f5aaa400640 1 -- 172.21.15.29:0/4212976224 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5aa406be20 msgr2=0x7f5aa415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:47.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.286+0000 7f5aaa400640 1 --2- 172.21.15.29:0/4212976224 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5aa406be20 0x7f5aa415a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.286+0000 7f5aaa400640 1 -- 172.21.15.29:0/4212976224 >> v1:172.21.15.29:6789/0 conn(0x7f5aa406c200 legacy=0x7f5aa413cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.286+0000 7f5aaa400640 1 -- 172.21.15.29:0/4212976224 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa40cd3a0 con 0x7f5aa413d4b0 2024-01-24T13:06:47.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.290+0000 7f5aaa400640 1 --2- 172.21.15.29:0/4212976224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5aa413d4b0 0x7f5aa415af00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c009d90 tx=0x7f5a9c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc54b8cf0b35ab9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:47.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.290+0000 7f5aa3e00640 1 -- 172.21.15.29:0/4212976224 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c0a5a30 con 0x7f5aa413d4b0 2024-01-24T13:06:47.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.290+0000 7f5aa3e00640 1 -- 172.21.15.29:0/4212976224 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c0a5b90 con 0x7f5aa413d4b0 2024-01-24T13:06:47.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.290+0000 7f5aa3e00640 1 -- 172.21.15.29:0/4212976224 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c0ad440 con 0x7f5aa413d4b0 2024-01-24T13:06:47.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.290+0000 7f5aac400640 1 -- 172.21.15.29:0/4212976224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5aa413d4b0 msgr2=0x7f5aa415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.290+0000 7f5aac400640 1 --2- 172.21.15.29:0/4212976224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5aa413d4b0 0x7f5aa415af00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c009d90 tx=0x7f5a9c01c910 comp rx=0 tx=0).stop 2024-01-24T13:06:47.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.290+0000 7f5aac400640 1 -- 172.21.15.29:0/4212976224 shutdown_connections 2024-01-24T13:06:47.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.290+0000 7f5aac400640 1 --2- 172.21.15.29:0/4212976224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5aa413d4b0 0x7f5aa415af00 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.290+0000 7f5aac400640 1 --2- 172.21.15.29:0/4212976224 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5aa406be20 0x7f5aa415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.290+0000 7f5aac400640 1 -- 172.21.15.29:0/4212976224 >> 172.21.15.29:0/4212976224 conn(0x7f5aa406d700 msgr2=0x7f5aa4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:47.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.290+0000 7f5aac400640 1 -- 172.21.15.29:0/4212976224 shutdown_connections 2024-01-24T13:06:47.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.290+0000 7f5aac400640 1 -- 172.21.15.29:0/4212976224 wait complete. 2024-01-24T13:06:47.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.290+0000 7f5aac400640 1 Processor -- start 2024-01-24T13:06:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.290+0000 7f5aac400640 1 -- start start 2024-01-24T13:06:47.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aac400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5aa406be20 0x7f5aa4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:47.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aac400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5aa406c200 0x7f5aa413b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:47.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aac400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5aa413d4b0 0x7f5aa4153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:47.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aac400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa41520a0 con 0x7f5aa406be20 2024-01-24T13:06:47.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aac400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa413bf40 con 0x7f5aa413d4b0 2024-01-24T13:06:47.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aac400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa413b980 con 0x7f5aa406c200 2024-01-24T13:06:47.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aa9a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5aa406be20 0x7f5aa4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:47.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aa9a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5aa406be20 0x7f5aa4138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58300/0 (socket says 172.21.15.29:58300) 2024-01-24T13:06:47.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aa9a00640 1 -- 172.21.15.29:0/98460675 learned_addr learned my addr 172.21.15.29:0/98460675 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:47.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aaa400640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5aa413d4b0 0x7f5aa4153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:47.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aa9000640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5aa406c200 0x7f5aa413b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:47.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aa9a00640 1 -- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5aa406c200 msgr2=0x7f5aa413b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aa9a00640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5aa406c200 0x7f5aa413b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aa9a00640 1 -- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5aa413d4b0 msgr2=0x7f5aa4153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aa9a00640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5aa413d4b0 0x7f5aa4153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aa9a00640 1 -- 172.21.15.29:0/98460675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c009a70 con 0x7f5aa406be20 2024-01-24T13:06:47.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aaa400640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5aa413d4b0 0x7f5aa4153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:47.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aa9a00640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5aa406be20 0x7f5aa4138c30 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400d800 tx=0x7f5a9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:47.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aa1600640 1 -- 172.21.15.29:0/98460675 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9400b6c0 con 0x7f5aa406be20 2024-01-24T13:06:47.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aa1600640 1 -- 172.21.15.29:0/98460675 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9400b820 con 0x7f5aa406be20 2024-01-24T13:06:47.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aa1600640 1 -- 172.21.15.29:0/98460675 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9400bb90 con 0x7f5aa406be20 2024-01-24T13:06:47.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aac400640 1 -- 172.21.15.29:0/98460675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa413bc60 con 0x7f5aa406be20 2024-01-24T13:06:47.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aac400640 1 -- 172.21.15.29:0/98460675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa4139170 con 0x7f5aa406be20 2024-01-24T13:06:47.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.294+0000 7f5aac400640 1 -- 172.21.15.29:0/98460675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa404e850 con 0x7f5aa406be20 2024-01-24T13:06:47.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.298+0000 7f5aa1600640 1 -- 172.21.15.29:0/98460675 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5a9400bcf0 con 0x7f5aa406be20 2024-01-24T13:06:47.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.298+0000 7f5aa1600640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5a7c065a90 0x7f5a7c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:47.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.298+0000 7f5aa1600640 1 -- 172.21.15.29:0/98460675 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5a94083830 con 0x7f5aa406be20 2024-01-24T13:06:47.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.298+0000 7f5aa9000640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5a7c065a90 0x7f5a7c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:47.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.298+0000 7f5aa9000640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5a7c065a90 0x7f5a7c067f50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5aa414f6a0 tx=0x7f5a8c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:47.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.302+0000 7f5aa1600640 1 -- 172.21.15.29:0/98460675 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f5a940510a0 con 0x7f5aa406be20 2024-01-24T13:06:47.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.458+0000 7f5aac400640 1 -- 172.21.15.29:0/98460675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5aa4069f00 con 0x7f5aa406be20 2024-01-24T13:06:47.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.458+0000 7f5aa1600640 1 -- 172.21.15.29:0/98460675 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a940546c0 con 0x7f5aa406be20 2024-01-24T13:06:47.461 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:06:47.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.458+0000 7f5aac400640 1 -- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5a7c065a90 msgr2=0x7f5a7c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.458+0000 7f5aac400640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5a7c065a90 0x7f5a7c067f50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5aa414f6a0 tx=0x7f5a8c009040 comp rx=0 tx=0).stop 2024-01-24T13:06:47.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.458+0000 7f5aac400640 1 -- 172.21.15.29:0/98460675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5aa406be20 msgr2=0x7f5aa4138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.458+0000 7f5aac400640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5aa406be20 0x7f5aa4138c30 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400d800 tx=0x7f5a9400dcc0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.458+0000 7f5aac400640 1 -- 172.21.15.29:0/98460675 shutdown_connections 2024-01-24T13:06:47.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.458+0000 7f5aac400640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f5a7c065a90 0x7f5a7c067f50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.458+0000 7f5aac400640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5aa413d4b0 0x7f5aa4153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.458+0000 7f5aac400640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5aa406c200 0x7f5aa413b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.458+0000 7f5aac400640 1 --2- 172.21.15.29:0/98460675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5aa406be20 0x7f5aa4138c30 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.458+0000 7f5aac400640 1 -- 172.21.15.29:0/98460675 >> 172.21.15.29:0/98460675 conn(0x7f5aa406d700 msgr2=0x7f5aa40aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:47.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.458+0000 7f5aac400640 1 -- 172.21.15.29:0/98460675 shutdown_connections 2024-01-24T13:06:47.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.458+0000 7f5aac400640 1 -- 172.21.15.29:0/98460675 wait complete. 2024-01-24T13:06:47.484 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:06:47.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.622+0000 7f7856e00640 1 Processor -- start 2024-01-24T13:06:47.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.622+0000 7f7856e00640 1 -- start start 2024-01-24T13:06:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.622+0000 7f7856e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f785015d9a0 0x7f785006ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.622+0000 7f7856e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7850159980 con 0x7f78500ca110 2024-01-24T13:06:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.622+0000 7f7856e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78500711a0 con 0x7f785013ecc0 2024-01-24T13:06:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.622+0000 7f7856e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785013fc60 con 0x7f785015d9a0 2024-01-24T13:06:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.622+0000 7f784fe00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f78500ca110 0x7f7850070a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47106/0 (socket says 172.21.15.29:47106) 2024-01-24T13:06:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.622+0000 7f784fe00640 1 -- 172.21.15.29:0/1134172110 learned_addr learned my addr 172.21.15.29:0/1134172110 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:47.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.622+0000 7f7854e00640 1 --2- 172.21.15.29:0/1134172110 >> v2:172.21.15.163:3300/0 conn(0x7f785015d9a0 0x7f785006ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:47.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.626+0000 7f784ea00640 1 -- 172.21.15.29:0/1134172110 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271174763 0 0) 0x7f7850159980 con 0x7f78500ca110 2024-01-24T13:06:47.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.626+0000 7f784ea00640 1 -- 172.21.15.29:0/1134172110 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7830005740 con 0x7f78500ca110 2024-01-24T13:06:47.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.626+0000 7f784ea00640 1 -- 172.21.15.29:0/1134172110 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709889658 0 0) 0x7f7838001120 con 0x7f785013ecc0 2024-01-24T13:06:47.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.626+0000 7f784ea00640 1 -- 172.21.15.29:0/1134172110 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7850159980 con 0x7f785013ecc0 2024-01-24T13:06:47.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.626+0000 7f7854e00640 1 -- 172.21.15.29:0/1134172110 >> v1:172.21.15.163:6789/0 conn(0x7f785013ecc0 legacy=0x7f785015a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.626+0000 7f7854e00640 1 -- 172.21.15.29:0/1134172110 >> v1:172.21.15.29:6789/0 conn(0x7f78500ca110 legacy=0x7f7850070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.626+0000 7f7854e00640 1 -- 172.21.15.29:0/1134172110 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785015de30 con 0x7f785015d9a0 2024-01-24T13:06:47.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.626+0000 7f7854e00640 1 --2- 172.21.15.29:0/1134172110 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f785015d9a0 0x7f785006ba60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7848009d90 tx=0x7f784801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b3479ba57764f07 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:47.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.626+0000 7f784ea00640 1 -- 172.21.15.29:0/1134172110 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78480a5820 con 0x7f785015d9a0 2024-01-24T13:06:47.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.626+0000 7f784ea00640 1 -- 172.21.15.29:0/1134172110 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78480a5980 con 0x7f785015d9a0 2024-01-24T13:06:47.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.626+0000 7f784ea00640 1 -- 172.21.15.29:0/1134172110 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78480a5d10 con 0x7f785015d9a0 2024-01-24T13:06:47.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 -- 172.21.15.29:0/1134172110 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f785015d9a0 msgr2=0x7f785006ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 --2- 172.21.15.29:0/1134172110 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f785015d9a0 0x7f785006ba60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7848009d90 tx=0x7f784801c950 comp rx=0 tx=0).stop 2024-01-24T13:06:47.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 -- 172.21.15.29:0/1134172110 shutdown_connections 2024-01-24T13:06:47.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 --2- 172.21.15.29:0/1134172110 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f785015d9a0 0x7f785006ba60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 -- 172.21.15.29:0/1134172110 >> 172.21.15.29:0/1134172110 conn(0x7f785006a2d0 msgr2=0x7f78500afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:47.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 -- 172.21.15.29:0/1134172110 shutdown_connections 2024-01-24T13:06:47.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 -- 172.21.15.29:0/1134172110 wait complete. 2024-01-24T13:06:47.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 Processor -- start 2024-01-24T13:06:47.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 -- start start 2024-01-24T13:06:47.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78500ca110 0x7f78500b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f785013ecc0 0x7f7850157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f785015d9a0 0x7f7850157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785013fdb0 con 0x7f78500ca110 2024-01-24T13:06:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78500b3220 con 0x7f785013ecc0 2024-01-24T13:06:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7856e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78500b3500 con 0x7f785015d9a0 2024-01-24T13:06:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f784fe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78500ca110 0x7f78500b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f784fe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78500ca110 0x7f78500b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58310/0 (socket says 172.21.15.29:58310) 2024-01-24T13:06:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f784fe00640 1 -- 172.21.15.29:0/573573208 learned_addr learned my addr 172.21.15.29:0/573573208 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f7854e00640 1 --2- 172.21.15.29:0/573573208 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f785015d9a0 0x7f7850157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.630+0000 7f784f400640 1 --2- 172.21.15.29:0/573573208 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f785013ecc0 0x7f7850157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.634+0000 7f784fe00640 1 -- 172.21.15.29:0/573573208 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f785015d9a0 msgr2=0x7f7850157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.634+0000 7f784fe00640 1 --2- 172.21.15.29:0/573573208 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f785015d9a0 0x7f7850157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.634+0000 7f784fe00640 1 -- 172.21.15.29:0/573573208 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f785013ecc0 msgr2=0x7f7850157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.634+0000 7f784fe00640 1 --2- 172.21.15.29:0/573573208 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f785013ecc0 0x7f7850157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.634+0000 7f784fe00640 1 -- 172.21.15.29:0/573573208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7848009a70 con 0x7f78500ca110 2024-01-24T13:06:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.634+0000 7f784fe00640 1 --2- 172.21.15.29:0/573573208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78500ca110 0x7f78500b2bb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f784000c450 tx=0x7f784000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.634+0000 7f7847e00640 1 -- 172.21.15.29:0/573573208 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840007480 con 0x7f78500ca110 2024-01-24T13:06:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.634+0000 7f7847e00640 1 -- 172.21.15.29:0/573573208 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78400075e0 con 0x7f78500ca110 2024-01-24T13:06:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.634+0000 7f7847e00640 1 -- 172.21.15.29:0/573573208 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400059b0 con 0x7f78500ca110 2024-01-24T13:06:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.634+0000 7f7856e00640 1 -- 172.21.15.29:0/573573208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78500b37e0 con 0x7f78500ca110 2024-01-24T13:06:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.634+0000 7f7856e00640 1 -- 172.21.15.29:0/573573208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78500c10f0 con 0x7f78500ca110 2024-01-24T13:06:47.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.634+0000 7f7856e00640 1 -- 172.21.15.29:0/573573208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785013ffb0 con 0x7f78500ca110 2024-01-24T13:06:47.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.634+0000 7f7847e00640 1 -- 172.21.15.29:0/573573208 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7840005b10 con 0x7f78500ca110 2024-01-24T13:06:47.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.634+0000 7f7847e00640 1 --2- 172.21.15.29:0/573573208 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7828065a60 0x7f7828067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:47.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.638+0000 7f7847e00640 1 -- 172.21.15.29:0/573573208 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f78400826e0 con 0x7f78500ca110 2024-01-24T13:06:47.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.638+0000 7f784f400640 1 --2- 172.21.15.29:0/573573208 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7828065a60 0x7f7828067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:47.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.638+0000 7f784f400640 1 --2- 172.21.15.29:0/573573208 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7828065a60 0x7f7828067f20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7850157e10 tx=0x7f7838009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:47.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.638+0000 7f7847e00640 1 -- 172.21.15.29:0/573573208 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7840050000 con 0x7f78500ca110 2024-01-24T13:06:47.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.810+0000 7f7856e00640 1 -- 172.21.15.29:0/573573208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f785013f950 con 0x7f78500ca110 2024-01-24T13:06:47.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.810+0000 7f7847e00640 1 -- 172.21.15.29:0/573573208 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7840017080 con 0x7f78500ca110 2024-01-24T13:06:47.813 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:06:47.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.810+0000 7f7856e00640 1 -- 172.21.15.29:0/573573208 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7828065a60 msgr2=0x7f7828067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.810+0000 7f7856e00640 1 --2- 172.21.15.29:0/573573208 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7828065a60 0x7f7828067f20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7850157e10 tx=0x7f7838009040 comp rx=0 tx=0).stop 2024-01-24T13:06:47.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.810+0000 7f7856e00640 1 -- 172.21.15.29:0/573573208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78500ca110 msgr2=0x7f78500b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:47.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.810+0000 7f7856e00640 1 --2- 172.21.15.29:0/573573208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78500ca110 0x7f78500b2bb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f784000c450 tx=0x7f784000c910 comp rx=0 tx=0).stop 2024-01-24T13:06:47.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.810+0000 7f7856e00640 1 -- 172.21.15.29:0/573573208 shutdown_connections 2024-01-24T13:06:47.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.810+0000 7f7856e00640 1 --2- 172.21.15.29:0/573573208 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7828065a60 0x7f7828067f20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.810+0000 7f7856e00640 1 --2- 172.21.15.29:0/573573208 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f785015d9a0 0x7f7850157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.810+0000 7f7856e00640 1 --2- 172.21.15.29:0/573573208 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f785013ecc0 0x7f7850157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.810+0000 7f7856e00640 1 --2- 172.21.15.29:0/573573208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78500ca110 0x7f78500b2bb0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:47.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.810+0000 7f7856e00640 1 -- 172.21.15.29:0/573573208 >> 172.21.15.29:0/573573208 conn(0x7f785006a2d0 msgr2=0x7f78500cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:47.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.810+0000 7f7856e00640 1 -- 172.21.15.29:0/573573208 shutdown_connections 2024-01-24T13:06:47.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:47.810+0000 7f7856e00640 1 -- 172.21.15.29:0/573573208 wait complete. 2024-01-24T13:06:47.835 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:06:47.835 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:06:47.848 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:06:48.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.030+0000 7f43db800640 1 Processor -- start 2024-01-24T13:06:48.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.030+0000 7f43db800640 1 -- start start 2024-01-24T13:06:48.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.030+0000 7f43db800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f43d415a630 0x7f43d40cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.030+0000 7f43db800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40cfe50 con 0x7f43d40c3ef0 2024-01-24T13:06:48.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.030+0000 7f43db800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d415aa10 con 0x7f43d40cb100 2024-01-24T13:06:48.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.030+0000 7f43db800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d40cf380 con 0x7f43d415a630 2024-01-24T13:06:48.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.030+0000 7f43d8e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f43d415a630 0x7f43d40cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.030+0000 7f43d3e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f43d40c3ef0 0x7f43d40ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47120/0 (socket says 172.21.15.29:47120) 2024-01-24T13:06:48.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.030+0000 7f43d8e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f43d415a630 0x7f43d40cdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58316/0 (socket says 172.21.15.29:58316) 2024-01-24T13:06:48.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.030+0000 7f43d3e00640 1 -- 172.21.15.29:0/576115311 learned_addr learned my addr 172.21.15.29:0/576115311 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:48.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.030+0000 7f43d8e00640 1 -- 172.21.15.29:0/576115311 >> v1:172.21.15.163:6789/0 conn(0x7f43d40cb100 legacy=0x7f43d40d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.030+0000 7f43d8e00640 1 -- 172.21.15.29:0/576115311 >> v1:172.21.15.29:6789/0 conn(0x7f43d40c3ef0 legacy=0x7f43d40ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.030+0000 7f43d3400640 1 -- 172.21.15.29:0/576115311 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640446471 0 0) 0x7f43d40cfe50 con 0x7f43d40c3ef0 2024-01-24T13:06:48.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.030+0000 7f43d8e00640 1 -- 172.21.15.29:0/576115311 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40b2b70 con 0x7f43d415a630 2024-01-24T13:06:48.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.034+0000 7f43d8e00640 1 --2- 172.21.15.29:0/576115311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43d415a630 0x7f43d40cdf70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f43c40097c0 tx=0x7f43c401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e669df04c96c55 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:48.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.034+0000 7f43d3400640 1 -- 172.21.15.29:0/576115311 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40ad660 con 0x7f43d415a630 2024-01-24T13:06:48.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.034+0000 7f43d3400640 1 -- 172.21.15.29:0/576115311 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c40ad7c0 con 0x7f43d415a630 2024-01-24T13:06:48.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.034+0000 7f43d3400640 1 -- 172.21.15.29:0/576115311 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40adb50 con 0x7f43d415a630 2024-01-24T13:06:48.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.034+0000 7f43db800640 1 -- 172.21.15.29:0/576115311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43d415a630 msgr2=0x7f43d40cdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.034+0000 7f43db800640 1 --2- 172.21.15.29:0/576115311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43d415a630 0x7f43d40cdf70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f43c40097c0 tx=0x7f43c401c450 comp rx=0 tx=0).stop 2024-01-24T13:06:48.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.034+0000 7f43db800640 1 -- 172.21.15.29:0/576115311 shutdown_connections 2024-01-24T13:06:48.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.034+0000 7f43db800640 1 --2- 172.21.15.29:0/576115311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43d415a630 0x7f43d40cdf70 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.034+0000 7f43db800640 1 -- 172.21.15.29:0/576115311 >> 172.21.15.29:0/576115311 conn(0x7f43d4070570 msgr2=0x7f43d4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:48.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.034+0000 7f43db800640 1 -- 172.21.15.29:0/576115311 shutdown_connections 2024-01-24T13:06:48.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.034+0000 7f43db800640 1 -- 172.21.15.29:0/576115311 wait complete. 2024-01-24T13:06:48.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43db800640 1 Processor -- start 2024-01-24T13:06:48.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43db800640 1 -- start start 2024-01-24T13:06:48.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43db800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43d40c3ef0 0x7f43d41532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43db800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d40cb100 0x7f43d415c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43db800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f43d415a630 0x7f43d4159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43db800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d415da40 con 0x7f43d40c3ef0 2024-01-24T13:06:48.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43db800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d4153830 con 0x7f43d40cb100 2024-01-24T13:06:48.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43db800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d415cdc0 con 0x7f43d415a630 2024-01-24T13:06:48.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d8e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43d40c3ef0 0x7f43d41532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d8e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43d40c3ef0 0x7f43d41532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58330/0 (socket says 172.21.15.29:58330) 2024-01-24T13:06:48.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d8e00640 1 -- 172.21.15.29:0/2935132521 learned_addr learned my addr 172.21.15.29:0/2935132521 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:48.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d9800640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f43d415a630 0x7f43d4159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d3e00640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d40cb100 0x7f43d415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d8e00640 1 -- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f43d415a630 msgr2=0x7f43d4159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d8e00640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f43d415a630 0x7f43d4159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d8e00640 1 -- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d40cb100 msgr2=0x7f43d415c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d8e00640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d40cb100 0x7f43d415c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d8e00640 1 -- 172.21.15.29:0/2935132521 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4009420 con 0x7f43d40c3ef0 2024-01-24T13:06:48.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d3e00640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d40cb100 0x7f43d415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:48.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d8e00640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43d40c3ef0 0x7f43d41532f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f43c40b0040 tx=0x7f43c401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:48.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d0c00640 1 -- 172.21.15.29:0/2935132521 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40b9650 con 0x7f43d40c3ef0 2024-01-24T13:06:48.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d0c00640 1 -- 172.21.15.29:0/2935132521 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c40b97d0 con 0x7f43d40c3ef0 2024-01-24T13:06:48.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43db800640 1 -- 172.21.15.29:0/2935132521 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d415d0a0 con 0x7f43d40c3ef0 2024-01-24T13:06:48.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43d0c00640 1 -- 172.21.15.29:0/2935132521 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40b9b80 con 0x7f43d40c3ef0 2024-01-24T13:06:48.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.038+0000 7f43db800640 1 -- 172.21.15.29:0/2935132521 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d415d660 con 0x7f43d40c3ef0 2024-01-24T13:06:48.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.042+0000 7f43db800640 1 -- 172.21.15.29:0/2935132521 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d40c73d0 con 0x7f43d40c3ef0 2024-01-24T13:06:48.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.042+0000 7f43d0c00640 1 -- 172.21.15.29:0/2935132521 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f43c40b7400 con 0x7f43d40c3ef0 2024-01-24T13:06:48.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.042+0000 7f43d0c00640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f43ac065a60 0x7f43ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.042+0000 7f43d0c00640 1 -- 172.21.15.29:0/2935132521 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f43c411e0e0 con 0x7f43d40c3ef0 2024-01-24T13:06:48.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.042+0000 7f43d3e00640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f43ac065a60 0x7f43ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.042+0000 7f43d3e00640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f43ac065a60 0x7f43ac067f20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f43d4159ea0 tx=0x7f43bc007c60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:48.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.046+0000 7f43d0c00640 1 -- 172.21.15.29:0/2935132521 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f43c40eb950 con 0x7f43d40c3ef0 2024-01-24T13:06:48.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.206+0000 7f43db800640 1 -- 172.21.15.29:0/2935132521 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43d415d7f0 con 0x7f43d40c3ef0 2024-01-24T13:06:48.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.206+0000 7f43d0c00640 1 -- 172.21.15.29:0/2935132521 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16302 (secure 0 0 0) 0x7f43c40eef70 con 0x7f43d40c3ef0 2024-01-24T13:06:48.210 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:48.211 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":59,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:06:34.365221+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:06:31.105908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-24T13:06:32.357292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:06:48.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.210+0000 7f43db800640 1 -- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f43ac065a60 msgr2=0x7f43ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.210+0000 7f43db800640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f43ac065a60 0x7f43ac067f20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f43d4159ea0 tx=0x7f43bc007c60 comp rx=0 tx=0).stop 2024-01-24T13:06:48.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.210+0000 7f43db800640 1 -- 172.21.15.29:0/2935132521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43d40c3ef0 msgr2=0x7f43d41532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.210+0000 7f43db800640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43d40c3ef0 0x7f43d41532f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f43c40b0040 tx=0x7f43c401ac90 comp rx=0 tx=0).stop 2024-01-24T13:06:48.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.210+0000 7f43db800640 1 -- 172.21.15.29:0/2935132521 shutdown_connections 2024-01-24T13:06:48.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.210+0000 7f43db800640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f43ac065a60 0x7f43ac067f20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.210+0000 7f43db800640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f43d415a630 0x7f43d4159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.210+0000 7f43db800640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d40cb100 0x7f43d415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.210+0000 7f43db800640 1 --2- 172.21.15.29:0/2935132521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43d40c3ef0 0x7f43d41532f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.210+0000 7f43db800640 1 -- 172.21.15.29:0/2935132521 >> 172.21.15.29:0/2935132521 conn(0x7f43d4070570 msgr2=0x7f43d40b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:48.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.210+0000 7f43db800640 1 -- 172.21.15.29:0/2935132521 shutdown_connections 2024-01-24T13:06:48.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.210+0000 7f43db800640 1 -- 172.21.15.29:0/2935132521 wait complete. 2024-01-24T13:06:48.234 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:06:31.105908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:06:32.357292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:06:48.234 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:06:48.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.374+0000 7faecb400640 1 Processor -- start 2024-01-24T13:06:48.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.374+0000 7faecb400640 1 -- start start 2024-01-24T13:06:48.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faecb400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7faec415c830 0x7faec40c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faecb400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faec41603a0 0x7faec40ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faecb400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec4070cf0 con 0x7faec4069cd0 2024-01-24T13:06:48.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faecb400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec415cc10 con 0x7faec41603a0 2024-01-24T13:06:48.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faecb400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec4160910 con 0x7faec415c830 2024-01-24T13:06:48.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faec3e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faec41603a0 0x7faec40ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faec9400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7faec4069cd0 0x7faec40711d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47134/0 (socket says 172.21.15.29:47134) 2024-01-24T13:06:48.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faec3e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faec41603a0 0x7faec40ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58332/0 (socket says 172.21.15.29:58332) 2024-01-24T13:06:48.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faec9400640 1 -- 172.21.15.29:0/699839153 learned_addr learned my addr 172.21.15.29:0/699839153 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:48.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faec8a00640 1 --2- 172.21.15.29:0/699839153 >> v2:172.21.15.163:3300/0 conn(0x7faec415c830 0x7faec40c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faec3e00640 1 -- 172.21.15.29:0/699839153 >> v2:172.21.15.163:3300/0 conn(0x7faec415c830 msgr2=0x7faec40c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:48.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faec3e00640 1 --2- 172.21.15.29:0/699839153 >> v2:172.21.15.163:3300/0 conn(0x7faec415c830 0x7faec40c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faec3e00640 1 -- 172.21.15.29:0/699839153 >> v1:172.21.15.29:6789/0 conn(0x7faec4069cd0 legacy=0x7faec40711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faec3e00640 1 -- 172.21.15.29:0/699839153 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec4160bf0 con 0x7faec41603a0 2024-01-24T13:06:48.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faec3400640 1 -- 172.21.15.29:0/699839153 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976655716 0 0) 0x7faec4070cf0 con 0x7faec4069cd0 2024-01-24T13:06:48.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.378+0000 7faec3e00640 1 --2- 172.21.15.29:0/699839153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faec41603a0 0x7faec40ccea0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7faec40709a0 tx=0x7faeac01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751ece761e8fd07d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:48.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faec3400640 1 -- 172.21.15.29:0/699839153 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac0a8950 con 0x7faec41603a0 2024-01-24T13:06:48.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faec3400640 1 -- 172.21.15.29:0/699839153 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac0a8ab0 con 0x7faec41603a0 2024-01-24T13:06:48.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faec3400640 1 -- 172.21.15.29:0/699839153 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac0a8e40 con 0x7faec41603a0 2024-01-24T13:06:48.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 -- 172.21.15.29:0/699839153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faec41603a0 msgr2=0x7faec40ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 --2- 172.21.15.29:0/699839153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faec41603a0 0x7faec40ccea0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7faec40709a0 tx=0x7faeac01ec50 comp rx=0 tx=0).stop 2024-01-24T13:06:48.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 -- 172.21.15.29:0/699839153 shutdown_connections 2024-01-24T13:06:48.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 --2- 172.21.15.29:0/699839153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faec41603a0 0x7faec40ccea0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 --2- 172.21.15.29:0/699839153 >> v2:172.21.15.163:3300/0 conn(0x7faec415c830 0x7faec40c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 -- 172.21.15.29:0/699839153 >> 172.21.15.29:0/699839153 conn(0x7faec40cbd50 msgr2=0x7faec40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:48.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 -- 172.21.15.29:0/699839153 shutdown_connections 2024-01-24T13:06:48.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 -- 172.21.15.29:0/699839153 wait complete. 2024-01-24T13:06:48.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 Processor -- start 2024-01-24T13:06:48.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 -- start start 2024-01-24T13:06:48.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faec4069cd0 0x7faec415f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faec415c830 0x7faec40c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faec41603a0 0x7faec40c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec40c4cb0 con 0x7faec41603a0 2024-01-24T13:06:48.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec415e040 con 0x7faec4069cd0 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.382+0000 7faecb400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec415e320 con 0x7faec415c830 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec9400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faec41603a0 0x7faec40c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec9400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faec41603a0 0x7faec40c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58338/0 (socket says 172.21.15.29:58338) 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec9400640 1 -- 172.21.15.29:0/2477406341 learned_addr learned my addr 172.21.15.29:0/2477406341 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec8a00640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faec4069cd0 0x7faec415f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec3e00640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faec415c830 0x7faec40c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec9400640 1 -- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faec415c830 msgr2=0x7faec40c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec9400640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faec415c830 0x7faec40c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec9400640 1 -- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faec4069cd0 msgr2=0x7faec415f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec9400640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faec4069cd0 0x7faec415f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec9400640 1 -- 172.21.15.29:0/2477406341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac009420 con 0x7faec41603a0 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec8a00640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faec4069cd0 0x7faec415f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec9400640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faec41603a0 0x7faec40c9b80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7faebc001570 tx=0x7faebc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec0c00640 1 -- 172.21.15.29:0/2477406341 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00a640 con 0x7faec41603a0 2024-01-24T13:06:48.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec0c00640 1 -- 172.21.15.29:0/2477406341 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc00a7c0 con 0x7faec41603a0 2024-01-24T13:06:48.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faecb400640 1 -- 172.21.15.29:0/2477406341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec415e600 con 0x7faec41603a0 2024-01-24T13:06:48.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec0c00640 1 -- 172.21.15.29:0/2477406341 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00ab70 con 0x7faec41603a0 2024-01-24T13:06:48.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faecb400640 1 -- 172.21.15.29:0/2477406341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec415dd40 con 0x7faec41603a0 2024-01-24T13:06:48.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faecb400640 1 -- 172.21.15.29:0/2477406341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec415eb20 con 0x7faec41603a0 2024-01-24T13:06:48.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.386+0000 7faec0c00640 1 -- 172.21.15.29:0/2477406341 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faebc00acd0 con 0x7faec41603a0 2024-01-24T13:06:48.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.390+0000 7faec0c00640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fae9c065a60 0x7fae9c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.390+0000 7faec0c00640 1 -- 172.21.15.29:0/2477406341 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faebc082b20 con 0x7faec41603a0 2024-01-24T13:06:48.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.390+0000 7faec8a00640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fae9c065a60 0x7fae9c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.390+0000 7faec8a00640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fae9c065a60 0x7fae9c067f20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009bb0 tx=0x7faeb4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:48.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.390+0000 7faec0c00640 1 -- 172.21.15.29:0/2477406341 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7faec415eb20 con 0x7faec41603a0 2024-01-24T13:06:48.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.550+0000 7faecb400640 1 -- 172.21.15.29:0/2477406341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faec415eb20 con 0x7faec41603a0 2024-01-24T13:06:48.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.550+0000 7faec0c00640 1 -- 172.21.15.29:0/2477406341 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7faec415eb20 con 0x7faec41603a0 2024-01-24T13:06:48.553 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:06:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.550+0000 7faecb400640 1 -- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fae9c065a60 msgr2=0x7fae9c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.550+0000 7faecb400640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fae9c065a60 0x7fae9c067f20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009bb0 tx=0x7faeb4008040 comp rx=0 tx=0).stop 2024-01-24T13:06:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.550+0000 7faecb400640 1 -- 172.21.15.29:0/2477406341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faec41603a0 msgr2=0x7faec40c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.550+0000 7faecb400640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faec41603a0 0x7faec40c9b80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7faebc001570 tx=0x7faebc00cca0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.550+0000 7faecb400640 1 -- 172.21.15.29:0/2477406341 shutdown_connections 2024-01-24T13:06:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.550+0000 7faecb400640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fae9c065a60 0x7fae9c067f20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.550+0000 7faecb400640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faec41603a0 0x7faec40c9b80 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.550+0000 7faecb400640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faec415c830 0x7faec40c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.550+0000 7faecb400640 1 --2- 172.21.15.29:0/2477406341 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faec4069cd0 0x7faec415f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.550+0000 7faecb400640 1 -- 172.21.15.29:0/2477406341 >> 172.21.15.29:0/2477406341 conn(0x7faec40cbd50 msgr2=0x7faec40aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.550+0000 7faecb400640 1 -- 172.21.15.29:0/2477406341 shutdown_connections 2024-01-24T13:06:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.550+0000 7faecb400640 1 -- 172.21.15.29:0/2477406341 wait complete. 2024-01-24T13:06:48.575 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:06:48.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.714+0000 7fc374400640 1 Processor -- start 2024-01-24T13:06:48.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.714+0000 7fc374400640 1 -- start start 2024-01-24T13:06:48.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.714+0000 7fc374400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc36c070560 0x7fc36c06c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.714+0000 7fc374400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36c070970 con 0x7fc36c06bbc0 2024-01-24T13:06:48.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.714+0000 7fc374400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36c06c560 con 0x7fc36c158ca0 2024-01-24T13:06:48.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.714+0000 7fc374400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36c159080 con 0x7fc36c070560 2024-01-24T13:06:48.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.714+0000 7fc371000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc36c06bbc0 0x7fc36c06fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47140/0 (socket says 172.21.15.29:47140) 2024-01-24T13:06:48.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.714+0000 7fc371000640 1 -- 172.21.15.29:0/1221700650 learned_addr learned my addr 172.21.15.29:0/1221700650 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:48.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.718+0000 7fc372400640 1 --2- 172.21.15.29:0/1221700650 >> v2:172.21.15.163:3300/0 conn(0x7fc36c070560 0x7fc36c06c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.718+0000 7fc36be00640 1 -- 172.21.15.29:0/1221700650 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528787100 0 0) 0x7fc36c070970 con 0x7fc36c06bbc0 2024-01-24T13:06:48.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.718+0000 7fc36be00640 1 -- 172.21.15.29:0/1221700650 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc34c003450 con 0x7fc36c06bbc0 2024-01-24T13:06:48.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.718+0000 7fc372400640 1 -- 172.21.15.29:0/1221700650 >> v1:172.21.15.163:6789/0 conn(0x7fc36c158ca0 legacy=0x7fc36c0b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.718+0000 7fc372400640 1 -- 172.21.15.29:0/1221700650 >> v1:172.21.15.29:6789/0 conn(0x7fc36c06bbc0 legacy=0x7fc36c06fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.718+0000 7fc372400640 1 -- 172.21.15.29:0/1221700650 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c070ba0 con 0x7fc36c070560 2024-01-24T13:06:48.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.718+0000 7fc372400640 1 --2- 172.21.15.29:0/1221700650 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc36c070560 0x7fc36c06c020 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc364009d90 tx=0x7fc36401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d50490bbe9657556 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:48.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc36be00640 1 -- 172.21.15.29:0/1221700650 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640a5990 con 0x7fc36c070560 2024-01-24T13:06:48.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc36be00640 1 -- 172.21.15.29:0/1221700650 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3640a5af0 con 0x7fc36c070560 2024-01-24T13:06:48.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc36be00640 1 -- 172.21.15.29:0/1221700650 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640a5e80 con 0x7fc36c070560 2024-01-24T13:06:48.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 -- 172.21.15.29:0/1221700650 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc36c070560 msgr2=0x7fc36c06c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 --2- 172.21.15.29:0/1221700650 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc36c070560 0x7fc36c06c020 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc364009d90 tx=0x7fc36401c950 comp rx=0 tx=0).stop 2024-01-24T13:06:48.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 -- 172.21.15.29:0/1221700650 shutdown_connections 2024-01-24T13:06:48.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 --2- 172.21.15.29:0/1221700650 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc36c070560 0x7fc36c06c020 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 -- 172.21.15.29:0/1221700650 >> 172.21.15.29:0/1221700650 conn(0x7fc36c06d700 msgr2=0x7fc36c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:48.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 -- 172.21.15.29:0/1221700650 shutdown_connections 2024-01-24T13:06:48.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 -- 172.21.15.29:0/1221700650 wait complete. 2024-01-24T13:06:48.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 Processor -- start 2024-01-24T13:06:48.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 -- start start 2024-01-24T13:06:48.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc36c06bbc0 0x7fc36c156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc36c070560 0x7fc36c0c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc36c158ca0 0x7fc36c150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c1556b0 con 0x7fc36c158ca0 2024-01-24T13:06:48.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c0c91f0 con 0x7fc36c06bbc0 2024-01-24T13:06:48.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.722+0000 7fc374400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c156ff0 con 0x7fc36c070560 2024-01-24T13:06:48.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc372400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc36c158ca0 0x7fc36c150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc372400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc36c158ca0 0x7fc36c150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58344/0 (socket says 172.21.15.29:58344) 2024-01-24T13:06:48.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc372400640 1 -- 172.21.15.29:0/3630852536 learned_addr learned my addr 172.21.15.29:0/3630852536 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:48.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc371000640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc36c070560 0x7fc36c0c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc371a00640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc36c06bbc0 0x7fc36c156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc372400640 1 -- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc36c070560 msgr2=0x7fc36c0c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc372400640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc36c070560 0x7fc36c0c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc372400640 1 -- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc36c06bbc0 msgr2=0x7fc36c156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc372400640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc36c06bbc0 0x7fc36c156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc372400640 1 -- 172.21.15.29:0/3630852536 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc364009a70 con 0x7fc36c158ca0 2024-01-24T13:06:48.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc371a00640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc36c06bbc0 0x7fc36c156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:48.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc372400640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc36c158ca0 0x7fc36c150010 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc36401a580 tx=0x7fc3640196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:48.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc369600640 1 -- 172.21.15.29:0/3630852536 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640aec60 con 0x7fc36c158ca0 2024-01-24T13:06:48.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc369600640 1 -- 172.21.15.29:0/3630852536 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3640aedc0 con 0x7fc36c158ca0 2024-01-24T13:06:48.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc374400640 1 -- 172.21.15.29:0/3630852536 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36c154d10 con 0x7fc36c158ca0 2024-01-24T13:06:48.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc369600640 1 -- 172.21.15.29:0/3630852536 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640b7630 con 0x7fc36c158ca0 2024-01-24T13:06:48.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc374400640 1 -- 172.21.15.29:0/3630852536 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36c1552d0 con 0x7fc36c158ca0 2024-01-24T13:06:48.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc374400640 1 -- 172.21.15.29:0/3630852536 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36c04e850 con 0x7fc36c158ca0 2024-01-24T13:06:48.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.726+0000 7fc369600640 1 -- 172.21.15.29:0/3630852536 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc3640b4050 con 0x7fc36c158ca0 2024-01-24T13:06:48.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.730+0000 7fc369600640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc344065a60 0x7fc344067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:48.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.730+0000 7fc369600640 1 -- 172.21.15.29:0/3630852536 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc36411e3f0 con 0x7fc36c158ca0 2024-01-24T13:06:48.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.730+0000 7fc371a00640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc344065a60 0x7fc344067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:48.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.730+0000 7fc371a00640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc344065a60 0x7fc344067f20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0ccde0 tx=0x7fc35c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:48.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.734+0000 7fc369600640 1 -- 172.21.15.29:0/3630852536 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc3640ebd10 con 0x7fc36c158ca0 2024-01-24T13:06:48.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.890+0000 7fc374400640 1 -- 172.21.15.29:0/3630852536 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc36c1593d0 con 0x7fc36c158ca0 2024-01-24T13:06:48.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.890+0000 7fc369600640 1 -- 172.21.15.29:0/3630852536 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3640ef330 con 0x7fc36c158ca0 2024-01-24T13:06:48.894 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:06:48.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.894+0000 7fc374400640 1 -- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc344065a60 msgr2=0x7fc344067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.894+0000 7fc374400640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc344065a60 0x7fc344067f20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0ccde0 tx=0x7fc35c009040 comp rx=0 tx=0).stop 2024-01-24T13:06:48.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.894+0000 7fc374400640 1 -- 172.21.15.29:0/3630852536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc36c158ca0 msgr2=0x7fc36c150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:48.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.894+0000 7fc374400640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc36c158ca0 0x7fc36c150010 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc36401a580 tx=0x7fc3640196f0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.894+0000 7fc374400640 1 -- 172.21.15.29:0/3630852536 shutdown_connections 2024-01-24T13:06:48.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.894+0000 7fc374400640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc344065a60 0x7fc344067f20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.894+0000 7fc374400640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc36c158ca0 0x7fc36c150010 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.894+0000 7fc374400640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc36c070560 0x7fc36c0c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.894+0000 7fc374400640 1 --2- 172.21.15.29:0/3630852536 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc36c06bbc0 0x7fc36c156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:48.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.894+0000 7fc374400640 1 -- 172.21.15.29:0/3630852536 >> 172.21.15.29:0/3630852536 conn(0x7fc36c06d700 msgr2=0x7fc36c1534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:48.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.894+0000 7fc374400640 1 -- 172.21.15.29:0/3630852536 shutdown_connections 2024-01-24T13:06:48.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:48.894+0000 7fc374400640 1 -- 172.21.15.29:0/3630852536 wait complete. 2024-01-24T13:06:48.917 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:06:49.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.058+0000 7f3d2ba00640 1 Processor -- start 2024-01-24T13:06:49.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.058+0000 7f3d2ba00640 1 -- start start 2024-01-24T13:06:49.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.058+0000 7f3d2ba00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d2415a6f0 0x7f3d240c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:49.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.058+0000 7f3d2ba00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3d240ceb10 0x7f3d240cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:49.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.058+0000 7f3d2ba00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d240caad0 0x7f3d240caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:49.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.058+0000 7f3d2ba00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2415aad0 con 0x7f3d240ceb10 2024-01-24T13:06:49.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.058+0000 7f3d2ba00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d240cb480 con 0x7f3d2415a6f0 2024-01-24T13:06:49.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.058+0000 7f3d2ba00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d240cd1e0 con 0x7f3d240caad0 2024-01-24T13:06:49.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.058+0000 7f3d23e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3d240ceb10 0x7f3d240cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:49.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.058+0000 7f3d23e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3d240ceb10 0x7f3d240cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58352/0 (socket says 172.21.15.29:58352) 2024-01-24T13:06:49.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.058+0000 7f3d23e00640 1 -- 172.21.15.29:0/1161741808 learned_addr learned my addr 172.21.15.29:0/1161741808 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:49.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.062+0000 7f3d23e00640 1 -- 172.21.15.29:0/1161741808 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d240caad0 msgr2=0x7f3d240caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:49.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.062+0000 7f3d23e00640 1 --2- 172.21.15.29:0/1161741808 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d240caad0 0x7f3d240caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.062+0000 7f3d23e00640 1 -- 172.21.15.29:0/1161741808 >> v2:172.21.15.163:3300/0 conn(0x7f3d2415a6f0 msgr2=0x7f3d240c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:49.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.062+0000 7f3d29000640 1 --2- 172.21.15.29:0/1161741808 >> v2:172.21.15.163:3300/0 conn(0x7f3d2415a6f0 0x7f3d240c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:49.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.062+0000 7f3d23e00640 1 --2- 172.21.15.29:0/1161741808 >> v2:172.21.15.163:3300/0 conn(0x7f3d2415a6f0 0x7f3d240c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.062+0000 7f3d23e00640 1 -- 172.21.15.29:0/1161741808 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d240cd4c0 con 0x7f3d240ceb10 2024-01-24T13:06:49.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.062+0000 7f3d29000640 1 --2- 172.21.15.29:0/1161741808 >> v2:172.21.15.163:3300/0 conn(0x7f3d2415a6f0 0x7f3d240c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:49.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.062+0000 7f3d23e00640 1 --2- 172.21.15.29:0/1161741808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d240ceb10 0x7f3d240cef50 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3d240cce60 tx=0x7f3d0c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9880dd240706e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:49.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.062+0000 7f3d23400640 1 -- 172.21.15.29:0/1161741808 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0ab600 con 0x7f3d240ceb10 2024-01-24T13:06:49.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.062+0000 7f3d23400640 1 -- 172.21.15.29:0/1161741808 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c0ab760 con 0x7f3d240ceb10 2024-01-24T13:06:49.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.062+0000 7f3d23400640 1 -- 172.21.15.29:0/1161741808 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0abaf0 con 0x7f3d240ceb10 2024-01-24T13:06:49.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1161741808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d240ceb10 msgr2=0x7f3d240cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:49.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 --2- 172.21.15.29:0/1161741808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d240ceb10 0x7f3d240cef50 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3d240cce60 tx=0x7f3d0c01c440 comp rx=0 tx=0).stop 2024-01-24T13:06:49.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1161741808 shutdown_connections 2024-01-24T13:06:49.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 --2- 172.21.15.29:0/1161741808 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d240caad0 0x7f3d240caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 --2- 172.21.15.29:0/1161741808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d240ceb10 0x7f3d240cef50 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 --2- 172.21.15.29:0/1161741808 >> v2:172.21.15.163:3300/0 conn(0x7f3d2415a6f0 0x7f3d240c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1161741808 >> 172.21.15.29:0/1161741808 conn(0x7f3d24069cd0 msgr2=0x7f3d2406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:49.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1161741808 shutdown_connections 2024-01-24T13:06:49.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1161741808 wait complete. 2024-01-24T13:06:49.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 Processor -- start 2024-01-24T13:06:49.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 -- start start 2024-01-24T13:06:49.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d240caad0 0x7f3d2414fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:49.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d240ceb10 0x7f3d24154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:49.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d2415a6f0 0x7f3d24154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:49.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2406bab0 con 0x7f3d240caad0 2024-01-24T13:06:49.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2406bd90 con 0x7f3d240ceb10 2024-01-24T13:06:49.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d2ba00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2406c070 con 0x7f3d2415a6f0 2024-01-24T13:06:49.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d29000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d240caad0 0x7f3d2414fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:49.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d29000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d240caad0 0x7f3d2414fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58354/0 (socket says 172.21.15.29:58354) 2024-01-24T13:06:49.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d29000640 1 -- 172.21.15.29:0/1802755781 learned_addr learned my addr 172.21.15.29:0/1802755781 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:49.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d23e00640 1 --2- 172.21.15.29:0/1802755781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d240ceb10 0x7f3d24154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:49.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.066+0000 7f3d29a00640 1 --2- 172.21.15.29:0/1802755781 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d2415a6f0 0x7f3d24154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:49.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d29000640 1 -- 172.21.15.29:0/1802755781 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d2415a6f0 msgr2=0x7f3d24154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:49.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d29000640 1 --2- 172.21.15.29:0/1802755781 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d2415a6f0 0x7f3d24154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d29000640 1 -- 172.21.15.29:0/1802755781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d240ceb10 msgr2=0x7f3d24154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:49.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d29000640 1 --2- 172.21.15.29:0/1802755781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d240ceb10 0x7f3d24154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d29000640 1 -- 172.21.15.29:0/1802755781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c0094d0 con 0x7f3d240caad0 2024-01-24T13:06:49.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d29000640 1 --2- 172.21.15.29:0/1802755781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d240caad0 0x7f3d2414fba0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400c7f0 tx=0x7f3d1400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:49.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d20c00640 1 -- 172.21.15.29:0/1802755781 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14007820 con 0x7f3d240caad0 2024-01-24T13:06:49.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d20c00640 1 -- 172.21.15.29:0/1802755781 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d14007980 con 0x7f3d240caad0 2024-01-24T13:06:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1802755781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2406c350 con 0x7f3d240caad0 2024-01-24T13:06:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d20c00640 1 -- 172.21.15.29:0/1802755781 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14007d30 con 0x7f3d240caad0 2024-01-24T13:06:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1802755781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2406b650 con 0x7f3d240caad0 2024-01-24T13:06:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1802755781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2404e850 con 0x7f3d240caad0 2024-01-24T13:06:49.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d20c00640 1 -- 172.21.15.29:0/1802755781 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3d140113f0 con 0x7f3d240caad0 2024-01-24T13:06:49.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d20c00640 1 --2- 172.21.15.29:0/1802755781 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3cfc065a90 0x7f3cfc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:49.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d20c00640 1 -- 172.21.15.29:0/1802755781 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3d140835e0 con 0x7f3d240caad0 2024-01-24T13:06:49.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.070+0000 7f3d23e00640 1 --2- 172.21.15.29:0/1802755781 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3cfc065a90 0x7f3cfc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:49.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.074+0000 7f3d23e00640 1 --2- 172.21.15.29:0/1802755781 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3cfc065a90 0x7f3cfc067f50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0af000 tx=0x7f3d0c0b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:49.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.074+0000 7f3d20c00640 1 -- 172.21.15.29:0/1802755781 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3d14050e70 con 0x7f3d240caad0 2024-01-24T13:06:49.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.230+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1802755781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d2406c800 con 0x7f3d240caad0 2024-01-24T13:06:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.230+0000 7f3d20c00640 1 -- 172.21.15.29:0/1802755781 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d14054490 con 0x7f3d240caad0 2024-01-24T13:06:49.236 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:06:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.234+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1802755781 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3cfc065a90 msgr2=0x7f3cfc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.234+0000 7f3d2ba00640 1 --2- 172.21.15.29:0/1802755781 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3cfc065a90 0x7f3cfc067f50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0af000 tx=0x7f3d0c0b6040 comp rx=0 tx=0).stop 2024-01-24T13:06:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.234+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1802755781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d240caad0 msgr2=0x7f3d2414fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.234+0000 7f3d2ba00640 1 --2- 172.21.15.29:0/1802755781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d240caad0 0x7f3d2414fba0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400c7f0 tx=0x7f3d1400ccb0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.234+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1802755781 shutdown_connections 2024-01-24T13:06:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.234+0000 7f3d2ba00640 1 --2- 172.21.15.29:0/1802755781 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3cfc065a90 0x7f3cfc067f50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.234+0000 7f3d2ba00640 1 --2- 172.21.15.29:0/1802755781 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3d2415a6f0 0x7f3d24154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.234+0000 7f3d2ba00640 1 --2- 172.21.15.29:0/1802755781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d240ceb10 0x7f3d24154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.234+0000 7f3d2ba00640 1 --2- 172.21.15.29:0/1802755781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d240caad0 0x7f3d2414fba0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.234+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1802755781 >> 172.21.15.29:0/1802755781 conn(0x7f3d24069cd0 msgr2=0x7f3d240b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.234+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1802755781 shutdown_connections 2024-01-24T13:06:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.234+0000 7f3d2ba00640 1 -- 172.21.15.29:0/1802755781 wait complete. 2024-01-24T13:06:49.258 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:06:49.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.398+0000 7f997ee00640 1 Processor -- start 2024-01-24T13:06:49.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.398+0000 7f997ee00640 1 -- start start 2024-01-24T13:06:49.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.398+0000 7f997ee00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99780cd160 0x7f99780cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:49.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.398+0000 7f997ee00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f997815e0f0 0x7f997815b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:49.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.398+0000 7f997ee00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997815e920 con 0x7f997815b8b0 2024-01-24T13:06:49.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.398+0000 7f997ee00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997815ec00 con 0x7f997815e0f0 2024-01-24T13:06:49.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.398+0000 7f997ee00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997815eee0 con 0x7f99780cd160 2024-01-24T13:06:49.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.398+0000 7f9977400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f997815e0f0 0x7f997815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:49.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.402+0000 7f997ce00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f997815b8b0 0x7f99780cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47142/0 (socket says 172.21.15.29:47142) 2024-01-24T13:06:49.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.402+0000 7f997ce00640 1 -- 172.21.15.29:0/2548976716 learned_addr learned my addr 172.21.15.29:0/2548976716 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:49.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.402+0000 7f9977e00640 1 --2- 172.21.15.29:0/2548976716 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99780cd160 0x7f99780cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:49.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.402+0000 7f9977400640 1 -- 172.21.15.29:0/2548976716 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99780cd160 msgr2=0x7f99780cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:49.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.402+0000 7f9977400640 1 --2- 172.21.15.29:0/2548976716 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99780cd160 0x7f99780cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.402+0000 7f9977400640 1 -- 172.21.15.29:0/2548976716 >> v1:172.21.15.29:6789/0 conn(0x7f997815b8b0 legacy=0x7f99780cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:49.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.402+0000 7f9977400640 1 -- 172.21.15.29:0/2548976716 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997815ae50 con 0x7f997815e0f0 2024-01-24T13:06:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.402+0000 7f9977400640 1 --2- 172.21.15.29:0/2548976716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f997815e0f0 0x7f997815b370 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f99600097c0 tx=0x7f996001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41430fce2e7a4516 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.402+0000 7f9976a00640 1 -- 172.21.15.29:0/2548976716 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99600ac620 con 0x7f997815e0f0 2024-01-24T13:06:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.402+0000 7f9976a00640 1 -- 172.21.15.29:0/2548976716 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99600ac780 con 0x7f997815e0f0 2024-01-24T13:06:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.402+0000 7f9976a00640 1 -- 172.21.15.29:0/2548976716 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99600acb10 con 0x7f997815e0f0 2024-01-24T13:06:49.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 -- 172.21.15.29:0/2548976716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f997815e0f0 msgr2=0x7f997815b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:49.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 --2- 172.21.15.29:0/2548976716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f997815e0f0 0x7f997815b370 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f99600097c0 tx=0x7f996001c480 comp rx=0 tx=0).stop 2024-01-24T13:06:49.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 -- 172.21.15.29:0/2548976716 shutdown_connections 2024-01-24T13:06:49.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 --2- 172.21.15.29:0/2548976716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f997815e0f0 0x7f997815b370 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 --2- 172.21.15.29:0/2548976716 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99780cd160 0x7f99780cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 -- 172.21.15.29:0/2548976716 >> 172.21.15.29:0/2548976716 conn(0x7f9978069cd0 msgr2=0x7f997806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:49.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 -- 172.21.15.29:0/2548976716 shutdown_connections 2024-01-24T13:06:49.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 -- 172.21.15.29:0/2548976716 wait complete. 2024-01-24T13:06:49.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 Processor -- start 2024-01-24T13:06:49.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 -- start start 2024-01-24T13:06:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99780cd160 0x7f99780b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f997815e0f0 0x7f9978153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99780b3cd0 0x7f99781540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99780c5c00 con 0x7f99780b3cd0 2024-01-24T13:06:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99781f4d30 con 0x7f997815e0f0 2024-01-24T13:06:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ee00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99781f4ff0 con 0x7f99780cd160 2024-01-24T13:06:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ce00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99780b3cd0 0x7f99781540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ce00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99780b3cd0 0x7f99781540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58372/0 (socket says 172.21.15.29:58372) 2024-01-24T13:06:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f997ce00640 1 -- 172.21.15.29:0/1034856867 learned_addr learned my addr 172.21.15.29:0/1034856867 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f9977e00640 1 --2- 172.21.15.29:0/1034856867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99780cd160 0x7f99780b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.406+0000 7f9977400640 1 --2- 172.21.15.29:0/1034856867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f997815e0f0 0x7f9978153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f997ce00640 1 -- 172.21.15.29:0/1034856867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99780cd160 msgr2=0x7f99780b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f997ce00640 1 --2- 172.21.15.29:0/1034856867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99780cd160 0x7f99780b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f997ce00640 1 -- 172.21.15.29:0/1034856867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f997815e0f0 msgr2=0x7f9978153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f997ce00640 1 --2- 172.21.15.29:0/1034856867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f997815e0f0 0x7f9978153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f997ce00640 1 -- 172.21.15.29:0/1034856867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9960009420 con 0x7f99780b3cd0 2024-01-24T13:06:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f997ce00640 1 --2- 172.21.15.29:0/1034856867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99780b3cd0 0x7f99781540b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f997000cb10 tx=0x7f997000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f996fe00640 1 -- 172.21.15.29:0/1034856867 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000ac70 con 0x7f99780b3cd0 2024-01-24T13:06:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f996fe00640 1 -- 172.21.15.29:0/1034856867 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997000add0 con 0x7f99780b3cd0 2024-01-24T13:06:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f997ee00640 1 -- 172.21.15.29:0/1034856867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99781f52d0 con 0x7f99780b3cd0 2024-01-24T13:06:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f996fe00640 1 -- 172.21.15.29:0/1034856867 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970012600 con 0x7f99780b3cd0 2024-01-24T13:06:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f997ee00640 1 -- 172.21.15.29:0/1034856867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99781f5890 con 0x7f99780b3cd0 2024-01-24T13:06:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f997ee00640 1 -- 172.21.15.29:0/1034856867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99781f5a80 con 0x7f99780b3cd0 2024-01-24T13:06:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f996fe00640 1 -- 172.21.15.29:0/1034856867 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9970007070 con 0x7f99780b3cd0 2024-01-24T13:06:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f996fe00640 1 --2- 172.21.15.29:0/1034856867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9950065a60 0x7f9950067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.410+0000 7f996fe00640 1 -- 172.21.15.29:0/1034856867 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f99700830a0 con 0x7f99780b3cd0 2024-01-24T13:06:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.414+0000 7f9977e00640 1 --2- 172.21.15.29:0/1034856867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9950065a60 0x7f9950067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.414+0000 7f9977e00640 1 --2- 172.21.15.29:0/1034856867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9950065a60 0x7f9950067f20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9968009b60 tx=0x7f9968009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:49.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.414+0000 7f996fe00640 1 -- 172.21.15.29:0/1034856867 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f99700509d0 con 0x7f99780b3cd0 2024-01-24T13:06:49.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.586+0000 7f997ee00640 1 -- 172.21.15.29:0/1034856867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f997804e850 con 0x7f99780b3cd0 2024-01-24T13:06:49.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.586+0000 7f996fe00640 1 -- 172.21.15.29:0/1034856867 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9970017080 con 0x7f99780b3cd0 2024-01-24T13:06:49.589 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:06:49.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.586+0000 7f997ee00640 1 -- 172.21.15.29:0/1034856867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9950065a60 msgr2=0x7f9950067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:49.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.586+0000 7f997ee00640 1 --2- 172.21.15.29:0/1034856867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9950065a60 0x7f9950067f20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9968009b60 tx=0x7f9968009190 comp rx=0 tx=0).stop 2024-01-24T13:06:49.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.586+0000 7f997ee00640 1 -- 172.21.15.29:0/1034856867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99780b3cd0 msgr2=0x7f99781540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:49.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.586+0000 7f997ee00640 1 --2- 172.21.15.29:0/1034856867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99780b3cd0 0x7f99781540b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f997000cb10 tx=0x7f997000a060 comp rx=0 tx=0).stop 2024-01-24T13:06:49.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.586+0000 7f997ee00640 1 -- 172.21.15.29:0/1034856867 shutdown_connections 2024-01-24T13:06:49.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.586+0000 7f997ee00640 1 --2- 172.21.15.29:0/1034856867 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9950065a60 0x7f9950067f20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.586+0000 7f997ee00640 1 --2- 172.21.15.29:0/1034856867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99780b3cd0 0x7f99781540b0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.586+0000 7f997ee00640 1 --2- 172.21.15.29:0/1034856867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f997815e0f0 0x7f9978153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.586+0000 7f997ee00640 1 --2- 172.21.15.29:0/1034856867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99780cd160 0x7f99780b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:49.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.586+0000 7f997ee00640 1 -- 172.21.15.29:0/1034856867 >> 172.21.15.29:0/1034856867 conn(0x7f9978069cd0 msgr2=0x7f997806a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:49.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.586+0000 7f997ee00640 1 -- 172.21.15.29:0/1034856867 shutdown_connections 2024-01-24T13:06:49.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:49.586+0000 7f997ee00640 1 -- 172.21.15.29:0/1034856867 wait complete. 2024-01-24T13:06:49.611 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-01-24T13:06:49.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:49.611 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:49.629 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[39834]: fuse finished with error 0 and tester_r 0 2024-01-24T13:06:49.632 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:06:55.711 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:06:55.715 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:06:55.733 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:06:55.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:55.734 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-24T13:06:55.769 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-24T13:06:55.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb56a200640 1 Processor -- start 2024-01-24T13:06:55.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb56a200640 1 -- start start 2024-01-24T13:06:55.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb56a200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5641612c0 0x7fb56406c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:55.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb56a200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb5640ae150 0x7fb56406cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:55.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb56a200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5640caed0 con 0x7fb5640cd600 2024-01-24T13:06:55.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb56a200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5640caca0 con 0x7fb5640ae150 2024-01-24T13:06:55.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb56a200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640cb170 con 0x7fb5641612c0 2024-01-24T13:06:55.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb563e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb5640cd600 0x7fb5640c94b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51390/0 (socket says 172.21.15.29:51390) 2024-01-24T13:06:55.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb563e00640 1 -- 172.21.15.29:0/1115596678 learned_addr learned my addr 172.21.15.29:0/1115596678 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:55.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb562a00640 1 --2- 172.21.15.29:0/1115596678 >> v2:172.21.15.163:3300/0 conn(0x7fb5640ae150 0x7fb56406cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:55.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb563400640 1 --2- 172.21.15.29:0/1115596678 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5641612c0 0x7fb56406c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:55.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb562000640 1 -- 172.21.15.29:0/1115596678 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743673855 0 0) 0x7fb5640caed0 con 0x7fb5640cd600 2024-01-24T13:06:55.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb562000640 1 -- 172.21.15.29:0/1115596678 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb544003530 con 0x7fb5640cd600 2024-01-24T13:06:55.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb562a00640 1 -- 172.21.15.29:0/1115596678 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5641612c0 msgr2=0x7fb56406c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:55.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb562a00640 1 --2- 172.21.15.29:0/1115596678 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5641612c0 0x7fb56406c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:55.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb562a00640 1 -- 172.21.15.29:0/1115596678 >> v1:172.21.15.29:6789/0 conn(0x7fb5640cd600 legacy=0x7fb5640c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:55.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.961+0000 7fb562a00640 1 -- 172.21.15.29:0/1115596678 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56406dab0 con 0x7fb5640ae150 2024-01-24T13:06:55.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.965+0000 7fb562a00640 1 --2- 172.21.15.29:0/1115596678 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5640ae150 0x7fb56406cdf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0097c0 tx=0x7fb54c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6328101ca9d4ebb1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:55.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.965+0000 7fb562000640 1 -- 172.21.15.29:0/1115596678 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0ac620 con 0x7fb5640ae150 2024-01-24T13:06:55.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.965+0000 7fb562000640 1 -- 172.21.15.29:0/1115596678 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c0ac780 con 0x7fb5640ae150 2024-01-24T13:06:55.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.965+0000 7fb562000640 1 -- 172.21.15.29:0/1115596678 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0acb10 con 0x7fb5640ae150 2024-01-24T13:06:55.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.965+0000 7fb56a200640 1 -- 172.21.15.29:0/1115596678 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5640ae150 msgr2=0x7fb56406cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:55.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.965+0000 7fb56a200640 1 --2- 172.21.15.29:0/1115596678 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5640ae150 0x7fb56406cdf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0097c0 tx=0x7fb54c01c3c0 comp rx=0 tx=0).stop 2024-01-24T13:06:55.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.965+0000 7fb56a200640 1 -- 172.21.15.29:0/1115596678 shutdown_connections 2024-01-24T13:06:55.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.965+0000 7fb56a200640 1 --2- 172.21.15.29:0/1115596678 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5640ae150 0x7fb56406cdf0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:55.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.965+0000 7fb56a200640 1 --2- 172.21.15.29:0/1115596678 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5641612c0 0x7fb56406c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:55.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.965+0000 7fb56a200640 1 -- 172.21.15.29:0/1115596678 >> 172.21.15.29:0/1115596678 conn(0x7fb5640cb700 msgr2=0x7fb5640cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:55.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.965+0000 7fb56a200640 1 -- 172.21.15.29:0/1115596678 shutdown_connections 2024-01-24T13:06:55.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.965+0000 7fb56a200640 1 -- 172.21.15.29:0/1115596678 wait complete. 2024-01-24T13:06:55.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb56a200640 1 Processor -- start 2024-01-24T13:06:55.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb56a200640 1 -- start start 2024-01-24T13:06:55.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb56a200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5640ae150 0x7fb5640c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:55.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb56a200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5640cd600 0x7fb5640abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:55.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb56a200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5641612c0 0x7fb564159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:55.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb56a200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b3780 con 0x7fb5641612c0 2024-01-24T13:06:55.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb56a200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b3a60 con 0x7fb5640cd600 2024-01-24T13:06:55.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb56a200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b3d40 con 0x7fb5640ae150 2024-01-24T13:06:55.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb563e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5641612c0 0x7fb564159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:55.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb563e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5641612c0 0x7fb564159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53950/0 (socket says 172.21.15.29:53950) 2024-01-24T13:06:55.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb563e00640 1 -- 172.21.15.29:0/113994389 learned_addr learned my addr 172.21.15.29:0/113994389 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:55.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb562a00640 1 --2- 172.21.15.29:0/113994389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5640cd600 0x7fb5640abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:55.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb563400640 1 --2- 172.21.15.29:0/113994389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5640ae150 0x7fb5640c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:55.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb563e00640 1 -- 172.21.15.29:0/113994389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5640ae150 msgr2=0x7fb5640c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:55.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb563e00640 1 --2- 172.21.15.29:0/113994389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5640ae150 0x7fb5640c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:55.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb563e00640 1 -- 172.21.15.29:0/113994389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5640cd600 msgr2=0x7fb5640abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:55.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb563e00640 1 --2- 172.21.15.29:0/113994389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5640cd600 0x7fb5640abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:55.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb563e00640 1 -- 172.21.15.29:0/113994389 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c009420 con 0x7fb5641612c0 2024-01-24T13:06:55.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb563e00640 1 --2- 172.21.15.29:0/113994389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5641612c0 0x7fb564159cc0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00cb40 tx=0x7fb55c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:55.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb55b400640 1 -- 172.21.15.29:0/113994389 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c00aca0 con 0x7fb5641612c0 2024-01-24T13:06:55.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb55b400640 1 -- 172.21.15.29:0/113994389 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c00ae00 con 0x7fb5641612c0 2024-01-24T13:06:55.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb55b400640 1 -- 172.21.15.29:0/113994389 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c012620 con 0x7fb5641612c0 2024-01-24T13:06:55.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb56a200640 1 -- 172.21.15.29:0/113994389 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5640b4020 con 0x7fb5641612c0 2024-01-24T13:06:55.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.969+0000 7fb56a200640 1 -- 172.21.15.29:0/113994389 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5640c5150 con 0x7fb5641612c0 2024-01-24T13:06:55.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.973+0000 7fb56a200640 1 -- 172.21.15.29:0/113994389 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5640b16d0 con 0x7fb5641612c0 2024-01-24T13:06:55.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.973+0000 7fb55b400640 1 -- 172.21.15.29:0/113994389 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb55c007070 con 0x7fb5641612c0 2024-01-24T13:06:55.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.973+0000 7fb55b400640 1 --2- 172.21.15.29:0/113994389 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb53c065a90 0x7fb53c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:55.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.973+0000 7fb55b400640 1 -- 172.21.15.29:0/113994389 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb55c083220 con 0x7fb5641612c0 2024-01-24T13:06:55.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.973+0000 7fb563400640 1 --2- 172.21.15.29:0/113994389 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb53c065a90 0x7fb53c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:55.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.973+0000 7fb563400640 1 --2- 172.21.15.29:0/113994389 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb53c065a90 0x7fb53c067f50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb554009a50 tx=0x7fb554008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:55.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:55.977+0000 7fb55b400640 1 -- 172.21.15.29:0/113994389 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb55c050b40 con 0x7fb5641612c0 2024-01-24T13:06:56.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:56.169+0000 7fb56a200640 1 -- 172.21.15.29:0/113994389 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb56404e850 con 0x7fb5641612c0 2024-01-24T13:06:56.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:56.169+0000 7fb55b400640 1 -- 172.21.15.29:0/113994389 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb55c017060 con 0x7fb5641612c0 2024-01-24T13:06:56.175 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-24T13:06:56.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:56.173+0000 7fb56a200640 1 -- 172.21.15.29:0/113994389 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb53c065a90 msgr2=0x7fb53c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:56.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:56.173+0000 7fb56a200640 1 --2- 172.21.15.29:0/113994389 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb53c065a90 0x7fb53c067f50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb554009a50 tx=0x7fb554008040 comp rx=0 tx=0).stop 2024-01-24T13:06:56.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:56.173+0000 7fb56a200640 1 -- 172.21.15.29:0/113994389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5641612c0 msgr2=0x7fb564159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:56.173+0000 7fb56a200640 1 --2- 172.21.15.29:0/113994389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5641612c0 0x7fb564159cc0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00cb40 tx=0x7fb55c00a060 comp rx=0 tx=0).stop 2024-01-24T13:06:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:56.173+0000 7fb56a200640 1 -- 172.21.15.29:0/113994389 shutdown_connections 2024-01-24T13:06:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:56.173+0000 7fb56a200640 1 --2- 172.21.15.29:0/113994389 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb53c065a90 0x7fb53c067f50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:56.173+0000 7fb56a200640 1 --2- 172.21.15.29:0/113994389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5641612c0 0x7fb564159cc0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:56.173+0000 7fb56a200640 1 --2- 172.21.15.29:0/113994389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5640cd600 0x7fb5640abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:56.173+0000 7fb56a200640 1 --2- 172.21.15.29:0/113994389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb5640ae150 0x7fb5640c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:56.173+0000 7fb56a200640 1 -- 172.21.15.29:0/113994389 >> 172.21.15.29:0/113994389 conn(0x7fb5640cb700 msgr2=0x7fb564070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:56.173+0000 7fb56a200640 1 -- 172.21.15.29:0/113994389 shutdown_connections 2024-01-24T13:06:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:56.173+0000 7fb56a200640 1 -- 172.21.15.29:0/113994389 wait complete. 2024-01-24T13:06:56.197 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-24T13:06:56.197 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-24T13:06:56.198 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-01-24T13:06:56.198 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-24T13:06:56.198 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:56.198 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-24T13:06:56.198 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-24T13:06:56.198 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-24T13:06:56.198 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:06:56.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:56.198 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-01-24T13:06:56.208 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:06:56.208 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:06:56.208 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:06:56.209 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:56.209 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-24T13:06:56.209 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:56.209 INFO:teuthology.orchestra.run.smithi029.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-24T13:06:56.209 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:56.209 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-01-24T13:06:56.209 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-24T13:06:56.209 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42282sec preferred_lft 42282sec 2024-01-24T13:06:56.209 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-01-24T13:06:56.209 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:56.209 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:06:56.209 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:56.209 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-01-24T13:06:56.209 INFO:teuthology.orchestra.run.smithi029.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:06:56.210 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:56.210 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-01-24T13:06:56.210 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:06:56.210 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:56.210 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-01-24T13:06:56.210 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-24T13:06:56.210 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:b4:3c:c7:07 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:56.210 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-24T13:06:56.210 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:56.210 INFO:teuthology.orchestra.run.smithi029.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-24T13:06:56.210 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-24T13:06:56.210 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-24T13:06:56.210 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:56.210 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-24T13:06:56.211 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:56.211 INFO:teuthology.orchestra.run.smithi029.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T13:06:56.211 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-24T13:06:56.211 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-24T13:06:56.211 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:56.211 INFO:teuthology.orchestra.run.smithi029.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T13:06:56.211 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-24T13:06:56.211 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-01-24T13:06:56.211 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:06:56.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:56.211 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-24T13:06:56.269 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-01-24T13:06:56.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:56.272 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-01-24T13:06:56.325 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-01-24T13:06:56.325 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-24T13:06:56.325 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-24T13:06:56.326 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-24T13:06:56.326 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-24T13:06:56.326 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-24T13:06:56.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:56.326 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:06:56.326 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:06:56.326 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-24T13:06:56.326 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-24T13:06:56.326 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-24T13:06:56.326 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:06:56.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:56.418 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-24T13:06:56.428 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-24T13:06:56.428 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-24T13:06:56.428 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:06:56.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:56.428 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-01-24T13:06:56.492 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-24T13:06:56.492 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:06:56.492 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:56.548 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:06:56.548 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:06:56.548 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:56.599 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:06:56.660 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:06:56.660 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:06:56.726 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:06:56.727 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:06:56.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:56.728 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:06:56.783 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-24T13:06:56.784 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-24T13:06:56.830 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:06:56.851 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:06:56.851 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:06:56.910 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:06:56.911 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:06:56.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:56.912 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:06:56.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2024-01-24T13:06:56.921+0000 7f4c51847580 -1 init, newargv = 0x55e4f60c2110 newargc=15 2024-01-24T13:06:56.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[40234]: starting ceph client 2024-01-24T13:06:56.932 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[40234]: starting fuse 2024-01-24T13:06:56.934 INFO:teuthology.orchestra.run.smithi029.stdout:43 2024-01-24T13:06:56.934 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-01-24T13:06:56.935 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-01-24T13:06:56.936 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:06:56.936 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-01-24T13:06:56.936 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-24T13:06:56.936 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-24T13:06:56.936 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-24T13:06:56.936 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-01-24T13:06:56.936 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-01-24T13:06:56.936 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-01-24T13:06:56.936 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-24T13:06:56.936 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:06:56.936 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2024-01-24T13:06:56.936 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-01-24T13:06:57.057 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.40234.asok 2024-01-24T13:06:57.240 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40234.asok 2024-01-24T13:06:57.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:57.241 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40234.asok status 2024-01-24T13:06:57.421 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:06:57.421 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-01-24T13:06:57.421 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "4e3182a65800aed6d4aa2f6b86da3cfd72188134", 2024-01-24T13:06:57.421 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable)", 2024-01-24T13:06:57.421 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2024-01-24T13:06:57.421 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-01-24T13:06:57.421 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-24T13:06:57.421 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "40234", 2024-01-24T13:06:57.421 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-01-24T13:06:57.422 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:57.422 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-01-24T13:06:57.422 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-01-24T13:06:57.422 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 6453, 2024-01-24T13:06:57.422 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-01-24T13:06:57.422 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-01-24T13:06:57.422 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-01-24T13:06:57.422 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 6453 2024-01-24T13:06:57.422 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:57.422 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:06:57.422 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:06:57.422 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:06:57.422 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3198631965 2024-01-24T13:06:57.422 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:06:57.423 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:57.423 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:06:57.423 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:06:57.423 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:06:57.423 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3198631965 2024-01-24T13:06:57.423 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:06:57.423 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.6453 192.168.0.1:0/3198631965", 2024-01-24T13:06:57.423 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/3198631965", 2024-01-24T13:06:57.423 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-01-24T13:06:57.423 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 26, 2024-01-24T13:06:57.423 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 59, 2024-01-24T13:06:57.423 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-01-24T13:06:57.423 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-01-24T13:06:57.423 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-01-24T13:06:57.424 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:06:57.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:57.436 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-01-24T13:06:57.436 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:57.445 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-01-24T13:06:57.445 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:57.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:06:57.446 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-24T13:06:57.507 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2024-01-24T13:06:57.507 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-01-24T13:06:57.507 DEBUG:teuthology.orchestra.run.smithi029:> import errno 2024-01-24T13:06:57.507 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:06:57.507 DEBUG:teuthology.orchestra.run.smithi029:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-01-24T13:06:57.507 DEBUG:teuthology.orchestra.run.smithi029:> try: 2024-01-24T13:06:57.507 DEBUG:teuthology.orchestra.run.smithi029:> if False: 2024-01-24T13:06:57.508 DEBUG:teuthology.orchestra.run.smithi029:> ret = os.read(fd, 1024) 2024-01-24T13:06:57.508 DEBUG:teuthology.orchestra.run.smithi029:> else: 2024-01-24T13:06:57.508 DEBUG:teuthology.orchestra.run.smithi029:> os.write(fd, b'"'"'content'"'"') 2024-01-24T13:06:57.508 DEBUG:teuthology.orchestra.run.smithi029:> except OSError as e: 2024-01-24T13:06:57.508 DEBUG:teuthology.orchestra.run.smithi029:> if e.errno != errno.EPERM: 2024-01-24T13:06:57.508 DEBUG:teuthology.orchestra.run.smithi029:> raise 2024-01-24T13:06:57.508 DEBUG:teuthology.orchestra.run.smithi029:> else: 2024-01-24T13:06:57.508 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("client does not check permission of data pool") 2024-01-24T13:06:57.508 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-01-24T13:06:57.805 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2024-01-24T13:06:58.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e18e00640 1 Processor -- start 2024-01-24T13:06:58.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e18e00640 1 -- start start 2024-01-24T13:06:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e18e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7e140b40c0 0x7f7e140b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e18e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e140b1280 0x7f7e140b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e18e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e140b4f20 con 0x7f7e140b5730 2024-01-24T13:06:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e18e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e140cd9b0 con 0x7f7e140b40c0 2024-01-24T13:06:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e18e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140cdc90 con 0x7f7e140b1280 2024-01-24T13:06:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e11400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7e140b5730 0x7f7e140d2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51402/0 (socket says 172.21.15.29:51402) 2024-01-24T13:06:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e11400640 1 -- 172.21.15.29:0/1956891861 learned_addr learned my addr 172.21.15.29:0/1956891861 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:58.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e11e00640 1 --2- 172.21.15.29:0/1956891861 >> v2:172.21.15.163:3300/0 conn(0x7f7e140b40c0 0x7f7e140b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e12800640 1 --2- 172.21.15.29:0/1956891861 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e140b1280 0x7f7e140b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e10a00640 1 -- 172.21.15.29:0/1956891861 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484139453 0 0) 0x7f7e140b4f20 con 0x7f7e140b5730 2024-01-24T13:06:58.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e10a00640 1 -- 172.21.15.29:0/1956891861 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df4003530 con 0x7f7e140b5730 2024-01-24T13:06:58.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e12800640 1 -- 172.21.15.29:0/1956891861 >> v2:172.21.15.163:3300/0 conn(0x7f7e140b40c0 msgr2=0x7f7e140b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:58.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e12800640 1 --2- 172.21.15.29:0/1956891861 >> v2:172.21.15.163:3300/0 conn(0x7f7e140b40c0 0x7f7e140b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e12800640 1 -- 172.21.15.29:0/1956891861 >> v1:172.21.15.29:6789/0 conn(0x7f7e140b5730 legacy=0x7f7e140d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e12800640 1 -- 172.21.15.29:0/1956891861 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e140d1520 con 0x7f7e140b1280 2024-01-24T13:06:58.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:57.997+0000 7f7e11e00640 1 --2- 172.21.15.29:0/1956891861 >> v2:172.21.15.163:3300/0 conn(0x7f7e140b40c0 0x7f7e140b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:58.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.001+0000 7f7e12800640 1 --2- 172.21.15.29:0/1956891861 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e140b1280 0x7f7e140b49e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009d90 tx=0x7f7e0c01f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6937eaa2073c6d00 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:58.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.001+0000 7f7e10a00640 1 -- 172.21.15.29:0/1956891861 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0af600 con 0x7f7e140b1280 2024-01-24T13:06:58.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.001+0000 7f7e10a00640 1 -- 172.21.15.29:0/1956891861 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c0ab050 con 0x7f7e140b1280 2024-01-24T13:06:58.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.001+0000 7f7e10a00640 1 -- 172.21.15.29:0/1956891861 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0af980 con 0x7f7e140b1280 2024-01-24T13:06:58.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.001+0000 7f7e18e00640 1 -- 172.21.15.29:0/1956891861 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e140b1280 msgr2=0x7f7e140b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.001+0000 7f7e18e00640 1 --2- 172.21.15.29:0/1956891861 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e140b1280 0x7f7e140b49e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009d90 tx=0x7f7e0c01f130 comp rx=0 tx=0).stop 2024-01-24T13:06:58.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.001+0000 7f7e18e00640 1 -- 172.21.15.29:0/1956891861 shutdown_connections 2024-01-24T13:06:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.001+0000 7f7e18e00640 1 --2- 172.21.15.29:0/1956891861 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e140b1280 0x7f7e140b49e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.001+0000 7f7e18e00640 1 --2- 172.21.15.29:0/1956891861 >> v2:172.21.15.163:3300/0 conn(0x7f7e140b40c0 0x7f7e140b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.001+0000 7f7e18e00640 1 -- 172.21.15.29:0/1956891861 >> 172.21.15.29:0/1956891861 conn(0x7f7e14071800 msgr2=0x7f7e14071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.001+0000 7f7e18e00640 1 -- 172.21.15.29:0/1956891861 shutdown_connections 2024-01-24T13:06:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.001+0000 7f7e18e00640 1 -- 172.21.15.29:0/1956891861 wait complete. 2024-01-24T13:06:58.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e18e00640 1 Processor -- start 2024-01-24T13:06:58.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e18e00640 1 -- start start 2024-01-24T13:06:58.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e18e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e140b1280 0x7f7e14158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e18e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e140b40c0 0x7f7e14157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e18e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e140b5730 0x7f7e140cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e18e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1415f3f0 con 0x7f7e140b1280 2024-01-24T13:06:58.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e18e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1415fc20 con 0x7f7e140b40c0 2024-01-24T13:06:58.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e18e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1415f660 con 0x7f7e140b5730 2024-01-24T13:06:58.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e11e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e140b1280 0x7f7e14158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e11e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e140b1280 0x7f7e14158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53954/0 (socket says 172.21.15.29:53954) 2024-01-24T13:06:58.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e11e00640 1 -- 172.21.15.29:0/1857417054 learned_addr learned my addr 172.21.15.29:0/1857417054 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:58.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e11400640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e140b40c0 0x7f7e14157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e12800640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e140b5730 0x7f7e140cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e11e00640 1 -- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e140b5730 msgr2=0x7f7e140cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e11e00640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e140b5730 0x7f7e140cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e11e00640 1 -- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e140b40c0 msgr2=0x7f7e14157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e11e00640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e140b40c0 0x7f7e14157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e11e00640 1 -- 172.21.15.29:0/1857417054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e04009420 con 0x7f7e140b1280 2024-01-24T13:06:58.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e12800640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e140b5730 0x7f7e140cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:58.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e11e00640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e140b1280 0x7f7e14158ef0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400ebe0 tx=0x7f7e0400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:58.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e0a000640 1 -- 172.21.15.29:0/1857417054 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400eee0 con 0x7f7e140b1280 2024-01-24T13:06:58.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e0a000640 1 -- 172.21.15.29:0/1857417054 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0400cc30 con 0x7f7e140b1280 2024-01-24T13:06:58.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e0a000640 1 -- 172.21.15.29:0/1857417054 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04013470 con 0x7f7e140b1280 2024-01-24T13:06:58.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e18e00640 1 -- 172.21.15.29:0/1857417054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c009a70 con 0x7f7e140b1280 2024-01-24T13:06:58.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.005+0000 7f7e18e00640 1 -- 172.21.15.29:0/1857417054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e140c7280 con 0x7f7e140b1280 2024-01-24T13:06:58.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.009+0000 7f7e18e00640 1 -- 172.21.15.29:0/1857417054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1404e850 con 0x7f7e140b1280 2024-01-24T13:06:58.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.009+0000 7f7e0a000640 1 -- 172.21.15.29:0/1857417054 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7e040135d0 con 0x7f7e140b1280 2024-01-24T13:06:58.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.009+0000 7f7e0a000640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7dec065a60 0x7f7dec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.009+0000 7f7e0a000640 1 -- 172.21.15.29:0/1857417054 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7e04083520 con 0x7f7e140b1280 2024-01-24T13:06:58.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.009+0000 7f7e11400640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7dec065a60 0x7f7dec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.009+0000 7f7e11400640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7dec065a60 0x7f7dec067f20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7e140b5e40 tx=0x7f7dfc007d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:58.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.013+0000 7f7e0a000640 1 -- 172.21.15.29:0/1857417054 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7e04050e40 con 0x7f7e140b1280 2024-01-24T13:06:58.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.225+0000 7f7e18e00640 1 -- 172.21.15.29:0/1857417054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) v1 -- 0x7f7e140d17d0 con 0x7f7e140b1280 2024-01-24T13:06:58.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.233+0000 7f7e0a000640 1 -- 172.21.15.29:0/1857417054 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v19) v1 ==== 183+0+0 (secure 0 0 0) 0x7f7e04054460 con 0x7f7e140b1280 2024-01-24T13:06:58.236 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2024-01-24T13:06:58.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.233+0000 7f7e18e00640 1 -- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7dec065a60 msgr2=0x7f7dec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.233+0000 7f7e18e00640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7dec065a60 0x7f7dec067f20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7e140b5e40 tx=0x7f7dfc007d40 comp rx=0 tx=0).stop 2024-01-24T13:06:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.233+0000 7f7e18e00640 1 -- 172.21.15.29:0/1857417054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e140b1280 msgr2=0x7f7e14158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.233+0000 7f7e18e00640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e140b1280 0x7f7e14158ef0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400ebe0 tx=0x7f7e0400c520 comp rx=0 tx=0).stop 2024-01-24T13:06:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.233+0000 7f7e18e00640 1 -- 172.21.15.29:0/1857417054 shutdown_connections 2024-01-24T13:06:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.233+0000 7f7e18e00640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7dec065a60 0x7f7dec067f20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.233+0000 7f7e18e00640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e140b5730 0x7f7e140cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.233+0000 7f7e18e00640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e140b40c0 0x7f7e14157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.233+0000 7f7e18e00640 1 --2- 172.21.15.29:0/1857417054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e140b1280 0x7f7e14158ef0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.233+0000 7f7e18e00640 1 -- 172.21.15.29:0/1857417054 >> 172.21.15.29:0/1857417054 conn(0x7f7e14071800 msgr2=0x7f7e14072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.233+0000 7f7e18e00640 1 -- 172.21.15.29:0/1857417054 shutdown_connections 2024-01-24T13:06:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.233+0000 7f7e18e00640 1 -- 172.21.15.29:0/1857417054 wait complete. 2024-01-24T13:06:58.259 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:06:58.259 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:06:58.269 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:06:58.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.449+0000 7f942c600640 1 Processor -- start 2024-01-24T13:06:58.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f942c600640 1 -- start start 2024-01-24T13:06:58.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f942c600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9424070240 0x7f9424070680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f942c600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9424070bc0 0x7f94240b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f942c600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9424071050 con 0x7f94241588d0 2024-01-24T13:06:58.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f942c600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94241593c0 con 0x7f9424070240 2024-01-24T13:06:58.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f942c600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942415c830 con 0x7f9424070bc0 2024-01-24T13:06:58.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9429c00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f94241588d0 0x7f9424158cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51418/0 (socket says 172.21.15.29:51418) 2024-01-24T13:06:58.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9429c00640 1 -- 172.21.15.29:0/3317254001 learned_addr learned my addr 172.21.15.29:0/3317254001 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:58.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9429200640 1 --2- 172.21.15.29:0/3317254001 >> v2:172.21.15.163:3300/0 conn(0x7f9424070240 0x7f9424070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f942a600640 1 --2- 172.21.15.29:0/3317254001 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9424070bc0 0x7f94240b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 -- 172.21.15.29:0/3317254001 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079149108 0 0) 0x7f9424071050 con 0x7f94241588d0 2024-01-24T13:06:58.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 -- 172.21.15.29:0/3317254001 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9404003530 con 0x7f94241588d0 2024-01-24T13:06:58.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 -- 172.21.15.29:0/3317254001 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3439387091 0 0) 0x7f9404003530 con 0x7f94241588d0 2024-01-24T13:06:58.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 -- 172.21.15.29:0/3317254001 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9424070bc0 msgr2=0x7f94240b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:58.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 --2- 172.21.15.29:0/3317254001 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9424070bc0 0x7f94240b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 -- 172.21.15.29:0/3317254001 >> v2:172.21.15.163:3300/0 conn(0x7f9424070240 msgr2=0x7f9424070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:58.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 --2- 172.21.15.29:0/3317254001 >> v2:172.21.15.163:3300/0 conn(0x7f9424070240 0x7f9424070680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 -- 172.21.15.29:0/3317254001 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942415cb10 con 0x7f94241588d0 2024-01-24T13:06:58.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 -- 172.21.15.29:0/3317254001 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f9414001680 con 0x7f94241588d0 2024-01-24T13:06:58.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 -- 172.21.15.29:0/3317254001 >> v1:172.21.15.29:6789/0 conn(0x7f94241588d0 legacy=0x7f9424158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 --2- 172.21.15.29:0/3317254001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9404003980 0x7f9404003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 --2- 172.21.15.29:0/3317254001 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9424070bc0 0x7f94040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 --2- 172.21.15.29:0/3317254001 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9404004d10 0x7f9404005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 -- 172.21.15.29:0/3317254001 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94241593c0 con 0x7f9404003980 2024-01-24T13:06:58.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 -- 172.21.15.29:0/3317254001 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942415c830 con 0x7f9404004d10 2024-01-24T13:06:58.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9423e00640 1 -- 172.21.15.29:0/3317254001 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940400dba0 con 0x7f9424070bc0 2024-01-24T13:06:58.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9429200640 1 --2- 172.21.15.29:0/3317254001 >> v2:172.21.15.163:3300/0 conn(0x7f9424070240 0x7f9424070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:58.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9429c00640 1 --2- 172.21.15.29:0/3317254001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9404003980 0x7f9404003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9429c00640 1 -- 172.21.15.29:0/3317254001 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9424070bc0 msgr2=0x7f94040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:58.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9429c00640 1 --2- 172.21.15.29:0/3317254001 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9424070bc0 0x7f94040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9429c00640 1 -- 172.21.15.29:0/3317254001 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9404004d10 msgr2=0x7f9404005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:58.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9429c00640 1 --2- 172.21.15.29:0/3317254001 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9404004d10 0x7f9404005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.453+0000 7f9429c00640 1 -- 172.21.15.29:0/3317254001 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9404003530 con 0x7f9404003980 2024-01-24T13:06:58.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.457+0000 7f9429c00640 1 --2- 172.21.15.29:0/3317254001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9404003980 0x7f9404003da0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f941400c210 tx=0x7f941401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84d6d724566b95f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:58.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.457+0000 7f9423e00640 1 -- 172.21.15.29:0/3317254001 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94140058e0 con 0x7f9404003980 2024-01-24T13:06:58.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.457+0000 7f9423e00640 1 -- 172.21.15.29:0/3317254001 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9414005a40 con 0x7f9404003980 2024-01-24T13:06:58.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.457+0000 7f9423e00640 1 -- 172.21.15.29:0/3317254001 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414005e10 con 0x7f9404003980 2024-01-24T13:06:58.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.457+0000 7f942c600640 1 -- 172.21.15.29:0/3317254001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9404003980 msgr2=0x7f9404003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.457+0000 7f942c600640 1 --2- 172.21.15.29:0/3317254001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9404003980 0x7f9404003da0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f941400c210 tx=0x7f941401cc30 comp rx=0 tx=0).stop 2024-01-24T13:06:58.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.457+0000 7f942a600640 1 -- 172.21.15.29:0/3317254001 reap_dead start 2024-01-24T13:06:58.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.457+0000 7f942c600640 1 -- 172.21.15.29:0/3317254001 shutdown_connections 2024-01-24T13:06:58.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.457+0000 7f942c600640 1 -- 172.21.15.29:0/3317254001 >> 172.21.15.29:0/3317254001 conn(0x7f94240b3950 msgr2=0x7f9424069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:58.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.457+0000 7f942c600640 1 -- 172.21.15.29:0/3317254001 shutdown_connections 2024-01-24T13:06:58.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.457+0000 7f942c600640 1 -- 172.21.15.29:0/3317254001 wait complete. 2024-01-24T13:06:58.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f942c600640 1 Processor -- start 2024-01-24T13:06:58.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f942c600640 1 -- start start 2024-01-24T13:06:58.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f942c600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9404003980 0x7f9424151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f942c600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f942415e130 0x7f94241543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f942c600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94241548e0 0x7f942415fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f942c600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942415f300 con 0x7f9404003980 2024-01-24T13:06:58.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f942c600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9424154d60 con 0x7f94241548e0 2024-01-24T13:06:58.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f942c600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942415e680 con 0x7f942415e130 2024-01-24T13:06:58.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f9429c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9404003980 0x7f9424151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f9429c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9404003980 0x7f9424151630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53972/0 (socket says 172.21.15.29:53972) 2024-01-24T13:06:58.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f9429c00640 1 -- 172.21.15.29:0/2493452304 learned_addr learned my addr 172.21.15.29:0/2493452304 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:58.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f9429200640 1 --2- 172.21.15.29:0/2493452304 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f942415e130 0x7f94241543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f942a600640 1 --2- 172.21.15.29:0/2493452304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94241548e0 0x7f942415fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f9429c00640 1 -- 172.21.15.29:0/2493452304 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f942415e130 msgr2=0x7f94241543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f9429c00640 1 --2- 172.21.15.29:0/2493452304 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f942415e130 0x7f94241543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f9429c00640 1 -- 172.21.15.29:0/2493452304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94241548e0 msgr2=0x7f942415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f9429c00640 1 --2- 172.21.15.29:0/2493452304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94241548e0 0x7f942415fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f9429c00640 1 -- 172.21.15.29:0/2493452304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9424071540 con 0x7f9404003980 2024-01-24T13:06:58.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f9429c00640 1 --2- 172.21.15.29:0/2493452304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9404003980 0x7f9424151630 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f941400c210 tx=0x7f9404005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:58.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f9421600640 1 -- 172.21.15.29:0/2493452304 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94140a5890 con 0x7f9404003980 2024-01-24T13:06:58.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f9421600640 1 -- 172.21.15.29:0/2493452304 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94140a59f0 con 0x7f9404003980 2024-01-24T13:06:58.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f9421600640 1 -- 172.21.15.29:0/2493452304 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94140a5da0 con 0x7f9404003980 2024-01-24T13:06:58.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f942c600640 1 -- 172.21.15.29:0/2493452304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942415e960 con 0x7f9404003980 2024-01-24T13:06:58.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.461+0000 7f942c600640 1 -- 172.21.15.29:0/2493452304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942415ef20 con 0x7f9404003980 2024-01-24T13:06:58.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.465+0000 7f942c600640 1 -- 172.21.15.29:0/2493452304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f942404e850 con 0x7f9404003980 2024-01-24T13:06:58.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.465+0000 7f9421600640 1 -- 172.21.15.29:0/2493452304 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f94140047f0 con 0x7f9404003980 2024-01-24T13:06:58.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.465+0000 7f9421600640 1 --2- 172.21.15.29:0/2493452304 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f93fc065a90 0x7f93fc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.465+0000 7f9421600640 1 -- 172.21.15.29:0/2493452304 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f941411c9b0 con 0x7f9404003980 2024-01-24T13:06:58.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.465+0000 7f9429200640 1 --2- 172.21.15.29:0/2493452304 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f93fc065a90 0x7f93fc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.465+0000 7f9429200640 1 --2- 172.21.15.29:0/2493452304 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f93fc065a90 0x7f93fc067f50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9424153e80 tx=0x7f940c00a0d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:58.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.469+0000 7f9421600640 1 -- 172.21.15.29:0/2493452304 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f94140ea2e0 con 0x7f9404003980 2024-01-24T13:06:58.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.629+0000 7f942c600640 1 -- 172.21.15.29:0/2493452304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94240b1960 con 0x7f9404003980 2024-01-24T13:06:58.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.629+0000 7f9421600640 1 -- 172.21.15.29:0/2493452304 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16302 (secure 0 0 0) 0x7f94140ed900 con 0x7f9404003980 2024-01-24T13:06:58.634 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:06:58.635 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":59,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:06:34.365221+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:06:31.105908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-24T13:06:32.357292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:06:58.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.633+0000 7f942c600640 1 -- 172.21.15.29:0/2493452304 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f93fc065a90 msgr2=0x7f93fc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.633+0000 7f942c600640 1 --2- 172.21.15.29:0/2493452304 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f93fc065a90 0x7f93fc067f50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9424153e80 tx=0x7f940c00a0d0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.633+0000 7f942c600640 1 -- 172.21.15.29:0/2493452304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9404003980 msgr2=0x7f9424151630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.633+0000 7f942c600640 1 --2- 172.21.15.29:0/2493452304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9404003980 0x7f9424151630 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f941400c210 tx=0x7f9404005800 comp rx=0 tx=0).stop 2024-01-24T13:06:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.633+0000 7f942c600640 1 -- 172.21.15.29:0/2493452304 shutdown_connections 2024-01-24T13:06:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.633+0000 7f942c600640 1 --2- 172.21.15.29:0/2493452304 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f93fc065a90 0x7f93fc067f50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.633+0000 7f942c600640 1 --2- 172.21.15.29:0/2493452304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94241548e0 0x7f942415fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.633+0000 7f942c600640 1 --2- 172.21.15.29:0/2493452304 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f942415e130 0x7f94241543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.633+0000 7f942c600640 1 --2- 172.21.15.29:0/2493452304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9404003980 0x7f9424151630 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.633+0000 7f942c600640 1 -- 172.21.15.29:0/2493452304 >> 172.21.15.29:0/2493452304 conn(0x7f94240b3950 msgr2=0x7f942406bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.633+0000 7f942c600640 1 -- 172.21.15.29:0/2493452304 shutdown_connections 2024-01-24T13:06:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.633+0000 7f942c600640 1 -- 172.21.15.29:0/2493452304 wait complete. 2024-01-24T13:06:58.657 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:06:31.105908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:06:32.357292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:06:58.658 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:06:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.797+0000 7f70e8a00640 1 Processor -- start 2024-01-24T13:06:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.797+0000 7f70e8a00640 1 -- start start 2024-01-24T13:06:58.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.797+0000 7f70e8a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f70e015a6f0 0x7f70e00c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.797+0000 7f70e8a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e00cd1e0 con 0x7f70e00cb1e0 2024-01-24T13:06:58.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.797+0000 7f70e8a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e00cd4c0 con 0x7f70e00ceb10 2024-01-24T13:06:58.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.797+0000 7f70e8a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e015aad0 con 0x7f70e015a6f0 2024-01-24T13:06:58.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.797+0000 7f70e6a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f70e00cb1e0 0x7f70e00d0520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51420/0 (socket says 172.21.15.29:51420) 2024-01-24T13:06:58.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.797+0000 7f70e6a00640 1 -- 172.21.15.29:0/2893986191 learned_addr learned my addr 172.21.15.29:0/2893986191 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:58.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.797+0000 7f70e6000640 1 --2- 172.21.15.29:0/2893986191 >> v2:172.21.15.163:3300/0 conn(0x7f70e015a6f0 0x7f70e00c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.801+0000 7f70e4c00640 1 -- 172.21.15.29:0/2893986191 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931253473 0 0) 0x7f70e00cd1e0 con 0x7f70e00cb1e0 2024-01-24T13:06:58.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.801+0000 7f70e4c00640 1 -- 172.21.15.29:0/2893986191 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70c0003530 con 0x7f70e00cb1e0 2024-01-24T13:06:58.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.801+0000 7f70e4c00640 1 -- 172.21.15.29:0/2893986191 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745488580 0 0) 0x7f70e00cd4c0 con 0x7f70e00ceb10 2024-01-24T13:06:58.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.801+0000 7f70e4c00640 1 -- 172.21.15.29:0/2893986191 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e00cd1e0 con 0x7f70e00ceb10 2024-01-24T13:06:58.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.801+0000 7f70e4c00640 1 -- 172.21.15.29:0/2893986191 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1177225688 0 0) 0x7f70c0003530 con 0x7f70e00cb1e0 2024-01-24T13:06:58.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.801+0000 7f70e6000640 1 -- 172.21.15.29:0/2893986191 >> v1:172.21.15.163:6789/0 conn(0x7f70e00ceb10 legacy=0x7f70e00caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.801+0000 7f70e6000640 1 -- 172.21.15.29:0/2893986191 >> v1:172.21.15.29:6789/0 conn(0x7f70e00cb1e0 legacy=0x7f70e00d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.801+0000 7f70e6000640 1 -- 172.21.15.29:0/2893986191 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00cd7a0 con 0x7f70e015a6f0 2024-01-24T13:06:58.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.801+0000 7f70e6000640 1 --2- 172.21.15.29:0/2893986191 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70e015a6f0 0x7f70e00c3fd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f70d00097c0 tx=0x7f70d001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f57fbc4d5455a38 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:58.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.801+0000 7f70e4c00640 1 -- 172.21.15.29:0/2893986191 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8001a00 con 0x7f70e015a6f0 2024-01-24T13:06:58.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.801+0000 7f70e4c00640 1 -- 172.21.15.29:0/2893986191 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d00ac440 con 0x7f70e015a6f0 2024-01-24T13:06:58.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.801+0000 7f70e4c00640 1 -- 172.21.15.29:0/2893986191 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d00ac7d0 con 0x7f70e015a6f0 2024-01-24T13:06:58.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 -- 172.21.15.29:0/2893986191 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70e015a6f0 msgr2=0x7f70e00c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 --2- 172.21.15.29:0/2893986191 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70e015a6f0 0x7f70e00c3fd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f70d00097c0 tx=0x7f70d001c370 comp rx=0 tx=0).stop 2024-01-24T13:06:58.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 -- 172.21.15.29:0/2893986191 shutdown_connections 2024-01-24T13:06:58.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 --2- 172.21.15.29:0/2893986191 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70e015a6f0 0x7f70e00c3fd0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 -- 172.21.15.29:0/2893986191 >> 172.21.15.29:0/2893986191 conn(0x7f70e0069cd0 msgr2=0x7f70e006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:58.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 -- 172.21.15.29:0/2893986191 shutdown_connections 2024-01-24T13:06:58.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 -- 172.21.15.29:0/2893986191 wait complete. 2024-01-24T13:06:58.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 Processor -- start 2024-01-24T13:06:58.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 -- start start 2024-01-24T13:06:58.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70e00cb1e0 0x7f70e00c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e00ceb10 0x7f70e00c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70e015a6f0 0x7f70e00c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00c83b0 con 0x7f70e00ceb10 2024-01-24T13:06:58.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e0155e10 con 0x7f70e00cb1e0 2024-01-24T13:06:58.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e8a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e01560f0 con 0x7f70e015a6f0 2024-01-24T13:06:58.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e5600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e00ceb10 0x7f70e00c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e6000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70e00cb1e0 0x7f70e00c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.805+0000 7f70e6000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70e00cb1e0 0x7f70e00c9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.29:42830/0 (socket says 172.21.15.29:42830) 2024-01-24T13:06:58.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70e6000640 1 -- 172.21.15.29:0/2028195521 learned_addr learned my addr 172.21.15.29:0/2028195521 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:58.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70e6a00640 1 --2- 172.21.15.29:0/2028195521 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70e015a6f0 0x7f70e00c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70e6000640 1 -- 172.21.15.29:0/2028195521 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70e015a6f0 msgr2=0x7f70e00c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70e6000640 1 --2- 172.21.15.29:0/2028195521 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70e015a6f0 0x7f70e00c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70e6000640 1 -- 172.21.15.29:0/2028195521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e00ceb10 msgr2=0x7f70e00c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70e6000640 1 --2- 172.21.15.29:0/2028195521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e00ceb10 0x7f70e00c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70e6000640 1 -- 172.21.15.29:0/2028195521 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d0009420 con 0x7f70e00cb1e0 2024-01-24T13:06:58.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70e5600640 1 --2- 172.21.15.29:0/2028195521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e00ceb10 0x7f70e00c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:58.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70e6000640 1 --2- 172.21.15.29:0/2028195521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70e00cb1e0 0x7f70e00c9f70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f70d00097c0 tx=0x7f70d001abb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:58.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70de000640 1 -- 172.21.15.29:0/2028195521 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0004220 con 0x7f70e00cb1e0 2024-01-24T13:06:58.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70de000640 1 -- 172.21.15.29:0/2028195521 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d0004380 con 0x7f70e00cb1e0 2024-01-24T13:06:58.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70de000640 1 -- 172.21.15.29:0/2028195521 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d00b88a0 con 0x7f70e00cb1e0 2024-01-24T13:06:58.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70e8a00640 1 -- 172.21.15.29:0/2028195521 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e01563d0 con 0x7f70e00cb1e0 2024-01-24T13:06:58.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70e8a00640 1 -- 172.21.15.29:0/2028195521 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e01508c0 con 0x7f70e00cb1e0 2024-01-24T13:06:58.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70e8a00640 1 -- 172.21.15.29:0/2028195521 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e00c8180 con 0x7f70e00cb1e0 2024-01-24T13:06:58.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.809+0000 7f70de000640 1 -- 172.21.15.29:0/2028195521 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f70d00b8a00 con 0x7f70e00cb1e0 2024-01-24T13:06:58.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.813+0000 7f70de000640 1 --2- 172.21.15.29:0/2028195521 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f70b8065a60 0x7f70b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:58.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.813+0000 7f70de000640 1 -- 172.21.15.29:0/2028195521 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f70d011d270 con 0x7f70e00cb1e0 2024-01-24T13:06:58.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.813+0000 7f70e5600640 1 --2- 172.21.15.29:0/2028195521 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f70b8065a60 0x7f70b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:58.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.813+0000 7f70e5600640 1 --2- 172.21.15.29:0/2028195521 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f70b8065a60 0x7f70b8067f20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f70c80011f0 tx=0x7f70c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:58.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.817+0000 7f70de000640 1 -- 172.21.15.29:0/2028195521 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f70d00eada0 con 0x7f70e00cb1e0 2024-01-24T13:06:58.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.973+0000 7f70e8a00640 1 -- 172.21.15.29:0/2028195521 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70e004e850 con 0x7f70e00cb1e0 2024-01-24T13:06:58.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.973+0000 7f70de000640 1 -- 172.21.15.29:0/2028195521 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70d0006e20 con 0x7f70e00cb1e0 2024-01-24T13:06:58.977 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:06:58.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.973+0000 7f70e8a00640 1 -- 172.21.15.29:0/2028195521 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f70b8065a60 msgr2=0x7f70b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.973+0000 7f70e8a00640 1 --2- 172.21.15.29:0/2028195521 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f70b8065a60 0x7f70b8067f20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f70c80011f0 tx=0x7f70c8009040 comp rx=0 tx=0).stop 2024-01-24T13:06:58.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.973+0000 7f70e8a00640 1 -- 172.21.15.29:0/2028195521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70e00cb1e0 msgr2=0x7f70e00c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:58.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.973+0000 7f70e8a00640 1 --2- 172.21.15.29:0/2028195521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70e00cb1e0 0x7f70e00c9f70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f70d00097c0 tx=0x7f70d001abb0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.973+0000 7f70e8a00640 1 -- 172.21.15.29:0/2028195521 shutdown_connections 2024-01-24T13:06:58.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.973+0000 7f70e8a00640 1 --2- 172.21.15.29:0/2028195521 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f70b8065a60 0x7f70b8067f20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.973+0000 7f70e8a00640 1 --2- 172.21.15.29:0/2028195521 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70e015a6f0 0x7f70e00c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.973+0000 7f70e8a00640 1 --2- 172.21.15.29:0/2028195521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e00ceb10 0x7f70e00c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.973+0000 7f70e8a00640 1 --2- 172.21.15.29:0/2028195521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70e00cb1e0 0x7f70e00c9f70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:58.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.973+0000 7f70e8a00640 1 -- 172.21.15.29:0/2028195521 >> 172.21.15.29:0/2028195521 conn(0x7f70e0069cd0 msgr2=0x7f70e0156d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:58.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.973+0000 7f70e8a00640 1 -- 172.21.15.29:0/2028195521 shutdown_connections 2024-01-24T13:06:58.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:58.973+0000 7f70e8a00640 1 -- 172.21.15.29:0/2028195521 wait complete. 2024-01-24T13:06:59.000 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:06:59.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.137+0000 7f275ec00640 1 Processor -- start 2024-01-24T13:06:59.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.137+0000 7f275ec00640 1 -- start start 2024-01-24T13:06:59.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f275ec00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f275815c8b0 0x7f2758069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f275ec00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f275806a210 0x7f27580cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f275ec00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27580c91e0 con 0x7f275815cc90 2024-01-24T13:06:59.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f275ec00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275806a6b0 con 0x7f275815c8b0 2024-01-24T13:06:59.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f275ec00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275806a990 con 0x7f275806a210 2024-01-24T13:06:59.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f2757e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f275815c8b0 0x7f2758069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f2757400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f275806a210 0x7f27580cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f275cc00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f275815cc90 0x7f275806c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:45996/0 (socket says 172.21.15.29:45996) 2024-01-24T13:06:59.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f275cc00640 1 -- 172.21.15.29:0/65122782 learned_addr learned my addr 172.21.15.29:0/65122782 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:59.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f2756a00640 1 -- 172.21.15.29:0/65122782 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904932153 0 0) 0x7f27580c91e0 con 0x7f275815cc90 2024-01-24T13:06:59.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f2756a00640 1 -- 172.21.15.29:0/65122782 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2738003530 con 0x7f275815cc90 2024-01-24T13:06:59.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f2757e00640 1 -- 172.21.15.29:0/65122782 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f275806a210 msgr2=0x7f27580cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:59.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f2757e00640 1 --2- 172.21.15.29:0/65122782 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f275806a210 0x7f27580cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f2757e00640 1 -- 172.21.15.29:0/65122782 >> v1:172.21.15.163:6789/0 conn(0x7f275815cc90 legacy=0x7f275806c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f2757e00640 1 -- 172.21.15.29:0/65122782 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275806ac70 con 0x7f275815c8b0 2024-01-24T13:06:59.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.141+0000 7f2757400640 1 --2- 172.21.15.29:0/65122782 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f275806a210 0x7f27580cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:06:59.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.145+0000 7f2757e00640 1 --2- 172.21.15.29:0/65122782 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f275815c8b0 0x7f2758069cd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f27480097c0 tx=0x7f274801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e59fcd8d269d80 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:59.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.145+0000 7f2756a00640 1 -- 172.21.15.29:0/65122782 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480ac640 con 0x7f275815c8b0 2024-01-24T13:06:59.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.145+0000 7f2756a00640 1 -- 172.21.15.29:0/65122782 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27480ac7a0 con 0x7f275815c8b0 2024-01-24T13:06:59.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.145+0000 7f2756a00640 1 -- 172.21.15.29:0/65122782 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480acb30 con 0x7f275815c8b0 2024-01-24T13:06:59.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.145+0000 7f275ec00640 1 -- 172.21.15.29:0/65122782 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f275815c8b0 msgr2=0x7f2758069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.145+0000 7f275ec00640 1 --2- 172.21.15.29:0/65122782 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f275815c8b0 0x7f2758069cd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f27480097c0 tx=0x7f274801c3c0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.145+0000 7f275ec00640 1 -- 172.21.15.29:0/65122782 shutdown_connections 2024-01-24T13:06:59.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.145+0000 7f275ec00640 1 --2- 172.21.15.29:0/65122782 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f275806a210 0x7f27580cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.145+0000 7f275ec00640 1 --2- 172.21.15.29:0/65122782 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f275815c8b0 0x7f2758069cd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.145+0000 7f275ec00640 1 -- 172.21.15.29:0/65122782 >> 172.21.15.29:0/65122782 conn(0x7f27580cb6a0 msgr2=0x7f27580cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:59.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.145+0000 7f275ec00640 1 -- 172.21.15.29:0/65122782 shutdown_connections 2024-01-24T13:06:59.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.145+0000 7f275ec00640 1 -- 172.21.15.29:0/65122782 wait complete. 2024-01-24T13:06:59.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f275ec00640 1 Processor -- start 2024-01-24T13:06:59.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f275ec00640 1 -- start start 2024-01-24T13:06:59.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f275ec00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f275806a210 0x7f275815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f275ec00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f275815c8b0 0x7f275815d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f275ec00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f275815cc90 0x7f27580c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f275ec00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275815c420 con 0x7f275806a210 2024-01-24T13:06:59.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f275ec00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275815ef90 con 0x7f275815cc90 2024-01-24T13:06:59.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f275ec00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275815d720 con 0x7f275815c8b0 2024-01-24T13:06:59.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f2757e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f275806a210 0x7f275815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f2757e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f275806a210 0x7f275815bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54000/0 (socket says 172.21.15.29:54000) 2024-01-24T13:06:59.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f2757e00640 1 -- 172.21.15.29:0/4026314972 learned_addr learned my addr 172.21.15.29:0/4026314972 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:59.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f275cc00640 1 --2- 172.21.15.29:0/4026314972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f275815cc90 0x7f27580c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f2757400640 1 --2- 172.21.15.29:0/4026314972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f275815c8b0 0x7f275815d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f2757e00640 1 -- 172.21.15.29:0/4026314972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f275815c8b0 msgr2=0x7f275815d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f2757e00640 1 --2- 172.21.15.29:0/4026314972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f275815c8b0 0x7f275815d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f2757e00640 1 -- 172.21.15.29:0/4026314972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f275815cc90 msgr2=0x7f27580c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f2757e00640 1 --2- 172.21.15.29:0/4026314972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f275815cc90 0x7f27580c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f2757e00640 1 -- 172.21.15.29:0/4026314972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2740009420 con 0x7f275806a210 2024-01-24T13:06:59.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f2757e00640 1 --2- 172.21.15.29:0/4026314972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f275806a210 0x7f275815bd90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f274801aa70 tx=0x7f2748019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:59.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f274fe00640 1 -- 172.21.15.29:0/4026314972 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480b5600 con 0x7f275806a210 2024-01-24T13:06:59.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f274fe00640 1 -- 172.21.15.29:0/4026314972 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27480b5760 con 0x7f275806a210 2024-01-24T13:06:59.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f274fe00640 1 -- 172.21.15.29:0/4026314972 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480b5b10 con 0x7f275806a210 2024-01-24T13:06:59.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f275ec00640 1 -- 172.21.15.29:0/4026314972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2748009420 con 0x7f275806a210 2024-01-24T13:06:59.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.149+0000 7f275ec00640 1 -- 172.21.15.29:0/4026314972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275815af60 con 0x7f275806a210 2024-01-24T13:06:59.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.153+0000 7f275ec00640 1 -- 172.21.15.29:0/4026314972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275815ecd0 con 0x7f275806a210 2024-01-24T13:06:59.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.153+0000 7f274fe00640 1 -- 172.21.15.29:0/4026314972 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f27480b3040 con 0x7f275806a210 2024-01-24T13:06:59.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.153+0000 7f274fe00640 1 --2- 172.21.15.29:0/4026314972 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2730065a90 0x7f2730067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.153+0000 7f274fe00640 1 -- 172.21.15.29:0/4026314972 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f274811d170 con 0x7f275806a210 2024-01-24T13:06:59.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.153+0000 7f2757400640 1 --2- 172.21.15.29:0/4026314972 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2730065a90 0x7f2730067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.153+0000 7f2757400640 1 --2- 172.21.15.29:0/4026314972 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2730065a90 0x7f2730067f50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f275815b5c0 tx=0x7f2740009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:59.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.157+0000 7f274fe00640 1 -- 172.21.15.29:0/4026314972 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f27480eaa90 con 0x7f275806a210 2024-01-24T13:06:59.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.313+0000 7f275ec00640 1 -- 172.21.15.29:0/4026314972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f275815b150 con 0x7f275806a210 2024-01-24T13:06:59.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.313+0000 7f274fe00640 1 -- 172.21.15.29:0/4026314972 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f27480ee0b0 con 0x7f275806a210 2024-01-24T13:06:59.318 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:06:59.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.313+0000 7f275ec00640 1 -- 172.21.15.29:0/4026314972 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2730065a90 msgr2=0x7f2730067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.313+0000 7f275ec00640 1 --2- 172.21.15.29:0/4026314972 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2730065a90 0x7f2730067f50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f275815b5c0 tx=0x7f2740009190 comp rx=0 tx=0).stop 2024-01-24T13:06:59.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.313+0000 7f275ec00640 1 -- 172.21.15.29:0/4026314972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f275806a210 msgr2=0x7f275815bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.313+0000 7f275ec00640 1 --2- 172.21.15.29:0/4026314972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f275806a210 0x7f275815bd90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f274801aa70 tx=0x7f2748019160 comp rx=0 tx=0).stop 2024-01-24T13:06:59.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.317+0000 7f275ec00640 1 -- 172.21.15.29:0/4026314972 shutdown_connections 2024-01-24T13:06:59.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.317+0000 7f275ec00640 1 --2- 172.21.15.29:0/4026314972 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f2730065a90 0x7f2730067f50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.317+0000 7f275ec00640 1 --2- 172.21.15.29:0/4026314972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f275815cc90 0x7f27580c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.317+0000 7f275ec00640 1 --2- 172.21.15.29:0/4026314972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f275815c8b0 0x7f275815d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.317+0000 7f275ec00640 1 --2- 172.21.15.29:0/4026314972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f275806a210 0x7f275815bd90 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.317+0000 7f275ec00640 1 -- 172.21.15.29:0/4026314972 >> 172.21.15.29:0/4026314972 conn(0x7f27580cb6a0 msgr2=0x7f27580cba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:59.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.317+0000 7f275ec00640 1 -- 172.21.15.29:0/4026314972 shutdown_connections 2024-01-24T13:06:59.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.317+0000 7f275ec00640 1 -- 172.21.15.29:0/4026314972 wait complete. 2024-01-24T13:06:59.339 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:06:59.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.477+0000 7f3fabc00640 1 Processor -- start 2024-01-24T13:06:59.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fabc00640 1 -- start start 2024-01-24T13:06:59.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fabc00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3fa4153a00 0x7f3fa4071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fabc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fa40b2c10 0x7f3fa40b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fabc00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa4153de0 con 0x7f3fa40b2760 2024-01-24T13:06:59.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fabc00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa415df00 con 0x7f3fa4153a00 2024-01-24T13:06:59.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fabc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40b30a0 con 0x7f3fa40b2c10 2024-01-24T13:06:59.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fa9200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3fa4153a00 0x7f3fa4071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fa9c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fa40b2c10 0x7f3fa40b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fa3e00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f3fa40b2760 0x7f3fa40b1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:45998/0 (socket says 172.21.15.29:45998) 2024-01-24T13:06:59.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fa3e00640 1 -- 172.21.15.29:0/1932397516 learned_addr learned my addr 172.21.15.29:0/1932397516 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:06:59.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fa9200640 1 -- 172.21.15.29:0/1932397516 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fa40b2c10 msgr2=0x7f3fa40b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:59.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fa9200640 1 --2- 172.21.15.29:0/1932397516 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fa40b2c10 0x7f3fa40b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fa9200640 1 -- 172.21.15.29:0/1932397516 >> v1:172.21.15.163:6789/0 conn(0x7f3fa40b2760 legacy=0x7f3fa40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fa9200640 1 -- 172.21.15.29:0/1932397516 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa4159900 con 0x7f3fa4153a00 2024-01-24T13:06:59.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.481+0000 7f3fa3400640 1 -- 172.21.15.29:0/1932397516 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057841268 0 0) 0x7f3fa4153de0 con 0x7f3fa40b2760 2024-01-24T13:06:59.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.485+0000 7f3fa9200640 1 --2- 172.21.15.29:0/1932397516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fa4153a00 0x7f3fa4071600 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400ba60 tx=0x7f3f9401ea90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c99e6c2e592a2e98 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:59.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.485+0000 7f3fa3400640 1 -- 172.21.15.29:0/1932397516 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f940a7a60 con 0x7f3fa4153a00 2024-01-24T13:06:59.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.485+0000 7f3fa3400640 1 -- 172.21.15.29:0/1932397516 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f940a7bc0 con 0x7f3fa4153a00 2024-01-24T13:06:59.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.485+0000 7f3fa3400640 1 -- 172.21.15.29:0/1932397516 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f940af440 con 0x7f3fa4153a00 2024-01-24T13:06:59.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.485+0000 7f3fabc00640 1 -- 172.21.15.29:0/1932397516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fa4153a00 msgr2=0x7f3fa4071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.485+0000 7f3fabc00640 1 --2- 172.21.15.29:0/1932397516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fa4153a00 0x7f3fa4071600 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400ba60 tx=0x7f3f9401ea90 comp rx=0 tx=0).stop 2024-01-24T13:06:59.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.485+0000 7f3fabc00640 1 -- 172.21.15.29:0/1932397516 shutdown_connections 2024-01-24T13:06:59.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.485+0000 7f3fabc00640 1 --2- 172.21.15.29:0/1932397516 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fa40b2c10 0x7f3fa40b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.485+0000 7f3fabc00640 1 --2- 172.21.15.29:0/1932397516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fa4153a00 0x7f3fa4071600 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.485+0000 7f3fabc00640 1 -- 172.21.15.29:0/1932397516 >> 172.21.15.29:0/1932397516 conn(0x7f3fa406d700 msgr2=0x7f3fa4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:59.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.485+0000 7f3fabc00640 1 -- 172.21.15.29:0/1932397516 shutdown_connections 2024-01-24T13:06:59.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.485+0000 7f3fabc00640 1 -- 172.21.15.29:0/1932397516 wait complete. 2024-01-24T13:06:59.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fabc00640 1 Processor -- start 2024-01-24T13:06:59.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fabc00640 1 -- start start 2024-01-24T13:06:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fabc00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fa40b2760 0x7f3fa415d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fabc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fa40b2c10 0x7f3fa40a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fabc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa4153a00 0x7f3fa40a7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fabc00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa413c5e0 con 0x7f3fa4153a00 2024-01-24T13:06:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fabc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa413c8c0 con 0x7f3fa40b2c10 2024-01-24T13:06:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fabc00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa413cba0 con 0x7f3fa40b2760 2024-01-24T13:06:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fa9c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa4153a00 0x7f3fa40a7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fa9c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa4153a00 0x7f3fa40a7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54012/0 (socket says 172.21.15.29:54012) 2024-01-24T13:06:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fa9c00640 1 -- 172.21.15.29:0/327340818 learned_addr learned my addr 172.21.15.29:0/327340818 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fa9c00640 1 -- 172.21.15.29:0/327340818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fa40b2760 msgr2=0x7f3fa415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fa9c00640 1 --2- 172.21.15.29:0/327340818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fa40b2760 0x7f3fa415d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fa9c00640 1 -- 172.21.15.29:0/327340818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fa40b2c10 msgr2=0x7f3fa40a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fa3e00640 1 --2- 172.21.15.29:0/327340818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fa40b2c10 0x7f3fa40a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fa9c00640 1 --2- 172.21.15.29:0/327340818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fa40b2c10 0x7f3fa40a74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fa9c00640 1 -- 172.21.15.29:0/327340818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9400b6c0 con 0x7f3fa4153a00 2024-01-24T13:06:59.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fa3e00640 1 --2- 172.21.15.29:0/327340818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fa40b2c10 0x7f3fa40a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:06:59.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fa9c00640 1 --2- 172.21.15.29:0/327340818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa4153a00 0x7f3fa40a7a00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00efc0 tx=0x7f3f9c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:59.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fa0c00640 1 -- 172.21.15.29:0/327340818 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c014480 con 0x7f3fa4153a00 2024-01-24T13:06:59.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fa0c00640 1 -- 172.21.15.29:0/327340818 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c00f040 con 0x7f3fa4153a00 2024-01-24T13:06:59.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fa0c00640 1 -- 172.21.15.29:0/327340818 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c014820 con 0x7f3fa4153a00 2024-01-24T13:06:59.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fabc00640 1 -- 172.21.15.29:0/327340818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa413ce80 con 0x7f3fa4153a00 2024-01-24T13:06:59.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fabc00640 1 -- 172.21.15.29:0/327340818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa415d6f0 con 0x7f3fa4153a00 2024-01-24T13:06:59.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.489+0000 7f3fabc00640 1 -- 172.21.15.29:0/327340818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa404e850 con 0x7f3fa4153a00 2024-01-24T13:06:59.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.493+0000 7f3fa0c00640 1 -- 172.21.15.29:0/327340818 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3f9c014980 con 0x7f3fa4153a00 2024-01-24T13:06:59.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.493+0000 7f3fa0c00640 1 --2- 172.21.15.29:0/327340818 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f7c065a60 0x7f3f7c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.493+0000 7f3fa0c00640 1 -- 172.21.15.29:0/327340818 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3f9c0840e0 con 0x7f3fa4153a00 2024-01-24T13:06:59.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.493+0000 7f3fa9200640 1 --2- 172.21.15.29:0/327340818 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f7c065a60 0x7f3f7c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.493+0000 7f3fa9200640 1 --2- 172.21.15.29:0/327340818 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f7c065a60 0x7f3f7c067f20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3f940b1000 tx=0x7f3f94004740 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:59.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.497+0000 7f3fa0c00640 1 -- 172.21.15.29:0/327340818 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3f9c0519f0 con 0x7f3fa4153a00 2024-01-24T13:06:59.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.653+0000 7f3fabc00640 1 -- 172.21.15.29:0/327340818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3fa413d330 con 0x7f3fa4153a00 2024-01-24T13:06:59.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.653+0000 7f3fa0c00640 1 -- 172.21.15.29:0/327340818 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f9c018020 con 0x7f3fa4153a00 2024-01-24T13:06:59.660 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:06:59.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.657+0000 7f3fabc00640 1 -- 172.21.15.29:0/327340818 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f7c065a60 msgr2=0x7f3f7c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.657+0000 7f3fabc00640 1 --2- 172.21.15.29:0/327340818 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f7c065a60 0x7f3f7c067f20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3f940b1000 tx=0x7f3f94004740 comp rx=0 tx=0).stop 2024-01-24T13:06:59.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.657+0000 7f3fabc00640 1 -- 172.21.15.29:0/327340818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa4153a00 msgr2=0x7f3fa40a7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.657+0000 7f3fabc00640 1 --2- 172.21.15.29:0/327340818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa4153a00 0x7f3fa40a7a00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00efc0 tx=0x7f3f9c00c490 comp rx=0 tx=0).stop 2024-01-24T13:06:59.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.657+0000 7f3fabc00640 1 -- 172.21.15.29:0/327340818 shutdown_connections 2024-01-24T13:06:59.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.657+0000 7f3fabc00640 1 --2- 172.21.15.29:0/327340818 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f7c065a60 0x7f3f7c067f20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.657+0000 7f3fabc00640 1 --2- 172.21.15.29:0/327340818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa4153a00 0x7f3fa40a7a00 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.657+0000 7f3fabc00640 1 --2- 172.21.15.29:0/327340818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fa40b2c10 0x7f3fa40a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.657+0000 7f3fabc00640 1 --2- 172.21.15.29:0/327340818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fa40b2760 0x7f3fa415d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.657+0000 7f3fabc00640 1 -- 172.21.15.29:0/327340818 >> 172.21.15.29:0/327340818 conn(0x7f3fa406d700 msgr2=0x7f3fa40af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:59.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.657+0000 7f3fabc00640 1 -- 172.21.15.29:0/327340818 shutdown_connections 2024-01-24T13:06:59.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.657+0000 7f3fabc00640 1 -- 172.21.15.29:0/327340818 wait complete. 2024-01-24T13:06:59.682 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:06:59.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f1016000640 1 Processor -- start 2024-01-24T13:06:59.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f1016000640 1 -- start start 2024-01-24T13:06:59.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f1016000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f101015cab0 0x7f101006bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f1016000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f10100ce080 0x7f10100ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f1016000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10100ce7f0 con 0x7f101015c6d0 2024-01-24T13:06:59.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f1016000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10100cead0 con 0x7f101015cab0 2024-01-24T13:06:59.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f1016000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10100d04a0 con 0x7f10100ce080 2024-01-24T13:06:59.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f100ea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f101015cab0 0x7f101006bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f100ea00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f101015cab0 0x7f101006bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54020/0 (socket says 172.21.15.29:54020) 2024-01-24T13:06:59.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f100ea00640 1 -- 172.21.15.29:0/2361161160 learned_addr learned my addr 172.21.15.29:0/2361161160 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:59.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f100fe00640 1 --2- 172.21.15.29:0/2361161160 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f10100ce080 0x7f10100ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f100ea00640 1 -- 172.21.15.29:0/2361161160 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f10100ce080 msgr2=0x7f10100ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:06:59.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f100ea00640 1 --2- 172.21.15.29:0/2361161160 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f10100ce080 0x7f10100ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f100ea00640 1 -- 172.21.15.29:0/2361161160 >> v1:172.21.15.163:6789/0 conn(0x7f101015c6d0 legacy=0x7f10100d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f100ea00640 1 -- 172.21.15.29:0/2361161160 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10100d0780 con 0x7f101015cab0 2024-01-24T13:06:59.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.821+0000 7f100e000640 1 -- 172.21.15.29:0/2361161160 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933624089 0 0) 0x7f10100ce7f0 con 0x7f101015c6d0 2024-01-24T13:06:59.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.825+0000 7f100ea00640 1 --2- 172.21.15.29:0/2361161160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f101015cab0 0x7f101006bcc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009870 tx=0x7f0ff801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fa76dba53b6564 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:59.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.825+0000 7f100e000640 1 -- 172.21.15.29:0/2361161160 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80ab650 con 0x7f101015cab0 2024-01-24T13:06:59.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.825+0000 7f100e000640 1 -- 172.21.15.29:0/2361161160 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff80ab7b0 con 0x7f101015cab0 2024-01-24T13:06:59.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.825+0000 7f100e000640 1 -- 172.21.15.29:0/2361161160 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80abb40 con 0x7f101015cab0 2024-01-24T13:06:59.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.825+0000 7f1016000640 1 -- 172.21.15.29:0/2361161160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f101015cab0 msgr2=0x7f101006bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.825+0000 7f1016000640 1 --2- 172.21.15.29:0/2361161160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f101015cab0 0x7f101006bcc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009870 tx=0x7f0ff801c540 comp rx=0 tx=0).stop 2024-01-24T13:06:59.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.825+0000 7f1016000640 1 -- 172.21.15.29:0/2361161160 shutdown_connections 2024-01-24T13:06:59.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.825+0000 7f1016000640 1 --2- 172.21.15.29:0/2361161160 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f10100ce080 0x7f10100ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.825+0000 7f1016000640 1 --2- 172.21.15.29:0/2361161160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f101015cab0 0x7f101006bcc0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.825+0000 7f1016000640 1 -- 172.21.15.29:0/2361161160 >> 172.21.15.29:0/2361161160 conn(0x7f1010069cd0 msgr2=0x7f101006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:06:59.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.825+0000 7f1016000640 1 -- 172.21.15.29:0/2361161160 shutdown_connections 2024-01-24T13:06:59.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.825+0000 7f1016000640 1 -- 172.21.15.29:0/2361161160 wait complete. 2024-01-24T13:06:59.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f1016000640 1 Processor -- start 2024-01-24T13:06:59.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f1016000640 1 -- start start 2024-01-24T13:06:59.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f1016000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f10100ce080 0x7f1010154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f1016000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f101015c6d0 0x7f10100b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f1016000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10100c9310 0x7f10100c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f1016000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100ca3b0 con 0x7f10100c9310 2024-01-24T13:06:59.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f1016000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100c9b10 con 0x7f101015c6d0 2024-01-24T13:06:59.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f1016000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10100c9df0 con 0x7f10100ce080 2024-01-24T13:06:59.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f100fe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10100c9310 0x7f10100c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f100fe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10100c9310 0x7f10100c6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54028/0 (socket says 172.21.15.29:54028) 2024-01-24T13:06:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f100fe00640 1 -- 172.21.15.29:0/1550737826 learned_addr learned my addr 172.21.15.29:0/1550737826 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:06:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f100f400640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f10100ce080 0x7f1010154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f100ea00640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f101015c6d0 0x7f10100b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f100fe00640 1 -- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f10100ce080 msgr2=0x7f1010154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f100fe00640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f10100ce080 0x7f1010154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f100fe00640 1 -- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f101015c6d0 msgr2=0x7f10100b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:06:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f100fe00640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f101015c6d0 0x7f10100b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:06:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f100fe00640 1 -- 172.21.15.29:0/1550737826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80094d0 con 0x7f10100c9310 2024-01-24T13:06:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f100f400640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f10100ce080 0x7f1010154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f100ea00640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f101015c6d0 0x7f10100b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:06:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f100fe00640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10100c9310 0x7f10100c6470 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f100800efc0 tx=0x7f100800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:59.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f1007400640 1 -- 172.21.15.29:0/1550737826 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008009ba0 con 0x7f10100c9310 2024-01-24T13:06:59.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f1007400640 1 -- 172.21.15.29:0/1550737826 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100800f040 con 0x7f10100c9310 2024-01-24T13:06:59.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f1007400640 1 -- 172.21.15.29:0/1550737826 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10080146c0 con 0x7f10100c9310 2024-01-24T13:06:59.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.829+0000 7f1016000640 1 -- 172.21.15.29:0/1550737826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10100ca0d0 con 0x7f10100c9310 2024-01-24T13:06:59.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.833+0000 7f1016000640 1 -- 172.21.15.29:0/1550737826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10100c69b0 con 0x7f10100c9310 2024-01-24T13:06:59.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.833+0000 7f1016000640 1 -- 172.21.15.29:0/1550737826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101004e850 con 0x7f10100c9310 2024-01-24T13:06:59.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.833+0000 7f1007400640 1 -- 172.21.15.29:0/1550737826 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1008014820 con 0x7f10100c9310 2024-01-24T13:06:59.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.833+0000 7f1007400640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0fe8065a60 0x7f0fe8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:06:59.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.833+0000 7f1007400640 1 -- 172.21.15.29:0/1550737826 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1008083e70 con 0x7f10100c9310 2024-01-24T13:06:59.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.833+0000 7f100f400640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0fe8065a60 0x7f0fe8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:06:59.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.833+0000 7f100f400640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0fe8065a60 0x7f0fe8067f20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1000000f70 tx=0x7f1000009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:06:59.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:06:59.837+0000 7f1007400640 1 -- 172.21.15.29:0/1550737826 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1008051650 con 0x7f10100c9310 2024-01-24T13:07:00.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.009+0000 7f1016000640 1 -- 172.21.15.29:0/1550737826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f10100ca8e0 con 0x7f10100c9310 2024-01-24T13:07:00.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.009+0000 7f1007400640 1 -- 172.21.15.29:0/1550737826 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1008018080 con 0x7f10100c9310 2024-01-24T13:07:00.013 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:07:00.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.009+0000 7f1016000640 1 -- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0fe8065a60 msgr2=0x7f0fe8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.009+0000 7f1016000640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0fe8065a60 0x7f0fe8067f20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1000000f70 tx=0x7f1000009040 comp rx=0 tx=0).stop 2024-01-24T13:07:00.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.009+0000 7f1016000640 1 -- 172.21.15.29:0/1550737826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10100c9310 msgr2=0x7f10100c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.009+0000 7f1016000640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10100c9310 0x7f10100c6470 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f100800efc0 tx=0x7f100800c490 comp rx=0 tx=0).stop 2024-01-24T13:07:00.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.009+0000 7f1016000640 1 -- 172.21.15.29:0/1550737826 shutdown_connections 2024-01-24T13:07:00.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.009+0000 7f1016000640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0fe8065a60 0x7f0fe8067f20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.009+0000 7f1016000640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10100c9310 0x7f10100c6470 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.009+0000 7f1016000640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f101015c6d0 0x7f10100b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.009+0000 7f1016000640 1 --2- 172.21.15.29:0/1550737826 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f10100ce080 0x7f1010154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.009+0000 7f1016000640 1 -- 172.21.15.29:0/1550737826 >> 172.21.15.29:0/1550737826 conn(0x7f1010069cd0 msgr2=0x7f10100d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:00.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.009+0000 7f1016000640 1 -- 172.21.15.29:0/1550737826 shutdown_connections 2024-01-24T13:07:00.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.009+0000 7f1016000640 1 -- 172.21.15.29:0/1550737826 wait complete. 2024-01-24T13:07:00.035 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:07:00.035 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:07:00.045 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:07:00.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.225+0000 7eff94200640 1 Processor -- start 2024-01-24T13:07:00.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.225+0000 7eff94200640 1 -- start start 2024-01-24T13:07:00.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.225+0000 7eff94200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7eff8c0ce8a0 0x7eff8c165380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.225+0000 7eff94200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c15aa30 con 0x7eff8c143910 2024-01-24T13:07:00.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.225+0000 7eff94200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c0712a0 con 0x7eff8c143d30 2024-01-24T13:07:00.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.225+0000 7eff94200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8c071580 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.225+0000 7eff92200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7eff8c0ce8a0 0x7eff8c165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.225+0000 7eff91800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7eff8c143910 0x7eff8c070ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51426/0 (socket says 172.21.15.29:51426) 2024-01-24T13:07:00.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.225+0000 7eff91800640 1 -- 172.21.15.29:0/643841021 learned_addr learned my addr 172.21.15.29:0/643841021 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:00.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.225+0000 7eff92200640 1 -- 172.21.15.29:0/643841021 >> v1:172.21.15.163:6789/0 conn(0x7eff8c143d30 legacy=0x7eff8c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.225+0000 7eff92200640 1 -- 172.21.15.29:0/643841021 >> v1:172.21.15.29:6789/0 conn(0x7eff8c143910 legacy=0x7eff8c070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.225+0000 7eff8be00640 1 -- 172.21.15.29:0/643841021 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281333068 0 0) 0x7eff7c001120 con 0x7eff8c143910 2024-01-24T13:07:00.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.225+0000 7eff92200640 1 -- 172.21.15.29:0/643841021 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c0cd090 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.229+0000 7eff92200640 1 --2- 172.21.15.29:0/643841021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff8c0ce8a0 0x7eff8c165380 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7eff84009d90 tx=0x7eff8401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c99052f32147b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:00.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.229+0000 7eff8be00640 1 -- 172.21.15.29:0/643841021 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff840a58e0 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.229+0000 7eff8be00640 1 -- 172.21.15.29:0/643841021 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff840a5a40 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.229+0000 7eff8be00640 1 -- 172.21.15.29:0/643841021 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff840a5dd0 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.229+0000 7eff94200640 1 -- 172.21.15.29:0/643841021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff8c0ce8a0 msgr2=0x7eff8c165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.229+0000 7eff94200640 1 --2- 172.21.15.29:0/643841021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff8c0ce8a0 0x7eff8c165380 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7eff84009d90 tx=0x7eff8401c950 comp rx=0 tx=0).stop 2024-01-24T13:07:00.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.229+0000 7eff94200640 1 -- 172.21.15.29:0/643841021 shutdown_connections 2024-01-24T13:07:00.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.229+0000 7eff94200640 1 --2- 172.21.15.29:0/643841021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff8c0ce8a0 0x7eff8c165380 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.229+0000 7eff94200640 1 -- 172.21.15.29:0/643841021 >> 172.21.15.29:0/643841021 conn(0x7eff8c0b3950 msgr2=0x7eff8c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:00.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.229+0000 7eff94200640 1 -- 172.21.15.29:0/643841021 shutdown_connections 2024-01-24T13:07:00.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.229+0000 7eff94200640 1 -- 172.21.15.29:0/643841021 wait complete. 2024-01-24T13:07:00.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff94200640 1 Processor -- start 2024-01-24T13:07:00.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff94200640 1 -- start start 2024-01-24T13:07:00.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff94200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff8c0ce8a0 0x7eff8c15d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff94200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff8c143910 0x7eff8c15b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff94200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7eff8c143d30 0x7eff8c139820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff94200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c165750 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff94200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c15bb20 con 0x7eff8c143910 2024-01-24T13:07:00.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff94200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c163640 con 0x7eff8c143d30 2024-01-24T13:07:00.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff91800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff8c0ce8a0 0x7eff8c15d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff91800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff8c0ce8a0 0x7eff8c15d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54050/0 (socket says 172.21.15.29:54050) 2024-01-24T13:07:00.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff91800640 1 -- 172.21.15.29:0/1296808489 learned_addr learned my addr 172.21.15.29:0/1296808489 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:00.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff92200640 1 --2- 172.21.15.29:0/1296808489 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7eff8c143d30 0x7eff8c139820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff90e00640 1 --2- 172.21.15.29:0/1296808489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff8c143910 0x7eff8c15b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff91800640 1 -- 172.21.15.29:0/1296808489 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7eff8c143d30 msgr2=0x7eff8c139820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff91800640 1 --2- 172.21.15.29:0/1296808489 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7eff8c143d30 0x7eff8c139820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff91800640 1 -- 172.21.15.29:0/1296808489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff8c143910 msgr2=0x7eff8c15b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff91800640 1 --2- 172.21.15.29:0/1296808489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff8c143910 0x7eff8c15b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff91800640 1 -- 172.21.15.29:0/1296808489 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff84009a70 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff91800640 1 --2- 172.21.15.29:0/1296808489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff8c0ce8a0 0x7eff8c15d230 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00c780 tx=0x7eff7c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:00.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff89600640 1 -- 172.21.15.29:0/1296808489 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0072d0 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff89600640 1 -- 172.21.15.29:0/1296808489 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c007430 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff89600640 1 -- 172.21.15.29:0/1296808489 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c001d20 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff94200640 1 -- 172.21.15.29:0/1296808489 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8c163920 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.233+0000 7eff94200640 1 -- 172.21.15.29:0/1296808489 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8c163ee0 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.237+0000 7eff94200640 1 -- 172.21.15.29:0/1296808489 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8c04e850 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.237+0000 7eff89600640 1 -- 172.21.15.29:0/1296808489 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7eff7c0047f0 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.237+0000 7eff89600640 1 --2- 172.21.15.29:0/1296808489 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7eff64065a60 0x7eff64067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.237+0000 7eff89600640 1 -- 172.21.15.29:0/1296808489 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7eff7c082420 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.237+0000 7eff90e00640 1 --2- 172.21.15.29:0/1296808489 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7eff64065a60 0x7eff64067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.237+0000 7eff90e00640 1 --2- 172.21.15.29:0/1296808489 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7eff64065a60 0x7eff64067f20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7eff8c06c2b0 tx=0x7eff74009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:00.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.241+0000 7eff89600640 1 -- 172.21.15.29:0/1296808489 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7eff7c04fd40 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.401+0000 7eff94200640 1 -- 172.21.15.29:0/1296808489 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff8c15aa30 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.401+0000 7eff89600640 1 -- 172.21.15.29:0/1296808489 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16302 (secure 0 0 0) 0x7eff8c15aa30 con 0x7eff8c0ce8a0 2024-01-24T13:07:00.407 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:00.408 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":59,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:06:34.365221+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:06:31.105908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-24T13:06:32.357292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:07:00.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.405+0000 7eff94200640 1 -- 172.21.15.29:0/1296808489 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7eff64065a60 msgr2=0x7eff64067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.405+0000 7eff94200640 1 --2- 172.21.15.29:0/1296808489 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7eff64065a60 0x7eff64067f20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7eff8c06c2b0 tx=0x7eff74009040 comp rx=0 tx=0).stop 2024-01-24T13:07:00.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.405+0000 7eff94200640 1 -- 172.21.15.29:0/1296808489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff8c0ce8a0 msgr2=0x7eff8c15d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.405+0000 7eff94200640 1 --2- 172.21.15.29:0/1296808489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff8c0ce8a0 0x7eff8c15d230 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00c780 tx=0x7eff7c00cc40 comp rx=0 tx=0).stop 2024-01-24T13:07:00.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.405+0000 7eff94200640 1 -- 172.21.15.29:0/1296808489 shutdown_connections 2024-01-24T13:07:00.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.405+0000 7eff94200640 1 --2- 172.21.15.29:0/1296808489 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7eff64065a60 0x7eff64067f20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.405+0000 7eff94200640 1 --2- 172.21.15.29:0/1296808489 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7eff8c143d30 0x7eff8c139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.405+0000 7eff94200640 1 --2- 172.21.15.29:0/1296808489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff8c143910 0x7eff8c15b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.405+0000 7eff94200640 1 --2- 172.21.15.29:0/1296808489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff8c0ce8a0 0x7eff8c15d230 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.405+0000 7eff94200640 1 -- 172.21.15.29:0/1296808489 >> 172.21.15.29:0/1296808489 conn(0x7eff8c0b3950 msgr2=0x7eff8c070490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:00.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.405+0000 7eff94200640 1 -- 172.21.15.29:0/1296808489 shutdown_connections 2024-01-24T13:07:00.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.405+0000 7eff94200640 1 -- 172.21.15.29:0/1296808489 wait complete. 2024-01-24T13:07:00.430 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:06:31.105908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:06:32.357292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:07:00.430 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:07:00.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.569+0000 7f81e7200640 1 Processor -- start 2024-01-24T13:07:00.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.569+0000 7f81e7200640 1 -- start start 2024-01-24T13:07:00.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.573+0000 7f81e7200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f81e00c3fd0 0x7f81e00caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.573+0000 7f81e7200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81e00cb010 0x7f81e00d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.573+0000 7f81e7200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e00cd1e0 con 0x7f81e015a6f0 2024-01-24T13:07:00.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.573+0000 7f81e7200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e015aad0 con 0x7f81e00c3fd0 2024-01-24T13:07:00.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.573+0000 7f81e7200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00cb480 con 0x7f81e00cb010 2024-01-24T13:07:00.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.573+0000 7f81e5200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81e00cb010 0x7f81e00d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.573+0000 7f81e5200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81e00cb010 0x7f81e00d0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:60772/0 (socket says 172.21.15.29:60772) 2024-01-24T13:07:00.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.573+0000 7f81e5200640 1 -- 172.21.15.29:0/2614639690 learned_addr learned my addr 172.21.15.29:0/2614639690 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:00.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.573+0000 7f81df400640 1 --2- 172.21.15.29:0/2614639690 >> v2:172.21.15.163:3300/0 conn(0x7f81e00c3fd0 0x7f81e00caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.573+0000 7f81e5200640 1 -- 172.21.15.29:0/2614639690 >> v2:172.21.15.163:3300/0 conn(0x7f81e00c3fd0 msgr2=0x7f81e00caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:00.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.573+0000 7f81e5200640 1 --2- 172.21.15.29:0/2614639690 >> v2:172.21.15.163:3300/0 conn(0x7f81e00c3fd0 0x7f81e00caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.573+0000 7f81e5200640 1 -- 172.21.15.29:0/2614639690 >> v1:172.21.15.163:6789/0 conn(0x7f81e015a6f0 legacy=0x7f81e00ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.573+0000 7f81e5200640 1 -- 172.21.15.29:0/2614639690 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00cd4c0 con 0x7f81e00cb010 2024-01-24T13:07:00.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.573+0000 7f81dea00640 1 -- 172.21.15.29:0/2614639690 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101236436 0 0) 0x7f81e00cd1e0 con 0x7f81e015a6f0 2024-01-24T13:07:00.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.577+0000 7f81e5200640 1 --2- 172.21.15.29:0/2614639690 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81e00cb010 0x7f81e00d0520 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009e50 tx=0x7f81d801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=258ca8acd4f9b12d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:00.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.577+0000 7f81dea00640 1 -- 172.21.15.29:0/2614639690 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d80a57c0 con 0x7f81e00cb010 2024-01-24T13:07:00.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.577+0000 7f81dea00640 1 -- 172.21.15.29:0/2614639690 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d80a5920 con 0x7f81e00cb010 2024-01-24T13:07:00.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.577+0000 7f81dea00640 1 -- 172.21.15.29:0/2614639690 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d80a5cb0 con 0x7f81e00cb010 2024-01-24T13:07:00.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.577+0000 7f81e7200640 1 -- 172.21.15.29:0/2614639690 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81e00cb010 msgr2=0x7f81e00d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.577+0000 7f81e7200640 1 --2- 172.21.15.29:0/2614639690 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81e00cb010 0x7f81e00d0520 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009e50 tx=0x7f81d801c9e0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.577+0000 7f81e7200640 1 -- 172.21.15.29:0/2614639690 shutdown_connections 2024-01-24T13:07:00.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.577+0000 7f81e7200640 1 --2- 172.21.15.29:0/2614639690 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81e00cb010 0x7f81e00d0520 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.577+0000 7f81e7200640 1 --2- 172.21.15.29:0/2614639690 >> v2:172.21.15.163:3300/0 conn(0x7f81e00c3fd0 0x7f81e00caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.577+0000 7f81e7200640 1 -- 172.21.15.29:0/2614639690 >> 172.21.15.29:0/2614639690 conn(0x7f81e0069cd0 msgr2=0x7f81e006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:00.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.577+0000 7f81e7200640 1 -- 172.21.15.29:0/2614639690 shutdown_connections 2024-01-24T13:07:00.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.577+0000 7f81e7200640 1 -- 172.21.15.29:0/2614639690 wait complete. 2024-01-24T13:07:00.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.577+0000 7f81e7200640 1 Processor -- start 2024-01-24T13:07:00.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81e7200640 1 -- start start 2024-01-24T13:07:00.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81e7200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e00c3fd0 0x7f81e015d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81e7200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81e00cb010 0x7f81e0155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81e7200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81e015a6f0 0x7f81e0156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81e7200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e015ac10 con 0x7f81e00c3fd0 2024-01-24T13:07:00.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81e7200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00c9200 con 0x7f81e00cb010 2024-01-24T13:07:00.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81e7200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00c76f0 con 0x7f81e015a6f0 2024-01-24T13:07:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81dfe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e00c3fd0 0x7f81e015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81dfe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e00c3fd0 0x7f81e015d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54052/0 (socket says 172.21.15.29:54052) 2024-01-24T13:07:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81dfe00640 1 -- 172.21.15.29:0/160445502 learned_addr learned my addr 172.21.15.29:0/160445502 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81e5200640 1 --2- 172.21.15.29:0/160445502 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81e015a6f0 0x7f81e0156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81df400640 1 --2- 172.21.15.29:0/160445502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81e00cb010 0x7f81e0155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81dfe00640 1 -- 172.21.15.29:0/160445502 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81e015a6f0 msgr2=0x7f81e0156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81dfe00640 1 --2- 172.21.15.29:0/160445502 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81e015a6f0 0x7f81e0156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81dfe00640 1 -- 172.21.15.29:0/160445502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81e00cb010 msgr2=0x7f81e0155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81dfe00640 1 --2- 172.21.15.29:0/160445502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81e00cb010 0x7f81e0155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81dfe00640 1 -- 172.21.15.29:0/160445502 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d8009b30 con 0x7f81e00c3fd0 2024-01-24T13:07:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81dfe00640 1 --2- 172.21.15.29:0/160445502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e00c3fd0 0x7f81e015d690 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f81d000c4d0 tx=0x7f81d000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:00.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81d7e00640 1 -- 172.21.15.29:0/160445502 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0005480 con 0x7f81e00c3fd0 2024-01-24T13:07:00.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81d7e00640 1 -- 172.21.15.29:0/160445502 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d0003600 con 0x7f81e00c3fd0 2024-01-24T13:07:00.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81e7200640 1 -- 172.21.15.29:0/160445502 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e00c79d0 con 0x7f81e00c3fd0 2024-01-24T13:07:00.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81d7e00640 1 -- 172.21.15.29:0/160445502 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d00039b0 con 0x7f81e00c3fd0 2024-01-24T13:07:00.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81e7200640 1 -- 172.21.15.29:0/160445502 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e00c7f90 con 0x7f81e00c3fd0 2024-01-24T13:07:00.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.581+0000 7f81e7200640 1 -- 172.21.15.29:0/160445502 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e0153140 con 0x7f81e00c3fd0 2024-01-24T13:07:00.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.585+0000 7f81d7e00640 1 -- 172.21.15.29:0/160445502 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f81d0003b10 con 0x7f81e00c3fd0 2024-01-24T13:07:00.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.585+0000 7f81d7e00640 1 --2- 172.21.15.29:0/160445502 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f81b8065a60 0x7f81b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.585+0000 7f81d7e00640 1 -- 172.21.15.29:0/160445502 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f81d0082870 con 0x7f81e00c3fd0 2024-01-24T13:07:00.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.585+0000 7f81df400640 1 --2- 172.21.15.29:0/160445502 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f81b8065a60 0x7f81b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.585+0000 7f81df400640 1 --2- 172.21.15.29:0/160445502 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f81b8065a60 0x7f81b8067f20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f81e01529e0 tx=0x7f81c8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:00.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.589+0000 7f81d7e00640 1 -- 172.21.15.29:0/160445502 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f81d00501d0 con 0x7f81e00c3fd0 2024-01-24T13:07:00.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.749+0000 7f81e7200640 1 -- 172.21.15.29:0/160445502 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81e004e850 con 0x7f81e00c3fd0 2024-01-24T13:07:00.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.749+0000 7f81d7e00640 1 -- 172.21.15.29:0/160445502 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81d0017020 con 0x7f81e00c3fd0 2024-01-24T13:07:00.755 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:07:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.753+0000 7f81e7200640 1 -- 172.21.15.29:0/160445502 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f81b8065a60 msgr2=0x7f81b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.753+0000 7f81e7200640 1 --2- 172.21.15.29:0/160445502 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f81b8065a60 0x7f81b8067f20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f81e01529e0 tx=0x7f81c8009190 comp rx=0 tx=0).stop 2024-01-24T13:07:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.753+0000 7f81e7200640 1 -- 172.21.15.29:0/160445502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e00c3fd0 msgr2=0x7f81e015d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.753+0000 7f81e7200640 1 --2- 172.21.15.29:0/160445502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e00c3fd0 0x7f81e015d690 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f81d000c4d0 tx=0x7f81d000c990 comp rx=0 tx=0).stop 2024-01-24T13:07:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.753+0000 7f81e7200640 1 -- 172.21.15.29:0/160445502 shutdown_connections 2024-01-24T13:07:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.753+0000 7f81e7200640 1 --2- 172.21.15.29:0/160445502 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f81b8065a60 0x7f81b8067f20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.753+0000 7f81e7200640 1 --2- 172.21.15.29:0/160445502 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81e015a6f0 0x7f81e0156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.753+0000 7f81e7200640 1 --2- 172.21.15.29:0/160445502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81e00cb010 0x7f81e0155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.753+0000 7f81e7200640 1 --2- 172.21.15.29:0/160445502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e00c3fd0 0x7f81e015d690 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.753+0000 7f81e7200640 1 -- 172.21.15.29:0/160445502 >> 172.21.15.29:0/160445502 conn(0x7f81e0069cd0 msgr2=0x7f81e00afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.753+0000 7f81e7200640 1 -- 172.21.15.29:0/160445502 shutdown_connections 2024-01-24T13:07:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.753+0000 7f81e7200640 1 -- 172.21.15.29:0/160445502 wait complete. 2024-01-24T13:07:00.777 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:07:00.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f4925600640 1 Processor -- start 2024-01-24T13:07:00.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f4925600640 1 -- start start 2024-01-24T13:07:00.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f4925600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f49200ce710 0x7f492015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f4925600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f492006ebb0 0x7f4920159e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f4925600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49201599e0 con 0x7f49200ae970 2024-01-24T13:07:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f4925600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49200cde00 con 0x7f492006ebb0 2024-01-24T13:07:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f4925600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49200cd280 con 0x7f49200ce710 2024-01-24T13:07:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f491f400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f492006ebb0 0x7f4920159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f491f400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f492006ebb0 0x7f4920159e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34604/0 (socket says 172.21.15.29:34604) 2024-01-24T13:07:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f491f400640 1 -- 172.21.15.29:0/1072991142 learned_addr learned my addr 172.21.15.29:0/1072991142 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f491ea00640 1 --2- 172.21.15.29:0/1072991142 >> v2:172.21.15.163:3300/0 conn(0x7f49200ce710 0x7f492015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f491f400640 1 -- 172.21.15.29:0/1072991142 >> v2:172.21.15.163:3300/0 conn(0x7f49200ce710 msgr2=0x7f492015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f491f400640 1 --2- 172.21.15.29:0/1072991142 >> v2:172.21.15.163:3300/0 conn(0x7f49200ce710 0x7f492015d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f491f400640 1 -- 172.21.15.29:0/1072991142 >> v1:172.21.15.163:6789/0 conn(0x7f49200ae970 legacy=0x7f492006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f491f400640 1 -- 172.21.15.29:0/1072991142 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49200cd560 con 0x7f492006ebb0 2024-01-24T13:07:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.917+0000 7f491ea00640 1 --2- 172.21.15.29:0/1072991142 >> v2:172.21.15.163:3300/0 conn(0x7f49200ce710 0x7f492015d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.921+0000 7f491f400640 1 --2- 172.21.15.29:0/1072991142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f492006ebb0 0x7f4920159e80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f49200709a0 tx=0x7f491801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385796a39b67f2da server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.921+0000 7f491d600640 1 -- 172.21.15.29:0/1072991142 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49180a57d0 con 0x7f492006ebb0 2024-01-24T13:07:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.921+0000 7f491d600640 1 -- 172.21.15.29:0/1072991142 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49180a5930 con 0x7f492006ebb0 2024-01-24T13:07:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.921+0000 7f491d600640 1 -- 172.21.15.29:0/1072991142 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49180a5cc0 con 0x7f492006ebb0 2024-01-24T13:07:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.921+0000 7f4925600640 1 -- 172.21.15.29:0/1072991142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f492006ebb0 msgr2=0x7f4920159e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.921+0000 7f4925600640 1 --2- 172.21.15.29:0/1072991142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f492006ebb0 0x7f4920159e80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f49200709a0 tx=0x7f491801c910 comp rx=0 tx=0).stop 2024-01-24T13:07:00.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.921+0000 7f4925600640 1 -- 172.21.15.29:0/1072991142 shutdown_connections 2024-01-24T13:07:00.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.921+0000 7f4925600640 1 --2- 172.21.15.29:0/1072991142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f492006ebb0 0x7f4920159e80 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.921+0000 7f4925600640 1 --2- 172.21.15.29:0/1072991142 >> v2:172.21.15.163:3300/0 conn(0x7f49200ce710 0x7f492015d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.921+0000 7f4925600640 1 -- 172.21.15.29:0/1072991142 >> 172.21.15.29:0/1072991142 conn(0x7f49200cbd50 msgr2=0x7f49200cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:00.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.921+0000 7f4925600640 1 -- 172.21.15.29:0/1072991142 shutdown_connections 2024-01-24T13:07:00.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.921+0000 7f4925600640 1 -- 172.21.15.29:0/1072991142 wait complete. 2024-01-24T13:07:00.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f4925600640 1 Processor -- start 2024-01-24T13:07:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f4925600640 1 -- start start 2024-01-24T13:07:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f4925600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f492006ebb0 0x7f49201f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f4925600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49200ae970 0x7f49200c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f4925600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49200ce710 0x7f4920150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f4925600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49200c3dc0 con 0x7f49200ae970 2024-01-24T13:07:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f4925600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49200c4060 con 0x7f49200ce710 2024-01-24T13:07:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f4925600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49200c4340 con 0x7f492006ebb0 2024-01-24T13:07:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f491e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49200ae970 0x7f49200c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f491e000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49200ae970 0x7f49200c3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34614/0 (socket says 172.21.15.29:34614) 2024-01-24T13:07:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f491e000640 1 -- 172.21.15.29:0/2779842754 learned_addr learned my addr 172.21.15.29:0/2779842754 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f491ea00640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f492006ebb0 0x7f49201f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f491f400640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49200ce710 0x7f4920150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f491e000640 1 -- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f492006ebb0 msgr2=0x7f49201f8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f491e000640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f492006ebb0 0x7f49201f8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f491e000640 1 -- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49200ce710 msgr2=0x7f4920150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f491e000640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49200ce710 0x7f4920150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f491e000640 1 -- 172.21.15.29:0/2779842754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4918009b30 con 0x7f49200ae970 2024-01-24T13:07:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f491f400640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49200ce710 0x7f4920150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:00.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f491e000640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49200ae970 0x7f49200c3880 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f490800c420 tx=0x7f490800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:00.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f4916a00640 1 -- 172.21.15.29:0/2779842754 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49080052d0 con 0x7f49200ae970 2024-01-24T13:07:00.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f4916a00640 1 -- 172.21.15.29:0/2779842754 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4908005430 con 0x7f49200ae970 2024-01-24T13:07:00.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f4925600640 1 -- 172.21.15.29:0/2779842754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49200c4620 con 0x7f49200ae970 2024-01-24T13:07:00.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f4916a00640 1 -- 172.21.15.29:0/2779842754 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908003820 con 0x7f49200ae970 2024-01-24T13:07:00.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.925+0000 7f4925600640 1 -- 172.21.15.29:0/2779842754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49200c4be0 con 0x7f49200ae970 2024-01-24T13:07:00.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.929+0000 7f4925600640 1 -- 172.21.15.29:0/2779842754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492004e850 con 0x7f49200ae970 2024-01-24T13:07:00.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.929+0000 7f4916a00640 1 -- 172.21.15.29:0/2779842754 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4908003980 con 0x7f49200ae970 2024-01-24T13:07:00.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.929+0000 7f4916a00640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f48f8065a60 0x7f48f8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:00.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.929+0000 7f4916a00640 1 -- 172.21.15.29:0/2779842754 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4908082850 con 0x7f49200ae970 2024-01-24T13:07:00.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.929+0000 7f491ea00640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f48f8065a60 0x7f48f8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.929+0000 7f491ea00640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f48f8065a60 0x7f48f8067f20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f49100045f0 tx=0x7f4910008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:00.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:00.933+0000 7f4916a00640 1 -- 172.21.15.29:0/2779842754 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f49080500e0 con 0x7f49200ae970 2024-01-24T13:07:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.093+0000 7f4925600640 1 -- 172.21.15.29:0/2779842754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49200661a0 con 0x7f49200ae970 2024-01-24T13:07:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.093+0000 7f4916a00640 1 -- 172.21.15.29:0/2779842754 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4908053700 con 0x7f49200ae970 2024-01-24T13:07:01.099 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:07:01.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.097+0000 7f4925600640 1 -- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f48f8065a60 msgr2=0x7f48f8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:01.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.097+0000 7f4925600640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f48f8065a60 0x7f48f8067f20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f49100045f0 tx=0x7f4910008040 comp rx=0 tx=0).stop 2024-01-24T13:07:01.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.097+0000 7f4925600640 1 -- 172.21.15.29:0/2779842754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49200ae970 msgr2=0x7f49200c3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.097+0000 7f4925600640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49200ae970 0x7f49200c3880 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f490800c420 tx=0x7f490800c8e0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.097+0000 7f4925600640 1 -- 172.21.15.29:0/2779842754 shutdown_connections 2024-01-24T13:07:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.097+0000 7f4925600640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f48f8065a60 0x7f48f8067f20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.097+0000 7f4925600640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49200ce710 0x7f4920150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.097+0000 7f4925600640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49200ae970 0x7f49200c3880 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.097+0000 7f4925600640 1 --2- 172.21.15.29:0/2779842754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f492006ebb0 0x7f49201f8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.097+0000 7f4925600640 1 -- 172.21.15.29:0/2779842754 >> 172.21.15.29:0/2779842754 conn(0x7f49200cbd50 msgr2=0x7f492006e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.097+0000 7f4925600640 1 -- 172.21.15.29:0/2779842754 shutdown_connections 2024-01-24T13:07:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.097+0000 7f4925600640 1 -- 172.21.15.29:0/2779842754 wait complete. 2024-01-24T13:07:01.121 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:07:01.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d3b000640 1 Processor -- start 2024-01-24T13:07:01.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d3b000640 1 -- start start 2024-01-24T13:07:01.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d3b000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d3406be20 0x7f4d3415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:01.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d3b000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d3406c200 0x7f4d3415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:01.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d3b000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3415b4f0 con 0x7f4d3413cda0 2024-01-24T13:07:01.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d3b000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3415b7d0 con 0x7f4d3406c200 2024-01-24T13:07:01.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d3b000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340cd0c0 con 0x7f4d3406be20 2024-01-24T13:07:01.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d33400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d3406c200 0x7f4d3415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:01.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d33400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d3406c200 0x7f4d3415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34622/0 (socket says 172.21.15.29:34622) 2024-01-24T13:07:01.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d33400640 1 -- 172.21.15.29:0/1404105310 learned_addr learned my addr 172.21.15.29:0/1404105310 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:01.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d33e00640 1 --2- 172.21.15.29:0/1404105310 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d3406be20 0x7f4d3415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:01.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d33400640 1 -- 172.21.15.29:0/1404105310 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d3406be20 msgr2=0x7f4d3415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:01.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d33400640 1 --2- 172.21.15.29:0/1404105310 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d3406be20 0x7f4d3415a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d33400640 1 -- 172.21.15.29:0/1404105310 >> v1:172.21.15.163:6789/0 conn(0x7f4d3413cda0 legacy=0x7f4d3413d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:01.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d33400640 1 -- 172.21.15.29:0/1404105310 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d340cd3a0 con 0x7f4d3406c200 2024-01-24T13:07:01.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.261+0000 7f4d33e00640 1 --2- 172.21.15.29:0/1404105310 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d3406be20 0x7f4d3415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:01.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.265+0000 7f4d33400640 1 --2- 172.21.15.29:0/1404105310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3406c200 0x7f4d3415af00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c009870 tx=0x7f4d1c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77f68033d10a4ed server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:01.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.265+0000 7f4d32a00640 1 -- 172.21.15.29:0/1404105310 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0a9620 con 0x7f4d3406c200 2024-01-24T13:07:01.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.265+0000 7f4d32a00640 1 -- 172.21.15.29:0/1404105310 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c0a9780 con 0x7f4d3406c200 2024-01-24T13:07:01.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.265+0000 7f4d32a00640 1 -- 172.21.15.29:0/1404105310 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0a9b10 con 0x7f4d3406c200 2024-01-24T13:07:01.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.265+0000 7f4d3b000640 1 -- 172.21.15.29:0/1404105310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3406c200 msgr2=0x7f4d3415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:01.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.265+0000 7f4d3b000640 1 --2- 172.21.15.29:0/1404105310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3406c200 0x7f4d3415af00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c009870 tx=0x7f4d1c01c500 comp rx=0 tx=0).stop 2024-01-24T13:07:01.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.265+0000 7f4d3b000640 1 -- 172.21.15.29:0/1404105310 shutdown_connections 2024-01-24T13:07:01.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.265+0000 7f4d3b000640 1 --2- 172.21.15.29:0/1404105310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3406c200 0x7f4d3415af00 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.265+0000 7f4d3b000640 1 --2- 172.21.15.29:0/1404105310 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d3406be20 0x7f4d3415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.265+0000 7f4d3b000640 1 -- 172.21.15.29:0/1404105310 >> 172.21.15.29:0/1404105310 conn(0x7f4d3406d700 msgr2=0x7f4d34069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:01.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.265+0000 7f4d3b000640 1 -- 172.21.15.29:0/1404105310 shutdown_connections 2024-01-24T13:07:01.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.265+0000 7f4d3b000640 1 -- 172.21.15.29:0/1404105310 wait complete. 2024-01-24T13:07:01.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d3b000640 1 Processor -- start 2024-01-24T13:07:01.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d3b000640 1 -- start start 2024-01-24T13:07:01.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d3b000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d3406be20 0x7f4d34071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:01.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d3b000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3406c200 0x7f4d34154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:01.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d3b000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d3413cda0 0x7f4d34138d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:01.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d3b000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34151ae0 con 0x7f4d3406c200 2024-01-24T13:07:01.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d3b000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34154880 con 0x7f4d3413cda0 2024-01-24T13:07:01.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d3b000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34071000 con 0x7f4d3406be20 2024-01-24T13:07:01.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d33400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3406c200 0x7f4d34154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:01.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d33400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3406c200 0x7f4d34154340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34632/0 (socket says 172.21.15.29:34632) 2024-01-24T13:07:01.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d33400640 1 -- 172.21.15.29:0/1914462447 learned_addr learned my addr 172.21.15.29:0/1914462447 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:01.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d33e00640 1 --2- 172.21.15.29:0/1914462447 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d3406be20 0x7f4d34071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:01.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d39000640 1 --2- 172.21.15.29:0/1914462447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d3413cda0 0x7f4d34138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:01.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d33400640 1 -- 172.21.15.29:0/1914462447 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d3406be20 msgr2=0x7f4d34071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:01.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d33400640 1 --2- 172.21.15.29:0/1914462447 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d3406be20 0x7f4d34071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d33400640 1 -- 172.21.15.29:0/1914462447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d3413cda0 msgr2=0x7f4d34138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:01.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d33400640 1 --2- 172.21.15.29:0/1914462447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d3413cda0 0x7f4d34138d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d33400640 1 -- 172.21.15.29:0/1914462447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c0094d0 con 0x7f4d3406c200 2024-01-24T13:07:01.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.269+0000 7f4d33400640 1 --2- 172.21.15.29:0/1914462447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3406c200 0x7f4d34154340 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c01abb0 tx=0x7f4d1c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:01.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.273+0000 7f4d2be00640 1 -- 172.21.15.29:0/1914462447 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0bc450 con 0x7f4d3406c200 2024-01-24T13:07:01.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.273+0000 7f4d2be00640 1 -- 172.21.15.29:0/1914462447 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c0bc5b0 con 0x7f4d3406c200 2024-01-24T13:07:01.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.273+0000 7f4d2be00640 1 -- 172.21.15.29:0/1914462447 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0bc960 con 0x7f4d3406c200 2024-01-24T13:07:01.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.273+0000 7f4d3b000640 1 -- 172.21.15.29:0/1914462447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d34154ab0 con 0x7f4d3406c200 2024-01-24T13:07:01.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.273+0000 7f4d3b000640 1 -- 172.21.15.29:0/1914462447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d340709b0 con 0x7f4d3406c200 2024-01-24T13:07:01.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.273+0000 7f4d3b000640 1 -- 172.21.15.29:0/1914462447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3404e850 con 0x7f4d3406c200 2024-01-24T13:07:01.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.273+0000 7f4d2be00640 1 -- 172.21.15.29:0/1914462447 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4d1c0bcac0 con 0x7f4d3406c200 2024-01-24T13:07:01.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.273+0000 7f4d2be00640 1 --2- 172.21.15.29:0/1914462447 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4d0c065a60 0x7f4d0c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:01.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.273+0000 7f4d2be00640 1 -- 172.21.15.29:0/1914462447 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4d1c11d900 con 0x7f4d3406c200 2024-01-24T13:07:01.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.273+0000 7f4d33e00640 1 --2- 172.21.15.29:0/1914462447 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4d0c065a60 0x7f4d0c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:01.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.277+0000 7f4d33e00640 1 --2- 172.21.15.29:0/1914462447 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4d0c065a60 0x7f4d0c067f20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400ab60 tx=0x7f4d24008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:01.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.277+0000 7f4d2be00640 1 -- 172.21.15.29:0/1914462447 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4d1c0eb190 con 0x7f4d3406c200 2024-01-24T13:07:01.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.433+0000 7f4d3b000640 1 -- 172.21.15.29:0/1914462447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d34071140 con 0x7f4d3406c200 2024-01-24T13:07:01.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.437+0000 7f4d2be00640 1 -- 172.21.15.29:0/1914462447 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d1c0ee7b0 con 0x7f4d3406c200 2024-01-24T13:07:01.440 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:07:01.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.437+0000 7f4d3b000640 1 -- 172.21.15.29:0/1914462447 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4d0c065a60 msgr2=0x7f4d0c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:01.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.437+0000 7f4d3b000640 1 --2- 172.21.15.29:0/1914462447 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4d0c065a60 0x7f4d0c067f20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400ab60 tx=0x7f4d24008040 comp rx=0 tx=0).stop 2024-01-24T13:07:01.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.437+0000 7f4d3b000640 1 -- 172.21.15.29:0/1914462447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3406c200 msgr2=0x7f4d34154340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:01.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.437+0000 7f4d3b000640 1 --2- 172.21.15.29:0/1914462447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3406c200 0x7f4d34154340 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c01abb0 tx=0x7f4d1c01ad40 comp rx=0 tx=0).stop 2024-01-24T13:07:01.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.437+0000 7f4d3b000640 1 -- 172.21.15.29:0/1914462447 shutdown_connections 2024-01-24T13:07:01.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.437+0000 7f4d3b000640 1 --2- 172.21.15.29:0/1914462447 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f4d0c065a60 0x7f4d0c067f20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.437+0000 7f4d3b000640 1 --2- 172.21.15.29:0/1914462447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d3413cda0 0x7f4d34138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.437+0000 7f4d3b000640 1 --2- 172.21.15.29:0/1914462447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3406c200 0x7f4d34154340 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.437+0000 7f4d3b000640 1 --2- 172.21.15.29:0/1914462447 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4d3406be20 0x7f4d34071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.437+0000 7f4d3b000640 1 -- 172.21.15.29:0/1914462447 >> 172.21.15.29:0/1914462447 conn(0x7f4d3406d700 msgr2=0x7f4d3414dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:01.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.437+0000 7f4d3b000640 1 -- 172.21.15.29:0/1914462447 shutdown_connections 2024-01-24T13:07:01.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.437+0000 7f4d3b000640 1 -- 172.21.15.29:0/1914462447 wait complete. 2024-01-24T13:07:01.462 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:07:01.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f34800640 1 Processor -- start 2024-01-24T13:07:01.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f34800640 1 -- start start 2024-01-24T13:07:01.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f34800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f2c0d0150 0x7f7f2c0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:01.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f34800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f2c0ce5c0 0x7f7f2c06b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:01.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f34800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c0cd970 con 0x7f7f2c0cd590 2024-01-24T13:07:01.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f34800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c0cea10 con 0x7f7f2c0d0150 2024-01-24T13:07:01.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f34800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0d0810 con 0x7f7f2c0ce5c0 2024-01-24T13:07:01.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f31400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f2c0d0150 0x7f7f2c0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:01.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f31400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f2c0d0150 0x7f7f2c0ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34638/0 (socket says 172.21.15.29:34638) 2024-01-24T13:07:01.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f31400640 1 -- 172.21.15.29:0/3773224421 learned_addr learned my addr 172.21.15.29:0/3773224421 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:01.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f32800640 1 --2- 172.21.15.29:0/3773224421 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f2c0ce5c0 0x7f7f2c06b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:01.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f31400640 1 -- 172.21.15.29:0/3773224421 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f2c0ce5c0 msgr2=0x7f7f2c06b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:01.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f31400640 1 --2- 172.21.15.29:0/3773224421 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f2c0ce5c0 0x7f7f2c06b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f31400640 1 -- 172.21.15.29:0/3773224421 >> v1:172.21.15.163:6789/0 conn(0x7f7f2c0cd590 legacy=0x7f7f2c15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:01.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.601+0000 7f7f31400640 1 -- 172.21.15.29:0/3773224421 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c0d05e0 con 0x7f7f2c0d0150 2024-01-24T13:07:01.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.605+0000 7f7f31400640 1 --2- 172.21.15.29:0/3773224421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f2c0d0150 0x7f7f2c0ce080 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009870 tx=0x7f7f1401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ae0e575fa8adc6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:01.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.605+0000 7f7f30a00640 1 -- 172.21.15.29:0/3773224421 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f140aa670 con 0x7f7f2c0d0150 2024-01-24T13:07:01.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.605+0000 7f7f30a00640 1 -- 172.21.15.29:0/3773224421 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f140aa7d0 con 0x7f7f2c0d0150 2024-01-24T13:07:01.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.605+0000 7f7f30a00640 1 -- 172.21.15.29:0/3773224421 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f140aab60 con 0x7f7f2c0d0150 2024-01-24T13:07:01.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.605+0000 7f7f34800640 1 -- 172.21.15.29:0/3773224421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f2c0d0150 msgr2=0x7f7f2c0ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:01.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.605+0000 7f7f34800640 1 --2- 172.21.15.29:0/3773224421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f2c0d0150 0x7f7f2c0ce080 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009870 tx=0x7f7f1401c510 comp rx=0 tx=0).stop 2024-01-24T13:07:01.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.605+0000 7f7f34800640 1 -- 172.21.15.29:0/3773224421 shutdown_connections 2024-01-24T13:07:01.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.605+0000 7f7f34800640 1 --2- 172.21.15.29:0/3773224421 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f2c0ce5c0 0x7f7f2c06b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.605+0000 7f7f34800640 1 --2- 172.21.15.29:0/3773224421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f2c0d0150 0x7f7f2c0ce080 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.605+0000 7f7f34800640 1 -- 172.21.15.29:0/3773224421 >> 172.21.15.29:0/3773224421 conn(0x7f7f2c069cd0 msgr2=0x7f7f2c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:01.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.605+0000 7f7f34800640 1 -- 172.21.15.29:0/3773224421 shutdown_connections 2024-01-24T13:07:01.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.605+0000 7f7f34800640 1 -- 172.21.15.29:0/3773224421 wait complete. 2024-01-24T13:07:01.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f34800640 1 Processor -- start 2024-01-24T13:07:01.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f34800640 1 -- start start 2024-01-24T13:07:01.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f34800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f2c0cd590 0x7f7f2c159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:01.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f34800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f2c0ce5c0 0x7f7f2c14f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:01.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f34800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f2c0d0150 0x7f7f2c14f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:01.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f34800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c14fa90 con 0x7f7f2c0cd590 2024-01-24T13:07:01.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f34800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c15a280 con 0x7f7f2c0ce5c0 2024-01-24T13:07:01.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f34800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c1599e0 con 0x7f7f2c0d0150 2024-01-24T13:07:01.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f31e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f2c0cd590 0x7f7f2c159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:01.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f31e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f2c0cd590 0x7f7f2c159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34652/0 (socket says 172.21.15.29:34652) 2024-01-24T13:07:01.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f31e00640 1 -- 172.21.15.29:0/545863605 learned_addr learned my addr 172.21.15.29:0/545863605 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:01.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f31400640 1 --2- 172.21.15.29:0/545863605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f2c0ce5c0 0x7f7f2c14f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:01.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f32800640 1 --2- 172.21.15.29:0/545863605 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f2c0d0150 0x7f7f2c14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:01.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f31e00640 1 -- 172.21.15.29:0/545863605 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f2c0d0150 msgr2=0x7f7f2c14f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:01.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f31e00640 1 --2- 172.21.15.29:0/545863605 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f2c0d0150 0x7f7f2c14f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f31e00640 1 -- 172.21.15.29:0/545863605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f2c0ce5c0 msgr2=0x7f7f2c14f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f31e00640 1 --2- 172.21.15.29:0/545863605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f2c0ce5c0 0x7f7f2c14f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f31e00640 1 -- 172.21.15.29:0/545863605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f140094d0 con 0x7f7f2c0cd590 2024-01-24T13:07:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f31e00640 1 --2- 172.21.15.29:0/545863605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f2c0cd590 0x7f7f2c159370 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00c450 tx=0x7f7f1c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f2a000640 1 -- 172.21.15.29:0/545863605 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0052d0 con 0x7f7f2c0cd590 2024-01-24T13:07:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f2a000640 1 -- 172.21.15.29:0/545863605 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c005450 con 0x7f7f2c0cd590 2024-01-24T13:07:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f2a000640 1 -- 172.21.15.29:0/545863605 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c012870 con 0x7f7f2c0cd590 2024-01-24T13:07:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f34800640 1 -- 172.21.15.29:0/545863605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c159cc0 con 0x7f7f2c0cd590 2024-01-24T13:07:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.609+0000 7f7f34800640 1 -- 172.21.15.29:0/545863605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c15e380 con 0x7f7f2c0cd590 2024-01-24T13:07:01.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.613+0000 7f7f34800640 1 -- 172.21.15.29:0/545863605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c04e850 con 0x7f7f2c0cd590 2024-01-24T13:07:01.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.613+0000 7f7f2a000640 1 -- 172.21.15.29:0/545863605 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7f1c0129d0 con 0x7f7f2c0cd590 2024-01-24T13:07:01.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.613+0000 7f7f2a000640 1 --2- 172.21.15.29:0/545863605 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f04065a60 0x7f7f04067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:01.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.613+0000 7f7f2a000640 1 -- 172.21.15.29:0/545863605 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7f1c082c20 con 0x7f7f2c0cd590 2024-01-24T13:07:01.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.613+0000 7f7f31400640 1 --2- 172.21.15.29:0/545863605 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f04065a60 0x7f7f04067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:01.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.613+0000 7f7f31400640 1 --2- 172.21.15.29:0/545863605 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f04065a60 0x7f7f04067f20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7f140ae000 tx=0x7f7f140a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:01.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.617+0000 7f7f2a000640 1 -- 172.21.15.29:0/545863605 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7f1c0505e0 con 0x7f7f2c0cd590 2024-01-24T13:07:01.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.801+0000 7f7f34800640 1 -- 172.21.15.29:0/545863605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7f2c0b6430 con 0x7f7f2c0cd590 2024-01-24T13:07:01.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.801+0000 7f7f2a000640 1 -- 172.21.15.29:0/545863605 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7f1c053c00 con 0x7f7f2c0cd590 2024-01-24T13:07:01.806 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:07:01.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.801+0000 7f7f34800640 1 -- 172.21.15.29:0/545863605 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f04065a60 msgr2=0x7f7f04067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:01.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.801+0000 7f7f34800640 1 --2- 172.21.15.29:0/545863605 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f04065a60 0x7f7f04067f20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7f140ae000 tx=0x7f7f140a7000 comp rx=0 tx=0).stop 2024-01-24T13:07:01.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.801+0000 7f7f34800640 1 -- 172.21.15.29:0/545863605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f2c0cd590 msgr2=0x7f7f2c159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:01.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.801+0000 7f7f34800640 1 --2- 172.21.15.29:0/545863605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f2c0cd590 0x7f7f2c159370 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00c450 tx=0x7f7f1c00c910 comp rx=0 tx=0).stop 2024-01-24T13:07:01.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.805+0000 7f7f34800640 1 -- 172.21.15.29:0/545863605 shutdown_connections 2024-01-24T13:07:01.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.805+0000 7f7f34800640 1 --2- 172.21.15.29:0/545863605 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7f04065a60 0x7f7f04067f20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.805+0000 7f7f34800640 1 --2- 172.21.15.29:0/545863605 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7f2c0d0150 0x7f7f2c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.805+0000 7f7f34800640 1 --2- 172.21.15.29:0/545863605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f2c0ce5c0 0x7f7f2c14f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.805+0000 7f7f34800640 1 --2- 172.21.15.29:0/545863605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f2c0cd590 0x7f7f2c159370 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:01.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.805+0000 7f7f34800640 1 -- 172.21.15.29:0/545863605 >> 172.21.15.29:0/545863605 conn(0x7f7f2c069cd0 msgr2=0x7f7f2c06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:01.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.805+0000 7f7f34800640 1 -- 172.21.15.29:0/545863605 shutdown_connections 2024-01-24T13:07:01.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:01.805+0000 7f7f34800640 1 -- 172.21.15.29:0/545863605 wait complete. 2024-01-24T13:07:01.829 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-01-24T13:07:01.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:01.829 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-24T13:07:01.847 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[40234]: fuse finished with error 0 and tester_r 0 2024-01-24T13:07:01.849 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:01.912 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:07:01.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:01.913 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-24T13:07:01.922 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-24T13:07:02.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02b1400640 1 Processor -- start 2024-01-24T13:07:02.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02b1400640 1 -- start start 2024-01-24T13:07:02.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02b1400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f02ac15d130 0x7f02ac15d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:02.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02b1400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02ac06ade0 0x7f02ac06b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:02.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02b1400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02ac0d0bf0 con 0x7f02ac0ccdb0 2024-01-24T13:07:02.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02b1400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02ac0cec60 con 0x7f02ac15d130 2024-01-24T13:07:02.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02b1400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac15de60 con 0x7f02ac06ade0 2024-01-24T13:07:02.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02aa800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f02ac0ccdb0 0x7f02ac0cd190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49510/0 (socket says 172.21.15.29:49510) 2024-01-24T13:07:02.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02aa800640 1 -- 172.21.15.29:0/437988742 learned_addr learned my addr 172.21.15.29:0/437988742 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02ab200640 1 --2- 172.21.15.29:0/437988742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02ac06ade0 0x7f02ac06b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9e00640 1 --2- 172.21.15.29:0/437988742 >> v2:172.21.15.163:3300/0 conn(0x7f02ac15d130 0x7f02ac15d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 -- 172.21.15.29:0/437988742 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641562851 0 0) 0x7f02ac0d0bf0 con 0x7f02ac0ccdb0 2024-01-24T13:07:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 -- 172.21.15.29:0/437988742 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f028c003530 con 0x7f02ac0ccdb0 2024-01-24T13:07:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 -- 172.21.15.29:0/437988742 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 670678278 0 0) 0x7f028c003530 con 0x7f02ac0ccdb0 2024-01-24T13:07:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 -- 172.21.15.29:0/437988742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02ac06ade0 msgr2=0x7f02ac06b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 --2- 172.21.15.29:0/437988742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02ac06ade0 0x7f02ac06b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 -- 172.21.15.29:0/437988742 >> v2:172.21.15.163:3300/0 conn(0x7f02ac15d130 msgr2=0x7f02ac15d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 --2- 172.21.15.29:0/437988742 >> v2:172.21.15.163:3300/0 conn(0x7f02ac15d130 0x7f02ac15d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 -- 172.21.15.29:0/437988742 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac0d0040 con 0x7f02ac0ccdb0 2024-01-24T13:07:02.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 -- 172.21.15.29:0/437988742 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f029c001680 con 0x7f02ac0ccdb0 2024-01-24T13:07:02.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 -- 172.21.15.29:0/437988742 >> v1:172.21.15.29:6789/0 conn(0x7f02ac0ccdb0 legacy=0x7f02ac0cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:02.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 --2- 172.21.15.29:0/437988742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02ac06ade0 0x7f028c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:02.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 --2- 172.21.15.29:0/437988742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f028c003f50 0x7f028c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:02.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 --2- 172.21.15.29:0/437988742 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f028c004d10 0x7f028c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:02.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 -- 172.21.15.29:0/437988742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac0cec60 con 0x7f028c003f50 2024-01-24T13:07:02.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 -- 172.21.15.29:0/437988742 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac15de60 con 0x7f028c004d10 2024-01-24T13:07:02.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9400640 1 -- 172.21.15.29:0/437988742 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028c00bac0 con 0x7f02ac06ade0 2024-01-24T13:07:02.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02a9e00640 1 --2- 172.21.15.29:0/437988742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f028c003f50 0x7f028c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:02.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.101+0000 7f02aa800640 1 --2- 172.21.15.29:0/437988742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02ac06ade0 0x7f028c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:02.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.105+0000 7f02ab200640 1 --2- 172.21.15.29:0/437988742 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f028c004d10 0x7f028c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:02.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.105+0000 7f02a9e00640 1 -- 172.21.15.29:0/437988742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02ac06ade0 msgr2=0x7f028c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:02.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.105+0000 7f02a9e00640 1 --2- 172.21.15.29:0/437988742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f02ac06ade0 0x7f028c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:02.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.105+0000 7f02a9e00640 1 -- 172.21.15.29:0/437988742 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f028c004d10 msgr2=0x7f028c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:02.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.105+0000 7f02a9e00640 1 --2- 172.21.15.29:0/437988742 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f028c004d10 0x7f028c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:02.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.105+0000 7f02a9e00640 1 -- 172.21.15.29:0/437988742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028c003530 con 0x7f028c003f50 2024-01-24T13:07:02.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.105+0000 7f02ab200640 1 --2- 172.21.15.29:0/437988742 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f028c004d10 0x7f028c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:02.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.105+0000 7f02a9e00640 1 --2- 172.21.15.29:0/437988742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f028c003f50 0x7f028c0047d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0294009ae0 tx=0x7f029401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df75030278609bec server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:02.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.105+0000 7f02a9400640 1 -- 172.21.15.29:0/437988742 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940a5630 con 0x7f028c003f50 2024-01-24T13:07:02.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.105+0000 7f02a9400640 1 -- 172.21.15.29:0/437988742 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02940a5790 con 0x7f028c003f50 2024-01-24T13:07:02.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.105+0000 7f02a9400640 1 -- 172.21.15.29:0/437988742 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940a5b40 con 0x7f028c003f50 2024-01-24T13:07:02.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02b1400640 1 -- 172.21.15.29:0/437988742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f028c003f50 msgr2=0x7f028c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:02.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02b1400640 1 --2- 172.21.15.29:0/437988742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f028c003f50 0x7f028c0047d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0294009ae0 tx=0x7f029401ca60 comp rx=0 tx=0).stop 2024-01-24T13:07:02.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02ab200640 1 -- 172.21.15.29:0/437988742 reap_dead start 2024-01-24T13:07:02.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02b1400640 1 -- 172.21.15.29:0/437988742 shutdown_connections 2024-01-24T13:07:02.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02b1400640 1 -- 172.21.15.29:0/437988742 >> 172.21.15.29:0/437988742 conn(0x7f02ac070570 msgr2=0x7f02ac069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:02.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02b1400640 1 -- 172.21.15.29:0/437988742 shutdown_connections 2024-01-24T13:07:02.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02b1400640 1 -- 172.21.15.29:0/437988742 wait complete. 2024-01-24T13:07:02.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02b1400640 1 Processor -- start 2024-01-24T13:07:02.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02b1400640 1 -- start start 2024-01-24T13:07:02.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02b1400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f028c003f50 0x7f02ac0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:02.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02b1400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02ac0c6370 0x7f02ac1f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:02.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02b1400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02ac1f8730 0x7f02ac0c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:02.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02b1400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac0c75a0 con 0x7f02ac0c6370 2024-01-24T13:07:02.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02b1400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac1f8bb0 con 0x7f02ac1f8730 2024-01-24T13:07:02.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02b1400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac0c6860 con 0x7f028c003f50 2024-01-24T13:07:02.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02a9e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02ac0c6370 0x7f02ac1f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:02.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02a9e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02ac0c6370 0x7f02ac1f81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34670/0 (socket says 172.21.15.29:34670) 2024-01-24T13:07:02.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.109+0000 7f02a9e00640 1 -- 172.21.15.29:0/2587822460 learned_addr learned my addr 172.21.15.29:0/2587822460 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02ab200640 1 --2- 172.21.15.29:0/2587822460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02ac1f8730 0x7f02ac0c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02aa800640 1 --2- 172.21.15.29:0/2587822460 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f028c003f50 0x7f02ac0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02a9e00640 1 -- 172.21.15.29:0/2587822460 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f028c003f50 msgr2=0x7f02ac0c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:02.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02a9e00640 1 --2- 172.21.15.29:0/2587822460 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f028c003f50 0x7f02ac0c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02a9e00640 1 -- 172.21.15.29:0/2587822460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02ac1f8730 msgr2=0x7f02ac0c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02a9e00640 1 --2- 172.21.15.29:0/2587822460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02ac1f8730 0x7f02ac0c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02a9e00640 1 -- 172.21.15.29:0/2587822460 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac0c6b40 con 0x7f02ac0c6370 2024-01-24T13:07:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02a9e00640 1 --2- 172.21.15.29:0/2587822460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02ac0c6370 0x7f02ac1f81f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0294009ae0 tx=0x7f028c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02a2a00640 1 -- 172.21.15.29:0/2587822460 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294004020 con 0x7f02ac0c6370 2024-01-24T13:07:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02a2a00640 1 -- 172.21.15.29:0/2587822460 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0294004180 con 0x7f02ac0c6370 2024-01-24T13:07:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02b1400640 1 -- 172.21.15.29:0/2587822460 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ac0c6e20 con 0x7f02ac0c6370 2024-01-24T13:07:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02a2a00640 1 -- 172.21.15.29:0/2587822460 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940044f0 con 0x7f02ac0c6370 2024-01-24T13:07:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02b1400640 1 -- 172.21.15.29:0/2587822460 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ac152d60 con 0x7f02ac0c6370 2024-01-24T13:07:02.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02b1400640 1 -- 172.21.15.29:0/2587822460 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ac04e850 con 0x7f02ac0c6370 2024-01-24T13:07:02.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.113+0000 7f02a2a00640 1 -- 172.21.15.29:0/2587822460 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f02940b4040 con 0x7f02ac0c6370 2024-01-24T13:07:02.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.117+0000 7f02a2a00640 1 --2- 172.21.15.29:0/2587822460 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0284065a90 0x7f0284067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:02.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.117+0000 7f02a2a00640 1 -- 172.21.15.29:0/2587822460 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f029411d510 con 0x7f02ac0c6370 2024-01-24T13:07:02.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.117+0000 7f02aa800640 1 --2- 172.21.15.29:0/2587822460 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0284065a90 0x7f0284067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:02.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.117+0000 7f02aa800640 1 --2- 172.21.15.29:0/2587822460 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0284065a90 0x7f0284067f50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f029c001130 tx=0x7f029c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:02.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.117+0000 7f02a2a00640 1 -- 172.21.15.29:0/2587822460 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f02940ee8c0 con 0x7f02ac0c6370 2024-01-24T13:07:02.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.309+0000 7f02b1400640 1 -- 172.21.15.29:0/2587822460 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f02ac0b29c0 con 0x7f02ac0c6370 2024-01-24T13:07:02.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.313+0000 7f02a2a00640 1 -- 172.21.15.29:0/2587822460 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f02940ee450 con 0x7f02ac0c6370 2024-01-24T13:07:02.316 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-24T13:07:02.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.313+0000 7f02b1400640 1 -- 172.21.15.29:0/2587822460 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0284065a90 msgr2=0x7f0284067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:02.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.313+0000 7f02b1400640 1 --2- 172.21.15.29:0/2587822460 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0284065a90 0x7f0284067f50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f029c001130 tx=0x7f029c009040 comp rx=0 tx=0).stop 2024-01-24T13:07:02.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.313+0000 7f02b1400640 1 -- 172.21.15.29:0/2587822460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02ac0c6370 msgr2=0x7f02ac1f81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:02.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.313+0000 7f02b1400640 1 --2- 172.21.15.29:0/2587822460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02ac0c6370 0x7f02ac1f81f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0294009ae0 tx=0x7f028c005800 comp rx=0 tx=0).stop 2024-01-24T13:07:02.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.313+0000 7f02b1400640 1 -- 172.21.15.29:0/2587822460 shutdown_connections 2024-01-24T13:07:02.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.313+0000 7f02b1400640 1 --2- 172.21.15.29:0/2587822460 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0284065a90 0x7f0284067f50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:02.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.313+0000 7f02b1400640 1 --2- 172.21.15.29:0/2587822460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02ac1f8730 0x7f02ac0c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:02.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.313+0000 7f02b1400640 1 --2- 172.21.15.29:0/2587822460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02ac0c6370 0x7f02ac1f81f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:02.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.313+0000 7f02b1400640 1 --2- 172.21.15.29:0/2587822460 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f028c003f50 0x7f02ac0c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:02.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.313+0000 7f02b1400640 1 -- 172.21.15.29:0/2587822460 >> 172.21.15.29:0/2587822460 conn(0x7f02ac070570 msgr2=0x7f02ac0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:02.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.313+0000 7f02b1400640 1 -- 172.21.15.29:0/2587822460 shutdown_connections 2024-01-24T13:07:02.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:02.313+0000 7f02b1400640 1 -- 172.21.15.29:0/2587822460 wait complete. 2024-01-24T13:07:02.338 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-24T13:07:02.338 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-24T13:07:02.338 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-01-24T13:07:02.339 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-24T13:07:02.339 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-24T13:07:02.339 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-24T13:07:02.339 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-24T13:07:02.339 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-24T13:07:02.339 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:07:02.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:02.339 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-01-24T13:07:02.353 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T13:07:02.353 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T13:07:02.353 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T13:07:02.353 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:07:02.353 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-24T13:07:02.353 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:07:02.353 INFO:teuthology.orchestra.run.smithi029.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-24T13:07:02.353 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-01-24T13:07:02.353 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-01-24T13:07:02.353 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-24T13:07:02.353 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42276sec preferred_lft 42276sec 2024-01-24T13:07:02.353 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:b4:3c:c7:07 brd ff:ff:ff:ff:ff:ff 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:07:02.354 INFO:teuthology.orchestra.run.smithi029.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-24T13:07:02.355 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-24T13:07:02.355 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-24T13:07:02.355 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:07:02.355 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-24T13:07:02.355 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:07:02.355 INFO:teuthology.orchestra.run.smithi029.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T13:07:02.355 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-24T13:07:02.355 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-24T13:07:02.355 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:07:02.355 INFO:teuthology.orchestra.run.smithi029.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T13:07:02.355 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-24T13:07:02.355 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-01-24T13:07:02.355 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-24T13:07:02.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:02.356 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-24T13:07:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-01-24T13:07:02.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:02.415 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-01-24T13:07:02.469 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-01-24T13:07:02.469 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-24T13:07:02.469 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-24T13:07:02.469 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-24T13:07:02.469 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-24T13:07:02.469 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-24T13:07:02.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:02.470 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-24T13:07:02.470 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-24T13:07:02.470 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-24T13:07:02.470 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-24T13:07:02.470 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-24T13:07:02.470 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-24T13:07:02.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:02.562 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-24T13:07:02.571 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-24T13:07:02.571 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-24T13:07:02.572 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:07:02.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:02.572 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-01-24T13:07:02.635 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-24T13:07:02.636 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:07:02.636 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-24T13:07:02.688 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-24T13:07:02.688 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T13:07:02.688 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-24T13:07:02.739 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:07:02.804 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:07:02.804 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:07:02.866 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:07:02.867 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:07:02.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:02.868 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:07:02.919 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-24T13:07:02.920 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-24T13:07:02.967 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-24T13:07:02.988 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-01-24T13:07:02.988 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-01-24T13:07:03.050 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-01-24T13:07:03.051 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-24T13:07:03.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:03.052 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-24T13:07:03.063 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2024-01-24T13:07:03.057+0000 7f7a41633580 -1 init, newargv = 0x55e6dc6eed40 newargc=15 2024-01-24T13:07:03.063 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[40632]: starting ceph client 2024-01-24T13:07:03.069 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[40632]: starting fuse 2024-01-24T13:07:03.071 INFO:teuthology.orchestra.run.smithi029.stdout:43 2024-01-24T13:07:03.072 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-24T13:07:03.072 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-01-24T13:07:03.072 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-01-24T13:07:03.072 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-01-24T13:07:03.072 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-01-24T13:07:03.072 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-01-24T13:07:03.072 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:07:03.072 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-01-24T13:07:03.072 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-24T13:07:03.072 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-01-24T13:07:03.073 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-24T13:07:03.074 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:07:03.074 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2024-01-24T13:07:03.074 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-01-24T13:07:03.196 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.40632.asok 2024-01-24T13:07:03.380 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40632.asok 2024-01-24T13:07:03.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:03.381 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40632.asok status 2024-01-24T13:07:03.559 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:07:03.559 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-01-24T13:07:03.559 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "4e3182a65800aed6d4aa2f6b86da3cfd72188134", 2024-01-24T13:07:03.559 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable)", 2024-01-24T13:07:03.559 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2024-01-24T13:07:03.559 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-01-24T13:07:03.559 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-24T13:07:03.559 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "40632", 2024-01-24T13:07:03.559 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-01-24T13:07:03.559 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:07:03.559 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-01-24T13:07:03.559 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-01-24T13:07:03.560 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 6525, 2024-01-24T13:07:03.560 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-01-24T13:07:03.560 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-01-24T13:07:03.560 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-01-24T13:07:03.560 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 6525 2024-01-24T13:07:03.560 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:07:03.560 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:07:03.560 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:07:03.560 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:07:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 903279838 2024-01-24T13:07:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-24T13:07:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:07:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-24T13:07:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-24T13:07:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-24T13:07:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 903279838 2024-01-24T13:07:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-24T13:07:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.6525 192.168.0.1:0/903279838", 2024-01-24T13:07:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/903279838", 2024-01-24T13:07:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-01-24T13:07:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 26, 2024-01-24T13:07:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 59, 2024-01-24T13:07:03.561 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-01-24T13:07:03.562 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-01-24T13:07:03.562 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-01-24T13:07:03.562 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:07:03.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:03.574 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-01-24T13:07:03.574 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-24T13:07:03.584 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-01-24T13:07:03.584 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-24T13:07:03.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:03.584 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-24T13:07:03.647 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2024-01-24T13:07:03.647 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-01-24T13:07:03.647 DEBUG:teuthology.orchestra.run.smithi029:> import errno 2024-01-24T13:07:03.647 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-24T13:07:03.647 DEBUG:teuthology.orchestra.run.smithi029:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-01-24T13:07:03.647 DEBUG:teuthology.orchestra.run.smithi029:> try: 2024-01-24T13:07:03.648 DEBUG:teuthology.orchestra.run.smithi029:> if True: 2024-01-24T13:07:03.648 DEBUG:teuthology.orchestra.run.smithi029:> ret = os.read(fd, 1024) 2024-01-24T13:07:03.648 DEBUG:teuthology.orchestra.run.smithi029:> else: 2024-01-24T13:07:03.648 DEBUG:teuthology.orchestra.run.smithi029:> os.write(fd, b'"'"'content'"'"') 2024-01-24T13:07:03.648 DEBUG:teuthology.orchestra.run.smithi029:> except OSError as e: 2024-01-24T13:07:03.648 DEBUG:teuthology.orchestra.run.smithi029:> if e.errno != errno.EPERM: 2024-01-24T13:07:03.648 DEBUG:teuthology.orchestra.run.smithi029:> raise 2024-01-24T13:07:03.648 DEBUG:teuthology.orchestra.run.smithi029:> else: 2024-01-24T13:07:03.648 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("client does not check permission of data pool") 2024-01-24T13:07:03.648 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-01-24T13:07:03.754 INFO:teuthology.orchestra.run.smithi029.stderr:Traceback (most recent call last): 2024-01-24T13:07:03.754 INFO:teuthology.orchestra.run.smithi029.stderr: File "", line 15, in 2024-01-24T13:07:03.754 INFO:teuthology.orchestra.run.smithi029.stderr:RuntimeError: client does not check permission of data pool 2024-01-24T13:07:03.934 INFO:teuthology.orchestra.run.smithi029.stderr:daemon-helper: command failed with exit status 1 2024-01-24T13:07:03.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:07:03.942 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-01-24T13:07:04.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2fe200640 1 Processor -- start 2024-01-24T13:07:04.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2fe200640 1 -- start start 2024-01-24T13:07:04.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2fe200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2f80cce10 0x7ff2f80cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2fe200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f815a710 con 0x7ff2f815cc50 2024-01-24T13:07:04.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2fe200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f80cd7e0 con 0x7ff2f815a330 2024-01-24T13:07:04.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2fe200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f815d0d0 con 0x7ff2f80cce10 2024-01-24T13:07:04.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff2f815cc50 0x7ff2f80d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49516/0 (socket says 172.21.15.29:49516) 2024-01-24T13:07:04.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6a00640 1 -- 172.21.15.29:0/2064128829 learned_addr learned my addr 172.21.15.29:0/2064128829 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:04.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f7e00640 1 --2- 172.21.15.29:0/2064128829 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2f80cce10 0x7ff2f80cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853789579 0 0) 0x7ff2f815a710 con 0x7ff2f815cc50 2024-01-24T13:07:04.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d8003530 con 0x7ff2f815cc50 2024-01-24T13:07:04.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550876733 0 0) 0x7ff2f80cd7e0 con 0x7ff2f815a330 2024-01-24T13:07:04.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2f815a710 con 0x7ff2f815a330 2024-01-24T13:07:04.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1479690210 0 0) 0x7ff2d8003530 con 0x7ff2f815cc50 2024-01-24T13:07:04.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2f80cce10 msgr2=0x7ff2f80cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:04.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 --2- 172.21.15.29:0/2064128829 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2f80cce10 0x7ff2f80cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 >> v1:172.21.15.163:6789/0 conn(0x7ff2f815a330 legacy=0x7ff2f80b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:04.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f815d2b0 con 0x7ff2f815cc50 2024-01-24T13:07:04.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7ff2e0001680 con 0x7ff2f815cc50 2024-01-24T13:07:04.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f7e00640 1 --2- 172.21.15.29:0/2064128829 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2f80cce10 0x7ff2f80cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:07:04.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 >> v1:172.21.15.29:6789/0 conn(0x7ff2f815cc50 legacy=0x7ff2f80d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:04.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 --2- 172.21.15.29:0/2064128829 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2f80cce10 0x7ff2d8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 --2- 172.21.15.29:0/2064128829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d8004080 0x7ff2d80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 --2- 172.21.15.29:0/2064128829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2d8004d10 0x7ff2d8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f815d0d0 con 0x7ff2d8004d10 2024-01-24T13:07:04.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d800ba40 con 0x7ff2d8004080 2024-01-24T13:07:04.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d800bc00 con 0x7ff2f80cce10 2024-01-24T13:07:04.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.129+0000 7ff2f7e00640 1 --2- 172.21.15.29:0/2064128829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2d8004d10 0x7ff2d8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.133+0000 7ff2f7400640 1 --2- 172.21.15.29:0/2064128829 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2f80cce10 0x7ff2d8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.133+0000 7ff2f6a00640 1 --2- 172.21.15.29:0/2064128829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d8004080 0x7ff2d80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.133+0000 7ff2f7e00640 1 -- 172.21.15.29:0/2064128829 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2f80cce10 msgr2=0x7ff2d8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:04.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.133+0000 7ff2f7e00640 1 --2- 172.21.15.29:0/2064128829 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2f80cce10 0x7ff2d8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.133+0000 7ff2f7e00640 1 -- 172.21.15.29:0/2064128829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d8004080 msgr2=0x7ff2d80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:04.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.133+0000 7ff2f7e00640 1 --2- 172.21.15.29:0/2064128829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d8004080 0x7ff2d80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.133+0000 7ff2f7e00640 1 -- 172.21.15.29:0/2064128829 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f0009a70 con 0x7ff2d8004d10 2024-01-24T13:07:04.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.133+0000 7ff2f6a00640 1 --2- 172.21.15.29:0/2064128829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d8004080 0x7ff2d80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:04.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.133+0000 7ff2f7e00640 1 --2- 172.21.15.29:0/2064128829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2d8004d10 0x7ff2d8005190 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000e350 tx=0x7ff2f001cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d78d391d935588 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:04.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.133+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f00a5ce0 con 0x7ff2d8004d10 2024-01-24T13:07:04.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.133+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f000f040 con 0x7ff2d8004d10 2024-01-24T13:07:04.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.133+0000 7ff2f6000640 1 -- 172.21.15.29:0/2064128829 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0003ba0 con 0x7ff2d8004d10 2024-01-24T13:07:04.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2fe200640 1 -- 172.21.15.29:0/2064128829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2d8004d10 msgr2=0x7ff2d8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:04.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2fe200640 1 --2- 172.21.15.29:0/2064128829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2d8004d10 0x7ff2d8005190 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000e350 tx=0x7ff2f001cde0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2f7e00640 1 -- 172.21.15.29:0/2064128829 reap_dead start 2024-01-24T13:07:04.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2fe200640 1 -- 172.21.15.29:0/2064128829 shutdown_connections 2024-01-24T13:07:04.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2fe200640 1 -- 172.21.15.29:0/2064128829 >> 172.21.15.29:0/2064128829 conn(0x7ff2f8069cd0 msgr2=0x7ff2f806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:04.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2fe200640 1 -- 172.21.15.29:0/2064128829 shutdown_connections 2024-01-24T13:07:04.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2fe200640 1 -- 172.21.15.29:0/2064128829 wait complete. 2024-01-24T13:07:04.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2fe200640 1 Processor -- start 2024-01-24T13:07:04.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2fe200640 1 -- start start 2024-01-24T13:07:04.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2fe200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d8004d10 0x7ff2f815b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2fe200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f81f1a60 0x7ff2f80c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2fe200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2f8156d00 0x7ff2f81571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2fe200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f81576f0 con 0x7ff2f81f1a60 2024-01-24T13:07:04.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2fe200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80c4da0 con 0x7ff2d8004d10 2024-01-24T13:07:04.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2fe200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80c9190 con 0x7ff2f8156d00 2024-01-24T13:07:04.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2f6a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f81f1a60 0x7ff2f80c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2f6a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f81f1a60 0x7ff2f80c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34700/0 (socket says 172.21.15.29:34700) 2024-01-24T13:07:04.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2f6a00640 1 -- 172.21.15.29:0/2861625949 learned_addr learned my addr 172.21.15.29:0/2861625949 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:04.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2f7400640 1 --2- 172.21.15.29:0/2861625949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d8004d10 0x7ff2f815b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.137+0000 7ff2f7e00640 1 --2- 172.21.15.29:0/2861625949 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2f8156d00 0x7ff2f81571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2f6a00640 1 -- 172.21.15.29:0/2861625949 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2f8156d00 msgr2=0x7ff2f81571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:04.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2f6a00640 1 --2- 172.21.15.29:0/2861625949 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2f8156d00 0x7ff2f81571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2f6a00640 1 -- 172.21.15.29:0/2861625949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d8004d10 msgr2=0x7ff2f815b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:04.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2f6a00640 1 --2- 172.21.15.29:0/2861625949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d8004d10 0x7ff2f815b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2f6a00640 1 -- 172.21.15.29:0/2861625949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f80c9430 con 0x7ff2f81f1a60 2024-01-24T13:07:04.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2f6a00640 1 --2- 172.21.15.29:0/2861625949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f81f1a60 0x7ff2f80c8c50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0011840 tx=0x7ff2e0011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:04.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2ef400640 1 -- 172.21.15.29:0/2861625949 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000fb60 con 0x7ff2f81f1a60 2024-01-24T13:07:04.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2ef400640 1 -- 172.21.15.29:0/2861625949 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e000fcc0 con 0x7ff2f81f1a60 2024-01-24T13:07:04.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2ef400640 1 -- 172.21.15.29:0/2861625949 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0015630 con 0x7ff2f81f1a60 2024-01-24T13:07:04.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2fe200640 1 -- 172.21.15.29:0/2861625949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f80c9710 con 0x7ff2f81f1a60 2024-01-24T13:07:04.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2fe200640 1 -- 172.21.15.29:0/2861625949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f80c9cd0 con 0x7ff2f81f1a60 2024-01-24T13:07:04.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2fe200640 1 -- 172.21.15.29:0/2861625949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f804e850 con 0x7ff2f81f1a60 2024-01-24T13:07:04.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2ef400640 1 -- 172.21.15.29:0/2861625949 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff2e0015790 con 0x7ff2f81f1a60 2024-01-24T13:07:04.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2ef400640 1 --2- 172.21.15.29:0/2861625949 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff2d0065a90 0x7ff2d0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.141+0000 7ff2ef400640 1 -- 172.21.15.29:0/2861625949 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff2e0086540 con 0x7ff2f81f1a60 2024-01-24T13:07:04.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.145+0000 7ff2f7400640 1 --2- 172.21.15.29:0/2861625949 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff2d0065a90 0x7ff2d0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.145+0000 7ff2f7400640 1 --2- 172.21.15.29:0/2861625949 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff2d0065a90 0x7ff2d0067f50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff2f815c8f0 tx=0x7ff2e8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:04.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.145+0000 7ff2ef400640 1 -- 172.21.15.29:0/2861625949 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff2e0053e60 con 0x7ff2f81f1a60 2024-01-24T13:07:04.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.357+0000 7ff2fe200640 1 -- 172.21.15.29:0/2861625949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff2f815baa0 con 0x7ff2f81f1a60 2024-01-24T13:07:04.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.365+0000 7ff2ef400640 1 -- 172.21.15.29:0/2861625949 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff2e0057480 con 0x7ff2f81f1a60 2024-01-24T13:07:04.368 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2024-01-24T13:07:04.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.365+0000 7ff2fe200640 1 -- 172.21.15.29:0/2861625949 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff2d0065a90 msgr2=0x7ff2d0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:04.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.365+0000 7ff2fe200640 1 --2- 172.21.15.29:0/2861625949 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff2d0065a90 0x7ff2d0067f50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff2f815c8f0 tx=0x7ff2e8009040 comp rx=0 tx=0).stop 2024-01-24T13:07:04.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.365+0000 7ff2fe200640 1 -- 172.21.15.29:0/2861625949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f81f1a60 msgr2=0x7ff2f80c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:04.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.365+0000 7ff2fe200640 1 --2- 172.21.15.29:0/2861625949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f81f1a60 0x7ff2f80c8c50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0011840 tx=0x7ff2e0011d00 comp rx=0 tx=0).stop 2024-01-24T13:07:04.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.365+0000 7ff2fe200640 1 -- 172.21.15.29:0/2861625949 shutdown_connections 2024-01-24T13:07:04.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.365+0000 7ff2fe200640 1 --2- 172.21.15.29:0/2861625949 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff2d0065a90 0x7ff2d0067f50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.365+0000 7ff2fe200640 1 --2- 172.21.15.29:0/2861625949 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2f8156d00 0x7ff2f81571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.365+0000 7ff2fe200640 1 --2- 172.21.15.29:0/2861625949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f81f1a60 0x7ff2f80c8c50 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.365+0000 7ff2fe200640 1 --2- 172.21.15.29:0/2861625949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d8004d10 0x7ff2f815b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.365+0000 7ff2fe200640 1 -- 172.21.15.29:0/2861625949 >> 172.21.15.29:0/2861625949 conn(0x7ff2f8069cd0 msgr2=0x7ff2f80cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:04.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.365+0000 7ff2fe200640 1 -- 172.21.15.29:0/2861625949 shutdown_connections 2024-01-24T13:07:04.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.365+0000 7ff2fe200640 1 -- 172.21.15.29:0/2861625949 wait complete. 2024-01-24T13:07:04.390 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-24T13:07:04.390 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-24T13:07:04.451 DEBUG:teuthology.orchestra.run.smithi163:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-24T13:07:04.541 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-24T13:07:04.541 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:07:04.541 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:07:04.551 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:07:04.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb806e00640 1 Processor -- start 2024-01-24T13:07:04.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb806e00640 1 -- start start 2024-01-24T13:07:04.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb806e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb80015c770 0x7fb80006d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb806e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8000cedc0 0x7fb8000cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb806e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb800071ce0 0x7fb8000cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb806e00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb800070d10 con 0x7fb8000cedc0 2024-01-24T13:07:04.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb806e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80015cb50 con 0x7fb80015c770 2024-01-24T13:07:04.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb806e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb800070f20 con 0x7fb800071ce0 2024-01-24T13:07:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb7ff400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8000cedc0 0x7fb8000cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb7ff400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8000cedc0 0x7fb8000cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34704/0 (socket says 172.21.15.29:34704) 2024-01-24T13:07:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb7ff400640 1 -- 172.21.15.29:0/1335964207 learned_addr learned my addr 172.21.15.29:0/1335964207 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb7ffe00640 1 --2- 172.21.15.29:0/1335964207 >> v2:172.21.15.163:3300/0 conn(0x7fb80015c770 0x7fb80006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb804e00640 1 --2- 172.21.15.29:0/1335964207 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb800071ce0 0x7fb8000cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb7ff400640 1 -- 172.21.15.29:0/1335964207 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb800071ce0 msgr2=0x7fb8000cfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb7ff400640 1 --2- 172.21.15.29:0/1335964207 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb800071ce0 0x7fb8000cfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb7ff400640 1 -- 172.21.15.29:0/1335964207 >> v2:172.21.15.163:3300/0 conn(0x7fb80015c770 msgr2=0x7fb80006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb7ff400640 1 --2- 172.21.15.29:0/1335964207 >> v2:172.21.15.163:3300/0 conn(0x7fb80015c770 0x7fb80006d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb7ff400640 1 -- 172.21.15.29:0/1335964207 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800071200 con 0x7fb8000cedc0 2024-01-24T13:07:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb7ffe00640 1 --2- 172.21.15.29:0/1335964207 >> v2:172.21.15.163:3300/0 conn(0x7fb80015c770 0x7fb80006d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.729+0000 7fb804e00640 1 --2- 172.21.15.29:0/1335964207 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb800071ce0 0x7fb8000cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:04.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.733+0000 7fb7ff400640 1 --2- 172.21.15.29:0/1335964207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8000cedc0 0x7fb8000cf770 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb80006ad80 tx=0x7fb7e801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99632d78171c459 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:04.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.733+0000 7fb7fea00640 1 -- 172.21.15.29:0/1335964207 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80ab620 con 0x7fb8000cedc0 2024-01-24T13:07:04.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.733+0000 7fb7fea00640 1 -- 172.21.15.29:0/1335964207 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e80ab780 con 0x7fb8000cedc0 2024-01-24T13:07:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.733+0000 7fb7fea00640 1 -- 172.21.15.29:0/1335964207 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80abb10 con 0x7fb8000cedc0 2024-01-24T13:07:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.733+0000 7fb806e00640 1 -- 172.21.15.29:0/1335964207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8000cedc0 msgr2=0x7fb8000cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.733+0000 7fb806e00640 1 --2- 172.21.15.29:0/1335964207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8000cedc0 0x7fb8000cf770 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb80006ad80 tx=0x7fb7e801c440 comp rx=0 tx=0).stop 2024-01-24T13:07:04.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.733+0000 7fb806e00640 1 -- 172.21.15.29:0/1335964207 shutdown_connections 2024-01-24T13:07:04.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.733+0000 7fb806e00640 1 --2- 172.21.15.29:0/1335964207 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb800071ce0 0x7fb8000cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.733+0000 7fb806e00640 1 --2- 172.21.15.29:0/1335964207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8000cedc0 0x7fb8000cf770 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.733+0000 7fb806e00640 1 --2- 172.21.15.29:0/1335964207 >> v2:172.21.15.163:3300/0 conn(0x7fb80015c770 0x7fb80006d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.733+0000 7fb806e00640 1 -- 172.21.15.29:0/1335964207 >> 172.21.15.29:0/1335964207 conn(0x7fb80006b1e0 msgr2=0x7fb80006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:04.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.733+0000 7fb806e00640 1 -- 172.21.15.29:0/1335964207 shutdown_connections 2024-01-24T13:07:04.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.733+0000 7fb806e00640 1 -- 172.21.15.29:0/1335964207 wait complete. 2024-01-24T13:07:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb806e00640 1 Processor -- start 2024-01-24T13:07:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb806e00640 1 -- start start 2024-01-24T13:07:04.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb806e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb800071ce0 0x7fb80014f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb806e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8000cedc0 0x7fb8000ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb806e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80015c770 0x7fb80013c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb806e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000acef0 con 0x7fb80015c770 2024-01-24T13:07:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb806e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb800154db0 con 0x7fb8000cedc0 2024-01-24T13:07:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb806e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000ac5c0 con 0x7fb800071ce0 2024-01-24T13:07:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb804e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80015c770 0x7fb80013c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb804e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80015c770 0x7fb80013c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34720/0 (socket says 172.21.15.29:34720) 2024-01-24T13:07:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb804e00640 1 -- 172.21.15.29:0/4132100296 learned_addr learned my addr 172.21.15.29:0/4132100296 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb7ff400640 1 --2- 172.21.15.29:0/4132100296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8000cedc0 0x7fb8000ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb7ffe00640 1 --2- 172.21.15.29:0/4132100296 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb800071ce0 0x7fb80014f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb804e00640 1 -- 172.21.15.29:0/4132100296 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb800071ce0 msgr2=0x7fb80014f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb804e00640 1 --2- 172.21.15.29:0/4132100296 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb800071ce0 0x7fb80014f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb804e00640 1 -- 172.21.15.29:0/4132100296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8000cedc0 msgr2=0x7fb8000ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:04.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb804e00640 1 --2- 172.21.15.29:0/4132100296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8000cedc0 0x7fb8000ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb804e00640 1 -- 172.21.15.29:0/4132100296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e80094d0 con 0x7fb80015c770 2024-01-24T13:07:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb804e00640 1 --2- 172.21.15.29:0/4132100296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80015c770 0x7fb80013c430 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800cef0 tx=0x7fb7f800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb7f7e00640 1 -- 172.21.15.29:0/4132100296 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f800d840 con 0x7fb80015c770 2024-01-24T13:07:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb7f7e00640 1 -- 172.21.15.29:0/4132100296 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f800d9a0 con 0x7fb80015c770 2024-01-24T13:07:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb806e00640 1 -- 172.21.15.29:0/4132100296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8000ac8a0 con 0x7fb80015c770 2024-01-24T13:07:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb7f7e00640 1 -- 172.21.15.29:0/4132100296 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f800dd50 con 0x7fb80015c770 2024-01-24T13:07:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.737+0000 7fb806e00640 1 -- 172.21.15.29:0/4132100296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8000ce5a0 con 0x7fb80015c770 2024-01-24T13:07:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.741+0000 7fb806e00640 1 -- 172.21.15.29:0/4132100296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80004e850 con 0x7fb80015c770 2024-01-24T13:07:04.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.741+0000 7fb7f7e00640 1 -- 172.21.15.29:0/4132100296 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb7f801e3b0 con 0x7fb80015c770 2024-01-24T13:07:04.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.741+0000 7fb7f7e00640 1 --2- 172.21.15.29:0/4132100296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7d8065a60 0x7fb7d8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:04.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.741+0000 7fb7f7e00640 1 -- 172.21.15.29:0/4132100296 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb7f8083cf0 con 0x7fb80015c770 2024-01-24T13:07:04.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.741+0000 7fb7ffe00640 1 --2- 172.21.15.29:0/4132100296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7d8065a60 0x7fb7d8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:04.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.741+0000 7fb7ffe00640 1 --2- 172.21.15.29:0/4132100296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7d8065a60 0x7fb7d8067f20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb8000b54a0 tx=0x7fb7f0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:04.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.745+0000 7fb7f7e00640 1 -- 172.21.15.29:0/4132100296 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb7f8051580 con 0x7fb80015c770 2024-01-24T13:07:04.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.909+0000 7fb806e00640 1 -- 172.21.15.29:0/4132100296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb800159560 con 0x7fb80015c770 2024-01-24T13:07:04.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.913+0000 7fb7f7e00640 1 -- 172.21.15.29:0/4132100296 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16302 (secure 0 0 0) 0x7fb7f801a090 con 0x7fb80015c770 2024-01-24T13:07:04.917 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:04.917 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":59,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:06:34.365221+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:06:31.105908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-24T13:06:32.357292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:07:04.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.913+0000 7fb806e00640 1 -- 172.21.15.29:0/4132100296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7d8065a60 msgr2=0x7fb7d8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:04.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.913+0000 7fb806e00640 1 --2- 172.21.15.29:0/4132100296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7d8065a60 0x7fb7d8067f20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb8000b54a0 tx=0x7fb7f0008040 comp rx=0 tx=0).stop 2024-01-24T13:07:04.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.913+0000 7fb806e00640 1 -- 172.21.15.29:0/4132100296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80015c770 msgr2=0x7fb80013c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:04.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.913+0000 7fb806e00640 1 --2- 172.21.15.29:0/4132100296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80015c770 0x7fb80013c430 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800cef0 tx=0x7fb7f800a710 comp rx=0 tx=0).stop 2024-01-24T13:07:04.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.913+0000 7fb806e00640 1 -- 172.21.15.29:0/4132100296 shutdown_connections 2024-01-24T13:07:04.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.913+0000 7fb806e00640 1 --2- 172.21.15.29:0/4132100296 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb7d8065a60 0x7fb7d8067f20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.913+0000 7fb806e00640 1 --2- 172.21.15.29:0/4132100296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80015c770 0x7fb80013c430 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.913+0000 7fb806e00640 1 --2- 172.21.15.29:0/4132100296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8000cedc0 0x7fb8000ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.913+0000 7fb806e00640 1 --2- 172.21.15.29:0/4132100296 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb800071ce0 0x7fb80014f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:04.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.913+0000 7fb806e00640 1 -- 172.21.15.29:0/4132100296 >> 172.21.15.29:0/4132100296 conn(0x7fb80006b1e0 msgr2=0x7fb8000c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:04.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.913+0000 7fb806e00640 1 -- 172.21.15.29:0/4132100296 shutdown_connections 2024-01-24T13:07:04.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:04.913+0000 7fb806e00640 1 -- 172.21.15.29:0/4132100296 wait complete. 2024-01-24T13:07:04.940 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:06:31.105908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:06:32.357292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:07:04.940 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:07:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe468e00640 1 Processor -- start 2024-01-24T13:07:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe468e00640 1 -- start start 2024-01-24T13:07:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe468e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe46415c690 0x7fe4640cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe468e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe4640b3360 0x7fe4640ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe468e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe464160fc0 con 0x7fe4640abae0 2024-01-24T13:07:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe468e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4640b2ef0 con 0x7fe4640b3360 2024-01-24T13:07:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe468e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4641603f0 con 0x7fe46415c690 2024-01-24T13:07:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe461400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe4640b3360 0x7fe4640ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe462800640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fe4640abae0 0x7fe46406bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:52138/0 (socket says 172.21.15.29:52138) 2024-01-24T13:07:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe462800640 1 -- 172.21.15.29:0/4078835958 learned_addr learned my addr 172.21.15.29:0/4078835958 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe461e00640 1 --2- 172.21.15.29:0/4078835958 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe46415c690 0x7fe4640cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe460a00640 1 -- 172.21.15.29:0/4078835958 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760245208 0 0) 0x7fe464160fc0 con 0x7fe4640abae0 2024-01-24T13:07:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe460a00640 1 -- 172.21.15.29:0/4078835958 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe444003530 con 0x7fe4640abae0 2024-01-24T13:07:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe461400640 1 -- 172.21.15.29:0/4078835958 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe46415c690 msgr2=0x7fe4640cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe461400640 1 --2- 172.21.15.29:0/4078835958 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe46415c690 0x7fe4640cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe461400640 1 -- 172.21.15.29:0/4078835958 >> v1:172.21.15.163:6789/0 conn(0x7fe4640abae0 legacy=0x7fe46406bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe461400640 1 -- 172.21.15.29:0/4078835958 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe464160690 con 0x7fe4640b3360 2024-01-24T13:07:05.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.081+0000 7fe461e00640 1 --2- 172.21.15.29:0/4078835958 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe46415c690 0x7fe4640cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:07:05.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.085+0000 7fe461400640 1 --2- 172.21.15.29:0/4078835958 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4640b3360 0x7fe4640ce3e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0097c0 tx=0x7fe44c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c05fdc97299a5e77 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:05.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.085+0000 7fe460a00640 1 -- 172.21.15.29:0/4078835958 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c0ac640 con 0x7fe4640b3360 2024-01-24T13:07:05.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.085+0000 7fe460a00640 1 -- 172.21.15.29:0/4078835958 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c0ac7a0 con 0x7fe4640b3360 2024-01-24T13:07:05.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.085+0000 7fe460a00640 1 -- 172.21.15.29:0/4078835958 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c0acb30 con 0x7fe4640b3360 2024-01-24T13:07:05.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 -- 172.21.15.29:0/4078835958 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4640b3360 msgr2=0x7fe4640ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 --2- 172.21.15.29:0/4078835958 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4640b3360 0x7fe4640ce3e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0097c0 tx=0x7fe44c01c3f0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 -- 172.21.15.29:0/4078835958 shutdown_connections 2024-01-24T13:07:05.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 --2- 172.21.15.29:0/4078835958 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4640b3360 0x7fe4640ce3e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 --2- 172.21.15.29:0/4078835958 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe46415c690 0x7fe4640cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 -- 172.21.15.29:0/4078835958 >> 172.21.15.29:0/4078835958 conn(0x7fe46406d700 msgr2=0x7fe464069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:05.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 -- 172.21.15.29:0/4078835958 shutdown_connections 2024-01-24T13:07:05.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 -- 172.21.15.29:0/4078835958 wait complete. 2024-01-24T13:07:05.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 Processor -- start 2024-01-24T13:07:05.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 -- start start 2024-01-24T13:07:05.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4640abae0 0x7fe46413c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4640b3360 0x7fe46414edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46415c690 0x7fe46414f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe464149fb0 con 0x7fe46415c690 2024-01-24T13:07:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46413cd60 con 0x7fe4640b3360 2024-01-24T13:07:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe468e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe464153e70 con 0x7fe4640abae0 2024-01-24T13:07:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe462800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46415c690 0x7fe46414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe462800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46415c690 0x7fe46414f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34736/0 (socket says 172.21.15.29:34736) 2024-01-24T13:07:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe462800640 1 -- 172.21.15.29:0/1913831387 learned_addr learned my addr 172.21.15.29:0/1913831387 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe461e00640 1 --2- 172.21.15.29:0/1913831387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4640abae0 0x7fe46413c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe461400640 1 --2- 172.21.15.29:0/1913831387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4640b3360 0x7fe46414edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.089+0000 7fe462800640 1 -- 172.21.15.29:0/1913831387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4640abae0 msgr2=0x7fe46413c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe462800640 1 --2- 172.21.15.29:0/1913831387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4640abae0 0x7fe46413c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe462800640 1 -- 172.21.15.29:0/1913831387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4640b3360 msgr2=0x7fe46414edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe462800640 1 --2- 172.21.15.29:0/1913831387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4640b3360 0x7fe46414edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe462800640 1 -- 172.21.15.29:0/1913831387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe454009420 con 0x7fe46415c690 2024-01-24T13:07:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe462800640 1 --2- 172.21.15.29:0/1913831387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46415c690 0x7fe46414f330 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00cad0 tx=0x7fe45c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:05.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe45a000640 1 -- 172.21.15.29:0/1913831387 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c00ac30 con 0x7fe46415c690 2024-01-24T13:07:05.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe45a000640 1 -- 172.21.15.29:0/1913831387 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45c00ad90 con 0x7fe46415c690 2024-01-24T13:07:05.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe468e00640 1 -- 172.21.15.29:0/1913831387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44c009420 con 0x7fe46415c690 2024-01-24T13:07:05.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe45a000640 1 -- 172.21.15.29:0/1913831387 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c012620 con 0x7fe46415c690 2024-01-24T13:07:05.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe468e00640 1 -- 172.21.15.29:0/1913831387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe464154430 con 0x7fe46415c690 2024-01-24T13:07:05.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe468e00640 1 -- 172.21.15.29:0/1913831387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46414a120 con 0x7fe46415c690 2024-01-24T13:07:05.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe45a000640 1 -- 172.21.15.29:0/1913831387 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe45c007070 con 0x7fe46415c690 2024-01-24T13:07:05.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe45a000640 1 --2- 172.21.15.29:0/1913831387 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe43c065a60 0x7fe43c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe45a000640 1 -- 172.21.15.29:0/1913831387 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe45c083300 con 0x7fe46415c690 2024-01-24T13:07:05.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.093+0000 7fe461e00640 1 --2- 172.21.15.29:0/1913831387 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe43c065a60 0x7fe43c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.097+0000 7fe461e00640 1 --2- 172.21.15.29:0/1913831387 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe43c065a60 0x7fe43c067f20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe454009c80 tx=0x7fe454008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:05.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.097+0000 7fe45a000640 1 -- 172.21.15.29:0/1913831387 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe45c050af0 con 0x7fe46415c690 2024-01-24T13:07:05.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.253+0000 7fe468e00640 1 -- 172.21.15.29:0/1913831387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe464154620 con 0x7fe46415c690 2024-01-24T13:07:05.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.253+0000 7fe45a000640 1 -- 172.21.15.29:0/1913831387 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe45c0170a0 con 0x7fe46415c690 2024-01-24T13:07:05.259 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:07:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.257+0000 7fe468e00640 1 -- 172.21.15.29:0/1913831387 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe43c065a60 msgr2=0x7fe43c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.257+0000 7fe468e00640 1 --2- 172.21.15.29:0/1913831387 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe43c065a60 0x7fe43c067f20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe454009c80 tx=0x7fe454008040 comp rx=0 tx=0).stop 2024-01-24T13:07:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.257+0000 7fe468e00640 1 -- 172.21.15.29:0/1913831387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46415c690 msgr2=0x7fe46414f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.257+0000 7fe468e00640 1 --2- 172.21.15.29:0/1913831387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46415c690 0x7fe46414f330 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00cad0 tx=0x7fe45c00cf90 comp rx=0 tx=0).stop 2024-01-24T13:07:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.257+0000 7fe468e00640 1 -- 172.21.15.29:0/1913831387 shutdown_connections 2024-01-24T13:07:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.257+0000 7fe468e00640 1 --2- 172.21.15.29:0/1913831387 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe43c065a60 0x7fe43c067f20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.257+0000 7fe468e00640 1 --2- 172.21.15.29:0/1913831387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46415c690 0x7fe46414f330 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.257+0000 7fe468e00640 1 --2- 172.21.15.29:0/1913831387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe4640b3360 0x7fe46414edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.257+0000 7fe468e00640 1 --2- 172.21.15.29:0/1913831387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe4640abae0 0x7fe46413c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.257+0000 7fe468e00640 1 -- 172.21.15.29:0/1913831387 >> 172.21.15.29:0/1913831387 conn(0x7fe46406d700 msgr2=0x7fe46406fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.257+0000 7fe468e00640 1 -- 172.21.15.29:0/1913831387 shutdown_connections 2024-01-24T13:07:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.257+0000 7fe468e00640 1 -- 172.21.15.29:0/1913831387 wait complete. 2024-01-24T13:07:05.282 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:07:05.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e19400640 1 Processor -- start 2024-01-24T13:07:05.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e19400640 1 -- start start 2024-01-24T13:07:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e19400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e14142980 0x7f6e140cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e19400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e140cd350 0x7f6e1415d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e19400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e140cd7e0 con 0x7f6e1406c860 2024-01-24T13:07:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e19400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e141611b0 con 0x7f6e140cd350 2024-01-24T13:07:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e19400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e14160630 con 0x7f6e14142980 2024-01-24T13:07:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e13200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e140cd350 0x7f6e1415d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e13200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e140cd350 0x7f6e1415d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34738/0 (socket says 172.21.15.29:34738) 2024-01-24T13:07:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e13200640 1 -- 172.21.15.29:0/759625575 learned_addr learned my addr 172.21.15.29:0/759625575 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e11e00640 1 --2- 172.21.15.29:0/759625575 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e14142980 0x7f6e140cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e13200640 1 -- 172.21.15.29:0/759625575 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e14142980 msgr2=0x7f6e140cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e13200640 1 --2- 172.21.15.29:0/759625575 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e14142980 0x7f6e140cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e13200640 1 -- 172.21.15.29:0/759625575 >> v1:172.21.15.163:6789/0 conn(0x7f6e1406c860 legacy=0x7f6e1406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e13200640 1 -- 172.21.15.29:0/759625575 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e14160910 con 0x7f6e140cd350 2024-01-24T13:07:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.425+0000 7f6e11e00640 1 --2- 172.21.15.29:0/759625575 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e14142980 0x7f6e140cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.429+0000 7f6e13200640 1 --2- 172.21.15.29:0/759625575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e140cd350 0x7f6e1415d080 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009e50 tx=0x7f6e0c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b085e5cf8b7380a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.429+0000 7f6e11400640 1 -- 172.21.15.29:0/759625575 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c0a58a0 con 0x7f6e140cd350 2024-01-24T13:07:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.429+0000 7f6e11400640 1 -- 172.21.15.29:0/759625575 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0c0a5a00 con 0x7f6e140cd350 2024-01-24T13:07:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.429+0000 7f6e11400640 1 -- 172.21.15.29:0/759625575 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c0a5d90 con 0x7f6e140cd350 2024-01-24T13:07:05.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.429+0000 7f6e19400640 1 -- 172.21.15.29:0/759625575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e140cd350 msgr2=0x7f6e1415d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.429+0000 7f6e19400640 1 --2- 172.21.15.29:0/759625575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e140cd350 0x7f6e1415d080 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009e50 tx=0x7f6e0c01c9e0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.429+0000 7f6e19400640 1 -- 172.21.15.29:0/759625575 shutdown_connections 2024-01-24T13:07:05.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.429+0000 7f6e19400640 1 --2- 172.21.15.29:0/759625575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e140cd350 0x7f6e1415d080 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.429+0000 7f6e19400640 1 --2- 172.21.15.29:0/759625575 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e14142980 0x7f6e140cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.429+0000 7f6e19400640 1 -- 172.21.15.29:0/759625575 >> 172.21.15.29:0/759625575 conn(0x7f6e14069cd0 msgr2=0x7f6e1406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:05.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.429+0000 7f6e19400640 1 -- 172.21.15.29:0/759625575 shutdown_connections 2024-01-24T13:07:05.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.429+0000 7f6e19400640 1 -- 172.21.15.29:0/759625575 wait complete. 2024-01-24T13:07:05.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e19400640 1 Processor -- start 2024-01-24T13:07:05.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e19400640 1 -- start start 2024-01-24T13:07:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e19400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e1406c860 0x7f6e140c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e19400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e140cd350 0x7f6e14158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e19400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e14142980 0x7f6e1406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e19400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e14159bd0 con 0x7f6e1406c860 2024-01-24T13:07:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e19400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e14158fc0 con 0x7f6e14142980 2024-01-24T13:07:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e19400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e141592a0 con 0x7f6e140cd350 2024-01-24T13:07:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e12800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e1406c860 0x7f6e140c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e12800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e1406c860 0x7f6e140c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34750/0 (socket says 172.21.15.29:34750) 2024-01-24T13:07:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e12800640 1 -- 172.21.15.29:0/1170409683 learned_addr learned my addr 172.21.15.29:0/1170409683 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e13200640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e14142980 0x7f6e1406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e11e00640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e140cd350 0x7f6e14158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e12800640 1 -- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e140cd350 msgr2=0x7f6e14158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e12800640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e140cd350 0x7f6e14158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e12800640 1 -- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e14142980 msgr2=0x7f6e1406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e12800640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e14142980 0x7f6e1406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e12800640 1 -- 172.21.15.29:0/1170409683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c009b30 con 0x7f6e1406c860 2024-01-24T13:07:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e13200640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e14142980 0x7f6e1406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:07:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e12800640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e1406c860 0x7f6e140c62d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400c500 tx=0x7f6e0400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e0aa00640 1 -- 172.21.15.29:0/1170409683 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04005220 con 0x7f6e1406c860 2024-01-24T13:07:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e0aa00640 1 -- 172.21.15.29:0/1170409683 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e04005380 con 0x7f6e1406c860 2024-01-24T13:07:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e0aa00640 1 -- 172.21.15.29:0/1170409683 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04007270 con 0x7f6e1406c860 2024-01-24T13:07:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e19400640 1 -- 172.21.15.29:0/1170409683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e14159580 con 0x7f6e1406c860 2024-01-24T13:07:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e19400640 1 -- 172.21.15.29:0/1170409683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e14158bb0 con 0x7f6e1406c860 2024-01-24T13:07:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.433+0000 7f6e19400640 1 -- 172.21.15.29:0/1170409683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e140c6810 con 0x7f6e1406c860 2024-01-24T13:07:05.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.437+0000 7f6e0aa00640 1 -- 172.21.15.29:0/1170409683 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6e040073d0 con 0x7f6e1406c860 2024-01-24T13:07:05.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.437+0000 7f6e0aa00640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6dec065a60 0x7f6dec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.437+0000 7f6e0aa00640 1 -- 172.21.15.29:0/1170409683 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6e04082b90 con 0x7f6e1406c860 2024-01-24T13:07:05.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.437+0000 7f6e11e00640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6dec065a60 0x7f6dec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.437+0000 7f6e11e00640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6dec065a60 0x7f6dec067f20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6e140d0890 tx=0x7f6dfc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.441+0000 7f6e0aa00640 1 -- 172.21.15.29:0/1170409683 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f6e04050430 con 0x7f6e1406c860 2024-01-24T13:07:05.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.597+0000 7f6e19400640 1 -- 172.21.15.29:0/1170409683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e1404e850 con 0x7f6e1406c860 2024-01-24T13:07:05.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.597+0000 7f6e0aa00640 1 -- 172.21.15.29:0/1170409683 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e04053a50 con 0x7f6e1406c860 2024-01-24T13:07:05.602 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:07:05.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.601+0000 7f6e19400640 1 -- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6dec065a60 msgr2=0x7f6dec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.601+0000 7f6e19400640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6dec065a60 0x7f6dec067f20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6e140d0890 tx=0x7f6dfc008040 comp rx=0 tx=0).stop 2024-01-24T13:07:05.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.601+0000 7f6e19400640 1 -- 172.21.15.29:0/1170409683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e1406c860 msgr2=0x7f6e140c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.601+0000 7f6e19400640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e1406c860 0x7f6e140c62d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400c500 tx=0x7f6e0400c9c0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.601+0000 7f6e19400640 1 -- 172.21.15.29:0/1170409683 shutdown_connections 2024-01-24T13:07:05.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.601+0000 7f6e19400640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6dec065a60 0x7f6dec067f20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.601+0000 7f6e19400640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e14142980 0x7f6e1406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.601+0000 7f6e19400640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6e140cd350 0x7f6e14158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.601+0000 7f6e19400640 1 --2- 172.21.15.29:0/1170409683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e1406c860 0x7f6e140c62d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.601+0000 7f6e19400640 1 -- 172.21.15.29:0/1170409683 >> 172.21.15.29:0/1170409683 conn(0x7f6e14069cd0 msgr2=0x7f6e1415f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.601+0000 7f6e19400640 1 -- 172.21.15.29:0/1170409683 shutdown_connections 2024-01-24T13:07:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.601+0000 7f6e19400640 1 -- 172.21.15.29:0/1170409683 wait complete. 2024-01-24T13:07:05.624 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:07:05.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe861a00640 1 Processor -- start 2024-01-24T13:07:05.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe861a00640 1 -- start start 2024-01-24T13:07:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe861a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe85c06c200 0x7fe85c13cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe861a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe85c13d2e0 0x7fe85c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe861a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85c13d720 con 0x7fe85c06be20 2024-01-24T13:07:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe861a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85c15b4f0 con 0x7fe85c06c200 2024-01-24T13:07:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe861a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c15b7d0 con 0x7fe85c13d2e0 2024-01-24T13:07:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe85a000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe85c06c200 0x7fe85c13cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe85a000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe85c06c200 0x7fe85c13cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34752/0 (socket says 172.21.15.29:34752) 2024-01-24T13:07:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe85a000640 1 -- 172.21.15.29:0/3633578294 learned_addr learned my addr 172.21.15.29:0/3633578294 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe85b400640 1 --2- 172.21.15.29:0/3633578294 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe85c13d2e0 0x7fe85c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe85a000640 1 -- 172.21.15.29:0/3633578294 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe85c13d2e0 msgr2=0x7fe85c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe85a000640 1 --2- 172.21.15.29:0/3633578294 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe85c13d2e0 0x7fe85c0cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe85a000640 1 -- 172.21.15.29:0/3633578294 >> v1:172.21.15.163:6789/0 conn(0x7fe85c06be20 legacy=0x7fe85c15a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:05.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.765+0000 7fe85a000640 1 -- 172.21.15.29:0/3633578294 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c0cd0c0 con 0x7fe85c06c200 2024-01-24T13:07:05.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.769+0000 7fe85a000640 1 --2- 172.21.15.29:0/3633578294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe85c06c200 0x7fe85c13cda0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe844009870 tx=0x7fe84401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10b0c33147306a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:05.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.769+0000 7fe859600640 1 -- 172.21.15.29:0/3633578294 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8440ab670 con 0x7fe85c06c200 2024-01-24T13:07:05.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.769+0000 7fe859600640 1 -- 172.21.15.29:0/3633578294 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8440ab7d0 con 0x7fe85c06c200 2024-01-24T13:07:05.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.769+0000 7fe859600640 1 -- 172.21.15.29:0/3633578294 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8440abb60 con 0x7fe85c06c200 2024-01-24T13:07:05.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.769+0000 7fe861a00640 1 -- 172.21.15.29:0/3633578294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe85c06c200 msgr2=0x7fe85c13cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.769+0000 7fe861a00640 1 --2- 172.21.15.29:0/3633578294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe85c06c200 0x7fe85c13cda0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe844009870 tx=0x7fe84401c4d0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.769+0000 7fe861a00640 1 -- 172.21.15.29:0/3633578294 shutdown_connections 2024-01-24T13:07:05.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.769+0000 7fe861a00640 1 --2- 172.21.15.29:0/3633578294 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe85c13d2e0 0x7fe85c0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.769+0000 7fe861a00640 1 --2- 172.21.15.29:0/3633578294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe85c06c200 0x7fe85c13cda0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.769+0000 7fe861a00640 1 -- 172.21.15.29:0/3633578294 >> 172.21.15.29:0/3633578294 conn(0x7fe85c06d700 msgr2=0x7fe85c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:05.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.769+0000 7fe861a00640 1 -- 172.21.15.29:0/3633578294 shutdown_connections 2024-01-24T13:07:05.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.769+0000 7fe861a00640 1 -- 172.21.15.29:0/3633578294 wait complete. 2024-01-24T13:07:05.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe861a00640 1 Processor -- start 2024-01-24T13:07:05.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe861a00640 1 -- start start 2024-01-24T13:07:05.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe861a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe85c06be20 0x7fe85c137e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe861a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe85c06c200 0x7fe85c14ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe861a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe85c13d2e0 0x7fe85c14b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe861a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c138360 con 0x7fe85c06c200 2024-01-24T13:07:05.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe861a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c14b040 con 0x7fe85c06be20 2024-01-24T13:07:05.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe861a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c13a600 con 0x7fe85c13d2e0 2024-01-24T13:07:05.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe85a000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe85c06c200 0x7fe85c14ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe85a000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe85c06c200 0x7fe85c14ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34764/0 (socket says 172.21.15.29:34764) 2024-01-24T13:07:05.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe85a000640 1 -- 172.21.15.29:0/2629957386 learned_addr learned my addr 172.21.15.29:0/2629957386 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:05.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe85b400640 1 --2- 172.21.15.29:0/2629957386 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe85c13d2e0 0x7fe85c14b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe85aa00640 1 --2- 172.21.15.29:0/2629957386 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe85c06be20 0x7fe85c137e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe85a000640 1 -- 172.21.15.29:0/2629957386 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe85c13d2e0 msgr2=0x7fe85c14b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe85a000640 1 --2- 172.21.15.29:0/2629957386 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe85c13d2e0 0x7fe85c14b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe85a000640 1 -- 172.21.15.29:0/2629957386 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe85c06be20 msgr2=0x7fe85c137e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe85a000640 1 --2- 172.21.15.29:0/2629957386 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe85c06be20 0x7fe85c137e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe85a000640 1 -- 172.21.15.29:0/2629957386 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8440094d0 con 0x7fe85c06c200 2024-01-24T13:07:05.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe85a000640 1 --2- 172.21.15.29:0/2629957386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe85c06c200 0x7fe85c14ab00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe8440ad040 tx=0x7fe84401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:05.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe852a00640 1 -- 172.21.15.29:0/2629957386 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8440b4800 con 0x7fe85c06c200 2024-01-24T13:07:05.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe852a00640 1 -- 172.21.15.29:0/2629957386 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8440b4980 con 0x7fe85c06c200 2024-01-24T13:07:05.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe852a00640 1 -- 172.21.15.29:0/2629957386 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8440b4d30 con 0x7fe85c06c200 2024-01-24T13:07:05.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe861a00640 1 -- 172.21.15.29:0/2629957386 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85c13c590 con 0x7fe85c06c200 2024-01-24T13:07:05.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.773+0000 7fe861a00640 1 -- 172.21.15.29:0/2629957386 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85c13a810 con 0x7fe85c06c200 2024-01-24T13:07:05.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.777+0000 7fe861a00640 1 -- 172.21.15.29:0/2629957386 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85c04e850 con 0x7fe85c06c200 2024-01-24T13:07:05.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.777+0000 7fe852a00640 1 -- 172.21.15.29:0/2629957386 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe8440aa450 con 0x7fe85c06c200 2024-01-24T13:07:05.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.777+0000 7fe852a00640 1 --2- 172.21.15.29:0/2629957386 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe834065a60 0x7fe834067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:05.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.777+0000 7fe852a00640 1 -- 172.21.15.29:0/2629957386 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe84411db60 con 0x7fe85c06c200 2024-01-24T13:07:05.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.777+0000 7fe85aa00640 1 --2- 172.21.15.29:0/2629957386 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe834065a60 0x7fe834067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:05.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.777+0000 7fe85aa00640 1 --2- 172.21.15.29:0/2629957386 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe834065a60 0x7fe834067f20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe84c007fd0 tx=0x7fe84c007e40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:05.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.781+0000 7fe852a00640 1 -- 172.21.15.29:0/2629957386 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe8440eb480 con 0x7fe85c06c200 2024-01-24T13:07:05.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.937+0000 7fe861a00640 1 -- 172.21.15.29:0/2629957386 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe85c0cb5e0 con 0x7fe85c06c200 2024-01-24T13:07:05.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.941+0000 7fe852a00640 1 -- 172.21.15.29:0/2629957386 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8440c40a0 con 0x7fe85c06c200 2024-01-24T13:07:05.944 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:07:05.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.941+0000 7fe861a00640 1 -- 172.21.15.29:0/2629957386 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe834065a60 msgr2=0x7fe834067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.941+0000 7fe861a00640 1 --2- 172.21.15.29:0/2629957386 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe834065a60 0x7fe834067f20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe84c007fd0 tx=0x7fe84c007e40 comp rx=0 tx=0).stop 2024-01-24T13:07:05.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.941+0000 7fe861a00640 1 -- 172.21.15.29:0/2629957386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe85c06c200 msgr2=0x7fe85c14ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:05.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.941+0000 7fe861a00640 1 --2- 172.21.15.29:0/2629957386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe85c06c200 0x7fe85c14ab00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe8440ad040 tx=0x7fe84401ad10 comp rx=0 tx=0).stop 2024-01-24T13:07:05.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.941+0000 7fe861a00640 1 -- 172.21.15.29:0/2629957386 shutdown_connections 2024-01-24T13:07:05.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.941+0000 7fe861a00640 1 --2- 172.21.15.29:0/2629957386 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe834065a60 0x7fe834067f20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.941+0000 7fe861a00640 1 --2- 172.21.15.29:0/2629957386 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe85c13d2e0 0x7fe85c14b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.941+0000 7fe861a00640 1 --2- 172.21.15.29:0/2629957386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe85c06c200 0x7fe85c14ab00 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.941+0000 7fe861a00640 1 --2- 172.21.15.29:0/2629957386 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe85c06be20 0x7fe85c137e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:05.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.941+0000 7fe861a00640 1 -- 172.21.15.29:0/2629957386 >> 172.21.15.29:0/2629957386 conn(0x7fe85c06d700 msgr2=0x7fe85c15e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:05.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.941+0000 7fe861a00640 1 -- 172.21.15.29:0/2629957386 shutdown_connections 2024-01-24T13:07:05.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:05.941+0000 7fe861a00640 1 -- 172.21.15.29:0/2629957386 wait complete. 2024-01-24T13:07:05.966 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T13:07:06.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4868c00640 1 Processor -- start 2024-01-24T13:07:06.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4868c00640 1 -- start start 2024-01-24T13:07:06.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4868c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48640cd460 0x7f48640d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:06.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4868c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f486415d870 0x7f48640ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:06.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4868c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f48640ce5c0 0x7f48641603e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:06.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4868c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48640ce9e0 con 0x7f48640ce5c0 2024-01-24T13:07:06.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4868c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48640d0830 con 0x7f486415d870 2024-01-24T13:07:06.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4868c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48640d0b10 con 0x7f48640cd460 2024-01-24T13:07:06.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4862800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f48640ce5c0 0x7f48641603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:06.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4862800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f48640ce5c0 0x7f48641603e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34774/0 (socket says 172.21.15.29:34774) 2024-01-24T13:07:06.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4862800640 1 -- 172.21.15.29:0/670782473 learned_addr learned my addr 172.21.15.29:0/670782473 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:06.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4861e00640 1 --2- 172.21.15.29:0/670782473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48640cd460 0x7f48640d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:06.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4861400640 1 --2- 172.21.15.29:0/670782473 >> v2:172.21.15.163:3300/0 conn(0x7f486415d870 0x7f48640ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:06.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4862800640 1 -- 172.21.15.29:0/670782473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48640cd460 msgr2=0x7f48640d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:06.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4862800640 1 --2- 172.21.15.29:0/670782473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48640cd460 0x7f48640d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4862800640 1 -- 172.21.15.29:0/670782473 >> v2:172.21.15.163:3300/0 conn(0x7f486415d870 msgr2=0x7f48640ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:06.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4862800640 1 --2- 172.21.15.29:0/670782473 >> v2:172.21.15.163:3300/0 conn(0x7f486415d870 0x7f48640ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4862800640 1 -- 172.21.15.29:0/670782473 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48640d0df0 con 0x7f48640ce5c0 2024-01-24T13:07:06.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.105+0000 7f4861400640 1 --2- 172.21.15.29:0/670782473 >> v2:172.21.15.163:3300/0 conn(0x7f486415d870 0x7f48640ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:06.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.109+0000 7f4862800640 1 --2- 172.21.15.29:0/670782473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48640ce5c0 0x7f48641603e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f486406ab70 tx=0x7f485c01c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc49dfc63aea118 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:06.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.109+0000 7f4860a00640 1 -- 172.21.15.29:0/670782473 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c0a64a0 con 0x7f48640ce5c0 2024-01-24T13:07:06.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.109+0000 7f4860a00640 1 -- 172.21.15.29:0/670782473 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c0a6600 con 0x7f48640ce5c0 2024-01-24T13:07:06.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.109+0000 7f4860a00640 1 -- 172.21.15.29:0/670782473 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c0a6990 con 0x7f48640ce5c0 2024-01-24T13:07:06.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.109+0000 7f4868c00640 1 -- 172.21.15.29:0/670782473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48640ce5c0 msgr2=0x7f48641603e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:06.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.109+0000 7f4868c00640 1 --2- 172.21.15.29:0/670782473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48640ce5c0 0x7f48641603e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f486406ab70 tx=0x7f485c01c650 comp rx=0 tx=0).stop 2024-01-24T13:07:06.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.109+0000 7f4868c00640 1 -- 172.21.15.29:0/670782473 shutdown_connections 2024-01-24T13:07:06.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.109+0000 7f4868c00640 1 --2- 172.21.15.29:0/670782473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48640ce5c0 0x7f48641603e0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.109+0000 7f4868c00640 1 --2- 172.21.15.29:0/670782473 >> v2:172.21.15.163:3300/0 conn(0x7f486415d870 0x7f48640ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.109+0000 7f4868c00640 1 --2- 172.21.15.29:0/670782473 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48640cd460 0x7f48640d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.109+0000 7f4868c00640 1 -- 172.21.15.29:0/670782473 >> 172.21.15.29:0/670782473 conn(0x7f4864069cd0 msgr2=0x7f486406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:06.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.109+0000 7f4868c00640 1 -- 172.21.15.29:0/670782473 shutdown_connections 2024-01-24T13:07:06.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.109+0000 7f4868c00640 1 -- 172.21.15.29:0/670782473 wait complete. 2024-01-24T13:07:06.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4868c00640 1 Processor -- start 2024-01-24T13:07:06.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4868c00640 1 -- start start 2024-01-24T13:07:06.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4868c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48640cd460 0x7f4864148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:06.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4868c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48640ce5c0 0x7f48640cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:06.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4868c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f486415d870 0x7f486414d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:06.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4868c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4864149fc0 con 0x7f486415d870 2024-01-24T13:07:06.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4868c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4864149340 con 0x7f48640ce5c0 2024-01-24T13:07:06.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4868c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4864149620 con 0x7f48640cd460 2024-01-24T13:07:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4862800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f486415d870 0x7f486414d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4862800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f486415d870 0x7f486414d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34788/0 (socket says 172.21.15.29:34788) 2024-01-24T13:07:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4862800640 1 -- 172.21.15.29:0/3889258231 learned_addr learned my addr 172.21.15.29:0/3889258231 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4861e00640 1 --2- 172.21.15.29:0/3889258231 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48640cd460 0x7f4864148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4861400640 1 --2- 172.21.15.29:0/3889258231 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48640ce5c0 0x7f48640cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4862800640 1 -- 172.21.15.29:0/3889258231 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48640cd460 msgr2=0x7f4864148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4862800640 1 --2- 172.21.15.29:0/3889258231 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48640cd460 0x7f4864148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4862800640 1 -- 172.21.15.29:0/3889258231 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48640ce5c0 msgr2=0x7f48640cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4862800640 1 --2- 172.21.15.29:0/3889258231 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48640ce5c0 0x7f48640cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4862800640 1 -- 172.21.15.29:0/3889258231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c009b30 con 0x7f486415d870 2024-01-24T13:07:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4862800640 1 --2- 172.21.15.29:0/3889258231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f486415d870 0x7f486414d520 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f485c01cef0 tx=0x7f485c0193f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:06.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f485a000640 1 -- 172.21.15.29:0/3889258231 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c0a64a0 con 0x7f486415d870 2024-01-24T13:07:06.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f485a000640 1 -- 172.21.15.29:0/3889258231 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c0a7680 con 0x7f486415d870 2024-01-24T13:07:06.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4868c00640 1 -- 172.21.15.29:0/3889258231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4864149900 con 0x7f486415d870 2024-01-24T13:07:06.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f485a000640 1 -- 172.21.15.29:0/3889258231 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c0a79f0 con 0x7f486415d870 2024-01-24T13:07:06.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.113+0000 7f4868c00640 1 -- 172.21.15.29:0/3889258231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4864148f60 con 0x7f486415d870 2024-01-24T13:07:06.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.117+0000 7f4868c00640 1 -- 172.21.15.29:0/3889258231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486414a100 con 0x7f486415d870 2024-01-24T13:07:06.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.117+0000 7f485a000640 1 -- 172.21.15.29:0/3889258231 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f485c0a7b50 con 0x7f486415d870 2024-01-24T13:07:06.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.117+0000 7f485a000640 1 --2- 172.21.15.29:0/3889258231 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f483c065a60 0x7f483c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:06.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.117+0000 7f485a000640 1 -- 172.21.15.29:0/3889258231 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f485c11dc80 con 0x7f486415d870 2024-01-24T13:07:06.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.117+0000 7f4861e00640 1 --2- 172.21.15.29:0/3889258231 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f483c065a60 0x7f483c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:06.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.117+0000 7f4861e00640 1 --2- 172.21.15.29:0/3889258231 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f483c065a60 0x7f483c067f20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f486415c9b0 tx=0x7f4854008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:06.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.121+0000 7f485a000640 1 -- 172.21.15.29:0/3889258231 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f486414a100 con 0x7f486415d870 2024-01-24T13:07:06.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.293+0000 7f4868c00640 1 -- 172.21.15.29:0/3889258231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f486414a100 con 0x7f486415d870 2024-01-24T13:07:06.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.293+0000 7f485a000640 1 -- 172.21.15.29:0/3889258231 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7f486414a100 con 0x7f486415d870 2024-01-24T13:07:06.298 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-24T13:07:06.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.293+0000 7f4868c00640 1 -- 172.21.15.29:0/3889258231 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f483c065a60 msgr2=0x7f483c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:06.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.293+0000 7f4868c00640 1 --2- 172.21.15.29:0/3889258231 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f483c065a60 0x7f483c067f20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f486415c9b0 tx=0x7f4854008040 comp rx=0 tx=0).stop 2024-01-24T13:07:06.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.293+0000 7f4868c00640 1 -- 172.21.15.29:0/3889258231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f486415d870 msgr2=0x7f486414d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:06.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.293+0000 7f4868c00640 1 --2- 172.21.15.29:0/3889258231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f486415d870 0x7f486414d520 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f485c01cef0 tx=0x7f485c0193f0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.293+0000 7f4868c00640 1 -- 172.21.15.29:0/3889258231 shutdown_connections 2024-01-24T13:07:06.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.293+0000 7f4868c00640 1 --2- 172.21.15.29:0/3889258231 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f483c065a60 0x7f483c067f20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.293+0000 7f4868c00640 1 --2- 172.21.15.29:0/3889258231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f486415d870 0x7f486414d520 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.293+0000 7f4868c00640 1 --2- 172.21.15.29:0/3889258231 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48640ce5c0 0x7f48640cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.293+0000 7f4868c00640 1 --2- 172.21.15.29:0/3889258231 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f48640cd460 0x7f4864148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.293+0000 7f4868c00640 1 -- 172.21.15.29:0/3889258231 >> 172.21.15.29:0/3889258231 conn(0x7f4864069cd0 msgr2=0x7f486415e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:06.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.297+0000 7f4868c00640 1 -- 172.21.15.29:0/3889258231 shutdown_connections 2024-01-24T13:07:06.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.297+0000 7f4868c00640 1 -- 172.21.15.29:0/3889258231 wait complete. 2024-01-24T13:07:06.320 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-01-24T13:07:06.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:06.320 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-24T13:07:06.338 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[40632]: fuse finished with error 0 and tester_r 0 2024-01-24T13:07:06.342 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:07:06.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:06.342 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-24T13:07:06.447 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:07:06.447 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:07:06.457 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5116 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-24T13:07:06.457 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:07:06.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:06.457 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-24T13:07:06.506 INFO:teuthology.orchestra.run.smithi163.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-01-24T13:07:06.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:07:06.507 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:07:06.507 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:07:06.516 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357740k,nr_inodes=4089435,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4625 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275996k,nr_inodes=818999,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-24T13:07:06.516 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:07:06.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:06.516 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-01-24T13:07:06.567 INFO:teuthology.orchestra.run.smithi029.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-01-24T13:07:06.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:07:06.568 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:07:06.568 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:07:06.578 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5116 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-24T13:07:06.578 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:07:06.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:06.578 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-01-24T13:07:06.630 INFO:teuthology.orchestra.run.smithi163.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-01-24T13:07:06.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:07:06.631 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:07:06.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.769+0000 7f3fc9600640 1 Processor -- start 2024-01-24T13:07:06.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.769+0000 7f3fc9600640 1 -- start start 2024-01-24T13:07:06.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.769+0000 7f3fc9600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3fc40b2700 0x7f3fc406b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:06.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.769+0000 7f3fc9600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3fc40ccdb0 0x7f3fc40cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:06.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc9600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc40cd720 con 0x7f3fc415c730 2024-01-24T13:07:06.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc9600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc406cc10 con 0x7f3fc40b2700 2024-01-24T13:07:06.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc9600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc406b7a0 con 0x7f3fc40ccdb0 2024-01-24T13:07:06.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc2000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3fc40b2700 0x7f3fc406b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:06.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc2000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3fc40b2700 0x7f3fc406b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34794/0 (socket says 172.21.15.29:34794) 2024-01-24T13:07:06.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc2000640 1 -- 172.21.15.29:0/301742754 learned_addr learned my addr 172.21.15.29:0/301742754 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:06.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc3400640 1 --2- 172.21.15.29:0/301742754 >> v2:172.21.15.163:3300/0 conn(0x7f3fc40ccdb0 0x7f3fc40cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:06.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc2000640 1 -- 172.21.15.29:0/301742754 >> v2:172.21.15.163:3300/0 conn(0x7f3fc40ccdb0 msgr2=0x7f3fc40cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:06.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc2000640 1 --2- 172.21.15.29:0/301742754 >> v2:172.21.15.163:3300/0 conn(0x7f3fc40ccdb0 0x7f3fc40cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc2000640 1 -- 172.21.15.29:0/301742754 >> v1:172.21.15.163:6789/0 conn(0x7f3fc415c730 legacy=0x7f3fc40ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:06.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc2000640 1 -- 172.21.15.29:0/301742754 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc406ba80 con 0x7f3fc40b2700 2024-01-24T13:07:06.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc2000640 1 --2- 172.21.15.29:0/301742754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc40b2700 0x7f3fc406b110 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3fc41602d0 tx=0x7f3fac01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59012f11556ef174 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:06.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc1600640 1 -- 172.21.15.29:0/301742754 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0ab5f0 con 0x7f3fc40b2700 2024-01-24T13:07:06.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc1600640 1 -- 172.21.15.29:0/301742754 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac0ab750 con 0x7f3fc40b2700 2024-01-24T13:07:06.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.773+0000 7f3fc1600640 1 -- 172.21.15.29:0/301742754 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0abae0 con 0x7f3fc40b2700 2024-01-24T13:07:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 -- 172.21.15.29:0/301742754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc40b2700 msgr2=0x7f3fc406b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 --2- 172.21.15.29:0/301742754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc40b2700 0x7f3fc406b110 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3fc41602d0 tx=0x7f3fac01c500 comp rx=0 tx=0).stop 2024-01-24T13:07:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 -- 172.21.15.29:0/301742754 shutdown_connections 2024-01-24T13:07:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 --2- 172.21.15.29:0/301742754 >> v2:172.21.15.163:3300/0 conn(0x7f3fc40ccdb0 0x7f3fc40cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 --2- 172.21.15.29:0/301742754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc40b2700 0x7f3fc406b110 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 -- 172.21.15.29:0/301742754 >> 172.21.15.29:0/301742754 conn(0x7f3fc4070570 msgr2=0x7f3fc4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 -- 172.21.15.29:0/301742754 shutdown_connections 2024-01-24T13:07:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 -- 172.21.15.29:0/301742754 wait complete. 2024-01-24T13:07:06.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 Processor -- start 2024-01-24T13:07:06.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 -- start start 2024-01-24T13:07:06.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc40b2700 0x7f3fc4153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:06.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fc40ccdb0 0x7f3fc40afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:06.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fc415c730 0x7f3fc40b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:06.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4157f60 con 0x7f3fc40b2700 2024-01-24T13:07:06.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4157350 con 0x7f3fc40ccdb0 2024-01-24T13:07:06.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.777+0000 7f3fc9600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4157630 con 0x7f3fc415c730 2024-01-24T13:07:06.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc2a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc40b2700 0x7f3fc4153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:06.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc2a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc40b2700 0x7f3fc4153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34802/0 (socket says 172.21.15.29:34802) 2024-01-24T13:07:06.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc2a00640 1 -- 172.21.15.29:0/2708226747 learned_addr learned my addr 172.21.15.29:0/2708226747 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:06.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc2000640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fc40ccdb0 0x7f3fc40afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:06.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc3400640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fc415c730 0x7f3fc40b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:06.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc2a00640 1 -- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fc415c730 msgr2=0x7f3fc40b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:06.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc2a00640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fc415c730 0x7f3fc40b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc2a00640 1 -- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fc40ccdb0 msgr2=0x7f3fc40afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:06.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc2a00640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fc40ccdb0 0x7f3fc40afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc2a00640 1 -- 172.21.15.29:0/2708226747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac0094d0 con 0x7f3fc40b2700 2024-01-24T13:07:06.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc2000640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fc40ccdb0 0x7f3fc40afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:07:06.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc2a00640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc40b2700 0x7f3fc4153590 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400c3a0 tx=0x7f3fb400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:06.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fbaa00640 1 -- 172.21.15.29:0/2708226747 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb40052d0 con 0x7f3fc40b2700 2024-01-24T13:07:06.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fbaa00640 1 -- 172.21.15.29:0/2708226747 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb4005450 con 0x7f3fc40b2700 2024-01-24T13:07:06.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fbaa00640 1 -- 172.21.15.29:0/2708226747 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4003860 con 0x7f3fc40b2700 2024-01-24T13:07:06.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc9600640 1 -- 172.21.15.29:0/2708226747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc4157910 con 0x7f3fc40b2700 2024-01-24T13:07:06.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc9600640 1 -- 172.21.15.29:0/2708226747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc4153ad0 con 0x7f3fc40b2700 2024-01-24T13:07:06.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fc9600640 1 -- 172.21.15.29:0/2708226747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc40cf430 con 0x7f3fc40b2700 2024-01-24T13:07:06.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.781+0000 7f3fbaa00640 1 -- 172.21.15.29:0/2708226747 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3fb40039c0 con 0x7f3fc40b2700 2024-01-24T13:07:06.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.785+0000 7f3fbaa00640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f9c065a60 0x7f3f9c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:06.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.785+0000 7f3fbaa00640 1 -- 172.21.15.29:0/2708226747 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3fb4082840 con 0x7f3fc40b2700 2024-01-24T13:07:06.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.785+0000 7f3fc2000640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f9c065a60 0x7f3f9c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:06.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.785+0000 7f3fc2000640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f9c065a60 0x7f3f9c067f20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0af000 tx=0x7f3fac0b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:06.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.789+0000 7f3fbaa00640 1 -- 172.21.15.29:0/2708226747 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3fb40500d0 con 0x7f3fc40b2700 2024-01-24T13:07:06.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.977+0000 7f3fc9600640 1 -- 172.21.15.29:0/2708226747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fc404e850 con 0x7f3fc40b2700 2024-01-24T13:07:06.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.977+0000 7f3fbaa00640 1 -- 172.21.15.29:0/2708226747 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f3fb40536f0 con 0x7f3fc40b2700 2024-01-24T13:07:06.981 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:06.981 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/2169087472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2169087472},{"type":"v1","addr":"172.21.15.163:6836","nonce":2169087472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/88874113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":88874113},{"type":"v1","addr":"172.21.15.163:6837","nonce":88874113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6177,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1411376794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1411376794},{"type":"v1","addr":"172.21.15.29:6834","nonce":1411376794}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:06:33.362322+0000","modified":"2024-01-24T13:06:36.373536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6180":{"gid":6180,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2075296900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2075296900},{"type":"v1","addr":"172.21.15.29:6835","nonce":2075296900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-24T13:07:06.981 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 26 2024-01-24T13:07:06.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.977+0000 7f3fc9600640 1 -- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f9c065a60 msgr2=0x7f3f9c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:06.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.977+0000 7f3fc9600640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f9c065a60 0x7f3f9c067f20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0af000 tx=0x7f3fac0b6040 comp rx=0 tx=0).stop 2024-01-24T13:07:06.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.977+0000 7f3fc9600640 1 -- 172.21.15.29:0/2708226747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc40b2700 msgr2=0x7f3fc4153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:06.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.977+0000 7f3fc9600640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc40b2700 0x7f3fc4153590 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400c3a0 tx=0x7f3fb400c860 comp rx=0 tx=0).stop 2024-01-24T13:07:06.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.977+0000 7f3fc9600640 1 -- 172.21.15.29:0/2708226747 shutdown_connections 2024-01-24T13:07:06.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.977+0000 7f3fc9600640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3f9c065a60 0x7f3f9c067f20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.977+0000 7f3fc9600640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fc415c730 0x7f3fc40b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.977+0000 7f3fc9600640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fc40ccdb0 0x7f3fc40afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.977+0000 7f3fc9600640 1 --2- 172.21.15.29:0/2708226747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc40b2700 0x7f3fc4153590 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:06.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.977+0000 7f3fc9600640 1 -- 172.21.15.29:0/2708226747 >> 172.21.15.29:0/2708226747 conn(0x7f3fc4070570 msgr2=0x7f3fc40b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:06.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.977+0000 7f3fc9600640 1 -- 172.21.15.29:0/2708226747 shutdown_connections 2024-01-24T13:07:06.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:06.977+0000 7f3fc9600640 1 -- 172.21.15.29:0/2708226747 wait complete. 2024-01-24T13:07:07.003 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:07:07.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.137+0000 7fd97b800640 1 Processor -- start 2024-01-24T13:07:07.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.137+0000 7fd97b800640 1 -- start start 2024-01-24T13:07:07.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd97b800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd974159300 0x7fd9740b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd97b800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd97415d660 0x7fd97406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd97b800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd97406c5b0 con 0x7fd97406bc10 2024-01-24T13:07:07.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd97b800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd974071140 con 0x7fd97415d660 2024-01-24T13:07:07.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd97b800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97415de10 con 0x7fd974159300 2024-01-24T13:07:07.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd973e00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd97406bc10 0x7fd97415cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49528/0 (socket says 172.21.15.29:49528) 2024-01-24T13:07:07.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd973e00640 1 -- 172.21.15.29:0/1082343532 learned_addr learned my addr 172.21.15.29:0/1082343532 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:07.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd979800640 1 --2- 172.21.15.29:0/1082343532 >> v2:172.21.15.29:3300/0 conn(0x7fd97415d660 0x7fd97406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd979800640 1 -- 172.21.15.29:0/1082343532 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd974159300 msgr2=0x7fd9740b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:07.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd978e00640 1 --2- 172.21.15.29:0/1082343532 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd974159300 0x7fd9740b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd973400640 1 -- 172.21.15.29:0/1082343532 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545425469 0 0) 0x7fd97406c5b0 con 0x7fd97406bc10 2024-01-24T13:07:07.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd979800640 1 --2- 172.21.15.29:0/1082343532 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd974159300 0x7fd9740b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd979800640 1 -- 172.21.15.29:0/1082343532 >> v1:172.21.15.29:6789/0 conn(0x7fd97406bc10 legacy=0x7fd97415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd979800640 1 -- 172.21.15.29:0/1082343532 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97415db30 con 0x7fd97415d660 2024-01-24T13:07:07.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.141+0000 7fd978e00640 1 --2- 172.21.15.29:0/1082343532 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd974159300 0x7fd9740b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:07.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.145+0000 7fd979800640 1 --2- 172.21.15.29:0/1082343532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd97415d660 0x7fd97406c070 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009d90 tx=0x7fd96c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ff8690bdba8823 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:07.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.145+0000 7fd973400640 1 -- 172.21.15.29:0/1082343532 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0a5950 con 0x7fd97415d660 2024-01-24T13:07:07.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.145+0000 7fd973400640 1 -- 172.21.15.29:0/1082343532 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96c0a5ab0 con 0x7fd97415d660 2024-01-24T13:07:07.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.145+0000 7fd973400640 1 -- 172.21.15.29:0/1082343532 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0a5e40 con 0x7fd97415d660 2024-01-24T13:07:07.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.145+0000 7fd97b800640 1 -- 172.21.15.29:0/1082343532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd97415d660 msgr2=0x7fd97406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.145+0000 7fd97b800640 1 --2- 172.21.15.29:0/1082343532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd97415d660 0x7fd97406c070 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009d90 tx=0x7fd96c01c890 comp rx=0 tx=0).stop 2024-01-24T13:07:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.145+0000 7fd97b800640 1 -- 172.21.15.29:0/1082343532 shutdown_connections 2024-01-24T13:07:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.145+0000 7fd97b800640 1 --2- 172.21.15.29:0/1082343532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd97415d660 0x7fd97406c070 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.145+0000 7fd97b800640 1 --2- 172.21.15.29:0/1082343532 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd974159300 0x7fd9740b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.145+0000 7fd97b800640 1 -- 172.21.15.29:0/1082343532 >> 172.21.15.29:0/1082343532 conn(0x7fd9740b3950 msgr2=0x7fd974069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.145+0000 7fd97b800640 1 -- 172.21.15.29:0/1082343532 shutdown_connections 2024-01-24T13:07:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.145+0000 7fd97b800640 1 -- 172.21.15.29:0/1082343532 wait complete. 2024-01-24T13:07:07.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.145+0000 7fd97b800640 1 Processor -- start 2024-01-24T13:07:07.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.145+0000 7fd97b800640 1 -- start start 2024-01-24T13:07:07.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd97b800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd97406bc10 0x7fd9741f8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd97b800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd974159300 0x7fd97414a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd97b800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd97415d660 0x7fd9740cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd97b800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9741f8a60 con 0x7fd97406bc10 2024-01-24T13:07:07.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd97b800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd974159f40 con 0x7fd97415d660 2024-01-24T13:07:07.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd97b800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97415a220 con 0x7fd974159300 2024-01-24T13:07:07.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd978e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd97406bc10 0x7fd9741f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd978e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd97406bc10 0x7fd9741f8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34810/0 (socket says 172.21.15.29:34810) 2024-01-24T13:07:07.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd978e00640 1 -- 172.21.15.29:0/1479483792 learned_addr learned my addr 172.21.15.29:0/1479483792 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:07.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd979800640 1 --2- 172.21.15.29:0/1479483792 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd97415d660 0x7fd9740cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd973e00640 1 --2- 172.21.15.29:0/1479483792 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd974159300 0x7fd97414a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd978e00640 1 -- 172.21.15.29:0/1479483792 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd974159300 msgr2=0x7fd97414a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd978e00640 1 --2- 172.21.15.29:0/1479483792 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd974159300 0x7fd97414a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd978e00640 1 -- 172.21.15.29:0/1479483792 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd97415d660 msgr2=0x7fd9740cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd978e00640 1 --2- 172.21.15.29:0/1479483792 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd97415d660 0x7fd9740cde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd978e00640 1 -- 172.21.15.29:0/1479483792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c009a70 con 0x7fd97406bc10 2024-01-24T13:07:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd978e00640 1 --2- 172.21.15.29:0/1479483792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd97406bc10 0x7fd9741f8520 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd96400c7c0 tx=0x7fd96400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd970c00640 1 -- 172.21.15.29:0/1479483792 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964007a30 con 0x7fd97406bc10 2024-01-24T13:07:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd970c00640 1 -- 172.21.15.29:0/1479483792 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964007b90 con 0x7fd97406bc10 2024-01-24T13:07:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd970c00640 1 -- 172.21.15.29:0/1479483792 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96400ce70 con 0x7fd97406bc10 2024-01-24T13:07:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd97b800640 1 -- 172.21.15.29:0/1479483792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97415a500 con 0x7fd97406bc10 2024-01-24T13:07:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd97b800640 1 -- 172.21.15.29:0/1479483792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97415aac0 con 0x7fd97406bc10 2024-01-24T13:07:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.149+0000 7fd97b800640 1 -- 172.21.15.29:0/1479483792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97415ace0 con 0x7fd97406bc10 2024-01-24T13:07:07.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.153+0000 7fd970c00640 1 -- 172.21.15.29:0/1479483792 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd9640113f0 con 0x7fd97406bc10 2024-01-24T13:07:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.153+0000 7fd970c00640 1 --2- 172.21.15.29:0/1479483792 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd94c065a60 0x7fd94c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.153+0000 7fd970c00640 1 -- 172.21.15.29:0/1479483792 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd9640837e0 con 0x7fd97406bc10 2024-01-24T13:07:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.153+0000 7fd973e00640 1 --2- 172.21.15.29:0/1479483792 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd94c065a60 0x7fd94c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.153+0000 7fd973e00640 1 --2- 172.21.15.29:0/1479483792 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd94c065a60 0x7fd94c067f20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd9740cebe0 tx=0x7fd95c007d60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:07.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.157+0000 7fd970c00640 1 -- 172.21.15.29:0/1479483792 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd964051070 con 0x7fd97406bc10 2024-01-24T13:07:07.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.313+0000 7fd97b800640 1 -- 172.21.15.29:0/1479483792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd97404e850 con 0x7fd97406bc10 2024-01-24T13:07:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.317+0000 7fd970c00640 1 -- 172.21.15.29:0/1479483792 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16302 (secure 0 0 0) 0x7fd964054690 con 0x7fd97406bc10 2024-01-24T13:07:07.321 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:07.321 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":59,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:06:34.365221+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:06:31.105908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-24T13:06:32.357292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:07:07.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.317+0000 7fd97b800640 1 -- 172.21.15.29:0/1479483792 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd94c065a60 msgr2=0x7fd94c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.317+0000 7fd97b800640 1 --2- 172.21.15.29:0/1479483792 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd94c065a60 0x7fd94c067f20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd9740cebe0 tx=0x7fd95c007d60 comp rx=0 tx=0).stop 2024-01-24T13:07:07.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.317+0000 7fd97b800640 1 -- 172.21.15.29:0/1479483792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd97406bc10 msgr2=0x7fd9741f8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.317+0000 7fd97b800640 1 --2- 172.21.15.29:0/1479483792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd97406bc10 0x7fd9741f8520 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd96400c7c0 tx=0x7fd96400cc80 comp rx=0 tx=0).stop 2024-01-24T13:07:07.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.317+0000 7fd97b800640 1 -- 172.21.15.29:0/1479483792 shutdown_connections 2024-01-24T13:07:07.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.317+0000 7fd97b800640 1 --2- 172.21.15.29:0/1479483792 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd94c065a60 0x7fd94c067f20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.317+0000 7fd97b800640 1 --2- 172.21.15.29:0/1479483792 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd97415d660 0x7fd9740cde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.317+0000 7fd97b800640 1 --2- 172.21.15.29:0/1479483792 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd974159300 0x7fd97414a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.317+0000 7fd97b800640 1 --2- 172.21.15.29:0/1479483792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd97406bc10 0x7fd9741f8520 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.317+0000 7fd97b800640 1 -- 172.21.15.29:0/1479483792 >> 172.21.15.29:0/1479483792 conn(0x7fd9740b3950 msgr2=0x7fd97414fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:07.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.317+0000 7fd97b800640 1 -- 172.21.15.29:0/1479483792 shutdown_connections 2024-01-24T13:07:07.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.317+0000 7fd97b800640 1 -- 172.21.15.29:0/1479483792 wait complete. 2024-01-24T13:07:07.344 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T13:03:43.595863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T13:06:31.105908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T13:06:32.357292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T13:07:07.344 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T13:07:07.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8dc800640 1 Processor -- start 2024-01-24T13:07:07.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8dc800640 1 -- start start 2024-01-24T13:07:07.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8dc800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8d415c690 0x7fe8d40cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8dc800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe8d40b3360 0x7fe8d40ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8dc800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d4160fc0 con 0x7fe8d40abae0 2024-01-24T13:07:07.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8dc800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d40b2ef0 con 0x7fe8d40b3360 2024-01-24T13:07:07.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8dc800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d41603f0 con 0x7fe8d415c690 2024-01-24T13:07:07.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8da800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe8d40abae0 0x7fe8d406bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49542/0 (socket says 172.21.15.29:49542) 2024-01-24T13:07:07.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8da800640 1 -- 172.21.15.29:0/4232208228 learned_addr learned my addr 172.21.15.29:0/4232208228 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:07.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8d9400640 1 --2- 172.21.15.29:0/4232208228 >> v2:172.21.15.163:3300/0 conn(0x7fe8d40b3360 0x7fe8d40ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8d9e00640 1 --2- 172.21.15.29:0/4232208228 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8d415c690 0x7fe8d40cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8d8a00640 1 -- 172.21.15.29:0/4232208228 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080503785 0 0) 0x7fe8d4160fc0 con 0x7fe8d40abae0 2024-01-24T13:07:07.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8d8a00640 1 -- 172.21.15.29:0/4232208228 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8b4003530 con 0x7fe8d40abae0 2024-01-24T13:07:07.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8d9400640 1 -- 172.21.15.29:0/4232208228 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8d415c690 msgr2=0x7fe8d40cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:07.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8d9400640 1 --2- 172.21.15.29:0/4232208228 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8d415c690 0x7fe8d40cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8d9400640 1 -- 172.21.15.29:0/4232208228 >> v1:172.21.15.29:6789/0 conn(0x7fe8d40abae0 legacy=0x7fe8d406bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8d9400640 1 -- 172.21.15.29:0/4232208228 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4160690 con 0x7fe8d40b3360 2024-01-24T13:07:07.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.485+0000 7fe8d9e00640 1 --2- 172.21.15.29:0/4232208228 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8d415c690 0x7fe8d40cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:07:07.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.489+0000 7fe8d9400640 1 --2- 172.21.15.29:0/4232208228 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8d40b3360 0x7fe8d40ce3e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0097c0 tx=0x7fe8bc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb63d5a32131edb4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:07.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.489+0000 7fe8d8a00640 1 -- 172.21.15.29:0/4232208228 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc0ac640 con 0x7fe8d40b3360 2024-01-24T13:07:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.489+0000 7fe8d8a00640 1 -- 172.21.15.29:0/4232208228 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8bc0ac7a0 con 0x7fe8d40b3360 2024-01-24T13:07:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.489+0000 7fe8d8a00640 1 -- 172.21.15.29:0/4232208228 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc0acb30 con 0x7fe8d40b3360 2024-01-24T13:07:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.489+0000 7fe8dc800640 1 -- 172.21.15.29:0/4232208228 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8d40b3360 msgr2=0x7fe8d40ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.489+0000 7fe8dc800640 1 --2- 172.21.15.29:0/4232208228 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8d40b3360 0x7fe8d40ce3e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0097c0 tx=0x7fe8bc01c3f0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.489+0000 7fe8dc800640 1 -- 172.21.15.29:0/4232208228 shutdown_connections 2024-01-24T13:07:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.489+0000 7fe8dc800640 1 --2- 172.21.15.29:0/4232208228 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8d40b3360 0x7fe8d40ce3e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.489+0000 7fe8dc800640 1 --2- 172.21.15.29:0/4232208228 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8d415c690 0x7fe8d40cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.489+0000 7fe8dc800640 1 -- 172.21.15.29:0/4232208228 >> 172.21.15.29:0/4232208228 conn(0x7fe8d406d700 msgr2=0x7fe8d4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.489+0000 7fe8dc800640 1 -- 172.21.15.29:0/4232208228 shutdown_connections 2024-01-24T13:07:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.489+0000 7fe8dc800640 1 -- 172.21.15.29:0/4232208228 wait complete. 2024-01-24T13:07:07.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8dc800640 1 Processor -- start 2024-01-24T13:07:07.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8dc800640 1 -- start start 2024-01-24T13:07:07.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8dc800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8d40abae0 0x7fe8d413c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8dc800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8d40b3360 0x7fe8d414edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8dc800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d415c690 0x7fe8d414f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8dc800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d4149fb0 con 0x7fe8d415c690 2024-01-24T13:07:07.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8dc800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d413cd60 con 0x7fe8d40abae0 2024-01-24T13:07:07.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8dc800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d4153e70 con 0x7fe8d40b3360 2024-01-24T13:07:07.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8da800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d415c690 0x7fe8d414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8da800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d415c690 0x7fe8d414f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34816/0 (socket says 172.21.15.29:34816) 2024-01-24T13:07:07.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8da800640 1 -- 172.21.15.29:0/3410222459 learned_addr learned my addr 172.21.15.29:0/3410222459 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:07.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8d9400640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8d40b3360 0x7fe8d414edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8d9e00640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8d40abae0 0x7fe8d413c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8da800640 1 -- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8d40b3360 msgr2=0x7fe8d414edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8da800640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8d40b3360 0x7fe8d414edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8da800640 1 -- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8d40abae0 msgr2=0x7fe8d413c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8da800640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8d40abae0 0x7fe8d413c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8da800640 1 -- 172.21.15.29:0/3410222459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c4009420 con 0x7fe8d415c690 2024-01-24T13:07:07.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8d9e00640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8d40abae0 0x7fe8d413c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:07.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8da800640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d415c690 0x7fe8d414f330 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00cad0 tx=0x7fe8cc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:07.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8d2000640 1 -- 172.21.15.29:0/3410222459 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00ac30 con 0x7fe8d415c690 2024-01-24T13:07:07.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8d2000640 1 -- 172.21.15.29:0/3410222459 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc00ad90 con 0x7fe8d415c690 2024-01-24T13:07:07.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8d2000640 1 -- 172.21.15.29:0/3410222459 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc012620 con 0x7fe8d415c690 2024-01-24T13:07:07.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8dc800640 1 -- 172.21.15.29:0/3410222459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc009420 con 0x7fe8d415c690 2024-01-24T13:07:07.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.493+0000 7fe8dc800640 1 -- 172.21.15.29:0/3410222459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d4154430 con 0x7fe8d415c690 2024-01-24T13:07:07.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.497+0000 7fe8dc800640 1 -- 172.21.15.29:0/3410222459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d414a120 con 0x7fe8d415c690 2024-01-24T13:07:07.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.497+0000 7fe8d2000640 1 -- 172.21.15.29:0/3410222459 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe8cc007070 con 0x7fe8d415c690 2024-01-24T13:07:07.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.497+0000 7fe8d2000640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe8ac065a60 0x7fe8ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.497+0000 7fe8d2000640 1 -- 172.21.15.29:0/3410222459 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe8cc0832d0 con 0x7fe8d415c690 2024-01-24T13:07:07.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.497+0000 7fe8d9e00640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe8ac065a60 0x7fe8ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.501+0000 7fe8d9e00640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe8ac065a60 0x7fe8ac067f20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009d40 tx=0x7fe8c4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:07.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.501+0000 7fe8d2000640 1 -- 172.21.15.29:0/3410222459 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe8cc050ad0 con 0x7fe8d415c690 2024-01-24T13:07:07.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.661+0000 7fe8dc800640 1 -- 172.21.15.29:0/3410222459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8d4154620 con 0x7fe8d415c690 2024-01-24T13:07:07.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.661+0000 7fe8d2000640 1 -- 172.21.15.29:0/3410222459 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8cc0540f0 con 0x7fe8d415c690 2024-01-24T13:07:07.665 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-24T13:07:07.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.661+0000 7fe8dc800640 1 -- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe8ac065a60 msgr2=0x7fe8ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.661+0000 7fe8dc800640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe8ac065a60 0x7fe8ac067f20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009d40 tx=0x7fe8c4008040 comp rx=0 tx=0).stop 2024-01-24T13:07:07.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.661+0000 7fe8dc800640 1 -- 172.21.15.29:0/3410222459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d415c690 msgr2=0x7fe8d414f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.661+0000 7fe8dc800640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d415c690 0x7fe8d414f330 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00cad0 tx=0x7fe8cc00cf90 comp rx=0 tx=0).stop 2024-01-24T13:07:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.661+0000 7fe8dc800640 1 -- 172.21.15.29:0/3410222459 shutdown_connections 2024-01-24T13:07:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.661+0000 7fe8dc800640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe8ac065a60 0x7fe8ac067f20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.661+0000 7fe8dc800640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d415c690 0x7fe8d414f330 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.661+0000 7fe8dc800640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe8d40b3360 0x7fe8d414edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.661+0000 7fe8dc800640 1 --2- 172.21.15.29:0/3410222459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8d40abae0 0x7fe8d413c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.661+0000 7fe8dc800640 1 -- 172.21.15.29:0/3410222459 >> 172.21.15.29:0/3410222459 conn(0x7fe8d406d700 msgr2=0x7fe8d406fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.661+0000 7fe8dc800640 1 -- 172.21.15.29:0/3410222459 shutdown_connections 2024-01-24T13:07:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.661+0000 7fe8dc800640 1 -- 172.21.15.29:0/3410222459 wait complete. 2024-01-24T13:07:07.689 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T13:07:07.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.829+0000 7f20f3800640 1 Processor -- start 2024-01-24T13:07:07.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.829+0000 7f20f3800640 1 -- start start 2024-01-24T13:07:07.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.829+0000 7f20f3800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20ec06be20 0x7f20ec15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.829+0000 7f20f3800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f20ec06c200 0x7f20ec15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.829+0000 7f20f3800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec15b4f0 con 0x7f20ec13cda0 2024-01-24T13:07:07.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.829+0000 7f20f3800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ec15b7d0 con 0x7f20ec06c200 2024-01-24T13:07:07.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.829+0000 7f20f3800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0cd0c0 con 0x7f20ec06be20 2024-01-24T13:07:07.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.829+0000 7f20ebe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f20ec06c200 0x7f20ec15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.829+0000 7f20ebe00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f20ec06c200 0x7f20ec15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34820/0 (socket says 172.21.15.29:34820) 2024-01-24T13:07:07.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.829+0000 7f20ebe00640 1 -- 172.21.15.29:0/3253195927 learned_addr learned my addr 172.21.15.29:0/3253195927 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:07.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.829+0000 7f20ebe00640 1 -- 172.21.15.29:0/3253195927 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20ec06be20 msgr2=0x7f20ec15a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:07.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.829+0000 7f20ebe00640 1 --2- 172.21.15.29:0/3253195927 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20ec06be20 0x7f20ec15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.829+0000 7f20ebe00640 1 -- 172.21.15.29:0/3253195927 >> v1:172.21.15.163:6789/0 conn(0x7f20ec13cda0 legacy=0x7f20ec13d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:07.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.829+0000 7f20ebe00640 1 -- 172.21.15.29:0/3253195927 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0cd3a0 con 0x7f20ec06c200 2024-01-24T13:07:07.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.833+0000 7f20ebe00640 1 --2- 172.21.15.29:0/3253195927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20ec06c200 0x7f20ec15af00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009870 tx=0x7f20d401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b0d1b7b66f8721 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:07.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.833+0000 7f20eb400640 1 -- 172.21.15.29:0/3253195927 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d40aa640 con 0x7f20ec06c200 2024-01-24T13:07:07.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.833+0000 7f20eb400640 1 -- 172.21.15.29:0/3253195927 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d40aa7a0 con 0x7f20ec06c200 2024-01-24T13:07:07.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.833+0000 7f20eb400640 1 -- 172.21.15.29:0/3253195927 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d40aab30 con 0x7f20ec06c200 2024-01-24T13:07:07.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.833+0000 7f20f3800640 1 -- 172.21.15.29:0/3253195927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20ec06c200 msgr2=0x7f20ec15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.833+0000 7f20f3800640 1 --2- 172.21.15.29:0/3253195927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20ec06c200 0x7f20ec15af00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009870 tx=0x7f20d401c4c0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.833+0000 7f20f3800640 1 -- 172.21.15.29:0/3253195927 shutdown_connections 2024-01-24T13:07:07.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.833+0000 7f20f3800640 1 --2- 172.21.15.29:0/3253195927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20ec06c200 0x7f20ec15af00 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.833+0000 7f20f3800640 1 --2- 172.21.15.29:0/3253195927 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20ec06be20 0x7f20ec15a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.833+0000 7f20f3800640 1 -- 172.21.15.29:0/3253195927 >> 172.21.15.29:0/3253195927 conn(0x7f20ec06d700 msgr2=0x7f20ec069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:07.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.833+0000 7f20f3800640 1 -- 172.21.15.29:0/3253195927 shutdown_connections 2024-01-24T13:07:07.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.833+0000 7f20f3800640 1 -- 172.21.15.29:0/3253195927 wait complete. 2024-01-24T13:07:07.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20f3800640 1 Processor -- start 2024-01-24T13:07:07.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20f3800640 1 -- start start 2024-01-24T13:07:07.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20f3800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20ec06be20 0x7f20ec0b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20f3800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20ec06c200 0x7f20ec154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20f3800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20ec13cda0 0x7f20ec138ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20f3800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0b0e00 con 0x7f20ec06c200 2024-01-24T13:07:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20f3800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0b10e0 con 0x7f20ec13cda0 2024-01-24T13:07:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20f3800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0b13c0 con 0x7f20ec06be20 2024-01-24T13:07:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20ebe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20ec06c200 0x7f20ec154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20ebe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20ec06c200 0x7f20ec154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34830/0 (socket says 172.21.15.29:34830) 2024-01-24T13:07:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20ebe00640 1 -- 172.21.15.29:0/2685052419 learned_addr learned my addr 172.21.15.29:0/2685052419 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20f1800640 1 --2- 172.21.15.29:0/2685052419 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20ec13cda0 0x7f20ec138ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20f0e00640 1 --2- 172.21.15.29:0/2685052419 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20ec06be20 0x7f20ec0b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20ebe00640 1 -- 172.21.15.29:0/2685052419 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20ec06be20 msgr2=0x7f20ec0b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20ebe00640 1 --2- 172.21.15.29:0/2685052419 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20ec06be20 0x7f20ec0b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20ebe00640 1 -- 172.21.15.29:0/2685052419 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20ec13cda0 msgr2=0x7f20ec138ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20ebe00640 1 --2- 172.21.15.29:0/2685052419 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20ec13cda0 0x7f20ec138ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20ebe00640 1 -- 172.21.15.29:0/2685052419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d40094d0 con 0x7f20ec06c200 2024-01-24T13:07:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20ebe00640 1 --2- 172.21.15.29:0/2685052419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20ec06c200 0x7f20ec154660 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f20d40ac040 tx=0x7f20d401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:07.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20e8c00640 1 -- 172.21.15.29:0/2685052419 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d40bd5f0 con 0x7f20ec06c200 2024-01-24T13:07:07.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20e8c00640 1 -- 172.21.15.29:0/2685052419 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d40bd770 con 0x7f20ec06c200 2024-01-24T13:07:07.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20f3800640 1 -- 172.21.15.29:0/2685052419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec0b16a0 con 0x7f20ec06c200 2024-01-24T13:07:07.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20e8c00640 1 -- 172.21.15.29:0/2685052419 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d40bdb20 con 0x7f20ec06c200 2024-01-24T13:07:07.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.837+0000 7f20f3800640 1 -- 172.21.15.29:0/2685052419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec1391e0 con 0x7f20ec06c200 2024-01-24T13:07:07.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.841+0000 7f20f3800640 1 -- 172.21.15.29:0/2685052419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec04e850 con 0x7f20ec06c200 2024-01-24T13:07:07.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.841+0000 7f20e8c00640 1 -- 172.21.15.29:0/2685052419 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f20d40a8050 con 0x7f20ec06c200 2024-01-24T13:07:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.841+0000 7f20e8c00640 1 --2- 172.21.15.29:0/2685052419 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f20c4065a90 0x7f20c4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.841+0000 7f20e8c00640 1 -- 172.21.15.29:0/2685052419 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f20d411dd50 con 0x7f20ec06c200 2024-01-24T13:07:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.841+0000 7f20f0e00640 1 --2- 172.21.15.29:0/2685052419 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f20c4065a90 0x7f20c4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:07.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.841+0000 7f20f0e00640 1 --2- 172.21.15.29:0/2685052419 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f20c4065a90 0x7f20c4067f50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009990 tx=0x7f20dc009110 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:07.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:07.845+0000 7f20e8c00640 1 -- 172.21.15.29:0/2685052419 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f20d40eb670 con 0x7f20ec06c200 2024-01-24T13:07:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.005+0000 7f20f3800640 1 -- 172.21.15.29:0/2685052419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20ec14b780 con 0x7f20ec06c200 2024-01-24T13:07:08.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.005+0000 7f20e8c00640 1 -- 172.21.15.29:0/2685052419 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20d40eec90 con 0x7f20ec06c200 2024-01-24T13:07:08.011 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-24T13:07:08.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.009+0000 7f20f3800640 1 -- 172.21.15.29:0/2685052419 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f20c4065a90 msgr2=0x7f20c4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.009+0000 7f20f3800640 1 --2- 172.21.15.29:0/2685052419 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f20c4065a90 0x7f20c4067f50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009990 tx=0x7f20dc009110 comp rx=0 tx=0).stop 2024-01-24T13:07:08.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.009+0000 7f20f3800640 1 -- 172.21.15.29:0/2685052419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20ec06c200 msgr2=0x7f20ec154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.009+0000 7f20f3800640 1 --2- 172.21.15.29:0/2685052419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20ec06c200 0x7f20ec154660 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f20d40ac040 tx=0x7f20d401ad00 comp rx=0 tx=0).stop 2024-01-24T13:07:08.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.009+0000 7f20f3800640 1 -- 172.21.15.29:0/2685052419 shutdown_connections 2024-01-24T13:07:08.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.009+0000 7f20f3800640 1 --2- 172.21.15.29:0/2685052419 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f20c4065a90 0x7f20c4067f50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.009+0000 7f20f3800640 1 --2- 172.21.15.29:0/2685052419 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20ec13cda0 0x7f20ec138ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.009+0000 7f20f3800640 1 --2- 172.21.15.29:0/2685052419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20ec06c200 0x7f20ec154660 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.009+0000 7f20f3800640 1 --2- 172.21.15.29:0/2685052419 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f20ec06be20 0x7f20ec0b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.009+0000 7f20f3800640 1 -- 172.21.15.29:0/2685052419 >> 172.21.15.29:0/2685052419 conn(0x7f20ec06d700 msgr2=0x7f20ec150fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:08.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.009+0000 7f20f3800640 1 -- 172.21.15.29:0/2685052419 shutdown_connections 2024-01-24T13:07:08.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.009+0000 7f20f3800640 1 -- 172.21.15.29:0/2685052419 wait complete. 2024-01-24T13:07:08.036 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T13:07:08.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.173+0000 7fd0e2000640 1 Processor -- start 2024-01-24T13:07:08.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0e2000640 1 -- start start 2024-01-24T13:07:08.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0e2000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc13d4b0 0x7fd0dc165130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0e2000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0dc15b4f0 con 0x7fd0dc06be20 2024-01-24T13:07:08.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0e2000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0dc15b7d0 con 0x7fd0dc06c200 2024-01-24T13:07:08.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0e2000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0cd0c0 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0db400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd0dc06be20 0x7fd0dc15a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49544/0 (socket says 172.21.15.29:49544) 2024-01-24T13:07:08.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0db400640 1 -- 172.21.15.29:0/1410582350 learned_addr learned my addr 172.21.15.29:0/1410582350 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:08.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0dbe00640 1 --2- 172.21.15.29:0/1410582350 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc13d4b0 0x7fd0dc165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0da000640 1 -- 172.21.15.29:0/1410582350 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087207963 0 0) 0x7fd0dc15b4f0 con 0x7fd0dc06be20 2024-01-24T13:07:08.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0da000640 1 -- 172.21.15.29:0/1410582350 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0bc003530 con 0x7fd0dc06be20 2024-01-24T13:07:08.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0da000640 1 -- 172.21.15.29:0/1410582350 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242230128 0 0) 0x7fd0dc15b7d0 con 0x7fd0dc06c200 2024-01-24T13:07:08.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0da000640 1 -- 172.21.15.29:0/1410582350 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0dc15b4f0 con 0x7fd0dc06c200 2024-01-24T13:07:08.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0dbe00640 1 -- 172.21.15.29:0/1410582350 >> v1:172.21.15.163:6789/0 conn(0x7fd0dc06c200 legacy=0x7fd0dc13cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0dbe00640 1 -- 172.21.15.29:0/1410582350 >> v1:172.21.15.29:6789/0 conn(0x7fd0dc06be20 legacy=0x7fd0dc15a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.177+0000 7fd0dbe00640 1 -- 172.21.15.29:0/1410582350 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc0cd3a0 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.181+0000 7fd0dbe00640 1 --2- 172.21.15.29:0/1410582350 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc13d4b0 0x7fd0dc165130 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009dc0 tx=0x7fd0d401c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1833cdd8814fa48f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:08.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.181+0000 7fd0da000640 1 -- 172.21.15.29:0/1410582350 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40a5a50 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.181+0000 7fd0da000640 1 -- 172.21.15.29:0/1410582350 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d40a5bb0 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.181+0000 7fd0da000640 1 -- 172.21.15.29:0/1410582350 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40ad440 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.181+0000 7fd0e2000640 1 -- 172.21.15.29:0/1410582350 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc13d4b0 msgr2=0x7fd0dc165130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.181+0000 7fd0e2000640 1 --2- 172.21.15.29:0/1410582350 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc13d4b0 0x7fd0dc165130 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009dc0 tx=0x7fd0d401c930 comp rx=0 tx=0).stop 2024-01-24T13:07:08.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.181+0000 7fd0e2000640 1 -- 172.21.15.29:0/1410582350 shutdown_connections 2024-01-24T13:07:08.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.181+0000 7fd0e2000640 1 --2- 172.21.15.29:0/1410582350 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc13d4b0 0x7fd0dc165130 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.181+0000 7fd0e2000640 1 -- 172.21.15.29:0/1410582350 >> 172.21.15.29:0/1410582350 conn(0x7fd0dc06d700 msgr2=0x7fd0dc069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:08.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.181+0000 7fd0e2000640 1 -- 172.21.15.29:0/1410582350 shutdown_connections 2024-01-24T13:07:08.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.181+0000 7fd0e2000640 1 -- 172.21.15.29:0/1410582350 wait complete. 2024-01-24T13:07:08.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0e2000640 1 Processor -- start 2024-01-24T13:07:08.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0e2000640 1 -- start start 2024-01-24T13:07:08.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0e2000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc06be20 0x7fd0dc139c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0e2000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc06c200 0x7fd0dc14b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0e2000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0dc13d4b0 0x7fd0dc150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0e2000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc13a160 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0e2000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc070190 con 0x7fd0dc06be20 2024-01-24T13:07:08.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0e2000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc070470 con 0x7fd0dc06c200 2024-01-24T13:07:08.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0dc13d4b0 0x7fd0dc150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0dc13d4b0 0x7fd0dc150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34834/0 (socket says 172.21.15.29:34834) 2024-01-24T13:07:08.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0dbe00640 1 -- 172.21.15.29:0/1118291800 learned_addr learned my addr 172.21.15.29:0/1118291800 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:08.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0db400640 1 --2- 172.21.15.29:0/1118291800 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc06be20 0x7fd0dc139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0daa00640 1 --2- 172.21.15.29:0/1118291800 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc06c200 0x7fd0dc14b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0dbe00640 1 -- 172.21.15.29:0/1118291800 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc06c200 msgr2=0x7fd0dc14b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0dbe00640 1 --2- 172.21.15.29:0/1118291800 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc06c200 0x7fd0dc14b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0dbe00640 1 -- 172.21.15.29:0/1118291800 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc06be20 msgr2=0x7fd0dc139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0dbe00640 1 --2- 172.21.15.29:0/1118291800 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc06be20 0x7fd0dc139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0dbe00640 1 -- 172.21.15.29:0/1118291800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d4009a70 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0dbe00640 1 --2- 172.21.15.29:0/1118291800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0dc13d4b0 0x7fd0dc150440 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd0d401a560 tx=0x7fd0d40196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:08.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0d3400640 1 -- 172.21.15.29:0/1118291800 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40adca0 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0d3400640 1 -- 172.21.15.29:0/1118291800 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d40ade00 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0d3400640 1 -- 172.21.15.29:0/1118291800 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40b9690 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0e2000640 1 -- 172.21.15.29:0/1118291800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc070750 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.185+0000 7fd0e2000640 1 -- 172.21.15.29:0/1118291800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc070d10 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.189+0000 7fd0e2000640 1 -- 172.21.15.29:0/1118291800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc070f00 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.189+0000 7fd0d3400640 1 -- 172.21.15.29:0/1118291800 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd0d40b97f0 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.189+0000 7fd0d3400640 1 --2- 172.21.15.29:0/1118291800 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd0b4065a60 0x7fd0b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.189+0000 7fd0d3400640 1 -- 172.21.15.29:0/1118291800 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd0d411e940 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.189+0000 7fd0db400640 1 --2- 172.21.15.29:0/1118291800 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd0b4065a60 0x7fd0b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.189+0000 7fd0db400640 1 --2- 172.21.15.29:0/1118291800 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd0b4065a60 0x7fd0b4067f20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc007fd0 tx=0x7fd0cc007d80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:08.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.193+0000 7fd0d3400640 1 -- 172.21.15.29:0/1118291800 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd0d40ec440 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.349+0000 7fd0e2000640 1 -- 172.21.15.29:0/1118291800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0dc04e850 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.349+0000 7fd0d3400640 1 -- 172.21.15.29:0/1118291800 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0d4009450 con 0x7fd0dc13d4b0 2024-01-24T13:07:08.355 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-24T13:07:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.353+0000 7fd0e2000640 1 -- 172.21.15.29:0/1118291800 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd0b4065a60 msgr2=0x7fd0b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.353+0000 7fd0e2000640 1 --2- 172.21.15.29:0/1118291800 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd0b4065a60 0x7fd0b4067f20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc007fd0 tx=0x7fd0cc007d80 comp rx=0 tx=0).stop 2024-01-24T13:07:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.353+0000 7fd0e2000640 1 -- 172.21.15.29:0/1118291800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0dc13d4b0 msgr2=0x7fd0dc150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.353+0000 7fd0e2000640 1 --2- 172.21.15.29:0/1118291800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0dc13d4b0 0x7fd0dc150440 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd0d401a560 tx=0x7fd0d40196d0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.353+0000 7fd0e2000640 1 -- 172.21.15.29:0/1118291800 shutdown_connections 2024-01-24T13:07:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.353+0000 7fd0e2000640 1 --2- 172.21.15.29:0/1118291800 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd0b4065a60 0x7fd0b4067f20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.353+0000 7fd0e2000640 1 --2- 172.21.15.29:0/1118291800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0dc13d4b0 0x7fd0dc150440 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.353+0000 7fd0e2000640 1 --2- 172.21.15.29:0/1118291800 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc06c200 0x7fd0dc14b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.353+0000 7fd0e2000640 1 --2- 172.21.15.29:0/1118291800 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc06be20 0x7fd0dc139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.353+0000 7fd0e2000640 1 -- 172.21.15.29:0/1118291800 >> 172.21.15.29:0/1118291800 conn(0x7fd0dc06d700 msgr2=0x7fd0dc15e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.353+0000 7fd0e2000640 1 -- 172.21.15.29:0/1118291800 shutdown_connections 2024-01-24T13:07:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.353+0000 7fd0e2000640 1 -- 172.21.15.29:0/1118291800 wait complete. 2024-01-24T13:07:08.378 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:07:08.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.513+0000 7f1e38400640 1 Processor -- start 2024-01-24T13:07:08.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.513+0000 7f1e38400640 1 -- start start 2024-01-24T13:07:08.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.517+0000 7f1e38400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1e300cf790 0x7f1e300cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.517+0000 7f1e38400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1e300cce80 0x7f1e300cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.517+0000 7f1e38400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e300719c0 con 0x7f1e300ceea0 2024-01-24T13:07:08.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.517+0000 7f1e38400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3006d810 con 0x7f1e300cf790 2024-01-24T13:07:08.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.517+0000 7f1e38400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e300d00b0 con 0x7f1e300cce80 2024-01-24T13:07:08.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.517+0000 7f1e35a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1e300cf790 0x7f1e300cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.517+0000 7f1e35a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1e300cf790 0x7f1e300cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34848/0 (socket says 172.21.15.29:34848) 2024-01-24T13:07:08.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.517+0000 7f1e35a00640 1 -- 172.21.15.29:0/1326108306 learned_addr learned my addr 172.21.15.29:0/1326108306 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:08.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.517+0000 7f1e35a00640 1 -- 172.21.15.29:0/1326108306 >> v2:172.21.15.163:3300/0 conn(0x7f1e300cce80 msgr2=0x7f1e300cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:08.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.517+0000 7f1e36400640 1 --2- 172.21.15.29:0/1326108306 >> v2:172.21.15.163:3300/0 conn(0x7f1e300cce80 0x7f1e300cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.517+0000 7f1e35a00640 1 --2- 172.21.15.29:0/1326108306 >> v2:172.21.15.163:3300/0 conn(0x7f1e300cce80 0x7f1e300cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.517+0000 7f1e35a00640 1 -- 172.21.15.29:0/1326108306 >> v1:172.21.15.163:6789/0 conn(0x7f1e300ceea0 legacy=0x7f1e3006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:08.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.517+0000 7f1e35a00640 1 -- 172.21.15.29:0/1326108306 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e30070db0 con 0x7f1e300cf790 2024-01-24T13:07:08.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.517+0000 7f1e36400640 1 --2- 172.21.15.29:0/1326108306 >> v2:172.21.15.163:3300/0 conn(0x7f1e300cce80 0x7f1e300cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:08.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.521+0000 7f1e35a00640 1 --2- 172.21.15.29:0/1326108306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e300cf790 0x7f1e300cfb70 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1e30070ad0 tx=0x7f1e2001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1d14285fb8eec6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:08.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.521+0000 7f1e2fe00640 1 -- 172.21.15.29:0/1326108306 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e200ab600 con 0x7f1e300cf790 2024-01-24T13:07:08.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.521+0000 7f1e2fe00640 1 -- 172.21.15.29:0/1326108306 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e200ab760 con 0x7f1e300cf790 2024-01-24T13:07:08.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.521+0000 7f1e2fe00640 1 -- 172.21.15.29:0/1326108306 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e200abaf0 con 0x7f1e300cf790 2024-01-24T13:07:08.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.521+0000 7f1e38400640 1 -- 172.21.15.29:0/1326108306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e300cf790 msgr2=0x7f1e300cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.521+0000 7f1e38400640 1 --2- 172.21.15.29:0/1326108306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e300cf790 0x7f1e300cfb70 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1e30070ad0 tx=0x7f1e2001c400 comp rx=0 tx=0).stop 2024-01-24T13:07:08.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.521+0000 7f1e38400640 1 -- 172.21.15.29:0/1326108306 shutdown_connections 2024-01-24T13:07:08.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.521+0000 7f1e38400640 1 --2- 172.21.15.29:0/1326108306 >> v2:172.21.15.163:3300/0 conn(0x7f1e300cce80 0x7f1e300cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.521+0000 7f1e38400640 1 --2- 172.21.15.29:0/1326108306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e300cf790 0x7f1e300cfb70 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.521+0000 7f1e38400640 1 -- 172.21.15.29:0/1326108306 >> 172.21.15.29:0/1326108306 conn(0x7f1e3006b1e0 msgr2=0x7f1e3006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:08.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.521+0000 7f1e38400640 1 -- 172.21.15.29:0/1326108306 shutdown_connections 2024-01-24T13:07:08.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.521+0000 7f1e38400640 1 -- 172.21.15.29:0/1326108306 wait complete. 2024-01-24T13:07:08.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.521+0000 7f1e38400640 1 Processor -- start 2024-01-24T13:07:08.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e38400640 1 -- start start 2024-01-24T13:07:08.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e38400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1e300cce80 0x7f1e301521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e38400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e300ceea0 0x7f1e300ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e38400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1e300cf790 0x7f1e300c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e38400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300ad920 con 0x7f1e300ceea0 2024-01-24T13:07:08.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e38400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300ad320 con 0x7f1e300cce80 2024-01-24T13:07:08.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e38400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3015bcf0 con 0x7f1e300cf790 2024-01-24T13:07:08.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e35000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e300ceea0 0x7f1e300ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e35000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e300ceea0 0x7f1e300ac9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34850/0 (socket says 172.21.15.29:34850) 2024-01-24T13:07:08.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e35000640 1 -- 172.21.15.29:0/520045818 learned_addr learned my addr 172.21.15.29:0/520045818 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:08.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e35a00640 1 --2- 172.21.15.29:0/520045818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1e300cce80 0x7f1e301521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e36400640 1 --2- 172.21.15.29:0/520045818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1e300cf790 0x7f1e300c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e35000640 1 -- 172.21.15.29:0/520045818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1e300cf790 msgr2=0x7f1e300c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e35000640 1 --2- 172.21.15.29:0/520045818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1e300cf790 0x7f1e300c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e35000640 1 -- 172.21.15.29:0/520045818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1e300cce80 msgr2=0x7f1e301521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e35000640 1 --2- 172.21.15.29:0/520045818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1e300cce80 0x7f1e301521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e35000640 1 -- 172.21.15.29:0/520045818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e200094d0 con 0x7f1e300ceea0 2024-01-24T13:07:08.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e35000640 1 --2- 172.21.15.29:0/520045818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e300ceea0 0x7f1e300ac9b0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800b3e0 tx=0x7f1e1800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:08.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e2d600640 1 -- 172.21.15.29:0/520045818 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18011830 con 0x7f1e300ceea0 2024-01-24T13:07:08.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e2d600640 1 -- 172.21.15.29:0/520045818 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e18011990 con 0x7f1e300ceea0 2024-01-24T13:07:08.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e2d600640 1 -- 172.21.15.29:0/520045818 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18011d80 con 0x7f1e300ceea0 2024-01-24T13:07:08.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e38400640 1 -- 172.21.15.29:0/520045818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e30071fd0 con 0x7f1e300ceea0 2024-01-24T13:07:08.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e38400640 1 -- 172.21.15.29:0/520045818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3015c220 con 0x7f1e300ceea0 2024-01-24T13:07:08.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.525+0000 7f1e38400640 1 -- 172.21.15.29:0/520045818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e30071e30 con 0x7f1e300ceea0 2024-01-24T13:07:08.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.529+0000 7f1e2d600640 1 -- 172.21.15.29:0/520045818 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1e1801a400 con 0x7f1e300ceea0 2024-01-24T13:07:08.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.529+0000 7f1e2d600640 1 --2- 172.21.15.29:0/520045818 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1e08065a60 0x7f1e08067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.529+0000 7f1e2d600640 1 -- 172.21.15.29:0/520045818 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1e18082f90 con 0x7f1e300ceea0 2024-01-24T13:07:08.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.529+0000 7f1e35a00640 1 --2- 172.21.15.29:0/520045818 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1e08065a60 0x7f1e08067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.529+0000 7f1e35a00640 1 --2- 172.21.15.29:0/520045818 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1e08065a60 0x7f1e08067f20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1e200af000 tx=0x7f1e200b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:08.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.533+0000 7f1e2d600640 1 -- 172.21.15.29:0/520045818 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1e30071e30 con 0x7f1e300ceea0 2024-01-24T13:07:08.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.721+0000 7f1e38400640 1 -- 172.21.15.29:0/520045818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e30071e30 con 0x7f1e300ceea0 2024-01-24T13:07:08.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.725+0000 7f1e2d600640 1 -- 172.21.15.29:0/520045818 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f1e30071e30 con 0x7f1e300ceea0 2024-01-24T13:07:08.728 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:08.729 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/2169087472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2169087472},{"type":"v1","addr":"172.21.15.163:6836","nonce":2169087472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/88874113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":88874113},{"type":"v1","addr":"172.21.15.163:6837","nonce":88874113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6177,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1411376794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1411376794},{"type":"v1","addr":"172.21.15.29:6834","nonce":1411376794}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:06:33.362322+0000","modified":"2024-01-24T13:06:36.373536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6180":{"gid":6180,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2075296900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2075296900},{"type":"v1","addr":"172.21.15.29:6835","nonce":2075296900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-24T13:07:08.729 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 26 2024-01-24T13:07:08.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.725+0000 7f1e38400640 1 -- 172.21.15.29:0/520045818 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1e08065a60 msgr2=0x7f1e08067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.725+0000 7f1e38400640 1 --2- 172.21.15.29:0/520045818 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1e08065a60 0x7f1e08067f20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1e200af000 tx=0x7f1e200b6040 comp rx=0 tx=0).stop 2024-01-24T13:07:08.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.725+0000 7f1e38400640 1 -- 172.21.15.29:0/520045818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e300ceea0 msgr2=0x7f1e300ac9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.725+0000 7f1e38400640 1 --2- 172.21.15.29:0/520045818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e300ceea0 0x7f1e300ac9b0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800b3e0 tx=0x7f1e1800b8a0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.725+0000 7f1e38400640 1 -- 172.21.15.29:0/520045818 shutdown_connections 2024-01-24T13:07:08.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.725+0000 7f1e38400640 1 --2- 172.21.15.29:0/520045818 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1e08065a60 0x7f1e08067f20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.725+0000 7f1e38400640 1 --2- 172.21.15.29:0/520045818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1e300cf790 0x7f1e300c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.725+0000 7f1e38400640 1 --2- 172.21.15.29:0/520045818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e300ceea0 0x7f1e300ac9b0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.725+0000 7f1e38400640 1 --2- 172.21.15.29:0/520045818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1e300cce80 0x7f1e301521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.725+0000 7f1e38400640 1 -- 172.21.15.29:0/520045818 >> 172.21.15.29:0/520045818 conn(0x7f1e3006b1e0 msgr2=0x7f1e3006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:08.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.725+0000 7f1e38400640 1 -- 172.21.15.29:0/520045818 shutdown_connections 2024-01-24T13:07:08.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.725+0000 7f1e38400640 1 -- 172.21.15.29:0/520045818 wait complete. 2024-01-24T13:07:08.751 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:07:08.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.885+0000 7fb4eda00640 1 Processor -- start 2024-01-24T13:07:08.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4eda00640 1 -- start start 2024-01-24T13:07:08.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4eda00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb4e815c730 0x7fb4e806b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4eda00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb4e80b2700 0x7fb4e80ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4eda00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4e80ccdb0 0x7fb4e80cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4eda00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e80cd720 con 0x7fb4e815c730 2024-01-24T13:07:08.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4eda00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e806cc10 con 0x7fb4e80b2700 2024-01-24T13:07:08.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4eda00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e806b7a0 con 0x7fb4e80ccdb0 2024-01-24T13:07:08.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4e6a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb4e815c730 0x7fb4e806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4e6a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb4e815c730 0x7fb4e806b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34858/0 (socket says 172.21.15.29:34858) 2024-01-24T13:07:08.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4e6a00640 1 -- 172.21.15.29:0/3387349159 learned_addr learned my addr 172.21.15.29:0/3387349159 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:08.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4e6000640 1 --2- 172.21.15.29:0/3387349159 >> v2:172.21.15.163:3300/0 conn(0x7fb4e80b2700 0x7fb4e80ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4e7400640 1 --2- 172.21.15.29:0/3387349159 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4e80ccdb0 0x7fb4e80cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4e6a00640 1 -- 172.21.15.29:0/3387349159 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4e80ccdb0 msgr2=0x7fb4e80cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:08.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4e6a00640 1 --2- 172.21.15.29:0/3387349159 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4e80ccdb0 0x7fb4e80cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4e6a00640 1 -- 172.21.15.29:0/3387349159 >> v2:172.21.15.163:3300/0 conn(0x7fb4e80b2700 msgr2=0x7fb4e80ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:08.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4e6a00640 1 --2- 172.21.15.29:0/3387349159 >> v2:172.21.15.163:3300/0 conn(0x7fb4e80b2700 0x7fb4e80ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4e6a00640 1 -- 172.21.15.29:0/3387349159 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e806ba80 con 0x7fb4e815c730 2024-01-24T13:07:08.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.889+0000 7fb4e7400640 1 --2- 172.21.15.29:0/3387349159 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4e80ccdb0 0x7fb4e80cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:08.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4e6a00640 1 --2- 172.21.15.29:0/3387349159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4e815c730 0x7fb4e806b110 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80cdd00 tx=0x7fb4d801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c2e9c133f9629c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:08.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4e5600640 1 -- 172.21.15.29:0/3387349159 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80aa5f0 con 0x7fb4e815c730 2024-01-24T13:07:08.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4e5600640 1 -- 172.21.15.29:0/3387349159 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d80aa750 con 0x7fb4e815c730 2024-01-24T13:07:08.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4e5600640 1 -- 172.21.15.29:0/3387349159 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80aaae0 con 0x7fb4e815c730 2024-01-24T13:07:08.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4eda00640 1 -- 172.21.15.29:0/3387349159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4e815c730 msgr2=0x7fb4e806b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4eda00640 1 --2- 172.21.15.29:0/3387349159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4e815c730 0x7fb4e806b110 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80cdd00 tx=0x7fb4d801c4d0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4eda00640 1 -- 172.21.15.29:0/3387349159 shutdown_connections 2024-01-24T13:07:08.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4eda00640 1 --2- 172.21.15.29:0/3387349159 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4e80ccdb0 0x7fb4e80cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4eda00640 1 --2- 172.21.15.29:0/3387349159 >> v2:172.21.15.163:3300/0 conn(0x7fb4e80b2700 0x7fb4e80ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4eda00640 1 --2- 172.21.15.29:0/3387349159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4e815c730 0x7fb4e806b110 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4eda00640 1 -- 172.21.15.29:0/3387349159 >> 172.21.15.29:0/3387349159 conn(0x7fb4e8070570 msgr2=0x7fb4e8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:08.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4eda00640 1 -- 172.21.15.29:0/3387349159 shutdown_connections 2024-01-24T13:07:08.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4eda00640 1 -- 172.21.15.29:0/3387349159 wait complete. 2024-01-24T13:07:08.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4eda00640 1 Processor -- start 2024-01-24T13:07:08.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.893+0000 7fb4eda00640 1 -- start start 2024-01-24T13:07:08.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4eda00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4e80b2700 0x7fb4e80c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4eda00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4e80ccdb0 0x7fb4e81556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4eda00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb4e815c730 0x7fb4e80c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4eda00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c4290 con 0x7fb4e80b2700 2024-01-24T13:07:08.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4eda00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c4570 con 0x7fb4e815c730 2024-01-24T13:07:08.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4eda00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c4850 con 0x7fb4e80ccdb0 2024-01-24T13:07:08.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4e6a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4e80b2700 0x7fb4e80c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4e6000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4e80ccdb0 0x7fb4e81556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4e6a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4e80b2700 0x7fb4e80c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34874/0 (socket says 172.21.15.29:34874) 2024-01-24T13:07:08.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4e6a00640 1 -- 172.21.15.29:0/2924037994 learned_addr learned my addr 172.21.15.29:0/2924037994 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:08.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4e7400640 1 --2- 172.21.15.29:0/2924037994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb4e815c730 0x7fb4e80c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4e6a00640 1 -- 172.21.15.29:0/2924037994 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4e80ccdb0 msgr2=0x7fb4e81556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4e6a00640 1 --2- 172.21.15.29:0/2924037994 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4e80ccdb0 0x7fb4e81556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4e6a00640 1 -- 172.21.15.29:0/2924037994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb4e815c730 msgr2=0x7fb4e80c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:08.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4e6a00640 1 --2- 172.21.15.29:0/2924037994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb4e815c730 0x7fb4e80c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:08.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4e6a00640 1 -- 172.21.15.29:0/2924037994 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d80094d0 con 0x7fb4e80b2700 2024-01-24T13:07:08.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4e6a00640 1 --2- 172.21.15.29:0/2924037994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4e80b2700 0x7fb4e80c5330 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb4d801ab80 tx=0x7fb4d801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:08.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4dea00640 1 -- 172.21.15.29:0/2924037994 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80aa5f0 con 0x7fb4e80b2700 2024-01-24T13:07:08.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4dea00640 1 -- 172.21.15.29:0/2924037994 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d80b3800 con 0x7fb4e80b2700 2024-01-24T13:07:08.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4dea00640 1 -- 172.21.15.29:0/2924037994 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80b3bb0 con 0x7fb4e80b2700 2024-01-24T13:07:08.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4eda00640 1 -- 172.21.15.29:0/2924037994 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e80c4b30 con 0x7fb4e80b2700 2024-01-24T13:07:08.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4eda00640 1 -- 172.21.15.29:0/2924037994 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e80c83c0 con 0x7fb4e80b2700 2024-01-24T13:07:08.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.897+0000 7fb4eda00640 1 -- 172.21.15.29:0/2924037994 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e80cf430 con 0x7fb4e80b2700 2024-01-24T13:07:08.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.901+0000 7fb4dea00640 1 -- 172.21.15.29:0/2924037994 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb4d80b3d10 con 0x7fb4e80b2700 2024-01-24T13:07:08.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.901+0000 7fb4dea00640 1 --2- 172.21.15.29:0/2924037994 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb4c0065a60 0x7fb4c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:08.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.901+0000 7fb4dea00640 1 -- 172.21.15.29:0/2924037994 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb4d80a7070 con 0x7fb4e80b2700 2024-01-24T13:07:08.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.901+0000 7fb4e6000640 1 --2- 172.21.15.29:0/2924037994 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb4c0065a60 0x7fb4c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:08.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.901+0000 7fb4e6000640 1 --2- 172.21.15.29:0/2924037994 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb4c0065a60 0x7fb4c0067f20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8158360 tx=0x7fb4d0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:08.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:08.905+0000 7fb4dea00640 1 -- 172.21.15.29:0/2924037994 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb4d80eb120 con 0x7fb4e80b2700 2024-01-24T13:07:09.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.065+0000 7fb4eda00640 1 -- 172.21.15.29:0/2924037994 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4e8073770 con 0x7fb4e80b2700 2024-01-24T13:07:09.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.065+0000 7fb4dea00640 1 -- 172.21.15.29:0/2924037994 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16302 (secure 0 0 0) 0x7fb4e8073770 con 0x7fb4e80b2700 2024-01-24T13:07:09.070 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:09.070 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":59,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:06:34.365221+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:06:31.105908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-24T13:06:32.357292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:07:09.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.065+0000 7fb4eda00640 1 -- 172.21.15.29:0/2924037994 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb4c0065a60 msgr2=0x7fb4c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.065+0000 7fb4eda00640 1 --2- 172.21.15.29:0/2924037994 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb4c0065a60 0x7fb4c0067f20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8158360 tx=0x7fb4d0008040 comp rx=0 tx=0).stop 2024-01-24T13:07:09.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.065+0000 7fb4eda00640 1 -- 172.21.15.29:0/2924037994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4e80b2700 msgr2=0x7fb4e80c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.065+0000 7fb4eda00640 1 --2- 172.21.15.29:0/2924037994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4e80b2700 0x7fb4e80c5330 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb4d801ab80 tx=0x7fb4d801ad10 comp rx=0 tx=0).stop 2024-01-24T13:07:09.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.069+0000 7fb4eda00640 1 -- 172.21.15.29:0/2924037994 shutdown_connections 2024-01-24T13:07:09.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.069+0000 7fb4eda00640 1 --2- 172.21.15.29:0/2924037994 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fb4c0065a60 0x7fb4c0067f20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.069+0000 7fb4eda00640 1 --2- 172.21.15.29:0/2924037994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb4e815c730 0x7fb4e80c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.069+0000 7fb4eda00640 1 --2- 172.21.15.29:0/2924037994 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb4e80ccdb0 0x7fb4e81556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.069+0000 7fb4eda00640 1 --2- 172.21.15.29:0/2924037994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4e80b2700 0x7fb4e80c5330 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.069+0000 7fb4eda00640 1 -- 172.21.15.29:0/2924037994 >> 172.21.15.29:0/2924037994 conn(0x7fb4e8070570 msgr2=0x7fb4e80b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:09.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.069+0000 7fb4eda00640 1 -- 172.21.15.29:0/2924037994 shutdown_connections 2024-01-24T13:07:09.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.069+0000 7fb4eda00640 1 -- 172.21.15.29:0/2924037994 wait complete. 2024-01-24T13:07:09.093 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-24T13:07:09.093 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:07:09.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.229+0000 7f04c5000640 1 Processor -- start 2024-01-24T13:07:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.229+0000 7f04c5000640 1 -- start start 2024-01-24T13:07:09.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.229+0000 7f04c5000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f04c0143910 0x7f04c0143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.229+0000 7f04c5000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04c0070ac0 0x7f04c006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.229+0000 7f04c5000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f04c006c150 0x7f04c015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.229+0000 7f04c5000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c006c5e0 con 0x7f04c0143910 2024-01-24T13:07:09.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.229+0000 7f04c5000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c015aa30 con 0x7f04c006c150 2024-01-24T13:07:09.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.229+0000 7f04c5000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c00712a0 con 0x7f04c0070ac0 2024-01-24T13:07:09.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04bde00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f04c0143910 0x7f04c0143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04bde00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f04c0143910 0x7f04c0143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34876/0 (socket says 172.21.15.29:34876) 2024-01-24T13:07:09.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04bde00640 1 -- 172.21.15.29:0/345167398 learned_addr learned my addr 172.21.15.29:0/345167398 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:09.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04bd400640 1 --2- 172.21.15.29:0/345167398 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04c0070ac0 0x7f04c006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04be800640 1 --2- 172.21.15.29:0/345167398 >> v2:172.21.15.163:3300/0 conn(0x7f04c006c150 0x7f04c015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04bde00640 1 -- 172.21.15.29:0/345167398 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04c0070ac0 msgr2=0x7f04c006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:09.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04bde00640 1 --2- 172.21.15.29:0/345167398 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04c0070ac0 0x7f04c006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04bde00640 1 -- 172.21.15.29:0/345167398 >> v2:172.21.15.163:3300/0 conn(0x7f04c006c150 msgr2=0x7f04c015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:09.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04bde00640 1 --2- 172.21.15.29:0/345167398 >> v2:172.21.15.163:3300/0 conn(0x7f04c006c150 0x7f04c015dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04bde00640 1 -- 172.21.15.29:0/345167398 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c0071580 con 0x7f04c0143910 2024-01-24T13:07:09.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04be800640 1 --2- 172.21.15.29:0/345167398 >> v2:172.21.15.163:3300/0 conn(0x7f04c006c150 0x7f04c015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:09.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04bd400640 1 --2- 172.21.15.29:0/345167398 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04c0070ac0 0x7f04c006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:09.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04bde00640 1 --2- 172.21.15.29:0/345167398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04c0143910 0x7f04c0143d30 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f04c006a970 tx=0x7f04b001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b063da70197eea server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:09.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04bca00640 1 -- 172.21.15.29:0/345167398 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b00ab600 con 0x7f04c0143910 2024-01-24T13:07:09.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04bca00640 1 -- 172.21.15.29:0/345167398 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b00a7050 con 0x7f04c0143910 2024-01-24T13:07:09.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.233+0000 7f04bca00640 1 -- 172.21.15.29:0/345167398 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b00ab980 con 0x7f04c0143910 2024-01-24T13:07:09.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 -- 172.21.15.29:0/345167398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04c0143910 msgr2=0x7f04c0143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 --2- 172.21.15.29:0/345167398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04c0143910 0x7f04c0143d30 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f04c006a970 tx=0x7f04b001c210 comp rx=0 tx=0).stop 2024-01-24T13:07:09.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 -- 172.21.15.29:0/345167398 shutdown_connections 2024-01-24T13:07:09.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 --2- 172.21.15.29:0/345167398 >> v2:172.21.15.163:3300/0 conn(0x7f04c006c150 0x7f04c015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 --2- 172.21.15.29:0/345167398 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04c0070ac0 0x7f04c006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 --2- 172.21.15.29:0/345167398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04c0143910 0x7f04c0143d30 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 -- 172.21.15.29:0/345167398 >> 172.21.15.29:0/345167398 conn(0x7f04c00b3950 msgr2=0x7f04c0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:09.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 -- 172.21.15.29:0/345167398 shutdown_connections 2024-01-24T13:07:09.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 -- 172.21.15.29:0/345167398 wait complete. 2024-01-24T13:07:09.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 Processor -- start 2024-01-24T13:07:09.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 -- start start 2024-01-24T13:07:09.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04c006c150 0x7f04c0157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04c0070ac0 0x7f04c015fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04c0143910 0x7f04c0158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0160bd0 con 0x7f04c006c150 2024-01-24T13:07:09.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c00ab500 con 0x7f04c0143910 2024-01-24T13:07:09.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04c5000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0160610 con 0x7f04c0070ac0 2024-01-24T13:07:09.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04bde00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04c006c150 0x7f04c0157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04bde00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04c006c150 0x7f04c0157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34884/0 (socket says 172.21.15.29:34884) 2024-01-24T13:07:09.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.237+0000 7f04bde00640 1 -- 172.21.15.29:0/1169174859 learned_addr learned my addr 172.21.15.29:0/1169174859 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:09.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04bd400640 1 --2- 172.21.15.29:0/1169174859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04c0070ac0 0x7f04c015fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04be800640 1 --2- 172.21.15.29:0/1169174859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04c0143910 0x7f04c0158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04bde00640 1 -- 172.21.15.29:0/1169174859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04c0070ac0 msgr2=0x7f04c015fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04bde00640 1 --2- 172.21.15.29:0/1169174859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04c0070ac0 0x7f04c015fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04bde00640 1 -- 172.21.15.29:0/1169174859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04c0143910 msgr2=0x7f04c0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04bde00640 1 --2- 172.21.15.29:0/1169174859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04c0143910 0x7f04c0158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04bde00640 1 -- 172.21.15.29:0/1169174859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00094d0 con 0x7f04c006c150 2024-01-24T13:07:09.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04bde00640 1 --2- 172.21.15.29:0/1169174859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04c006c150 0x7f04c0157100 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f04b0000c10 tx=0x7f04b0018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:09.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04b6000640 1 -- 172.21.15.29:0/1169174859 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b00b5600 con 0x7f04c006c150 2024-01-24T13:07:09.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04b6000640 1 -- 172.21.15.29:0/1169174859 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b00b5780 con 0x7f04c006c150 2024-01-24T13:07:09.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04c5000640 1 -- 172.21.15.29:0/1169174859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c01608f0 con 0x7f04c006c150 2024-01-24T13:07:09.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04b6000640 1 -- 172.21.15.29:0/1169174859 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b00b5b30 con 0x7f04c006c150 2024-01-24T13:07:09.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04c5000640 1 -- 172.21.15.29:0/1169174859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c00ab9f0 con 0x7f04c006c150 2024-01-24T13:07:09.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04c5000640 1 -- 172.21.15.29:0/1169174859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c00cbd00 con 0x7f04c006c150 2024-01-24T13:07:09.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.241+0000 7f04b6000640 1 -- 172.21.15.29:0/1169174859 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f04b00b5c90 con 0x7f04c006c150 2024-01-24T13:07:09.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.245+0000 7f04b6000640 1 --2- 172.21.15.29:0/1169174859 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0498065a90 0x7f0498067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.245+0000 7f04b6000640 1 -- 172.21.15.29:0/1169174859 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f04b011d610 con 0x7f04c006c150 2024-01-24T13:07:09.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.245+0000 7f04bd400640 1 --2- 172.21.15.29:0/1169174859 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0498065a90 0x7f0498067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.245+0000 7f04bd400640 1 --2- 172.21.15.29:0/1169174859 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0498065a90 0x7f0498067f50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f04c00ab430 tx=0x7f04a8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:09.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.249+0000 7f04b6000640 1 -- 172.21.15.29:0/1169174859 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f04b00eadf0 con 0x7f04c006c150 2024-01-24T13:07:09.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.437+0000 7f04c5000640 1 -- 172.21.15.29:0/1169174859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04c004e850 con 0x7f04c006c150 2024-01-24T13:07:09.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.437+0000 7f04b6000640 1 -- 172.21.15.29:0/1169174859 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f04b00ee410 con 0x7f04c006c150 2024-01-24T13:07:09.441 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:09.441 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/2169087472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2169087472},{"type":"v1","addr":"172.21.15.163:6836","nonce":2169087472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/88874113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":88874113},{"type":"v1","addr":"172.21.15.163:6837","nonce":88874113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6177,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1411376794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1411376794},{"type":"v1","addr":"172.21.15.29:6834","nonce":1411376794}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:06:33.362322+0000","modified":"2024-01-24T13:06:36.373536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6180":{"gid":6180,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2075296900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2075296900},{"type":"v1","addr":"172.21.15.29:6835","nonce":2075296900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-24T13:07:09.442 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 26 2024-01-24T13:07:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.437+0000 7f04c5000640 1 -- 172.21.15.29:0/1169174859 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0498065a90 msgr2=0x7f0498067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.437+0000 7f04c5000640 1 --2- 172.21.15.29:0/1169174859 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0498065a90 0x7f0498067f50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f04c00ab430 tx=0x7f04a8008040 comp rx=0 tx=0).stop 2024-01-24T13:07:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.437+0000 7f04c5000640 1 -- 172.21.15.29:0/1169174859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04c006c150 msgr2=0x7f04c0157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.437+0000 7f04c5000640 1 --2- 172.21.15.29:0/1169174859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04c006c150 0x7f04c0157100 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f04b0000c10 tx=0x7f04b0018fb0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.437+0000 7f04c5000640 1 -- 172.21.15.29:0/1169174859 shutdown_connections 2024-01-24T13:07:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.437+0000 7f04c5000640 1 --2- 172.21.15.29:0/1169174859 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f0498065a90 0x7f0498067f50 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.437+0000 7f04c5000640 1 --2- 172.21.15.29:0/1169174859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04c0143910 0x7f04c0158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.437+0000 7f04c5000640 1 --2- 172.21.15.29:0/1169174859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04c0070ac0 0x7f04c015fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.437+0000 7f04c5000640 1 --2- 172.21.15.29:0/1169174859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04c006c150 0x7f04c0157100 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.437+0000 7f04c5000640 1 -- 172.21.15.29:0/1169174859 >> 172.21.15.29:0/1169174859 conn(0x7f04c00b3950 msgr2=0x7f04c00af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.437+0000 7f04c5000640 1 -- 172.21.15.29:0/1169174859 shutdown_connections 2024-01-24T13:07:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.437+0000 7f04c5000640 1 -- 172.21.15.29:0/1169174859 wait complete. 2024-01-24T13:07:09.464 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:07:09.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.601+0000 7f6a24200640 1 Processor -- start 2024-01-24T13:07:09.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.601+0000 7f6a24200640 1 -- start start 2024-01-24T13:07:09.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.601+0000 7f6a24200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a1c15a630 0x7f6a1c0cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.601+0000 7f6a24200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6a1c0c3ef0 0x7f6a1c0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.601+0000 7f6a24200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1c0cfe50 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.601+0000 7f6a24200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1c0cf380 con 0x7f6a1c0c3ef0 2024-01-24T13:07:09.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.601+0000 7f6a24200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c15aa10 con 0x7f6a1c15a630 2024-01-24T13:07:09.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.601+0000 7f6a22200640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6a1c0ca9f0 0x7f6a1c15e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49546/0 (socket says 172.21.15.29:49546) 2024-01-24T13:07:09.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.601+0000 7f6a22200640 1 -- 172.21.15.29:0/4208280312 learned_addr learned my addr 172.21.15.29:0/4208280312 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:09.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.605+0000 7f6a20e00640 1 --2- 172.21.15.29:0/4208280312 >> v2:172.21.15.163:3300/0 conn(0x7f6a1c0c3ef0 0x7f6a1c0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.605+0000 7f6a21800640 1 --2- 172.21.15.29:0/4208280312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a1c15a630 0x7f6a1c0cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.605+0000 7f6a1be00640 1 -- 172.21.15.29:0/4208280312 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736027579 0 0) 0x7f6a1c0cfe50 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.605+0000 7f6a1be00640 1 -- 172.21.15.29:0/4208280312 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69fc003530 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.605+0000 7f6a20e00640 1 -- 172.21.15.29:0/4208280312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a1c15a630 msgr2=0x7f6a1c0cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:09.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.605+0000 7f6a20e00640 1 --2- 172.21.15.29:0/4208280312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a1c15a630 0x7f6a1c0cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.605+0000 7f6a20e00640 1 -- 172.21.15.29:0/4208280312 >> v1:172.21.15.29:6789/0 conn(0x7f6a1c0ca9f0 legacy=0x7f6a1c15e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.605+0000 7f6a20e00640 1 -- 172.21.15.29:0/4208280312 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c0b2b70 con 0x7f6a1c0c3ef0 2024-01-24T13:07:09.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.605+0000 7f6a20e00640 1 --2- 172.21.15.29:0/4208280312 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a1c0c3ef0 0x7f6a1c0ce4b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6a040097c0 tx=0x7f6a0401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46dce7c106741013 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:09.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a1be00640 1 -- 172.21.15.29:0/4208280312 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a040ab650 con 0x7f6a1c0c3ef0 2024-01-24T13:07:09.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a1be00640 1 -- 172.21.15.29:0/4208280312 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a040ab7b0 con 0x7f6a1c0c3ef0 2024-01-24T13:07:09.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a1be00640 1 -- 172.21.15.29:0/4208280312 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a040abb40 con 0x7f6a1c0c3ef0 2024-01-24T13:07:09.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 -- 172.21.15.29:0/4208280312 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a1c0c3ef0 msgr2=0x7f6a1c0ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 --2- 172.21.15.29:0/4208280312 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a1c0c3ef0 0x7f6a1c0ce4b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6a040097c0 tx=0x7f6a0401c450 comp rx=0 tx=0).stop 2024-01-24T13:07:09.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 -- 172.21.15.29:0/4208280312 shutdown_connections 2024-01-24T13:07:09.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 --2- 172.21.15.29:0/4208280312 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a1c0c3ef0 0x7f6a1c0ce4b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 --2- 172.21.15.29:0/4208280312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a1c15a630 0x7f6a1c0cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 -- 172.21.15.29:0/4208280312 >> 172.21.15.29:0/4208280312 conn(0x7f6a1c070570 msgr2=0x7f6a1c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:09.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 -- 172.21.15.29:0/4208280312 shutdown_connections 2024-01-24T13:07:09.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 -- 172.21.15.29:0/4208280312 wait complete. 2024-01-24T13:07:09.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 Processor -- start 2024-01-24T13:07:09.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 -- start start 2024-01-24T13:07:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a1c0c3ef0 0x7f6a1c1f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a1c0ca9f0 0x7f6a1c1f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a1c15a630 0x7f6a1c1f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c1f2eb0 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0c8f60 con 0x7f6a1c15a630 2024-01-24T13:07:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.609+0000 7f6a24200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0c9200 con 0x7f6a1c0c3ef0 2024-01-24T13:07:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a20e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a1c0ca9f0 0x7f6a1c1f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a20e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a1c0ca9f0 0x7f6a1c1f68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34898/0 (socket says 172.21.15.29:34898) 2024-01-24T13:07:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a20e00640 1 -- 172.21.15.29:0/4179196027 learned_addr learned my addr 172.21.15.29:0/4179196027 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a22200640 1 --2- 172.21.15.29:0/4179196027 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a1c15a630 0x7f6a1c1f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a21800640 1 --2- 172.21.15.29:0/4179196027 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a1c0c3ef0 0x7f6a1c1f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a20e00640 1 -- 172.21.15.29:0/4179196027 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a1c0c3ef0 msgr2=0x7f6a1c1f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a20e00640 1 --2- 172.21.15.29:0/4179196027 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a1c0c3ef0 0x7f6a1c1f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a20e00640 1 -- 172.21.15.29:0/4179196027 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a1c15a630 msgr2=0x7f6a1c1f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a20e00640 1 --2- 172.21.15.29:0/4179196027 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a1c15a630 0x7f6a1c1f56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a20e00640 1 -- 172.21.15.29:0/4179196027 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a04009420 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a20e00640 1 --2- 172.21.15.29:0/4179196027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a1c0ca9f0 0x7f6a1c1f68f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6a040ad040 tx=0x7f6a0401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a19600640 1 -- 172.21.15.29:0/4179196027 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a040bf610 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a19600640 1 -- 172.21.15.29:0/4179196027 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a040bf770 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a24200640 1 -- 172.21.15.29:0/4179196027 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1c1f6e30 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a19600640 1 -- 172.21.15.29:0/4179196027 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a040bfb20 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a24200640 1 -- 172.21.15.29:0/4179196027 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1c1f3380 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a24200640 1 -- 172.21.15.29:0/4179196027 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1c04e850 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.613+0000 7f6a19600640 1 -- 172.21.15.29:0/4179196027 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6a040bfc80 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.617+0000 7f6a19600640 1 --2- 172.21.15.29:0/4179196027 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f69f4065a60 0x7f69f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.617+0000 7f6a19600640 1 -- 172.21.15.29:0/4179196027 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6a0411dd60 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.617+0000 7f6a21800640 1 --2- 172.21.15.29:0/4179196027 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f69f4065a60 0x7f69f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.617+0000 7f6a21800640 1 --2- 172.21.15.29:0/4179196027 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f69f4065a60 0x7f69f4067f20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009ac0 tx=0x7f6a0c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:09.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.617+0000 7f6a19600640 1 -- 172.21.15.29:0/4179196027 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f6a040eb570 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.813+0000 7f6a24200640 1 -- 172.21.15.29:0/4179196027 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a1c0b1fd0 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.813+0000 7f6a19600640 1 -- 172.21.15.29:0/4179196027 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f6a040eeb90 con 0x7f6a1c0ca9f0 2024-01-24T13:07:09.817 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:09.817 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/2169087472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2169087472},{"type":"v1","addr":"172.21.15.163:6836","nonce":2169087472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/88874113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":88874113},{"type":"v1","addr":"172.21.15.163:6837","nonce":88874113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6177,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1411376794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1411376794},{"type":"v1","addr":"172.21.15.29:6834","nonce":1411376794}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T13:06:33.362322+0000","modified":"2024-01-24T13:06:36.373536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6180":{"gid":6180,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2075296900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2075296900},{"type":"v1","addr":"172.21.15.29:6835","nonce":2075296900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-24T13:07:09.817 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 26 2024-01-24T13:07:09.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.813+0000 7f6a24200640 1 -- 172.21.15.29:0/4179196027 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f69f4065a60 msgr2=0x7f69f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.813+0000 7f6a24200640 1 --2- 172.21.15.29:0/4179196027 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f69f4065a60 0x7f69f4067f20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009ac0 tx=0x7f6a0c009190 comp rx=0 tx=0).stop 2024-01-24T13:07:09.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.813+0000 7f6a24200640 1 -- 172.21.15.29:0/4179196027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a1c0ca9f0 msgr2=0x7f6a1c1f68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.813+0000 7f6a24200640 1 --2- 172.21.15.29:0/4179196027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a1c0ca9f0 0x7f6a1c1f68f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6a040ad040 tx=0x7f6a0401ac90 comp rx=0 tx=0).stop 2024-01-24T13:07:09.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.813+0000 7f6a24200640 1 -- 172.21.15.29:0/4179196027 shutdown_connections 2024-01-24T13:07:09.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.813+0000 7f6a24200640 1 --2- 172.21.15.29:0/4179196027 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f69f4065a60 0x7f69f4067f20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.813+0000 7f6a24200640 1 --2- 172.21.15.29:0/4179196027 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a1c15a630 0x7f6a1c1f56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.813+0000 7f6a24200640 1 --2- 172.21.15.29:0/4179196027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a1c0ca9f0 0x7f6a1c1f68f0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.813+0000 7f6a24200640 1 --2- 172.21.15.29:0/4179196027 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6a1c0c3ef0 0x7f6a1c1f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.813+0000 7f6a24200640 1 -- 172.21.15.29:0/4179196027 >> 172.21.15.29:0/4179196027 conn(0x7f6a1c070570 msgr2=0x7f6a1c156ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:09.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.813+0000 7f6a24200640 1 -- 172.21.15.29:0/4179196027 shutdown_connections 2024-01-24T13:07:09.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.813+0000 7f6a24200640 1 -- 172.21.15.29:0/4179196027 wait complete. 2024-01-24T13:07:09.839 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:07:09.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.977+0000 7fe321a00640 1 Processor -- start 2024-01-24T13:07:09.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.977+0000 7fe321a00640 1 -- start start 2024-01-24T13:07:09.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.977+0000 7fe321a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe31c15d7a0 0x7fe31c152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.977+0000 7fe321a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31c0d0b80 con 0x7fe31c0ce950 2024-01-24T13:07:09.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.977+0000 7fe321a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31c06bdf0 con 0x7fe31c0cd4c0 2024-01-24T13:07:09.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.977+0000 7fe321a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31c0d0040 con 0x7fe31c15d7a0 2024-01-24T13:07:09.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.977+0000 7fe31aa00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe31c0ce950 0x7fe31c0ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49550/0 (socket says 172.21.15.29:49550) 2024-01-24T13:07:09.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.977+0000 7fe31aa00640 1 -- 172.21.15.29:0/499052529 learned_addr learned my addr 172.21.15.29:0/499052529 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:09.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.977+0000 7fe31b400640 1 --2- 172.21.15.29:0/499052529 >> v2:172.21.15.29:3300/0 conn(0x7fe31c15d7a0 0x7fe31c152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.977+0000 7fe31b400640 1 -- 172.21.15.29:0/499052529 >> v1:172.21.15.163:6789/0 conn(0x7fe31c0cd4c0 legacy=0x7fe31c15d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.977+0000 7fe319600640 1 -- 172.21.15.29:0/499052529 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125677552 0 0) 0x7fe31c0d0b80 con 0x7fe31c0ce950 2024-01-24T13:07:09.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.977+0000 7fe31b400640 1 -- 172.21.15.29:0/499052529 >> v1:172.21.15.29:6789/0 conn(0x7fe31c0ce950 legacy=0x7fe31c0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.977+0000 7fe31b400640 1 -- 172.21.15.29:0/499052529 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c15ddc0 con 0x7fe31c15d7a0 2024-01-24T13:07:09.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.981+0000 7fe31b400640 1 --2- 172.21.15.29:0/499052529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31c15d7a0 0x7fe31c152f80 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe314009d90 tx=0x7fe31401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fcb2d6f4921d91 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:09.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.981+0000 7fe319600640 1 -- 172.21.15.29:0/499052529 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140a57e0 con 0x7fe31c15d7a0 2024-01-24T13:07:09.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.981+0000 7fe319600640 1 -- 172.21.15.29:0/499052529 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3140a5940 con 0x7fe31c15d7a0 2024-01-24T13:07:09.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.981+0000 7fe319600640 1 -- 172.21.15.29:0/499052529 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140a5cd0 con 0x7fe31c15d7a0 2024-01-24T13:07:09.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.981+0000 7fe321a00640 1 -- 172.21.15.29:0/499052529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31c15d7a0 msgr2=0x7fe31c152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.981+0000 7fe321a00640 1 --2- 172.21.15.29:0/499052529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31c15d7a0 0x7fe31c152f80 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe314009d90 tx=0x7fe31401c830 comp rx=0 tx=0).stop 2024-01-24T13:07:09.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.981+0000 7fe321a00640 1 -- 172.21.15.29:0/499052529 shutdown_connections 2024-01-24T13:07:09.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.981+0000 7fe321a00640 1 --2- 172.21.15.29:0/499052529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31c15d7a0 0x7fe31c152f80 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.981+0000 7fe321a00640 1 -- 172.21.15.29:0/499052529 >> 172.21.15.29:0/499052529 conn(0x7fe31c070570 msgr2=0x7fe31c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:09.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.981+0000 7fe321a00640 1 -- 172.21.15.29:0/499052529 shutdown_connections 2024-01-24T13:07:09.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.981+0000 7fe321a00640 1 -- 172.21.15.29:0/499052529 wait complete. 2024-01-24T13:07:09.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe321a00640 1 Processor -- start 2024-01-24T13:07:09.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe321a00640 1 -- start start 2024-01-24T13:07:09.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe321a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe31c0cd4c0 0x7fe31c1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe321a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe31c0ce950 0x7fe31c0c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe321a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31c15d7a0 0x7fe31c0c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe321a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c159290 con 0x7fe31c15d7a0 2024-01-24T13:07:09.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe321a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c1574b0 con 0x7fe31c0cd4c0 2024-01-24T13:07:09.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe321a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c157790 con 0x7fe31c0ce950 2024-01-24T13:07:09.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe31b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31c15d7a0 0x7fe31c0c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe31b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31c15d7a0 0x7fe31c0c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34918/0 (socket says 172.21.15.29:34918) 2024-01-24T13:07:09.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe31b400640 1 -- 172.21.15.29:0/1589449589 learned_addr learned my addr 172.21.15.29:0/1589449589 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:09.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe31aa00640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe31c0cd4c0 0x7fe31c1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe31a000640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe31c0ce950 0x7fe31c0c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe31b400640 1 -- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe31c0ce950 msgr2=0x7fe31c0c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe31b400640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe31c0ce950 0x7fe31c0c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe31b400640 1 -- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe31c0cd4c0 msgr2=0x7fe31c1588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:09.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe31b400640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe31c0cd4c0 0x7fe31c1588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:09.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe31b400640 1 -- 172.21.15.29:0/1589449589 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314009a70 con 0x7fe31c15d7a0 2024-01-24T13:07:09.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe31a000640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe31c0ce950 0x7fe31c0c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:09.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe31b400640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31c15d7a0 0x7fe31c0c9b80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe31401a460 tx=0x7fe3140195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:09.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe312a00640 1 -- 172.21.15.29:0/1589449589 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140ad850 con 0x7fe31c15d7a0 2024-01-24T13:07:09.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe312a00640 1 -- 172.21.15.29:0/1589449589 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3140ad9b0 con 0x7fe31c15d7a0 2024-01-24T13:07:09.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe321a00640 1 -- 172.21.15.29:0/1589449589 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31c0d1190 con 0x7fe31c15d7a0 2024-01-24T13:07:09.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe312a00640 1 -- 172.21.15.29:0/1589449589 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140add20 con 0x7fe31c15d7a0 2024-01-24T13:07:09.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.985+0000 7fe321a00640 1 -- 172.21.15.29:0/1589449589 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31c157d50 con 0x7fe31c15d7a0 2024-01-24T13:07:09.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.989+0000 7fe321a00640 1 -- 172.21.15.29:0/1589449589 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31c0d0ff0 con 0x7fe31c15d7a0 2024-01-24T13:07:09.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.989+0000 7fe312a00640 1 -- 172.21.15.29:0/1589449589 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe3140b4050 con 0x7fe31c15d7a0 2024-01-24T13:07:09.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.989+0000 7fe312a00640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2f4065a60 0x7fe2f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:09.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.989+0000 7fe312a00640 1 -- 172.21.15.29:0/1589449589 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe31411e1d0 con 0x7fe31c15d7a0 2024-01-24T13:07:09.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.989+0000 7fe31aa00640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2f4065a60 0x7fe2f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:09.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.989+0000 7fe31aa00640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2f4065a60 0x7fe2f4067f20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe30c007a90 tx=0x7fe30c0079e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:09.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:09.993+0000 7fe312a00640 1 -- 172.21.15.29:0/1589449589 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe31c0d0ff0 con 0x7fe31c15d7a0 2024-01-24T13:07:10.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.149+0000 7fe321a00640 1 -- 172.21.15.29:0/1589449589 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe31c0d0ff0 con 0x7fe31c15d7a0 2024-01-24T13:07:10.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.149+0000 7fe312a00640 1 -- 172.21.15.29:0/1589449589 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16302 (secure 0 0 0) 0x7fe31c0d0ff0 con 0x7fe31c15d7a0 2024-01-24T13:07:10.154 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:10.155 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":59,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:06:34.365221+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-24T13:06:31.105908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-24T13:06:32.357292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:07:10.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.153+0000 7fe321a00640 1 -- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2f4065a60 msgr2=0x7fe2f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:10.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.153+0000 7fe321a00640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2f4065a60 0x7fe2f4067f20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe30c007a90 tx=0x7fe30c0079e0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.153+0000 7fe321a00640 1 -- 172.21.15.29:0/1589449589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31c15d7a0 msgr2=0x7fe31c0c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:10.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.153+0000 7fe321a00640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31c15d7a0 0x7fe31c0c9b80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe31401a460 tx=0x7fe3140195d0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.153+0000 7fe321a00640 1 -- 172.21.15.29:0/1589449589 shutdown_connections 2024-01-24T13:07:10.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.153+0000 7fe321a00640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe2f4065a60 0x7fe2f4067f20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.153+0000 7fe321a00640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31c15d7a0 0x7fe31c0c9b80 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.153+0000 7fe321a00640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe31c0ce950 0x7fe31c0c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.153+0000 7fe321a00640 1 --2- 172.21.15.29:0/1589449589 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe31c0cd4c0 0x7fe31c1588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.153+0000 7fe321a00640 1 -- 172.21.15.29:0/1589449589 >> 172.21.15.29:0/1589449589 conn(0x7fe31c070570 msgr2=0x7fe31c15a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:10.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.153+0000 7fe321a00640 1 -- 172.21.15.29:0/1589449589 shutdown_connections 2024-01-24T13:07:10.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.153+0000 7fe321a00640 1 -- 172.21.15.29:0/1589449589 wait complete. 2024-01-24T13:07:10.178 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-24T13:07:10.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41fa00640 1 Processor -- start 2024-01-24T13:07:10.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41fa00640 1 -- start start 2024-01-24T13:07:10.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41fa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41815cb10 0x7fa41806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:10.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41fa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa41806d580 0x7fa41806ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:10.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41fa00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41806e390 con 0x7fa41806d120 2024-01-24T13:07:10.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41fa00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4180ae540 con 0x7fa41806d580 2024-01-24T13:07:10.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41fa00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41806da60 con 0x7fa41815cb10 2024-01-24T13:07:10.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41da00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa41806d580 0x7fa41806ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:10.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41da00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa41806d580 0x7fa41806ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34920/0 (socket says 172.21.15.29:34920) 2024-01-24T13:07:10.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41da00640 1 -- 172.21.15.29:0/3872389312 learned_addr learned my addr 172.21.15.29:0/3872389312 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:10.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa417e00640 1 --1- 172.21.15.29:0/3872389312 >> v1:172.21.15.29:6789/0 conn(0x7fa41806d120 0x7fa4180cd010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49562/0 (socket says 172.21.15.29:49562) 2024-01-24T13:07:10.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41d000640 1 --2- 172.21.15.29:0/3872389312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41815cb10 0x7fa41806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:10.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41da00640 1 -- 172.21.15.29:0/3872389312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41815cb10 msgr2=0x7fa41806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:10.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41da00640 1 --2- 172.21.15.29:0/3872389312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41815cb10 0x7fa41806cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41da00640 1 -- 172.21.15.29:0/3872389312 >> v1:172.21.15.29:6789/0 conn(0x7fa41806d120 legacy=0x7fa4180cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:10.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa417400640 1 -- 172.21.15.29:0/3872389312 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752073372 0 0) 0x7fa41806e390 con 0x7fa41806d120 2024-01-24T13:07:10.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.317+0000 7fa41da00640 1 -- 172.21.15.29:0/3872389312 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41806dd40 con 0x7fa41806d580 2024-01-24T13:07:10.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.321+0000 7fa41da00640 1 --2- 172.21.15.29:0/3872389312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41806d580 0x7fa41806ace0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa410009e50 tx=0x7fa41001f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d060dc884cdcff31 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:10.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.321+0000 7fa417400640 1 -- 172.21.15.29:0/3872389312 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4100af400 con 0x7fa41806d580 2024-01-24T13:07:10.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.321+0000 7fa417400640 1 -- 172.21.15.29:0/3872389312 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4100ab050 con 0x7fa41806d580 2024-01-24T13:07:10.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.321+0000 7fa417400640 1 -- 172.21.15.29:0/3872389312 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4100af780 con 0x7fa41806d580 2024-01-24T13:07:10.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.321+0000 7fa41fa00640 1 -- 172.21.15.29:0/3872389312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41806d580 msgr2=0x7fa41806ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:10.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.321+0000 7fa41fa00640 1 --2- 172.21.15.29:0/3872389312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41806d580 0x7fa41806ace0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa410009e50 tx=0x7fa41001f1f0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.321+0000 7fa41fa00640 1 -- 172.21.15.29:0/3872389312 shutdown_connections 2024-01-24T13:07:10.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.321+0000 7fa41fa00640 1 --2- 172.21.15.29:0/3872389312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41806d580 0x7fa41806ace0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.321+0000 7fa41fa00640 1 --2- 172.21.15.29:0/3872389312 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41815cb10 0x7fa41806cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.321+0000 7fa41fa00640 1 -- 172.21.15.29:0/3872389312 >> 172.21.15.29:0/3872389312 conn(0x7fa4180cb6a0 msgr2=0x7fa4180cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:10.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.321+0000 7fa41fa00640 1 -- 172.21.15.29:0/3872389312 shutdown_connections 2024-01-24T13:07:10.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.321+0000 7fa41fa00640 1 -- 172.21.15.29:0/3872389312 wait complete. 2024-01-24T13:07:10.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41fa00640 1 Processor -- start 2024-01-24T13:07:10.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41fa00640 1 -- start start 2024-01-24T13:07:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41fa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41806d120 0x7fa418152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41fa00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41806d580 0x7fa4180aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41fa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41815cb10 0x7fa4180ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41fa00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa418152690 con 0x7fa41815cb10 2024-01-24T13:07:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41fa00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa418154330 con 0x7fa41806d120 2024-01-24T13:07:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41fa00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4180c69a0 con 0x7fa41806d580 2024-01-24T13:07:10.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41da00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41815cb10 0x7fa4180ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:10.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41da00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41815cb10 0x7fa4180ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34934/0 (socket says 172.21.15.29:34934) 2024-01-24T13:07:10.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41da00640 1 -- 172.21.15.29:0/1532273546 learned_addr learned my addr 172.21.15.29:0/1532273546 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41d000640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41806d120 0x7fa418152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa417e00640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41806d580 0x7fa4180aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41da00640 1 -- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41806d580 msgr2=0x7fa4180aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41da00640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41806d580 0x7fa4180aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41da00640 1 -- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41806d120 msgr2=0x7fa418152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41da00640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41806d120 0x7fa418152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41da00640 1 -- 172.21.15.29:0/1532273546 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa410009b30 con 0x7fa41815cb10 2024-01-24T13:07:10.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41d000640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41806d120 0x7fa418152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:10.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa417e00640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41806d580 0x7fa4180aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:10.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41da00640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41815cb10 0x7fa4180ad410 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa41001ce20 tx=0x7fa41001bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:10.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa414c00640 1 -- 172.21.15.29:0/1532273546 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4100afde0 con 0x7fa41815cb10 2024-01-24T13:07:10.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa414c00640 1 -- 172.21.15.29:0/1532273546 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa410009510 con 0x7fa41815cb10 2024-01-24T13:07:10.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41fa00640 1 -- 172.21.15.29:0/1532273546 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4180c5d90 con 0x7fa41815cb10 2024-01-24T13:07:10.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa414c00640 1 -- 172.21.15.29:0/1532273546 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4100ba660 con 0x7fa41815cb10 2024-01-24T13:07:10.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41fa00640 1 -- 172.21.15.29:0/1532273546 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4180c6350 con 0x7fa41815cb10 2024-01-24T13:07:10.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.325+0000 7fa41fa00640 1 -- 172.21.15.29:0/1532273546 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41804e850 con 0x7fa41815cb10 2024-01-24T13:07:10.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.329+0000 7fa414c00640 1 -- 172.21.15.29:0/1532273546 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa4100b6040 con 0x7fa41815cb10 2024-01-24T13:07:10.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.329+0000 7fa414c00640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3f0065a90 0x7fa3f0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:10.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.329+0000 7fa414c00640 1 -- 172.21.15.29:0/1532273546 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa410121530 con 0x7fa41815cb10 2024-01-24T13:07:10.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.329+0000 7fa41d000640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3f0065a90 0x7fa3f0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:10.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.329+0000 7fa41d000640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3f0065a90 0x7fa3f0067f50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa408009840 tx=0x7fa408008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:10.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.333+0000 7fa414c00640 1 -- 172.21.15.29:0/1532273546 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa4100eed10 con 0x7fa41815cb10 2024-01-24T13:07:10.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.525+0000 7fa41fa00640 1 -- 172.21.15.29:0/1532273546 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa4180c6ae0 con 0x7fa41815cb10 2024-01-24T13:07:10.529 INFO:tasks.ceph.mon.a.smithi029.stderr:2024-01-24T13:07:10.525+0000 7f8d5fe00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-24T13:07:10.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.541+0000 7fa414c00640 1 -- 172.21.15.29:0/1532273546 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa4100f2330 con 0x7fa41815cb10 2024-01-24T13:07:10.545 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-24T13:07:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.541+0000 7fa41fa00640 1 -- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3f0065a90 msgr2=0x7fa3f0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.541+0000 7fa41fa00640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3f0065a90 0x7fa3f0067f50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa408009840 tx=0x7fa408008040 comp rx=0 tx=0).stop 2024-01-24T13:07:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.541+0000 7fa41fa00640 1 -- 172.21.15.29:0/1532273546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41815cb10 msgr2=0x7fa4180ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.541+0000 7fa41fa00640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41815cb10 0x7fa4180ad410 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa41001ce20 tx=0x7fa41001bf90 comp rx=0 tx=0).stop 2024-01-24T13:07:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.541+0000 7fa41fa00640 1 -- 172.21.15.29:0/1532273546 shutdown_connections 2024-01-24T13:07:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.541+0000 7fa41fa00640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa3f0065a90 0x7fa3f0067f50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.541+0000 7fa41fa00640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa41815cb10 0x7fa4180ad410 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.541+0000 7fa41fa00640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa41806d580 0x7fa4180aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.541+0000 7fa41fa00640 1 --2- 172.21.15.29:0/1532273546 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa41806d120 0x7fa418152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.541+0000 7fa41fa00640 1 -- 172.21.15.29:0/1532273546 >> 172.21.15.29:0/1532273546 conn(0x7fa4180cb6a0 msgr2=0x7fa4180c8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.545+0000 7fa41fa00640 1 -- 172.21.15.29:0/1532273546 shutdown_connections 2024-01-24T13:07:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.545+0000 7fa41fa00640 1 -- 172.21.15.29:0/1532273546 wait complete. 2024-01-24T13:07:10.552 INFO:tasks.ceph.mds.c.smithi029.stderr: -2782> 2024-01-24T13:06:38.946+0000 7f4e0c200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-24T13:07:10.570 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-24T13:07:10.600 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2024-01-24T13:07:10.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.709+0000 7fca01000640 1 Processor -- start 2024-01-24T13:07:10.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.709+0000 7fca01000640 1 -- start start 2024-01-24T13:07:10.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fca01000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc9fc13d540 0x7fc9fc06bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:10.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fca01000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9fc06c050 0x7fc9fc15e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:10.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fca01000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc9fc15e570 0x7fc9fc15ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:10.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fca01000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9fc06c4d0 con 0x7fc9fc13d540 2024-01-24T13:07:10.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fca01000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9fc13db30 con 0x7fc9fc15e570 2024-01-24T13:07:10.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fca01000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc15b9d0 con 0x7fc9fc06c050 2024-01-24T13:07:10.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fc9f9e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc9fc13d540 0x7fc9fc06bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:10.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fc9f9e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc9fc13d540 0x7fc9fc06bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34944/0 (socket says 172.21.15.29:34944) 2024-01-24T13:07:10.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fc9f9e00640 1 -- 172.21.15.29:0/3303178596 learned_addr learned my addr 172.21.15.29:0/3303178596 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:10.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fc9fa800640 1 --2- 172.21.15.29:0/3303178596 >> v2:172.21.15.163:3300/0 conn(0x7fc9fc15e570 0x7fc9fc15ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:10.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fc9f9400640 1 --2- 172.21.15.29:0/3303178596 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9fc06c050 0x7fc9fc15e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:10.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fc9f9e00640 1 -- 172.21.15.29:0/3303178596 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9fc06c050 msgr2=0x7fc9fc15e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:10.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fc9f9e00640 1 --2- 172.21.15.29:0/3303178596 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9fc06c050 0x7fc9fc15e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fc9f9e00640 1 -- 172.21.15.29:0/3303178596 >> v2:172.21.15.163:3300/0 conn(0x7fc9fc15e570 msgr2=0x7fc9fc15ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:10.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fc9f9e00640 1 --2- 172.21.15.29:0/3303178596 >> v2:172.21.15.163:3300/0 conn(0x7fc9fc15e570 0x7fc9fc15ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fc9f9e00640 1 -- 172.21.15.29:0/3303178596 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc15ad70 con 0x7fc9fc13d540 2024-01-24T13:07:10.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.713+0000 7fc9f9400640 1 --2- 172.21.15.29:0/3303178596 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9fc06c050 0x7fc9fc15e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:10.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fc9f9e00640 1 --2- 172.21.15.29:0/3303178596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9fc13d540 0x7fc9fc06bb10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc155020 tx=0x7fc9ec01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216d52229aa20b0f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:10.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fc9f8a00640 1 -- 172.21.15.29:0/3303178596 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0ac410 con 0x7fc9fc13d540 2024-01-24T13:07:10.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fc9f8a00640 1 -- 172.21.15.29:0/3303178596 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec0ac570 con 0x7fc9fc13d540 2024-01-24T13:07:10.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fc9f8a00640 1 -- 172.21.15.29:0/3303178596 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0ac900 con 0x7fc9fc13d540 2024-01-24T13:07:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fca01000640 1 -- 172.21.15.29:0/3303178596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9fc13d540 msgr2=0x7fc9fc06bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fca01000640 1 --2- 172.21.15.29:0/3303178596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9fc13d540 0x7fc9fc06bb10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc155020 tx=0x7fc9ec01c500 comp rx=0 tx=0).stop 2024-01-24T13:07:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fca01000640 1 -- 172.21.15.29:0/3303178596 shutdown_connections 2024-01-24T13:07:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fca01000640 1 --2- 172.21.15.29:0/3303178596 >> v2:172.21.15.163:3300/0 conn(0x7fc9fc15e570 0x7fc9fc15ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fca01000640 1 --2- 172.21.15.29:0/3303178596 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9fc06c050 0x7fc9fc15e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fca01000640 1 --2- 172.21.15.29:0/3303178596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9fc13d540 0x7fc9fc06bb10 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fca01000640 1 -- 172.21.15.29:0/3303178596 >> 172.21.15.29:0/3303178596 conn(0x7fc9fc06d790 msgr2=0x7fc9fc069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fca01000640 1 -- 172.21.15.29:0/3303178596 shutdown_connections 2024-01-24T13:07:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fca01000640 1 -- 172.21.15.29:0/3303178596 wait complete. 2024-01-24T13:07:10.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fca01000640 1 Processor -- start 2024-01-24T13:07:10.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.717+0000 7fca01000640 1 -- start start 2024-01-24T13:07:10.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fca01000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9fc06c050 0x7fc9fc15cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:10.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fca01000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9fc13d540 0x7fc9fc0aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:10.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fca01000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9fc15e570 0x7fc9fc13bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:10.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fca01000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc13eee0 con 0x7fc9fc06c050 2024-01-24T13:07:10.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fca01000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc165fd0 con 0x7fc9fc13d540 2024-01-24T13:07:10.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fca01000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc15f690 con 0x7fc9fc15e570 2024-01-24T13:07:10.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fc9f9e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9fc06c050 0x7fc9fc15cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:10.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fc9f9e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9fc06c050 0x7fc9fc15cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34948/0 (socket says 172.21.15.29:34948) 2024-01-24T13:07:10.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fc9f9e00640 1 -- 172.21.15.29:0/3693334692 learned_addr learned my addr 172.21.15.29:0/3693334692 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:10.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fc9f9400640 1 --2- 172.21.15.29:0/3693334692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9fc13d540 0x7fc9fc0aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:10.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fc9fa800640 1 --2- 172.21.15.29:0/3693334692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9fc15e570 0x7fc9fc13bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:10.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fc9f9e00640 1 -- 172.21.15.29:0/3693334692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9fc15e570 msgr2=0x7fc9fc13bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:10.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fc9f9e00640 1 --2- 172.21.15.29:0/3693334692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9fc15e570 0x7fc9fc13bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fc9f9e00640 1 -- 172.21.15.29:0/3693334692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9fc13d540 msgr2=0x7fc9fc0aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:10.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fc9f9e00640 1 --2- 172.21.15.29:0/3693334692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9fc13d540 0x7fc9fc0aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:10.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fc9f9e00640 1 -- 172.21.15.29:0/3693334692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec0094d0 con 0x7fc9fc06c050 2024-01-24T13:07:10.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fc9f9e00640 1 --2- 172.21.15.29:0/3693334692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9fc06c050 0x7fc9fc15cc10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec01cda0 tx=0x7fc9ec0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:10.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fc9f2000640 1 -- 172.21.15.29:0/3693334692 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0ace20 con 0x7fc9fc06c050 2024-01-24T13:07:10.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fc9f2000640 1 -- 172.21.15.29:0/3693334692 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec0b5650 con 0x7fc9fc06c050 2024-01-24T13:07:10.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fca01000640 1 -- 172.21.15.29:0/3693334692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9fc165a10 con 0x7fc9fc06c050 2024-01-24T13:07:10.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fc9f2000640 1 -- 172.21.15.29:0/3693334692 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0b5a00 con 0x7fc9fc06c050 2024-01-24T13:07:10.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fca01000640 1 -- 172.21.15.29:0/3693334692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9fc161db0 con 0x7fc9fc06c050 2024-01-24T13:07:10.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.721+0000 7fca01000640 1 -- 172.21.15.29:0/3693334692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9fc13f020 con 0x7fc9fc06c050 2024-01-24T13:07:10.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.725+0000 7fc9f2000640 1 -- 172.21.15.29:0/3693334692 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc9ec0b3070 con 0x7fc9fc06c050 2024-01-24T13:07:10.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.725+0000 7fc9f2000640 1 --2- 172.21.15.29:0/3693334692 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc9d4065a60 0x7fc9d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:10.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.725+0000 7fc9f2000640 1 -- 172.21.15.29:0/3693334692 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fc9ec11d1d0 con 0x7fc9fc06c050 2024-01-24T13:07:10.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.725+0000 7fc9f9400640 1 --2- 172.21.15.29:0/3693334692 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc9d4065a60 0x7fc9d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:10.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.725+0000 7fc9f9400640 1 --2- 172.21.15.29:0/3693334692 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc9d4065a60 0x7fc9d4067f20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc15d470 tx=0x7fc9e4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:10.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.729+0000 7fc9f2000640 1 -- 172.21.15.29:0/3693334692 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc9ec0eab30 con 0x7fc9fc06c050 2024-01-24T13:07:10.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:10.921+0000 7fca01000640 1 -- 172.21.15.29:0/3693334692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc9fc0cd4b0 con 0x7fc9fc06c050 2024-01-24T13:07:11.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.545+0000 7fc9f2000640 1 -- 172.21.15.29:0/3693334692 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc9ec0ee150 con 0x7fc9fc06c050 2024-01-24T13:07:11.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.545+0000 7fca01000640 1 -- 172.21.15.29:0/3693334692 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc9d4065a60 msgr2=0x7fc9d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:11.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.545+0000 7fca01000640 1 --2- 172.21.15.29:0/3693334692 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc9d4065a60 0x7fc9d4067f20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc15d470 tx=0x7fc9e4008040 comp rx=0 tx=0).stop 2024-01-24T13:07:11.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.545+0000 7fca01000640 1 -- 172.21.15.29:0/3693334692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9fc06c050 msgr2=0x7fc9fc15cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:11.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.545+0000 7fca01000640 1 --2- 172.21.15.29:0/3693334692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9fc06c050 0x7fc9fc15cc10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec01cda0 tx=0x7fc9ec0192a0 comp rx=0 tx=0).stop 2024-01-24T13:07:11.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.545+0000 7fca01000640 1 -- 172.21.15.29:0/3693334692 shutdown_connections 2024-01-24T13:07:11.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.545+0000 7fca01000640 1 --2- 172.21.15.29:0/3693334692 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc9d4065a60 0x7fc9d4067f20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:11.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.545+0000 7fca01000640 1 --2- 172.21.15.29:0/3693334692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9fc15e570 0x7fc9fc13bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:11.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.545+0000 7fca01000640 1 --2- 172.21.15.29:0/3693334692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9fc13d540 0x7fc9fc0aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:11.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.545+0000 7fca01000640 1 --2- 172.21.15.29:0/3693334692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9fc06c050 0x7fc9fc15cc10 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:11.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.545+0000 7fca01000640 1 -- 172.21.15.29:0/3693334692 >> 172.21.15.29:0/3693334692 conn(0x7fc9fc06d790 msgr2=0x7fc9fc072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:11.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.545+0000 7fca01000640 1 -- 172.21.15.29:0/3693334692 shutdown_connections 2024-01-24T13:07:11.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.545+0000 7fca01000640 1 -- 172.21.15.29:0/3693334692 wait complete. 2024-01-24T13:07:11.574 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-24T13:07:11.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f3145a00640 1 Processor -- start 2024-01-24T13:07:11.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f3145a00640 1 -- start start 2024-01-24T13:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f3145a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f31400b07d0 0x7f314015d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f3145a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f314015d730 0x7f3140070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f3145a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31400cacd0 con 0x7f31400ca0f0 2024-01-24T13:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f3145a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31400cba90 con 0x7f31400b07d0 2024-01-24T13:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f3145a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31400cafb0 con 0x7f314015d730 2024-01-24T13:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313ea00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f31400ca0f0 0x7f31400b00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55434/0 (socket says 172.21.15.29:55434) 2024-01-24T13:07:11.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313ea00640 1 -- 172.21.15.29:0/986147077 learned_addr learned my addr 172.21.15.29:0/986147077 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:11.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313e000640 1 --2- 172.21.15.29:0/986147077 >> v2:172.21.15.163:3300/0 conn(0x7f31400b07d0 0x7f314015d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:11.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 -- 172.21.15.29:0/986147077 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652746309 0 0) 0x7f31400cacd0 con 0x7f31400ca0f0 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 -- 172.21.15.29:0/986147077 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3120003530 con 0x7f31400ca0f0 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313f400640 1 --2- 172.21.15.29:0/986147077 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f314015d730 0x7f3140070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 -- 172.21.15.29:0/986147077 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1707053611 0 0) 0x7f3120003530 con 0x7f31400ca0f0 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 -- 172.21.15.29:0/986147077 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f314015d730 msgr2=0x7f3140070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 --2- 172.21.15.29:0/986147077 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f314015d730 0x7f3140070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 -- 172.21.15.29:0/986147077 >> v2:172.21.15.163:3300/0 conn(0x7f31400b07d0 msgr2=0x7f314015d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 --2- 172.21.15.29:0/986147077 >> v2:172.21.15.163:3300/0 conn(0x7f31400b07d0 0x7f314015d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 -- 172.21.15.29:0/986147077 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31400cb290 con 0x7f31400ca0f0 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 -- 172.21.15.29:0/986147077 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f31300016a0 con 0x7f31400ca0f0 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 -- 172.21.15.29:0/986147077 >> v1:172.21.15.29:6789/0 conn(0x7f31400ca0f0 legacy=0x7f31400b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 --2- 172.21.15.29:0/986147077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31200039f0 0x7f3120003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 --2- 172.21.15.29:0/986147077 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f314015d730 0x7f31200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 --2- 172.21.15.29:0/986147077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3120004d10 0x7f3120005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 -- 172.21.15.29:0/986147077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31400cba90 con 0x7f3120004d10 2024-01-24T13:07:11.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 -- 172.21.15.29:0/986147077 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31400cafb0 con 0x7f31200039f0 2024-01-24T13:07:11.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313d600640 1 -- 172.21.15.29:0/986147077 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312000ba10 con 0x7f314015d730 2024-01-24T13:07:11.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313f400640 1 --2- 172.21.15.29:0/986147077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3120004d10 0x7f3120005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:11.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313ea00640 1 --2- 172.21.15.29:0/986147077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31200039f0 0x7f3120003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:11.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.761+0000 7f313e000640 1 --2- 172.21.15.29:0/986147077 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f314015d730 0x7f31200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:11.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.765+0000 7f313f400640 1 -- 172.21.15.29:0/986147077 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f314015d730 msgr2=0x7f31200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:11.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.765+0000 7f313f400640 1 --2- 172.21.15.29:0/986147077 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f314015d730 0x7f31200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:11.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.765+0000 7f313f400640 1 -- 172.21.15.29:0/986147077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31200039f0 msgr2=0x7f3120003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:11.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.765+0000 7f313f400640 1 --2- 172.21.15.29:0/986147077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31200039f0 0x7f3120003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:11.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.765+0000 7f313f400640 1 -- 172.21.15.29:0/986147077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3120003530 con 0x7f3120004d10 2024-01-24T13:07:11.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.765+0000 7f313f400640 1 --2- 172.21.15.29:0/986147077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3120004d10 0x7f3120005190 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3138009fc0 tx=0x7f313801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e157784ee7b171 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:11.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.765+0000 7f313d600640 1 -- 172.21.15.29:0/986147077 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31380a5c70 con 0x7f3120004d10 2024-01-24T13:07:11.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.765+0000 7f313d600640 1 -- 172.21.15.29:0/986147077 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313800f040 con 0x7f3120004d10 2024-01-24T13:07:11.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.765+0000 7f313d600640 1 -- 172.21.15.29:0/986147077 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31380ad440 con 0x7f3120004d10 2024-01-24T13:07:11.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.765+0000 7f3145a00640 1 -- 172.21.15.29:0/986147077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3120004d10 msgr2=0x7f3120005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:11.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.765+0000 7f3145a00640 1 --2- 172.21.15.29:0/986147077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3120004d10 0x7f3120005190 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3138009fc0 tx=0x7f313801cc60 comp rx=0 tx=0).stop 2024-01-24T13:07:11.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.765+0000 7f313f400640 1 -- 172.21.15.29:0/986147077 reap_dead start 2024-01-24T13:07:11.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f3145a00640 1 -- 172.21.15.29:0/986147077 shutdown_connections 2024-01-24T13:07:11.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f3145a00640 1 -- 172.21.15.29:0/986147077 >> 172.21.15.29:0/986147077 conn(0x7f314006a0d0 msgr2=0x7f314006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:11.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f3145a00640 1 -- 172.21.15.29:0/986147077 shutdown_connections 2024-01-24T13:07:11.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f3145a00640 1 -- 172.21.15.29:0/986147077 wait complete. 2024-01-24T13:07:11.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f3145a00640 1 Processor -- start 2024-01-24T13:07:11.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f3145a00640 1 -- start start 2024-01-24T13:07:11.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f3145a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3120004d10 0x7f31400c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:11.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f3145a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31400b3460 0x7f31401f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:11.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f3145a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31401f2da0 0x7f31400ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:11.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f3145a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31401f20f0 con 0x7f31401f2da0 2024-01-24T13:07:11.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f3145a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31400b1ec0 con 0x7f31400b3460 2024-01-24T13:07:11.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f3145a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31400b1620 con 0x7f3120004d10 2024-01-24T13:07:11.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f313f400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31401f2da0 0x7f31400ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:11.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f313f400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31401f2da0 0x7f31400ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46990/0 (socket says 172.21.15.29:46990) 2024-01-24T13:07:11.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f313f400640 1 -- 172.21.15.29:0/723840715 learned_addr learned my addr 172.21.15.29:0/723840715 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:11.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f313ea00640 1 --2- 172.21.15.29:0/723840715 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3120004d10 0x7f31400c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:11.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f313e000640 1 --2- 172.21.15.29:0/723840715 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31400b3460 0x7f31401f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:11.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f313f400640 1 -- 172.21.15.29:0/723840715 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3120004d10 msgr2=0x7f31400c2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:11.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f313f400640 1 --2- 172.21.15.29:0/723840715 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3120004d10 0x7f31400c2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:11.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f313f400640 1 -- 172.21.15.29:0/723840715 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31400b3460 msgr2=0x7f31401f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:11.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f313f400640 1 --2- 172.21.15.29:0/723840715 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31400b3460 0x7f31401f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:11.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.769+0000 7f313f400640 1 -- 172.21.15.29:0/723840715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31400b1900 con 0x7f31401f2da0 2024-01-24T13:07:11.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.773+0000 7f313f400640 1 --2- 172.21.15.29:0/723840715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31401f2da0 0x7f31400ab8e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f31380b0040 tx=0x7f3138009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:11.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.773+0000 7f3136a00640 1 -- 172.21.15.29:0/723840715 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31380ba070 con 0x7f31401f2da0 2024-01-24T13:07:11.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.773+0000 7f3136a00640 1 -- 172.21.15.29:0/723840715 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31380039a0 con 0x7f31401f2da0 2024-01-24T13:07:11.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.773+0000 7f3136a00640 1 -- 172.21.15.29:0/723840715 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3138003b30 con 0x7f31401f2da0 2024-01-24T13:07:11.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.773+0000 7f3145a00640 1 -- 172.21.15.29:0/723840715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31400b1be0 con 0x7f31401f2da0 2024-01-24T13:07:11.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.773+0000 7f3145a00640 1 -- 172.21.15.29:0/723840715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31400b1280 con 0x7f31401f2da0 2024-01-24T13:07:11.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.773+0000 7f3145a00640 1 -- 172.21.15.29:0/723840715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314004e000 con 0x7f31401f2da0 2024-01-24T13:07:11.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.773+0000 7f3136a00640 1 -- 172.21.15.29:0/723840715 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f31380b4040 con 0x7f31401f2da0 2024-01-24T13:07:11.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.773+0000 7f3136a00640 1 --2- 172.21.15.29:0/723840715 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f31180659f0 0x7f3118067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:11.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.773+0000 7f3136a00640 1 -- 172.21.15.29:0/723840715 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f313811cd20 con 0x7f31401f2da0 2024-01-24T13:07:11.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.773+0000 7f313ea00640 1 --2- 172.21.15.29:0/723840715 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f31180659f0 0x7f3118067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:11.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.777+0000 7f313ea00640 1 --2- 172.21.15.29:0/723840715 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f31180659f0 0x7f3118067eb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3130000c10 tx=0x7f3130009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:11.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.777+0000 7f3136a00640 1 -- 172.21.15.29:0/723840715 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f31380ea5e0 con 0x7f31401f2da0 2024-01-24T13:07:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:11.937+0000 7f3145a00640 1 -- 172.21.15.29:0/723840715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f31401f2510 con 0x7f31401f2da0 2024-01-24T13:07:12.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.697+0000 7f3136a00640 1 -- 172.21.15.29:0/723840715 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v61) v1 ==== 181+0+0 (secure 0 0 0) 0x7f31380edc00 con 0x7f31401f2da0 2024-01-24T13:07:12.703 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2024-01-24T13:07:12.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.701+0000 7f3145a00640 1 -- 172.21.15.29:0/723840715 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f31180659f0 msgr2=0x7f3118067eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:12.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.701+0000 7f3145a00640 1 --2- 172.21.15.29:0/723840715 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f31180659f0 0x7f3118067eb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3130000c10 tx=0x7f3130009040 comp rx=0 tx=0).stop 2024-01-24T13:07:12.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.701+0000 7f3145a00640 1 -- 172.21.15.29:0/723840715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31401f2da0 msgr2=0x7f31400ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:12.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.701+0000 7f3145a00640 1 --2- 172.21.15.29:0/723840715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31401f2da0 0x7f31400ab8e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f31380b0040 tx=0x7f3138009750 comp rx=0 tx=0).stop 2024-01-24T13:07:12.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.701+0000 7f3145a00640 1 -- 172.21.15.29:0/723840715 shutdown_connections 2024-01-24T13:07:12.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.701+0000 7f3145a00640 1 --2- 172.21.15.29:0/723840715 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f31180659f0 0x7f3118067eb0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:12.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.701+0000 7f3145a00640 1 --2- 172.21.15.29:0/723840715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31401f2da0 0x7f31400ab8e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:12.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.701+0000 7f3145a00640 1 --2- 172.21.15.29:0/723840715 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31400b3460 0x7f31401f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:12.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.701+0000 7f3145a00640 1 --2- 172.21.15.29:0/723840715 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3120004d10 0x7f31400c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:12.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.701+0000 7f3145a00640 1 -- 172.21.15.29:0/723840715 >> 172.21.15.29:0/723840715 conn(0x7f314006a0d0 msgr2=0x7f31400cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:12.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.701+0000 7f3145a00640 1 -- 172.21.15.29:0/723840715 shutdown_connections 2024-01-24T13:07:12.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.701+0000 7f3145a00640 1 -- 172.21.15.29:0/723840715 wait complete. 2024-01-24T13:07:12.735 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-24T13:07:12.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f5311e00640 1 Processor -- start 2024-01-24T13:07:12.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f5311e00640 1 -- start start 2024-01-24T13:07:12.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f5311e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f530c15c8b0 0x7f530c160310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:12.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f5311e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f530c06cc40 0x7f530c0c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:12.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f5311e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530c06dc20 con 0x7f530c069cd0 2024-01-24T13:07:12.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f5311e00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530c1612b0 con 0x7f530c15c8b0 2024-01-24T13:07:12.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f5311e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c0c9e50 con 0x7f530c06cc40 2024-01-24T13:07:12.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f530aa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f530c15c8b0 0x7f530c160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:12.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f530aa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f530c15c8b0 0x7f530c160310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46992/0 (socket says 172.21.15.29:46992) 2024-01-24T13:07:12.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f530aa00640 1 -- 172.21.15.29:0/1808034006 learned_addr learned my addr 172.21.15.29:0/1808034006 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:12.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f530aa00640 1 -- 172.21.15.29:0/1808034006 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f530c06cc40 msgr2=0x7f530c0c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:12.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f530a000640 1 --2- 172.21.15.29:0/1808034006 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f530c06cc40 0x7f530c0c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:12.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f530aa00640 1 --2- 172.21.15.29:0/1808034006 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f530c06cc40 0x7f530c0c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:12.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f530aa00640 1 -- 172.21.15.29:0/1808034006 >> v1:172.21.15.163:6789/0 conn(0x7f530c069cd0 legacy=0x7f530c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:12.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f530aa00640 1 -- 172.21.15.29:0/1808034006 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c160a10 con 0x7f530c15c8b0 2024-01-24T13:07:12.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.881+0000 7f530a000640 1 --2- 172.21.15.29:0/1808034006 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f530c06cc40 0x7f530c0c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:12.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.885+0000 7f530aa00640 1 --2- 172.21.15.29:0/1808034006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530c15c8b0 0x7f530c160310 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009870 tx=0x7f52fc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bbec949a6404b7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:12.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.885+0000 7f5309600640 1 -- 172.21.15.29:0/1808034006 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc0aa620 con 0x7f530c15c8b0 2024-01-24T13:07:12.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.885+0000 7f5309600640 1 -- 172.21.15.29:0/1808034006 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc0aa780 con 0x7f530c15c8b0 2024-01-24T13:07:12.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.885+0000 7f5309600640 1 -- 172.21.15.29:0/1808034006 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc0aab10 con 0x7f530c15c8b0 2024-01-24T13:07:12.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.885+0000 7f5311e00640 1 -- 172.21.15.29:0/1808034006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530c15c8b0 msgr2=0x7f530c160310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:12.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.885+0000 7f5311e00640 1 --2- 172.21.15.29:0/1808034006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530c15c8b0 0x7f530c160310 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009870 tx=0x7f52fc01c500 comp rx=0 tx=0).stop 2024-01-24T13:07:12.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.885+0000 7f5311e00640 1 -- 172.21.15.29:0/1808034006 shutdown_connections 2024-01-24T13:07:12.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.885+0000 7f5311e00640 1 --2- 172.21.15.29:0/1808034006 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f530c06cc40 0x7f530c0c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:12.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.885+0000 7f5311e00640 1 --2- 172.21.15.29:0/1808034006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530c15c8b0 0x7f530c160310 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:12.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.885+0000 7f5311e00640 1 -- 172.21.15.29:0/1808034006 >> 172.21.15.29:0/1808034006 conn(0x7f530c0cf2c0 msgr2=0x7f530c0cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:12.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.885+0000 7f5311e00640 1 -- 172.21.15.29:0/1808034006 shutdown_connections 2024-01-24T13:07:12.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.885+0000 7f5311e00640 1 -- 172.21.15.29:0/1808034006 wait complete. 2024-01-24T13:07:12.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f5311e00640 1 Processor -- start 2024-01-24T13:07:12.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f5311e00640 1 -- start start 2024-01-24T13:07:12.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f5311e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f530c069cd0 0x7f530c158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:12.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f5311e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f530c06cc40 0x7f530c1546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:12.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f5311e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530c15c8b0 0x7f530c0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f5311e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c158660 con 0x7f530c15c8b0 2024-01-24T13:07:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f5311e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c159ba0 con 0x7f530c06cc40 2024-01-24T13:07:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f5311e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c0b22a0 con 0x7f530c069cd0 2024-01-24T13:07:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f530b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530c15c8b0 0x7f530c0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f530b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530c15c8b0 0x7f530c0b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47008/0 (socket says 172.21.15.29:47008) 2024-01-24T13:07:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f530b400640 1 -- 172.21.15.29:0/139011196 learned_addr learned my addr 172.21.15.29:0/139011196 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f530aa00640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f530c069cd0 0x7f530c158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f530a000640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f530c06cc40 0x7f530c1546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f530b400640 1 -- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f530c069cd0 msgr2=0x7f530c158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f530b400640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f530c069cd0 0x7f530c158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f530b400640 1 -- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f530c06cc40 msgr2=0x7f530c1546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f530b400640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f530c06cc40 0x7f530c1546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:12.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f530b400640 1 -- 172.21.15.29:0/139011196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0094d0 con 0x7f530c15c8b0 2024-01-24T13:07:12.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f530a000640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f530c06cc40 0x7f530c1546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:12.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f530b400640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530c15c8b0 0x7f530c0b3b50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f530400ba10 tx=0x7f530400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:12.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f5303400640 1 -- 172.21.15.29:0/139011196 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530400cac0 con 0x7f530c15c8b0 2024-01-24T13:07:12.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f5303400640 1 -- 172.21.15.29:0/139011196 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530400cc20 con 0x7f530c15c8b0 2024-01-24T13:07:12.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f5311e00640 1 -- 172.21.15.29:0/139011196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530c159e10 con 0x7f530c15c8b0 2024-01-24T13:07:12.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f5303400640 1 -- 172.21.15.29:0/139011196 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304014440 con 0x7f530c15c8b0 2024-01-24T13:07:12.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f5311e00640 1 -- 172.21.15.29:0/139011196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530c154c30 con 0x7f530c15c8b0 2024-01-24T13:07:12.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.889+0000 7f5311e00640 1 -- 172.21.15.29:0/139011196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530c15a330 con 0x7f530c15c8b0 2024-01-24T13:07:12.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.893+0000 7f5303400640 1 -- 172.21.15.29:0/139011196 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f530401d3b0 con 0x7f530c15c8b0 2024-01-24T13:07:12.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.893+0000 7f5303400640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f52e4065a60 0x7f52e4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:12.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.893+0000 7f5303400640 1 -- 172.21.15.29:0/139011196 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5677+0+0 (secure 0 0 0) 0x7f5304082ff0 con 0x7f530c15c8b0 2024-01-24T13:07:12.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.893+0000 7f530aa00640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f52e4065a60 0x7f52e4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:12.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.893+0000 7f530aa00640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f52e4065a60 0x7f52e4067f20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0ae000 tx=0x7f52fc0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:12.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:12.897+0000 7f5303400640 1 -- 172.21.15.29:0/139011196 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f530c15a330 con 0x7f530c15c8b0 2024-01-24T13:07:13.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.057+0000 7f5311e00640 1 -- 172.21.15.29:0/139011196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f530c15a330 con 0x7f530c15c8b0 2024-01-24T13:07:13.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.705+0000 7f5303400640 1 -- 172.21.15.29:0/139011196 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v62) v1 ==== 169+0+0 (secure 0 0 0) 0x7f530c15a330 con 0x7f530c15c8b0 2024-01-24T13:07:13.712 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2024-01-24T13:07:13.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.709+0000 7f5311e00640 1 -- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f52e4065a60 msgr2=0x7f52e4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:13.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.709+0000 7f5311e00640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f52e4065a60 0x7f52e4067f20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0ae000 tx=0x7f52fc0a7000 comp rx=0 tx=0).stop 2024-01-24T13:07:13.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.709+0000 7f5311e00640 1 -- 172.21.15.29:0/139011196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530c15c8b0 msgr2=0x7f530c0b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:13.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.709+0000 7f5311e00640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530c15c8b0 0x7f530c0b3b50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f530400ba10 tx=0x7f530400bed0 comp rx=0 tx=0).stop 2024-01-24T13:07:13.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.709+0000 7f5311e00640 1 -- 172.21.15.29:0/139011196 shutdown_connections 2024-01-24T13:07:13.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.709+0000 7f5311e00640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f52e4065a60 0x7f52e4067f20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:13.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.709+0000 7f5311e00640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530c15c8b0 0x7f530c0b3b50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:13.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.709+0000 7f5311e00640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f530c06cc40 0x7f530c1546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:13.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.709+0000 7f5311e00640 1 --2- 172.21.15.29:0/139011196 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f530c069cd0 0x7f530c158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:13.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.709+0000 7f5311e00640 1 -- 172.21.15.29:0/139011196 >> 172.21.15.29:0/139011196 conn(0x7f530c0cf2c0 msgr2=0x7f530c0713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:13.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.709+0000 7f5311e00640 1 -- 172.21.15.29:0/139011196 shutdown_connections 2024-01-24T13:07:13.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.709+0000 7f5311e00640 1 -- 172.21.15.29:0/139011196 wait complete. 2024-01-24T13:07:13.753 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-24T13:07:13.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00f5400640 1 Processor -- start 2024-01-24T13:07:13.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00f5400640 1 -- start start 2024-01-24T13:07:13.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00f5400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00f0159e00 0x7f00f006bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:13.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00f5400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f00f006c050 0x7f00f00b1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:13.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00f5400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f00f00b1ed0 0x7f00f015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:13.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00f5400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f00b2c80 con 0x7f00f006c050 2024-01-24T13:07:13.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00f5400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f006fc00 con 0x7f00f00b1ed0 2024-01-24T13:07:13.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00f5400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f006c4d0 con 0x7f00f0159e00 2024-01-24T13:07:13.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00ede00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f00f006c050 0x7f00f00b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:13.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00ede00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f00f006c050 0x7f00f00b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47016/0 (socket says 172.21.15.29:47016) 2024-01-24T13:07:13.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00ede00640 1 -- 172.21.15.29:0/3263411158 learned_addr learned my addr 172.21.15.29:0/3263411158 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:13.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00ef200640 1 --2- 172.21.15.29:0/3263411158 >> v2:172.21.15.163:3300/0 conn(0x7f00f00b1ed0 0x7f00f015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:13.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00ee800640 1 --2- 172.21.15.29:0/3263411158 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00f0159e00 0x7f00f006bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:13.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00ede00640 1 -- 172.21.15.29:0/3263411158 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00f0159e00 msgr2=0x7f00f006bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:13.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00ede00640 1 --2- 172.21.15.29:0/3263411158 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00f0159e00 0x7f00f006bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:13.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00ede00640 1 -- 172.21.15.29:0/3263411158 >> v2:172.21.15.163:3300/0 conn(0x7f00f00b1ed0 msgr2=0x7f00f015c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:13.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00ede00640 1 --2- 172.21.15.29:0/3263411158 >> v2:172.21.15.163:3300/0 conn(0x7f00f00b1ed0 0x7f00f015c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:13.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.893+0000 7f00ede00640 1 -- 172.21.15.29:0/3263411158 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f015a1e0 con 0x7f00f006c050 2024-01-24T13:07:13.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.897+0000 7f00ede00640 1 --2- 172.21.15.29:0/3263411158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f006c050 0x7f00f00b1990 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f00f00cf210 tx=0x7f00d801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9804a7ced339d650 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:13.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.897+0000 7f00ed400640 1 -- 172.21.15.29:0/3263411158 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d80a4ea0 con 0x7f00f006c050 2024-01-24T13:07:13.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.897+0000 7f00ed400640 1 -- 172.21.15.29:0/3263411158 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d80a7050 con 0x7f00f006c050 2024-01-24T13:07:13.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.897+0000 7f00ed400640 1 -- 172.21.15.29:0/3263411158 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d80ab820 con 0x7f00f006c050 2024-01-24T13:07:13.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.897+0000 7f00f5400640 1 -- 172.21.15.29:0/3263411158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f006c050 msgr2=0x7f00f00b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:13.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.897+0000 7f00f5400640 1 --2- 172.21.15.29:0/3263411158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f006c050 0x7f00f00b1990 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f00f00cf210 tx=0x7f00d801c3e0 comp rx=0 tx=0).stop 2024-01-24T13:07:13.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.897+0000 7f00f5400640 1 -- 172.21.15.29:0/3263411158 shutdown_connections 2024-01-24T13:07:13.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.897+0000 7f00f5400640 1 --2- 172.21.15.29:0/3263411158 >> v2:172.21.15.163:3300/0 conn(0x7f00f00b1ed0 0x7f00f015c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:13.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.897+0000 7f00f5400640 1 --2- 172.21.15.29:0/3263411158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f006c050 0x7f00f00b1990 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:13.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.897+0000 7f00f5400640 1 --2- 172.21.15.29:0/3263411158 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00f0159e00 0x7f00f006bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:13.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.897+0000 7f00f5400640 1 -- 172.21.15.29:0/3263411158 >> 172.21.15.29:0/3263411158 conn(0x7f00f006d790 msgr2=0x7f00f0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:13.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.897+0000 7f00f5400640 1 -- 172.21.15.29:0/3263411158 shutdown_connections 2024-01-24T13:07:13.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.897+0000 7f00f5400640 1 -- 172.21.15.29:0/3263411158 wait complete. 2024-01-24T13:07:13.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00f5400640 1 Processor -- start 2024-01-24T13:07:13.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00f5400640 1 -- start start 2024-01-24T13:07:13.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00f5400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f006c050 0x7f00f0146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:13.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00f5400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00f00b1ed0 0x7f00f01553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00f5400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00f0159e00 0x7f00f0151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00f5400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f00b0ba0 con 0x7f00f006c050 2024-01-24T13:07:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00f5400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0155c60 con 0x7f00f0159e00 2024-01-24T13:07:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00f5400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0155f40 con 0x7f00f00b1ed0 2024-01-24T13:07:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00ee800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f006c050 0x7f00f0146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00ee800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f006c050 0x7f00f0146370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47030/0 (socket says 172.21.15.29:47030) 2024-01-24T13:07:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00ee800640 1 -- 172.21.15.29:0/2638485438 learned_addr learned my addr 172.21.15.29:0/2638485438 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00ede00640 1 --2- 172.21.15.29:0/2638485438 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00f00b1ed0 0x7f00f01553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00ef200640 1 --2- 172.21.15.29:0/2638485438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00f0159e00 0x7f00f0151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00ee800640 1 -- 172.21.15.29:0/2638485438 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00f00b1ed0 msgr2=0x7f00f01553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00ee800640 1 --2- 172.21.15.29:0/2638485438 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00f00b1ed0 0x7f00f01553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00ee800640 1 -- 172.21.15.29:0/2638485438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00f0159e00 msgr2=0x7f00f0151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00ee800640 1 --2- 172.21.15.29:0/2638485438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00f0159e00 0x7f00f0151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00ee800640 1 -- 172.21.15.29:0/2638485438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d80094d0 con 0x7f00f006c050 2024-01-24T13:07:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00ee800640 1 --2- 172.21.15.29:0/2638485438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f006c050 0x7f00f0146370 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f00e000d800 tx=0x7f00e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00e6a00640 1 -- 172.21.15.29:0/2638485438 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e000b6c0 con 0x7f00f006c050 2024-01-24T13:07:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00e6a00640 1 -- 172.21.15.29:0/2638485438 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e000b820 con 0x7f00f006c050 2024-01-24T13:07:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00e6a00640 1 -- 172.21.15.29:0/2638485438 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e000bb90 con 0x7f00f006c050 2024-01-24T13:07:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00f5400640 1 -- 172.21.15.29:0/2638485438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f0156220 con 0x7f00f006c050 2024-01-24T13:07:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00f5400640 1 -- 172.21.15.29:0/2638485438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f01468b0 con 0x7f00f006c050 2024-01-24T13:07:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.901+0000 7f00f5400640 1 -- 172.21.15.29:0/2638485438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f004e850 con 0x7f00f006c050 2024-01-24T13:07:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.905+0000 7f00e6a00640 1 -- 172.21.15.29:0/2638485438 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f00e000bcf0 con 0x7f00f006c050 2024-01-24T13:07:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.905+0000 7f00e6a00640 1 --2- 172.21.15.29:0/2638485438 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f00c8065a60 0x7f00c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:13.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.905+0000 7f00e6a00640 1 -- 172.21.15.29:0/2638485438 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f00e0083430 con 0x7f00f006c050 2024-01-24T13:07:13.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.905+0000 7f00ede00640 1 --2- 172.21.15.29:0/2638485438 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f00c8065a60 0x7f00c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:13.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.905+0000 7f00ede00640 1 --2- 172.21.15.29:0/2638485438 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f00c8065a60 0x7f00c8067f20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f00d80ad000 tx=0x7f00d8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:13.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:13.909+0000 7f00e6a00640 1 -- 172.21.15.29:0/2638485438 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f00e0051050 con 0x7f00f006c050 2024-01-24T13:07:14.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.069+0000 7f00f5400640 1 -- 172.21.15.29:0/2638485438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f00f0159220 con 0x7f00f006c050 2024-01-24T13:07:14.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.073+0000 7f00e6a00640 1 -- 172.21.15.29:0/2638485438 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f00e0054670 con 0x7f00f006c050 2024-01-24T13:07:14.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.077+0000 7f00f5400640 1 -- 172.21.15.29:0/2638485438 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f00c8065a60 msgr2=0x7f00c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:14.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.077+0000 7f00f5400640 1 --2- 172.21.15.29:0/2638485438 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f00c8065a60 0x7f00c8067f20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f00d80ad000 tx=0x7f00d8008040 comp rx=0 tx=0).stop 2024-01-24T13:07:14.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.077+0000 7f00f5400640 1 -- 172.21.15.29:0/2638485438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f006c050 msgr2=0x7f00f0146370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:14.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.077+0000 7f00f5400640 1 --2- 172.21.15.29:0/2638485438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f006c050 0x7f00f0146370 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f00e000d800 tx=0x7f00e000dcc0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.077+0000 7f00f5400640 1 -- 172.21.15.29:0/2638485438 shutdown_connections 2024-01-24T13:07:14.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.077+0000 7f00f5400640 1 --2- 172.21.15.29:0/2638485438 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f00c8065a60 0x7f00c8067f20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.077+0000 7f00f5400640 1 --2- 172.21.15.29:0/2638485438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00f0159e00 0x7f00f0151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.077+0000 7f00f5400640 1 --2- 172.21.15.29:0/2638485438 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00f00b1ed0 0x7f00f01553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.077+0000 7f00f5400640 1 --2- 172.21.15.29:0/2638485438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f006c050 0x7f00f0146370 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.077+0000 7f00f5400640 1 -- 172.21.15.29:0/2638485438 >> 172.21.15.29:0/2638485438 conn(0x7f00f006d790 msgr2=0x7f00f0156df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:14.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.077+0000 7f00f5400640 1 -- 172.21.15.29:0/2638485438 shutdown_connections 2024-01-24T13:07:14.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.077+0000 7f00f5400640 1 -- 172.21.15.29:0/2638485438 wait complete. 2024-01-24T13:07:14.101 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-01-24T13:07:14.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.237+0000 7f9bc2600640 1 Processor -- start 2024-01-24T13:07:14.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.237+0000 7f9bc2600640 1 -- start start 2024-01-24T13:07:14.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.237+0000 7f9bc2600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bbc159300 0x7f9bbc0b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:14.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.237+0000 7f9bc2600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9bbc06bc10 0x7f9bbc06c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:14.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.237+0000 7f9bc2600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9bbc15cf50 0x7f9bbc15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:14.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.237+0000 7f9bc2600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc071140 con 0x7f9bbc06bc10 2024-01-24T13:07:14.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.237+0000 7f9bc2600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc15d920 con 0x7f9bbc15cf50 2024-01-24T13:07:14.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.237+0000 7f9bc2600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc06c5b0 con 0x7f9bbc159300 2024-01-24T13:07:14.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.237+0000 7f9bbaa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9bbc06bc10 0x7f9bbc06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:14.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bbaa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9bbc06bc10 0x7f9bbc06c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47032/0 (socket says 172.21.15.29:47032) 2024-01-24T13:07:14.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bbaa00640 1 -- 172.21.15.29:0/2876048729 learned_addr learned my addr 172.21.15.29:0/2876048729 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:14.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bbb400640 1 --2- 172.21.15.29:0/2876048729 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bbc159300 0x7f9bbc0b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:14.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bbaa00640 1 -- 172.21.15.29:0/2876048729 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bbc159300 msgr2=0x7f9bbc0b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:14.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bbbe00640 1 --2- 172.21.15.29:0/2876048729 >> v2:172.21.15.163:3300/0 conn(0x7f9bbc15cf50 0x7f9bbc15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:14.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bbaa00640 1 --2- 172.21.15.29:0/2876048729 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bbc159300 0x7f9bbc0b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bbaa00640 1 -- 172.21.15.29:0/2876048729 >> v2:172.21.15.163:3300/0 conn(0x7f9bbc15cf50 msgr2=0x7f9bbc15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:14.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bbaa00640 1 --2- 172.21.15.29:0/2876048729 >> v2:172.21.15.163:3300/0 conn(0x7f9bbc15cf50 0x7f9bbc15d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bbaa00640 1 -- 172.21.15.29:0/2876048729 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc15de10 con 0x7f9bbc06bc10 2024-01-24T13:07:14.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bbb400640 1 --2- 172.21.15.29:0/2876048729 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bbc159300 0x7f9bbc0b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:14.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bbbe00640 1 --2- 172.21.15.29:0/2876048729 >> v2:172.21.15.163:3300/0 conn(0x7f9bbc15cf50 0x7f9bbc15d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:14.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bbaa00640 1 --2- 172.21.15.29:0/2876048729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bbc06bc10 0x7f9bbc06c070 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0cb810 tx=0x7f9ba401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb8e07fbe55e748 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:14.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bba000640 1 -- 172.21.15.29:0/2876048729 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40a7ba0 con 0x7f9bbc06bc10 2024-01-24T13:07:14.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bba000640 1 -- 172.21.15.29:0/2876048729 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba40a7d00 con 0x7f9bbc06bc10 2024-01-24T13:07:14.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.241+0000 7f9bba000640 1 -- 172.21.15.29:0/2876048729 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40af660 con 0x7f9bbc06bc10 2024-01-24T13:07:14.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 -- 172.21.15.29:0/2876048729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bbc06bc10 msgr2=0x7f9bbc06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:14.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 --2- 172.21.15.29:0/2876048729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bbc06bc10 0x7f9bbc06c070 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0cb810 tx=0x7f9ba401eb10 comp rx=0 tx=0).stop 2024-01-24T13:07:14.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 -- 172.21.15.29:0/2876048729 shutdown_connections 2024-01-24T13:07:14.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 --2- 172.21.15.29:0/2876048729 >> v2:172.21.15.163:3300/0 conn(0x7f9bbc15cf50 0x7f9bbc15d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 --2- 172.21.15.29:0/2876048729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bbc06bc10 0x7f9bbc06c070 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 --2- 172.21.15.29:0/2876048729 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bbc159300 0x7f9bbc0b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 -- 172.21.15.29:0/2876048729 >> 172.21.15.29:0/2876048729 conn(0x7f9bbc0b3950 msgr2=0x7f9bbc069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:14.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 -- 172.21.15.29:0/2876048729 shutdown_connections 2024-01-24T13:07:14.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 -- 172.21.15.29:0/2876048729 wait complete. 2024-01-24T13:07:14.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 Processor -- start 2024-01-24T13:07:14.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 -- start start 2024-01-24T13:07:14.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bbc06bc10 0x7f9bbc147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:14.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bbc159300 0x7f9bbc149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:14.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bbc15cf50 0x7f9bbc149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:14.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc158730 con 0x7f9bbc15cf50 2024-01-24T13:07:14.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc158170 con 0x7f9bbc159300 2024-01-24T13:07:14.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bc2600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc158450 con 0x7f9bbc06bc10 2024-01-24T13:07:14.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bbbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bbc15cf50 0x7f9bbc149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:14.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bbbe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bbc15cf50 0x7f9bbc149970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47046/0 (socket says 172.21.15.29:47046) 2024-01-24T13:07:14.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bbbe00640 1 -- 172.21.15.29:0/457418869 learned_addr learned my addr 172.21.15.29:0/457418869 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:14.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bbaa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bbc159300 0x7f9bbc149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:14.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.245+0000 7f9bbb400640 1 --2- 172.21.15.29:0/457418869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bbc06bc10 0x7f9bbc147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:14.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.249+0000 7f9bbbe00640 1 -- 172.21.15.29:0/457418869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bbc06bc10 msgr2=0x7f9bbc147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:14.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.249+0000 7f9bbbe00640 1 --2- 172.21.15.29:0/457418869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bbc06bc10 0x7f9bbc147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.249+0000 7f9bbbe00640 1 -- 172.21.15.29:0/457418869 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bbc159300 msgr2=0x7f9bbc149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:14.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.249+0000 7f9bbbe00640 1 --2- 172.21.15.29:0/457418869 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bbc159300 0x7f9bbc149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.249+0000 7f9bbbe00640 1 -- 172.21.15.29:0/457418869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba400b770 con 0x7f9bbc15cf50 2024-01-24T13:07:14.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.249+0000 7f9bbaa00640 1 --2- 172.21.15.29:0/457418869 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bbc159300 0x7f9bbc149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:07:14.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.249+0000 7f9bbbe00640 1 --2- 172.21.15.29:0/457418869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bbc15cf50 0x7f9bbc149970 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400cd50 tx=0x7f9bb400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:14.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.249+0000 7f9bb3400640 1 -- 172.21.15.29:0/457418869 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400f680 con 0x7f9bbc15cf50 2024-01-24T13:07:14.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.249+0000 7f9bb3400640 1 -- 172.21.15.29:0/457418869 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb400f800 con 0x7f9bbc15cf50 2024-01-24T13:07:14.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.249+0000 7f9bb3400640 1 -- 172.21.15.29:0/457418869 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400fbb0 con 0x7f9bbc15cf50 2024-01-24T13:07:14.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.249+0000 7f9bc2600640 1 -- 172.21.15.29:0/457418869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc14f1b0 con 0x7f9bbc15cf50 2024-01-24T13:07:14.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.249+0000 7f9bc2600640 1 -- 172.21.15.29:0/457418869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc1f58f0 con 0x7f9bbc15cf50 2024-01-24T13:07:14.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.249+0000 7f9bc2600640 1 -- 172.21.15.29:0/457418869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc04e850 con 0x7f9bbc15cf50 2024-01-24T13:07:14.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.249+0000 7f9bb3400640 1 -- 172.21.15.29:0/457418869 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9bb400b040 con 0x7f9bbc15cf50 2024-01-24T13:07:14.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.253+0000 7f9bb3400640 1 --2- 172.21.15.29:0/457418869 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9b94065a60 0x7f9b94067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:14.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.253+0000 7f9bb3400640 1 -- 172.21.15.29:0/457418869 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9bb4083820 con 0x7f9bbc15cf50 2024-01-24T13:07:14.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.253+0000 7f9bbb400640 1 --2- 172.21.15.29:0/457418869 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9b94065a60 0x7f9b94067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:14.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.253+0000 7f9bbb400640 1 --2- 172.21.15.29:0/457418869 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9b94065a60 0x7f9b94067f20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00ab60 tx=0x7f9bac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:14.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.257+0000 7f9bb3400640 1 -- 172.21.15.29:0/457418869 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9bb4051440 con 0x7f9bbc15cf50 2024-01-24T13:07:14.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.465+0000 7f9bc2600640 1 -- 172.21.15.29:0/457418869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7f9bbc14f660 con 0x7f9bbc15cf50 2024-01-24T13:07:14.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.709+0000 7f9bb3400640 1 -- 172.21.15.29:0/457418869 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v199) v1 ==== 134+0+0 (secure 0 0 0) 0x7f9bb4054a60 con 0x7f9bbc15cf50 2024-01-24T13:07:14.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.709+0000 7f9bc2600640 1 -- 172.21.15.29:0/457418869 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9b94065a60 msgr2=0x7f9b94067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:14.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.709+0000 7f9bc2600640 1 --2- 172.21.15.29:0/457418869 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9b94065a60 0x7f9b94067f20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00ab60 tx=0x7f9bac008040 comp rx=0 tx=0).stop 2024-01-24T13:07:14.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.709+0000 7f9bc2600640 1 -- 172.21.15.29:0/457418869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bbc15cf50 msgr2=0x7f9bbc149970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:14.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.709+0000 7f9bc2600640 1 --2- 172.21.15.29:0/457418869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bbc15cf50 0x7f9bbc149970 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400cd50 tx=0x7f9bb400a650 comp rx=0 tx=0).stop 2024-01-24T13:07:14.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.709+0000 7f9bc2600640 1 -- 172.21.15.29:0/457418869 shutdown_connections 2024-01-24T13:07:14.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.709+0000 7f9bc2600640 1 --2- 172.21.15.29:0/457418869 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9b94065a60 0x7f9b94067f20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.709+0000 7f9bc2600640 1 --2- 172.21.15.29:0/457418869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bbc15cf50 0x7f9bbc149970 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.709+0000 7f9bc2600640 1 --2- 172.21.15.29:0/457418869 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bbc159300 0x7f9bbc149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.709+0000 7f9bc2600640 1 --2- 172.21.15.29:0/457418869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bbc06bc10 0x7f9bbc147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:14.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.709+0000 7f9bc2600640 1 -- 172.21.15.29:0/457418869 >> 172.21.15.29:0/457418869 conn(0x7f9bbc0b3950 msgr2=0x7f9bbc0b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:14.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.709+0000 7f9bc2600640 1 -- 172.21.15.29:0/457418869 shutdown_connections 2024-01-24T13:07:14.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:14.709+0000 7f9bc2600640 1 -- 172.21.15.29:0/457418869 wait complete. 2024-01-24T13:07:14.736 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ERROR 2024-01-24T13:07:14.737 INFO:tasks.cephfs_test_runner: 2024-01-24T13:07:14.737 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-24T13:07:14.737 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-01-24T13:07:14.737 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-24T13:07:14.737 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-24T13:07:14.737 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2024-01-24T13:07:14.737 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2024-01-24T13:07:14.737 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs/mount.py", line 777, in run_python 2024-01-24T13:07:14.737 INFO:tasks.cephfs_test_runner: p.wait() 2024-01-24T13:07:14.737 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait 2024-01-24T13:07:14.737 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-01-24T13:07:14.737 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-01-24T13:07:14.737 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-01-24T13:07:14.737 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 1: 'adjust-ulimits daemon-helper kill python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner: 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner:Ran 2 tests in 146.306s 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner: 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner: 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs/mount.py", line 777, in run_python 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner: p.wait() 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait 2024-01-24T13:07:14.738 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-01-24T13:07:14.739 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-01-24T13:07:14.739 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-01-24T13:07:14.739 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 1: 'adjust-ulimits daemon-helper kill python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2024-01-24T13:07:14.739 INFO:tasks.cephfs_test_runner: 2024-01-24T13:07:14.739 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-01-24T13:07:14.961 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9779b32c64eb45a692e5b25c06336110 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-01-24T13:07:14.963 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-24T13:07:14.971 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-01-24T13:07:14.990 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-01-24T13:07:14.990 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:07:14.990 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:07:15.004 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357740k,nr_inodes=4089435,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4625 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275996k,nr_inodes=818999,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-24T13:07:15.004 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-24T13:07:15.004 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:07:15.055 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357740k,nr_inodes=4089435,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4625 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275996k,nr_inodes=818999,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-24T13:07:15.055 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:07:15.056 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:07:15.065 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5116 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-24T13:07:15.065 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-01-24T13:07:15.065 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T13:07:15.114 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5116 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-24T13:07:15.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:15.114 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2024-01-24T13:07:15.166 INFO:teuthology.orchestra.run.smithi163.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-24T13:07:15.167 INFO:teuthology.orchestra.run.smithi163.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-01-24T13:07:15.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:15.168 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-24T13:07:15.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:15.231 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-24T13:07:15.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:15.319 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2024-01-24T13:07:15.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:15.497 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-24T13:07:15.508 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-24T13:07:15.508 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-24T13:07:15.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:15.509 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-24T13:07:15.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:15.574 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-24T13:07:15.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T13:07:15.653 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-01-24T13:07:15.855 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-24T13:07:15.865 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-24T13:07:15.865 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:07:16.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8ba000640 1 Processor -- start 2024-01-24T13:07:16.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8ba000640 1 -- start start 2024-01-24T13:07:16.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8ba000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8b40c3a10 0x7ff8b41611f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8ba000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff8b406ade0 0x7ff8b406b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8ba000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b40d0420 con 0x7ff8b40ccdb0 2024-01-24T13:07:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8ba000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b406c430 con 0x7ff8b406ade0 2024-01-24T13:07:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8ba000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4161ae0 con 0x7ff8b40c3a10 2024-01-24T13:07:16.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8b2a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8b40c3a10 0x7ff8b41611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8b3e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff8b406ade0 0x7ff8b406b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8b2a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8b40c3a10 0x7ff8b41611f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.29:54768/0 (socket says 172.21.15.29:54768) 2024-01-24T13:07:16.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8b2a00640 1 -- 172.21.15.29:0/3819248226 learned_addr learned my addr 172.21.15.29:0/3819248226 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:16.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8b3400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7ff8b40ccdb0 0x7ff8b40cd190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:44490/0 (socket says 172.21.15.29:44490) 2024-01-24T13:07:16.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8b2a00640 1 -- 172.21.15.29:0/3819248226 >> v2:172.21.15.163:3300/0 conn(0x7ff8b406ade0 msgr2=0x7ff8b406b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:16.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8b2a00640 1 --2- 172.21.15.29:0/3819248226 >> v2:172.21.15.163:3300/0 conn(0x7ff8b406ade0 0x7ff8b406b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8b2a00640 1 -- 172.21.15.29:0/3819248226 >> v1:172.21.15.163:6789/0 conn(0x7ff8b40ccdb0 legacy=0x7ff8b40cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8b2a00640 1 -- 172.21.15.29:0/3819248226 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b4161dc0 con 0x7ff8b40c3a10 2024-01-24T13:07:16.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.009+0000 7ff8b3e00640 1 --2- 172.21.15.29:0/3819248226 >> v2:172.21.15.163:3300/0 conn(0x7ff8b406ade0 0x7ff8b406b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:07:16.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.013+0000 7ff8b2a00640 1 --2- 172.21.15.29:0/3819248226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8b40c3a10 0x7ff8b41611f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff89c009870 tx=0x7ff89c01c1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62b531c3c0d91a81 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:16.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.013+0000 7ff8b2000640 1 -- 172.21.15.29:0/3819248226 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0a4ea0 con 0x7ff8b40c3a10 2024-01-24T13:07:16.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.013+0000 7ff8b2000640 1 -- 172.21.15.29:0/3819248226 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c0a7050 con 0x7ff8b40c3a10 2024-01-24T13:07:16.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.013+0000 7ff8b2000640 1 -- 172.21.15.29:0/3819248226 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0ab820 con 0x7ff8b40c3a10 2024-01-24T13:07:16.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.013+0000 7ff8ba000640 1 -- 172.21.15.29:0/3819248226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8b40c3a10 msgr2=0x7ff8b41611f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.013+0000 7ff8ba000640 1 --2- 172.21.15.29:0/3819248226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8b40c3a10 0x7ff8b41611f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff89c009870 tx=0x7ff89c01c1f0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8ba000640 1 -- 172.21.15.29:0/3819248226 shutdown_connections 2024-01-24T13:07:16.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8ba000640 1 --2- 172.21.15.29:0/3819248226 >> v2:172.21.15.163:3300/0 conn(0x7ff8b406ade0 0x7ff8b406b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8ba000640 1 --2- 172.21.15.29:0/3819248226 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8b40c3a10 0x7ff8b41611f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8ba000640 1 -- 172.21.15.29:0/3819248226 >> 172.21.15.29:0/3819248226 conn(0x7ff8b4070570 msgr2=0x7ff8b4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:16.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8ba000640 1 -- 172.21.15.29:0/3819248226 shutdown_connections 2024-01-24T13:07:16.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8ba000640 1 -- 172.21.15.29:0/3819248226 wait complete. 2024-01-24T13:07:16.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8ba000640 1 Processor -- start 2024-01-24T13:07:16.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8ba000640 1 -- start start 2024-01-24T13:07:16.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8ba000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8b406ade0 0x7ff8b41575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8ba000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8b40c3a10 0x7ff8b415f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8ba000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8b40ccdb0 0x7ff8b415fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8ba000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40b3f50 con 0x7ff8b40c3a10 2024-01-24T13:07:16.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8ba000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b41603f0 con 0x7ff8b40ccdb0 2024-01-24T13:07:16.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8ba000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40b41a0 con 0x7ff8b406ade0 2024-01-24T13:07:16.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8b2a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8b40c3a10 0x7ff8b415f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8b2a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8b40c3a10 0x7ff8b415f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47060/0 (socket says 172.21.15.29:47060) 2024-01-24T13:07:16.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8b2a00640 1 -- 172.21.15.29:0/3630782089 learned_addr learned my addr 172.21.15.29:0/3630782089 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:16.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8b3e00640 1 --2- 172.21.15.29:0/3630782089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8b40ccdb0 0x7ff8b415fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8b3400640 1 --2- 172.21.15.29:0/3630782089 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8b406ade0 0x7ff8b41575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8b2a00640 1 -- 172.21.15.29:0/3630782089 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8b406ade0 msgr2=0x7ff8b41575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.017+0000 7ff8b2a00640 1 --2- 172.21.15.29:0/3630782089 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8b406ade0 0x7ff8b41575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.021+0000 7ff8b2a00640 1 -- 172.21.15.29:0/3630782089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8b40ccdb0 msgr2=0x7ff8b415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.021+0000 7ff8b2a00640 1 --2- 172.21.15.29:0/3630782089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8b40ccdb0 0x7ff8b415fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.021+0000 7ff8b2a00640 1 -- 172.21.15.29:0/3630782089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac009a70 con 0x7ff8b40c3a10 2024-01-24T13:07:16.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.021+0000 7ff8b2a00640 1 --2- 172.21.15.29:0/3630782089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8b40c3a10 0x7ff8b415f520 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0ae040 tx=0x7ff89c01aa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:16.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.021+0000 7ff8ab400640 1 -- 172.21.15.29:0/3630782089 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0a4ea0 con 0x7ff8b40c3a10 2024-01-24T13:07:16.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.021+0000 7ff8ab400640 1 -- 172.21.15.29:0/3630782089 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c0b6420 con 0x7ff8b40c3a10 2024-01-24T13:07:16.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.021+0000 7ff8ba000640 1 -- 172.21.15.29:0/3630782089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89c0094d0 con 0x7ff8b40c3a10 2024-01-24T13:07:16.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.021+0000 7ff8ab400640 1 -- 172.21.15.29:0/3630782089 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0b67d0 con 0x7ff8b40c3a10 2024-01-24T13:07:16.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.021+0000 7ff8ba000640 1 -- 172.21.15.29:0/3630782089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b41618b0 con 0x7ff8b40c3a10 2024-01-24T13:07:16.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.021+0000 7ff8ba000640 1 -- 172.21.15.29:0/3630782089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b404e850 con 0x7ff8b40c3a10 2024-01-24T13:07:16.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.021+0000 7ff8ab400640 1 -- 172.21.15.29:0/3630782089 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff89c0b2040 con 0x7ff8b40c3a10 2024-01-24T13:07:16.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.021+0000 7ff8ab400640 1 --2- 172.21.15.29:0/3630782089 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff88c065a60 0x7ff88c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.025+0000 7ff8ab400640 1 -- 172.21.15.29:0/3630782089 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff89c11d060 con 0x7ff8b40c3a10 2024-01-24T13:07:16.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.025+0000 7ff8b3400640 1 --2- 172.21.15.29:0/3630782089 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff88c065a60 0x7ff88c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.025+0000 7ff8b3400640 1 --2- 172.21.15.29:0/3630782089 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff88c065a60 0x7ff88c067f20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4000f70 tx=0x7ff8a4007c90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:16.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.029+0000 7ff8ab400640 1 -- 172.21.15.29:0/3630782089 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff89c0eac60 con 0x7ff8b40c3a10 2024-01-24T13:07:16.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.185+0000 7ff8ba000640 1 -- 172.21.15.29:0/3630782089 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8b4161730 con 0x7ff88c065a60 2024-01-24T13:07:16.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.185+0000 7ff8ab400640 1 -- 172.21.15.29:0/3630782089 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50654 (secure 0 0 0) 0x7ff8a4005a60 con 0x7ff88c065a60 2024-01-24T13:07:16.192 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:16.193 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:07:16.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.189+0000 7ff8ba000640 1 -- 172.21.15.29:0/3630782089 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff88c065a60 msgr2=0x7ff88c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.189+0000 7ff8ba000640 1 --2- 172.21.15.29:0/3630782089 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff88c065a60 0x7ff88c067f20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4000f70 tx=0x7ff8a4007c90 comp rx=0 tx=0).stop 2024-01-24T13:07:16.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.189+0000 7ff8ba000640 1 -- 172.21.15.29:0/3630782089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8b40c3a10 msgr2=0x7ff8b415f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.189+0000 7ff8ba000640 1 --2- 172.21.15.29:0/3630782089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8b40c3a10 0x7ff8b415f520 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0ae040 tx=0x7ff89c01aa30 comp rx=0 tx=0).stop 2024-01-24T13:07:16.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.189+0000 7ff8ba000640 1 -- 172.21.15.29:0/3630782089 shutdown_connections 2024-01-24T13:07:16.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.189+0000 7ff8ba000640 1 --2- 172.21.15.29:0/3630782089 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7ff88c065a60 0x7ff88c067f20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.189+0000 7ff8ba000640 1 --2- 172.21.15.29:0/3630782089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8b40ccdb0 0x7ff8b415fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.189+0000 7ff8ba000640 1 --2- 172.21.15.29:0/3630782089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8b40c3a10 0x7ff8b415f520 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.189+0000 7ff8ba000640 1 --2- 172.21.15.29:0/3630782089 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8b406ade0 0x7ff8b41575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.189+0000 7ff8ba000640 1 -- 172.21.15.29:0/3630782089 >> 172.21.15.29:0/3630782089 conn(0x7ff8b4070570 msgr2=0x7ff8b40cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:16.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.189+0000 7ff8ba000640 1 -- 172.21.15.29:0/3630782089 shutdown_connections 2024-01-24T13:07:16.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.189+0000 7ff8ba000640 1 -- 172.21.15.29:0/3630782089 wait complete. 2024-01-24T13:07:16.213 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-01-24T13:07:15.586595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239368,"kb_used_data":6820,"kb_used_omap":13,"kb_used_meta":232434,"kb_avail":754735352,"statfs":{"total":773094113280,"available":772849000448,"internally_reserved":0,"allocated":6983680,"data_stored":3757242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":238012504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14888,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-65,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001449"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":196,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559292+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:06:34.559292+0000","last_peered":"2024-01-24T13:06:34.559292+0000","last_clean":"2024-01-24T13:06:34.559292+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:06:34.559292+0000","last_undegraded":"2024-01-24T13:06:34.559292+0000","last_fullsized":"2024-01-24T13:06:34.559292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":720896,"data_stored":317971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70499999999999996,"15min":0.72299999999999998},"min":{"1min":0.50800000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99099999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.44900000000000001}]},{"osd":1,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.53400000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.71899999999999997},"min":{"1min":0.53700000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94599999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.54000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88500000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73599999999999999,"15min":0.747},"min":{"1min":0.57699999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93100000000000005,"5min":1.131,"15min":1.131},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.502,"15min":0.502},"max":{"1min":0.95899999999999996,"5min":1.05,"15min":1.05},"last":0.66200000000000003}]},{"osd":4,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80400000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.746},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67400000000000004,"15min":0.70299999999999996},"min":{"1min":0.41499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.82599999999999996,"5min":1.341,"15min":1.341},"last":0.76300000000000001}]},{"osd":5,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88700000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.69299999999999995},"min":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.75,"15min":0.77400000000000002},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96299999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.79400000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":317901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.76600000000000001,"15min":0.80400000000000005},"min":{"1min":0.47499999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88700000000000001,"5min":2.827,"15min":2.827},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.52900000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.878,"5min":2.052,"15min":2.052},"last":0.71399999999999997}]},{"osd":1,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51900000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91200000000000003,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.85999999999999999,"15min":0.94999999999999996},"min":{"1min":0.48999999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.872,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.88600000000000001}]},{"osd":2,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.80400000000000005,"15min":0.87},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80600000000000005,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.88700000000000001,"15min":0.96699999999999997},"min":{"1min":0.51200000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.82399999999999995}]},{"osd":3,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.86199999999999999,"15min":0.93999999999999995},"min":{"1min":0.503,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.874,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.78700000000000003,"15min":0.83499999999999996},"min":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84199999999999997,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.68899999999999995}]},{"osd":4,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.434,"5min":0.37,"15min":0.37},"max":{"1min":0.91900000000000004,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83299999999999996,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.72199999999999998,"15min":0.77000000000000002},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84199999999999997,"5min":4.274,"15min":4.274},"last":0.625},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78700000000000003,"15min":0.81399999999999995},"min":{"1min":0.53300000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89500000000000002,"5min":2.645,"15min":2.645},"last":0.90100000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.79300000000000004,"15min":0.85499999999999998},"min":{"1min":0.432,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80000000000000004,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.81399999999999995,"15min":0.87},"min":{"1min":0.55400000000000005,"5min":0.495,"15min":0.495},"max":{"1min":0.879,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.81100000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":720896,"data_stored":318495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64500000000000002,"15min":0.64000000000000001},"min":{"1min":0.47099999999999997,"5min":0.434,"15min":0.434},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.44900000000000001}]},{"osd":1,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91200000000000003,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.495,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.876,"5min":1.484,"15min":1.484},"last":0.61699999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68400000000000005,"15min":0.67400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90500000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.48599999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88100000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53700000000000003}]},{"osd":3,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.505},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92300000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.623,"15min":0.63},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.79400000000000004,"5min":1.002,"15min":1.002},"last":0.56799999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64600000000000002,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85999999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.40999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.88800000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.77400000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91900000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0620000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.751}]}]},{"osd":3,"up_from":15,"seq":64424509484,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":716800,"data_stored":317969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41999999999999998,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.623,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45300000000000001,"15min":0.46899999999999997},"min":{"1min":0.313,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55600000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.56000000000000005}]},{"osd":2,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.504},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.002,"5min":1.014,"15min":1.014},"last":0.60799999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.621},{"interface":"front","average":{"1min":0.748,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.56200000000000006,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.63300000000000001}]},{"osd":6,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78000000000000003,"15min":0.80000000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.79600000000000004,"15min":0.83599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97899999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80900000000000005,"15min":0.84299999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.82899999999999996,"15min":0.86199999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.64900000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":745472,"data_stored":334292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.28199999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70899999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61199999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.443}]},{"osd":1,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51800000000000002,"15min":0.54200000000000004},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72299999999999998,"5min":1.379,"15min":1.379},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80700000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.499}]},{"osd":3,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.495,"15min":0.503},"min":{"1min":0.33900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.78100000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.60999999999999999,"15min":0.65000000000000002},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.747,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.51000000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95399999999999996,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"min":{"1min":0.55500000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98999999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0469999999999999,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81799999999999995,"15min":0.84399999999999997},"min":{"1min":0.60299999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.115,"5min":1.448,"15min":1.448},"last":0.69799999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.59999999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.079,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.83399999999999996,"15min":0.85199999999999998},"min":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1319999999999999,"5min":1.554,"15min":1.554},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1539999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.72399999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1298432,"data_stored":902428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.48299999999999998,"15min":0.51800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63700000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.54200000000000004,"15min":0.58999999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59499999999999997,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.52200000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.52400000000000002,"15min":0.56399999999999995},"min":{"1min":0.31,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.55200000000000005,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.56699999999999995,"15min":0.60299999999999998},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66400000000000003,"5min":1.958,"15min":1.958},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.623,"15min":0.66700000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67900000000000005,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.55600000000000005,"15min":0.58199999999999996},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.59199999999999997}]},{"osd":4,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.78400000000000003,"15min":0.82899999999999996},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95999999999999996,"5min":1.601,"15min":1.601},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.80300000000000005,"15min":0.85499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.052,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.79900000000000004,"15min":0.84499999999999997},"min":{"1min":0.504,"5min":0.502,"15min":0.502},"max":{"1min":1.101,"5min":1.627,"15min":1.627},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.85199999999999998,"15min":0.91500000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.018,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81899999999999995,"15min":0.871},"min":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0369999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.81399999999999995,"15min":0.84999999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.079,"5min":1.421,"15min":1.421},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81000000000000005,"15min":0.85399999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.93999999999999995,"5min":1.452,"15min":1.452},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.83699999999999997,"15min":0.89100000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98099999999999998,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.628}]}]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":724992,"data_stored":327731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.45600000000000002,"15min":0.48599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.629,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.64600000000000002,"15min":0.73499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64100000000000001,"5min":5.556,"15min":5.556},"last":0.41299999999999998}]},{"osd":2,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.67900000000000005,"15min":0.76300000000000001},"min":{"1min":0.33700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.69199999999999995,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.59799999999999998,"15min":0.64300000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.75600000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.60599999999999998}]},{"osd":3,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.54000000000000004,"15min":0.58399999999999996},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.436},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58299999999999996,"15min":0.623},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.745,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.48399999999999999}]},{"osd":4,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.80400000000000005,"15min":0.84399999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91700000000000004,"5min":1.925,"15min":1.925},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.749,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.876,"5min":1.512,"15min":1.512},"last":0.55700000000000005}]},{"osd":5,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.79200000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90800000000000003,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.84299999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.90700000000000003,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80100000000000005,"15min":0.82899999999999996},"min":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.85899999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.81799999999999995,"15min":0.84999999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94199999999999995,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.64100000000000001}]},{"osd":7,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82399999999999995,"15min":0.85799999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.98299999999999998,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.94699999999999995,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1339392,"data_stored":920455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.502,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.99299999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.97099999999999997}]},{"osd":1,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84699999999999998,"5min":0.872,"15min":0.872},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.46600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.97599999999999998,"5min":1.012,"15min":1.012},"last":0.73599999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71999999999999997,"15min":0.72199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91400000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":1.014},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0029999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.871}]},{"osd":3,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.498,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93200000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0389999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.75900000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86699999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90100000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95699999999999996,"5min":1.018,"15min":1.018},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.78300000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94299999999999995,"5min":1.107,"15min":1.107},"last":1.0900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:07:16.215 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:07:16.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a7f600640 1 Processor -- start 2024-01-24T13:07:16.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a7f600640 1 -- start start 2024-01-24T13:07:16.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a7f600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a780b2700 0x7f1a7806b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a7f600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a780ccdb0 0x7f1a780cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a7f600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a780cd720 con 0x7f1a7815c730 2024-01-24T13:07:16.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a7f600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7806cc10 con 0x7f1a780b2700 2024-01-24T13:07:16.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a7f600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7806b7a0 con 0x7f1a780ccdb0 2024-01-24T13:07:16.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a77e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a780b2700 0x7f1a7806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a7cc00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1a7815c730 0x7f1a780ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55436/0 (socket says 172.21.15.29:55436) 2024-01-24T13:07:16.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a77e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a780b2700 0x7f1a7806b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47064/0 (socket says 172.21.15.29:47064) 2024-01-24T13:07:16.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a7cc00640 1 -- 172.21.15.29:0/3838524108 learned_addr learned my addr 172.21.15.29:0/3838524108 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:16.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a7d600640 1 --2- 172.21.15.29:0/3838524108 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a780ccdb0 0x7f1a780cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a77e00640 1 -- 172.21.15.29:0/3838524108 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a780ccdb0 msgr2=0x7f1a780cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:16.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a77e00640 1 --2- 172.21.15.29:0/3838524108 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a780ccdb0 0x7f1a780cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a77e00640 1 -- 172.21.15.29:0/3838524108 >> v1:172.21.15.29:6789/0 conn(0x7f1a7815c730 legacy=0x7f1a780ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a77e00640 1 -- 172.21.15.29:0/3838524108 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7806ba80 con 0x7f1a780b2700 2024-01-24T13:07:16.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.353+0000 7f1a77400640 1 -- 172.21.15.29:0/3838524108 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206630160 0 0) 0x7f1a780cd720 con 0x7f1a7815c730 2024-01-24T13:07:16.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.357+0000 7f1a77e00640 1 --2- 172.21.15.29:0/3838524108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a780b2700 0x7f1a7806b110 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1a600097c0 tx=0x7f1a6001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4ffbb630f09ac8 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:16.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.357+0000 7f1a77400640 1 -- 172.21.15.29:0/3838524108 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a600ab600 con 0x7f1a780b2700 2024-01-24T13:07:16.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.357+0000 7f1a77400640 1 -- 172.21.15.29:0/3838524108 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a600a7050 con 0x7f1a780b2700 2024-01-24T13:07:16.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.357+0000 7f1a77400640 1 -- 172.21.15.29:0/3838524108 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a600ab980 con 0x7f1a780b2700 2024-01-24T13:07:16.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.357+0000 7f1a7f600640 1 -- 172.21.15.29:0/3838524108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a780b2700 msgr2=0x7f1a7806b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.357+0000 7f1a7f600640 1 --2- 172.21.15.29:0/3838524108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a780b2700 0x7f1a7806b110 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1a600097c0 tx=0x7f1a6001c480 comp rx=0 tx=0).stop 2024-01-24T13:07:16.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.357+0000 7f1a7f600640 1 -- 172.21.15.29:0/3838524108 shutdown_connections 2024-01-24T13:07:16.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.357+0000 7f1a7f600640 1 --2- 172.21.15.29:0/3838524108 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a780ccdb0 0x7f1a780cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.357+0000 7f1a7f600640 1 --2- 172.21.15.29:0/3838524108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a780b2700 0x7f1a7806b110 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.357+0000 7f1a7f600640 1 -- 172.21.15.29:0/3838524108 >> 172.21.15.29:0/3838524108 conn(0x7f1a78070570 msgr2=0x7f1a78069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:16.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.357+0000 7f1a7f600640 1 -- 172.21.15.29:0/3838524108 shutdown_connections 2024-01-24T13:07:16.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.357+0000 7f1a7f600640 1 -- 172.21.15.29:0/3838524108 wait complete. 2024-01-24T13:07:16.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7f600640 1 Processor -- start 2024-01-24T13:07:16.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7f600640 1 -- start start 2024-01-24T13:07:16.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7f600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a780b2700 0x7f1a780b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7f600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a780ccdb0 0x7f1a78156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7f600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a7815c730 0x7f1a780c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7f600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780c9d70 con 0x7f1a7815c730 2024-01-24T13:07:16.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7f600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780ca050 con 0x7f1a780b2700 2024-01-24T13:07:16.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7f600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780ca330 con 0x7f1a780ccdb0 2024-01-24T13:07:16.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7d600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a7815c730 0x7f1a780c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7d600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a7815c730 0x7f1a780c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47072/0 (socket says 172.21.15.29:47072) 2024-01-24T13:07:16.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7d600640 1 -- 172.21.15.29:0/1067370654 learned_addr learned my addr 172.21.15.29:0/1067370654 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:16.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a77e00640 1 --2- 172.21.15.29:0/1067370654 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a780ccdb0 0x7f1a78156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7cc00640 1 --2- 172.21.15.29:0/1067370654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a780b2700 0x7f1a780b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7d600640 1 -- 172.21.15.29:0/1067370654 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a780ccdb0 msgr2=0x7f1a78156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7d600640 1 --2- 172.21.15.29:0/1067370654 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a780ccdb0 0x7f1a78156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7d600640 1 -- 172.21.15.29:0/1067370654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a780b2700 msgr2=0x7f1a780b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7d600640 1 --2- 172.21.15.29:0/1067370654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a780b2700 0x7f1a780b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7d600640 1 -- 172.21.15.29:0/1067370654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60009420 con 0x7f1a7815c730 2024-01-24T13:07:16.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7d600640 1 --2- 172.21.15.29:0/1067370654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a7815c730 0x7f1a780c9520 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000efc0 tx=0x7f1a7000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:16.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a74c00640 1 -- 172.21.15.29:0/1067370654 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70014480 con 0x7f1a7815c730 2024-01-24T13:07:16.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a74c00640 1 -- 172.21.15.29:0/1067370654 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7000f040 con 0x7f1a7815c730 2024-01-24T13:07:16.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a74c00640 1 -- 172.21.15.29:0/1067370654 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70014820 con 0x7f1a7815c730 2024-01-24T13:07:16.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7f600640 1 -- 172.21.15.29:0/1067370654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a780ca610 con 0x7f1a7815c730 2024-01-24T13:07:16.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.361+0000 7f1a7f600640 1 -- 172.21.15.29:0/1067370654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a780c9a60 con 0x7f1a7815c730 2024-01-24T13:07:16.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.365+0000 7f1a7f600640 1 -- 172.21.15.29:0/1067370654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a780cf430 con 0x7f1a7815c730 2024-01-24T13:07:16.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.365+0000 7f1a74c00640 1 -- 172.21.15.29:0/1067370654 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1a70014980 con 0x7f1a7815c730 2024-01-24T13:07:16.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.365+0000 7f1a74c00640 1 --2- 172.21.15.29:0/1067370654 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1a50065a60 0x7f1a50067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.365+0000 7f1a74c00640 1 -- 172.21.15.29:0/1067370654 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1a70083a90 con 0x7f1a7815c730 2024-01-24T13:07:16.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.365+0000 7f1a7cc00640 1 --2- 172.21.15.29:0/1067370654 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1a50065a60 0x7f1a50067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.365+0000 7f1a7cc00640 1 --2- 172.21.15.29:0/1067370654 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1a50065a60 0x7f1a50067f20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1a68000f70 tx=0x7f1a68009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:16.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.369+0000 7f1a74c00640 1 -- 172.21.15.29:0/1067370654 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1a700516b0 con 0x7f1a7815c730 2024-01-24T13:07:16.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.525+0000 7f1a7f600640 1 -- 172.21.15.29:0/1067370654 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a7815cb10 con 0x7f1a50065a60 2024-01-24T13:07:16.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.529+0000 7f1a74c00640 1 -- 172.21.15.29:0/1067370654 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50654 (secure 0 0 0) 0x7f1a680014b0 con 0x7f1a50065a60 2024-01-24T13:07:16.534 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:16.535 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:07:16.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.529+0000 7f1a7f600640 1 -- 172.21.15.29:0/1067370654 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1a50065a60 msgr2=0x7f1a50067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.529+0000 7f1a7f600640 1 --2- 172.21.15.29:0/1067370654 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1a50065a60 0x7f1a50067f20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1a68000f70 tx=0x7f1a68009040 comp rx=0 tx=0).stop 2024-01-24T13:07:16.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.529+0000 7f1a7f600640 1 -- 172.21.15.29:0/1067370654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a7815c730 msgr2=0x7f1a780c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.529+0000 7f1a7f600640 1 --2- 172.21.15.29:0/1067370654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a7815c730 0x7f1a780c9520 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000efc0 tx=0x7f1a7000c490 comp rx=0 tx=0).stop 2024-01-24T13:07:16.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.533+0000 7f1a7f600640 1 -- 172.21.15.29:0/1067370654 shutdown_connections 2024-01-24T13:07:16.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.533+0000 7f1a7f600640 1 --2- 172.21.15.29:0/1067370654 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f1a50065a60 0x7f1a50067f20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.533+0000 7f1a7f600640 1 --2- 172.21.15.29:0/1067370654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a7815c730 0x7f1a780c9520 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.533+0000 7f1a7f600640 1 --2- 172.21.15.29:0/1067370654 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a780ccdb0 0x7f1a78156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.533+0000 7f1a7f600640 1 --2- 172.21.15.29:0/1067370654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a780b2700 0x7f1a780b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.533+0000 7f1a7f600640 1 -- 172.21.15.29:0/1067370654 >> 172.21.15.29:0/1067370654 conn(0x7f1a78070570 msgr2=0x7f1a780b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:16.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.533+0000 7f1a7f600640 1 -- 172.21.15.29:0/1067370654 shutdown_connections 2024-01-24T13:07:16.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.533+0000 7f1a7f600640 1 -- 172.21.15.29:0/1067370654 wait complete. 2024-01-24T13:07:16.556 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-01-24T13:07:15.586595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239368,"kb_used_data":6820,"kb_used_omap":13,"kb_used_meta":232434,"kb_avail":754735352,"statfs":{"total":773094113280,"available":772849000448,"internally_reserved":0,"allocated":6983680,"data_stored":3757242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":238012504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14888,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-65,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001449"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":196,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559292+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:06:34.559292+0000","last_peered":"2024-01-24T13:06:34.559292+0000","last_clean":"2024-01-24T13:06:34.559292+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:06:34.559292+0000","last_undegraded":"2024-01-24T13:06:34.559292+0000","last_fullsized":"2024-01-24T13:06:34.559292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":720896,"data_stored":317971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70499999999999996,"15min":0.72299999999999998},"min":{"1min":0.50800000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99099999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.44900000000000001}]},{"osd":1,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.53400000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.71899999999999997},"min":{"1min":0.53700000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94599999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.54000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88500000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73599999999999999,"15min":0.747},"min":{"1min":0.57699999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93100000000000005,"5min":1.131,"15min":1.131},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.502,"15min":0.502},"max":{"1min":0.95899999999999996,"5min":1.05,"15min":1.05},"last":0.66200000000000003}]},{"osd":4,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80400000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.746},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67400000000000004,"15min":0.70299999999999996},"min":{"1min":0.41499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.82599999999999996,"5min":1.341,"15min":1.341},"last":0.76300000000000001}]},{"osd":5,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88700000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.69299999999999995},"min":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.75,"15min":0.77400000000000002},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96299999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.79400000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":317901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.76600000000000001,"15min":0.80400000000000005},"min":{"1min":0.47499999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88700000000000001,"5min":2.827,"15min":2.827},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.52900000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.878,"5min":2.052,"15min":2.052},"last":0.71399999999999997}]},{"osd":1,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51900000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91200000000000003,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.85999999999999999,"15min":0.94999999999999996},"min":{"1min":0.48999999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.872,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.88600000000000001}]},{"osd":2,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.80400000000000005,"15min":0.87},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80600000000000005,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.88700000000000001,"15min":0.96699999999999997},"min":{"1min":0.51200000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.82399999999999995}]},{"osd":3,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.86199999999999999,"15min":0.93999999999999995},"min":{"1min":0.503,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.874,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.78700000000000003,"15min":0.83499999999999996},"min":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84199999999999997,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.68899999999999995}]},{"osd":4,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.434,"5min":0.37,"15min":0.37},"max":{"1min":0.91900000000000004,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83299999999999996,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.72199999999999998,"15min":0.77000000000000002},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84199999999999997,"5min":4.274,"15min":4.274},"last":0.625},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78700000000000003,"15min":0.81399999999999995},"min":{"1min":0.53300000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89500000000000002,"5min":2.645,"15min":2.645},"last":0.90100000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.79300000000000004,"15min":0.85499999999999998},"min":{"1min":0.432,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80000000000000004,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.81399999999999995,"15min":0.87},"min":{"1min":0.55400000000000005,"5min":0.495,"15min":0.495},"max":{"1min":0.879,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.81100000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":720896,"data_stored":318495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64500000000000002,"15min":0.64000000000000001},"min":{"1min":0.47099999999999997,"5min":0.434,"15min":0.434},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.44900000000000001}]},{"osd":1,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91200000000000003,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.495,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.876,"5min":1.484,"15min":1.484},"last":0.61699999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68400000000000005,"15min":0.67400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90500000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.48599999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88100000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53700000000000003}]},{"osd":3,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.505},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92300000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.623,"15min":0.63},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.79400000000000004,"5min":1.002,"15min":1.002},"last":0.56799999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64600000000000002,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85999999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.40999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.88800000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.77400000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91900000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0620000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.751}]}]},{"osd":3,"up_from":15,"seq":64424509484,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":716800,"data_stored":317969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41999999999999998,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.623,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45300000000000001,"15min":0.46899999999999997},"min":{"1min":0.313,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55600000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.56000000000000005}]},{"osd":2,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.504},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.002,"5min":1.014,"15min":1.014},"last":0.60799999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.621},{"interface":"front","average":{"1min":0.748,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.56200000000000006,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.63300000000000001}]},{"osd":6,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78000000000000003,"15min":0.80000000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.79600000000000004,"15min":0.83599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97899999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80900000000000005,"15min":0.84299999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.82899999999999996,"15min":0.86199999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.64900000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":745472,"data_stored":334292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.28199999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70899999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61199999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.443}]},{"osd":1,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51800000000000002,"15min":0.54200000000000004},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72299999999999998,"5min":1.379,"15min":1.379},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80700000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.499}]},{"osd":3,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.495,"15min":0.503},"min":{"1min":0.33900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.78100000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.60999999999999999,"15min":0.65000000000000002},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.747,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.51000000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95399999999999996,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"min":{"1min":0.55500000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98999999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0469999999999999,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81799999999999995,"15min":0.84399999999999997},"min":{"1min":0.60299999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.115,"5min":1.448,"15min":1.448},"last":0.69799999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.59999999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.079,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.83399999999999996,"15min":0.85199999999999998},"min":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1319999999999999,"5min":1.554,"15min":1.554},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1539999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.72399999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1298432,"data_stored":902428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.48299999999999998,"15min":0.51800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63700000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.54200000000000004,"15min":0.58999999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59499999999999997,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.52200000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.52400000000000002,"15min":0.56399999999999995},"min":{"1min":0.31,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.55200000000000005,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.56699999999999995,"15min":0.60299999999999998},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66400000000000003,"5min":1.958,"15min":1.958},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.623,"15min":0.66700000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67900000000000005,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.55600000000000005,"15min":0.58199999999999996},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.59199999999999997}]},{"osd":4,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.78400000000000003,"15min":0.82899999999999996},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95999999999999996,"5min":1.601,"15min":1.601},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.80300000000000005,"15min":0.85499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.052,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.79900000000000004,"15min":0.84499999999999997},"min":{"1min":0.504,"5min":0.502,"15min":0.502},"max":{"1min":1.101,"5min":1.627,"15min":1.627},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.85199999999999998,"15min":0.91500000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.018,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81899999999999995,"15min":0.871},"min":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0369999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.81399999999999995,"15min":0.84999999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.079,"5min":1.421,"15min":1.421},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81000000000000005,"15min":0.85399999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.93999999999999995,"5min":1.452,"15min":1.452},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.83699999999999997,"15min":0.89100000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98099999999999998,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.628}]}]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":724992,"data_stored":327731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.45600000000000002,"15min":0.48599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.629,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.64600000000000002,"15min":0.73499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64100000000000001,"5min":5.556,"15min":5.556},"last":0.41299999999999998}]},{"osd":2,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.67900000000000005,"15min":0.76300000000000001},"min":{"1min":0.33700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.69199999999999995,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.59799999999999998,"15min":0.64300000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.75600000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.60599999999999998}]},{"osd":3,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.54000000000000004,"15min":0.58399999999999996},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.436},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58299999999999996,"15min":0.623},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.745,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.48399999999999999}]},{"osd":4,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.80400000000000005,"15min":0.84399999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91700000000000004,"5min":1.925,"15min":1.925},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.749,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.876,"5min":1.512,"15min":1.512},"last":0.55700000000000005}]},{"osd":5,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.79200000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90800000000000003,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.84299999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.90700000000000003,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80100000000000005,"15min":0.82899999999999996},"min":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.85899999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.81799999999999995,"15min":0.84999999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94199999999999995,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.64100000000000001}]},{"osd":7,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82399999999999995,"15min":0.85799999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.98299999999999998,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.94699999999999995,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1339392,"data_stored":920455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.502,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.99299999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.97099999999999997}]},{"osd":1,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84699999999999998,"5min":0.872,"15min":0.872},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.46600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.97599999999999998,"5min":1.012,"15min":1.012},"last":0.73599999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71999999999999997,"15min":0.72199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91400000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":1.014},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0029999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.871}]},{"osd":3,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.498,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93200000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0389999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.75900000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86699999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90100000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95699999999999996,"5min":1.018,"15min":1.018},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.78300000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94299999999999995,"5min":1.107,"15min":1.107},"last":1.0900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:07:16.557 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-24T13:07:16.558 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:07:16.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.693+0000 7fd68d800640 1 Processor -- start 2024-01-24T13:07:16.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.693+0000 7fd68d800640 1 -- start start 2024-01-24T13:07:16.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd68d800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd6881612c0 0x7fd68806c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd68d800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6880ae150 0x7fd68806cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd68d800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd6880cd600 0x7fd6880c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd68d800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6880caed0 con 0x7fd6881612c0 2024-01-24T13:07:16.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd68d800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6880caca0 con 0x7fd6880cd600 2024-01-24T13:07:16.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd68d800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880cb170 con 0x7fd6880ae150 2024-01-24T13:07:16.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd686a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd6881612c0 0x7fd68806c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd686a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd6881612c0 0x7fd68806c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47074/0 (socket says 172.21.15.29:47074) 2024-01-24T13:07:16.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd686a00640 1 -- 172.21.15.29:0/1849805748 learned_addr learned my addr 172.21.15.29:0/1849805748 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:16.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd686000640 1 --2- 172.21.15.29:0/1849805748 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6880ae150 0x7fd68806cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd687400640 1 --2- 172.21.15.29:0/1849805748 >> v2:172.21.15.163:3300/0 conn(0x7fd6880cd600 0x7fd6880c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd686a00640 1 -- 172.21.15.29:0/1849805748 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6880ae150 msgr2=0x7fd68806cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:16.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd686a00640 1 --2- 172.21.15.29:0/1849805748 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6880ae150 0x7fd68806cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd686a00640 1 -- 172.21.15.29:0/1849805748 >> v2:172.21.15.163:3300/0 conn(0x7fd6880cd600 msgr2=0x7fd6880c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:16.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd686a00640 1 --2- 172.21.15.29:0/1849805748 >> v2:172.21.15.163:3300/0 conn(0x7fd6880cd600 0x7fd6880c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd686a00640 1 -- 172.21.15.29:0/1849805748 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68806dab0 con 0x7fd6881612c0 2024-01-24T13:07:16.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.697+0000 7fd686000640 1 --2- 172.21.15.29:0/1849805748 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6880ae150 0x7fd68806cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:16.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd686a00640 1 --2- 172.21.15.29:0/1849805748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6881612c0 0x7fd68806c8b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd6880ae6d0 tx=0x7fd67801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910fcdf384f7833a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:16.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd685600640 1 -- 172.21.15.29:0/1849805748 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780ab600 con 0x7fd6881612c0 2024-01-24T13:07:16.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd685600640 1 -- 172.21.15.29:0/1849805748 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6780ab760 con 0x7fd6881612c0 2024-01-24T13:07:16.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd685600640 1 -- 172.21.15.29:0/1849805748 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780abaf0 con 0x7fd6881612c0 2024-01-24T13:07:16.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd68d800640 1 -- 172.21.15.29:0/1849805748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6881612c0 msgr2=0x7fd68806c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd68d800640 1 --2- 172.21.15.29:0/1849805748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6881612c0 0x7fd68806c8b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd6880ae6d0 tx=0x7fd67801c440 comp rx=0 tx=0).stop 2024-01-24T13:07:16.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd68d800640 1 -- 172.21.15.29:0/1849805748 shutdown_connections 2024-01-24T13:07:16.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd68d800640 1 --2- 172.21.15.29:0/1849805748 >> v2:172.21.15.163:3300/0 conn(0x7fd6880cd600 0x7fd6880c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd68d800640 1 --2- 172.21.15.29:0/1849805748 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6880ae150 0x7fd68806cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd68d800640 1 --2- 172.21.15.29:0/1849805748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6881612c0 0x7fd68806c8b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd68d800640 1 -- 172.21.15.29:0/1849805748 >> 172.21.15.29:0/1849805748 conn(0x7fd6880cb700 msgr2=0x7fd6880cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:16.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd68d800640 1 -- 172.21.15.29:0/1849805748 shutdown_connections 2024-01-24T13:07:16.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd68d800640 1 -- 172.21.15.29:0/1849805748 wait complete. 2024-01-24T13:07:16.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd68d800640 1 Processor -- start 2024-01-24T13:07:16.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.701+0000 7fd68d800640 1 -- start start 2024-01-24T13:07:16.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd68d800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6880ae150 0x7fd688152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd68d800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6880cd600 0x7fd688156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd68d800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd6881612c0 0x7fd68815df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd68d800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd688152c60 con 0x7fd6880cd600 2024-01-24T13:07:16.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd68d800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68815fdd0 con 0x7fd6881612c0 2024-01-24T13:07:16.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd68d800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6881600b0 con 0x7fd6880ae150 2024-01-24T13:07:16.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd686000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6880cd600 0x7fd688156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd686000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6880cd600 0x7fd688156540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47086/0 (socket says 172.21.15.29:47086) 2024-01-24T13:07:16.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd686000640 1 -- 172.21.15.29:0/1101250139 learned_addr learned my addr 172.21.15.29:0/1101250139 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:16.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd687400640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd6881612c0 0x7fd68815df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd686a00640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6880ae150 0x7fd688152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd686000640 1 -- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6880ae150 msgr2=0x7fd688152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd686000640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6880ae150 0x7fd688152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd686000640 1 -- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd6881612c0 msgr2=0x7fd68815df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd686000640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd6881612c0 0x7fd68815df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd686000640 1 -- 172.21.15.29:0/1101250139 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6780094d0 con 0x7fd6880cd600 2024-01-24T13:07:16.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd687400640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd6881612c0 0x7fd68815df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:16.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd686000640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6880cd600 0x7fd688156540 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd67000e810 tx=0x7fd67000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:16.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd67ea00640 1 -- 172.21.15.29:0/1101250139 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670004030 con 0x7fd6880cd600 2024-01-24T13:07:16.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd67ea00640 1 -- 172.21.15.29:0/1101250139 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd670004190 con 0x7fd6880cd600 2024-01-24T13:07:16.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd67ea00640 1 -- 172.21.15.29:0/1101250139 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670004520 con 0x7fd6880cd600 2024-01-24T13:07:16.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd68d800640 1 -- 172.21.15.29:0/1101250139 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd688155a60 con 0x7fd6880cd600 2024-01-24T13:07:16.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd68d800640 1 -- 172.21.15.29:0/1101250139 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd688156020 con 0x7fd6880cd600 2024-01-24T13:07:16.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd68d800640 1 -- 172.21.15.29:0/1101250139 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6880b16d0 con 0x7fd6880cd600 2024-01-24T13:07:16.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.705+0000 7fd67ea00640 1 -- 172.21.15.29:0/1101250139 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd67000c6d0 con 0x7fd6880cd600 2024-01-24T13:07:16.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.709+0000 7fd67ea00640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd660065a60 0x7fd660067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:16.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.709+0000 7fd67ea00640 1 -- 172.21.15.29:0/1101250139 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd670082c00 con 0x7fd6880cd600 2024-01-24T13:07:16.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.709+0000 7fd686a00640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd660065a60 0x7fd660067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:16.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.709+0000 7fd686a00640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd660065a60 0x7fd660067f20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd6780af000 tx=0x7fd6780a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:16.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.713+0000 7fd67ea00640 1 -- 172.21.15.29:0/1101250139 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd6700506e0 con 0x7fd6880cd600 2024-01-24T13:07:16.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.865+0000 7fd68d800640 1 -- 172.21.15.29:0/1101250139 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd6880add70 con 0x7fd660065a60 2024-01-24T13:07:16.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.873+0000 7fd67ea00640 1 -- 172.21.15.29:0/1101250139 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50654 (secure 0 0 0) 0x7fd6780ab5c0 con 0x7fd660065a60 2024-01-24T13:07:16.875 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:16.875 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:07:16.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.873+0000 7fd68d800640 1 -- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd660065a60 msgr2=0x7fd660067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.873+0000 7fd68d800640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd660065a60 0x7fd660067f20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd6780af000 tx=0x7fd6780a7000 comp rx=0 tx=0).stop 2024-01-24T13:07:16.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.873+0000 7fd68d800640 1 -- 172.21.15.29:0/1101250139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6880cd600 msgr2=0x7fd688156540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:16.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.873+0000 7fd68d800640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6880cd600 0x7fd688156540 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd67000e810 tx=0x7fd67000ecd0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.873+0000 7fd68d800640 1 -- 172.21.15.29:0/1101250139 shutdown_connections 2024-01-24T13:07:16.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.873+0000 7fd68d800640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd660065a60 0x7fd660067f20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.873+0000 7fd68d800640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd6881612c0 0x7fd68815df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.873+0000 7fd68d800640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6880cd600 0x7fd688156540 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.873+0000 7fd68d800640 1 --2- 172.21.15.29:0/1101250139 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd6880ae150 0x7fd688152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:16.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.873+0000 7fd68d800640 1 -- 172.21.15.29:0/1101250139 >> 172.21.15.29:0/1101250139 conn(0x7fd6880cb700 msgr2=0x7fd6880aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:16.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.873+0000 7fd68d800640 1 -- 172.21.15.29:0/1101250139 shutdown_connections 2024-01-24T13:07:16.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:16.873+0000 7fd68d800640 1 -- 172.21.15.29:0/1101250139 wait complete. 2024-01-24T13:07:16.895 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-01-24T13:07:15.586595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239368,"kb_used_data":6820,"kb_used_omap":13,"kb_used_meta":232434,"kb_avail":754735352,"statfs":{"total":773094113280,"available":772849000448,"internally_reserved":0,"allocated":6983680,"data_stored":3757242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":238012504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14888,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-65,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001449"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":196,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-01-24T13:06:34.559292+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:06:34.559292+0000","last_peered":"2024-01-24T13:06:34.559292+0000","last_clean":"2024-01-24T13:06:34.559292+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:06:34.559292+0000","last_undegraded":"2024-01-24T13:06:34.559292+0000","last_fullsized":"2024-01-24T13:06:34.559292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":720896,"data_stored":317971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70499999999999996,"15min":0.72299999999999998},"min":{"1min":0.50800000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99099999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.44900000000000001}]},{"osd":1,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.53400000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.71899999999999997},"min":{"1min":0.53700000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94599999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.54000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88500000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73599999999999999,"15min":0.747},"min":{"1min":0.57699999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93100000000000005,"5min":1.131,"15min":1.131},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.502,"15min":0.502},"max":{"1min":0.95899999999999996,"5min":1.05,"15min":1.05},"last":0.66200000000000003}]},{"osd":4,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80400000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.746},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67400000000000004,"15min":0.70299999999999996},"min":{"1min":0.41499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.82599999999999996,"5min":1.341,"15min":1.341},"last":0.76300000000000001}]},{"osd":5,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88700000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.69299999999999995},"min":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.75,"15min":0.77400000000000002},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96299999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.79400000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":317901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.76600000000000001,"15min":0.80400000000000005},"min":{"1min":0.47499999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88700000000000001,"5min":2.827,"15min":2.827},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.52900000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.878,"5min":2.052,"15min":2.052},"last":0.71399999999999997}]},{"osd":1,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51900000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91200000000000003,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.85999999999999999,"15min":0.94999999999999996},"min":{"1min":0.48999999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.872,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.88600000000000001}]},{"osd":2,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.80400000000000005,"15min":0.87},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80600000000000005,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.88700000000000001,"15min":0.96699999999999997},"min":{"1min":0.51200000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.82399999999999995}]},{"osd":3,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.86199999999999999,"15min":0.93999999999999995},"min":{"1min":0.503,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.874,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.78700000000000003,"15min":0.83499999999999996},"min":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84199999999999997,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.68899999999999995}]},{"osd":4,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.434,"5min":0.37,"15min":0.37},"max":{"1min":0.91900000000000004,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83299999999999996,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.72199999999999998,"15min":0.77000000000000002},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84199999999999997,"5min":4.274,"15min":4.274},"last":0.625},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78700000000000003,"15min":0.81399999999999995},"min":{"1min":0.53300000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89500000000000002,"5min":2.645,"15min":2.645},"last":0.90100000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.79300000000000004,"15min":0.85499999999999998},"min":{"1min":0.432,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80000000000000004,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.81399999999999995,"15min":0.87},"min":{"1min":0.55400000000000005,"5min":0.495,"15min":0.495},"max":{"1min":0.879,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.81100000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":720896,"data_stored":318495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64500000000000002,"15min":0.64000000000000001},"min":{"1min":0.47099999999999997,"5min":0.434,"15min":0.434},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.44900000000000001}]},{"osd":1,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91200000000000003,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.495,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.876,"5min":1.484,"15min":1.484},"last":0.61699999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68400000000000005,"15min":0.67400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90500000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.48599999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88100000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53700000000000003}]},{"osd":3,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.505},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92300000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.623,"15min":0.63},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.79400000000000004,"5min":1.002,"15min":1.002},"last":0.56799999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64600000000000002,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85999999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.40999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.88800000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.77400000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91900000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0620000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.751}]}]},{"osd":3,"up_from":15,"seq":64424509484,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":716800,"data_stored":317969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41999999999999998,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.623,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45300000000000001,"15min":0.46899999999999997},"min":{"1min":0.313,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55600000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.56000000000000005}]},{"osd":2,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.504},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.002,"5min":1.014,"15min":1.014},"last":0.60799999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.621},{"interface":"front","average":{"1min":0.748,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.56200000000000006,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.63300000000000001}]},{"osd":6,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78000000000000003,"15min":0.80000000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.79600000000000004,"15min":0.83599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97899999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80900000000000005,"15min":0.84299999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.82899999999999996,"15min":0.86199999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.64900000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":745472,"data_stored":334292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.28199999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70899999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61199999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.443}]},{"osd":1,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51800000000000002,"15min":0.54200000000000004},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72299999999999998,"5min":1.379,"15min":1.379},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80700000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.499}]},{"osd":3,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.495,"15min":0.503},"min":{"1min":0.33900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.78100000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.60999999999999999,"15min":0.65000000000000002},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.747,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.51000000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95399999999999996,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"min":{"1min":0.55500000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98999999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0469999999999999,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81799999999999995,"15min":0.84399999999999997},"min":{"1min":0.60299999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.115,"5min":1.448,"15min":1.448},"last":0.69799999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.59999999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.079,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.83399999999999996,"15min":0.85199999999999998},"min":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1319999999999999,"5min":1.554,"15min":1.554},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1539999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.72399999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1298432,"data_stored":902428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.48299999999999998,"15min":0.51800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63700000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.54200000000000004,"15min":0.58999999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59499999999999997,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.52200000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.52400000000000002,"15min":0.56399999999999995},"min":{"1min":0.31,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.55200000000000005,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.56699999999999995,"15min":0.60299999999999998},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66400000000000003,"5min":1.958,"15min":1.958},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.623,"15min":0.66700000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67900000000000005,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.55600000000000005,"15min":0.58199999999999996},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.59199999999999997}]},{"osd":4,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.78400000000000003,"15min":0.82899999999999996},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95999999999999996,"5min":1.601,"15min":1.601},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.80300000000000005,"15min":0.85499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.052,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.79900000000000004,"15min":0.84499999999999997},"min":{"1min":0.504,"5min":0.502,"15min":0.502},"max":{"1min":1.101,"5min":1.627,"15min":1.627},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.85199999999999998,"15min":0.91500000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.018,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81899999999999995,"15min":0.871},"min":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0369999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.81399999999999995,"15min":0.84999999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.079,"5min":1.421,"15min":1.421},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81000000000000005,"15min":0.85399999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.93999999999999995,"5min":1.452,"15min":1.452},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.83699999999999997,"15min":0.89100000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98099999999999998,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.628}]}]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":724992,"data_stored":327731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.45600000000000002,"15min":0.48599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.629,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.64600000000000002,"15min":0.73499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64100000000000001,"5min":5.556,"15min":5.556},"last":0.41299999999999998}]},{"osd":2,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.67900000000000005,"15min":0.76300000000000001},"min":{"1min":0.33700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.69199999999999995,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.59799999999999998,"15min":0.64300000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.75600000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.60599999999999998}]},{"osd":3,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.54000000000000004,"15min":0.58399999999999996},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.436},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58299999999999996,"15min":0.623},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.745,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.48399999999999999}]},{"osd":4,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.80400000000000005,"15min":0.84399999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91700000000000004,"5min":1.925,"15min":1.925},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.749,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.876,"5min":1.512,"15min":1.512},"last":0.55700000000000005}]},{"osd":5,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.79200000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90800000000000003,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.84299999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.90700000000000003,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80100000000000005,"15min":0.82899999999999996},"min":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.85899999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.81799999999999995,"15min":0.84999999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94199999999999995,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.64100000000000001}]},{"osd":7,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82399999999999995,"15min":0.85799999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.98299999999999998,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.94699999999999995,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1339392,"data_stored":920455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.502,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.99299999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.97099999999999997}]},{"osd":1,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84699999999999998,"5min":0.872,"15min":0.872},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.46600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.97599999999999998,"5min":1.012,"15min":1.012},"last":0.73599999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71999999999999997,"15min":0.72199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91400000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":1.014},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0029999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.871}]},{"osd":3,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.498,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93200000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0389999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.75900000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86699999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90100000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95699999999999996,"5min":1.018,"15min":1.018},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.78300000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94299999999999995,"5min":1.107,"15min":1.107},"last":1.0900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:07:16.897 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T13:07:17.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a3a800640 1 Processor -- start 2024-01-24T13:07:17.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a3a800640 1 -- start start 2024-01-24T13:07:17.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a3a800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7a3406f4f0 0x7f7a3406df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:17.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a3a800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7a3406ca90 0x7f7a3406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:17.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a3a800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3406f990 con 0x7f7a3415c6d0 2024-01-24T13:07:17.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a3a800640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3406fc50 con 0x7f7a3406f4f0 2024-01-24T13:07:17.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a3a800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3406ff30 con 0x7f7a3406ca90 2024-01-24T13:07:17.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a32a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7a3406f4f0 0x7f7a3406df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a33400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7a3415c6d0 0x7f7a340ca970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55448/0 (socket says 172.21.15.29:55448) 2024-01-24T13:07:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a32a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7a3406f4f0 0x7f7a3406df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47090/0 (socket says 172.21.15.29:47090) 2024-01-24T13:07:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a33400640 1 -- 172.21.15.29:0/2637048221 learned_addr learned my addr 172.21.15.29:0/2637048221 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a33e00640 1 --2- 172.21.15.29:0/2637048221 >> v2:172.21.15.163:3300/0 conn(0x7f7a3406ca90 0x7f7a3406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a32a00640 1 -- 172.21.15.29:0/2637048221 >> v2:172.21.15.163:3300/0 conn(0x7f7a3406ca90 msgr2=0x7f7a3406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a32a00640 1 --2- 172.21.15.29:0/2637048221 >> v2:172.21.15.163:3300/0 conn(0x7f7a3406ca90 0x7f7a3406e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a32a00640 1 -- 172.21.15.29:0/2637048221 >> v1:172.21.15.29:6789/0 conn(0x7f7a3415c6d0 legacy=0x7f7a340ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a32a00640 1 -- 172.21.15.29:0/2637048221 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34070210 con 0x7f7a3406f4f0 2024-01-24T13:07:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.033+0000 7f7a32000640 1 -- 172.21.15.29:0/2637048221 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151351188 0 0) 0x7f7a3406f990 con 0x7f7a3415c6d0 2024-01-24T13:07:17.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.037+0000 7f7a32a00640 1 --2- 172.21.15.29:0/2637048221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a3406f4f0 0x7f7a3406df90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f7a340733f0 tx=0x7f7a1c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d15471d8ba1b87 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:17.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.037+0000 7f7a32000640 1 -- 172.21.15.29:0/2637048221 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0ab5f0 con 0x7f7a3406f4f0 2024-01-24T13:07:17.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.037+0000 7f7a32000640 1 -- 172.21.15.29:0/2637048221 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c0ab750 con 0x7f7a3406f4f0 2024-01-24T13:07:17.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.037+0000 7f7a32000640 1 -- 172.21.15.29:0/2637048221 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0abae0 con 0x7f7a3406f4f0 2024-01-24T13:07:17.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.037+0000 7f7a3a800640 1 -- 172.21.15.29:0/2637048221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a3406f4f0 msgr2=0x7f7a3406df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:17.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.037+0000 7f7a3a800640 1 --2- 172.21.15.29:0/2637048221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a3406f4f0 0x7f7a3406df90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f7a340733f0 tx=0x7f7a1c01c3d0 comp rx=0 tx=0).stop 2024-01-24T13:07:17.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.037+0000 7f7a3a800640 1 -- 172.21.15.29:0/2637048221 shutdown_connections 2024-01-24T13:07:17.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.037+0000 7f7a3a800640 1 --2- 172.21.15.29:0/2637048221 >> v2:172.21.15.163:3300/0 conn(0x7f7a3406ca90 0x7f7a3406e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:17.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.037+0000 7f7a3a800640 1 --2- 172.21.15.29:0/2637048221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a3406f4f0 0x7f7a3406df90 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:17.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.037+0000 7f7a3a800640 1 -- 172.21.15.29:0/2637048221 >> 172.21.15.29:0/2637048221 conn(0x7f7a340d0320 msgr2=0x7f7a340d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:17.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.037+0000 7f7a3a800640 1 -- 172.21.15.29:0/2637048221 shutdown_connections 2024-01-24T13:07:17.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.037+0000 7f7a3a800640 1 -- 172.21.15.29:0/2637048221 wait complete. 2024-01-24T13:07:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a3a800640 1 Processor -- start 2024-01-24T13:07:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a3a800640 1 -- start start 2024-01-24T13:07:17.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a3a800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a3406ca90 0x7f7a340af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:17.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a3a800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a3406f4f0 0x7f7a3414f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:17.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a3a800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a3415c6d0 0x7f7a340c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:17.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a3a800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3414fbb0 con 0x7f7a3406ca90 2024-01-24T13:07:17.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a3a800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3414fe50 con 0x7f7a3415c6d0 2024-01-24T13:07:17.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a3a800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340c52e0 con 0x7f7a3406f4f0 2024-01-24T13:07:17.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a33400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a3406ca90 0x7f7a340af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:17.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a33400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a3406ca90 0x7f7a340af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47096/0 (socket says 172.21.15.29:47096) 2024-01-24T13:07:17.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a33400640 1 -- 172.21.15.29:0/871294731 learned_addr learned my addr 172.21.15.29:0/871294731 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:17.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a33e00640 1 --2- 172.21.15.29:0/871294731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a3415c6d0 0x7f7a340c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:17.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a32a00640 1 --2- 172.21.15.29:0/871294731 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a3406f4f0 0x7f7a3414f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:17.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a33400640 1 -- 172.21.15.29:0/871294731 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a3406f4f0 msgr2=0x7f7a3414f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:17.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a33400640 1 --2- 172.21.15.29:0/871294731 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a3406f4f0 0x7f7a3414f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:17.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a33400640 1 -- 172.21.15.29:0/871294731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a3415c6d0 msgr2=0x7f7a340c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:17.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a33400640 1 --2- 172.21.15.29:0/871294731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a3415c6d0 0x7f7a340c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:17.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a33400640 1 -- 172.21.15.29:0/871294731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c009420 con 0x7f7a3406ca90 2024-01-24T13:07:17.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a33400640 1 --2- 172.21.15.29:0/871294731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a3406ca90 0x7f7a340af380 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400c480 tx=0x7f7a2400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:17.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a2b400640 1 -- 172.21.15.29:0/871294731 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240074e0 con 0x7f7a3406ca90 2024-01-24T13:07:17.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a2b400640 1 -- 172.21.15.29:0/871294731 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a24007660 con 0x7f7a3406ca90 2024-01-24T13:07:17.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a2b400640 1 -- 172.21.15.29:0/871294731 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24004a30 con 0x7f7a3406ca90 2024-01-24T13:07:17.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a3a800640 1 -- 172.21.15.29:0/871294731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a340c5040 con 0x7f7a3406ca90 2024-01-24T13:07:17.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.041+0000 7f7a3a800640 1 -- 172.21.15.29:0/871294731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a34155010 con 0x7f7a3406ca90 2024-01-24T13:07:17.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.045+0000 7f7a3a800640 1 -- 172.21.15.29:0/871294731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3404e850 con 0x7f7a3406ca90 2024-01-24T13:07:17.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.045+0000 7f7a2b400640 1 -- 172.21.15.29:0/871294731 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7a24004b90 con 0x7f7a3406ca90 2024-01-24T13:07:17.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.045+0000 7f7a2b400640 1 --2- 172.21.15.29:0/871294731 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7a0c065a60 0x7f7a0c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:17.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.045+0000 7f7a2b400640 1 -- 172.21.15.29:0/871294731 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7a240821a0 con 0x7f7a3406ca90 2024-01-24T13:07:17.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.045+0000 7f7a32a00640 1 --2- 172.21.15.29:0/871294731 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7a0c065a60 0x7f7a0c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:17.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.045+0000 7f7a32a00640 1 --2- 172.21.15.29:0/871294731 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7a0c065a60 0x7f7a0c067f20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0af000 tx=0x7f7a1c0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:17.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.049+0000 7f7a2b400640 1 -- 172.21.15.29:0/871294731 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7a240537a0 con 0x7f7a3406ca90 2024-01-24T13:07:17.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.209+0000 7f7a3a800640 1 -- 172.21.15.29:0/871294731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a340c7520 con 0x7f7a3406ca90 2024-01-24T13:07:17.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.209+0000 7f7a2b400640 1 -- 172.21.15.29:0/871294731 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+12723 (secure 0 0 0) 0x7f7a24053330 con 0x7f7a3406ca90 2024-01-24T13:07:17.213 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:17.213 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":62,"fsid":"065451ff-9152-4ec9-a888-63a66559ccfb","created":"2024-01-24T13:03:30.515962+0000","modified":"2024-01-24T13:07:13.703122+0000","last_up_change":"2024-01-24T13:03:42.390186+0000","last_in_change":"2024-01-24T13:03:33.020270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T13:03:43.595863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d693f07-513d-4097-bb94-24b39fe37a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":26963},{"type":"v1","addr":"172.21.15.29:6809","nonce":26963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":26963},{"type":"v1","addr":"172.21.15.29:6811","nonce":26963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":26963},{"type":"v1","addr":"172.21.15.29:6815","nonce":26963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":26963},{"type":"v1","addr":"172.21.15.29:6813","nonce":26963}]},"public_addr":"172.21.15.29:6809/26963","cluster_addr":"172.21.15.29:6811/26963","heartbeat_back_addr":"172.21.15.29:6815/26963","heartbeat_front_addr":"172.21.15.29:6813/26963","state":["exists","up"]},{"osd":1,"uuid":"98c792e9-7d74-4d6f-889e-5859b024ca09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":26966},{"type":"v1","addr":"172.21.15.29:6824","nonce":26966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":26966},{"type":"v1","addr":"172.21.15.29:6827","nonce":26966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":26966},{"type":"v1","addr":"172.21.15.29:6831","nonce":26966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":26966},{"type":"v1","addr":"172.21.15.29:6829","nonce":26966}]},"public_addr":"172.21.15.29:6824/26966","cluster_addr":"172.21.15.29:6827/26966","heartbeat_back_addr":"172.21.15.29:6831/26966","heartbeat_front_addr":"172.21.15.29:6829/26966","state":["exists","up"]},{"osd":2,"uuid":"7bee7edd-48e1-4dc2-ac4b-8abc08e4166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":26968},{"type":"v1","addr":"172.21.15.29:6817","nonce":26968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":26968},{"type":"v1","addr":"172.21.15.29:6819","nonce":26968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":26968},{"type":"v1","addr":"172.21.15.29:6825","nonce":26968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":26968},{"type":"v1","addr":"172.21.15.29:6821","nonce":26968}]},"public_addr":"172.21.15.29:6817/26968","cluster_addr":"172.21.15.29:6819/26968","heartbeat_back_addr":"172.21.15.29:6825/26968","heartbeat_front_addr":"172.21.15.29:6821/26968","state":["exists","up"]},{"osd":3,"uuid":"c2bef51a-c7c8-454c-8de7-1a61f17bef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":26967},{"type":"v1","addr":"172.21.15.29:6801","nonce":26967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":26967},{"type":"v1","addr":"172.21.15.29:6803","nonce":26967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":26967},{"type":"v1","addr":"172.21.15.29:6807","nonce":26967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":26967},{"type":"v1","addr":"172.21.15.29:6805","nonce":26967}]},"public_addr":"172.21.15.29:6801/26967","cluster_addr":"172.21.15.29:6803/26967","heartbeat_back_addr":"172.21.15.29:6807/26967","heartbeat_front_addr":"172.21.15.29:6805/26967","state":["exists","up"]},{"osd":4,"uuid":"bcedd366-9488-44ff-8f18-1e0e8f7c914e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":27228},{"type":"v1","addr":"172.21.15.163:6817","nonce":27228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":27228},{"type":"v1","addr":"172.21.15.163:6819","nonce":27228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":27228},{"type":"v1","addr":"172.21.15.163:6823","nonce":27228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":27228},{"type":"v1","addr":"172.21.15.163:6821","nonce":27228}]},"public_addr":"172.21.15.163:6817/27228","cluster_addr":"172.21.15.163:6819/27228","heartbeat_back_addr":"172.21.15.163:6823/27228","heartbeat_front_addr":"172.21.15.163:6821/27228","state":["exists","up"]},{"osd":5,"uuid":"e7dedab9-0a8f-4a9f-b3ce-0f3fd7eae212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":27229},{"type":"v1","addr":"172.21.15.163:6801","nonce":27229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":27229},{"type":"v1","addr":"172.21.15.163:6803","nonce":27229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":27229},{"type":"v1","addr":"172.21.15.163:6807","nonce":27229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":27229},{"type":"v1","addr":"172.21.15.163:6805","nonce":27229}]},"public_addr":"172.21.15.163:6801/27229","cluster_addr":"172.21.15.163:6803/27229","heartbeat_back_addr":"172.21.15.163:6807/27229","heartbeat_front_addr":"172.21.15.163:6805/27229","state":["exists","up"]},{"osd":6,"uuid":"0470be49-3213-499e-8d70-6e5244fec32f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":27230},{"type":"v1","addr":"172.21.15.163:6825","nonce":27230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":27230},{"type":"v1","addr":"172.21.15.163:6827","nonce":27230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":27230},{"type":"v1","addr":"172.21.15.163:6831","nonce":27230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":27230},{"type":"v1","addr":"172.21.15.163:6829","nonce":27230}]},"public_addr":"172.21.15.163:6825/27230","cluster_addr":"172.21.15.163:6827/27230","heartbeat_back_addr":"172.21.15.163:6831/27230","heartbeat_front_addr":"172.21.15.163:6829/27230","state":["exists","up"]},{"osd":7,"uuid":"36b884b5-d9f6-417c-a5f1-9fccbe0b556c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":27231},{"type":"v1","addr":"172.21.15.163:6809","nonce":27231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":27231},{"type":"v1","addr":"172.21.15.163:6811","nonce":27231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":27231},{"type":"v1","addr":"172.21.15.163:6815","nonce":27231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":27231},{"type":"v1","addr":"172.21.15.163:6813","nonce":27231}]},"public_addr":"172.21.15.163:6809/27231","cluster_addr":"172.21.15.163:6811/27231","heartbeat_back_addr":"172.21.15.163:6815/27231","heartbeat_front_addr":"172.21.15.163:6813/27231","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.735830+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.738832+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.701348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.545598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.702133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.539861+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.651834+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T13:03:38.557145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6835/2075296900":"2024-01-25T13:07:10.530330+0000","172.21.15.29:6833/2075296900":"2024-01-25T13:07:10.530330+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T13:07:17.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.209+0000 7f7a3a800640 1 -- 172.21.15.29:0/871294731 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7a0c065a60 msgr2=0x7f7a0c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:17.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.209+0000 7f7a3a800640 1 --2- 172.21.15.29:0/871294731 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7a0c065a60 0x7f7a0c067f20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0af000 tx=0x7f7a1c0a7000 comp rx=0 tx=0).stop 2024-01-24T13:07:17.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.209+0000 7f7a3a800640 1 -- 172.21.15.29:0/871294731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a3406ca90 msgr2=0x7f7a340af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:17.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.209+0000 7f7a3a800640 1 --2- 172.21.15.29:0/871294731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a3406ca90 0x7f7a340af380 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400c480 tx=0x7f7a2400c940 comp rx=0 tx=0).stop 2024-01-24T13:07:17.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.209+0000 7f7a3a800640 1 -- 172.21.15.29:0/871294731 shutdown_connections 2024-01-24T13:07:17.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.209+0000 7f7a3a800640 1 --2- 172.21.15.29:0/871294731 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7a0c065a60 0x7f7a0c067f20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:17.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.209+0000 7f7a3a800640 1 --2- 172.21.15.29:0/871294731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a3415c6d0 0x7f7a340c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:17.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.209+0000 7f7a3a800640 1 --2- 172.21.15.29:0/871294731 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a3406f4f0 0x7f7a3414f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:17.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.209+0000 7f7a3a800640 1 --2- 172.21.15.29:0/871294731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a3406ca90 0x7f7a340af380 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:17.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.209+0000 7f7a3a800640 1 -- 172.21.15.29:0/871294731 >> 172.21.15.29:0/871294731 conn(0x7f7a340d0320 msgr2=0x7f7a340cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:17.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.209+0000 7f7a3a800640 1 -- 172.21.15.29:0/871294731 shutdown_connections 2024-01-24T13:07:17.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:17.209+0000 7f7a3a800640 1 -- 172.21.15.29:0/871294731 wait complete. 2024-01-24T13:07:18.236 INFO:tasks.ceph:Scrubbing osd.0 2024-01-24T13:07:18.237 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-24T13:07:18.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34bc400640 1 Processor -- start 2024-01-24T13:07:18.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34bc400640 1 -- start start 2024-01-24T13:07:18.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34bc400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34b40cd460 0x7f34b40d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34bc400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f34b415d870 0x7f34b40ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34bc400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b40ce9e0 con 0x7f34b40ce5c0 2024-01-24T13:07:18.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34bc400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b40d0830 con 0x7f34b415d870 2024-01-24T13:07:18.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34bc400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b40d0b10 con 0x7f34b40cd460 2024-01-24T13:07:18.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34b9a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34b40cd460 0x7f34b40d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34ba400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f34b40ce5c0 0x7f34b41603e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.29:44506/0 (socket says 172.21.15.29:44506) 2024-01-24T13:07:18.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34ba400640 1 -- 172.21.15.29:0/3469255905 learned_addr learned my addr 172.21.15.29:0/3469255905 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:18.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34b9000640 1 --2- 172.21.15.29:0/3469255905 >> v2:172.21.15.163:3300/0 conn(0x7f34b415d870 0x7f34b40ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34b3e00640 1 -- 172.21.15.29:0/3469255905 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669643765 0 0) 0x7f34b40ce9e0 con 0x7f34b40ce5c0 2024-01-24T13:07:18.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34b3e00640 1 -- 172.21.15.29:0/3469255905 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3494003530 con 0x7f34b40ce5c0 2024-01-24T13:07:18.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34b9000640 1 -- 172.21.15.29:0/3469255905 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34b40cd460 msgr2=0x7f34b40d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:18.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34b9000640 1 --2- 172.21.15.29:0/3469255905 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34b40cd460 0x7f34b40d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34b9000640 1 -- 172.21.15.29:0/3469255905 >> v1:172.21.15.163:6789/0 conn(0x7f34b40ce5c0 legacy=0x7f34b41603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34b9000640 1 -- 172.21.15.29:0/3469255905 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b40d0df0 con 0x7f34b415d870 2024-01-24T13:07:18.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.393+0000 7f34b9a00640 1 --2- 172.21.15.29:0/3469255905 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34b40cd460 0x7f34b40d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:07:18.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.397+0000 7f34b9000640 1 --2- 172.21.15.29:0/3469255905 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34b415d870 0x7f34b40ce080 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f349c0097c0 tx=0x7f349c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6557bd2f31692ce server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:18.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.397+0000 7f34b3e00640 1 -- 172.21.15.29:0/3469255905 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0ab600 con 0x7f34b415d870 2024-01-24T13:07:18.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.397+0000 7f34b3e00640 1 -- 172.21.15.29:0/3469255905 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c0a7050 con 0x7f34b415d870 2024-01-24T13:07:18.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.397+0000 7f34b3e00640 1 -- 172.21.15.29:0/3469255905 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0ab980 con 0x7f34b415d870 2024-01-24T13:07:18.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.397+0000 7f34bc400640 1 -- 172.21.15.29:0/3469255905 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34b415d870 msgr2=0x7f34b40ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.397+0000 7f34bc400640 1 --2- 172.21.15.29:0/3469255905 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34b415d870 0x7f34b40ce080 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f349c0097c0 tx=0x7f349c01c3f0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.397+0000 7f34bc400640 1 -- 172.21.15.29:0/3469255905 shutdown_connections 2024-01-24T13:07:18.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.397+0000 7f34bc400640 1 --2- 172.21.15.29:0/3469255905 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34b415d870 0x7f34b40ce080 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.397+0000 7f34bc400640 1 --2- 172.21.15.29:0/3469255905 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34b40cd460 0x7f34b40d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.397+0000 7f34bc400640 1 -- 172.21.15.29:0/3469255905 >> 172.21.15.29:0/3469255905 conn(0x7f34b4069cd0 msgr2=0x7f34b406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:18.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.397+0000 7f34bc400640 1 -- 172.21.15.29:0/3469255905 shutdown_connections 2024-01-24T13:07:18.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.397+0000 7f34bc400640 1 -- 172.21.15.29:0/3469255905 wait complete. 2024-01-24T13:07:18.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.397+0000 7f34bc400640 1 Processor -- start 2024-01-24T13:07:18.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.397+0000 7f34bc400640 1 -- start start 2024-01-24T13:07:18.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34bc400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34b40cd460 0x7f34b414d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34bc400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34b40ce5c0 0x7f34b415aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34bc400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34b415d870 0x7f34b40c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34bc400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b415b310 con 0x7f34b40cd460 2024-01-24T13:07:18.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34bc400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b415b5f0 con 0x7f34b415d870 2024-01-24T13:07:18.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34bc400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b415b8d0 con 0x7f34b40ce5c0 2024-01-24T13:07:18.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34b9a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34b40cd460 0x7f34b414d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34b9a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34b40cd460 0x7f34b414d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47106/0 (socket says 172.21.15.29:47106) 2024-01-24T13:07:18.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34b9a00640 1 -- 172.21.15.29:0/1256942228 learned_addr learned my addr 172.21.15.29:0/1256942228 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:18.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34b9000640 1 --2- 172.21.15.29:0/1256942228 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34b40ce5c0 0x7f34b415aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34ba400640 1 --2- 172.21.15.29:0/1256942228 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34b415d870 0x7f34b40c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34b9a00640 1 -- 172.21.15.29:0/1256942228 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34b40ce5c0 msgr2=0x7f34b415aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34b9a00640 1 --2- 172.21.15.29:0/1256942228 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f34b40ce5c0 0x7f34b415aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34b9a00640 1 -- 172.21.15.29:0/1256942228 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34b415d870 msgr2=0x7f34b40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34b9a00640 1 --2- 172.21.15.29:0/1256942228 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34b415d870 0x7f34b40c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34b9a00640 1 -- 172.21.15.29:0/1256942228 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a4009420 con 0x7f34b40cd460 2024-01-24T13:07:18.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34b9a00640 1 --2- 172.21.15.29:0/1256942228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34b40cd460 0x7f34b414d9a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f34a400ebe0 tx=0x7f34a400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:18.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34b1600640 1 -- 172.21.15.29:0/1256942228 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a400eee0 con 0x7f34b40cd460 2024-01-24T13:07:18.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34b1600640 1 -- 172.21.15.29:0/1256942228 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a400cc30 con 0x7f34b40cd460 2024-01-24T13:07:18.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34bc400640 1 -- 172.21.15.29:0/1256942228 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c009420 con 0x7f34b40cd460 2024-01-24T13:07:18.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34b1600640 1 -- 172.21.15.29:0/1256942228 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a4013470 con 0x7f34b40cd460 2024-01-24T13:07:18.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34bc400640 1 -- 172.21.15.29:0/1256942228 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b40b3390 con 0x7f34b40cd460 2024-01-24T13:07:18.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.401+0000 7f34bc400640 1 -- 172.21.15.29:0/1256942228 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f34b415dcd0 con 0x7f34b40cd460 2024-01-24T13:07:18.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.405+0000 7f34b1600640 1 -- 172.21.15.29:0/1256942228 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f34a40135d0 con 0x7f34b40cd460 2024-01-24T13:07:18.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.405+0000 7f34b1600640 1 --2- 172.21.15.29:0/1256942228 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f348c065a60 0x7f348c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.405+0000 7f34b1600640 1 -- 172.21.15.29:0/1256942228 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f34a4083630 con 0x7f34b40cd460 2024-01-24T13:07:18.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.405+0000 7f34b1600640 1 --2- 172.21.15.29:0/1256942228 >> [v2:172.21.15.29:6808/26963,v1:172.21.15.29:6809/26963] conn(0x7f348c06bd60 0x7f348c06e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.405+0000 7f34b1600640 1 -- 172.21.15.29:0/1256942228 --> [v2:172.21.15.29:6808/26963,v1:172.21.15.29:6809/26963] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f348c06e870 con 0x7f348c06bd60 2024-01-24T13:07:18.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.405+0000 7f34b1600640 1 -- 172.21.15.29:0/1256942228 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34a40839a0 con 0x7f34b40cd460 2024-01-24T13:07:18.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.405+0000 7f34b9000640 1 --2- 172.21.15.29:0/1256942228 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f348c065a60 0x7f348c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.405+0000 7f34ba400640 1 --2- 172.21.15.29:0/1256942228 >> [v2:172.21.15.29:6808/26963,v1:172.21.15.29:6809/26963] conn(0x7f348c06bd60 0x7f348c06e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.405+0000 7f34ba400640 1 --2- 172.21.15.29:0/1256942228 >> [v2:172.21.15.29:6808/26963,v1:172.21.15.29:6809/26963] conn(0x7f348c06bd60 0x7f348c06e1a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:18.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.405+0000 7f34b9000640 1 --2- 172.21.15.29:0/1256942228 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f348c065a60 0x7f348c067f20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f349c0ad000 tx=0x7f349c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:18.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.405+0000 7f34b1600640 1 -- 172.21.15.29:0/1256942228 <== osd.0 v2:172.21.15.29:6808/26963 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f348c06e870 con 0x7f348c06bd60 2024-01-24T13:07:18.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.417+0000 7f34bc400640 1 -- 172.21.15.29:0/1256942228 --> [v2:172.21.15.29:6808/26963,v1:172.21.15.29:6809/26963] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f34b404e000 con 0x7f348c06bd60 2024-01-24T13:07:18.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.417+0000 7f34b1600640 1 -- 172.21.15.29:0/1256942228 <== osd.0 v2:172.21.15.29:6808/26963 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f34b404e000 con 0x7f348c06bd60 2024-01-24T13:07:18.424 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:07:18.424 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T13:07:18.424 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:07:18.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.421+0000 7f34bc400640 1 -- 172.21.15.29:0/1256942228 >> [v2:172.21.15.29:6808/26963,v1:172.21.15.29:6809/26963] conn(0x7f348c06bd60 msgr2=0x7f348c06e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.421+0000 7f34bc400640 1 --2- 172.21.15.29:0/1256942228 >> [v2:172.21.15.29:6808/26963,v1:172.21.15.29:6809/26963] conn(0x7f348c06bd60 0x7f348c06e1a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.421+0000 7f34bc400640 1 -- 172.21.15.29:0/1256942228 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f348c065a60 msgr2=0x7f348c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.421+0000 7f34bc400640 1 --2- 172.21.15.29:0/1256942228 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f348c065a60 0x7f348c067f20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f349c0ad000 tx=0x7f349c008040 comp rx=0 tx=0).stop 2024-01-24T13:07:18.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.421+0000 7f34bc400640 1 -- 172.21.15.29:0/1256942228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34b40cd460 msgr2=0x7f34b414d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.421+0000 7f34bc400640 1 --2- 172.21.15.29:0/1256942228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34b40cd460 0x7f34b414d9a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f34a400ebe0 tx=0x7f34a400c520 comp rx=0 tx=0).stop 2024-01-24T13:07:18.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.421+0000 7f34ba400640 1 -- 172.21.15.29:0/1256942228 reap_dead start 2024-01-24T13:07:18.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.421+0000 7f34bc400640 1 -- 172.21.15.29:0/1256942228 shutdown_connections 2024-01-24T13:07:18.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.421+0000 7f34bc400640 1 -- 172.21.15.29:0/1256942228 >> 172.21.15.29:0/1256942228 conn(0x7f34b4069cd0 msgr2=0x7f34b406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:18.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.421+0000 7f34bc400640 1 -- 172.21.15.29:0/1256942228 shutdown_connections 2024-01-24T13:07:18.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.421+0000 7f34bc400640 1 -- 172.21.15.29:0/1256942228 wait complete. 2024-01-24T13:07:18.443 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-24T13:07:18.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f6962c00640 1 Processor -- start 2024-01-24T13:07:18.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f6962c00640 1 -- start start 2024-01-24T13:07:18.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f6962c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f695c0cb110 0x7f695c158c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f6962c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c0cb880 con 0x7f695c0cc640 2024-01-24T13:07:18.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f6962c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c0ccaa0 con 0x7f695c15c790 2024-01-24T13:07:18.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f6962c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c159150 con 0x7f695c0cb110 2024-01-24T13:07:18.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f695b400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f695c0cc640 0x7f695c0caa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55456/0 (socket says 172.21.15.29:55456) 2024-01-24T13:07:18.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f695b400640 1 -- 172.21.15.29:0/1784925578 learned_addr learned my addr 172.21.15.29:0/1784925578 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:18.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f6960c00640 1 --2- 172.21.15.29:0/1784925578 >> v2:172.21.15.163:3300/0 conn(0x7f695c0cb110 0x7f695c158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f695aa00640 1 -- 172.21.15.29:0/1784925578 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215451874 0 0) 0x7f695c0cb880 con 0x7f695c0cc640 2024-01-24T13:07:18.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f695aa00640 1 -- 172.21.15.29:0/1784925578 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f693c003530 con 0x7f695c0cc640 2024-01-24T13:07:18.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f695aa00640 1 -- 172.21.15.29:0/1784925578 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895508235 0 0) 0x7f695c0ccaa0 con 0x7f695c15c790 2024-01-24T13:07:18.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f695aa00640 1 -- 172.21.15.29:0/1784925578 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f695c0cb880 con 0x7f695c15c790 2024-01-24T13:07:18.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f6960c00640 1 -- 172.21.15.29:0/1784925578 >> v1:172.21.15.163:6789/0 conn(0x7f695c15c790 legacy=0x7f695c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f6960c00640 1 -- 172.21.15.29:0/1784925578 >> v1:172.21.15.29:6789/0 conn(0x7f695c0cc640 legacy=0x7f695c0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f6960c00640 1 -- 172.21.15.29:0/1784925578 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c0ccd40 con 0x7f695c0cb110 2024-01-24T13:07:18.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f6960c00640 1 --2- 172.21.15.29:0/1784925578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f695c0cb110 0x7f695c158c10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6954009d90 tx=0x7f695401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60d8083c8aab0292 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:18.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f695aa00640 1 -- 172.21.15.29:0/1784925578 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69540a5810 con 0x7f695c0cb110 2024-01-24T13:07:18.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f695aa00640 1 -- 172.21.15.29:0/1784925578 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69540a5970 con 0x7f695c0cb110 2024-01-24T13:07:18.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.585+0000 7f695aa00640 1 -- 172.21.15.29:0/1784925578 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69540a5d00 con 0x7f695c0cb110 2024-01-24T13:07:18.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 -- 172.21.15.29:0/1784925578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f695c0cb110 msgr2=0x7f695c158c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 --2- 172.21.15.29:0/1784925578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f695c0cb110 0x7f695c158c10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6954009d90 tx=0x7f695401c950 comp rx=0 tx=0).stop 2024-01-24T13:07:18.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 -- 172.21.15.29:0/1784925578 shutdown_connections 2024-01-24T13:07:18.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 --2- 172.21.15.29:0/1784925578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f695c0cb110 0x7f695c158c10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 -- 172.21.15.29:0/1784925578 >> 172.21.15.29:0/1784925578 conn(0x7f695c06a2d0 msgr2=0x7f695c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:18.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 -- 172.21.15.29:0/1784925578 shutdown_connections 2024-01-24T13:07:18.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 -- 172.21.15.29:0/1784925578 wait complete. 2024-01-24T13:07:18.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 Processor -- start 2024-01-24T13:07:18.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 -- start start 2024-01-24T13:07:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f695c0cb110 0x7f695c0ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f695c0cc640 0x7f695c0c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f695c15c790 0x7f695c1f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c150120 con 0x7f695c0cc640 2024-01-24T13:07:18.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c14f550 con 0x7f695c0cb110 2024-01-24T13:07:18.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f6962c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c1f4ff0 con 0x7f695c15c790 2024-01-24T13:07:18.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f695b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f695c0cc640 0x7f695c0c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f695b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f695c0cc640 0x7f695c0c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47108/0 (socket says 172.21.15.29:47108) 2024-01-24T13:07:18.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.589+0000 7f695b400640 1 -- 172.21.15.29:0/3609531965 learned_addr learned my addr 172.21.15.29:0/3609531965 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:18.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f695be00640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f695c0cb110 0x7f695c0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f695b400640 1 -- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f695c15c790 msgr2=0x7f695c1f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f6960c00640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f695c15c790 0x7f695c1f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f695b400640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f695c15c790 0x7f695c1f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f695b400640 1 -- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f695c0cb110 msgr2=0x7f695c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f695b400640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f695c0cb110 0x7f695c0ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f695b400640 1 -- 172.21.15.29:0/3609531965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6954009a70 con 0x7f695c0cc640 2024-01-24T13:07:18.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f695be00640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f695c0cb110 0x7f695c0ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:18.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f6960c00640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f695c15c790 0x7f695c1f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:18.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f695b400640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f695c0cc640 0x7f695c0c2bb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f694400c4f0 tx=0x7f694400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:18.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f6953e00640 1 -- 172.21.15.29:0/3609531965 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944005cf0 con 0x7f695c0cc640 2024-01-24T13:07:18.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f6953e00640 1 -- 172.21.15.29:0/3609531965 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6944005e50 con 0x7f695c0cc640 2024-01-24T13:07:18.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f6962c00640 1 -- 172.21.15.29:0/3609531965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c14f7f0 con 0x7f695c0cc640 2024-01-24T13:07:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f6953e00640 1 -- 172.21.15.29:0/3609531965 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944007270 con 0x7f695c0cc640 2024-01-24T13:07:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f6962c00640 1 -- 172.21.15.29:0/3609531965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c14fdb0 con 0x7f695c0cc640 2024-01-24T13:07:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f6962c00640 1 -- 172.21.15.29:0/3609531965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c04e850 con 0x7f695c0cc640 2024-01-24T13:07:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.593+0000 7f6953e00640 1 -- 172.21.15.29:0/3609531965 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f69440073d0 con 0x7f695c0cc640 2024-01-24T13:07:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.597+0000 7f6953e00640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6934065a60 0x7f6934067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.597+0000 7f6953e00640 1 -- 172.21.15.29:0/3609531965 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6944082520 con 0x7f695c0cc640 2024-01-24T13:07:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.597+0000 7f695be00640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6934065a60 0x7f6934067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.597+0000 7f695be00640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6934065a60 0x7f6934067f20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f694c001240 tx=0x7f694c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:18.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.601+0000 7f6953e00640 1 -- 172.21.15.29:0/3609531965 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f6944050150 con 0x7f695c0cc640 2024-01-24T13:07:18.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.753+0000 7f6962c00640 1 -- 172.21.15.29:0/3609531965 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f695c0cd8c0 con 0x7f6934065a60 2024-01-24T13:07:18.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.757+0000 7f6953e00640 1 -- 172.21.15.29:0/3609531965 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f694c001d40 con 0x7f6934065a60 2024-01-24T13:07:18.760 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 0 to deep-scrub 2024-01-24T13:07:18.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.757+0000 7f6962c00640 1 -- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6934065a60 msgr2=0x7f6934067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.757+0000 7f6962c00640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6934065a60 0x7f6934067f20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f694c001240 tx=0x7f694c009040 comp rx=0 tx=0).stop 2024-01-24T13:07:18.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.757+0000 7f6962c00640 1 -- 172.21.15.29:0/3609531965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f695c0cc640 msgr2=0x7f695c0c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.757+0000 7f6962c00640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f695c0cc640 0x7f695c0c2bb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f694400c4f0 tx=0x7f694400c9b0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.757+0000 7f6962c00640 1 -- 172.21.15.29:0/3609531965 shutdown_connections 2024-01-24T13:07:18.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.757+0000 7f6962c00640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6934065a60 0x7f6934067f20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.757+0000 7f6962c00640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f695c15c790 0x7f695c1f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.757+0000 7f6962c00640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f695c0cc640 0x7f695c0c2bb0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.757+0000 7f6962c00640 1 --2- 172.21.15.29:0/3609531965 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f695c0cb110 0x7f695c0ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.757+0000 7f6962c00640 1 -- 172.21.15.29:0/3609531965 >> 172.21.15.29:0/3609531965 conn(0x7f695c06a2d0 msgr2=0x7f695c156b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:18.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.757+0000 7f6962c00640 1 -- 172.21.15.29:0/3609531965 shutdown_connections 2024-01-24T13:07:18.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.757+0000 7f6962c00640 1 -- 172.21.15.29:0/3609531965 wait complete. 2024-01-24T13:07:18.781 INFO:tasks.ceph:Scrubbing osd.1 2024-01-24T13:07:18.781 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-24T13:07:18.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5fd800640 1 Processor -- start 2024-01-24T13:07:18.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5fd800640 1 -- start start 2024-01-24T13:07:18.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5fd800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa5f8069cd0 0x7fa5f815c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5fd800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5f80ccb50 0x7fa5f80cd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5fd800640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f815d8b0 con 0x7fa5f815c4a0 2024-01-24T13:07:18.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5fd800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f80b24e0 con 0x7fa5f8069cd0 2024-01-24T13:07:18.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5fd800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f815cf80 con 0x7fa5f80ccb50 2024-01-24T13:07:18.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5f6a00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa5f815c4a0 0x7fa5f80cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55458/0 (socket says 172.21.15.29:55458) 2024-01-24T13:07:18.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5f6a00640 1 -- 172.21.15.29:0/3330359138 learned_addr learned my addr 172.21.15.29:0/3330359138 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:18.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5f7e00640 1 --2- 172.21.15.29:0/3330359138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5f80ccb50 0x7fa5f80cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5f6000640 1 --2- 172.21.15.29:0/3330359138 >> v2:172.21.15.163:3300/0 conn(0x7fa5f8069cd0 0x7fa5f815c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5f5600640 1 -- 172.21.15.29:0/3330359138 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065415183 0 0) 0x7fa5f815d8b0 con 0x7fa5f815c4a0 2024-01-24T13:07:18.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5f5600640 1 -- 172.21.15.29:0/3330359138 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d8003530 con 0x7fa5f815c4a0 2024-01-24T13:07:18.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5f7e00640 1 -- 172.21.15.29:0/3330359138 >> v2:172.21.15.163:3300/0 conn(0x7fa5f8069cd0 msgr2=0x7fa5f815c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:18.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5f7e00640 1 --2- 172.21.15.29:0/3330359138 >> v2:172.21.15.163:3300/0 conn(0x7fa5f8069cd0 0x7fa5f815c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5f7e00640 1 -- 172.21.15.29:0/3330359138 >> v1:172.21.15.29:6789/0 conn(0x7fa5f815c4a0 legacy=0x7fa5f80cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5f7e00640 1 -- 172.21.15.29:0/3330359138 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f815d260 con 0x7fa5f80ccb50 2024-01-24T13:07:18.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5f7e00640 1 --2- 172.21.15.29:0/3330359138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5f80ccb50 0x7fa5f80cd640 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009d90 tx=0x7fa5f001c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a51c126717af277 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:18.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5f5600640 1 -- 172.21.15.29:0/3330359138 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00a59a0 con 0x7fa5f80ccb50 2024-01-24T13:07:18.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5f5600640 1 -- 172.21.15.29:0/3330359138 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f00a5b00 con 0x7fa5f80ccb50 2024-01-24T13:07:18.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.925+0000 7fa5f5600640 1 -- 172.21.15.29:0/3330359138 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00a5e90 con 0x7fa5f80ccb50 2024-01-24T13:07:18.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 -- 172.21.15.29:0/3330359138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5f80ccb50 msgr2=0x7fa5f80cd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 --2- 172.21.15.29:0/3330359138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5f80ccb50 0x7fa5f80cd640 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009d90 tx=0x7fa5f001c8c0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 -- 172.21.15.29:0/3330359138 shutdown_connections 2024-01-24T13:07:18.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 --2- 172.21.15.29:0/3330359138 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5f80ccb50 0x7fa5f80cd640 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 --2- 172.21.15.29:0/3330359138 >> v2:172.21.15.163:3300/0 conn(0x7fa5f8069cd0 0x7fa5f815c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 -- 172.21.15.29:0/3330359138 >> 172.21.15.29:0/3330359138 conn(0x7fa5f80714a0 msgr2=0x7fa5f80718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:18.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 -- 172.21.15.29:0/3330359138 shutdown_connections 2024-01-24T13:07:18.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 -- 172.21.15.29:0/3330359138 wait complete. 2024-01-24T13:07:18.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 Processor -- start 2024-01-24T13:07:18.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 -- start start 2024-01-24T13:07:18.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5f8069cd0 0x7fa5f815f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5f80ccb50 0x7fa5f814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5f815c4a0 0x7fa5f80b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f80c70c0 con 0x7fa5f8069cd0 2024-01-24T13:07:18.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f8151180 con 0x7fa5f815c4a0 2024-01-24T13:07:18.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5fd800640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f806a790 con 0x7fa5f80ccb50 2024-01-24T13:07:18.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.929+0000 7fa5f6a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5f8069cd0 0x7fa5f815f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5f7e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5f815c4a0 0x7fa5f80b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5f6a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5f8069cd0 0x7fa5f815f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47124/0 (socket says 172.21.15.29:47124) 2024-01-24T13:07:18.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5f6000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5f80ccb50 0x7fa5f814f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5f6a00640 1 -- 172.21.15.29:0/439001216 learned_addr learned my addr 172.21.15.29:0/439001216 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:18.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5f7e00640 1 -- 172.21.15.29:0/439001216 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5f80ccb50 msgr2=0x7fa5f814f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5f7e00640 1 --2- 172.21.15.29:0/439001216 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5f80ccb50 0x7fa5f814f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5f7e00640 1 -- 172.21.15.29:0/439001216 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5f8069cd0 msgr2=0x7fa5f815f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5f7e00640 1 --2- 172.21.15.29:0/439001216 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5f8069cd0 0x7fa5f815f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5f7e00640 1 -- 172.21.15.29:0/439001216 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0009a70 con 0x7fa5f815c4a0 2024-01-24T13:07:18.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5f6a00640 1 --2- 172.21.15.29:0/439001216 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5f8069cd0 0x7fa5f815f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:07:18.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5f7e00640 1 --2- 172.21.15.29:0/439001216 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5f815c4a0 0x7fa5f80b0650 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00ac000 tx=0x7fa5f0019660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:18.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5eea00640 1 -- 172.21.15.29:0/439001216 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00add20 con 0x7fa5f815c4a0 2024-01-24T13:07:18.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5eea00640 1 -- 172.21.15.29:0/439001216 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f00ade80 con 0x7fa5f815c4a0 2024-01-24T13:07:18.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5fd800640 1 -- 172.21.15.29:0/439001216 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f806aa70 con 0x7fa5f815c4a0 2024-01-24T13:07:18.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5eea00640 1 -- 172.21.15.29:0/439001216 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00b9650 con 0x7fa5f815c4a0 2024-01-24T13:07:18.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5fd800640 1 -- 172.21.15.29:0/439001216 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f814f650 con 0x7fa5f815c4a0 2024-01-24T13:07:18.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5fd800640 1 -- 172.21.15.29:0/439001216 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5f81542e0 con 0x7fa5f815c4a0 2024-01-24T13:07:18.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.933+0000 7fa5eea00640 1 -- 172.21.15.29:0/439001216 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa5f00b97b0 con 0x7fa5f815c4a0 2024-01-24T13:07:18.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.937+0000 7fa5eea00640 1 --2- 172.21.15.29:0/439001216 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa5d0065ab0 0x7fa5d0067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.937+0000 7fa5eea00640 1 -- 172.21.15.29:0/439001216 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa5f011e7e0 con 0x7fa5f815c4a0 2024-01-24T13:07:18.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.937+0000 7fa5eea00640 1 --2- 172.21.15.29:0/439001216 >> [v2:172.21.15.29:6822/26966,v1:172.21.15.29:6824/26966] conn(0x7fa5d006bdb0 0x7fa5d006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:18.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.937+0000 7fa5eea00640 1 -- 172.21.15.29:0/439001216 --> [v2:172.21.15.29:6822/26966,v1:172.21.15.29:6824/26966] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5d006e8c0 con 0x7fa5d006bdb0 2024-01-24T13:07:18.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.937+0000 7fa5eea00640 1 -- 172.21.15.29:0/439001216 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5f011eb50 con 0x7fa5f815c4a0 2024-01-24T13:07:18.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.937+0000 7fa5f6a00640 1 --2- 172.21.15.29:0/439001216 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa5d0065ab0 0x7fa5d0067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.937+0000 7fa5f6000640 1 --2- 172.21.15.29:0/439001216 >> [v2:172.21.15.29:6822/26966,v1:172.21.15.29:6824/26966] conn(0x7fa5d006bdb0 0x7fa5d006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:18.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.937+0000 7fa5f6000640 1 --2- 172.21.15.29:0/439001216 >> [v2:172.21.15.29:6822/26966,v1:172.21.15.29:6824/26966] conn(0x7fa5d006bdb0 0x7fa5d006e1f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:18.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.937+0000 7fa5f6a00640 1 --2- 172.21.15.29:0/439001216 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa5d0065ab0 0x7fa5d0067f70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80011f0 tx=0x7fa5e8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:18.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.937+0000 7fa5eea00640 1 -- 172.21.15.29:0/439001216 <== osd.1 v2:172.21.15.29:6822/26966 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa5d006e8c0 con 0x7fa5d006bdb0 2024-01-24T13:07:18.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.949+0000 7fa5fd800640 1 -- 172.21.15.29:0/439001216 --> [v2:172.21.15.29:6822/26966,v1:172.21.15.29:6824/26966] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa5f806ac60 con 0x7fa5d006bdb0 2024-01-24T13:07:18.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.949+0000 7fa5eea00640 1 -- 172.21.15.29:0/439001216 <== osd.1 v2:172.21.15.29:6822/26966 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa5f806ac60 con 0x7fa5d006bdb0 2024-01-24T13:07:18.955 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:07:18.955 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T13:07:18.955 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:07:18.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.949+0000 7fa5fd800640 1 -- 172.21.15.29:0/439001216 >> [v2:172.21.15.29:6822/26966,v1:172.21.15.29:6824/26966] conn(0x7fa5d006bdb0 msgr2=0x7fa5d006e1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.949+0000 7fa5fd800640 1 --2- 172.21.15.29:0/439001216 >> [v2:172.21.15.29:6822/26966,v1:172.21.15.29:6824/26966] conn(0x7fa5d006bdb0 0x7fa5d006e1f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.949+0000 7fa5fd800640 1 -- 172.21.15.29:0/439001216 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa5d0065ab0 msgr2=0x7fa5d0067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.949+0000 7fa5fd800640 1 --2- 172.21.15.29:0/439001216 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa5d0065ab0 0x7fa5d0067f70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80011f0 tx=0x7fa5e8009040 comp rx=0 tx=0).stop 2024-01-24T13:07:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.949+0000 7fa5fd800640 1 -- 172.21.15.29:0/439001216 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5f815c4a0 msgr2=0x7fa5f80b0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.949+0000 7fa5fd800640 1 --2- 172.21.15.29:0/439001216 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5f815c4a0 0x7fa5f80b0650 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00ac000 tx=0x7fa5f0019660 comp rx=0 tx=0).stop 2024-01-24T13:07:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.949+0000 7fa5f7e00640 1 -- 172.21.15.29:0/439001216 reap_dead start 2024-01-24T13:07:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.949+0000 7fa5fd800640 1 -- 172.21.15.29:0/439001216 shutdown_connections 2024-01-24T13:07:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.949+0000 7fa5fd800640 1 -- 172.21.15.29:0/439001216 >> 172.21.15.29:0/439001216 conn(0x7fa5f80714a0 msgr2=0x7fa5f8151e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:18.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.953+0000 7fa5fd800640 1 -- 172.21.15.29:0/439001216 shutdown_connections 2024-01-24T13:07:18.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:18.953+0000 7fa5fd800640 1 -- 172.21.15.29:0/439001216 wait complete. 2024-01-24T13:07:18.974 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-24T13:07:19.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.113+0000 7f80cf400640 1 Processor -- start 2024-01-24T13:07:19.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.113+0000 7f80cf400640 1 -- start start 2024-01-24T13:07:19.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.113+0000 7f80cf400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f80c81599c0 0x7f80c8071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.113+0000 7f80cf400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c815a960 con 0x7f80c806ba60 2024-01-24T13:07:19.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.113+0000 7f80cf400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c8070ca0 con 0x7f80c80c87e0 2024-01-24T13:07:19.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.113+0000 7f80cf400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c815df10 con 0x7f80c81599c0 2024-01-24T13:07:19.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.113+0000 7f80cd400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f80c81599c0 0x7f80c8071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.113+0000 7f80cca00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f80c806ba60 0x7f80c806be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55470/0 (socket says 172.21.15.29:55470) 2024-01-24T13:07:19.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.113+0000 7f80cd400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f80c81599c0 0x7f80c8071130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47128/0 (socket says 172.21.15.29:47128) 2024-01-24T13:07:19.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.113+0000 7f80cca00640 1 -- 172.21.15.29:0/1538269989 learned_addr learned my addr 172.21.15.29:0/1538269989 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:19.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.113+0000 7f80cd400640 1 -- 172.21.15.29:0/1538269989 >> v1:172.21.15.163:6789/0 conn(0x7f80c80c87e0 legacy=0x7f80c815d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.113+0000 7f80cd400640 1 -- 172.21.15.29:0/1538269989 >> v1:172.21.15.29:6789/0 conn(0x7f80c806ba60 legacy=0x7f80c806be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.113+0000 7f80cd400640 1 -- 172.21.15.29:0/1538269989 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c8159e50 con 0x7f80c81599c0 2024-01-24T13:07:19.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.113+0000 7f80c7400640 1 -- 172.21.15.29:0/1538269989 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246152989 0 0) 0x7f80c815a960 con 0x7f80c806ba60 2024-01-24T13:07:19.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.117+0000 7f80cd400640 1 --2- 172.21.15.29:0/1538269989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c81599c0 0x7f80c8071130 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009d90 tx=0x7f80c001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773d2869435d6d8d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:19.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.117+0000 7f80c7400640 1 -- 172.21.15.29:0/1538269989 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c00a5810 con 0x7f80c81599c0 2024-01-24T13:07:19.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.117+0000 7f80c7400640 1 -- 172.21.15.29:0/1538269989 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c00a5970 con 0x7f80c81599c0 2024-01-24T13:07:19.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.117+0000 7f80c7400640 1 -- 172.21.15.29:0/1538269989 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c00a5d00 con 0x7f80c81599c0 2024-01-24T13:07:19.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.117+0000 7f80cf400640 1 -- 172.21.15.29:0/1538269989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c81599c0 msgr2=0x7f80c8071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.117+0000 7f80cf400640 1 --2- 172.21.15.29:0/1538269989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c81599c0 0x7f80c8071130 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009d90 tx=0x7f80c001c950 comp rx=0 tx=0).stop 2024-01-24T13:07:19.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.117+0000 7f80cf400640 1 -- 172.21.15.29:0/1538269989 shutdown_connections 2024-01-24T13:07:19.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.117+0000 7f80cf400640 1 --2- 172.21.15.29:0/1538269989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c81599c0 0x7f80c8071130 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.117+0000 7f80cf400640 1 -- 172.21.15.29:0/1538269989 >> 172.21.15.29:0/1538269989 conn(0x7f80c806a2d0 msgr2=0x7f80c80afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:19.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.117+0000 7f80cf400640 1 -- 172.21.15.29:0/1538269989 shutdown_connections 2024-01-24T13:07:19.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.117+0000 7f80cf400640 1 -- 172.21.15.29:0/1538269989 wait complete. 2024-01-24T13:07:19.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cf400640 1 Processor -- start 2024-01-24T13:07:19.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cf400640 1 -- start start 2024-01-24T13:07:19.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cf400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c806ba60 0x7f80c80c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cf400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f80c80c87e0 0x7f80c814af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cf400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80c81599c0 0x7f80c80b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cf400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c814b4b0 con 0x7f80c806ba60 2024-01-24T13:07:19.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cf400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c80c5c70 con 0x7f80c81599c0 2024-01-24T13:07:19.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cf400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c80c5f50 con 0x7f80c80c87e0 2024-01-24T13:07:19.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cca00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c806ba60 0x7f80c80c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cca00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c806ba60 0x7f80c80c6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47130/0 (socket says 172.21.15.29:47130) 2024-01-24T13:07:19.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cca00640 1 -- 172.21.15.29:0/949336754 learned_addr learned my addr 172.21.15.29:0/949336754 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:19.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80c7e00640 1 --2- 172.21.15.29:0/949336754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f80c80c87e0 0x7f80c814af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cd400640 1 --2- 172.21.15.29:0/949336754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80c81599c0 0x7f80c80b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cca00640 1 -- 172.21.15.29:0/949336754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f80c80c87e0 msgr2=0x7f80c814af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cca00640 1 --2- 172.21.15.29:0/949336754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f80c80c87e0 0x7f80c814af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cca00640 1 -- 172.21.15.29:0/949336754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80c81599c0 msgr2=0x7f80c80b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cca00640 1 --2- 172.21.15.29:0/949336754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80c81599c0 0x7f80c80b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cca00640 1 -- 172.21.15.29:0/949336754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c0009a70 con 0x7f80c806ba60 2024-01-24T13:07:19.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cca00640 1 --2- 172.21.15.29:0/949336754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c806ba60 0x7f80c80c6ff0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f80b800c750 tx=0x7f80b800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:19.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80c4c00640 1 -- 172.21.15.29:0/949336754 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8007270 con 0x7f80c806ba60 2024-01-24T13:07:19.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80c4c00640 1 -- 172.21.15.29:0/949336754 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b80073d0 con 0x7f80c806ba60 2024-01-24T13:07:19.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cf400640 1 -- 172.21.15.29:0/949336754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c80c6230 con 0x7f80c806ba60 2024-01-24T13:07:19.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80c4c00640 1 -- 172.21.15.29:0/949336754 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8001d30 con 0x7f80c806ba60 2024-01-24T13:07:19.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cf400640 1 -- 172.21.15.29:0/949336754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c80c67f0 con 0x7f80c806ba60 2024-01-24T13:07:19.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.121+0000 7f80cf400640 1 -- 172.21.15.29:0/949336754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c804e850 con 0x7f80c806ba60 2024-01-24T13:07:19.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.125+0000 7f80c4c00640 1 -- 172.21.15.29:0/949336754 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f80b80057b0 con 0x7f80c806ba60 2024-01-24T13:07:19.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.125+0000 7f80c4c00640 1 --2- 172.21.15.29:0/949336754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f80a0065a60 0x7f80a0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.125+0000 7f80c4c00640 1 -- 172.21.15.29:0/949336754 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f80b8082b50 con 0x7f80c806ba60 2024-01-24T13:07:19.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.125+0000 7f80c7e00640 1 --2- 172.21.15.29:0/949336754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f80a0065a60 0x7f80a0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.125+0000 7f80c7e00640 1 --2- 172.21.15.29:0/949336754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f80a0065a60 0x7f80a0067f20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f80c81652e0 tx=0x7f80b0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:19.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.133+0000 7f80c4c00640 1 -- 172.21.15.29:0/949336754 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f80b8050650 con 0x7f80c806ba60 2024-01-24T13:07:19.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.289+0000 7f80cf400640 1 -- 172.21.15.29:0/949336754 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f80c815a680 con 0x7f80a0065a60 2024-01-24T13:07:19.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.289+0000 7f80c4c00640 1 -- 172.21.15.29:0/949336754 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f80b00014f0 con 0x7f80a0065a60 2024-01-24T13:07:19.293 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 1 to deep-scrub 2024-01-24T13:07:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.289+0000 7f80cf400640 1 -- 172.21.15.29:0/949336754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f80a0065a60 msgr2=0x7f80a0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.289+0000 7f80cf400640 1 --2- 172.21.15.29:0/949336754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f80a0065a60 0x7f80a0067f20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f80c81652e0 tx=0x7f80b0009040 comp rx=0 tx=0).stop 2024-01-24T13:07:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.289+0000 7f80cf400640 1 -- 172.21.15.29:0/949336754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c806ba60 msgr2=0x7f80c80c6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.289+0000 7f80cf400640 1 --2- 172.21.15.29:0/949336754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c806ba60 0x7f80c80c6ff0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f80b800c750 tx=0x7f80b800cc10 comp rx=0 tx=0).stop 2024-01-24T13:07:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.289+0000 7f80cf400640 1 -- 172.21.15.29:0/949336754 shutdown_connections 2024-01-24T13:07:19.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.289+0000 7f80cf400640 1 --2- 172.21.15.29:0/949336754 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f80a0065a60 0x7f80a0067f20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.289+0000 7f80cf400640 1 --2- 172.21.15.29:0/949336754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80c81599c0 0x7f80c80b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.289+0000 7f80cf400640 1 --2- 172.21.15.29:0/949336754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f80c80c87e0 0x7f80c814af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.289+0000 7f80cf400640 1 --2- 172.21.15.29:0/949336754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c806ba60 0x7f80c80c6ff0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.289+0000 7f80cf400640 1 -- 172.21.15.29:0/949336754 >> 172.21.15.29:0/949336754 conn(0x7f80c806a2d0 msgr2=0x7f80c80adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.289+0000 7f80cf400640 1 -- 172.21.15.29:0/949336754 shutdown_connections 2024-01-24T13:07:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.289+0000 7f80cf400640 1 -- 172.21.15.29:0/949336754 wait complete. 2024-01-24T13:07:19.314 INFO:tasks.ceph:Scrubbing osd.2 2024-01-24T13:07:19.315 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-24T13:07:19.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07d7000640 1 Processor -- start 2024-01-24T13:07:19.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07d7000640 1 -- start start 2024-01-24T13:07:19.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07d7000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f07d00ca0f0 0x7f07d00b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07d7000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f07d00b0600 0x7f07d015d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07d7000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d00cacd0 con 0x7f07d015d730 2024-01-24T13:07:19.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07d7000640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d00b0a90 con 0x7f07d00b0600 2024-01-24T13:07:19.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07d7000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d00cba90 con 0x7f07d00ca0f0 2024-01-24T13:07:19.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07cf400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f07d00b0600 0x7f07d015d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07d5000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f07d015d730 0x7f07d00c8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55474/0 (socket says 172.21.15.29:55474) 2024-01-24T13:07:19.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07cf400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f07d00b0600 0x7f07d015d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47134/0 (socket says 172.21.15.29:47134) 2024-01-24T13:07:19.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07d5000640 1 -- 172.21.15.29:0/2519060393 learned_addr learned my addr 172.21.15.29:0/2519060393 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:19.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07cfe00640 1 --2- 172.21.15.29:0/2519060393 >> v2:172.21.15.163:3300/0 conn(0x7f07d00ca0f0 0x7f07d00b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07cf400640 1 -- 172.21.15.29:0/2519060393 >> v2:172.21.15.163:3300/0 conn(0x7f07d00ca0f0 msgr2=0x7f07d00b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:19.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07cf400640 1 --2- 172.21.15.29:0/2519060393 >> v2:172.21.15.163:3300/0 conn(0x7f07d00ca0f0 0x7f07d00b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07cf400640 1 -- 172.21.15.29:0/2519060393 >> v1:172.21.15.29:6789/0 conn(0x7f07d015d730 legacy=0x7f07d00c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07cea00640 1 -- 172.21.15.29:0/2519060393 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642029488 0 0) 0x7f07d00cacd0 con 0x7f07d015d730 2024-01-24T13:07:19.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.457+0000 7f07cf400640 1 -- 172.21.15.29:0/2519060393 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00cafb0 con 0x7f07d00b0600 2024-01-24T13:07:19.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.461+0000 7f07cf400640 1 --2- 172.21.15.29:0/2519060393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07d00b0600 0x7f07d015d1f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f07d00cc7e0 tx=0x7f07b801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69cf0c0609024083 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:19.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.461+0000 7f07cea00640 1 -- 172.21.15.29:0/2519060393 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b80ab600 con 0x7f07d00b0600 2024-01-24T13:07:19.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.461+0000 7f07cea00640 1 -- 172.21.15.29:0/2519060393 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b80a7050 con 0x7f07d00b0600 2024-01-24T13:07:19.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.461+0000 7f07cea00640 1 -- 172.21.15.29:0/2519060393 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b80ab980 con 0x7f07d00b0600 2024-01-24T13:07:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.461+0000 7f07d7000640 1 -- 172.21.15.29:0/2519060393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07d00b0600 msgr2=0x7f07d015d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.461+0000 7f07d7000640 1 --2- 172.21.15.29:0/2519060393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07d00b0600 0x7f07d015d1f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f07d00cc7e0 tx=0x7f07b801c3b0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.461+0000 7f07d7000640 1 -- 172.21.15.29:0/2519060393 shutdown_connections 2024-01-24T13:07:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.461+0000 7f07d7000640 1 --2- 172.21.15.29:0/2519060393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07d00b0600 0x7f07d015d1f0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.461+0000 7f07d7000640 1 --2- 172.21.15.29:0/2519060393 >> v2:172.21.15.163:3300/0 conn(0x7f07d00ca0f0 0x7f07d00b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.461+0000 7f07d7000640 1 -- 172.21.15.29:0/2519060393 >> 172.21.15.29:0/2519060393 conn(0x7f07d006a0d0 msgr2=0x7f07d006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.461+0000 7f07d7000640 1 -- 172.21.15.29:0/2519060393 shutdown_connections 2024-01-24T13:07:19.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.461+0000 7f07d7000640 1 -- 172.21.15.29:0/2519060393 wait complete. 2024-01-24T13:07:19.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.461+0000 7f07d7000640 1 Processor -- start 2024-01-24T13:07:19.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.461+0000 7f07d7000640 1 -- start start 2024-01-24T13:07:19.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07d7000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07d00b0600 0x7f07d00ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07d7000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f07d00ca0f0 0x7f07d0158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07d7000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07d015d730 0x7f07d0158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07d7000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00acbd0 con 0x7f07d00b0600 2024-01-24T13:07:19.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07d7000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00c8cf0 con 0x7f07d015d730 2024-01-24T13:07:19.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07d7000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00abfc0 con 0x7f07d00ca0f0 2024-01-24T13:07:19.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07cfe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07d00b0600 0x7f07d00ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07cfe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07d00b0600 0x7f07d00ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47138/0 (socket says 172.21.15.29:47138) 2024-01-24T13:07:19.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07cfe00640 1 -- 172.21.15.29:0/2942699807 learned_addr learned my addr 172.21.15.29:0/2942699807 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:19.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07cf400640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f07d00ca0f0 0x7f07d0158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07d5000640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07d015d730 0x7f07d0158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07cfe00640 1 -- 172.21.15.29:0/2942699807 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f07d00ca0f0 msgr2=0x7f07d0158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07cfe00640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f07d00ca0f0 0x7f07d0158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07cfe00640 1 -- 172.21.15.29:0/2942699807 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07d015d730 msgr2=0x7f07d0158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07cfe00640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07d015d730 0x7f07d0158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07cfe00640 1 -- 172.21.15.29:0/2942699807 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b8009420 con 0x7f07d00b0600 2024-01-24T13:07:19.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07d5000640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07d015d730 0x7f07d0158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:19.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07cfe00640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07d00b0600 0x7f07d00ab8e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f07c000d800 tx=0x7f07c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:19.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07c7e00640 1 -- 172.21.15.29:0/2942699807 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c000b6c0 con 0x7f07d00b0600 2024-01-24T13:07:19.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07c7e00640 1 -- 172.21.15.29:0/2942699807 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c000b820 con 0x7f07d00b0600 2024-01-24T13:07:19.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07c7e00640 1 -- 172.21.15.29:0/2942699807 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c000bb90 con 0x7f07d00b0600 2024-01-24T13:07:19.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07d7000640 1 -- 172.21.15.29:0/2942699807 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d00ac2a0 con 0x7f07d00b0600 2024-01-24T13:07:19.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07d7000640 1 -- 172.21.15.29:0/2942699807 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d00ac860 con 0x7f07d00b0600 2024-01-24T13:07:19.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07d7000640 1 -- 172.21.15.29:0/2942699807 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f07d00ca4d0 con 0x7f07d00b0600 2024-01-24T13:07:19.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.465+0000 7f07c7e00640 1 -- 172.21.15.29:0/2942699807 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f07c000bcf0 con 0x7f07d00b0600 2024-01-24T13:07:19.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.469+0000 7f07c7e00640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f07a8065a90 0x7f07a8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.469+0000 7f07c7e00640 1 -- 172.21.15.29:0/2942699807 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f07c00835c0 con 0x7f07d00b0600 2024-01-24T13:07:19.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.469+0000 7f07c7e00640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.29:6816/26968,v1:172.21.15.29:6817/26968] conn(0x7f07a806bd90 0x7f07a806e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.469+0000 7f07c7e00640 1 -- 172.21.15.29:0/2942699807 --> [v2:172.21.15.29:6816/26968,v1:172.21.15.29:6817/26968] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07a806e8a0 con 0x7f07a806bd90 2024-01-24T13:07:19.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.469+0000 7f07c7e00640 1 -- 172.21.15.29:0/2942699807 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07c0085ba0 con 0x7f07d00b0600 2024-01-24T13:07:19.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.469+0000 7f07cf400640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f07a8065a90 0x7f07a8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.469+0000 7f07d5000640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.29:6816/26968,v1:172.21.15.29:6817/26968] conn(0x7f07a806bd90 0x7f07a806e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.469+0000 7f07cf400640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f07a8065a90 0x7f07a8067f50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f07b80ad000 tx=0x7f07b8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:19.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.469+0000 7f07d5000640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.29:6816/26968,v1:172.21.15.29:6817/26968] conn(0x7f07a806bd90 0x7f07a806e1d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:19.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.469+0000 7f07c7e00640 1 -- 172.21.15.29:0/2942699807 <== osd.2 v2:172.21.15.29:6816/26968 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f07a806e8a0 con 0x7f07a806bd90 2024-01-24T13:07:19.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.485+0000 7f07d7000640 1 -- 172.21.15.29:0/2942699807 --> [v2:172.21.15.29:6816/26968,v1:172.21.15.29:6817/26968] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f07d00ca9e0 con 0x7f07a806bd90 2024-01-24T13:07:19.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.485+0000 7f07c7e00640 1 -- 172.21.15.29:0/2942699807 <== osd.2 v2:172.21.15.29:6816/26968 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f07c8001a10 con 0x7f07a806bd90 2024-01-24T13:07:19.487 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:07:19.488 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T13:07:19.488 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:07:19.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.485+0000 7f07d7000640 1 -- 172.21.15.29:0/2942699807 >> [v2:172.21.15.29:6816/26968,v1:172.21.15.29:6817/26968] conn(0x7f07a806bd90 msgr2=0x7f07a806e1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.485+0000 7f07d7000640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.29:6816/26968,v1:172.21.15.29:6817/26968] conn(0x7f07a806bd90 0x7f07a806e1d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.485+0000 7f07d7000640 1 -- 172.21.15.29:0/2942699807 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f07a8065a90 msgr2=0x7f07a8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.485+0000 7f07d7000640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f07a8065a90 0x7f07a8067f50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f07b80ad000 tx=0x7f07b8008040 comp rx=0 tx=0).stop 2024-01-24T13:07:19.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.485+0000 7f07d7000640 1 -- 172.21.15.29:0/2942699807 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07d00b0600 msgr2=0x7f07d00ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.485+0000 7f07d7000640 1 --2- 172.21.15.29:0/2942699807 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07d00b0600 0x7f07d00ab8e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f07c000d800 tx=0x7f07c000dcc0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.485+0000 7f07d5000640 1 -- 172.21.15.29:0/2942699807 reap_dead start 2024-01-24T13:07:19.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.485+0000 7f07d7000640 1 -- 172.21.15.29:0/2942699807 shutdown_connections 2024-01-24T13:07:19.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.485+0000 7f07d7000640 1 -- 172.21.15.29:0/2942699807 >> 172.21.15.29:0/2942699807 conn(0x7f07d006a0d0 msgr2=0x7f07d00ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:19.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.485+0000 7f07d7000640 1 -- 172.21.15.29:0/2942699807 shutdown_connections 2024-01-24T13:07:19.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.485+0000 7f07d7000640 1 -- 172.21.15.29:0/2942699807 wait complete. 2024-01-24T13:07:19.507 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-24T13:07:19.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.645+0000 7f3fe8c00640 1 Processor -- start 2024-01-24T13:07:19.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.645+0000 7f3fe8c00640 1 -- start start 2024-01-24T13:07:19.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.645+0000 7f3fe8c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3fe40cd540 0x7f3fe415b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.649+0000 7f3fe8c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe415e920 con 0x7f3fe415b8b0 2024-01-24T13:07:19.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.649+0000 7f3fe8c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe415ec00 con 0x7f3fe40cd160 2024-01-24T13:07:19.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.649+0000 7f3fe8c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe415eee0 con 0x7f3fe40cd540 2024-01-24T13:07:19.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.649+0000 7f3fe1400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3fe40cd540 0x7f3fe415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.649+0000 7f3fe2800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3fe415b8b0 0x7f3fe40cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55490/0 (socket says 172.21.15.29:55490) 2024-01-24T13:07:19.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.649+0000 7f3fe2800640 1 -- 172.21.15.29:0/3953154995 learned_addr learned my addr 172.21.15.29:0/3953154995 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:19.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.649+0000 7f3fe1400640 1 -- 172.21.15.29:0/3953154995 >> v1:172.21.15.163:6789/0 conn(0x7f3fe40cd160 legacy=0x7f3fe415e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.649+0000 7f3fe1400640 1 -- 172.21.15.29:0/3953154995 >> v1:172.21.15.29:6789/0 conn(0x7f3fe415b8b0 legacy=0x7f3fe40cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.649+0000 7f3fe1400640 1 -- 172.21.15.29:0/3953154995 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe415ae50 con 0x7f3fe40cd540 2024-01-24T13:07:19.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.649+0000 7f3fe1400640 1 --2- 172.21.15.29:0/3953154995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fe40cd540 0x7f3fe415b370 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40097c0 tx=0x7f3fd401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6969ff13b6546bb server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:19.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.649+0000 7f3fe0a00640 1 -- 172.21.15.29:0/3953154995 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd40ac620 con 0x7f3fe40cd540 2024-01-24T13:07:19.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.649+0000 7f3fe0a00640 1 -- 172.21.15.29:0/3953154995 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd40ac780 con 0x7f3fe40cd540 2024-01-24T13:07:19.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.649+0000 7f3fe0a00640 1 -- 172.21.15.29:0/3953154995 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd40acb10 con 0x7f3fe40cd540 2024-01-24T13:07:19.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 -- 172.21.15.29:0/3953154995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fe40cd540 msgr2=0x7f3fe415b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 --2- 172.21.15.29:0/3953154995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fe40cd540 0x7f3fe415b370 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40097c0 tx=0x7f3fd401c480 comp rx=0 tx=0).stop 2024-01-24T13:07:19.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 -- 172.21.15.29:0/3953154995 shutdown_connections 2024-01-24T13:07:19.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 --2- 172.21.15.29:0/3953154995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fe40cd540 0x7f3fe415b370 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 -- 172.21.15.29:0/3953154995 >> 172.21.15.29:0/3953154995 conn(0x7f3fe4069cd0 msgr2=0x7f3fe406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:19.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 -- 172.21.15.29:0/3953154995 shutdown_connections 2024-01-24T13:07:19.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 -- 172.21.15.29:0/3953154995 wait complete. 2024-01-24T13:07:19.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 Processor -- start 2024-01-24T13:07:19.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 -- start start 2024-01-24T13:07:19.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fe40cd160 0x7f3fe414eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fe40cd540 0x7f3fe414d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fe414dec0 0x7f3fe41f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40b58d0 con 0x7f3fe40cd540 2024-01-24T13:07:19.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40b4d00 con 0x7f3fe414dec0 2024-01-24T13:07:19.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe8c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40b4fa0 con 0x7f3fe40cd160 2024-01-24T13:07:19.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe1400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fe40cd540 0x7f3fe414d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe1400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fe40cd540 0x7f3fe414d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47162/0 (socket says 172.21.15.29:47162) 2024-01-24T13:07:19.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe1400640 1 -- 172.21.15.29:0/751190075 learned_addr learned my addr 172.21.15.29:0/751190075 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:19.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe2800640 1 --2- 172.21.15.29:0/751190075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fe414dec0 0x7f3fe41f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.653+0000 7f3fe1e00640 1 --2- 172.21.15.29:0/751190075 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fe40cd160 0x7f3fe414eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fe1400640 1 -- 172.21.15.29:0/751190075 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fe40cd160 msgr2=0x7f3fe414eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fe1400640 1 --2- 172.21.15.29:0/751190075 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fe40cd160 0x7f3fe414eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fe1400640 1 -- 172.21.15.29:0/751190075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fe414dec0 msgr2=0x7f3fe41f67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fe1400640 1 --2- 172.21.15.29:0/751190075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fe414dec0 0x7f3fe41f67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fe1400640 1 -- 172.21.15.29:0/751190075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd4009420 con 0x7f3fe40cd540 2024-01-24T13:07:19.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fe1400640 1 --2- 172.21.15.29:0/751190075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fe40cd540 0x7f3fe414d980 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40af040 tx=0x7f3fd4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:19.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fda000640 1 -- 172.21.15.29:0/751190075 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd40b5610 con 0x7f3fe40cd540 2024-01-24T13:07:19.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fda000640 1 -- 172.21.15.29:0/751190075 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd40b5790 con 0x7f3fe40cd540 2024-01-24T13:07:19.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fda000640 1 -- 172.21.15.29:0/751190075 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd40b5b40 con 0x7f3fe40cd540 2024-01-24T13:07:19.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fe8c00640 1 -- 172.21.15.29:0/751190075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe40b5280 con 0x7f3fe40cd540 2024-01-24T13:07:19.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fe8c00640 1 -- 172.21.15.29:0/751190075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe414eff0 con 0x7f3fe40cd540 2024-01-24T13:07:19.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fe8c00640 1 -- 172.21.15.29:0/751190075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe414f1e0 con 0x7f3fe40cd540 2024-01-24T13:07:19.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fda000640 1 -- 172.21.15.29:0/751190075 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3fd40b3040 con 0x7f3fe40cd540 2024-01-24T13:07:19.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fda000640 1 --2- 172.21.15.29:0/751190075 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3fbc065a90 0x7f3fbc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.657+0000 7f3fda000640 1 -- 172.21.15.29:0/751190075 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3fd411d1e0 con 0x7f3fe40cd540 2024-01-24T13:07:19.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.661+0000 7f3fe1e00640 1 --2- 172.21.15.29:0/751190075 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3fbc065a90 0x7f3fbc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.661+0000 7f3fe1e00640 1 --2- 172.21.15.29:0/751190075 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3fbc065a90 0x7f3fbc067f50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc000f70 tx=0x7f3fcc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:19.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.661+0000 7f3fda000640 1 -- 172.21.15.29:0/751190075 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3fe414f1e0 con 0x7f3fe40cd540 2024-01-24T13:07:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.817+0000 7f3fe8c00640 1 -- 172.21.15.29:0/751190075 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fe414f1e0 con 0x7f3fbc065a90 2024-01-24T13:07:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.817+0000 7f3fda000640 1 -- 172.21.15.29:0/751190075 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3fe414f1e0 con 0x7f3fbc065a90 2024-01-24T13:07:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 2 to deep-scrub 2024-01-24T13:07:19.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.825+0000 7f3fe8c00640 1 -- 172.21.15.29:0/751190075 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3fbc065a90 msgr2=0x7f3fbc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.825+0000 7f3fe8c00640 1 --2- 172.21.15.29:0/751190075 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3fbc065a90 0x7f3fbc067f50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc000f70 tx=0x7f3fcc009040 comp rx=0 tx=0).stop 2024-01-24T13:07:19.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.825+0000 7f3fe8c00640 1 -- 172.21.15.29:0/751190075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fe40cd540 msgr2=0x7f3fe414d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.825+0000 7f3fe8c00640 1 --2- 172.21.15.29:0/751190075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fe40cd540 0x7f3fe414d980 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40af040 tx=0x7f3fd4019220 comp rx=0 tx=0).stop 2024-01-24T13:07:19.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.825+0000 7f3fe8c00640 1 -- 172.21.15.29:0/751190075 shutdown_connections 2024-01-24T13:07:19.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.825+0000 7f3fe8c00640 1 --2- 172.21.15.29:0/751190075 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3fbc065a90 0x7f3fbc067f50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.825+0000 7f3fe8c00640 1 --2- 172.21.15.29:0/751190075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3fe414dec0 0x7f3fe41f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.825+0000 7f3fe8c00640 1 --2- 172.21.15.29:0/751190075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fe40cd540 0x7f3fe414d980 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.825+0000 7f3fe8c00640 1 --2- 172.21.15.29:0/751190075 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3fe40cd160 0x7f3fe414eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.825+0000 7f3fe8c00640 1 -- 172.21.15.29:0/751190075 >> 172.21.15.29:0/751190075 conn(0x7f3fe4069cd0 msgr2=0x7f3fe40d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:19.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.825+0000 7f3fe8c00640 1 -- 172.21.15.29:0/751190075 shutdown_connections 2024-01-24T13:07:19.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.825+0000 7f3fe8c00640 1 -- 172.21.15.29:0/751190075 wait complete. 2024-01-24T13:07:19.846 INFO:tasks.ceph:Scrubbing osd.3 2024-01-24T13:07:19.846 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-24T13:07:19.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd161c00640 1 Processor -- start 2024-01-24T13:07:19.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd161c00640 1 -- start start 2024-01-24T13:07:19.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd161c00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd15c0ca0f0 0x7fd15c0b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd161c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd15c15d900 0x7fd15c070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:19.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd161c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15c15dd70 con 0x7fd15c0b0600 2024-01-24T13:07:19.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd161c00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15c0b0a90 con 0x7fd15c0ca0f0 2024-01-24T13:07:19.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd161c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c0cba90 con 0x7fd15c15d900 2024-01-24T13:07:19.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd15aa00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd15c0ca0f0 0x7fd15c0b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd15a000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd15c0b0600 0x7fd15c15d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55506/0 (socket says 172.21.15.29:55506) 2024-01-24T13:07:19.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd15a000640 1 -- 172.21.15.29:0/1526764740 learned_addr learned my addr 172.21.15.29:0/1526764740 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:19.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd15b400640 1 --2- 172.21.15.29:0/1526764740 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd15c15d900 0x7fd15c070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:19.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd15aa00640 1 -- 172.21.15.29:0/1526764740 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd15c15d900 msgr2=0x7fd15c070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:19.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd15aa00640 1 --2- 172.21.15.29:0/1526764740 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd15c15d900 0x7fd15c070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd15aa00640 1 -- 172.21.15.29:0/1526764740 >> v1:172.21.15.29:6789/0 conn(0x7fd15c0b0600 legacy=0x7fd15c15d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd15aa00640 1 -- 172.21.15.29:0/1526764740 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c0cacd0 con 0x7fd15c0ca0f0 2024-01-24T13:07:19.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd159600640 1 -- 172.21.15.29:0/1526764740 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313190185 0 0) 0x7fd15c15dd70 con 0x7fd15c0b0600 2024-01-24T13:07:19.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd15b400640 1 --2- 172.21.15.29:0/1526764740 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd15c15d900 0x7fd15c070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:19.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.989+0000 7fd15aa00640 1 --2- 172.21.15.29:0/1526764740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd15c0ca0f0 0x7fd15c0b00c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0097f0 tx=0x7fd14c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6257fe6ef4a3c48f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:19.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd159600640 1 -- 172.21.15.29:0/1526764740 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0ab600 con 0x7fd15c0ca0f0 2024-01-24T13:07:19.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd159600640 1 -- 172.21.15.29:0/1526764740 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c0a7050 con 0x7fd15c0ca0f0 2024-01-24T13:07:19.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd159600640 1 -- 172.21.15.29:0/1526764740 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0ab980 con 0x7fd15c0ca0f0 2024-01-24T13:07:19.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 -- 172.21.15.29:0/1526764740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd15c0ca0f0 msgr2=0x7fd15c0b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:19.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 --2- 172.21.15.29:0/1526764740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd15c0ca0f0 0x7fd15c0b00c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0097f0 tx=0x7fd14c01c3f0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 -- 172.21.15.29:0/1526764740 shutdown_connections 2024-01-24T13:07:19.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 --2- 172.21.15.29:0/1526764740 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd15c15d900 0x7fd15c070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 --2- 172.21.15.29:0/1526764740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd15c0ca0f0 0x7fd15c0b00c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:19.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 -- 172.21.15.29:0/1526764740 >> 172.21.15.29:0/1526764740 conn(0x7fd15c06a0d0 msgr2=0x7fd15c06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:19.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 -- 172.21.15.29:0/1526764740 shutdown_connections 2024-01-24T13:07:19.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 -- 172.21.15.29:0/1526764740 wait complete. 2024-01-24T13:07:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 Processor -- start 2024-01-24T13:07:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 -- start start 2024-01-24T13:07:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd15c0b0600 0x7fd15c156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd15c0ca0f0 0x7fd15c0c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd15c15d900 0x7fd15c0adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c156ac0 con 0x7fd15c0b0600 2024-01-24T13:07:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c0c2650 con 0x7fd15c15d900 2024-01-24T13:07:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.993+0000 7fd161c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c0c2930 con 0x7fd15c0ca0f0 2024-01-24T13:07:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd15aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd15c0b0600 0x7fd15c156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd15aa00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd15c0b0600 0x7fd15c156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47188/0 (socket says 172.21.15.29:47188) 2024-01-24T13:07:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd15aa00640 1 -- 172.21.15.29:0/1610793558 learned_addr learned my addr 172.21.15.29:0/1610793558 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd15b400640 1 --2- 172.21.15.29:0/1610793558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd15c15d900 0x7fd15c0adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd15a000640 1 --2- 172.21.15.29:0/1610793558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd15c0ca0f0 0x7fd15c0c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd15aa00640 1 -- 172.21.15.29:0/1610793558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd15c0ca0f0 msgr2=0x7fd15c0c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd15aa00640 1 --2- 172.21.15.29:0/1610793558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd15c0ca0f0 0x7fd15c0c1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd15aa00640 1 -- 172.21.15.29:0/1610793558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd15c15d900 msgr2=0x7fd15c0adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd15aa00640 1 --2- 172.21.15.29:0/1610793558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd15c15d900 0x7fd15c0adc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd15aa00640 1 -- 172.21.15.29:0/1610793558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c009420 con 0x7fd15c0b0600 2024-01-24T13:07:20.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd15aa00640 1 --2- 172.21.15.29:0/1610793558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd15c0b0600 0x7fd15c156580 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd14c01a020 tx=0x7fd14c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:20.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd152a00640 1 -- 172.21.15.29:0/1610793558 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0b7650 con 0x7fd15c0b0600 2024-01-24T13:07:20.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd152a00640 1 -- 172.21.15.29:0/1610793558 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c0b77d0 con 0x7fd15c0b0600 2024-01-24T13:07:20.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd152a00640 1 -- 172.21.15.29:0/1610793558 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0b7b80 con 0x7fd15c0b0600 2024-01-24T13:07:20.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd161c00640 1 -- 172.21.15.29:0/1610793558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15c0c2c10 con 0x7fd15c0b0600 2024-01-24T13:07:20.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd161c00640 1 -- 172.21.15.29:0/1610793558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15c0b20f0 con 0x7fd15c0b0600 2024-01-24T13:07:20.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd161c00640 1 -- 172.21.15.29:0/1610793558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd15c0ca9e0 con 0x7fd15c0b0600 2024-01-24T13:07:20.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:19.997+0000 7fd152a00640 1 -- 172.21.15.29:0/1610793558 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd14c0b7ce0 con 0x7fd15c0b0600 2024-01-24T13:07:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.001+0000 7fd152a00640 1 --2- 172.21.15.29:0/1610793558 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd134065a60 0x7fd134067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.001+0000 7fd152a00640 1 -- 172.21.15.29:0/1610793558 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd14c11d8b0 con 0x7fd15c0b0600 2024-01-24T13:07:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.001+0000 7fd152a00640 1 --2- 172.21.15.29:0/1610793558 >> [v2:172.21.15.29:6800/26967,v1:172.21.15.29:6801/26967] conn(0x7fd13406bd60 0x7fd13406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.001+0000 7fd152a00640 1 -- 172.21.15.29:0/1610793558 --> [v2:172.21.15.29:6800/26967,v1:172.21.15.29:6801/26967] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd13406e870 con 0x7fd13406bd60 2024-01-24T13:07:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.001+0000 7fd152a00640 1 -- 172.21.15.29:0/1610793558 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd14c1222a0 con 0x7fd15c0b0600 2024-01-24T13:07:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.001+0000 7fd15a000640 1 --2- 172.21.15.29:0/1610793558 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd134065a60 0x7fd134067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.001+0000 7fd15b400640 1 --2- 172.21.15.29:0/1610793558 >> [v2:172.21.15.29:6800/26967,v1:172.21.15.29:6801/26967] conn(0x7fd13406bd60 0x7fd13406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.001+0000 7fd15a000640 1 --2- 172.21.15.29:0/1610793558 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd134065a60 0x7fd134067f20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0c2ef0 tx=0x7fd144007d60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.001+0000 7fd15b400640 1 --2- 172.21.15.29:0/1610793558 >> [v2:172.21.15.29:6800/26967,v1:172.21.15.29:6801/26967] conn(0x7fd13406bd60 0x7fd13406e1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.001+0000 7fd152a00640 1 -- 172.21.15.29:0/1610793558 <== osd.3 v2:172.21.15.29:6800/26967 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd13406e870 con 0x7fd13406bd60 2024-01-24T13:07:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.017+0000 7fd161c00640 1 -- 172.21.15.29:0/1610793558 --> [v2:172.21.15.29:6800/26967,v1:172.21.15.29:6801/26967] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd15c0cb570 con 0x7fd13406bd60 2024-01-24T13:07:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.017+0000 7fd152a00640 1 -- 172.21.15.29:0/1610793558 <== osd.3 v2:172.21.15.29:6800/26967 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd15400f040 con 0x7fd13406bd60 2024-01-24T13:07:20.018 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:07:20.019 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T13:07:20.019 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:07:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.017+0000 7fd161c00640 1 -- 172.21.15.29:0/1610793558 >> [v2:172.21.15.29:6800/26967,v1:172.21.15.29:6801/26967] conn(0x7fd13406bd60 msgr2=0x7fd13406e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.017+0000 7fd161c00640 1 --2- 172.21.15.29:0/1610793558 >> [v2:172.21.15.29:6800/26967,v1:172.21.15.29:6801/26967] conn(0x7fd13406bd60 0x7fd13406e1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.017+0000 7fd161c00640 1 -- 172.21.15.29:0/1610793558 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd134065a60 msgr2=0x7fd134067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.017+0000 7fd161c00640 1 --2- 172.21.15.29:0/1610793558 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd134065a60 0x7fd134067f20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0c2ef0 tx=0x7fd144007d60 comp rx=0 tx=0).stop 2024-01-24T13:07:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.017+0000 7fd161c00640 1 -- 172.21.15.29:0/1610793558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd15c0b0600 msgr2=0x7fd15c156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.017+0000 7fd161c00640 1 --2- 172.21.15.29:0/1610793558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd15c0b0600 0x7fd15c156580 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd14c01a020 tx=0x7fd14c01ac30 comp rx=0 tx=0).stop 2024-01-24T13:07:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.017+0000 7fd15b400640 1 -- 172.21.15.29:0/1610793558 reap_dead start 2024-01-24T13:07:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.017+0000 7fd161c00640 1 -- 172.21.15.29:0/1610793558 shutdown_connections 2024-01-24T13:07:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.017+0000 7fd161c00640 1 -- 172.21.15.29:0/1610793558 >> 172.21.15.29:0/1610793558 conn(0x7fd15c06a0d0 msgr2=0x7fd15c0cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.017+0000 7fd161c00640 1 -- 172.21.15.29:0/1610793558 shutdown_connections 2024-01-24T13:07:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.017+0000 7fd161c00640 1 -- 172.21.15.29:0/1610793558 wait complete. 2024-01-24T13:07:20.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-24T13:07:20.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f699d000640 1 Processor -- start 2024-01-24T13:07:20.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f699d000640 1 -- start start 2024-01-24T13:07:20.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f699d000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f69980cb250 0x7f699815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f699d000640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699815e220 con 0x7f69980702d0 2024-01-24T13:07:20.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f699d000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69980cb630 con 0x7f699815aab0 2024-01-24T13:07:20.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f699d000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699815b570 con 0x7f69980cb250 2024-01-24T13:07:20.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6996800640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f69980702d0 0x7f69980c87e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55510/0 (socket says 172.21.15.29:55510) 2024-01-24T13:07:20.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6996800640 1 -- 172.21.15.29:0/2124320193 learned_addr learned my addr 172.21.15.29:0/2124320193 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 -- 172.21.15.29:0/2124320193 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821754774 0 0) 0x7f699815e220 con 0x7f69980702d0 2024-01-24T13:07:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 -- 172.21.15.29:0/2124320193 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6978003530 con 0x7f69980702d0 2024-01-24T13:07:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6995e00640 1 --2- 172.21.15.29:0/2124320193 >> v2:172.21.15.163:3300/0 conn(0x7f69980cb250 0x7f699815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 -- 172.21.15.29:0/2124320193 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1052426806 0 0) 0x7f6978003530 con 0x7f69980702d0 2024-01-24T13:07:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 -- 172.21.15.29:0/2124320193 >> v2:172.21.15.163:3300/0 conn(0x7f69980cb250 msgr2=0x7f699815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 --2- 172.21.15.29:0/2124320193 >> v2:172.21.15.163:3300/0 conn(0x7f69980cb250 0x7f699815ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 -- 172.21.15.29:0/2124320193 >> v1:172.21.15.163:6789/0 conn(0x7f699815aab0 legacy=0x7f699806fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 -- 172.21.15.29:0/2124320193 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699815b850 con 0x7f69980702d0 2024-01-24T13:07:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 -- 172.21.15.29:0/2124320193 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7f6990001a00 con 0x7f69980702d0 2024-01-24T13:07:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 -- 172.21.15.29:0/2124320193 >> v1:172.21.15.29:6789/0 conn(0x7f69980702d0 legacy=0x7f69980c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 --2- 172.21.15.29:0/2124320193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6978003980 0x7f6978003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 --2- 172.21.15.29:0/2124320193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69780047d0 0x7f6978004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 --2- 172.21.15.29:0/2124320193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6978005190 0x7f697800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 -- 172.21.15.29:0/2124320193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699815b570 con 0x7f6978005190 2024-01-24T13:07:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 -- 172.21.15.29:0/2124320193 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697800c030 con 0x7f69780047d0 2024-01-24T13:07:20.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6994a00640 1 -- 172.21.15.29:0/2124320193 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697800c1f0 con 0x7f6978003980 2024-01-24T13:07:20.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6996800640 1 --2- 172.21.15.29:0/2124320193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6978005190 0x7f697800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6995e00640 1 --2- 172.21.15.29:0/2124320193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6978003980 0x7f6978003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.181+0000 7f6995400640 1 --2- 172.21.15.29:0/2124320193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69780047d0 0x7f6978004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.185+0000 7f6996800640 1 -- 172.21.15.29:0/2124320193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6978003980 msgr2=0x7f6978003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:20.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.185+0000 7f6996800640 1 --2- 172.21.15.29:0/2124320193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6978003980 0x7f6978003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.185+0000 7f6996800640 1 -- 172.21.15.29:0/2124320193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69780047d0 msgr2=0x7f6978004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:20.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.185+0000 7f6996800640 1 --2- 172.21.15.29:0/2124320193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69780047d0 0x7f6978004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.185+0000 7f6996800640 1 -- 172.21.15.29:0/2124320193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6978003530 con 0x7f6978005190 2024-01-24T13:07:20.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.185+0000 7f6996800640 1 -- 172.21.15.29:0/2124320193 reap_dead start 2024-01-24T13:07:20.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.185+0000 7f6996800640 1 --2- 172.21.15.29:0/2124320193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6978005190 0x7f697800b990 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f699000a830 tx=0x7f699001d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6839b8632a0ba8c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:20.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.185+0000 7f6994a00640 1 -- 172.21.15.29:0/2124320193 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69900072d0 con 0x7f6978005190 2024-01-24T13:07:20.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.185+0000 7f6994a00640 1 -- 172.21.15.29:0/2124320193 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69900a8070 con 0x7f6978005190 2024-01-24T13:07:20.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.185+0000 7f6994a00640 1 -- 172.21.15.29:0/2124320193 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69900076b0 con 0x7f6978005190 2024-01-24T13:07:20.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.185+0000 7f699d000640 1 -- 172.21.15.29:0/2124320193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6978005190 msgr2=0x7f697800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.185+0000 7f699d000640 1 --2- 172.21.15.29:0/2124320193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6978005190 0x7f697800b990 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f699000a830 tx=0x7f699001d340 comp rx=0 tx=0).stop 2024-01-24T13:07:20.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f699d000640 1 -- 172.21.15.29:0/2124320193 shutdown_connections 2024-01-24T13:07:20.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f699d000640 1 --2- 172.21.15.29:0/2124320193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6978005190 0x7f697800b990 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f699d000640 1 -- 172.21.15.29:0/2124320193 >> 172.21.15.29:0/2124320193 conn(0x7f699806a2d0 msgr2=0x7f69980afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:20.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f699d000640 1 -- 172.21.15.29:0/2124320193 shutdown_connections 2024-01-24T13:07:20.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f699d000640 1 -- 172.21.15.29:0/2124320193 wait complete. 2024-01-24T13:07:20.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f699d000640 1 Processor -- start 2024-01-24T13:07:20.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f699d000640 1 -- start start 2024-01-24T13:07:20.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f699d000640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6978005190 0x7f69981540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f699d000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69980b37c0 0x7f69980b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f699d000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699814d610 0x7f69980c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f699d000640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699814e0c0 con 0x7f699814d610 2024-01-24T13:07:20.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f699d000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6998153000 con 0x7f69980b37c0 2024-01-24T13:07:20.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f699d000640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69981532e0 con 0x7f6978005190 2024-01-24T13:07:20.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f6996800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699814d610 0x7f69980c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f6996800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699814d610 0x7f69980c3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47214/0 (socket says 172.21.15.29:47214) 2024-01-24T13:07:20.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f6995e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6978005190 0x7f69981540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f6996800640 1 -- 172.21.15.29:0/2788949167 learned_addr learned my addr 172.21.15.29:0/2788949167 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:20.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f6995400640 1 --2- 172.21.15.29:0/2788949167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69980b37c0 0x7f69980b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f6996800640 1 -- 172.21.15.29:0/2788949167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6978005190 msgr2=0x7f69981540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f6996800640 1 --2- 172.21.15.29:0/2788949167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6978005190 0x7f69981540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f6996800640 1 -- 172.21.15.29:0/2788949167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69980b37c0 msgr2=0x7f69980b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f6996800640 1 --2- 172.21.15.29:0/2788949167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69980b37c0 0x7f69980b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.189+0000 7f6996800640 1 -- 172.21.15.29:0/2788949167 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69981535c0 con 0x7f699814d610 2024-01-24T13:07:20.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.193+0000 7f6996800640 1 --2- 172.21.15.29:0/2788949167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699814d610 0x7f69980c3e50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6990007040 tx=0x7f6978005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:20.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.193+0000 7f698e000640 1 -- 172.21.15.29:0/2788949167 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69900019c0 con 0x7f699814d610 2024-01-24T13:07:20.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.193+0000 7f698e000640 1 -- 172.21.15.29:0/2788949167 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6990001be0 con 0x7f699814d610 2024-01-24T13:07:20.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.193+0000 7f699d000640 1 -- 172.21.15.29:0/2788949167 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69981538a0 con 0x7f699814d610 2024-01-24T13:07:20.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.193+0000 7f698e000640 1 -- 172.21.15.29:0/2788949167 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990007690 con 0x7f699814d610 2024-01-24T13:07:20.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.193+0000 7f699d000640 1 -- 172.21.15.29:0/2788949167 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699814da90 con 0x7f699814d610 2024-01-24T13:07:20.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.193+0000 7f699d000640 1 -- 172.21.15.29:0/2788949167 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f699804e850 con 0x7f699814d610 2024-01-24T13:07:20.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.193+0000 7f698e000640 1 -- 172.21.15.29:0/2788949167 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f69900aa070 con 0x7f699814d610 2024-01-24T13:07:20.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.193+0000 7f698e000640 1 --2- 172.21.15.29:0/2788949167 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6970065a60 0x7f6970067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.193+0000 7f698e000640 1 -- 172.21.15.29:0/2788949167 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f699011c6c0 con 0x7f699814d610 2024-01-24T13:07:20.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.197+0000 7f6995e00640 1 --2- 172.21.15.29:0/2788949167 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6970065a60 0x7f6970067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.197+0000 7f6995e00640 1 --2- 172.21.15.29:0/2788949167 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6970065a60 0x7f6970067f20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f69980b32b0 tx=0x7f6988006f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:20.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.197+0000 7f698e000640 1 -- 172.21.15.29:0/2788949167 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f69900ea2e0 con 0x7f699814d610 2024-01-24T13:07:20.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.357+0000 7f699d000640 1 -- 172.21.15.29:0/2788949167 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f699815e4e0 con 0x7f6970065a60 2024-01-24T13:07:20.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.361+0000 7f698e000640 1 -- 172.21.15.29:0/2788949167 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6988014b20 con 0x7f6970065a60 2024-01-24T13:07:20.360 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 3 to deep-scrub 2024-01-24T13:07:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.361+0000 7f699d000640 1 -- 172.21.15.29:0/2788949167 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6970065a60 msgr2=0x7f6970067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.361+0000 7f699d000640 1 --2- 172.21.15.29:0/2788949167 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6970065a60 0x7f6970067f20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f69980b32b0 tx=0x7f6988006f90 comp rx=0 tx=0).stop 2024-01-24T13:07:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.361+0000 7f699d000640 1 -- 172.21.15.29:0/2788949167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699814d610 msgr2=0x7f69980c3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.361+0000 7f699d000640 1 --2- 172.21.15.29:0/2788949167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699814d610 0x7f69980c3e50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6990007040 tx=0x7f6978005800 comp rx=0 tx=0).stop 2024-01-24T13:07:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.361+0000 7f699d000640 1 -- 172.21.15.29:0/2788949167 shutdown_connections 2024-01-24T13:07:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.361+0000 7f699d000640 1 --2- 172.21.15.29:0/2788949167 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6970065a60 0x7f6970067f20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.361+0000 7f699d000640 1 --2- 172.21.15.29:0/2788949167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699814d610 0x7f69980c3e50 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.361+0000 7f699d000640 1 --2- 172.21.15.29:0/2788949167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69980b37c0 0x7f69980b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.361+0000 7f699d000640 1 --2- 172.21.15.29:0/2788949167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6978005190 0x7f69981540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.361+0000 7f699d000640 1 -- 172.21.15.29:0/2788949167 >> 172.21.15.29:0/2788949167 conn(0x7f699806a2d0 msgr2=0x7f699815c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.361+0000 7f699d000640 1 -- 172.21.15.29:0/2788949167 shutdown_connections 2024-01-24T13:07:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.361+0000 7f699d000640 1 -- 172.21.15.29:0/2788949167 wait complete. 2024-01-24T13:07:20.382 INFO:tasks.ceph:Scrubbing osd.4 2024-01-24T13:07:20.382 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-24T13:07:20.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.525+0000 7f73b1a00640 1 Processor -- start 2024-01-24T13:07:20.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.525+0000 7f73b1a00640 1 -- start start 2024-01-24T13:07:20.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.529+0000 7f73b1a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f73ac0714b0 0x7f73ac15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.529+0000 7f73b1a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ac070910 con 0x7f73ac1532d0 2024-01-24T13:07:20.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.529+0000 7f73b1a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ac1536b0 con 0x7f73ac15c7f0 2024-01-24T13:07:20.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.529+0000 7f73b1a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ac15d2b0 con 0x7f73ac0714b0 2024-01-24T13:07:20.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.529+0000 7f73aaa00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f73ac1532d0 0x7f73ac0c8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55518/0 (socket says 172.21.15.29:55518) 2024-01-24T13:07:20.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.529+0000 7f73aaa00640 1 -- 172.21.15.29:0/1542971466 learned_addr learned my addr 172.21.15.29:0/1542971466 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:20.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.529+0000 7f73ab400640 1 --2- 172.21.15.29:0/1542971466 >> v2:172.21.15.29:3300/0 conn(0x7f73ac0714b0 0x7f73ac15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.529+0000 7f73ab400640 1 -- 172.21.15.29:0/1542971466 >> v1:172.21.15.163:6789/0 conn(0x7f73ac15c7f0 legacy=0x7f73ac070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.529+0000 7f73ab400640 1 -- 172.21.15.29:0/1542971466 >> v1:172.21.15.29:6789/0 conn(0x7f73ac1532d0 legacy=0x7f73ac0c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.529+0000 7f73ab400640 1 -- 172.21.15.29:0/1542971466 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ac15d590 con 0x7f73ac0714b0 2024-01-24T13:07:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.529+0000 7f73a9600640 1 -- 172.21.15.29:0/1542971466 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110188767 0 0) 0x7f73ac070910 con 0x7f73ac1532d0 2024-01-24T13:07:20.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.529+0000 7f73ab400640 1 --2- 172.21.15.29:0/1542971466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73ac0714b0 0x7f73ac15cc70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f73a4009d90 tx=0x7f73a401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef1e543fa40e2b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73a9600640 1 -- 172.21.15.29:0/1542971466 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a40a5960 con 0x7f73ac0714b0 2024-01-24T13:07:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73a9600640 1 -- 172.21.15.29:0/1542971466 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a40a5ac0 con 0x7f73ac0714b0 2024-01-24T13:07:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73a9600640 1 -- 172.21.15.29:0/1542971466 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a40a5e50 con 0x7f73ac0714b0 2024-01-24T13:07:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73b1a00640 1 -- 172.21.15.29:0/1542971466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73ac0714b0 msgr2=0x7f73ac15cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73b1a00640 1 --2- 172.21.15.29:0/1542971466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73ac0714b0 0x7f73ac15cc70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f73a4009d90 tx=0x7f73a401c920 comp rx=0 tx=0).stop 2024-01-24T13:07:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73b1a00640 1 -- 172.21.15.29:0/1542971466 shutdown_connections 2024-01-24T13:07:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73b1a00640 1 --2- 172.21.15.29:0/1542971466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73ac0714b0 0x7f73ac15cc70 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73b1a00640 1 -- 172.21.15.29:0/1542971466 >> 172.21.15.29:0/1542971466 conn(0x7f73ac06a0d0 msgr2=0x7f73ac06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:20.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73b1a00640 1 -- 172.21.15.29:0/1542971466 shutdown_connections 2024-01-24T13:07:20.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73b1a00640 1 -- 172.21.15.29:0/1542971466 wait complete. 2024-01-24T13:07:20.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73b1a00640 1 Processor -- start 2024-01-24T13:07:20.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73b1a00640 1 -- start start 2024-01-24T13:07:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73b1a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f73ac0714b0 0x7f73ac151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73b1a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73ac1532d0 0x7f73ac0c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.533+0000 7f73b1a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73ac15c7f0 0x7f73ac148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73b1a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac0c2c30 con 0x7f73ac1532d0 2024-01-24T13:07:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73b1a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac0c3a70 con 0x7f73ac15c7f0 2024-01-24T13:07:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73b1a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac0c2e60 con 0x7f73ac0714b0 2024-01-24T13:07:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73aa000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73ac1532d0 0x7f73ac0c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73aa000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73ac1532d0 0x7f73ac0c26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47234/0 (socket says 172.21.15.29:47234) 2024-01-24T13:07:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73aa000640 1 -- 172.21.15.29:0/3039624594 learned_addr learned my addr 172.21.15.29:0/3039624594 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73ab400640 1 --2- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73ac15c7f0 0x7f73ac148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73aaa00640 1 --2- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f73ac0714b0 0x7f73ac151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73aa000640 1 -- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f73ac0714b0 msgr2=0x7f73ac151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73aa000640 1 --2- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f73ac0714b0 0x7f73ac151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73aa000640 1 -- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73ac15c7f0 msgr2=0x7f73ac148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73aa000640 1 --2- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73ac15c7f0 0x7f73ac148770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73aa000640 1 -- 172.21.15.29:0/3039624594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a4009a70 con 0x7f73ac1532d0 2024-01-24T13:07:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73aa000640 1 --2- 172.21.15.29:0/3039624594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73ac1532d0 0x7f73ac0c26f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f739400c3c0 tx=0x7f739400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73a2a00640 1 -- 172.21.15.29:0/3039624594 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940052d0 con 0x7f73ac1532d0 2024-01-24T13:07:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73a2a00640 1 -- 172.21.15.29:0/3039624594 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7394005430 con 0x7f73ac1532d0 2024-01-24T13:07:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73a2a00640 1 -- 172.21.15.29:0/3039624594 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7394003840 con 0x7f73ac1532d0 2024-01-24T13:07:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73b1a00640 1 -- 172.21.15.29:0/3039624594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ac0c3140 con 0x7f73ac1532d0 2024-01-24T13:07:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73b1a00640 1 -- 172.21.15.29:0/3039624594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ac0c3700 con 0x7f73ac1532d0 2024-01-24T13:07:20.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73b1a00640 1 -- 172.21.15.29:0/3039624594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73ac070290 con 0x7f73ac1532d0 2024-01-24T13:07:20.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.537+0000 7f73a2a00640 1 -- 172.21.15.29:0/3039624594 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f73940039a0 con 0x7f73ac1532d0 2024-01-24T13:07:20.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.541+0000 7f73a2a00640 1 --2- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7384065a60 0x7f7384067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.541+0000 7f73a2a00640 1 -- 172.21.15.29:0/3039624594 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7394082510 con 0x7f73ac1532d0 2024-01-24T13:07:20.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.541+0000 7f73a2a00640 1 --2- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:6816/27228,v1:172.21.15.163:6817/27228] conn(0x7f738406bd60 0x7f738406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.541+0000 7f73a2a00640 1 -- 172.21.15.29:0/3039624594 --> [v2:172.21.15.163:6816/27228,v1:172.21.15.163:6817/27228] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f738406e870 con 0x7f738406bd60 2024-01-24T13:07:20.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.541+0000 7f73a2a00640 1 -- 172.21.15.29:0/3039624594 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7394084af0 con 0x7f73ac1532d0 2024-01-24T13:07:20.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.541+0000 7f73aaa00640 1 --2- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7384065a60 0x7f7384067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.541+0000 7f73ab400640 1 --2- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:6816/27228,v1:172.21.15.163:6817/27228] conn(0x7f738406bd60 0x7f738406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.541+0000 7f73aaa00640 1 --2- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7384065a60 0x7f7384067f20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f739c000f70 tx=0x7f739c007240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:20.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.541+0000 7f73ab400640 1 --2- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:6816/27228,v1:172.21.15.163:6817/27228] conn(0x7f738406bd60 0x7f738406e1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:20.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.541+0000 7f73a2a00640 1 -- 172.21.15.29:0/3039624594 <== osd.4 v2:172.21.15.163:6816/27228 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f738406e870 con 0x7f738406bd60 2024-01-24T13:07:20.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.553+0000 7f73b1a00640 1 -- 172.21.15.29:0/3039624594 --> [v2:172.21.15.163:6816/27228,v1:172.21.15.163:6817/27228] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f73ac04e000 con 0x7f738406bd60 2024-01-24T13:07:20.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.557+0000 7f73a2a00640 1 -- 172.21.15.29:0/3039624594 <== osd.4 v2:172.21.15.163:6816/27228 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f73ac04e000 con 0x7f738406bd60 2024-01-24T13:07:20.556 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:07:20.556 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T13:07:20.556 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:07:20.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.557+0000 7f73b1a00640 1 -- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:6816/27228,v1:172.21.15.163:6817/27228] conn(0x7f738406bd60 msgr2=0x7f738406e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.557+0000 7f73b1a00640 1 --2- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:6816/27228,v1:172.21.15.163:6817/27228] conn(0x7f738406bd60 0x7f738406e1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.557+0000 7f73b1a00640 1 -- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7384065a60 msgr2=0x7f7384067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.557+0000 7f73b1a00640 1 --2- 172.21.15.29:0/3039624594 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f7384065a60 0x7f7384067f20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f739c000f70 tx=0x7f739c007240 comp rx=0 tx=0).stop 2024-01-24T13:07:20.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.557+0000 7f73b1a00640 1 -- 172.21.15.29:0/3039624594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73ac1532d0 msgr2=0x7f73ac0c26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.557+0000 7f73b1a00640 1 --2- 172.21.15.29:0/3039624594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73ac1532d0 0x7f73ac0c26f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f739400c3c0 tx=0x7f739400c880 comp rx=0 tx=0).stop 2024-01-24T13:07:20.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.557+0000 7f73ab400640 1 -- 172.21.15.29:0/3039624594 reap_dead start 2024-01-24T13:07:20.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.557+0000 7f73b1a00640 1 -- 172.21.15.29:0/3039624594 shutdown_connections 2024-01-24T13:07:20.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.557+0000 7f73b1a00640 1 -- 172.21.15.29:0/3039624594 >> 172.21.15.29:0/3039624594 conn(0x7f73ac06a0d0 msgr2=0x7f73ac070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:20.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.557+0000 7f73b1a00640 1 -- 172.21.15.29:0/3039624594 shutdown_connections 2024-01-24T13:07:20.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.557+0000 7f73b1a00640 1 -- 172.21.15.29:0/3039624594 wait complete. 2024-01-24T13:07:20.575 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-24T13:07:20.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.717+0000 7fc95b400640 1 Processor -- start 2024-01-24T13:07:20.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.717+0000 7fc95b400640 1 -- start start 2024-01-24T13:07:20.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.717+0000 7fc95b400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc9540cd540 0x7fc95415b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.717+0000 7fc95b400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc95415b8b0 0x7fc9540cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.717+0000 7fc95b400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95415e920 con 0x7fc9540cd160 2024-01-24T13:07:20.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.717+0000 7fc95b400640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc95415ec00 con 0x7fc95415b8b0 2024-01-24T13:07:20.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.717+0000 7fc95b400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc95415eee0 con 0x7fc9540cd540 2024-01-24T13:07:20.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.717+0000 7fc959400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc95415b8b0 0x7fc9540cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.717+0000 7fc959400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc95415b8b0 0x7fc9540cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47248/0 (socket says 172.21.15.29:47248) 2024-01-24T13:07:20.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.717+0000 7fc959400640 1 -- 172.21.15.29:0/4020882585 learned_addr learned my addr 172.21.15.29:0/4020882585 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:20.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.717+0000 7fc953e00640 1 --2- 172.21.15.29:0/4020882585 >> v2:172.21.15.163:3300/0 conn(0x7fc9540cd540 0x7fc95415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.721+0000 7fc959400640 1 -- 172.21.15.29:0/4020882585 >> v2:172.21.15.163:3300/0 conn(0x7fc9540cd540 msgr2=0x7fc95415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:20.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.721+0000 7fc959400640 1 --2- 172.21.15.29:0/4020882585 >> v2:172.21.15.163:3300/0 conn(0x7fc9540cd540 0x7fc95415b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.721+0000 7fc959400640 1 -- 172.21.15.29:0/4020882585 >> v1:172.21.15.29:6789/0 conn(0x7fc9540cd160 legacy=0x7fc95415e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.721+0000 7fc953400640 1 -- 172.21.15.29:0/4020882585 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403238358 0 0) 0x7fc95415e920 con 0x7fc9540cd160 2024-01-24T13:07:20.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.721+0000 7fc959400640 1 -- 172.21.15.29:0/4020882585 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95415ae50 con 0x7fc95415b8b0 2024-01-24T13:07:20.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.721+0000 7fc959400640 1 --2- 172.21.15.29:0/4020882585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc95415b8b0 0x7fc9540cab00 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc9540d14e0 tx=0x7fc94c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1497b16b93a3a259 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:20.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.721+0000 7fc953400640 1 -- 172.21.15.29:0/4020882585 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c0a56c0 con 0x7fc95415b8b0 2024-01-24T13:07:20.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.721+0000 7fc953400640 1 -- 172.21.15.29:0/4020882585 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c0a5820 con 0x7fc95415b8b0 2024-01-24T13:07:20.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.721+0000 7fc953400640 1 -- 172.21.15.29:0/4020882585 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c0a5bb0 con 0x7fc95415b8b0 2024-01-24T13:07:20.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 -- 172.21.15.29:0/4020882585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc95415b8b0 msgr2=0x7fc9540cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 --2- 172.21.15.29:0/4020882585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc95415b8b0 0x7fc9540cab00 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc9540d14e0 tx=0x7fc94c01c9d0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 -- 172.21.15.29:0/4020882585 shutdown_connections 2024-01-24T13:07:20.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 --2- 172.21.15.29:0/4020882585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc95415b8b0 0x7fc9540cab00 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 --2- 172.21.15.29:0/4020882585 >> v2:172.21.15.163:3300/0 conn(0x7fc9540cd540 0x7fc95415b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 -- 172.21.15.29:0/4020882585 >> 172.21.15.29:0/4020882585 conn(0x7fc954069cd0 msgr2=0x7fc95406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:20.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 -- 172.21.15.29:0/4020882585 shutdown_connections 2024-01-24T13:07:20.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 -- 172.21.15.29:0/4020882585 wait complete. 2024-01-24T13:07:20.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 Processor -- start 2024-01-24T13:07:20.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 -- start start 2024-01-24T13:07:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9540cd160 0x7fc95414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9540cd540 0x7fc9540b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9540d0710 0x7fc9540d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540d10e0 con 0x7fc9540cd160 2024-01-24T13:07:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540c9c90 con 0x7fc9540d0710 2024-01-24T13:07:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc95b400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540c7580 con 0x7fc9540cd540 2024-01-24T13:07:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc958a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9540cd160 0x7fc95414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc953e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9540cd540 0x7fc9540b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc958a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9540cd160 0x7fc95414fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47252/0 (socket says 172.21.15.29:47252) 2024-01-24T13:07:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc958a00640 1 -- 172.21.15.29:0/3942059576 learned_addr learned my addr 172.21.15.29:0/3942059576 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.725+0000 7fc959400640 1 --2- 172.21.15.29:0/3942059576 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9540d0710 0x7fc9540d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc953e00640 1 -- 172.21.15.29:0/3942059576 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9540d0710 msgr2=0x7fc9540d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc953e00640 1 --2- 172.21.15.29:0/3942059576 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9540d0710 0x7fc9540d0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc953e00640 1 -- 172.21.15.29:0/3942059576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9540cd160 msgr2=0x7fc95414fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc953e00640 1 --2- 172.21.15.29:0/3942059576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9540cd160 0x7fc95414fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc953e00640 1 -- 172.21.15.29:0/3942059576 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c009b30 con 0x7fc9540cd540 2024-01-24T13:07:20.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc958a00640 1 --2- 172.21.15.29:0/3942059576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9540cd160 0x7fc95414fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:07:20.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc953e00640 1 --2- 172.21.15.29:0/3942059576 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9540cd540 0x7fc9540b5da0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00d5f0 tx=0x7fc93c00dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:20.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc950c00640 1 -- 172.21.15.29:0/3942059576 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0125f0 con 0x7fc9540cd540 2024-01-24T13:07:20.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc950c00640 1 -- 172.21.15.29:0/3942059576 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c012750 con 0x7fc9540cd540 2024-01-24T13:07:20.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc95b400640 1 -- 172.21.15.29:0/3942059576 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9540c7860 con 0x7fc9540cd540 2024-01-24T13:07:20.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc950c00640 1 -- 172.21.15.29:0/3942059576 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c012ae0 con 0x7fc9540cd540 2024-01-24T13:07:20.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc95b400640 1 -- 172.21.15.29:0/3942059576 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9540ca210 con 0x7fc9540cd540 2024-01-24T13:07:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc95b400640 1 -- 172.21.15.29:0/3942059576 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95404e850 con 0x7fc9540cd540 2024-01-24T13:07:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc950c00640 1 -- 172.21.15.29:0/3942059576 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc93c012c40 con 0x7fc9540cd540 2024-01-24T13:07:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc950c00640 1 --2- 172.21.15.29:0/3942059576 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc92c065a90 0x7fc92c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.729+0000 7fc950c00640 1 -- 172.21.15.29:0/3942059576 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc93c0835d0 con 0x7fc9540cd540 2024-01-24T13:07:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.733+0000 7fc958a00640 1 --2- 172.21.15.29:0/3942059576 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc92c065a90 0x7fc92c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.733+0000 7fc958a00640 1 --2- 172.21.15.29:0/3942059576 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc92c065a90 0x7fc92c067f50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc944000f70 tx=0x7fc944009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.737+0000 7fc950c00640 1 -- 172.21.15.29:0/3942059576 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc93c0511e0 con 0x7fc9540cd540 2024-01-24T13:07:20.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.909+0000 7fc95b400640 1 -- 172.21.15.29:0/3942059576 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9540cb450 con 0x7fc92c065a90 2024-01-24T13:07:20.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.909+0000 7fc950c00640 1 -- 172.21.15.29:0/3942059576 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc944001940 con 0x7fc92c065a90 2024-01-24T13:07:20.909 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 4 to deep-scrub 2024-01-24T13:07:20.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.909+0000 7fc95b400640 1 -- 172.21.15.29:0/3942059576 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc92c065a90 msgr2=0x7fc92c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.909+0000 7fc95b400640 1 --2- 172.21.15.29:0/3942059576 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc92c065a90 0x7fc92c067f50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc944000f70 tx=0x7fc944009040 comp rx=0 tx=0).stop 2024-01-24T13:07:20.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.909+0000 7fc95b400640 1 -- 172.21.15.29:0/3942059576 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9540cd540 msgr2=0x7fc9540b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:20.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.909+0000 7fc95b400640 1 --2- 172.21.15.29:0/3942059576 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9540cd540 0x7fc9540b5da0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00d5f0 tx=0x7fc93c00dab0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.909+0000 7fc95b400640 1 -- 172.21.15.29:0/3942059576 shutdown_connections 2024-01-24T13:07:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.909+0000 7fc95b400640 1 --2- 172.21.15.29:0/3942059576 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fc92c065a90 0x7fc92c067f50 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.909+0000 7fc95b400640 1 --2- 172.21.15.29:0/3942059576 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9540d0710 0x7fc9540d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.909+0000 7fc95b400640 1 --2- 172.21.15.29:0/3942059576 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9540cd540 0x7fc9540b5da0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.909+0000 7fc95b400640 1 --2- 172.21.15.29:0/3942059576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9540cd160 0x7fc95414fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.909+0000 7fc95b400640 1 -- 172.21.15.29:0/3942059576 >> 172.21.15.29:0/3942059576 conn(0x7fc954069cd0 msgr2=0x7fc9541595d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.909+0000 7fc95b400640 1 -- 172.21.15.29:0/3942059576 shutdown_connections 2024-01-24T13:07:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:20.909+0000 7fc95b400640 1 -- 172.21.15.29:0/3942059576 wait complete. 2024-01-24T13:07:20.931 INFO:tasks.ceph:Scrubbing osd.5 2024-01-24T13:07:20.931 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-24T13:07:21.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc43a00640 1 Processor -- start 2024-01-24T13:07:21.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc43a00640 1 -- start start 2024-01-24T13:07:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc43a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc3c15c7f0 0x7efc3c15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc43a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efc3c070da0 0x7efc3c071250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc43a00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c070910 con 0x7efc3c1532d0 2024-01-24T13:07:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc43a00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c1536b0 con 0x7efc3c070da0 2024-01-24T13:07:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc43a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c15d2b0 con 0x7efc3c15c7f0 2024-01-24T13:07:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc41000640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efc3c1532d0 0x7efc3c0c8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43610/0 (socket says 172.21.15.29:43610) 2024-01-24T13:07:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc41000640 1 -- 172.21.15.29:0/55035692 learned_addr learned my addr 172.21.15.29:0/55035692 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc41a00640 1 --2- 172.21.15.29:0/55035692 >> v2:172.21.15.29:3300/0 conn(0x7efc3c070da0 0x7efc3c071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc3be00640 1 --2- 172.21.15.29:0/55035692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc3c15c7f0 0x7efc3c15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc41a00640 1 -- 172.21.15.29:0/55035692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc3c15c7f0 msgr2=0x7efc3c15cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc41a00640 1 --2- 172.21.15.29:0/55035692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc3c15c7f0 0x7efc3c15cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc41a00640 1 -- 172.21.15.29:0/55035692 >> v1:172.21.15.29:6789/0 conn(0x7efc3c1532d0 legacy=0x7efc3c0c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc41a00640 1 -- 172.21.15.29:0/55035692 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c15d590 con 0x7efc3c070da0 2024-01-24T13:07:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc3be00640 1 --2- 172.21.15.29:0/55035692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc3c15c7f0 0x7efc3c15cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.077+0000 7efc3b400640 1 -- 172.21.15.29:0/55035692 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589845999 0 0) 0x7efc3c070910 con 0x7efc3c1532d0 2024-01-24T13:07:21.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.081+0000 7efc41a00640 1 --2- 172.21.15.29:0/55035692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3c070da0 0x7efc3c071250 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7efc34009d90 tx=0x7efc3401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d2dc8793cd70c8 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:21.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.081+0000 7efc3b400640 1 -- 172.21.15.29:0/55035692 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc340a5770 con 0x7efc3c070da0 2024-01-24T13:07:21.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.081+0000 7efc3b400640 1 -- 172.21.15.29:0/55035692 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc340a58d0 con 0x7efc3c070da0 2024-01-24T13:07:21.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.081+0000 7efc3b400640 1 -- 172.21.15.29:0/55035692 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc340a5c60 con 0x7efc3c070da0 2024-01-24T13:07:21.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.081+0000 7efc43a00640 1 -- 172.21.15.29:0/55035692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3c070da0 msgr2=0x7efc3c071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.081+0000 7efc43a00640 1 --2- 172.21.15.29:0/55035692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3c070da0 0x7efc3c071250 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7efc34009d90 tx=0x7efc3401c950 comp rx=0 tx=0).stop 2024-01-24T13:07:21.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.081+0000 7efc43a00640 1 -- 172.21.15.29:0/55035692 shutdown_connections 2024-01-24T13:07:21.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.081+0000 7efc43a00640 1 --2- 172.21.15.29:0/55035692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3c070da0 0x7efc3c071250 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.081+0000 7efc43a00640 1 --2- 172.21.15.29:0/55035692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc3c15c7f0 0x7efc3c15cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.081+0000 7efc43a00640 1 -- 172.21.15.29:0/55035692 >> 172.21.15.29:0/55035692 conn(0x7efc3c06a0d0 msgr2=0x7efc3c06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.081+0000 7efc43a00640 1 -- 172.21.15.29:0/55035692 shutdown_connections 2024-01-24T13:07:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.081+0000 7efc43a00640 1 -- 172.21.15.29:0/55035692 wait complete. 2024-01-24T13:07:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc43a00640 1 Processor -- start 2024-01-24T13:07:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc43a00640 1 -- start start 2024-01-24T13:07:21.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc43a00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc3c070da0 0x7efc3c0c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc43a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc3c1532d0 0x7efc3c152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc43a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3c15c7f0 0x7efc3c0c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc43a00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c167c60 con 0x7efc3c15c7f0 2024-01-24T13:07:21.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc43a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c167730 con 0x7efc3c1532d0 2024-01-24T13:07:21.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc43a00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c167980 con 0x7efc3c070da0 2024-01-24T13:07:21.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc41a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3c15c7f0 0x7efc3c0c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc41a00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3c15c7f0 0x7efc3c0c1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43626/0 (socket says 172.21.15.29:43626) 2024-01-24T13:07:21.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc41a00640 1 -- 172.21.15.29:0/589862164 learned_addr learned my addr 172.21.15.29:0/589862164 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:21.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc3be00640 1 --2- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc3c1532d0 0x7efc3c152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc41000640 1 --2- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc3c070da0 0x7efc3c0c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc41a00640 1 -- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc3c070da0 msgr2=0x7efc3c0c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc41a00640 1 --2- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc3c070da0 0x7efc3c0c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc41a00640 1 -- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc3c1532d0 msgr2=0x7efc3c152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc41a00640 1 --2- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc3c1532d0 0x7efc3c152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc41a00640 1 -- 172.21.15.29:0/589862164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc34009a70 con 0x7efc3c15c7f0 2024-01-24T13:07:21.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc41a00640 1 --2- 172.21.15.29:0/589862164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3c15c7f0 0x7efc3c0c1ce0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7efc34009d90 tx=0x7efc340196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:21.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc38c00640 1 -- 172.21.15.29:0/589862164 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc340ad440 con 0x7efc3c15c7f0 2024-01-24T13:07:21.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc38c00640 1 -- 172.21.15.29:0/589862164 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc340ad5a0 con 0x7efc3c15c7f0 2024-01-24T13:07:21.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc43a00640 1 -- 172.21.15.29:0/589862164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c14b040 con 0x7efc3c15c7f0 2024-01-24T13:07:21.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc38c00640 1 -- 172.21.15.29:0/589862164 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc340ad930 con 0x7efc3c15c7f0 2024-01-24T13:07:21.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc43a00640 1 -- 172.21.15.29:0/589862164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c14b600 con 0x7efc3c15c7f0 2024-01-24T13:07:21.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.085+0000 7efc43a00640 1 -- 172.21.15.29:0/589862164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc3c14aec0 con 0x7efc3c15c7f0 2024-01-24T13:07:21.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.089+0000 7efc38c00640 1 -- 172.21.15.29:0/589862164 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efc340ada90 con 0x7efc3c15c7f0 2024-01-24T13:07:21.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.089+0000 7efc38c00640 1 --2- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7efc14065a60 0x7efc14067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.089+0000 7efc38c00640 1 -- 172.21.15.29:0/589862164 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7efc3411e0b0 con 0x7efc3c15c7f0 2024-01-24T13:07:21.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.089+0000 7efc38c00640 1 --2- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:6800/27229,v1:172.21.15.163:6801/27229] conn(0x7efc1406bd60 0x7efc1406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.089+0000 7efc38c00640 1 -- 172.21.15.29:0/589862164 --> [v2:172.21.15.163:6800/27229,v1:172.21.15.163:6801/27229] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc1406e870 con 0x7efc1406bd60 2024-01-24T13:07:21.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.089+0000 7efc38c00640 1 -- 172.21.15.29:0/589862164 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc34120770 con 0x7efc3c15c7f0 2024-01-24T13:07:21.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.089+0000 7efc41000640 1 --2- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7efc14065a60 0x7efc14067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.089+0000 7efc3be00640 1 --2- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:6800/27229,v1:172.21.15.163:6801/27229] conn(0x7efc1406bd60 0x7efc1406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.089+0000 7efc41000640 1 --2- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7efc14065a60 0x7efc14067f20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efc2c007fd0 tx=0x7efc2c007d60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:21.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.089+0000 7efc3be00640 1 --2- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:6800/27229,v1:172.21.15.163:6801/27229] conn(0x7efc1406bd60 0x7efc1406e1a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:21.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.093+0000 7efc38c00640 1 -- 172.21.15.29:0/589862164 <== osd.5 v2:172.21.15.163:6800/27229 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efc1406e870 con 0x7efc1406bd60 2024-01-24T13:07:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.105+0000 7efc43a00640 1 -- 172.21.15.29:0/589862164 --> [v2:172.21.15.163:6800/27229,v1:172.21.15.163:6801/27229] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efc3c070290 con 0x7efc1406bd60 2024-01-24T13:07:21.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.105+0000 7efc38c00640 1 -- 172.21.15.29:0/589862164 <== osd.5 v2:172.21.15.163:6800/27229 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efc24003700 con 0x7efc1406bd60 2024-01-24T13:07:21.105 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:07:21.105 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T13:07:21.106 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:07:21.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.105+0000 7efc43a00640 1 -- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:6800/27229,v1:172.21.15.163:6801/27229] conn(0x7efc1406bd60 msgr2=0x7efc1406e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.105+0000 7efc43a00640 1 --2- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:6800/27229,v1:172.21.15.163:6801/27229] conn(0x7efc1406bd60 0x7efc1406e1a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.105+0000 7efc43a00640 1 -- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7efc14065a60 msgr2=0x7efc14067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.105+0000 7efc43a00640 1 --2- 172.21.15.29:0/589862164 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7efc14065a60 0x7efc14067f20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efc2c007fd0 tx=0x7efc2c007d60 comp rx=0 tx=0).stop 2024-01-24T13:07:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.105+0000 7efc43a00640 1 -- 172.21.15.29:0/589862164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3c15c7f0 msgr2=0x7efc3c0c1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.105+0000 7efc43a00640 1 --2- 172.21.15.29:0/589862164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3c15c7f0 0x7efc3c0c1ce0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7efc34009d90 tx=0x7efc340196f0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.105+0000 7efc41a00640 1 -- 172.21.15.29:0/589862164 reap_dead start 2024-01-24T13:07:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.105+0000 7efc43a00640 1 -- 172.21.15.29:0/589862164 shutdown_connections 2024-01-24T13:07:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.105+0000 7efc43a00640 1 -- 172.21.15.29:0/589862164 >> 172.21.15.29:0/589862164 conn(0x7efc3c06a0d0 msgr2=0x7efc3c06bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.105+0000 7efc43a00640 1 -- 172.21.15.29:0/589862164 shutdown_connections 2024-01-24T13:07:21.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.105+0000 7efc43a00640 1 -- 172.21.15.29:0/589862164 wait complete. 2024-01-24T13:07:21.125 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-24T13:07:21.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.265+0000 7f852ee00640 1 Processor -- start 2024-01-24T13:07:21.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.265+0000 7f852ee00640 1 -- start start 2024-01-24T13:07:21.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.269+0000 7f852ee00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f85280cd540 0x7f852815b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.269+0000 7f852ee00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852815e920 con 0x7f852815b8b0 2024-01-24T13:07:21.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.269+0000 7f852ee00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852815ec00 con 0x7f85280cd160 2024-01-24T13:07:21.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.269+0000 7f852ee00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852815eee0 con 0x7f85280cd540 2024-01-24T13:07:21.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.269+0000 7f8527400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f85280cd540 0x7f852815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.269+0000 7f8527400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f85280cd540 0x7f852815b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43636/0 (socket says 172.21.15.29:43636) 2024-01-24T13:07:21.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.269+0000 7f852ce00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f852815b8b0 0x7f85280cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43626/0 (socket says 172.21.15.29:43626) 2024-01-24T13:07:21.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.269+0000 7f8527400640 1 -- 172.21.15.29:0/2717491045 learned_addr learned my addr 172.21.15.29:0/2717491045 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:21.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.269+0000 7f8527400640 1 -- 172.21.15.29:0/2717491045 >> v1:172.21.15.163:6789/0 conn(0x7f85280cd160 legacy=0x7f852815e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:21.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.269+0000 7f8527400640 1 -- 172.21.15.29:0/2717491045 >> v1:172.21.15.29:6789/0 conn(0x7f852815b8b0 legacy=0x7f85280cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.269+0000 7f8527400640 1 -- 172.21.15.29:0/2717491045 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852815ae50 con 0x7f85280cd540 2024-01-24T13:07:21.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.273+0000 7f8527400640 1 --2- 172.21.15.29:0/2717491045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85280cd540 0x7f852815b370 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8510009870 tx=0x7f851001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1d1b23fb51181f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:21.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.273+0000 7f8526a00640 1 -- 172.21.15.29:0/2717491045 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85100ab640 con 0x7f85280cd540 2024-01-24T13:07:21.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.273+0000 7f8526a00640 1 -- 172.21.15.29:0/2717491045 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85100a7070 con 0x7f85280cd540 2024-01-24T13:07:21.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.273+0000 7f8526a00640 1 -- 172.21.15.29:0/2717491045 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85100ab9c0 con 0x7f85280cd540 2024-01-24T13:07:21.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.273+0000 7f852ee00640 1 -- 172.21.15.29:0/2717491045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85280cd540 msgr2=0x7f852815b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.273+0000 7f852ee00640 1 --2- 172.21.15.29:0/2717491045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85280cd540 0x7f852815b370 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8510009870 tx=0x7f851001c500 comp rx=0 tx=0).stop 2024-01-24T13:07:21.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.273+0000 7f852ee00640 1 -- 172.21.15.29:0/2717491045 shutdown_connections 2024-01-24T13:07:21.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.273+0000 7f852ee00640 1 --2- 172.21.15.29:0/2717491045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85280cd540 0x7f852815b370 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.273+0000 7f852ee00640 1 -- 172.21.15.29:0/2717491045 >> 172.21.15.29:0/2717491045 conn(0x7f8528069cd0 msgr2=0x7f852806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:21.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.273+0000 7f852ee00640 1 -- 172.21.15.29:0/2717491045 shutdown_connections 2024-01-24T13:07:21.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.273+0000 7f852ee00640 1 -- 172.21.15.29:0/2717491045 wait complete. 2024-01-24T13:07:21.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.273+0000 7f852ee00640 1 Processor -- start 2024-01-24T13:07:21.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.273+0000 7f852ee00640 1 -- start start 2024-01-24T13:07:21.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ee00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85280cd160 0x7f85280c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ee00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85280cd540 0x7f852814bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ee00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8528152410 0x7f85280b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ee00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852814c410 con 0x7f8528152410 2024-01-24T13:07:21.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ee00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85280ca180 con 0x7f85280cd160 2024-01-24T13:07:21.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ee00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85280c9bc0 con 0x7f85280cd540 2024-01-24T13:07:21.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ce00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8528152410 0x7f85280b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ce00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8528152410 0x7f85280b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43646/0 (socket says 172.21.15.29:43646) 2024-01-24T13:07:21.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ce00640 1 -- 172.21.15.29:0/2904528702 learned_addr learned my addr 172.21.15.29:0/2904528702 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:21.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f8527400640 1 --2- 172.21.15.29:0/2904528702 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85280cd540 0x7f852814bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f8527e00640 1 --2- 172.21.15.29:0/2904528702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85280cd160 0x7f85280c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ce00640 1 -- 172.21.15.29:0/2904528702 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85280cd540 msgr2=0x7f852814bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ce00640 1 --2- 172.21.15.29:0/2904528702 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85280cd540 0x7f852814bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ce00640 1 -- 172.21.15.29:0/2904528702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85280cd160 msgr2=0x7f85280c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ce00640 1 --2- 172.21.15.29:0/2904528702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85280cd160 0x7f85280c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ce00640 1 -- 172.21.15.29:0/2904528702 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85100094d0 con 0x7f8528152410 2024-01-24T13:07:21.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ce00640 1 --2- 172.21.15.29:0/2904528702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8528152410 0x7f85280b4db0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f852000c700 tx=0x7f852000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:21.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f851fe00640 1 -- 172.21.15.29:0/2904528702 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000ce10 con 0x7f8528152410 2024-01-24T13:07:21.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f851fe00640 1 -- 172.21.15.29:0/2904528702 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852000a640 con 0x7f8528152410 2024-01-24T13:07:21.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ee00640 1 -- 172.21.15.29:0/2904528702 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85280c9ea0 con 0x7f8528152410 2024-01-24T13:07:21.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f851fe00640 1 -- 172.21.15.29:0/2904528702 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000a9b0 con 0x7f8528152410 2024-01-24T13:07:21.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ee00640 1 -- 172.21.15.29:0/2904528702 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85280b4550 con 0x7f8528152410 2024-01-24T13:07:21.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f852ee00640 1 -- 172.21.15.29:0/2904528702 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852804e850 con 0x7f8528152410 2024-01-24T13:07:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.277+0000 7f851fe00640 1 -- 172.21.15.29:0/2904528702 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f852000ab10 con 0x7f8528152410 2024-01-24T13:07:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.281+0000 7f851fe00640 1 --2- 172.21.15.29:0/2904528702 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8500065a60 0x7f8500067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.281+0000 7f851fe00640 1 -- 172.21.15.29:0/2904528702 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f85200826c0 con 0x7f8528152410 2024-01-24T13:07:21.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.281+0000 7f8527e00640 1 --2- 172.21.15.29:0/2904528702 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8500065a60 0x7f8500067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.281+0000 7f8527e00640 1 --2- 172.21.15.29:0/2904528702 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8500065a60 0x7f8500067f20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f85280cb1e0 tx=0x7f8518007e40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:21.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.285+0000 7f851fe00640 1 -- 172.21.15.29:0/2904528702 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f85200502e0 con 0x7f8528152410 2024-01-24T13:07:21.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.441+0000 7f852ee00640 1 -- 172.21.15.29:0/2904528702 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f85280ca340 con 0x7f8500065a60 2024-01-24T13:07:21.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.445+0000 7f851fe00640 1 -- 172.21.15.29:0/2904528702 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f85280ca340 con 0x7f8500065a60 2024-01-24T13:07:21.444 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 5 to deep-scrub 2024-01-24T13:07:21.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.445+0000 7f852ee00640 1 -- 172.21.15.29:0/2904528702 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8500065a60 msgr2=0x7f8500067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.445+0000 7f852ee00640 1 --2- 172.21.15.29:0/2904528702 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8500065a60 0x7f8500067f20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f85280cb1e0 tx=0x7f8518007e40 comp rx=0 tx=0).stop 2024-01-24T13:07:21.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.445+0000 7f852ee00640 1 -- 172.21.15.29:0/2904528702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8528152410 msgr2=0x7f85280b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.445+0000 7f852ee00640 1 --2- 172.21.15.29:0/2904528702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8528152410 0x7f85280b4db0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f852000c700 tx=0x7f852000cbc0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.445+0000 7f852ee00640 1 -- 172.21.15.29:0/2904528702 shutdown_connections 2024-01-24T13:07:21.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.445+0000 7f852ee00640 1 --2- 172.21.15.29:0/2904528702 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f8500065a60 0x7f8500067f20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.445+0000 7f852ee00640 1 --2- 172.21.15.29:0/2904528702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8528152410 0x7f85280b4db0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.445+0000 7f852ee00640 1 --2- 172.21.15.29:0/2904528702 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85280cd540 0x7f852814bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.445+0000 7f852ee00640 1 --2- 172.21.15.29:0/2904528702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85280cd160 0x7f85280c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.445+0000 7f852ee00640 1 -- 172.21.15.29:0/2904528702 >> 172.21.15.29:0/2904528702 conn(0x7f8528069cd0 msgr2=0x7f85280d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:21.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.445+0000 7f852ee00640 1 -- 172.21.15.29:0/2904528702 shutdown_connections 2024-01-24T13:07:21.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.445+0000 7f852ee00640 1 -- 172.21.15.29:0/2904528702 wait complete. 2024-01-24T13:07:21.466 INFO:tasks.ceph:Scrubbing osd.6 2024-01-24T13:07:21.467 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-24T13:07:21.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.609+0000 7f626e200640 1 Processor -- start 2024-01-24T13:07:21.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.609+0000 7f626e200640 1 -- start start 2024-01-24T13:07:21.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.613+0000 7f626e200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f62680ce790 0x7f6268167770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.613+0000 7f626e200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62680d05e0 con 0x7f62680cd460 2024-01-24T13:07:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.613+0000 7f626e200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62680d0830 con 0x7f62680d0150 2024-01-24T13:07:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.613+0000 7f626e200640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62680d0b10 con 0x7f62680ce790 2024-01-24T13:07:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.613+0000 7f6267400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f62680cd460 0x7f626815d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43636/0 (socket says 172.21.15.29:43636) 2024-01-24T13:07:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.613+0000 7f6267400640 1 -- 172.21.15.29:0/4235178782 learned_addr learned my addr 172.21.15.29:0/4235178782 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.613+0000 7f6267e00640 1 --2- 172.21.15.29:0/4235178782 >> v2:172.21.15.29:3300/0 conn(0x7f62680ce790 0x7f6268167770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.613+0000 7f6266000640 1 -- 172.21.15.29:0/4235178782 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815101728 0 0) 0x7f62680d05e0 con 0x7f62680cd460 2024-01-24T13:07:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.613+0000 7f6267e00640 1 -- 172.21.15.29:0/4235178782 >> v1:172.21.15.163:6789/0 conn(0x7f62680d0150 legacy=0x7f62680ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.613+0000 7f6267e00640 1 -- 172.21.15.29:0/4235178782 >> v1:172.21.15.29:6789/0 conn(0x7f62680cd460 legacy=0x7f626815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.613+0000 7f6267e00640 1 -- 172.21.15.29:0/4235178782 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680d0df0 con 0x7f62680ce790 2024-01-24T13:07:21.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.617+0000 7f6267e00640 1 --2- 172.21.15.29:0/4235178782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62680ce790 0x7f6268167770 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6260009d90 tx=0x7f626001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1579ed4b99ae9f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:21.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.617+0000 7f6266000640 1 -- 172.21.15.29:0/4235178782 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600a5940 con 0x7f62680ce790 2024-01-24T13:07:21.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.617+0000 7f6266000640 1 -- 172.21.15.29:0/4235178782 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62600a5aa0 con 0x7f62680ce790 2024-01-24T13:07:21.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.617+0000 7f6266000640 1 -- 172.21.15.29:0/4235178782 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600a5e30 con 0x7f62680ce790 2024-01-24T13:07:21.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.617+0000 7f626e200640 1 -- 172.21.15.29:0/4235178782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62680ce790 msgr2=0x7f6268167770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.617+0000 7f626e200640 1 --2- 172.21.15.29:0/4235178782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62680ce790 0x7f6268167770 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6260009d90 tx=0x7f626001c8c0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.617+0000 7f626e200640 1 -- 172.21.15.29:0/4235178782 shutdown_connections 2024-01-24T13:07:21.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.617+0000 7f626e200640 1 --2- 172.21.15.29:0/4235178782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62680ce790 0x7f6268167770 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.617+0000 7f626e200640 1 -- 172.21.15.29:0/4235178782 >> 172.21.15.29:0/4235178782 conn(0x7f6268069cd0 msgr2=0x7f626806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:21.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.617+0000 7f626e200640 1 -- 172.21.15.29:0/4235178782 shutdown_connections 2024-01-24T13:07:21.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.617+0000 7f626e200640 1 -- 172.21.15.29:0/4235178782 wait complete. 2024-01-24T13:07:21.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.617+0000 7f626e200640 1 Processor -- start 2024-01-24T13:07:21.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.617+0000 7f626e200640 1 -- start start 2024-01-24T13:07:21.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f626e200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62680cd460 0x7f626815e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f626e200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62680ce790 0x7f626814e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f626e200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62680d0150 0x7f6268159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f626e200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62681550a0 con 0x7f62680d0150 2024-01-24T13:07:21.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f626e200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6268157890 con 0x7f62680ce790 2024-01-24T13:07:21.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f626e200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6268157b70 con 0x7f62680cd460 2024-01-24T13:07:21.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f6267e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62680d0150 0x7f6268159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f6267e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62680d0150 0x7f6268159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43668/0 (socket says 172.21.15.29:43668) 2024-01-24T13:07:21.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f6267e00640 1 -- 172.21.15.29:0/1077406991 learned_addr learned my addr 172.21.15.29:0/1077406991 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:21.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f6267400640 1 --2- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62680cd460 0x7f626815e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f6266a00640 1 --2- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62680ce790 0x7f626814e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f6267e00640 1 -- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62680cd460 msgr2=0x7f626815e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f6267e00640 1 --2- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62680cd460 0x7f626815e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f6267e00640 1 -- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62680ce790 msgr2=0x7f626814e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f6267e00640 1 --2- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62680ce790 0x7f626814e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f6267e00640 1 -- 172.21.15.29:0/1077406991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6260009a70 con 0x7f62680d0150 2024-01-24T13:07:21.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f6267e00640 1 --2- 172.21.15.29:0/1077406991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62680d0150 0x7f6268159ac0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f62600b0040 tx=0x7f6260019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:21.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f625f400640 1 -- 172.21.15.29:0/1077406991 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600ade40 con 0x7f62680d0150 2024-01-24T13:07:21.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f625f400640 1 -- 172.21.15.29:0/1077406991 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62600b7410 con 0x7f62680d0150 2024-01-24T13:07:21.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f626e200640 1 -- 172.21.15.29:0/1077406991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6268154a50 con 0x7f62680d0150 2024-01-24T13:07:21.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f625f400640 1 -- 172.21.15.29:0/1077406991 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600b7800 con 0x7f62680d0150 2024-01-24T13:07:21.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f626e200640 1 -- 172.21.15.29:0/1077406991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626814ea10 con 0x7f62680d0150 2024-01-24T13:07:21.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.621+0000 7f626e200640 1 -- 172.21.15.29:0/1077406991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f626816a4d0 con 0x7f62680d0150 2024-01-24T13:07:21.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.625+0000 7f625f400640 1 -- 172.21.15.29:0/1077406991 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f62600b4050 con 0x7f62680d0150 2024-01-24T13:07:21.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.625+0000 7f625f400640 1 --2- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6240065a60 0x7f6240067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.625+0000 7f625f400640 1 -- 172.21.15.29:0/1077406991 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f626011e450 con 0x7f62680d0150 2024-01-24T13:07:21.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.625+0000 7f625f400640 1 --2- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:6824/27230,v1:172.21.15.163:6825/27230] conn(0x7f624006bd60 0x7f624006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.625+0000 7f625f400640 1 -- 172.21.15.29:0/1077406991 --> [v2:172.21.15.163:6824/27230,v1:172.21.15.163:6825/27230] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f624006e870 con 0x7f624006bd60 2024-01-24T13:07:21.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.625+0000 7f625f400640 1 -- 172.21.15.29:0/1077406991 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6260120b10 con 0x7f62680d0150 2024-01-24T13:07:21.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.625+0000 7f6267400640 1 --2- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6240065a60 0x7f6240067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.625+0000 7f6266a00640 1 --2- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:6824/27230,v1:172.21.15.163:6825/27230] conn(0x7f624006bd60 0x7f624006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.625+0000 7f6267400640 1 --2- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6240065a60 0x7f6240067f20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6258000f70 tx=0x7f6258007bc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:21.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.625+0000 7f6266a00640 1 --2- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:6824/27230,v1:172.21.15.163:6825/27230] conn(0x7f624006bd60 0x7f624006e1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:21.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.625+0000 7f625f400640 1 -- 172.21.15.29:0/1077406991 <== osd.6 v2:172.21.15.163:6824/27230 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f624006e870 con 0x7f624006bd60 2024-01-24T13:07:21.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.637+0000 7f626e200640 1 -- 172.21.15.29:0/1077406991 --> [v2:172.21.15.163:6824/27230,v1:172.21.15.163:6825/27230] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f62680c4ae0 con 0x7f624006bd60 2024-01-24T13:07:21.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.641+0000 7f625f400640 1 -- 172.21.15.29:0/1077406991 <== osd.6 v2:172.21.15.163:6824/27230 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f62680c4ae0 con 0x7f624006bd60 2024-01-24T13:07:21.640 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:07:21.640 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T13:07:21.640 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:07:21.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.641+0000 7f626e200640 1 -- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:6824/27230,v1:172.21.15.163:6825/27230] conn(0x7f624006bd60 msgr2=0x7f624006e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.641+0000 7f626e200640 1 --2- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:6824/27230,v1:172.21.15.163:6825/27230] conn(0x7f624006bd60 0x7f624006e1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.641+0000 7f626e200640 1 -- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6240065a60 msgr2=0x7f6240067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.641+0000 7f626e200640 1 --2- 172.21.15.29:0/1077406991 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f6240065a60 0x7f6240067f20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6258000f70 tx=0x7f6258007bc0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.641+0000 7f626e200640 1 -- 172.21.15.29:0/1077406991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62680d0150 msgr2=0x7f6268159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.641+0000 7f626e200640 1 --2- 172.21.15.29:0/1077406991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62680d0150 0x7f6268159ac0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f62600b0040 tx=0x7f6260019660 comp rx=0 tx=0).stop 2024-01-24T13:07:21.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.641+0000 7f6267e00640 1 -- 172.21.15.29:0/1077406991 reap_dead start 2024-01-24T13:07:21.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.641+0000 7f626e200640 1 -- 172.21.15.29:0/1077406991 shutdown_connections 2024-01-24T13:07:21.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.641+0000 7f626e200640 1 -- 172.21.15.29:0/1077406991 >> 172.21.15.29:0/1077406991 conn(0x7f6268069cd0 msgr2=0x7f62680c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:21.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.641+0000 7f626e200640 1 -- 172.21.15.29:0/1077406991 shutdown_connections 2024-01-24T13:07:21.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.641+0000 7f626e200640 1 -- 172.21.15.29:0/1077406991 wait complete. 2024-01-24T13:07:21.660 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-24T13:07:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.801+0000 7f37b6c00640 1 Processor -- start 2024-01-24T13:07:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.801+0000 7f37b6c00640 1 -- start start 2024-01-24T13:07:21.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.801+0000 7f37b6c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37b01599c0 0x7f37b0071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.801+0000 7f37b6c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b015a960 con 0x7f37b00c87e0 2024-01-24T13:07:21.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.801+0000 7f37b6c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b0070ca0 con 0x7f37b006ba60 2024-01-24T13:07:21.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.801+0000 7f37b6c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b015df10 con 0x7f37b01599c0 2024-01-24T13:07:21.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.801+0000 7f37af400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f37b00c87e0 0x7f37b015d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43642/0 (socket says 172.21.15.29:43642) 2024-01-24T13:07:21.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.801+0000 7f37af400640 1 -- 172.21.15.29:0/2718046492 learned_addr learned my addr 172.21.15.29:0/2718046492 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:21.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.805+0000 7f37b4c00640 1 --2- 172.21.15.29:0/2718046492 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37b01599c0 0x7f37b0071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.805+0000 7f37aea00640 1 -- 172.21.15.29:0/2718046492 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808441263 0 0) 0x7f37b015a960 con 0x7f37b00c87e0 2024-01-24T13:07:21.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.805+0000 7f37aea00640 1 -- 172.21.15.29:0/2718046492 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3790005740 con 0x7f37b00c87e0 2024-01-24T13:07:21.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.805+0000 7f37aea00640 1 -- 172.21.15.29:0/2718046492 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391871362 0 0) 0x7f37b0070ca0 con 0x7f37b006ba60 2024-01-24T13:07:21.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.805+0000 7f37aea00640 1 -- 172.21.15.29:0/2718046492 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b015a960 con 0x7f37b006ba60 2024-01-24T13:07:21.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.805+0000 7f37b4c00640 1 -- 172.21.15.29:0/2718046492 >> v1:172.21.15.163:6789/0 conn(0x7f37b006ba60 legacy=0x7f37b006be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.805+0000 7f37b4c00640 1 -- 172.21.15.29:0/2718046492 >> v1:172.21.15.29:6789/0 conn(0x7f37b00c87e0 legacy=0x7f37b015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.805+0000 7f37b4c00640 1 -- 172.21.15.29:0/2718046492 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b0159e50 con 0x7f37b01599c0 2024-01-24T13:07:21.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.805+0000 7f37b4c00640 1 --2- 172.21.15.29:0/2718046492 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37b01599c0 0x7f37b0071130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f37a8009dc0 tx=0x7f37a801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ce9800bd80586c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:21.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.805+0000 7f37aea00640 1 -- 172.21.15.29:0/2718046492 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a80a5830 con 0x7f37b01599c0 2024-01-24T13:07:21.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.805+0000 7f37aea00640 1 -- 172.21.15.29:0/2718046492 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a80a5990 con 0x7f37b01599c0 2024-01-24T13:07:21.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.805+0000 7f37aea00640 1 -- 172.21.15.29:0/2718046492 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a80a5d00 con 0x7f37b01599c0 2024-01-24T13:07:21.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 -- 172.21.15.29:0/2718046492 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37b01599c0 msgr2=0x7f37b0071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 --2- 172.21.15.29:0/2718046492 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37b01599c0 0x7f37b0071130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f37a8009dc0 tx=0x7f37a801c970 comp rx=0 tx=0).stop 2024-01-24T13:07:21.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 -- 172.21.15.29:0/2718046492 shutdown_connections 2024-01-24T13:07:21.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 --2- 172.21.15.29:0/2718046492 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37b01599c0 0x7f37b0071130 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 -- 172.21.15.29:0/2718046492 >> 172.21.15.29:0/2718046492 conn(0x7f37b006a2d0 msgr2=0x7f37b00afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:21.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 -- 172.21.15.29:0/2718046492 shutdown_connections 2024-01-24T13:07:21.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 -- 172.21.15.29:0/2718046492 wait complete. 2024-01-24T13:07:21.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 Processor -- start 2024-01-24T13:07:21.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 -- start start 2024-01-24T13:07:21.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b006ba60 0x7f37b0149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37b00c87e0 0x7f37b014fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37b01599c0 0x7f37b00c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b014f9f0 con 0x7f37b006ba60 2024-01-24T13:07:21.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b0153790 con 0x7f37b01599c0 2024-01-24T13:07:21.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37b6c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b014eb20 con 0x7f37b00c87e0 2024-01-24T13:07:21.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37afe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b006ba60 0x7f37b0149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37afe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b006ba60 0x7f37b0149a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43672/0 (socket says 172.21.15.29:43672) 2024-01-24T13:07:21.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.809+0000 7f37afe00640 1 -- 172.21.15.29:0/2280464088 learned_addr learned my addr 172.21.15.29:0/2280464088 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:21.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37b4c00640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37b01599c0 0x7f37b00c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37af400640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37b00c87e0 0x7f37b014fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37afe00640 1 -- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37b00c87e0 msgr2=0x7f37b014fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37afe00640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37b00c87e0 0x7f37b014fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37afe00640 1 -- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37b01599c0 msgr2=0x7f37b00c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37afe00640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37b01599c0 0x7f37b00c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37afe00640 1 -- 172.21.15.29:0/2280464088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a8009a70 con 0x7f37b006ba60 2024-01-24T13:07:21.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37b4c00640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37b01599c0 0x7f37b00c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:21.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37afe00640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b006ba60 0x7f37b0149a90 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f37a000c430 tx=0x7f37a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:21.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37a7e00640 1 -- 172.21.15.29:0/2280464088 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a00052d0 con 0x7f37b006ba60 2024-01-24T13:07:21.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37a7e00640 1 -- 172.21.15.29:0/2280464088 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a0005450 con 0x7f37b006ba60 2024-01-24T13:07:21.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37a7e00640 1 -- 172.21.15.29:0/2280464088 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a0003890 con 0x7f37b006ba60 2024-01-24T13:07:21.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37b6c00640 1 -- 172.21.15.29:0/2280464088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b014ed70 con 0x7f37b006ba60 2024-01-24T13:07:21.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37b6c00640 1 -- 172.21.15.29:0/2280464088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b014f330 con 0x7f37b006ba60 2024-01-24T13:07:21.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37b6c00640 1 -- 172.21.15.29:0/2280464088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b004e850 con 0x7f37b006ba60 2024-01-24T13:07:21.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37a7e00640 1 -- 172.21.15.29:0/2280464088 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f37a00039f0 con 0x7f37b006ba60 2024-01-24T13:07:21.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.813+0000 7f37a7e00640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3788065a60 0x7f3788067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:21.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.817+0000 7f37a7e00640 1 -- 172.21.15.29:0/2280464088 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f37a00827b0 con 0x7f37b006ba60 2024-01-24T13:07:21.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.817+0000 7f37af400640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3788065a60 0x7f3788067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:21.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.817+0000 7f37af400640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3788065a60 0x7f3788067f20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f37b0153d30 tx=0x7f3798009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:21.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.821+0000 7f37a7e00640 1 -- 172.21.15.29:0/2280464088 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f37a0050210 con 0x7f37b006ba60 2024-01-24T13:07:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.977+0000 7f37b6c00640 1 -- 172.21.15.29:0/2280464088 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f37b015a680 con 0x7f3788065a60 2024-01-24T13:07:21.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.977+0000 7f37a7e00640 1 -- 172.21.15.29:0/2280464088 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3798001cf0 con 0x7f3788065a60 2024-01-24T13:07:21.979 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 6 to deep-scrub 2024-01-24T13:07:21.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.981+0000 7f37b6c00640 1 -- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3788065a60 msgr2=0x7f3788067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.981+0000 7f37b6c00640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3788065a60 0x7f3788067f20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f37b0153d30 tx=0x7f3798009040 comp rx=0 tx=0).stop 2024-01-24T13:07:21.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.981+0000 7f37b6c00640 1 -- 172.21.15.29:0/2280464088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b006ba60 msgr2=0x7f37b0149a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:21.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.981+0000 7f37b6c00640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b006ba60 0x7f37b0149a90 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f37a000c430 tx=0x7f37a000c8f0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.981+0000 7f37b6c00640 1 -- 172.21.15.29:0/2280464088 shutdown_connections 2024-01-24T13:07:21.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.981+0000 7f37b6c00640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f3788065a60 0x7f3788067f20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.981+0000 7f37b6c00640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37b01599c0 0x7f37b00c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.981+0000 7f37b6c00640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f37b00c87e0 0x7f37b014fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.981+0000 7f37b6c00640 1 --2- 172.21.15.29:0/2280464088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b006ba60 0x7f37b0149a90 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:21.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.981+0000 7f37b6c00640 1 -- 172.21.15.29:0/2280464088 >> 172.21.15.29:0/2280464088 conn(0x7f37b006a2d0 msgr2=0x7f37b015d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:21.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.981+0000 7f37b6c00640 1 -- 172.21.15.29:0/2280464088 shutdown_connections 2024-01-24T13:07:21.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:21.981+0000 7f37b6c00640 1 -- 172.21.15.29:0/2280464088 wait complete. 2024-01-24T13:07:22.001 INFO:tasks.ceph:Scrubbing osd.7 2024-01-24T13:07:22.001 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-24T13:07:22.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.145+0000 7fe08c200640 1 Processor -- start 2024-01-24T13:07:22.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.145+0000 7fe08c200640 1 -- start start 2024-01-24T13:07:22.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe08c200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe0840cd590 0x7fe0840d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe08c200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe08415d870 0x7fe0840ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe08c200640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0840cd970 con 0x7fe0840ce5c0 2024-01-24T13:07:22.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe08c200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08406c1b0 con 0x7fe0840cd590 2024-01-24T13:07:22.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe08c200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840cea30 con 0x7fe08415d870 2024-01-24T13:07:22.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe08a200640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe0840ce5c0 0x7fe0841603e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43652/0 (socket says 172.21.15.29:43652) 2024-01-24T13:07:22.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe08a200640 1 -- 172.21.15.29:0/1109054961 learned_addr learned my addr 172.21.15.29:0/1109054961 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:22.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe089800640 1 --2- 172.21.15.29:0/1109054961 >> v2:172.21.15.163:3300/0 conn(0x7fe0840cd590 0x7fe0840d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe088e00640 1 --2- 172.21.15.29:0/1109054961 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe08415d870 0x7fe0840ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe083e00640 1 -- 172.21.15.29:0/1109054961 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011221550 0 0) 0x7fe0840cd970 con 0x7fe0840ce5c0 2024-01-24T13:07:22.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe083e00640 1 -- 172.21.15.29:0/1109054961 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe064003530 con 0x7fe0840ce5c0 2024-01-24T13:07:22.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe088e00640 1 -- 172.21.15.29:0/1109054961 >> v2:172.21.15.163:3300/0 conn(0x7fe0840cd590 msgr2=0x7fe0840d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:22.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe088e00640 1 --2- 172.21.15.29:0/1109054961 >> v2:172.21.15.163:3300/0 conn(0x7fe0840cd590 0x7fe0840d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe088e00640 1 -- 172.21.15.29:0/1109054961 >> v1:172.21.15.29:6789/0 conn(0x7fe0840ce5c0 legacy=0x7fe0841603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe088e00640 1 -- 172.21.15.29:0/1109054961 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0840d0810 con 0x7fe08415d870 2024-01-24T13:07:22.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.149+0000 7fe089800640 1 --2- 172.21.15.29:0/1109054961 >> v2:172.21.15.163:3300/0 conn(0x7fe0840cd590 0x7fe0840d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T13:07:22.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.153+0000 7fe088e00640 1 --2- 172.21.15.29:0/1109054961 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe08415d870 0x7fe0840ce080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0097c0 tx=0x7fe06c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9e225a374a55e37 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:22.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.153+0000 7fe083e00640 1 -- 172.21.15.29:0/1109054961 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c0ab600 con 0x7fe08415d870 2024-01-24T13:07:22.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.153+0000 7fe083e00640 1 -- 172.21.15.29:0/1109054961 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c0a7050 con 0x7fe08415d870 2024-01-24T13:07:22.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.153+0000 7fe083e00640 1 -- 172.21.15.29:0/1109054961 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c0ab980 con 0x7fe08415d870 2024-01-24T13:07:22.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.153+0000 7fe08c200640 1 -- 172.21.15.29:0/1109054961 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe08415d870 msgr2=0x7fe0840ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.153+0000 7fe08c200640 1 --2- 172.21.15.29:0/1109054961 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe08415d870 0x7fe0840ce080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0097c0 tx=0x7fe06c01c450 comp rx=0 tx=0).stop 2024-01-24T13:07:22.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.153+0000 7fe08c200640 1 -- 172.21.15.29:0/1109054961 shutdown_connections 2024-01-24T13:07:22.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.153+0000 7fe08c200640 1 --2- 172.21.15.29:0/1109054961 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe08415d870 0x7fe0840ce080 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.153+0000 7fe08c200640 1 --2- 172.21.15.29:0/1109054961 >> v2:172.21.15.163:3300/0 conn(0x7fe0840cd590 0x7fe0840d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.153+0000 7fe08c200640 1 -- 172.21.15.29:0/1109054961 >> 172.21.15.29:0/1109054961 conn(0x7fe084069cd0 msgr2=0x7fe08406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:22.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.153+0000 7fe08c200640 1 -- 172.21.15.29:0/1109054961 shutdown_connections 2024-01-24T13:07:22.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.153+0000 7fe08c200640 1 -- 172.21.15.29:0/1109054961 wait complete. 2024-01-24T13:07:22.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.153+0000 7fe08c200640 1 Processor -- start 2024-01-24T13:07:22.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.153+0000 7fe08c200640 1 -- start start 2024-01-24T13:07:22.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe08c200640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0840cd590 0x7fe084155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe08c200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe0840ce5c0 0x7fe0840c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe08c200640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe08415d870 0x7fe084150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe08c200640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840b5940 con 0x7fe0840cd590 2024-01-24T13:07:22.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe08c200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe084151520 con 0x7fe0840ce5c0 2024-01-24T13:07:22.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe08c200640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840b4a10 con 0x7fe08415d870 2024-01-24T13:07:22.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe089800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0840cd590 0x7fe084155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe089800640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0840cd590 0x7fe084155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43686/0 (socket says 172.21.15.29:43686) 2024-01-24T13:07:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe089800640 1 -- 172.21.15.29:0/1644529671 learned_addr learned my addr 172.21.15.29:0/1644529671 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe08a200640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe08415d870 0x7fe084150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe088e00640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe0840ce5c0 0x7fe0840c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe089800640 1 -- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe08415d870 msgr2=0x7fe084150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe089800640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe08415d870 0x7fe084150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe089800640 1 -- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe0840ce5c0 msgr2=0x7fe0840c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe089800640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe0840ce5c0 0x7fe0840c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe089800640 1 -- 172.21.15.29:0/1644529671 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe074009420 con 0x7fe0840cd590 2024-01-24T13:07:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe088e00640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe0840ce5c0 0x7fe0840c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe089800640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0840cd590 0x7fe084155ef0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe07400ec10 tx=0x7fe07400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe081600640 1 -- 172.21.15.29:0/1644529671 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07400cbd0 con 0x7fe0840cd590 2024-01-24T13:07:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe081600640 1 -- 172.21.15.29:0/1644529671 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07400cd30 con 0x7fe0840cd590 2024-01-24T13:07:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe08c200640 1 -- 172.21.15.29:0/1644529671 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe06c009420 con 0x7fe0840cd590 2024-01-24T13:07:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe081600640 1 -- 172.21.15.29:0/1644529671 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074013690 con 0x7fe0840cd590 2024-01-24T13:07:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe08c200640 1 -- 172.21.15.29:0/1644529671 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0840b4730 con 0x7fe0840cd590 2024-01-24T13:07:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe08c200640 1 -- 172.21.15.29:0/1644529671 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe08415dcd0 con 0x7fe0840cd590 2024-01-24T13:07:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.157+0000 7fe081600640 1 -- 172.21.15.29:0/1644529671 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe0740137f0 con 0x7fe0840cd590 2024-01-24T13:07:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.161+0000 7fe081600640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe05c065a90 0x7fe05c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.161+0000 7fe081600640 1 -- 172.21.15.29:0/1644529671 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe074083190 con 0x7fe0840cd590 2024-01-24T13:07:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.161+0000 7fe081600640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:6808/27231,v1:172.21.15.163:6809/27231] conn(0x7fe05c06bd90 0x7fe05c06e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.161+0000 7fe081600640 1 -- 172.21.15.29:0/1644529671 --> [v2:172.21.15.163:6808/27231,v1:172.21.15.163:6809/27231] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe05c06e8a0 con 0x7fe05c06bd90 2024-01-24T13:07:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.161+0000 7fe081600640 1 -- 172.21.15.29:0/1644529671 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe074085770 con 0x7fe0840cd590 2024-01-24T13:07:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.161+0000 7fe088e00640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe05c065a90 0x7fe05c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.161+0000 7fe08a200640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:6808/27231,v1:172.21.15.163:6809/27231] conn(0x7fe05c06bd90 0x7fe05c06e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.161+0000 7fe08a200640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:6808/27231,v1:172.21.15.163:6809/27231] conn(0x7fe05c06bd90 0x7fe05c06e1d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:22.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.161+0000 7fe088e00640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe05c065a90 0x7fe05c067f50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0097c0 tx=0x7fe06c0a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:22.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.161+0000 7fe081600640 1 -- 172.21.15.29:0/1644529671 <== osd.7 v2:172.21.15.163:6808/27231 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe05c06e8a0 con 0x7fe05c06bd90 2024-01-24T13:07:22.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.173+0000 7fe08c200640 1 -- 172.21.15.29:0/1644529671 --> [v2:172.21.15.163:6808/27231,v1:172.21.15.163:6809/27231] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe0840d10b0 con 0x7fe05c06bd90 2024-01-24T13:07:22.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.177+0000 7fe081600640 1 -- 172.21.15.29:0/1644529671 <== osd.7 v2:172.21.15.163:6808/27231 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe07c001fb0 con 0x7fe05c06bd90 2024-01-24T13:07:22.176 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-24T13:07:22.176 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T13:07:22.176 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-24T13:07:22.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.177+0000 7fe08c200640 1 -- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:6808/27231,v1:172.21.15.163:6809/27231] conn(0x7fe05c06bd90 msgr2=0x7fe05c06e1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.177+0000 7fe08c200640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:6808/27231,v1:172.21.15.163:6809/27231] conn(0x7fe05c06bd90 0x7fe05c06e1d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.177+0000 7fe08c200640 1 -- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe05c065a90 msgr2=0x7fe05c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.177+0000 7fe08c200640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fe05c065a90 0x7fe05c067f50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0097c0 tx=0x7fe06c0a6000 comp rx=0 tx=0).stop 2024-01-24T13:07:22.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.177+0000 7fe08c200640 1 -- 172.21.15.29:0/1644529671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0840cd590 msgr2=0x7fe084155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.177+0000 7fe08c200640 1 --2- 172.21.15.29:0/1644529671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0840cd590 0x7fe084155ef0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe07400ec10 tx=0x7fe07400c520 comp rx=0 tx=0).stop 2024-01-24T13:07:22.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.177+0000 7fe08a200640 1 -- 172.21.15.29:0/1644529671 reap_dead start 2024-01-24T13:07:22.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.177+0000 7fe08c200640 1 -- 172.21.15.29:0/1644529671 shutdown_connections 2024-01-24T13:07:22.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.177+0000 7fe08c200640 1 -- 172.21.15.29:0/1644529671 >> 172.21.15.29:0/1644529671 conn(0x7fe084069cd0 msgr2=0x7fe08406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:22.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.177+0000 7fe08c200640 1 -- 172.21.15.29:0/1644529671 shutdown_connections 2024-01-24T13:07:22.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.177+0000 7fe08c200640 1 -- 172.21.15.29:0/1644529671 wait complete. 2024-01-24T13:07:22.196 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-24T13:07:22.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.337+0000 7fa7b0400640 1 Processor -- start 2024-01-24T13:07:22.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.337+0000 7fa7b0400640 1 -- start start 2024-01-24T13:07:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.337+0000 7fa7b0400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa7a80d0150 0x7fa7a80ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.337+0000 7fa7b0400640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a80cd970 con 0x7fa7a80ce5c0 2024-01-24T13:07:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.337+0000 7fa7b0400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a80d05e0 con 0x7fa7a80cd590 2024-01-24T13:07:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.337+0000 7fa7b0400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a80ce9c0 con 0x7fa7a80d0150 2024-01-24T13:07:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.337+0000 7fa7ae400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa7a80ce5c0 0x7fa7a806b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43658/0 (socket says 172.21.15.29:43658) 2024-01-24T13:07:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.337+0000 7fa7ae400640 1 -- 172.21.15.29:0/1020363698 learned_addr learned my addr 172.21.15.29:0/1020363698 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.337+0000 7fa7ad000640 1 --2- 172.21.15.29:0/1020363698 >> v2:172.21.15.163:3300/0 conn(0x7fa7a80d0150 0x7fa7a80ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.337+0000 7fa7a7e00640 1 -- 172.21.15.29:0/1020363698 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110392736 0 0) 0x7fa7a80cd970 con 0x7fa7a80ce5c0 2024-01-24T13:07:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.337+0000 7fa7a7e00640 1 -- 172.21.15.29:0/1020363698 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa788003530 con 0x7fa7a80ce5c0 2024-01-24T13:07:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.337+0000 7fa7ad000640 1 -- 172.21.15.29:0/1020363698 >> v1:172.21.15.163:6789/0 conn(0x7fa7a80cd590 legacy=0x7fa7a815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.337+0000 7fa7ad000640 1 -- 172.21.15.29:0/1020363698 >> v1:172.21.15.29:6789/0 conn(0x7fa7a80ce5c0 legacy=0x7fa7a806b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.337+0000 7fa7ad000640 1 -- 172.21.15.29:0/1020363698 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a80d0810 con 0x7fa7a80d0150 2024-01-24T13:07:22.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.341+0000 7fa7ad000640 1 --2- 172.21.15.29:0/1020363698 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7a80d0150 0x7fa7a80ce080 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa7900097c0 tx=0x7fa79001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f56d8ca080a495c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:22.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.341+0000 7fa7a7e00640 1 -- 172.21.15.29:0/1020363698 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7900ab650 con 0x7fa7a80d0150 2024-01-24T13:07:22.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.341+0000 7fa7a7e00640 1 -- 172.21.15.29:0/1020363698 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7900ab7b0 con 0x7fa7a80d0150 2024-01-24T13:07:22.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.341+0000 7fa7a7e00640 1 -- 172.21.15.29:0/1020363698 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7900abb40 con 0x7fa7a80d0150 2024-01-24T13:07:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.341+0000 7fa7b0400640 1 -- 172.21.15.29:0/1020363698 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7a80d0150 msgr2=0x7fa7a80ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.341+0000 7fa7b0400640 1 --2- 172.21.15.29:0/1020363698 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7a80d0150 0x7fa7a80ce080 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa7900097c0 tx=0x7fa79001c450 comp rx=0 tx=0).stop 2024-01-24T13:07:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.341+0000 7fa7b0400640 1 -- 172.21.15.29:0/1020363698 shutdown_connections 2024-01-24T13:07:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.341+0000 7fa7b0400640 1 --2- 172.21.15.29:0/1020363698 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7a80d0150 0x7fa7a80ce080 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.341+0000 7fa7b0400640 1 -- 172.21.15.29:0/1020363698 >> 172.21.15.29:0/1020363698 conn(0x7fa7a8069cd0 msgr2=0x7fa7a806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.341+0000 7fa7b0400640 1 -- 172.21.15.29:0/1020363698 shutdown_connections 2024-01-24T13:07:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.341+0000 7fa7b0400640 1 -- 172.21.15.29:0/1020363698 wait complete. 2024-01-24T13:07:22.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7b0400640 1 Processor -- start 2024-01-24T13:07:22.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7b0400640 1 -- start start 2024-01-24T13:07:22.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7b0400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7a80cd590 0x7fa7a80cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7b0400640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa7a80ce5c0 0x7fa7a814ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7b0400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a80d0150 0x7fa7a8155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7b0400640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a815e720 con 0x7fa7a80d0150 2024-01-24T13:07:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7b0400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a8159d50 con 0x7fa7a80cd590 2024-01-24T13:07:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7b0400640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a815a030 con 0x7fa7a80ce5c0 2024-01-24T13:07:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7ae400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a80d0150 0x7fa7a8155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7ae400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a80d0150 0x7fa7a8155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43698/0 (socket says 172.21.15.29:43698) 2024-01-24T13:07:22.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7ae400640 1 -- 172.21.15.29:0/4258369205 learned_addr learned my addr 172.21.15.29:0/4258369205 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:22.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7ada00640 1 --2- 172.21.15.29:0/4258369205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7a80cd590 0x7fa7a80cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7ad000640 1 --2- 172.21.15.29:0/4258369205 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa7a80ce5c0 0x7fa7a814ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7ae400640 1 -- 172.21.15.29:0/4258369205 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa7a80ce5c0 msgr2=0x7fa7a814ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7ae400640 1 --2- 172.21.15.29:0/4258369205 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa7a80ce5c0 0x7fa7a814ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7ae400640 1 -- 172.21.15.29:0/4258369205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7a80cd590 msgr2=0x7fa7a80cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7ae400640 1 --2- 172.21.15.29:0/4258369205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7a80cd590 0x7fa7a80cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7ae400640 1 -- 172.21.15.29:0/4258369205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa790009420 con 0x7fa7a80d0150 2024-01-24T13:07:22.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7ae400640 1 --2- 172.21.15.29:0/4258369205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a80d0150 0x7fa7a8155e00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000cb40 tx=0x7fa7a000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:22.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7a5600640 1 -- 172.21.15.29:0/4258369205 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000aca0 con 0x7fa7a80d0150 2024-01-24T13:07:22.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7a5600640 1 -- 172.21.15.29:0/4258369205 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a000ae00 con 0x7fa7a80d0150 2024-01-24T13:07:22.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7a5600640 1 -- 172.21.15.29:0/4258369205 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0012620 con 0x7fa7a80d0150 2024-01-24T13:07:22.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7b0400640 1 -- 172.21.15.29:0/4258369205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a815a310 con 0x7fa7a80d0150 2024-01-24T13:07:22.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.345+0000 7fa7b0400640 1 -- 172.21.15.29:0/4258369205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a80cce40 con 0x7fa7a80d0150 2024-01-24T13:07:22.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.349+0000 7fa7b0400640 1 -- 172.21.15.29:0/4258369205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a815e890 con 0x7fa7a80d0150 2024-01-24T13:07:22.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.349+0000 7fa7a5600640 1 -- 172.21.15.29:0/4258369205 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa7a0007070 con 0x7fa7a80d0150 2024-01-24T13:07:22.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.349+0000 7fa7a5600640 1 --2- 172.21.15.29:0/4258369205 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa780065a60 0x7fa780067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.349+0000 7fa7a5600640 1 -- 172.21.15.29:0/4258369205 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa7a0082f70 con 0x7fa7a80d0150 2024-01-24T13:07:22.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.349+0000 7fa7ada00640 1 --2- 172.21.15.29:0/4258369205 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa780065a60 0x7fa780067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.349+0000 7fa7ada00640 1 --2- 172.21.15.29:0/4258369205 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa780065a60 0x7fa780067f20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa798007fd0 tx=0x7fa798009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:22.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.353+0000 7fa7a5600640 1 -- 172.21.15.29:0/4258369205 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa7a00b40b0 con 0x7fa7a80d0150 2024-01-24T13:07:22.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.513+0000 7fa7b0400640 1 -- 172.21.15.29:0/4258369205 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7a80d10b0 con 0x7fa780065a60 2024-01-24T13:07:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.513+0000 7fa7a5600640 1 -- 172.21.15.29:0/4258369205 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa7980014f0 con 0x7fa780065a60 2024-01-24T13:07:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 7 to deep-scrub 2024-01-24T13:07:22.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.517+0000 7fa7b0400640 1 -- 172.21.15.29:0/4258369205 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa780065a60 msgr2=0x7fa780067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.517+0000 7fa7b0400640 1 --2- 172.21.15.29:0/4258369205 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa780065a60 0x7fa780067f20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa798007fd0 tx=0x7fa798009040 comp rx=0 tx=0).stop 2024-01-24T13:07:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.517+0000 7fa7b0400640 1 -- 172.21.15.29:0/4258369205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a80d0150 msgr2=0x7fa7a8155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.517+0000 7fa7b0400640 1 --2- 172.21.15.29:0/4258369205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a80d0150 0x7fa7a8155e00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000cb40 tx=0x7fa7a000a060 comp rx=0 tx=0).stop 2024-01-24T13:07:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.517+0000 7fa7b0400640 1 -- 172.21.15.29:0/4258369205 shutdown_connections 2024-01-24T13:07:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.517+0000 7fa7b0400640 1 --2- 172.21.15.29:0/4258369205 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa780065a60 0x7fa780067f20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.517+0000 7fa7b0400640 1 --2- 172.21.15.29:0/4258369205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a80d0150 0x7fa7a8155e00 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.517+0000 7fa7b0400640 1 --2- 172.21.15.29:0/4258369205 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa7a80ce5c0 0x7fa7a814ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.517+0000 7fa7b0400640 1 --2- 172.21.15.29:0/4258369205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7a80cd590 0x7fa7a80cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.517+0000 7fa7b0400640 1 -- 172.21.15.29:0/4258369205 >> 172.21.15.29:0/4258369205 conn(0x7fa7a8069cd0 msgr2=0x7fa7a80c6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.517+0000 7fa7b0400640 1 -- 172.21.15.29:0/4258369205 shutdown_connections 2024-01-24T13:07:22.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.517+0000 7fa7b0400640 1 -- 172.21.15.29:0/4258369205 wait complete. 2024-01-24T13:07:22.536 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:07:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.677+0000 7fcab6c00640 1 Processor -- start 2024-01-24T13:07:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.677+0000 7fcab6c00640 1 -- start start 2024-01-24T13:07:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcab6c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcab015c770 0x7fcab006d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcab6c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcab00cedc0 0x7fcab00cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcab6c00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab015cb50 con 0x7fcab0071ce0 2024-01-24T13:07:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcab6c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab0070d10 con 0x7fcab015c770 2024-01-24T13:07:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcab6c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab0070f20 con 0x7fcab00cedc0 2024-01-24T13:07:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcab4c00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcab0071ce0 0x7fcab00cce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43666/0 (socket says 172.21.15.29:43666) 2024-01-24T13:07:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcab4c00640 1 -- 172.21.15.29:0/1987597863 learned_addr learned my addr 172.21.15.29:0/1987597863 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaafe00640 1 --2- 172.21.15.29:0/1987597863 >> v2:172.21.15.163:3300/0 conn(0x7fcab015c770 0x7fcab006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaf400640 1 --2- 172.21.15.29:0/1987597863 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcab00cedc0 0x7fcab00cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 -- 172.21.15.29:0/1987597863 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382775182 0 0) 0x7fcab015cb50 con 0x7fcab0071ce0 2024-01-24T13:07:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 -- 172.21.15.29:0/1987597863 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca90003530 con 0x7fcab0071ce0 2024-01-24T13:07:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 -- 172.21.15.29:0/1987597863 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1807382787 0 0) 0x7fca90003530 con 0x7fcab0071ce0 2024-01-24T13:07:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 -- 172.21.15.29:0/1987597863 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcab00cedc0 msgr2=0x7fcab00cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 --2- 172.21.15.29:0/1987597863 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcab00cedc0 0x7fcab00cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 -- 172.21.15.29:0/1987597863 >> v2:172.21.15.163:3300/0 conn(0x7fcab015c770 msgr2=0x7fcab006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 --2- 172.21.15.29:0/1987597863 >> v2:172.21.15.163:3300/0 conn(0x7fcab015c770 0x7fcab006d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 -- 172.21.15.29:0/1987597863 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab0071200 con 0x7fcab0071ce0 2024-01-24T13:07:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 -- 172.21.15.29:0/1987597863 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 263183785 0 0) 0x7fcaa8001a00 con 0x7fcab0071ce0 2024-01-24T13:07:22.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 -- 172.21.15.29:0/1987597863 >> v1:172.21.15.29:6789/0 conn(0x7fcab0071ce0 legacy=0x7fcab00cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 --2- 172.21.15.29:0/1987597863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca90003980 0x7fca90003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 --2- 172.21.15.29:0/1987597863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca900047d0 0x7fca90004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 --2- 172.21.15.29:0/1987597863 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcab00cedc0 0x7fca90005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 -- 172.21.15.29:0/1987597863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab0070d10 con 0x7fca900047d0 2024-01-24T13:07:22.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 -- 172.21.15.29:0/1987597863 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab0070f20 con 0x7fca90003980 2024-01-24T13:07:22.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaea00640 1 -- 172.21.15.29:0/1987597863 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9000b9c0 con 0x7fcab00cedc0 2024-01-24T13:07:22.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaf400640 1 --2- 172.21.15.29:0/1987597863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca900047d0 0x7fca90004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaafe00640 1 --2- 172.21.15.29:0/1987597863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca90003980 0x7fca90003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcab4c00640 1 --2- 172.21.15.29:0/1987597863 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcab00cedc0 0x7fca90005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaf400640 1 -- 172.21.15.29:0/1987597863 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcab00cedc0 msgr2=0x7fca90005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:22.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaf400640 1 --2- 172.21.15.29:0/1987597863 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcab00cedc0 0x7fca90005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaf400640 1 -- 172.21.15.29:0/1987597863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca90003980 msgr2=0x7fca90003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:22.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaf400640 1 --2- 172.21.15.29:0/1987597863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca90003980 0x7fca90003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.681+0000 7fcaaf400640 1 -- 172.21.15.29:0/1987597863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca90003530 con 0x7fca900047d0 2024-01-24T13:07:22.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.685+0000 7fcaaf400640 1 --2- 172.21.15.29:0/1987597863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca900047d0 0x7fca90004c50 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fca98009ae0 tx=0x7fca9801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0fdb3919c4de18 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:22.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.685+0000 7fcaaea00640 1 -- 172.21.15.29:0/1987597863 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca980a5510 con 0x7fca900047d0 2024-01-24T13:07:22.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.685+0000 7fcaaea00640 1 -- 172.21.15.29:0/1987597863 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca980a5670 con 0x7fca900047d0 2024-01-24T13:07:22.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.685+0000 7fcaaea00640 1 -- 172.21.15.29:0/1987597863 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca980a5a20 con 0x7fca900047d0 2024-01-24T13:07:22.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.685+0000 7fcab6c00640 1 -- 172.21.15.29:0/1987597863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca900047d0 msgr2=0x7fca90004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.685+0000 7fcab6c00640 1 --2- 172.21.15.29:0/1987597863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca900047d0 0x7fca90004c50 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fca98009ae0 tx=0x7fca9801c9c0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.685+0000 7fcab4c00640 1 -- 172.21.15.29:0/1987597863 reap_dead start 2024-01-24T13:07:22.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.685+0000 7fcab6c00640 1 -- 172.21.15.29:0/1987597863 shutdown_connections 2024-01-24T13:07:22.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.685+0000 7fcab6c00640 1 -- 172.21.15.29:0/1987597863 >> 172.21.15.29:0/1987597863 conn(0x7fcab006b1e0 msgr2=0x7fcab006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:22.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.685+0000 7fcab6c00640 1 -- 172.21.15.29:0/1987597863 shutdown_connections 2024-01-24T13:07:22.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.685+0000 7fcab6c00640 1 -- 172.21.15.29:0/1987597863 wait complete. 2024-01-24T13:07:22.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.685+0000 7fcab6c00640 1 Processor -- start 2024-01-24T13:07:22.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.685+0000 7fcab6c00640 1 -- start start 2024-01-24T13:07:22.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab6c00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca900047d0 0x7fcab0151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab6c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcab00b0f40 0x7fcab0161fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab6c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcab0162510 0x7fcab01629c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab6c00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00b2000 con 0x7fcab0162510 2024-01-24T13:07:22.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab6c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00b1410 con 0x7fcab00b0f40 2024-01-24T13:07:22.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab6c00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00b16f0 con 0x7fca900047d0 2024-01-24T13:07:22.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab4c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcab0162510 0x7fcab01629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab4c00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcab0162510 0x7fcab01629c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43708/0 (socket says 172.21.15.29:43708) 2024-01-24T13:07:22.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab4c00640 1 -- 172.21.15.29:0/2480480769 learned_addr learned my addr 172.21.15.29:0/2480480769 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:22.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcaafe00640 1 --2- 172.21.15.29:0/2480480769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca900047d0 0x7fcab0151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcaaf400640 1 --2- 172.21.15.29:0/2480480769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcab00b0f40 0x7fcab0161fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab4c00640 1 -- 172.21.15.29:0/2480480769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca900047d0 msgr2=0x7fcab0151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab4c00640 1 --2- 172.21.15.29:0/2480480769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca900047d0 0x7fcab0151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab4c00640 1 -- 172.21.15.29:0/2480480769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcab00b0f40 msgr2=0x7fcab0161fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab4c00640 1 --2- 172.21.15.29:0/2480480769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcab00b0f40 0x7fcab0161fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab4c00640 1 -- 172.21.15.29:0/2480480769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab00b19d0 con 0x7fcab0162510 2024-01-24T13:07:22.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab4c00640 1 --2- 172.21.15.29:0/2480480769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcab0162510 0x7fcab01629c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fcab00706b0 tx=0x7fcaa800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:22.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcaa7e00640 1 -- 172.21.15.29:0/2480480769 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa800ec10 con 0x7fcab0162510 2024-01-24T13:07:22.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcaa7e00640 1 -- 172.21.15.29:0/2480480769 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa800ed70 con 0x7fcab0162510 2024-01-24T13:07:22.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcaa7e00640 1 -- 172.21.15.29:0/2480480769 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa800eee0 con 0x7fcab0162510 2024-01-24T13:07:22.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab6c00640 1 -- 172.21.15.29:0/2480480769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab00b1cb0 con 0x7fcab0162510 2024-01-24T13:07:22.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab6c00640 1 -- 172.21.15.29:0/2480480769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab0160550 con 0x7fcab0162510 2024-01-24T13:07:22.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.689+0000 7fcab6c00640 1 -- 172.21.15.29:0/2480480769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab004e850 con 0x7fcab0162510 2024-01-24T13:07:22.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.693+0000 7fcaa7e00640 1 -- 172.21.15.29:0/2480480769 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcaa8013660 con 0x7fcab0162510 2024-01-24T13:07:22.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.693+0000 7fcaa7e00640 1 --2- 172.21.15.29:0/2480480769 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca88065a90 0x7fca88067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:22.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.693+0000 7fcaa7e00640 1 -- 172.21.15.29:0/2480480769 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fcaa8083420 con 0x7fcab0162510 2024-01-24T13:07:22.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.693+0000 7fcaafe00640 1 --2- 172.21.15.29:0/2480480769 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca88065a90 0x7fca88067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:22.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.693+0000 7fcaafe00640 1 --2- 172.21.15.29:0/2480480769 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca88065a90 0x7fca88067f50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009ba0 tx=0x7fcaa0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:22.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.697+0000 7fcaa7e00640 1 -- 172.21.15.29:0/2480480769 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fcaa8050fa0 con 0x7fcab0162510 2024-01-24T13:07:22.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.849+0000 7fcab6c00640 1 -- 172.21.15.29:0/2480480769 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcab006d640 con 0x7fca88065a90 2024-01-24T13:07:22.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.853+0000 7fcaa7e00640 1 -- 172.21.15.29:0/2480480769 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50522 (secure 0 0 0) 0x7fcaa00097f0 con 0x7fca88065a90 2024-01-24T13:07:22.853 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:22.853 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:07:22.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.853+0000 7fcab6c00640 1 -- 172.21.15.29:0/2480480769 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca88065a90 msgr2=0x7fca88067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.853+0000 7fcab6c00640 1 --2- 172.21.15.29:0/2480480769 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca88065a90 0x7fca88067f50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009ba0 tx=0x7fcaa0008040 comp rx=0 tx=0).stop 2024-01-24T13:07:22.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.853+0000 7fcab6c00640 1 -- 172.21.15.29:0/2480480769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcab0162510 msgr2=0x7fcab01629c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:22.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.853+0000 7fcab6c00640 1 --2- 172.21.15.29:0/2480480769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcab0162510 0x7fcab01629c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fcab00706b0 tx=0x7fcaa800e530 comp rx=0 tx=0).stop 2024-01-24T13:07:22.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.853+0000 7fcab6c00640 1 -- 172.21.15.29:0/2480480769 shutdown_connections 2024-01-24T13:07:22.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.853+0000 7fcab6c00640 1 --2- 172.21.15.29:0/2480480769 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fca88065a90 0x7fca88067f50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.853+0000 7fcab6c00640 1 --2- 172.21.15.29:0/2480480769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcab0162510 0x7fcab01629c0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.853+0000 7fcab6c00640 1 --2- 172.21.15.29:0/2480480769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcab00b0f40 0x7fcab0161fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.853+0000 7fcab6c00640 1 --2- 172.21.15.29:0/2480480769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca900047d0 0x7fcab0151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:22.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.853+0000 7fcab6c00640 1 -- 172.21.15.29:0/2480480769 >> 172.21.15.29:0/2480480769 conn(0x7fcab006b1e0 msgr2=0x7fcab00c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:22.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.853+0000 7fcab6c00640 1 -- 172.21.15.29:0/2480480769 shutdown_connections 2024-01-24T13:07:22.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:22.853+0000 7fcab6c00640 1 -- 172.21.15.29:0/2480480769 wait complete. 2024-01-24T13:07:22.874 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-01-24T13:07:21.587771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":239568,"kb_used_data":6984,"kb_used_omap":13,"kb_used_meta":232434,"kb_avail":754735152,"statfs":{"total":773094113280,"available":772848795648,"internally_reserved":0,"allocated":7151616,"data_stored":3821432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":238012504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.882638"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":197,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-01-24T13:07:12.238728+0000","last_change":"2024-01-24T13:03:45.524649+0000","last_active":"2024-01-24T13:07:12.238728+0000","last_peered":"2024-01-24T13:07:12.238728+0000","last_clean":"2024-01-24T13:07:12.238728+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:07:12.238728+0000","last_undegraded":"2024-01-24T13:07:12.238728+0000","last_fullsized":"2024-01-24T13:07:12.238728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T13:03:44.508574+0000","last_clean_scrub_stamp":"2024-01-24T13:03:44.508574+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:46:01.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27756,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":745472,"data_stored":330087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":1.702},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70499999999999996,"15min":0.72299999999999998},"min":{"1min":0.50800000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99099999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":1.407}]},{"osd":1,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.53400000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":1.51},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":1.139}]},{"osd":2,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.71899999999999997},"min":{"1min":0.53700000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94599999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.2250000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.54000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88500000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.8029999999999999}]},{"osd":3,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73599999999999999,"15min":0.747},"min":{"1min":0.57699999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93100000000000005,"5min":1.131,"15min":1.131},"last":1.851},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.502,"15min":0.502},"max":{"1min":0.95899999999999996,"5min":1.05,"15min":1.05},"last":1.55}]},{"osd":4,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80400000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67400000000000004,"15min":0.70299999999999996},"min":{"1min":0.41499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.82599999999999996,"5min":1.341,"15min":1.341},"last":1.893}]},{"osd":5,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88700000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.6100000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.69299999999999995},"min":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":1.6619999999999999}]},{"osd":6,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.7569999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.75,"15min":0.77400000000000002},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96299999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.931}]}]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27756,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":745472,"data_stored":330087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.76600000000000001,"15min":0.80400000000000005},"min":{"1min":0.47499999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88700000000000001,"5min":2.827,"15min":2.827},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.52900000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.878,"5min":2.052,"15min":2.052},"last":0.65500000000000003}]},{"osd":1,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51900000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91200000000000003,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.754},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.85999999999999999,"15min":0.94999999999999996},"min":{"1min":0.48999999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.872,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.497}]},{"osd":2,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.80400000000000005,"15min":0.87},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80600000000000005,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.88700000000000001,"15min":0.96699999999999997},"min":{"1min":0.51200000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.63100000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.86199999999999999,"15min":0.93999999999999995},"min":{"1min":0.503,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.874,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.78700000000000003,"15min":0.83499999999999996},"min":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84199999999999997,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.52400000000000002}]},{"osd":4,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.434,"5min":0.37,"15min":0.37},"max":{"1min":0.91900000000000004,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83299999999999996,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.69099999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.72199999999999998,"15min":0.77000000000000002},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84199999999999997,"5min":4.274,"15min":4.274},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78700000000000003,"15min":0.81399999999999995},"min":{"1min":0.53300000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89500000000000002,"5min":2.645,"15min":2.645},"last":0.77800000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.79300000000000004,"15min":0.85499999999999998},"min":{"1min":0.432,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80000000000000004,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.81399999999999995,"15min":0.87},"min":{"1min":0.55400000000000005,"5min":0.495,"15min":0.495},"max":{"1min":0.879,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.67200000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":330087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64500000000000002,"15min":0.64000000000000001},"min":{"1min":0.47099999999999997,"5min":0.434,"15min":0.434},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61499999999999999}]},{"osd":1,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91200000000000003,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.495,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.876,"5min":1.484,"15min":1.484},"last":0.67500000000000004}]},{"osd":2,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68400000000000005,"15min":0.67400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90500000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.48599999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88100000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92300000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.81100000000000005}]},{"osd":5,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.623,"15min":0.63},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.79400000000000004,"5min":1.002,"15min":1.002},"last":0.72599999999999998}]},{"osd":6,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64600000000000002,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85999999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.40999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.88800000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.78900000000000003}]},{"osd":7,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91900000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0620000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.95899999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31848,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":745472,"data_stored":330087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41999999999999998,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.623,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.35499999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45300000000000001,"15min":0.46899999999999997},"min":{"1min":0.313,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55600000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48399999999999999}]},{"osd":4,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.002,"5min":1.014,"15min":1.014},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.56200000000000006,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.57099999999999995}]},{"osd":6,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78000000000000003,"15min":0.80000000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.79600000000000004,"15min":0.83599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97899999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.628}]},{"osd":7,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80900000000000005,"15min":0.84299999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.82899999999999996,"15min":0.86199999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.61599999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31852,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":745472,"data_stored":330087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.28199999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70899999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61199999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47999999999999998}]},{"osd":1,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51800000000000002,"15min":0.54200000000000004},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72299999999999998,"5min":1.379,"15min":1.379},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80700000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.495,"15min":0.503},"min":{"1min":0.33900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.78100000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.60999999999999999,"15min":0.65000000000000002},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.747,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.504}]},{"osd":4,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95399999999999996,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"min":{"1min":0.55500000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98999999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.72999999999999998}]},{"osd":5,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0469999999999999,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81799999999999995,"15min":0.84399999999999997},"min":{"1min":0.60299999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.115,"5min":1.448,"15min":1.448},"last":0.60299999999999998}]},{"osd":6,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.59999999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.079,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.83399999999999996,"15min":0.85199999999999998},"min":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1319999999999999,"5min":1.554,"15min":1.554},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1539999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.65200000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509486,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1339392,"data_stored":920455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.48299999999999998,"15min":0.51800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63700000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.501},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.54200000000000004,"15min":0.58999999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59499999999999997,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.61699999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.52400000000000002,"15min":0.56399999999999995},"min":{"1min":0.31,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.55200000000000005,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.56699999999999995,"15min":0.60299999999999998},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66400000000000003,"5min":1.958,"15min":1.958},"last":0.59499999999999997}]},{"osd":3,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.623,"15min":0.66700000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67900000000000005,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.55600000000000005,"15min":0.58199999999999996},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55700000000000005}]},{"osd":4,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.78400000000000003,"15min":0.82899999999999996},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95999999999999996,"5min":1.601,"15min":1.601},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.80300000000000005,"15min":0.85499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.052,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.997}]},{"osd":5,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.79900000000000004,"15min":0.84499999999999997},"min":{"1min":0.504,"5min":0.502,"15min":0.502},"max":{"1min":1.101,"5min":1.627,"15min":1.627},"last":0.874},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.85199999999999998,"15min":0.91500000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.018,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.97099999999999997}]},{"osd":6,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81899999999999995,"15min":0.871},"min":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0369999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.81399999999999995,"15min":0.84999999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.079,"5min":1.421,"15min":1.421},"last":1.0149999999999999}]},{"osd":7,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81000000000000005,"15min":0.85399999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.93999999999999995,"5min":1.452,"15min":1.452},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.83699999999999997,"15min":0.89100000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98099999999999998,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.94499999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31848,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":745472,"data_stored":330087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.45600000000000002,"15min":0.48599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.629,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.64600000000000002,"15min":0.73499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64100000000000001,"5min":5.556,"15min":5.556},"last":0.47099999999999997}]},{"osd":2,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.67900000000000005,"15min":0.76300000000000001},"min":{"1min":0.33700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.69199999999999995,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.441},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.59799999999999998,"15min":0.64300000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.75600000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.68200000000000005}]},{"osd":3,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.54000000000000004,"15min":0.58399999999999996},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58299999999999996,"15min":0.623},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.745,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.39200000000000002}]},{"osd":4,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.80400000000000005,"15min":0.84399999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91700000000000004,"5min":1.925,"15min":1.925},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.749,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.876,"5min":1.512,"15min":1.512},"last":0.48899999999999999}]},{"osd":5,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.79200000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90800000000000003,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.84299999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.90700000000000003,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.63}]},{"osd":6,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80100000000000005,"15min":0.82899999999999996},"min":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.85899999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.81799999999999995,"15min":0.84999999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94199999999999995,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82399999999999995,"15min":0.85799999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.98299999999999998,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.94699999999999995,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.56000000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1339392,"data_stored":920455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.502,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.99299999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63200000000000001}]},{"osd":1,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84699999999999998,"5min":0.872,"15min":0.872},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.46600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.97599999999999998,"5min":1.012,"15min":1.012},"last":0.73799999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71999999999999997,"15min":0.72199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91400000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0029999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.77900000000000003}]},{"osd":3,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.498,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93200000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.754},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0389999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.71899999999999997}]},{"osd":4,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86699999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90100000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81499999999999995}]},{"osd":7,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95699999999999996,"5min":1.018,"15min":1.018},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.78300000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94299999999999995,"5min":1.107,"15min":1.107},"last":0.82499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:07:22.879 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-24T13:03:44.508574+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=24, tm_hour=13, tm_min=3, tm_sec=44, tm_wday=2, tm_yday=24, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=24, tm_hour=13, tm_min=7, tm_sec=17, tm_wday=2, tm_yday=24, tm_isdst=0) 2024-01-24T13:07:22.879 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-24T13:07:25.893 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:07:25.897 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:07:42.880 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T13:07:43.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.029+0000 7fa887e00640 1 Processor -- start 2024-01-24T13:07:43.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.029+0000 7fa887e00640 1 -- start start 2024-01-24T13:07:43.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.033+0000 7fa887e00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa880143d30 0x7fa88006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.033+0000 7fa887e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa88006c150 0x7fa8800cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.033+0000 7fa887e00640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88015aa30 con 0x7fa880143910 2024-01-24T13:07:43.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.033+0000 7fa887e00640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88006c5e0 con 0x7fa880143d30 2024-01-24T13:07:43.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.033+0000 7fa887e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800712a0 con 0x7fa88006c150 2024-01-24T13:07:43.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.033+0000 7fa884a00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa880143d30 0x7fa88006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.033+0000 7fa885400640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa880143910 0x7fa880070ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49904/0 (socket says 172.21.15.29:49904) 2024-01-24T13:07:43.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.033+0000 7fa885400640 1 -- 172.21.15.29:0/3865418682 learned_addr learned my addr 172.21.15.29:0/3865418682 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:43.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.033+0000 7fa885e00640 1 --2- 172.21.15.29:0/3865418682 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa88006c150 0x7fa8800cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.033+0000 7fa884a00640 1 -- 172.21.15.29:0/3865418682 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa88006c150 msgr2=0x7fa8800cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:43.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.033+0000 7fa884a00640 1 --2- 172.21.15.29:0/3865418682 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa88006c150 0x7fa8800cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.033+0000 7fa884a00640 1 -- 172.21.15.29:0/3865418682 >> v1:172.21.15.29:6789/0 conn(0x7fa880143910 legacy=0x7fa880070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.033+0000 7fa884a00640 1 -- 172.21.15.29:0/3865418682 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa880071580 con 0x7fa880143d30 2024-01-24T13:07:43.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.037+0000 7fa884a00640 1 --2- 172.21.15.29:0/3865418682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa880143d30 0x7fa88006bc10 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa8700097c0 tx=0x7fa87001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ebd41085b316b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:43.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.037+0000 7fa87fe00640 1 -- 172.21.15.29:0/3865418682 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8700ab600 con 0x7fa880143d30 2024-01-24T13:07:43.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.037+0000 7fa87fe00640 1 -- 172.21.15.29:0/3865418682 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8700a7050 con 0x7fa880143d30 2024-01-24T13:07:43.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.037+0000 7fa87fe00640 1 -- 172.21.15.29:0/3865418682 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8700ab980 con 0x7fa880143d30 2024-01-24T13:07:43.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.037+0000 7fa887e00640 1 -- 172.21.15.29:0/3865418682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa880143d30 msgr2=0x7fa88006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.037+0000 7fa887e00640 1 --2- 172.21.15.29:0/3865418682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa880143d30 0x7fa88006bc10 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa8700097c0 tx=0x7fa87001c480 comp rx=0 tx=0).stop 2024-01-24T13:07:43.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.037+0000 7fa887e00640 1 -- 172.21.15.29:0/3865418682 shutdown_connections 2024-01-24T13:07:43.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.037+0000 7fa887e00640 1 --2- 172.21.15.29:0/3865418682 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa88006c150 0x7fa8800cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.037+0000 7fa887e00640 1 --2- 172.21.15.29:0/3865418682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa880143d30 0x7fa88006bc10 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.037+0000 7fa887e00640 1 -- 172.21.15.29:0/3865418682 >> 172.21.15.29:0/3865418682 conn(0x7fa8800b3950 msgr2=0x7fa880069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:43.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.037+0000 7fa887e00640 1 -- 172.21.15.29:0/3865418682 shutdown_connections 2024-01-24T13:07:43.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.037+0000 7fa887e00640 1 -- 172.21.15.29:0/3865418682 wait complete. 2024-01-24T13:07:43.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa887e00640 1 Processor -- start 2024-01-24T13:07:43.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa887e00640 1 -- start start 2024-01-24T13:07:43.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa887e00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa88006c150 0x7fa880137cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa887e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa880143910 0x7fa88015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa887e00640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa880143d30 0x7fa88015b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa887e00640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa880151540 con 0x7fa88006c150 2024-01-24T13:07:43.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa887e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa880151820 con 0x7fa880143910 2024-01-24T13:07:43.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa887e00640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa880151b00 con 0x7fa880143d30 2024-01-24T13:07:43.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa885400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa88006c150 0x7fa880137cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa885400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa88006c150 0x7fa880137cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35042/0 (socket says 172.21.15.29:35042) 2024-01-24T13:07:43.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa885400640 1 -- 172.21.15.29:0/1307580029 learned_addr learned my addr 172.21.15.29:0/1307580029 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:43.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa884a00640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa880143910 0x7fa88015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa885e00640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa880143d30 0x7fa88015b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa885400640 1 -- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa880143d30 msgr2=0x7fa88015b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa885400640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa880143d30 0x7fa88015b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa885400640 1 -- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa880143910 msgr2=0x7fa88015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa885400640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa880143910 0x7fa88015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa885400640 1 -- 172.21.15.29:0/1307580029 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870009420 con 0x7fa88006c150 2024-01-24T13:07:43.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa885e00640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa880143d30 0x7fa88015b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T13:07:43.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa885400640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa88006c150 0x7fa880137cc0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fa86800c500 tx=0x7fa86800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:43.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa87d600640 1 -- 172.21.15.29:0/1307580029 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868005cf0 con 0x7fa88006c150 2024-01-24T13:07:43.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa87d600640 1 -- 172.21.15.29:0/1307580029 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa868005e50 con 0x7fa88006c150 2024-01-24T13:07:43.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa87d600640 1 -- 172.21.15.29:0/1307580029 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8680072f0 con 0x7fa88006c150 2024-01-24T13:07:43.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa887e00640 1 -- 172.21.15.29:0/1307580029 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa880151de0 con 0x7fa88006c150 2024-01-24T13:07:43.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa887e00640 1 -- 172.21.15.29:0/1307580029 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa880157cc0 con 0x7fa88006c150 2024-01-24T13:07:43.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.041+0000 7fa887e00640 1 -- 172.21.15.29:0/1307580029 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88004e850 con 0x7fa88006c150 2024-01-24T13:07:43.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.045+0000 7fa87d600640 1 -- 172.21.15.29:0/1307580029 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa868007450 con 0x7fa88006c150 2024-01-24T13:07:43.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.045+0000 7fa87d600640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa858065a60 0x7fa858067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.045+0000 7fa87d600640 1 -- 172.21.15.29:0/1307580029 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa868082330 con 0x7fa88006c150 2024-01-24T13:07:43.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.045+0000 7fa884a00640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa858065a60 0x7fa858067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.045+0000 7fa884a00640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa858065a60 0x7fa858067f20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa8700ad000 tx=0x7fa870008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:43.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.049+0000 7fa87d600640 1 -- 172.21.15.29:0/1307580029 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa86804ff50 con 0x7fa88006c150 2024-01-24T13:07:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.201+0000 7fa887e00640 1 -- 172.21.15.29:0/1307580029 --> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa880151990 con 0x7fa858065a60 2024-01-24T13:07:43.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.205+0000 7fa87d600640 1 -- 172.21.15.29:0/1307580029 <== mgr.4111 v2:172.21.15.163:6832/26915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50454 (secure 0 0 0) 0x7fa880151990 con 0x7fa858065a60 2024-01-24T13:07:43.206 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:43.207 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-24T13:07:43.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.209+0000 7fa887e00640 1 -- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa858065a60 msgr2=0x7fa858067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.209+0000 7fa887e00640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa858065a60 0x7fa858067f20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa8700ad000 tx=0x7fa870008040 comp rx=0 tx=0).stop 2024-01-24T13:07:43.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.209+0000 7fa887e00640 1 -- 172.21.15.29:0/1307580029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa88006c150 msgr2=0x7fa880137cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.209+0000 7fa887e00640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa88006c150 0x7fa880137cc0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fa86800c500 tx=0x7fa86800c9c0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.209+0000 7fa887e00640 1 -- 172.21.15.29:0/1307580029 shutdown_connections 2024-01-24T13:07:43.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.209+0000 7fa887e00640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fa858065a60 0x7fa858067f20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.209+0000 7fa887e00640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa880143d30 0x7fa88015b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.209+0000 7fa887e00640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa880143910 0x7fa88015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.209+0000 7fa887e00640 1 --2- 172.21.15.29:0/1307580029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa88006c150 0x7fa880137cc0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.209+0000 7fa887e00640 1 -- 172.21.15.29:0/1307580029 >> 172.21.15.29:0/1307580029 conn(0x7fa8800b3950 msgr2=0x7fa880141340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:43.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.209+0000 7fa887e00640 1 -- 172.21.15.29:0/1307580029 shutdown_connections 2024-01-24T13:07:43.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.209+0000 7fa887e00640 1 -- 172.21.15.29:0/1307580029 wait complete. 2024-01-24T13:07:43.228 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-01-24T13:07:41.592021+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":239556,"kb_used_data":6984,"kb_used_omap":13,"kb_used_meta":232434,"kb_avail":754735164,"statfs":{"total":773094113280,"available":772848807936,"internally_reserved":0,"allocated":7151616,"data_stored":3821432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":238012504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002718"},"pg_stats":[{"pgid":"1.0","version":"62'119","reported_seq":211,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-01-24T13:07:22.045350+0000","last_change":"2024-01-24T13:07:22.045466+0000","last_active":"2024-01-24T13:07:22.045350+0000","last_peered":"2024-01-24T13:07:22.045350+0000","last_clean":"2024-01-24T13:07:22.045350+0000","last_became_active":"2024-01-24T13:03:45.524406+0000","last_became_peered":"2024-01-24T13:03:45.524406+0000","last_unstale":"2024-01-24T13:07:22.045350+0000","last_undegraded":"2024-01-24T13:07:22.045350+0000","last_fullsized":"2024-01-24T13:07:22.045350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'119","last_scrub_stamp":"2024-01-24T13:07:22.045331+0000","last_deep_scrub":"62'119","last_deep_scrub_stamp":"2024-01-24T13:07:22.045331+0000","last_clean_scrub_stamp":"2024-01-24T13:07:22.045331+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:19:01.251213+0000","scrub_duration":0.0074983719999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27756,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":745472,"data_stored":330087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.876},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70499999999999996,"15min":0.72299999999999998},"min":{"1min":0.50800000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99099999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.82199999999999995}]},{"osd":1,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.53400000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.80100000000000005}]},{"osd":2,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.71899999999999997},"min":{"1min":0.53700000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94599999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.54000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88500000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.75800000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73599999999999999,"15min":0.747},"min":{"1min":0.57699999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93100000000000005,"5min":1.131,"15min":1.131},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.54700000000000004,"5min":0.502,"15min":0.502},"max":{"1min":0.95899999999999996,"5min":1.05,"15min":1.05},"last":0.78300000000000003}]},{"osd":4,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80400000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.503},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67400000000000004,"15min":0.70299999999999996},"min":{"1min":0.41499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.82599999999999996,"5min":1.341,"15min":1.341},"last":0.56899999999999995}]},{"osd":5,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88700000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.69299999999999995},"min":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.54200000000000004}]},{"osd":6,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.75,"15min":0.77400000000000002},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96299999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.68400000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27756,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":745472,"data_stored":330087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.76600000000000001,"15min":0.80400000000000005},"min":{"1min":0.47499999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88700000000000001,"5min":2.827,"15min":2.827},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.52900000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.878,"5min":2.052,"15min":2.052},"last":0.621}]},{"osd":1,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51900000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91200000000000003,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.85999999999999999,"15min":0.94999999999999996},"min":{"1min":0.48999999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.872,"5min":5.5579999999999998,"15min":5.5579999999999998},"last":0.68400000000000005}]},{"osd":2,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.80400000000000005,"15min":0.87},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80600000000000005,"5min":4.3289999999999997,"15min":4.3289999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.88700000000000001,"15min":0.96699999999999997},"min":{"1min":0.51200000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":4.9009999999999998,"15min":4.9009999999999998},"last":0.70899999999999996}]},{"osd":3,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.86199999999999999,"15min":0.93999999999999995},"min":{"1min":0.503,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.874,"5min":5.6059999999999999,"15min":5.6059999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.78700000000000003,"15min":0.83499999999999996},"min":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84199999999999997,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.72099999999999997}]},{"osd":4,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.434,"5min":0.37,"15min":0.37},"max":{"1min":0.91900000000000004,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83299999999999996,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.46200000000000002}]},{"osd":5,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.72199999999999998,"15min":0.77000000000000002},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84199999999999997,"5min":4.274,"15min":4.274},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78700000000000003,"15min":0.81399999999999995},"min":{"1min":0.53300000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89500000000000002,"5min":2.645,"15min":2.645},"last":0.59199999999999997}]},{"osd":7,"last update":"Wed Jan 24 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.79300000000000004,"15min":0.85499999999999998},"min":{"1min":0.432,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80000000000000004,"5min":5.6449999999999996,"15min":5.6449999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.81399999999999995,"15min":0.87},"min":{"1min":0.55400000000000005,"5min":0.495,"15min":0.495},"max":{"1min":0.879,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.64500000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":330087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64500000000000002,"15min":0.64000000000000001},"min":{"1min":0.47099999999999997,"5min":0.434,"15min":0.434},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.76500000000000001}]},{"osd":1,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91200000000000003,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.872},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.495,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.876,"5min":1.484,"15min":1.484},"last":0.91300000000000003}]},{"osd":2,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68400000000000005,"15min":0.67400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90500000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.48599999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88100000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.93700000000000006}]},{"osd":3,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92300000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.79000000000000004}]},{"osd":5,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.623,"15min":0.63},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.79400000000000004,"5min":1.002,"15min":1.002},"last":0.64900000000000002}]},{"osd":6,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64600000000000002,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85999999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.40999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.88800000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.71099999999999997}]},{"osd":7,"last update":"Wed Jan 24 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91900000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0620000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.73899999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31848,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":745472,"data_stored":330087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41999999999999998,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.623,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.438,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.375}]},{"osd":1,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45300000000000001,"15min":0.46899999999999997},"min":{"1min":0.313,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55600000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.501},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.45300000000000001}]},{"osd":4,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.002,"5min":1.014,"15min":1.014},"last":0.71799999999999997}]},{"osd":5,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.56200000000000006,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.78500000000000003}]},{"osd":6,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78000000000000003,"15min":0.80000000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.79600000000000004,"15min":0.83599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97899999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.80100000000000005}]},{"osd":7,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80900000000000005,"15min":0.84299999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.749},{"interface":"front","average":{"1min":0.752,"5min":0.82899999999999996,"15min":0.86199999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.77100000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31852,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":745472,"data_stored":330087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45100000000000001,"15min":0.47899999999999998},"min":{"1min":0.28199999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70899999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61199999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.72099999999999997}]},{"osd":1,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51800000000000002,"15min":0.54200000000000004},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72299999999999998,"5min":1.379,"15min":1.379},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80700000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.627}]},{"osd":3,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.495,"15min":0.503},"min":{"1min":0.33900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.78100000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.60999999999999999,"15min":0.65000000000000002},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.747,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95399999999999996,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"min":{"1min":0.55500000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98999999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.82899999999999996}]},{"osd":5,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0469999999999999,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81799999999999995,"15min":0.84399999999999997},"min":{"1min":0.60299999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.115,"5min":1.448,"15min":1.448},"last":0.754}]},{"osd":6,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.59999999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.079,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Wed Jan 24 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.83399999999999996,"15min":0.85199999999999998},"min":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1319999999999999,"5min":1.554,"15min":1.554},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1539999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.77000000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1339392,"data_stored":920455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.48299999999999998,"15min":0.51800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63700000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.54200000000000004,"15min":0.58999999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59499999999999997,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.66400000000000003}]},{"osd":2,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.52400000000000002,"15min":0.56399999999999995},"min":{"1min":0.31,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.55200000000000005,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.56699999999999995,"15min":0.60299999999999998},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66400000000000003,"5min":1.958,"15min":1.958},"last":0.51000000000000001}]},{"osd":3,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.623,"15min":0.66700000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.67900000000000005,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.55600000000000005,"15min":0.58199999999999996},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.624}]},{"osd":4,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.78400000000000003,"15min":0.82899999999999996},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95999999999999996,"5min":1.601,"15min":1.601},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.80300000000000005,"15min":0.85499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.052,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.83299999999999996}]},{"osd":5,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.79900000000000004,"15min":0.84499999999999997},"min":{"1min":0.504,"5min":0.502,"15min":0.502},"max":{"1min":1.101,"5min":1.627,"15min":1.627},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.85199999999999998,"15min":0.91500000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.018,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.86699999999999999}]},{"osd":6,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81899999999999995,"15min":0.871},"min":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0369999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.81399999999999995,"15min":0.84999999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.079,"5min":1.421,"15min":1.421},"last":0.90500000000000003}]},{"osd":7,"last update":"Wed Jan 24 13:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81000000000000005,"15min":0.85399999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.93999999999999995,"5min":1.452,"15min":1.452},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.83699999999999997,"15min":0.89100000000000001},"min":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98099999999999998,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.879}]}]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31848,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":745472,"data_stored":330087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.45600000000000002,"15min":0.48599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.629,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.64600000000000002,"15min":0.73499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64100000000000001,"5min":5.556,"15min":5.556},"last":0.73799999999999999}]},{"osd":2,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.67900000000000005,"15min":0.76300000000000001},"min":{"1min":0.33700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.69199999999999995,"5min":5.3929999999999998,"15min":5.3929999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.59799999999999998,"15min":0.64300000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.75600000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.68700000000000006}]},{"osd":3,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.54000000000000004,"15min":0.58399999999999996},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58299999999999996,"15min":0.623},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.745,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.621}]},{"osd":4,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.80400000000000005,"15min":0.84399999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91700000000000004,"5min":1.925,"15min":1.925},"last":1.079},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.749,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.876,"5min":1.512,"15min":1.512},"last":1.119}]},{"osd":5,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.79200000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90800000000000003,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.84299999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.90700000000000003,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.167}]},{"osd":6,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80100000000000005,"15min":0.82899999999999996},"min":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.85899999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.044},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.81799999999999995,"15min":0.84999999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94199999999999995,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.2230000000000001}]},{"osd":7,"last update":"Wed Jan 24 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82399999999999995,"15min":0.85799999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.98299999999999998,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.94699999999999995,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.1919999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28324,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343516,"statfs":{"total":96636764160,"available":96607760384,"internally_reserved":0,"allocated":1339392,"data_stored":920455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.502,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.99299999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.83499999999999996}]},{"osd":1,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84699999999999998,"5min":0.872,"15min":0.872},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67900000000000005,"15min":0.68700000000000006},"min":{"1min":0.46600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.97599999999999998,"5min":1.012,"15min":1.012},"last":0.81699999999999995}]},{"osd":2,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71999999999999997,"15min":0.72199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91400000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0029999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.84599999999999997}]},{"osd":3,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.498,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93200000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0389999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.755}]},{"osd":4,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86699999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90100000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.876},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed Jan 24 13:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95699999999999996,"5min":1.018,"15min":1.018},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.78300000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94299999999999995,"5min":1.107,"15min":1.107},"last":0.89400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T13:07:43.230 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-24T13:07:43.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd040600640 1 Processor -- start 2024-01-24T13:07:43.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd040600640 1 -- start start 2024-01-24T13:07:43.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd040600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd038158ca0 0x7fd0380b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd040600640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd03806bbc0 0x7fd03806c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd040600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03806c560 con 0x7fd03806fe50 2024-01-24T13:07:43.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd040600640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd038159080 con 0x7fd03806bbc0 2024-01-24T13:07:43.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd040600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd038070ba0 con 0x7fd038158ca0 2024-01-24T13:07:43.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd03d200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd03806bbc0 0x7fd03806c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd03d200640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd03806bbc0 0x7fd03806c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35048/0 (socket says 172.21.15.29:35048) 2024-01-24T13:07:43.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd03d200640 1 -- 172.21.15.29:0/1477055443 learned_addr learned my addr 172.21.15.29:0/1477055443 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:43.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd03e600640 1 --1- 172.21.15.29:0/1477055443 >> v1:172.21.15.29:6789/0 conn(0x7fd03806fe50 0x7fd0380702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49914/0 (socket says 172.21.15.29:49914) 2024-01-24T13:07:43.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd03dc00640 1 --2- 172.21.15.29:0/1477055443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd038158ca0 0x7fd0380b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd03d200640 1 -- 172.21.15.29:0/1477055443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd038158ca0 msgr2=0x7fd0380b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T13:07:43.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd03d200640 1 --2- 172.21.15.29:0/1477055443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd038158ca0 0x7fd0380b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd03d200640 1 -- 172.21.15.29:0/1477055443 >> v1:172.21.15.29:6789/0 conn(0x7fd03806fe50 legacy=0x7fd0380702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd03d200640 1 -- 172.21.15.29:0/1477055443 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0380b18c0 con 0x7fd03806bbc0 2024-01-24T13:07:43.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.369+0000 7fd037e00640 1 -- 172.21.15.29:0/1477055443 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611237984 0 0) 0x7fd03806c560 con 0x7fd03806fe50 2024-01-24T13:07:43.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.373+0000 7fd03d200640 1 --2- 172.21.15.29:0/1477055443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd03806bbc0 0x7fd03806c020 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd020009870 tx=0x7fd02001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbf60a5bdc94e50 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:43.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.373+0000 7fd037e00640 1 -- 172.21.15.29:0/1477055443 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0200ac410 con 0x7fd03806bbc0 2024-01-24T13:07:43.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.373+0000 7fd037e00640 1 -- 172.21.15.29:0/1477055443 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0200ac570 con 0x7fd03806bbc0 2024-01-24T13:07:43.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.373+0000 7fd037e00640 1 -- 172.21.15.29:0/1477055443 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0200ac900 con 0x7fd03806bbc0 2024-01-24T13:07:43.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.373+0000 7fd040600640 1 -- 172.21.15.29:0/1477055443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd03806bbc0 msgr2=0x7fd03806c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.373+0000 7fd040600640 1 --2- 172.21.15.29:0/1477055443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd03806bbc0 0x7fd03806c020 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd020009870 tx=0x7fd02001c540 comp rx=0 tx=0).stop 2024-01-24T13:07:43.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd040600640 1 -- 172.21.15.29:0/1477055443 shutdown_connections 2024-01-24T13:07:43.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd040600640 1 --2- 172.21.15.29:0/1477055443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd03806bbc0 0x7fd03806c020 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd040600640 1 --2- 172.21.15.29:0/1477055443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd038158ca0 0x7fd0380b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd040600640 1 -- 172.21.15.29:0/1477055443 >> 172.21.15.29:0/1477055443 conn(0x7fd03806d700 msgr2=0x7fd038069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:43.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd040600640 1 -- 172.21.15.29:0/1477055443 shutdown_connections 2024-01-24T13:07:43.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd040600640 1 -- 172.21.15.29:0/1477055443 wait complete. 2024-01-24T13:07:43.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd040600640 1 Processor -- start 2024-01-24T13:07:43.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd040600640 1 -- start start 2024-01-24T13:07:43.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd040600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd03806bbc0 0x7fd0380c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd040600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd03806fe50 0x7fd03813aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd040600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd038158ca0 0x7fd0380ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd040600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0380ca060 con 0x7fd03806bbc0 2024-01-24T13:07:43.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd040600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd038152600 con 0x7fd03806fe50 2024-01-24T13:07:43.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd040600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0381528e0 con 0x7fd038158ca0 2024-01-24T13:07:43.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd03dc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd03806bbc0 0x7fd0380c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd03dc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd03806bbc0 0x7fd0380c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35056/0 (socket says 172.21.15.29:35056) 2024-01-24T13:07:43.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd03dc00640 1 -- 172.21.15.29:0/1168328626 learned_addr learned my addr 172.21.15.29:0/1168328626 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:43.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd03d200640 1 --2- 172.21.15.29:0/1168328626 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd03806fe50 0x7fd03813aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd03e600640 1 --2- 172.21.15.29:0/1168328626 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd038158ca0 0x7fd0380ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd03dc00640 1 -- 172.21.15.29:0/1168328626 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd038158ca0 msgr2=0x7fd0380ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd03dc00640 1 --2- 172.21.15.29:0/1168328626 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd038158ca0 0x7fd0380ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd03dc00640 1 -- 172.21.15.29:0/1168328626 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd03806fe50 msgr2=0x7fd03813aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd03dc00640 1 --2- 172.21.15.29:0/1168328626 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd03806fe50 0x7fd03813aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.377+0000 7fd03dc00640 1 -- 172.21.15.29:0/1168328626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0200094d0 con 0x7fd03806bbc0 2024-01-24T13:07:43.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.381+0000 7fd03dc00640 1 --2- 172.21.15.29:0/1168328626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd03806bbc0 0x7fd0380c9b20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd02800d5f0 tx=0x7fd02800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:43.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.381+0000 7fd035600640 1 -- 172.21.15.29:0/1168328626 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0280125f0 con 0x7fd03806bbc0 2024-01-24T13:07:43.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.381+0000 7fd035600640 1 -- 172.21.15.29:0/1168328626 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd028012750 con 0x7fd03806bbc0 2024-01-24T13:07:43.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.381+0000 7fd035600640 1 -- 172.21.15.29:0/1168328626 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd028012ae0 con 0x7fd03806bbc0 2024-01-24T13:07:43.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.381+0000 7fd040600640 1 -- 172.21.15.29:0/1168328626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd038152bc0 con 0x7fd03806bbc0 2024-01-24T13:07:43.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.381+0000 7fd040600640 1 -- 172.21.15.29:0/1168328626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03813af40 con 0x7fd03806bbc0 2024-01-24T13:07:43.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.381+0000 7fd040600640 1 -- 172.21.15.29:0/1168328626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03804e850 con 0x7fd03806bbc0 2024-01-24T13:07:43.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.381+0000 7fd035600640 1 -- 172.21.15.29:0/1168328626 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd028012c40 con 0x7fd03806bbc0 2024-01-24T13:07:43.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.381+0000 7fd035600640 1 --2- 172.21.15.29:0/1168328626 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd010065a60 0x7fd010067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.381+0000 7fd035600640 1 -- 172.21.15.29:0/1168328626 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd0280833f0 con 0x7fd03806bbc0 2024-01-24T13:07:43.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.381+0000 7fd03d200640 1 --2- 172.21.15.29:0/1168328626 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd010065a60 0x7fd010067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.385+0000 7fd03d200640 1 --2- 172.21.15.29:0/1168328626 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd010065a60 0x7fd010067f20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd0200ae000 tx=0x7fd020009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:43.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.385+0000 7fd035600640 1 -- 172.21.15.29:0/1168328626 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd028050f80 con 0x7fd03806bbc0 2024-01-24T13:07:43.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.545+0000 7fd040600640 1 -- 172.21.15.29:0/1168328626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fd0380c74b0 con 0x7fd03806bbc0 2024-01-24T13:07:43.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.549+0000 7fd035600640 1 -- 172.21.15.29:0/1168328626 <== mon.0 v2:172.21.15.29:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd028012ef0 con 0x7fd03806bbc0 2024-01-24T13:07:43.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.549+0000 7fd035600640 1 -- 172.21.15.29:0/1168328626 <== mon.0 v2:172.21.15.29:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd028081e60 con 0x7fd03806bbc0 2024-01-24T13:07:43.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.553+0000 7fd040600640 1 -- 172.21.15.29:0/1168328626 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd010065a60 msgr2=0x7fd010067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.553+0000 7fd040600640 1 --2- 172.21.15.29:0/1168328626 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd010065a60 0x7fd010067f20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd0200ae000 tx=0x7fd020009040 comp rx=0 tx=0).stop 2024-01-24T13:07:43.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.553+0000 7fd040600640 1 -- 172.21.15.29:0/1168328626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd03806bbc0 msgr2=0x7fd0380c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.553+0000 7fd040600640 1 --2- 172.21.15.29:0/1168328626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd03806bbc0 0x7fd0380c9b20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd02800d5f0 tx=0x7fd02800dab0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.553+0000 7fd040600640 1 -- 172.21.15.29:0/1168328626 shutdown_connections 2024-01-24T13:07:43.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.553+0000 7fd040600640 1 --2- 172.21.15.29:0/1168328626 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7fd010065a60 0x7fd010067f20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.553+0000 7fd040600640 1 --2- 172.21.15.29:0/1168328626 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd038158ca0 0x7fd0380ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.553+0000 7fd040600640 1 --2- 172.21.15.29:0/1168328626 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd03806fe50 0x7fd03813aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.553+0000 7fd040600640 1 --2- 172.21.15.29:0/1168328626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd03806bbc0 0x7fd0380c9b20 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.553+0000 7fd040600640 1 -- 172.21.15.29:0/1168328626 >> 172.21.15.29:0/1168328626 conn(0x7fd03806d700 msgr2=0x7fd038069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:43.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.553+0000 7fd040600640 1 -- 172.21.15.29:0/1168328626 shutdown_connections 2024-01-24T13:07:43.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.553+0000 7fd040600640 1 -- 172.21.15.29:0/1168328626 wait complete. 2024-01-24T13:07:43.573 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-24T13:07:43.573 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T13:07:43.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.713+0000 7f9366600640 1 Processor -- start 2024-01-24T13:07:43.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.713+0000 7f9366600640 1 -- start start 2024-01-24T13:07:43.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.717+0000 7f9366600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f936006a7c0 0x7f9360158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.717+0000 7f9366600640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936015c830 con 0x7f9360070240 2024-01-24T13:07:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.717+0000 7f9366600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936015cb10 con 0x7f936006a3e0 2024-01-24T13:07:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.717+0000 7f9366600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936015cdf0 con 0x7f936006a7c0 2024-01-24T13:07:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.717+0000 7f935fe00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9360070240 0x7f93600706d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49916/0 (socket says 172.21.15.29:49916) 2024-01-24T13:07:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.717+0000 7f935fe00640 1 -- 172.21.15.29:0/4207501145 learned_addr learned my addr 172.21.15.29:0/4207501145 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-24T13:07:43.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.717+0000 7f935ea00640 1 --2- 172.21.15.29:0/4207501145 >> v2:172.21.15.163:3300/0 conn(0x7f936006a7c0 0x7f9360158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.717+0000 7f935e000640 1 -- 172.21.15.29:0/4207501145 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867237830 0 0) 0x7f936015c830 con 0x7f9360070240 2024-01-24T13:07:43.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.717+0000 7f935e000640 1 -- 172.21.15.29:0/4207501145 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9340003530 con 0x7f9360070240 2024-01-24T13:07:43.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.717+0000 7f935ea00640 1 -- 172.21.15.29:0/4207501145 >> v1:172.21.15.163:6789/0 conn(0x7f936006a3e0 legacy=0x7f93601588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.717+0000 7f935ea00640 1 -- 172.21.15.29:0/4207501145 >> v1:172.21.15.29:6789/0 conn(0x7f9360070240 legacy=0x7f93600706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.717+0000 7f935ea00640 1 -- 172.21.15.29:0/4207501145 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936015d0d0 con 0x7f936006a7c0 2024-01-24T13:07:43.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.721+0000 7f935ea00640 1 --2- 172.21.15.29:0/4207501145 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f936006a7c0 0x7f9360158fe0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f93480097c0 tx=0x7f934801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4c6df01e59cf124 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:43.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.721+0000 7f935e000640 1 -- 172.21.15.29:0/4207501145 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93480ab600 con 0x7f936006a7c0 2024-01-24T13:07:43.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.721+0000 7f935e000640 1 -- 172.21.15.29:0/4207501145 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f93480a7050 con 0x7f936006a7c0 2024-01-24T13:07:43.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.721+0000 7f935e000640 1 -- 172.21.15.29:0/4207501145 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93480ab960 con 0x7f936006a7c0 2024-01-24T13:07:43.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.721+0000 7f9366600640 1 -- 172.21.15.29:0/4207501145 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f936006a7c0 msgr2=0x7f9360158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.721+0000 7f9366600640 1 --2- 172.21.15.29:0/4207501145 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f936006a7c0 0x7f9360158fe0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f93480097c0 tx=0x7f934801c3c0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.721+0000 7f9366600640 1 -- 172.21.15.29:0/4207501145 shutdown_connections 2024-01-24T13:07:43.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.721+0000 7f9366600640 1 --2- 172.21.15.29:0/4207501145 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f936006a7c0 0x7f9360158fe0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.721+0000 7f9366600640 1 -- 172.21.15.29:0/4207501145 >> 172.21.15.29:0/4207501145 conn(0x7f93600b3950 msgr2=0x7f9360069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:43.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.721+0000 7f9366600640 1 -- 172.21.15.29:0/4207501145 shutdown_connections 2024-01-24T13:07:43.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.721+0000 7f9366600640 1 -- 172.21.15.29:0/4207501145 wait complete. 2024-01-24T13:07:43.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.721+0000 7f9366600640 1 Processor -- start 2024-01-24T13:07:43.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f9366600640 1 -- start start 2024-01-24T13:07:43.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f9366600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f936006a3e0 0x7f936014f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f9366600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f936006a7c0 0x7f93601521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f9366600640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9360070240 0x7f936015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f9366600640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9360151dd0 con 0x7f9360070240 2024-01-24T13:07:43.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f9366600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9360151200 con 0x7f936006a3e0 2024-01-24T13:07:43.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f9366600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93601580f0 con 0x7f936006a7c0 2024-01-24T13:07:43.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f935fe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9360070240 0x7f936015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f935fe00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9360070240 0x7f936015b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35070/0 (socket says 172.21.15.29:35070) 2024-01-24T13:07:43.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f935fe00640 1 -- 172.21.15.29:0/2703367619 learned_addr learned my addr 172.21.15.29:0/2703367619 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-24T13:07:43.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f935ea00640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f936006a7c0 0x7f93601521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f935f400640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f936006a3e0 0x7f936014f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f935fe00640 1 -- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f936006a7c0 msgr2=0x7f93601521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f935fe00640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f936006a7c0 0x7f93601521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f935fe00640 1 -- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f936006a3e0 msgr2=0x7f936014f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f935fe00640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f936006a3e0 0x7f936014f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f935fe00640 1 -- 172.21.15.29:0/2703367619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9348009420 con 0x7f9360070240 2024-01-24T13:07:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f935ea00640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f936006a7c0 0x7f93601521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T13:07:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f935fe00640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9360070240 0x7f936015b600 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f935800cad0 tx=0x7f935800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f9357400640 1 -- 172.21.15.29:0/2703367619 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935800ac30 con 0x7f9360070240 2024-01-24T13:07:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f9357400640 1 -- 172.21.15.29:0/2703367619 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f935800ad90 con 0x7f9360070240 2024-01-24T13:07:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f9366600640 1 -- 172.21.15.29:0/2703367619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936015a3e0 con 0x7f9360070240 2024-01-24T13:07:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f9357400640 1 -- 172.21.15.29:0/2703367619 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9358012640 con 0x7f9360070240 2024-01-24T13:07:43.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f9366600640 1 -- 172.21.15.29:0/2703367619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9360151430 con 0x7f9360070240 2024-01-24T13:07:43.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.725+0000 7f9366600640 1 -- 172.21.15.29:0/2703367619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9360151f10 con 0x7f9360070240 2024-01-24T13:07:43.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.729+0000 7f9357400640 1 -- 172.21.15.29:0/2703367619 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9358007070 con 0x7f9360070240 2024-01-24T13:07:43.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.729+0000 7f9357400640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9338065a60 0x7f9338067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T13:07:43.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.729+0000 7f9357400640 1 -- 172.21.15.29:0/2703367619 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9358082f60 con 0x7f9360070240 2024-01-24T13:07:43.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.729+0000 7f935f400640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9338065a60 0x7f9338067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T13:07:43.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.729+0000 7f935f400640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9338065a60 0x7f9338067f20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9350001810 tx=0x7f9350009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T13:07:43.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.733+0000 7f9357400640 1 -- 172.21.15.29:0/2703367619 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9358050af0 con 0x7f9360070240 2024-01-24T13:07:43.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.925+0000 7f9366600640 1 -- 172.21.15.29:0/2703367619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f936004e850 con 0x7f9360070240 2024-01-24T13:07:43.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.929+0000 7f9357400640 1 -- 172.21.15.29:0/2703367619 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f9358017020 con 0x7f9360070240 2024-01-24T13:07:43.928 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-24T13:07:43.928 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/2169087472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2169087472},{"type":"v1","addr":"172.21.15.163:6836","nonce":2169087472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/88874113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":88874113},{"type":"v1","addr":"172.21.15.163:6837","nonce":88874113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6177,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1411376794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1411376794},{"type":"v1","addr":"172.21.15.29:6834","nonce":1411376794}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6639,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3939903670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3939903670},{"type":"v1","addr":"172.21.15.29:6835","nonce":3939903670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[]} 2024-01-24T13:07:43.929 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 28 2024-01-24T13:07:43.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.929+0000 7f9366600640 1 -- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9338065a60 msgr2=0x7f9338067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.929+0000 7f9366600640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9338065a60 0x7f9338067f20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9350001810 tx=0x7f9350009040 comp rx=0 tx=0).stop 2024-01-24T13:07:43.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.929+0000 7f9366600640 1 -- 172.21.15.29:0/2703367619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9360070240 msgr2=0x7f936015b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T13:07:43.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.929+0000 7f9366600640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9360070240 0x7f936015b600 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f935800cad0 tx=0x7f935800cf90 comp rx=0 tx=0).stop 2024-01-24T13:07:43.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.929+0000 7f9366600640 1 -- 172.21.15.29:0/2703367619 shutdown_connections 2024-01-24T13:07:43.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.929+0000 7f9366600640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:6832/26915,v1:172.21.15.163:6833/26915] conn(0x7f9338065a60 0x7f9338067f20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.929+0000 7f9366600640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9360070240 0x7f936015b600 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.929+0000 7f9366600640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f936006a7c0 0x7f93601521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.929+0000 7f9366600640 1 --2- 172.21.15.29:0/2703367619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f936006a3e0 0x7f936014f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T13:07:43.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.929+0000 7f9366600640 1 -- 172.21.15.29:0/2703367619 >> 172.21.15.29:0/2703367619 conn(0x7f93600b3950 msgr2=0x7f9360159500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T13:07:43.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.929+0000 7f9366600640 1 -- 172.21.15.29:0/2703367619 shutdown_connections 2024-01-24T13:07:43.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-24T13:07:43.929+0000 7f9366600640 1 -- 172.21.15.29:0/2703367619 wait complete. 2024-01-24T13:07:43.951 DEBUG:tasks.cephfs.filesystem:already dead... 2024-01-24T13:07:43.951 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-24T13:07:43.951 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-24T13:07:43.951 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:43.965 INFO:tasks.ceph.mds.a:Stopped 2024-01-24T13:07:43.965 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-24T13:07:43.965 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:44.024 INFO:tasks.ceph.mds.c:Stopped 2024-01-24T13:07:44.025 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-24T13:07:44.025 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:44.040 INFO:tasks.ceph.mds.b:Stopped 2024-01-24T13:07:44.041 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-24T13:07:44.041 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:44.096 INFO:tasks.ceph.mds.d:Stopped 2024-01-24T13:07:44.097 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-24T13:07:44.097 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-24T13:07:44.097 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:44.178 INFO:tasks.ceph.osd.0:Stopped 2024-01-24T13:07:44.179 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-24T13:07:44.179 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:44.263 INFO:tasks.ceph.osd.1:Stopped 2024-01-24T13:07:44.264 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-24T13:07:44.264 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:50.235 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-01-24T13:07:50.365 INFO:tasks.ceph.osd.2:Stopped 2024-01-24T13:07:50.366 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-24T13:07:50.366 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:50.434 INFO:tasks.ceph.osd.3:Stopped 2024-01-24T13:07:50.434 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-24T13:07:50.434 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:50.520 INFO:tasks.ceph.osd.4:Stopped 2024-01-24T13:07:50.520 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-24T13:07:50.520 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:50.608 INFO:tasks.ceph.osd.5:Stopped 2024-01-24T13:07:50.609 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-24T13:07:50.609 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:50.687 INFO:tasks.ceph.osd.6:Stopped 2024-01-24T13:07:50.687 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-24T13:07:50.687 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:50.768 INFO:tasks.ceph.osd.7:Stopped 2024-01-24T13:07:50.769 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-24T13:07:50.769 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-24T13:07:50.769 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:50.820 INFO:tasks.ceph.mgr.y:Stopped 2024-01-24T13:07:50.821 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-24T13:07:50.821 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:50.874 INFO:tasks.ceph.mgr.x:Stopped 2024-01-24T13:07:50.874 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-24T13:07:50.875 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-24T13:07:50.875 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:50.893 INFO:tasks.ceph.mon.a:Stopped 2024-01-24T13:07:50.893 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-24T13:07:50.893 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:50.908 INFO:tasks.ceph.mon.b:Stopped 2024-01-24T13:07:50.909 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-24T13:07:50.909 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T13:07:50.966 INFO:tasks.ceph.mon.c:Stopped 2024-01-24T13:07:50.966 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-24T13:07:50.966 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-24T13:07:50.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:07:50.996 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-24T13:07:51.345 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:07:51.346 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-24T13:07:51.575 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:07:51.576 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-24T13:07:51.801 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:07:51.802 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-24T13:07:52.053 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:07:52.053 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-24T13:07:52.363 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:07:52.363 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-24T13:07:52.533 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:07:52.533 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-24T13:07:52.692 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:07:52.693 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-24T13:07:52.850 INFO:tasks.ceph:Archiving mon data... 2024-01-24T13:07:52.852 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785/data/mon.a.tgz 2024-01-24T13:07:52.852 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-01-24T13:07:52.861 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.C9lXGeAJaz 2024-01-24T13:07:52.862 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.C9lXGeAJaz 2024-01-24T13:07:53.002 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.C9lXGeAJaz 2024-01-24T13:07:53.081 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.C9lXGeAJaz is 365KB 2024-01-24T13:07:53.146 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.C9lXGeAJaz 2024-01-24T13:07:53.154 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785/data/mon.b.tgz 2024-01-24T13:07:53.154 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2024-01-24T13:07:53.162 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.VpmPdVFnsN 2024-01-24T13:07:53.163 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.VpmPdVFnsN 2024-01-24T13:07:53.321 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.VpmPdVFnsN 2024-01-24T13:07:53.398 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.VpmPdVFnsN is 480KB 2024-01-24T13:07:53.464 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.VpmPdVFnsN 2024-01-24T13:07:53.473 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785/data/mon.c.tgz 2024-01-24T13:07:53.473 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2024-01-24T13:07:53.521 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.CHkIwrWNM8 2024-01-24T13:07:53.522 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.CHkIwrWNM8 2024-01-24T13:07:53.680 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.CHkIwrWNM8 2024-01-24T13:07:53.753 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.CHkIwrWNM8 is 480KB 2024-01-24T13:07:53.816 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.CHkIwrWNM8 2024-01-24T13:07:53.825 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-24T13:07:53.825 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-24T13:07:53.828 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-24T13:07:53.885 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-01-24T13:07:53.885 DEBUG:teuthology.orchestra.run.smithi029:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-01-24T13:07:53.898 DEBUG:teuthology.orchestra.run.smithi163:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-01-24T13:07:53.937 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-01-24T13:07:53.957 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-01-24T13:07:53.964 INFO:tasks.ceph:Archiving crash dumps... 2024-01-24T13:07:53.966 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785/remote/smithi029/crash 2024-01-24T13:07:53.966 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-24T13:07:54.012 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785/remote/smithi163/crash 2024-01-24T13:07:54.013 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-24T13:07:54.031 INFO:tasks.ceph:Shutting down logrotate 2024-01-24T13:07:54.032 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:07:54.062 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:07:54.123 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-24T13:07:54.144 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-24T13:07:54.162 INFO:tasks.ceph:Compressing logs... 2024-01-24T13:07:54.163 DEBUG:teuthology.orchestra.run.smithi029:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T13:07:54.190 DEBUG:teuthology.orchestra.run.smithi163:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T13:07:55.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-01-24T13:07:58.565 INFO:tasks.ceph:Archiving logs... 2024-01-24T13:07:58.565 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785/remote/smithi029/log 2024-01-24T13:07:58.566 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-24T13:07:59.277 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785/remote/smithi163/log 2024-01-24T13:07:59.278 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-24T13:07:59.688 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-24T13:07:59.697 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-24T13:07:59.697 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-24T13:07:59.701 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-24T13:07:59.780 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-24T13:07:59.789 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-24T13:07:59.789 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T13:07:59.794 DEBUG:teuthology.orchestra.run.smithi163:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T13:07:59.807 INFO:teuthology.orchestra.run.smithi029.stdout: remote refid st t when poll reach delay offset jitter 2024-01-24T13:07:59.807 INFO:teuthology.orchestra.run.smithi029.stdout:============================================================================== 2024-01-24T13:07:59.807 INFO:teuthology.orchestra.run.smithi029.stdout:*hv01.front.sepi 44.4.53.2 2 u 16 64 377 0.085 -0.814 0.688 2024-01-24T13:07:59.807 INFO:teuthology.orchestra.run.smithi029.stdout:+hv02.front.sepi 63.231.80.2 3 u 19 64 377 0.080 -0.185 0.837 2024-01-24T13:07:59.807 INFO:teuthology.orchestra.run.smithi029.stdout:+hv03.front.sepi 74.6.168.72 3 u 25 64 377 0.074 -0.094 0.769 2024-01-24T13:07:59.807 INFO:teuthology.orchestra.run.smithi029.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T13:07:59.810 INFO:teuthology.orchestra.run.smithi163.stdout: remote refid st t when poll reach delay offset jitter 2024-01-24T13:07:59.810 INFO:teuthology.orchestra.run.smithi163.stdout:============================================================================== 2024-01-24T13:07:59.810 INFO:teuthology.orchestra.run.smithi163.stdout:*hv01.front.sepi 44.4.53.2 2 u 16 64 377 0.113 -1.334 0.881 2024-01-24T13:07:59.810 INFO:teuthology.orchestra.run.smithi163.stdout:+hv02.front.sepi 63.231.80.2 3 u 17 64 377 0.136 -0.989 0.846 2024-01-24T13:07:59.810 INFO:teuthology.orchestra.run.smithi163.stdout:+hv03.front.sepi 74.6.168.72 3 u 20 64 377 0.162 -0.740 0.903 2024-01-24T13:07:59.810 INFO:teuthology.orchestra.run.smithi163.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T13:07:59.811 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-24T13:07:59.824 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-24T13:07:59.824 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-24T13:07:59.835 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-24T13:07:59.894 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-24T13:07:59.908 INFO:teuthology.task.internal:Duration was 956.525865 seconds 2024-01-24T13:07:59.909 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-24T13:07:59.923 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-24T13:07:59.923 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-24T13:07:59.927 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-24T13:08:00.049 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-24T13:08:00.049 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2024-01-24T13:08:00.049 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-24T13:08:00.071 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi163.front.sepia.ceph.com 2024-01-24T13:08:00.071 DEBUG:teuthology.orchestra.run.smithi163:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-24T13:08:00.093 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-24T13:08:00.093 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T13:08:00.118 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T13:08:00.175 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-24T13:08:00.176 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-24T13:08:00.203 DEBUG:teuthology.orchestra.run.smithi163:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-24T13:08:00.286 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-24T13:08:00.302 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-24T13:08:00.303 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-24T13:08:00.324 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-24T13:08:00.345 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-24T13:08:00.360 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-24T13:08:00.370 DEBUG:teuthology.orchestra.run.smithi163:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-24T13:08:00.384 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2024-01-24T13:08:00.403 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = core 2024-01-24T13:08:00.420 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-24T13:08:00.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:08:00.450 DEBUG:teuthology.orchestra.run.smithi163:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-24T13:08:00.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T13:08:00.469 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-24T13:08:00.478 INFO:teuthology.task.internal:Transferring archived files... 2024-01-24T13:08:00.479 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785/remote/smithi029 2024-01-24T13:08:00.479 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-24T13:08:00.517 DEBUG:teuthology.misc:Transferring archived files from smithi163:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785/remote/smithi163 2024-01-24T13:08:00.518 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-24T13:08:00.543 INFO:teuthology.task.internal:Removing archive directory... 2024-01-24T13:08:00.543 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-24T13:08:00.558 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-24T13:08:00.590 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-24T13:08:00.600 INFO:teuthology.task.internal:Not uploading archives. 2024-01-24T13:08:00.600 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-24T13:08:00.611 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-24T13:08:00.611 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-24T13:08:00.614 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-24T13:08:00.620 INFO:teuthology.orchestra.run.smithi029.stdout: 658070 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 24 13:08 /home/ubuntu/cephtest 2024-01-24T13:08:00.642 INFO:teuthology.orchestra.run.smithi163.stdout: 658074 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 24 13:08 /home/ubuntu/cephtest 2024-01-24T13:08:00.644 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-24T13:08:00.654 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-24T13:08:00.676 INFO:teuthology.nuke:Checking targets against current locks 2024-01-24T13:08:00.701 DEBUG:teuthology.nuke:shortname: smithi029 2024-01-24T13:08:00.701 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T13:08:00.725 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 12:40:15.863398', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO6qSF79hcu2xwEl93Due8znq/AJy9oP3qGtTolhJtphDQ0WmLH3kKsrCYfv3HMdsM6Lr166rWQocA8uFWgTums='} 2024-01-24T13:08:00.728 DEBUG:teuthology.nuke:shortname: smithi163 2024-01-24T13:08:00.729 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T13:08:00.752 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530785', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 12:40:15.861614', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJtR4eptIOjV9QV7L7cywaJkxEyuolirOzoikyj4ghOQi1VZXdGTHIz3vCc7WT4qH2stJ4NJJ63P7UnilU98kuw='} 2024-01-24T13:08:00.784 INFO:teuthology.orchestra.console.smithi029:Power off 2024-01-24T13:08:00.785 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T13:08:00.810 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2024-01-24T13:08:00.810 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T13:08:00.827 INFO:teuthology.orchestra.console.smithi163:Power off 2024-01-24T13:08:00.827 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T13:08:00.837 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-01-24T13:08:00.849 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2024-01-24T13:08:00.849 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T13:08:00.871 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-01-24T13:08:04.838 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T13:08:04.871 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T13:08:04.950 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-01-24T13:08:04.982 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-01-24T13:08:08.952 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T13:08:08.983 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T13:08:09.063 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-01-24T13:08:09.096 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-01-24T13:08:09.197 INFO:teuthology.orchestra.console.smithi163:Power off completed 2024-01-24T13:08:13.067 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T13:08:13.177 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-01-24T13:08:13.278 INFO:teuthology.orchestra.console.smithi029:Power off completed 2024-01-24T13:08:13.383 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} duration: 956.5258650779724 failure_reason: 'Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm)' flavor: default mon.a-kernel-sha1: f2d3460408951339ac0933340ad449487c9efddc mon.b-kernel-sha1: f2d3460408951339ac0933340ad449487c9efddc owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9779b32c64eb45a692e5b25c06336110 status: fail success: false 2024-01-24T13:08:13.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T13:08:13.472 INFO:teuthology.run:FAIL